Author Topic: v4 of Movie and People scripts progress  (Read 35 times)

0 Members and 1 Guest are viewing this topic.

Offline afrocuban

  • Moderator
  • *****
  • Posts: 586
    • View Profile
v4 of Movie and People scripts progress
« on: January 21, 2025, 02:47:47 am »
This is temp topic so you could track where am I at the moment with scripts.
Most probably I will keep only this message and modify it with most recent updates.


IMDb People script:
CHANGE LOG :

            V 4.0.0.1 (23/01/2025) afrocuban:
         - Full and complete transtion to Selenium. No more instances or references to PVdBDownPage. Huge thanks to VVVEasy and Ivek to maintain decade long option to keep PVD alive with it.
         - Search function brought back to the script with thumbnails in the search window.
         - Full implementation of PvdConfigOptions. Extremely important for optimization and especially useful when refreshing only certain set of data
         - Job Title, Career and other personal data now moved from comment to bio field.
         - Starting positions provided for all the fileds in section "Field Overwrite Options position in pvdconf.ini".
         - No more pop-up windows stealing focus! In earlier versions, the downpage-UTF8_NO_BOM.htm file was repeatedly downloaded and deleted to parse different pages. Each time this occurred, a pop-up window would steal the focus. Thanks to a different approach in this script, which now downloads separate pages in parallel using Selenium, as well as the special PurgeTmpFiles procedure and vbs script instead of cmd.exe, this focus-stealing issue is now resolved.
TO DO:

SCRIPT COMPLETE


IMDb Movie script:
CHANGE LOG :

            V 4.0.0.1 (18/01/2025) afrocuban:
         - Transition to Selenium started.
         - Various DownloadPageXXX functions for each page to be downloaded constructed.
         - ParsePage function adapted accordingly.
         - DownloadPage and DownloadImage functions set up for Selenium scripts.
         - ParsePage_IMDBSearchTitle function fully transitioned to Selenium which means that
         - Search function is brought back to the script with thumbnails in the search window.
         - Starting positions provided for all the fileds in section "Field Overwrite Options position in pvdconf.ini".
         - No more pop-up windows stealing focus! In earlier versions, the downpage-UTF8_NO_BOM.htm file was repeatedly downloaded and deleted to parse different pages. Each time this occurred, a pop-up window would steal the focus. Thanks to a different approach in this script, which now downloads separate pages in parallel using Selenium, as well as the special PurgeTmpFiles procedure and vbs script instead cmd.exe, this focus-stealing issue is now resolved.
TO DO:
- A lot. In short, to redesign existing parsing logic because I intend to download a lot of pages to make a space for aditional custom fields and more robust system easier to update in the future when html layout changes over time.

IMDb Series Script:
Nothing yet. When I finish movie and people scripts, I will check for and assess a possibilty to merge it with episodes script.


IMDb Episodes Script:
Nothing yet. When I finish movie and people scripts, I will check for and assess a possibilty to merge it with series script.


FilmAffinity Script:
I will strip the version down to v4, and for now for testing purposes I have successfully transitioned only DownloadImage (poster) to Selenium. The plan is to fully transition it to Selenium too, but since it works perfectly at the moment, it is not priority. The transition should be fast, though, because most probably it is only needed to set Selenium scripts and switch functions to them (there are not as many functions for FA as fro IMDb scripts). Trailer page is intended to be added too.

Selenium Scripts:
All set for People script.

Download base page and additional pages scripts set for Movie script.
Search script set for Movie, People and FilmAffinity script.
Download image script set for Movie, People and FilmAffinity script.
TO DO:
- To set download base page and additional pages scripts for FilmAffinity, Series and Episodes script.
- To adapt Search script for Series and Episodes.

OTHER:
- vbs script set to use instead of cmd.exe in order to avoid annoying pop-up windows stealing focus.

WISHFULL THINKING:
- Bringing back Allmovie and Rottentomatoes scripts too.
« Last Edit: January 23, 2025, 01:52:55 am by afrocuban »

Offline afrocuban

  • Moderator
  • *****
  • Posts: 586
    • View Profile
Re: v4 of Movie and People scripts progress
« Reply #1 on: January 23, 2025, 01:56:13 am »
People Script Complete.

 

anything