v4 of Movie and People scripts progress

[afrocuban]

This is temp topic so you could track where am I at the moment with scripts.
Most probably I will keep only this message and modify it with most recent updates.


IMDb People script:
CHANGE LOG :

            V 4.0.0.1 (23/01/2025) afrocuban:
         - Full and complete transtion to Selenium. No more instances or references to PVdBDownPage. Huge thanks to VVVEasy and Ivek to maintain decade long option to keep PVD alive with it.
         - Search function brought back to the script with thumbnails in the search window.
         - Full implementation of PvdConfigOptions. Extremely important for optimization and especially useful when refreshing only certain set of data
         - Job Title, Career and other personal data now moved from comment to bio field.
         - Starting positions provided for all the fileds in section "Field Overwrite Options position in pvdconf.ini".
         - No more pop-up windows stealing focus! In earlier versions, the downpage-UTF8_NO_BOM.htm file was repeatedly downloaded and deleted to parse different pages. Each time this occurred, a pop-up window would steal the focus. Thanks to a different approach in this script, which now downloads separate pages in parallel using Selenium, as well as the special PurgeTmpFiles procedure and vbs script instead of cmd.exe, this focus-stealing issue is now resolved.
TO DO:
SCRIPT COMPLETE
Script and instructions available in a package here.


IMDb Movie script:
CHANGE LOG :

            V 4.0.0.1 (18/01/2025) afrocuban:
         - Transition to Selenium started.
         - Various DownloadPageXXX functions for each page to be downloaded constructed.
         - ParsePage function adapted accordingly.
         - DownloadPage and DownloadImage functions set up for Selenium scripts.
         - ParsePage_IMDBSearchTitle function fully transitioned to Selenium which means that
         - Search function is brought back to the script with thumbnails in the search window.
         - Starting positions provided for all the fileds in section "Field Overwrite Options position in pvdconf.ini".
         - No more pop-up windows stealing focus! In earlier versions, the downpage-UTF8_NO_BOM.htm file was repeatedly downloaded and deleted to parse different pages. Each time this occurred, a pop-up window would steal the focus. Thanks to a different approach in this script, which now downloads separate pages in parallel using Selenium, as well as the special PurgeTmpFiles procedure and vbs script instead cmd.exe, this focus-stealing issue is now resolved.
---------------------------------
February as of 1st 2025 news:
----------------------------------
- Script fully transitioned to Selenium.
- Script Options, Script Data and Global Vars upgraded.
- New GetPvdConfigOptions Function introduced, so now
- Whole script successfully set to rely on PVDConfigOptions.
- GetDownloadURL Function completely set and functional.
- DownloadPage Function completely set and functional.
- DownloadImage Function completely set and functional.
- ParsePage_IMDBSearchTitle Function completely set and functional.
- ParsePage_IMDBMovieBASE Function completely set and functional.
- ParsePage_IMDBMovieAWARDS Function completely set and functional. (check the screenshot here)
- ParsePage_IMDBMoviePLOTSUMMARY Function completely set and functional.
- ParsePage Function completely set and functional.


---------------------------------
February as of 6th 2025 news:
----------------------------------
- ParsePage_IMDBMovieCREDIT Function redesigned and completely set and functional.
- ParsePage_IMDBMovieAKA Function completely set and functional.
- ParsePage_IMDBMovieCONNECTIONS Function brought back to the script with additional connection type not existed in the script so far (check the screenshot here)


---------------------------------
February as of 16th 2025 news:
----------------------------------
SCRIPT BASICALLY COMPLETED

---------------------------------
March as of 13th 2025 news:
----------------------------------
SCRIPT COMPLETE
Script and instructions available in a package here.

IMDb Series Script:
Nothing yet. When I finish movie and people scripts, I will check for and assess a possibilty to merge it with episodes script.

IMDb Episodes Script:
Nothing yet. When I finish movie and people scripts, I will check for and assess a possibilty to merge it with series script.

FilmAffinity Script:
I will strip the version down to v4, and for now for testing purposes I have successfully transitioned only DownloadImage (poster) to Selenium. The plan is to fully transition it to Selenium too, but since it works perfectly at the moment, it is not priority. The transition should be fast, though, because most probably it is only needed to set Selenium scripts and switch functions to them (there are not as many functions for FA as fro IMDb scripts). Trailer page is intended to be added too.
TO DO:
SCRIPT COMPLETE
Script and instructions available in a package here.

Selenium Scripts:
Single Download base page set for IMDb Movie, People and FilmAffinity Movie. ("3 in 1")
Single Search script set for IMDb Movie, People and FilmAffinity Movie. ("3 in 1")
Single Download image script set for IMDb Movie, People and FilmAffinity Movie. ("3 in 1")
Single Download additional pages scripts set for IMDb Movie and FilmAffinity Movie. ("2 in 1")
Single Download additional pages scripts set for IMDb People.
Scripts and instructions available in a package here.


TO DO:
- To set download base page and additional pages scripts for Series and Episodes script.
- To adapt Search script for Series and Episodes.

OTHER:
- vbs script set to use instead of cmd.exe in order to avoid annoying pop-up windows stealing focus.
- SCRIPTS CONFIGURATOR completely rewritten from the scratch (yes, I had to learn about ahk, too ) so now we have resizable window with scrollbars with all the options I could think of included.
Scripts, configurator exe and source code, screenshots and instructions available in a package here.

WISHFULL THINKING:
- Bringing back Allmovie and Rottentomatoes scripts too.

[afrocuban]

People Script Complete.

[afrocuban]

New advances in the first post on February 1st 2025.

[afrocuban]

New advances in the first post as of February 6th 2025.

[afrocuban]

Function ParsePage_IMDBMovieREFERENCE gives me a lot of headache because of a huge redudancy and overlapping potential with ParsePage_IMDBMovieBASE and ParsePage_IMDBMovieCREDIT, which is not good for time optimization. But it's a great resource, so I am at the moment occupied with reorganization of Base and Credit not to parse when reference page is downloaded, while adding everything from both to parse from reference page that is redudant for base and credit. Will check for redudancy for other pages later too.

[Pacifist]

where to download new script IMDB Movie Selenium? 

[afrocuban]

I am preparing 3 scripts: IMDb Movie, People and FilmAffinity that I will publish all together, so people could test them all. I don't want to publish them separately, because I can't work on them, and to make updates on published scripts in parallel. I guess I am a week from the publishing. Thanks for patience, but Movie script now has almost 7000 lines...

[afrocuban]

News is that I adapted ParsePage_IMDBMovieCREDIT to parse either from reference or fullcredits page based on a new script option:

  GET_FULL_CREDIT_FROM_REFERENCE      =   True;   //Instead from FullCredits.htm page with Function ParsePage_IMDBMovieCREDIT, download full credits from Reference.htm with  Function ParsePage_IMDBMovieCREDIT.

This way we optimize the time and load, by not downloading and parsing fullcredits page. But if we set the option to "False", then it will download fullcredits page, and with the same Function ParsePage_IMDBMovieCREDIT, without any code changes, it will parse fullcredits page and get the exact same result as when this function parses reference.htm page.

[afrocuban]

New advances in the first post as of  February 16th 2025.

[afrocuban]

As of March 13, 2025 Selenium IMDb Movie, People and FilmAffinity Movie scripts, vbs script and Scripts Configurator for them completed. Read the first message about the details as well as how and where to get them.