Recent Posts

Pages: 1 ... 4 5 6 7 8 [9] 10
81
PVD Python Scripts / Re: Chrome Selenium v4 of Movie and People scripts progress
« Last post by afrocuban on February 15, 2025, 02:30:05 pm »
News is that I adapted ParsePage_IMDBMovieCREDIT to parse either from reference or fullcredits page based on a new script option:
Quote
  GET_FULL_CREDIT_FROM_REFERENCE      =   True;   //Instead from FullCredits.htm page with Function ParsePage_IMDBMovieCREDIT, download full credits from Reference.htm with  Function ParsePage_IMDBMovieCREDIT.


This way we optimize the time and load, by not downloading and parsing fullcredits page. But if we set the option to "False", then it will download fullcredits page, and with the same Function ParsePage_IMDBMovieCREDIT, without any code changes, it will parse fullcredits page and get the exact same result as when this function parses reference.htm page.


82
PVD Python Scripts / Re: Chrome Selenium v4 of Movie and People scripts progress
« Last post by afrocuban on February 15, 2025, 01:10:33 pm »
I am preparing 3 scripts: IMDb Movie, People and FilmAffinity that I will publish all together, so people could test them all. I don't want to publish them separately, because I can't work on them, and to make updates on published scripts in parallel. I guess I am a week from the publishing. Thanks for patience, but Movie script now has almost 7000 lines...
83
PVD Python Scripts / Re: IMDB_[EN][HTTPS]_TEST_Aka (+Selenium) script
« Last post by Pacifist on February 15, 2025, 08:44:00 am »
this is too complicated instruction for a person who is not a programmer  ??? :'( :'( :'( :'(
Is it possible to create a bat-file into which I could insert the necessary paths myself?
84
PVD Python Scripts / Re: Chrome Selenium v4 of Movie and People scripts progress
« Last post by Pacifist on February 15, 2025, 08:17:35 am »
where to download new script IMDB Movie Selenium?  ???
85
PVD Python Scripts / Re: Chrome Selenium v4 of Movie and People scripts progress
« Last post by afrocuban on February 10, 2025, 03:22:50 am »
Function ParsePage_IMDBMovieREFERENCE gives me a lot of headache because of a huge redudancy and overlapping potential with ParsePage_IMDBMovieBASE and ParsePage_IMDBMovieCREDIT, which is not good for time optimization. But it's a great resource, so I am at the moment occupied with reorganization of Base and Credit not to parse when reference page is downloaded, while adding everything from both to parse from reference page that is redudant for base and credit. Will check for redudancy for other pages later too.
86
PVD Python Scripts / Re: Downloading with Selenium experiences and tips
« Last post by afrocuban on February 08, 2025, 04:07:38 am »

I couldn't seem to download .htm and get "Storyline" section from the main page. Nothing helped that I tried. Even .mhtml couldn't catch it.


Then I tried it in a non-headless mode and succeeded. What was different? Scrolling! But not to the bottom of the page, but specifically to the storyline section:


Code: [Select]
                # Scroll down to the Storyline section
                storyline_section = driver.find_element(By.XPATH, "//*[@id='__next']/main/section[1]/section[1]/section[6]")
                driver.execute_script("arguments[0].scrollIntoView();", storyline_section)
                logging.info("Scrolled to the Storyline section.")


                # Adding a delay to ensure content loads
                time.sleep(3)

Adjusting the time helps depending of your connection and how old your computer is.

Now this might help to avoid downloading and parsing reference page... Yet to analyze.

But the point of the topic was to emphasize another way of getting dynamic conent of the page... Share your tips here too...
87
PVD Python Scripts / Downloading with Selenium experiences and tips
« Last post by afrocuban on February 08, 2025, 03:58:26 am »
Share your tips here...
88
PVD Python Scripts / Re: Chrome Selenium v4 of Movie and People scripts progress
« Last post by afrocuban on February 06, 2025, 08:56:58 pm »
New advances in the first post as of February 6th 2025.
89
PVD Python Scripts / Re: New IMDb People v4 Script Discussion
« Last post by Ivek23 on February 02, 2025, 01:18:57 pm »
Quote from: Ivek23 on January 31, 2025, 07:20:50 am
Quote from: afrocuban on January 23, 2025, 08:18:07 pm
Until then, I see no reason not to do as all others: I will follow Microsoft and I will use vbs script.

For users of Firefox and other browsers, this may be a problem when using the vbs script to run the new Imdb.psf scripts.
Quote from: afrocuban on February 01, 2025, 07:50:45 pm
Oh, good to know, thanks! Does vbs script used only to delete tmp files affect chosen browser? Popups we had so far were happening only while cmd.exe were trying to delete downpage-UTF8_NO_BOM.htm, they had nothing to do with downloading it, so that is why I'm confused what I'm missing.

We'll see what actually happens when the new Imdb.psf scripts are available to test. Then I'll see what happens when I test them by opening the firefox browser.
90
PVD Python Scripts / Re: Chrome Selenium v4 of Movie and People scripts progress
« Last post by afrocuban on February 01, 2025, 07:52:08 pm »
New advances in the first post on February 1st 2025.
Pages: 1 ... 4 5 6 7 8 [9] 10