Personal Video Database 1.0.2.7 MOD

[Ivek23]

The IMDB_[EN][HTTPS] script no longer downloads certain information for movies because there have been major changes in the source code of certain web pages. The script only downloads information from the basic Movies page. It currently also downloads information from the Full Cast & Crew, Awards and Plot Keywords web pages. Here, too, there will be changes in the source code sometime by the end of February. Currently, it still downloads movies information from the Reference View website for movies, but it's only a matter of time how long this will be, because the Reference View website is supposed to be discontinued in the near future, unfortunately for us of course.

There will be many problems for corrections in the IMDB_[EN][HTTPS] script, it is also possible that certain web pages and the transfer of information will no longer be possible in the future.

[Ivek23]

Here is the current IMDB_[EN][HTTPS]_TEST_1b script that is currently working. However, there is a possibility that tomorrow or the day after tomorrow some things may not be transferred by the script, because parts of the code in the source code of the IMDb websites change very often.

However, there have been major changes in the source code of the IMDb websites, and in some places it is possible to download only 6 items for a certain area. Such an example is primarily Also Known As (AKA).

Below are links to specific IMDb web pages with such examples.

https://www.imdb.com/title/tt0147800/releaseinfo/

https://www.imdb.com/title/tt0147800/companycredits/

https://www.imdb.com/title/tt0147800/movieconnections/

Most such IMDb websites will no longer be included in IMDB_[EN][HTTPS] script updates in the future. Individual specific IMDB_[EN][HTTPS] scripts will also no longer be updated. For example, the IMDB_[EN][HTTPS]_(Connections) script will not be updated in the future. Another similar IMDb script may meet the same fate.


There are some new features in the IMDB_[EN][HTTPS]_TEST_1b script.

Function ParsePage_IMDBMovieAKA transfers only 6 records. If you don't want this, then you can change it manually in the Retreive Data Config area.

Code: [Select]

  GET_FULL_AKA  = True ;  //Download 'Also Known As' provider page for retreive the info. Otherwise only the info of the principal movie page.
  //GET_FULL_AKA  = False ;  //Download 'Also Known As' provider page for retreive the info. Otherwise only the info of the principal movie page.
Function ParsePage_IMDBMoviePLOTSUMMARY is now primarily blocked and does not transfer any information because many times the Synopsis field is empty. If you don't want this, then you can change it manually in the Retreive Data Config area. You also have the option to have the GET_FULL_PLOT_SYNOPSIS function transfer or not transfer the Synopsis info and Custom IMDB Synopsis memo box. There is also a Custom Plot Summary memo box.

Code: [Select]

//  GET_FULL_PLOTSUMMARY  = True ;  //Download Plot provider page for retreive the Summaries info. Otherwise only the info of the principal movie page 
  GET_FULL_PLOTSUMMARY  = False ;  //Download Plot provider page for retreive the Summaries info. Otherwise only the info of the principal movie page   
  GET_FULL_PLOT_SYNOPSIS  = True ;  //Set to True if to wanted to Download full synopsis for Plot provider page for retreive the Synopsis info in Custom IMDB Synopsis box.
//  GET_FULL_PLOT_SYNOPSIS  = False ;  //Set to True if to wanted to Download full synopsis for Plot provider page for retreive the Synopsis info in Custom IMDB Synopsis box.
  GET_FULL_PLOT  = True ;  //Set to True if to wanted to Download full synopsis for Plot provider page for retreive the Plot info in Custom Plot Summary box.
//  GET_FULL_PLOT  = False ;  //Set to True if to wanted to Download full synopsis for Plot provider page for retreive the Plot info in Custom Plot Summary box.

IMDB_[EN][HTTPS]_TEST_1b script is attached.

[Ivek23]

IMDB_[EN][HTTPS]_TEST_1b script some new custom fields.

Some IMDb url links can now be found in the existing IMDb Movie Url memo box.

Some IMDb url links can now be found in the new Custom IMDbExternalSitesUrl memo box.

You also have IMDb url links to search results in the new Custom IMDbSearchUrl memo box.

You also have IMDb url links that are stored in the WaybackArchive and can be found in the new Custom WaybackArchive IMDb URLs memo box.

[Ivek23]

The IMDB_[EN][HTTPS] script no longer downloads certain information for movies because there have been major changes in the source code of certain web pages. The script only downloads information from the basic Movies page. It currently also downloads information from the Full Cast & Crew, Awards and Plot Keywords web pages. Here, too, there will be changes in the source code sometime by the end of February. Currently, it still downloads movies information from the Reference View website for movies, but it's only a matter of time how long this will be, because the Reference View website is supposed to be discontinued in the near future, unfortunately for us of course.

There will be many problems for corrections in the IMDB_[EN][HTTPS] script, it is also possible that certain web pages and the transfer of information will no longer be possible in the future.

Even from the pages listed above [EN][HTTPS] the script practically does not transfer any information anymore, except only downloads information from the basic Movies page. So there won't be any new IMDB_[EN][HTTPS] script updates anymore because it is no longer possible to download many full downloads of information. The new Imdb website design does not allow this anymore.

[Ivek23]

In the IMDB_[EN][HTTPS] script, the IMDB search results no longer work due to a change in the source code on these pages.

[Ivek23]

Here is the url link to the new AllMovie.com HTTPS script beta for PVD MOD versions.

http://www.videodb.info/forum_en/index.php/topic,4109.msg21882.html#msg21882

[Ivek23]

Here is the new IMDB_[EN][HTTPS]_TEST_2b script which currently transmits only partially or fully the information for a specific movie.

Partial download Also Known As info, full download info is for PlotKeywords, PlotSummary and Technical specifications. For the time being, the information for the Cast&Crew, ParentsGuide and Reference View websites is still in progress. The search for results does not work anymore (more information about this can be found here). Function ParsePage_BingSearch (changes in the source code of the Bing page) and also Function ParsePage_IMDBMovieAWARDS have been removed from the script, but now that the source code of the Awards website has been changed, it is impossible to edit or correct the code, and in addition, there is a limitation for a certain Event (on example: Academy Awards, USA) it is possible to see only five award categories for one event.

You now have a special script available to search for results and you can find them added below. 

Imdb.com[EN][HTTPS]_ b+ script is now called Imdb.com[EN][HTTPS]_Search script which would work in all PVD versions of the program. You can also add this long text IUpdated01 custom field to the database

Imdb.com[EN][HTTPS]_Search script attached.

The Imdb.com[EN][HTTPS]_Search_adv script is made in the same way as the Imdb.com[EN][HTTPS]_Search script but with the difference that the Advanced search list of search results is displayed.

You can use it if the Imdb.com[EN][HTTPS]_Search script may not show you results or may not add the correct url in case there are multiple movie titles of the same title.

The Imdb.com[EN][HTTPS]_Search_adv script also displays more hits in the list of search results.

The exact year of release of the movies is also correctly transferred here. Works in all PVD versions.

Imdb.com[EN][HTTPS]_Search_adv script attached.

IMDB_[EN][HTTPS]_TEST_2b script attached.
Imdb.com[EN][HTTPS]_Search script attached.
Imdb.com[EN][HTTPS]_Search_adv script attached.

[afrocuban]

For me, _2b works as advertised so far. Thank you so much Ivek.

Does anyone know which custom field states by which script the record is last updated? I absolutely forgot. Was it IUpdated?

[Ivek23]

For me, _2b works as advertised so far. Thank you so much Ivek.

Does anyone know which custom field states by which script the record is last updated? I absolutely forgot. Was it IUpdated?

Thanks.

With the IUpdated custom long text field, you will see exactly when and with which script the most recent record update was made.

[afrocuban]

Great, thank you. I want to track records in order to be updated with _2b!

[Ivek23]

Here is the new test IMDB_People_[EN][HTTPS]_TEST_1 script, which is updated to the new look of the Imdb People web pages. The same as written below is removed from the script.

The search for results does not work anymore (more information about this can be found here). Function ParsePage_BingSearch (changes in the source code of the Bing page) and also Function ParsePage_IMDBMovieAWARDS have been removed from the script, but now that the source code of the Awards website has been changed, it is impossible to edit or correct the code, and in addition, there is a limitation for a certain Event (on example: Academy Awards, USA) it is possible to see only five award categories for one event.

IMDB_People_[EN][HTTPS]_TEST_1 script attached.

[afrocuban]

Wow, that was u surprise! Thank you so much, but the script doesn't import anything for me, although people url is provided.
Example http://imdb.com/name/nm0000080

[Ivek23]

Wow, that was u surprise! Thank you so much, but the script doesn't import anything for me, although people url is provided.
Example http://imdb.com/name/nm0000080

Logically, it doesn't transfer anything to you, because you don't have the field for transferring information marked so that it would be overwritten, because for me, if the nose is marked for overwriting, it doesn't overwrite it. It only overwrites them if the fields were previously empty.

[afrocuban]

Of course. I tried everything. Please check screenshot attached.

[Ivek23]

Of course. I tried everything. Please check screenshot attached.

What do you find in the log file?

Use this attached portable.bat file to then see the transfer data in the log file.

The IMDB_People_[EN][HTTPS]_TEST_1 script only works with the url address because the search results do not work.

Then you might have the use of a proxy server checked in the proxy settings. Another possibility is that you have a blocked PVD or blocked access to Imdb websites. Sorry, but the problem is definitely on your side, because I haven't had any problems with the operation of different PVD versions for quite some time or for several years.

[afrocuban]

Thanks for response:
Strange things are happening when debugging:

(12/22/2023 8:09:25 PM) Compiling script: IMDB_People_[EN][HTTPS]_TEST_1.psf
(12/22/2023 8:09:25 PM) Script compiled successfully: IMDB_People_[EN][HTTPS]_TEST_1.psf
[Hint] (467:7): Variable 'CURPOS' never used
[Hint] (468:7): Variable 'ITEMVALUE' never used
[Hint] (468:7): Variable 'IMAGEFILE' never used
[Hint] (469:7): Variable 'NAME' never used
[Hint] (469:7): Variable 'PREVIEWURL' never used
[Warning] (621:62): "True and" is not needed
[Hint] (557:5): Variable 'INDEX' never used
[Hint] (560:2): Variable 'TITLE' never used
[Hint] (560:2): Variable 'ROLE' never used
[Hint] (560:2): Variable 'YEAR' never used
[Hint] (560:2): Variable 'MOVIEURL' never used
[Hint] (952:5): Variable 'DEBUG_POS1' never used
[Hint] (954:5): Variable 'ITEMVALUE10' never used
[Hint] (954:5): Variable 'ITEMVALUE11' never used
[Hint] (955:2): Variable 'ITEMLIST1' never used
[Hint] (1039:5): Variable 'ITEMVALUE' never used
[Hint] (1040:5): Variable 'NAME' never used
[Hint] (1040:5): Variable 'PERSONURL' never used
[Hint] (1042:2): Variable 'MOVIESID' never used
[Hint] (1043:5): Variable 'ITEMVALUE14' never used
[Hint] (1044:5): Variable 'FULLINFO' never used
[Hint] (1044:5): Variable 'DIRECTORS' never used
[Hint] (1044:5): Variable 'WRITERS' never used
[Hint] (1044:5): Variable 'COMPOSERS' never used
[Hint] (1044:5): Variable 'PRODUCERS' never used
[Warning] (1501:54): "True and" is not needed
[Warning] (1501:26): "True and" is not needed
(12/22/2023 8:09:25 PM) Executing script binary
(12/22/2023 8:09:25 PM) Logging in...
(12/22/2023 8:09:25 PM) Person -> LoadStatic -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadMultivalues -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadFilms -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadAwards -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadImages -> 0ms
(12/22/2023 8:09:25 PM) Function GetDownloadURL BEGIN======================|
(12/22/2023 8:09:25 PM) Global Var-Mode|0|
(12/22/2023 8:09:25 PM) Global Var-DownloadURL||
(12/22/2023 8:09:25 PM) Person -> LoadStatic -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadMultivalues -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadFilms -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadAwards -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadImages -> 0ms
(12/22/2023 8:09:25 PM) Stored URL is:http://imdb.com/name/nm0000080/||
(12/22/2023 8:09:25 PM) Person -> LoadStatic -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadMultivalues -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadFilms -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadAwards -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadImages -> 0ms
(12/22/2023 8:09:25 PM)       No IMDB URL.
(12/22/2023 8:09:25 PM) Function GetDownloadURL END====================== with Mode=0 Result=C:\PersonalVideoDB\portable.bat|
(12/22/2023 8:09:25 PM) Searching person information for: Orson Welles
(12/22/2023 8:09:25 PM) Function ParsePage BEGIN======================|
(12/22/2023 8:09:25 PM) Global Var-Mode|0|
(12/22/2023 8:09:25 PM) Global Var-DownloadURL||
(12/22/2023 8:09:25 PM) Local Var-URL||
(12/22/2023 8:09:25 PM) Person -> LoadStatic -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadMultivalues -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadFilms -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadAwards -> 16ms
(12/22/2023 8:09:25 PM) Person -> LoadImages -> 0ms
(12/22/2023 8:09:25 PM)   ParsePage smSearch|0|. Searching DownloadURL for PersonName |Orson Welles|
(12/22/2023 8:09:25 PM)       Searching in Provider:|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm||
(12/22/2023 8:09:25 PM)       Function DownloadPage BEGIN======================|
(12/22/2023 8:09:25 PM)       Global Var-DownloadURL|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm|
(12/22/2023 8:09:25 PM)             Local Var-URL|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm|
(12/22/2023 8:09:25 PM)             Waiting 1s for delete:C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm
(12/22/2023 8:09:26 PM)             Download with PVdBDownPage in file:|C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm the information of:|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm||
(12/22/2023 8:09:26 PM)             Waiting 2s for exists of:C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm
(12/22/2023 8:09:28 PM)             Waiting 2s for exists of:C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm
(12/22/2023 8:09:30 PM)             Now present complete page file: C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm
(12/22/2023 8:09:30 PM)       Function DownloadPage END======================|
(12/22/2023 8:09:30 PM) Function ParsePage_IMDBSearchName BEGIN======================|
(12/22/2023 8:09:30 PM) Global Var-Mode|0|
(12/22/2023 8:09:30 PM) Global Var-DownloadURL|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm|
(12/22/2023 8:09:31 PM)         No People results
(12/22/2023 8:09:31 PM) Function ParsePage_IMDBSearchName END=====================||
(12/22/2023 8:09:31 PM) Function ParsePage smSearch-prError END======================|

[Ivek23]

Change this part of the code, maybe the script will work with the url, but the search results will still not work.

Code: [Select]

  SEARCH_ENGINE  = True ;  //If there isn't provider search results, try with Bing search engine
  //SEARCH_ENGINE  = False ;  //If there isn't provider search results, try with Bing search engine
But now I know what's wrong and why can't stand anything. You are missing http://www.imdb.com/name/nm0000080/ in the url address. I will fix this in the new script version

[Ivek23]

Use SQL script if you are missing this part in the url: www.

More at the link below.

http://www.videodb.info/forum_en/index.php/topic,4087.msg21968.html#msg21968

[afrocuban]

Use SQL script if you are missing this part in the url: www.

More at the link below.

http://www.videodb.info/forum_en/index.php/topic,4087.msg21968.html#msg21968

It updates links with http://www.videodb.info/forum_en/index.php/topic,4087.msg21971.html#msg21971
but still

Change this part of the code, maybe the script will work with the url, but the search results will still not work.

Code: [Select]

  SEARCH_ENGINE  = True ;  //If there isn't provider search results, try with Bing search engine
  //SEARCH_ENGINE  = False ;  //If there isn't provider search results, try with Bing search engine
But now I know what's wrong and why can't stand anything. You are missing http://www.imdb.com/name/nm0000080/ in the url address. I will fix this in the new script version

gives nothing, although now link is "proper", with www. Same log as above, now with Stored URL is:https://www.imdb.com/name/nm0000080/||. To remind, _2b works flawlessly with url provided.

[afrocuban]

Update:

it works with only http and not https url?! How come _2b works with https in the url?