Author Topic: Personal Video Database 1.0.2.7 MOD  (Read 263960 times)

0 Members and 2 Guests are viewing this topic.

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #340 on: January 15, 2023, 09:20:36 am »
Here are IMDB_[EN][HTTPS]_Search script, which searches for movie results for feature, tv movie, video, and IMDB_[EN][HTTPS]_Search a script, which, in addition to the above, also finds results for series. Scripts download some basic information for movies or series. 

There is also an Imdb_[HTTPS]_Bing_Search script to find results using Bing search and display up to 50 hits. If there is already a url link, the script will search again and display the search list for this movies or series. The Imdb_[HTTPS]_Bing_Search script only works in PVD MOD versions with the help of the curl program, otherwise it is currently not possible to edit the script and to download the search results with Bing Search.

Scripts is attached.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #341 on: February 09, 2023, 08:38:00 am »
The IMDB_[EN][HTTPS] script no longer downloads certain information for movies because there have been major changes in the source code of certain web pages. The script only downloads information from the basic Movies page. It currently also downloads information from the Full Cast & Crew, Awards and Plot Keywords web pages. Here, too, there will be changes in the source code sometime by the end of February. Currently, it still downloads movies information from the Reference View website for movies, but it's only a matter of time how long this will be, because the Reference View website is supposed to be discontinued in the near future, unfortunately for us of course.

There will be many problems for corrections in the IMDB_[EN][HTTPS] script, it is also possible that certain web pages and the transfer of information will no longer be possible in the future.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #342 on: March 22, 2023, 07:41:07 pm »
Here is the current IMDB_[EN][HTTPS]_TEST_1b script that is currently working. However, there is a possibility that tomorrow or the day after tomorrow some things may not be transferred by the script, because parts of the code in the source code of the IMDb websites change very often.

However, there have been major changes in the source code of the IMDb websites, and in some places it is possible to download only 6 items for a certain area. Such an example is primarily Also Known As (AKA).

Below are links to specific IMDb web pages with such examples.

https://www.imdb.com/title/tt0147800/releaseinfo/

https://www.imdb.com/title/tt0147800/companycredits/

https://www.imdb.com/title/tt0147800/movieconnections/


Most such IMDb websites will no longer be included in IMDB_[EN][HTTPS] script updates in the future. Individual specific IMDB_[EN][HTTPS] scripts will also no longer be updated. For example, the IMDB_[EN][HTTPS]_(Connections) script will not be updated in the future. Another similar IMDb script may meet the same fate.



There are some new features in the IMDB_[EN][HTTPS]_TEST_1b script.

Function ParsePage_IMDBMovieAKA transfers only 6 records. If you don't want this, then you can change it manually in the Retreive Data Config area.
Code: [Select]
  GET_FULL_AKA  = True ;  //Download 'Also Known As' provider page for retreive the info. Otherwise only the info of the principal movie page.
  //GET_FULL_AKA  = False ;  //Download 'Also Known As' provider page for retreive the info. Otherwise only the info of the principal movie page.

Function ParsePage_IMDBMoviePLOTSUMMARY is now primarily blocked and does not transfer any information because many times the Synopsis field is empty. If you don't want this, then you can change it manually in the Retreive Data Config area. You also have the option to have the GET_FULL_PLOT_SYNOPSIS function transfer or not transfer the Synopsis info and Custom IMDB Synopsis memo box. There is also a Custom Plot Summary memo box.
Code: [Select]
//  GET_FULL_PLOTSUMMARY  = True ;  //Download Plot provider page for retreive the Summaries info. Otherwise only the info of the principal movie page 
  GET_FULL_PLOTSUMMARY  = False ;  //Download Plot provider page for retreive the Summaries info. Otherwise only the info of the principal movie page   
  GET_FULL_PLOT_SYNOPSIS  = True ;  //Set to True if to wanted to Download full synopsis for Plot provider page for retreive the Synopsis info in Custom IMDB Synopsis box.
//  GET_FULL_PLOT_SYNOPSIS  = False ;  //Set to True if to wanted to Download full synopsis for Plot provider page for retreive the Synopsis info in Custom IMDB Synopsis box.
  GET_FULL_PLOT  = True ;  //Set to True if to wanted to Download full synopsis for Plot provider page for retreive the Plot info in Custom Plot Summary box.
//  GET_FULL_PLOT  = False ;  //Set to True if to wanted to Download full synopsis for Plot provider page for retreive the Plot info in Custom Plot Summary box.



IMDB_[EN][HTTPS]_TEST_1b script is attached.
« Last Edit: May 21, 2023, 08:35:45 am by Ivek23 »
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #343 on: March 22, 2023, 08:01:19 pm »
IMDB_[EN][HTTPS]_TEST_1b script some new custom fields.

Some IMDb url links can now be found in the existing IMDb Movie Url memo box.

Some IMDb url links can now be found in the new Custom IMDbExternalSitesUrl memo box.

You also have IMDb url links to search results in the new Custom IMDbSearchUrl memo box.

You also have IMDb url links that are stored in the WaybackArchive and can be found in the new Custom WaybackArchive IMDb URLs memo box.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #344 on: May 23, 2023, 05:05:57 am »
The IMDB_[EN][HTTPS] script no longer downloads certain information for movies because there have been major changes in the source code of certain web pages. The script only downloads information from the basic Movies page. It currently also downloads information from the Full Cast & Crew, Awards and Plot Keywords web pages. Here, too, there will be changes in the source code sometime by the end of February. Currently, it still downloads movies information from the Reference View website for movies, but it's only a matter of time how long this will be, because the Reference View website is supposed to be discontinued in the near future, unfortunately for us of course.

There will be many problems for corrections in the IMDB_[EN][HTTPS] script, it is also possible that certain web pages and the transfer of information will no longer be possible in the future.

Even from the pages listed above [EN][HTTPS] the script practically does not transfer any information anymore, except only downloads information from the basic Movies page. So there won't be any new IMDB_[EN][HTTPS] script updates anymore because it is no longer possible to download many full downloads of information. The new Imdb website design does not allow this anymore.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #345 on: November 18, 2023, 09:28:42 pm »
In the IMDB_[EN][HTTPS] script, the IMDB search results no longer work due to a change in the source code on these pages.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #346 on: November 27, 2023, 07:12:46 pm »
Here is the url link to the new AllMovie.com HTTPS script beta for PVD MOD versions.

http://www.videodb.info/forum_en/index.php/topic,4109.msg21882.html#msg21882
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #347 on: December 18, 2023, 02:25:01 pm »
Here is the new IMDB_[EN][HTTPS]_TEST_2b script which currently transmits only partially or fully the information for a specific movie.

Partial download Also Known As info, full download info is for PlotKeywords, PlotSummary and Technical specifications. For the time being, the information for the Cast&Crew, ParentsGuide and Reference View websites is still in progress. The search for results does not work anymore (more information about this can be found here). Function ParsePage_BingSearch (changes in the source code of the Bing page) and also Function ParsePage_IMDBMovieAWARDS have been removed from the script, but now that the source code of the Awards website has been changed, it is impossible to edit or correct the code, and in addition, there is a limitation for a certain Event (on example: Academy Awards, USA) it is possible to see only five award categories for one event.

You now have a special script available to search for results and you can find them added below. 

Imdb.com[EN][HTTPS]_ b+ script is now called Imdb.com[EN][HTTPS]_Search script which would work in all PVD versions of the program. You can also add this long text IUpdated01 custom field to the database

Imdb.com[EN][HTTPS]_Search script attached.
The Imdb.com[EN][HTTPS]_Search_adv script is made in the same way as the Imdb.com[EN][HTTPS]_Search script but with the difference that the Advanced search list of search results is displayed.

You can use it if the Imdb.com[EN][HTTPS]_Search script may not show you results or may not add the correct url in case there are multiple movie titles of the same title.

The Imdb.com[EN][HTTPS]_Search_adv script also displays more hits in the list of search results.

The exact year of release of the movies is also correctly transferred here. Works in all PVD versions.

Imdb.com[EN][HTTPS]_Search_adv script attached.

IMDB_[EN][HTTPS]_TEST_2b script attached.
Imdb.com[EN][HTTPS]_Search script attached.
Imdb.com[EN][HTTPS]_Search_adv script attached.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 451
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #348 on: December 20, 2023, 02:48:39 am »
For me, _2b works as advertised so far. Thank you so much Ivek.

Does anyone know which custom field states by which script the record is last updated? I absolutely forgot. Was it IUpdated?
« Last Edit: December 20, 2023, 02:57:16 am by afrocuban »

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #349 on: December 20, 2023, 08:44:43 am »
For me, _2b works as advertised so far. Thank you so much Ivek.

Does anyone know which custom field states by which script the record is last updated? I absolutely forgot. Was it IUpdated?

Thanks.

With the IUpdated custom long text field, you will see exactly when and with which script the most recent record update was made.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 451
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #350 on: December 20, 2023, 08:56:35 pm »
Great, thank you. I want to track records in order to be updated with _2b!

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #351 on: December 22, 2023, 10:28:30 am »
Here is the new test IMDB_People_[EN][HTTPS]_TEST_1 script, which is updated to the new look of the Imdb People web pages. The same as written below is removed from the script.
The search for results does not work anymore (more information about this can be found here). Function ParsePage_BingSearch (changes in the source code of the Bing page) and also Function ParsePage_IMDBMovieAWARDS have been removed from the script, but now that the source code of the Awards website has been changed, it is impossible to edit or correct the code, and in addition, there is a limitation for a certain Event (on example: Academy Awards, USA) it is possible to see only five award categories for one event.

IMDB_People_[EN][HTTPS]_TEST_1 script attached.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 451
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #352 on: December 22, 2023, 05:11:07 pm »
Wow, that was u surprise! Thank you so much, but the script doesn't import anything for me, although people url is provided.
Example http://imdb.com/name/nm0000080


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #353 on: December 22, 2023, 06:14:29 pm »
Wow, that was u surprise! Thank you so much, but the script doesn't import anything for me, although people url is provided.
Example http://imdb.com/name/nm0000080

Logically, it doesn't transfer anything to you, because you don't have the field for transferring information marked so that it would be overwritten, because for me, if the nose is marked for overwriting, it doesn't overwrite it. It only overwrites them if the fields were previously empty.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 451
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #354 on: December 22, 2023, 07:15:13 pm »
Of course. I tried everything. Please check screenshot attached.

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #355 on: December 22, 2023, 07:55:23 pm »
Of course. I tried everything. Please check screenshot attached.

What do you find in the log file?

Use this attached portable.bat file to then see the transfer data in the log file.

The IMDB_People_[EN][HTTPS]_TEST_1 script only works with the url address because the search results do not work.


Then you might have the use of a proxy server checked in the proxy settings. Another possibility is that you have a blocked PVD or blocked access to Imdb websites. Sorry, but the problem is definitely on your side, because I haven't had any problems with the operation of different PVD versions for quite some time or for several years.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 451
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #356 on: December 22, 2023, 08:14:45 pm »
Thanks for response:
Strange things are happening when debugging:
Quote
(12/22/2023 8:09:25 PM) Compiling script: IMDB_People_[EN][HTTPS]_TEST_1.psf
(12/22/2023 8:09:25 PM) Script compiled successfully: IMDB_People_[EN][HTTPS]_TEST_1.psf
[Hint] (467:7): Variable 'CURPOS' never used
[Hint] (468:7): Variable 'ITEMVALUE' never used
[Hint] (468:7): Variable 'IMAGEFILE' never used
[Hint] (469:7): Variable 'NAME' never used
[Hint] (469:7): Variable 'PREVIEWURL' never used
[Warning] (621:62): "True and" is not needed
[Hint] (557:5): Variable 'INDEX' never used
[Hint] (560:2): Variable 'TITLE' never used
[Hint] (560:2): Variable 'ROLE' never used
[Hint] (560:2): Variable 'YEAR' never used
[Hint] (560:2): Variable 'MOVIEURL' never used
[Hint] (952:5): Variable 'DEBUG_POS1' never used
[Hint] (954:5): Variable 'ITEMVALUE10' never used
[Hint] (954:5): Variable 'ITEMVALUE11' never used
[Hint] (955:2): Variable 'ITEMLIST1' never used
[Hint] (1039:5): Variable 'ITEMVALUE' never used
[Hint] (1040:5): Variable 'NAME' never used
[Hint] (1040:5): Variable 'PERSONURL' never used
[Hint] (1042:2): Variable 'MOVIESID' never used
[Hint] (1043:5): Variable 'ITEMVALUE14' never used
[Hint] (1044:5): Variable 'FULLINFO' never used
[Hint] (1044:5): Variable 'DIRECTORS' never used
[Hint] (1044:5): Variable 'WRITERS' never used
[Hint] (1044:5): Variable 'COMPOSERS' never used
[Hint] (1044:5): Variable 'PRODUCERS' never used
[Warning] (1501:54): "True and" is not needed
[Warning] (1501:26): "True and" is not needed
(12/22/2023 8:09:25 PM) Executing script binary
(12/22/2023 8:09:25 PM) Logging in...
(12/22/2023 8:09:25 PM) Person -> LoadStatic -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadMultivalues -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadFilms -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadAwards -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadImages -> 0ms
(12/22/2023 8:09:25 PM) Function GetDownloadURL BEGIN======================|
(12/22/2023 8:09:25 PM) Global Var-Mode|0|
(12/22/2023 8:09:25 PM) Global Var-DownloadURL||
(12/22/2023 8:09:25 PM) Person -> LoadStatic -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadMultivalues -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadFilms -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadAwards -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadImages -> 0ms
(12/22/2023 8:09:25 PM) Stored URL is:http://imdb.com/name/nm0000080/||
(12/22/2023 8:09:25 PM) Person -> LoadStatic -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadMultivalues -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadFilms -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadAwards -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadImages -> 0ms
(12/22/2023 8:09:25 PM)       No IMDB URL.
(12/22/2023 8:09:25 PM) Function GetDownloadURL END====================== with Mode=0 Result=C:\PersonalVideoDB\portable.bat|
(12/22/2023 8:09:25 PM) Searching person information for: Orson Welles
(12/22/2023 8:09:25 PM) Function ParsePage BEGIN======================|
(12/22/2023 8:09:25 PM) Global Var-Mode|0|
(12/22/2023 8:09:25 PM) Global Var-DownloadURL||
(12/22/2023 8:09:25 PM) Local Var-URL||
(12/22/2023 8:09:25 PM) Person -> LoadStatic -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadMultivalues -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadFilms -> 0ms
(12/22/2023 8:09:25 PM) Person -> LoadAwards -> 16ms
(12/22/2023 8:09:25 PM) Person -> LoadImages -> 0ms
(12/22/2023 8:09:25 PM)   ParsePage smSearch|0|. Searching DownloadURL for PersonName |Orson Welles|
(12/22/2023 8:09:25 PM)       Searching in Provider:|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm||
(12/22/2023 8:09:25 PM)       Function DownloadPage BEGIN======================|
(12/22/2023 8:09:25 PM)       Global Var-DownloadURL|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm|
(12/22/2023 8:09:25 PM)             Local Var-URL|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm|
(12/22/2023 8:09:25 PM)             Waiting 1s for delete:C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm
(12/22/2023 8:09:26 PM)             Download with PVdBDownPage in file:|C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm the information of:|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm||
(12/22/2023 8:09:26 PM)             Waiting 2s for exists of:C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm
(12/22/2023 8:09:28 PM)             Waiting 2s for exists of:C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm
(12/22/2023 8:09:30 PM)             Now present complete page file: C:\PersonalVideoDB\Scripts\Tmp\downpage-UTF8_NO_BOM.htm
(12/22/2023 8:09:30 PM)       Function DownloadPage END======================|
(12/22/2023 8:09:30 PM) Function ParsePage_IMDBSearchName BEGIN======================|
(12/22/2023 8:09:30 PM) Global Var-Mode|0|
(12/22/2023 8:09:30 PM) Global Var-DownloadURL|https://www.imdb.com/search/name?name=Orson+Welles&sort=starmeter+desc&ref_=rlm|
(12/22/2023 8:09:31 PM)         No People results
(12/22/2023 8:09:31 PM) Function ParsePage_IMDBSearchName END=====================||
(12/22/2023 8:09:31 PM) Function ParsePage smSearch-prError END======================|

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #357 on: December 22, 2023, 08:21:20 pm »
Change this part of the code, maybe the script will work with the url, but the search results will still not work.
Code: [Select]
  SEARCH_ENGINE  = True ;  //If there isn't provider search results, try with Bing search engine
  //SEARCH_ENGINE  = False ;  //If there isn't provider search results, try with Bing search engine

But now I know what's wrong and why can't stand anything. You are missing http://www.imdb.com/name/nm0000080/ in the url address. I will fix this in the new script version
« Last Edit: December 22, 2023, 08:31:54 pm by Ivek23 »
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2689
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #358 on: December 22, 2023, 09:04:14 pm »
Use SQL script if you are missing this part in the url: www.

More at the link below.

http://www.videodb.info/forum_en/index.php/topic,4087.msg21968.html#msg21968
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 451
    • View Profile
Re: Personal Video Database 1.0.2.7 MOD
« Reply #359 on: December 22, 2023, 11:32:06 pm »
Use SQL script if you are missing this part in the url: www.

More at the link below.

http://www.videodb.info/forum_en/index.php/topic,4087.msg21968.html#msg21968


It updates links with http://www.videodb.info/forum_en/index.php/topic,4087.msg21971.html#msg21971
but still



Change this part of the code, maybe the script will work with the url, but the search results will still not work.
Code: [Select]
  SEARCH_ENGINE  = True ;  //If there isn't provider search results, try with Bing search engine
  //SEARCH_ENGINE  = False ;  //If there isn't provider search results, try with Bing search engine

But now I know what's wrong and why can't stand anything. You are missing http://www.imdb.com/name/nm0000080/ in the url address. I will fix this in the new script version


gives nothing, although now link is "proper", with www. Same log as above, now with Stored URL is:https://www.imdb.com/name/nm0000080/||. To remind, _2b works flawlessly with url provided.
« Last Edit: December 22, 2023, 11:34:57 pm by afrocuban »

 

anything