[SOLVED] Import from IMDB Not Working

[buah]

I don't seem Country and Original language data to get.

Movie: Frozen (2010/I)

[nostra]

Fixed in 0.9.5.3. Oh man, when will they finally stop changing stuff?!

[buah]

Thanks, nostra.

P.S. I don't think they will ever stop changing stuff. The way provides 'em at least a lot more clicks...

[rick.ca]

Oh man, when will they finally stop changing stuff?!

That's why I asked...

I'm wondering what we might expect as the IMDb redesign rolls out. Does your fix involve parsing the new main page, or finding the old one? And will further changes be required as they convert other pages?

From their description of the roll-out process, it sounds like this could go on for months. If the plugin is intelligently figuring out which page version it's being sent too and parsing accordingly, maybe that's not a problem. Otherwise, this will get even worse as they start changing all the subsidiary pages (i.e., keywords, fullcredits, awards, business, technical)—and using both versions of those at the same time.

[nostra]

If the plugin is intelligently figuring out which page version it's being sent too and parsing accordingly, maybe that's not a problem

It does, but they still manage to change stuff in the new design, so I can't do anything about it
Well, we just need to be patient and wait until they have finished. 

[buah]

In a way I see this as a challenge for all movie manager software, and as a chance for PVD to get a lot of new users...

[rick.ca]

Well, we just need to be patient and wait until they have finished.

Assuming, then, we'll be seeing a series of issues that will require changes to the plugin, is there any specific information users can report about those issues that will help you? We could start a new topic that explains the situation, and asks users to report their observations in the most helpful way. Do you need logs, examples, page.html files, etc.? Or would a report that awards data is not being downloaded (for example) imply clearly enough those pages are beginning to be affected?

I wonder if there's another forum we can monitor to give us a head's up on what's happening.

[Hyomil]

Looks like another one here: using the new 0.3.0.0 People plugin, I just updated Jeffrey Lau http://imdb.com/name/nm0311508, who I already had some movies of in my database, and PVD created new entries for them instead of merging like it used to.  None of these new entries have years, either.  (See attached screenshot.)  

In addition to not merging the credits, PVD didn't import all of them to begin with.  I tested on a copy of the database where I cleared the Jeffrey Lau record and reimported and the first entry under each category is missing.

Writer:
1.  Chut sui fu yung (2010) is missing.
Director:
1.  Chut sui fu yung (2010) is missing.
Producer:
1.  Kung Fu Hustle (2004) is missing.
Actor:
1.  Yuet gwong bo hup (2010) is missing.

And for the ones that did import, the years were missing.

I haven't made any changes to the plugin's settings recently; "Merge Filmography" is checked and "Filmography" has a black (not gray) checkmark.

Code: [Select]

(9/30/2010 2:41:03 AM) Logging in...
(9/30/2010 2:41:03 AM) POST: http://www.imdb.com/register/login
(9/30/2010 2:41:03 AM) Redirected to: https://secure.imdb.com/register-imdb/login
(9/30/2010 2:41:03 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:41:03 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:41:03 AM) Person -> LoadFilms -> 15ms
(9/30/2010 2:41:03 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:41:03 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:41:03 AM) Searching person information for: Jeffrey Lau
(9/30/2010 2:41:03 AM) GET: http://imdb.com/name/nm0311508
(9/30/2010 2:41:03 AM) Redirected to: http://www.imdb.com/rg/parked-domains/imdb.com/name/nm0311508
(9/30/2010 2:41:03 AM) Redirected to: http://www.imdb.com/name/nm0311508
(9/30/2010 2:41:03 AM) Redirected to: http://www.imdb.com/name/nm0311508/
(9/30/2010 2:41:06 AM) GET: http://www.imdb.com/name/nm0311508/awards
(9/30/2010 2:41:09 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:41:09 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:41:09 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:41:09 AM) Person -> LoadAwards -> 16ms
(9/30/2010 2:41:09 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:41:44 AM) UpdateToolbar: 46
(9/30/2010 2:41:44 AM) UpdateToolbar: 47
(9/30/2010 2:42:02 AM) UpdateToolbar: 48
(9/30/2010 2:42:02 AM) UpdateToolbar: 49
(9/30/2010 2:42:02 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:42:17 AM) UpdateToolbar: 50
(9/30/2010 2:42:17 AM) UpdateToolbar: 51
(9/30/2010 2:42:32 AM) UpdateToolbar: 52
(9/30/2010 2:42:32 AM) UpdateToolbar: 53
(9/30/2010 2:42:32 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadFilms -> 16ms
(9/30/2010 2:42:32 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:51:24 AM) UpdateToolbar: 54
(9/30/2010 2:51:24 AM) UpdateToolbar: 55

PVD 0.9.9.21
Windows 7 64-bit

[attachment deleted by admin]

[rick.ca]

I haven't made any changes to the plugin's settings recently; "Merge Filmography" is checked and "Filmography" has a black (not gray) checkmark.

Notwithstanding this should work properly, why do you have "Merge Filmography" checked? What happens if it's not checked?

[nostra]

You are right, Hyomil, thx for the info. I have uploaded a fix.

[Hyomil]

...why do you have "Merge Filmography" checked?...

Because I didn't read your post in this thread.     I'll leave it unchecked.

You are right, Hyomil, thx for the info. I have uploaded a fix.

Thanks, that works for the credits, but now an import for the same person (Jeffrey Lau http://imdb.com/name/nm0311508), fails to get the Alternative Names and Genres.

Also, for Jeeja Yanin http://imdb.com/name/nm2925876, I tried importing (with "Merge Filmography" unchecked) and PVD removed the 2 movies I already had in my database (presumably because I had Filmography as a black rather than gray checkbox, which I've changed now as well) and didn't add them back upon importing a second time.

[nostra]

Alternative Names and Genres.

I could not find those in the new design...

[Hyomil]

Alternative Names and Genres.

I could not find those in the new design...

With the new design, Alternative names are on the main page for me (see attached screenshot) and genres are on this page:

http://www.imdb.com/name/nm0311508/filmogenre

Also, are you able to import the 2 credits for Jeeja Yanin http://imdb.com/name/nm2925876?  I get nothing when I try to import them.

[attachment deleted by admin]

[rick.ca]

A few minor issues with the movie info plugin are illustrated in the attached screen shot...

• I've seen the missing space in the actor data before and assumed the problem was at the source. With the latest version, it does it to all actors in all series, while the data appears okay at IMDb.
  
  
• Votes has been without a thousands separator since it was introduced.

[attachment deleted by admin]

[nostra]

With the new design, Alternative names are on the main page for me (see attached screenshot)

OK, got them

and genres are on this page:
http://www.imdb.com/name/nm0311508/filmogenre

I think genres are not important enough for people to download an extra page.

Also, are you able to import the 2 credits for Jeeja Yanin http://imdb.com/name/nm2925876?  I get nothing when I try to import them.

Fixed

With the latest version, it does it to all actors in all series, while the data appears okay at IMDb.

Fixed

# Votes has been without a thousands separator since it was introduced.

It has nothing to do with the plugin. I need to improve the field behavior in the main app.

[rick.ca]

I've seen the missing space in the actor data before and assumed the problem was at the source. With the latest version, it does it to all actors in all series, while the data appears okay at IMDb.

Now the information in parentheses is gone completely.

In edit mode, I see there's a now a space between the role and comma-separator, so it seems the parenthetical part has simply been omitted.

[nostra]

Do you really need it? Looks kind of ugly...

[rick.ca]

Do you really need it? Looks kind of ugly...

Perhaps, but the information is essential. It is, after all, a summary of episode data, and not all actors have been with the series for the same period. Attached is an illustration from my series record for NYPD Blue (1993-2005). The information is particularly useful when looking back at an older series.

The screen shot illustrates another use. The last two entries are there as a result of PVD's unfortunate behaviour of adding people to movie records when they are updated in People View, even if the people there are restricted to "main page only." Such entries appearing tell me it's time to update the record to fix that problem. I would prefer, of course, if that weren't necessary in the first place. People should not be added to movie credits when the "Show people added from movie credits" option has been selected.

I'd be happy if you abbreviated the information. For example...

Hugh Laurie ... Dr. Gregory House (135x|2004-) instead of
Hugh Laurie ... Dr. Gregory House (135 episodes - 2004-2010)

...but some might think that even uglier.

[attachment deleted by admin]

[nostra]

OK, I'll add an option for this info.

[nostra]

OK, I'll add an option for this info.

Done