Author Topic: Deleting movie duplicates  (Read 11047 times)

0 Members and 1 Guest are viewing this topic.

Offline AimHere

  • Older Power User
  • *****
  • Posts: 213
    • View Profile
Deleting movie duplicates
« on: November 11, 2009, 02:19:53 am »
Hi,

How exactly does the "Delete movie duplicates" feature in "Optimize Database" work? What criteria does it use to determine whether a movie is a duplicate?

I ask because I did a test run on a copy of my database, which has some 1100 movies in it. After optimizing the database with "Delete movie duplicates" checked, it claimed to remove some 400 movies... apparently including at least 100 which were NOT actually duplicates of anything! These movies disappeared entirely from my main list. (Good thing I don't do experiments like this on my primary database!)

Aimhere

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Deleting movie duplicates
« Reply #1 on: November 11, 2009, 02:30:09 am »
It checks if title is equal to title or original title of the other movie and year is same or one of the years is absent.
Gentlemen, you can’t fight in here! This is the War Room!

Offline AimHere

  • Older Power User
  • *****
  • Posts: 213
    • View Profile
Re: Deleting movie duplicates
« Reply #2 on: November 11, 2009, 02:41:10 am »
And then it deletes the oldest entry[ies] in the database, leaving only the newest one? (I seem to recall this from another post.)

I did a little cleanup work on some fields in my database, going to try the "delete movie duplicates" function again and see what happens...

Aimhere
« Last Edit: November 11, 2009, 02:57:54 am by AimHere »

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Deleting movie duplicates
« Reply #3 on: November 11, 2009, 03:01:03 am »
Quote
And then it deletes the oldest entry[ies] in the database, leaving only the newest one? (I seem to recall this from another post.)

It is not really determined which copy will be deleted, it will be just the first copy of the movie found by SQL query.
Gentlemen, you can’t fight in here! This is the War Room!

Offline AimHere

  • Older Power User
  • *****
  • Posts: 213
    • View Profile
Re: Deleting movie duplicates
« Reply #4 on: November 12, 2009, 02:44:53 am »
Quote
And then it deletes the oldest entry[ies] in the database, leaving only the newest one? (I seem to recall this from another post.)

It is not really determined which copy will be deleted, it will be just the first copy of the movie found by SQL query.

Hmm, that seems rather arbitrary. It would be nice to be able to simply scan for duplicates without actually deleting them, and highlighting or grouping them in some way so they stand out, then I would be able to choose which one(s) to delete. I'd rather have PVD delete an "empty" Movie record (one with just the title and year) than a fully-populated one that I spent some considerable time filling in and checking!!!

Aimhere

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Deleting movie duplicates
« Reply #5 on: November 12, 2009, 03:02:13 am »
I'll think about it
Gentlemen, you can’t fight in here! This is the War Room!

Offline AimHere

  • Older Power User
  • *****
  • Posts: 213
    • View Profile
Re: Deleting movie duplicates
« Reply #6 on: November 12, 2009, 09:17:39 pm »
One possible approach would be to have PVD delete the duplicate that has the least number of fields containing data. Movie records added when importing filmographies are likely only going to have a couple of fields populated (Title, original title, year, actors) while the ones *I* added (through "New Movie Master" or file scans) are gonna have the works... posters, screenshots, media information, genre, descriptions, etc. etc.

Aimhere

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Deleting movie duplicates
« Reply #7 on: November 12, 2009, 11:00:02 pm »
If I do so, the process of removing duplicates will become way too complex and slow, especially when invisible movies are to be checked, so I do not think it is a good idea.

Maybe I will implement the duplicate highlighting functionality.
Gentlemen, you can’t fight in here! This is the War Room!

Offline CAD

  • Older Power User
  • *****
  • Posts: 168
  • I've got my eye on you!
    • View Profile
Re: Deleting movie duplicates
« Reply #8 on: November 13, 2009, 10:46:28 am »
i know pvd isnt a catalog program, but most people do use it as one.
Deleting duplicate functions need to be looked at with care as (especially now) people have the same movie in different formats
blueray/dvd

personally i would have it so it highlights duplicates and let the user make the choice what to do with them
Perhaps set the bookmarked flag ??
three fingered salutation

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Deleting movie duplicates
« Reply #9 on: November 14, 2009, 01:35:30 am »
Quote
personally i would have it so it highlights duplicates and let the user make the choice what to do with them
Perhaps set the bookmarked flag ??

Yes, most probably it will work like this in future
Gentlemen, you can’t fight in here! This is the War Room!