how to delete duplicated songs all at one time?

turingtest2 wrote:

The script avoids the more complex problem of trying to detect and selectively remove what I earlier called type 3 duplicates, that is alternate recordings or rips at different bit rates of the same tune, principally because that is a much harder problem to automate, but also because "best track to keep" from a set of potential candidates will be a subjective matter.

Having given this matter some more thought I've now rewritten the script to take this last group of duplicates into account. I've decided that in most cases the largest type 3 or alternate duplicate will be the one that you want to keep, but I've made this part of the new script fully optional so that those who prefer to check their alternate versions more closely can stll make use of the script.

The latest version of DeDuper also adds a feature to preserve playlist membership, though not necessarily the precise position. If a "dupe" is removed from a given playlist the "original" is added to the playlist unless it is already a member of it.

tt2

Hi tt2,

Thank you for you for your posted help so far. I had a problem error message thouhg pop[ up interrupting DeDuper. I got a message noting "error: file is unassociated"

I don't believe i've seen a fix for this otherwise, and this issue is preventing me from eliminating my duplicates with the benefits you designed into DeDuper.

Thanks,

Hmm, do you have many broken entries in your library? Tracks that show up with exclamation marks? I thought the script was set up just to ignore them but I didn't specifically create and test any under the latest build. Will look at it properly tomorrow, but the precise error message would be useful.

tt2

Hi tt2 and all,

no i don't appear to have broken files with elxclamation makes at least not in the info colums highlighted my itunes.

i got this repeat message trying the deduper today, and also this separate one too:

line: 415

Char: 5

Error: the track is not modifiable

code: A0040203

source: (null)

line: 1008

Char: 5

Error: object named "internetexporer.appplications".

code: 800704A6

source: WScript.createobject

thanks everyone, are these new issues or already debugged?

one more try got me a new message again:

line: 1060

Char: 7

Error: The Interface is unknown

code: 800706B5

source: (null)

The error on line 415 is generated by iTunes and occurs if the SkippedDate value is updated. I can't see a good reason for iTunes to reject this call, even if the track in question were locked or currently playing since the data only goes in iTunes own database. Not ever seen the issue myself. Easiest thing might be to simply comment out that line with a single quote.

The error on line 1008 looks like a security setting is preventing the script from creating a local IE browser object to host the progress bar used by the script. I thought I'd written in some code to detect if IE can't be invoked but it may not be thorough enough. I've only got XP to test on where the script works as expected. This page on IE security zone settings may be useful but I'll have to find time to access and test the script on a Windows 7 system again.

There's a note in my script regarding line 1060 - Causes error if UAC is active - so it looks like I've already determined that if UAC is enabled the script shouldn't attempt to use the progress bar feature. However I recall rewriting the way the progress bar is invoked during the different phases of the script so I probably just need to do some housekeeping there.

tt2

I stumbled upon this thread while checking to see if people were having problems with the new iTunes version just released. (They usually do 🙂) I used your script and it worked perfectly! Thank you so much for automating an tedious chore. Great job.

Tom D.

am i correct to say that the DeDuper didn't delete any copies during my usage since it comes up with an error mesage every time i use it on my exact uplicate list in itunes?

should i try it on smaller sets of of that library to more usefulness?

let me know if there are fixes or additions to the code that i should re-download to use again.

Thank you for all of your help so far, hoping to get this to work and be over/done with it.

Yep, it will be crashing out before it does anything useful. I don't know where you are but it's around 11am here in the UK. I won't really get a chance to look at it until some point this afternoon, at which point I can upload a new build. I'll post back here when it is done.

tt2

New build uploaded. Should fix the issue with trying to create a progress bar on systems running UAC and I've moved that SkippedDate assignment which might help out with that issue. Hopefully I can get access to a Windows 7 test machine later this evening just to check for any other weird issues.

tt2

Just to confirm the latest version of the DeDuper script works fine under Windows 7 with UAC enabled.

tt2

thank you tt2, appreciate your time in responding.

i guess i'm the only one having these issues.

I have my UAC enabled, and i even merged all my music folders, consolidated (while converting to aav files for hours...), and deleted the old folders.

anyhow, tried the deduper again and still have come up with this message:

i got this repeat message trying the deduper today, and also this separate one too:

line: 418

Char: 5

Error: the track is not modifiable

code: A0040203

source: (null)

I wonder if there is a permissions issue. Try this.

Right-click on your main iTunes folder and click Properties, then go to the Security tab and click Advanced. If necessary grant your account and SYSTEM full control of this folder, subfolders and files, then tick the option to replace permissions on child objects which will repair permissions throughout the library. If your media folder is separate from the library folder then repeat for the media folder. This is the XP dialog but Windows 7 shouldn't be too different.

If it won't let you change the permissions use the Owner tab to take ownneship from an account with administror privileges.

tt2

I'm understanding that you are refering to the itunes folder within libraries>music. the folder that i have consolidated everything into.

all of my permissions are already on full control.

Try to identify one of the tracks that the script is going to want to update, i.e. one of your sets of exact duplicates. Can you modify say the comment field via Get Info or is the file locked?

Even if the permissions dialog says you have full control there may be files with incorrect permissions within the folder structure. The tip above repairs the permissions for all files within the folder it is applied to.

Alternatively the files could be marked as read-only. Open the properties of the top folder, clear the Read-only checkbox, and apply the change to This folder, subfolders and files.

In the current build line 418 is a comment so that shouldn't cause an error. Can you check the line number please?

tt2