Bug with Duplicate files Hazel 3.3.1?

[edenexposito]

OSX: Yosemite
Hazel: 3.3.1 (1200)

Mr_noodle can you confirm "Throw away if duplicate" work as expected?. See this screenscast (all files are been duplicated with cmd+d hotkey):

https://dl.dropboxusercontent.com/u/122 ... -05-50.mp4

Why no compare if all file attributes are the same except "filename" and "folder inclusion date" to know if a duplicate?.

Only compare files with these name schemes: filename-#.ext , filename (#).ext ??
What happen with name schemes: filename copy #.ext ??


Here the log:

Code: Select all

 Marcador - 28/10/2014 11:05:13
2014-10-28 11:05:17.821 HazelHelper[9196] DEBUG: Deploy folders: (
)
2014-10-28 11:05:17.821 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: Undeploying worker for folder: /Users/edenexposito/Desktop/CARPETA 1
2014-10-28 11:05:17.821 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: FOLDERS SYNCED: (
)
2014-10-28 11:05:23.334 HazelHelper[9196] DEBUG: Deploy folders: (
)
2014-10-28 11:05:23.335 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: FOLDERS SYNCED: (
)
2014-10-28 11:06:45.193 HazelHelper[9196] DEBUG: Deploy folders: (
)
2014-10-28 11:06:45.193 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: FOLDERS SYNCED: (
)
2014-10-28 11:07:01.728 HazelHelper[9196] DEBUG: Deploy folders: (
    "<ComNoodlesoft_HazelConcreteFolder: 0x7f8f13f383b0> \"CARPETA 1\""
)
2014-10-28 11:07:01.728 HazelHelper[9196] DEBUG: Warning: attempted to schedule paused folder: <ComNoodlesoft_HazelConcreteFolder: 0x7f8f13f383b0> "CARPETA 1"
2014-10-28 11:07:01.728 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: FOLDERS SYNCED: (
)
2014-10-28 11:07:03.742 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: Run worker for folder: /Users/edenexposito/Desktop/CARPETA 1
2014-10-28 11:07:03.770 hazelworker[16739] ###main load address: 0x10a509000
2014-10-28 11:07:03.771 hazelworker[16739] ###Noodle load address: 0x10a611000
2014-10-28 11:07:03.771 hazelworker[16739] ###CK load address: 0x10a5da000
2014-10-28 11:07:03.784 hazelworker[16739] DEBUG: Program is licensed.
2014-10-28 11:07:03.789 hazelworker[16739] DEBUG: Unexpected type for Mail download URL: (null)
2014-10-28 11:07:03.796 hazelworker[16739] DEBUG: Could not find entry for default_directory in Chrome preference file.
2014-10-28 11:07:03.803 hazelworker[16739] Processing folder CARPETA 1 (forced)
2014-10-28 11:07:03.803 hazelworker[16739] DEBUG: Initialized
2014-10-28 11:07:03.803 hazelworker[16739] DEBUG: Pausing to wait for things to settle down.
2014-10-28 11:07:05.903 hazelworker[16739] DEBUG: Processing directories: (
    "/Users/edenexposito/Desktop/CARPETA 1"
)
2014-10-28 11:07:05.905 HazelHelper[9196] DEBUG: Checking events for path /Users/edenexposito/Desktop/CARPETA 1, folder <ComNoodlesoft_HazelConcreteFolder: 0x7f8f13f383b0> "CARPETA 1"
2014-10-28 11:07:05.905 hazelworker[16739] DEBUG: Received file event: {
    abort = 1;
}
2014-10-28 11:07:05.905 hazelworker[16739] DEBUG: About to process directory /Users/edenexposito/Desktop/CARPETA 1
2014-10-28 11:07:05.906 hazelworker[16739] DEBUG: .DS_Store: File is hidden/invisible. Skipping.
2014-10-28 11:07:05.907 hazelworker[16739] imagen1 (3).png: Rule Throw away if duplicate matched.
2014-10-28 11:07:05.907 hazelworker[16739] DEBUG: New rule signature. Executing actions.
Old signatures: (
)
New Signature:{TRUEPREDICATE}:{(move:/Users/edenexposito/Desktop/CARPETA 2,{
    keepFolderStructure = 0;
    replaceExisting = 2;
    throwAwayDupes = 1;
})}
2014-10-28 11:07:05.915 hazelworker[16739] [File Event] File moved: imagen1 (3).png moved from folder /Users/edenexposito/Desktop/CARPETA 1 to folder /Users/edenexposito/Desktop/CARPETA 2.
2014-10-28 11:07:05.915 hazelworker[16739] DEBUG: Action changed file: imagen1 (3).png
2014-10-28 11:07:05.916 hazelworker[16739] imagen1 (4).png: Rule Throw away if duplicate matched.
2014-10-28 11:07:05.917 hazelworker[16739] DEBUG: New rule signature. Executing actions.
Old signatures: (
)
New Signature:{TRUEPREDICATE}:{(move:/Users/edenexposito/Desktop/CARPETA 2,{
    keepFolderStructure = 0;
    replaceExisting = 2;
    throwAwayDupes = 1;
})}
2014-10-28 11:07:05.917 hazelworker[16739] [File Event] File moved: imagen1 (4).png moved from folder /Users/edenexposito/Desktop/CARPETA 1 to folder /Users/edenexposito/Desktop/CARPETA 2.
2014-10-28 11:07:05.918 hazelworker[16739] DEBUG: Action changed file: imagen1 (4).png
2014-10-28 11:07:05.919 hazelworker[16739] imagen1 copia 4.png: Rule Throw away if duplicate matched.
2014-10-28 11:07:05.919 hazelworker[16739] DEBUG: New rule signature. Executing actions.
Old signatures: (
)
New Signature:{TRUEPREDICATE}:{(move:/Users/edenexposito/Desktop/CARPETA 2,{
    keepFolderStructure = 0;
    replaceExisting = 2;
    throwAwayDupes = 1;
})}
2014-10-28 11:07:05.920 hazelworker[16739] [File Event] File moved: imagen1 copia 4.png moved from folder /Users/edenexposito/Desktop/CARPETA 1 to folder /Users/edenexposito/Desktop/CARPETA 2.
2014-10-28 11:07:05.920 hazelworker[16739] DEBUG: Action changed file: imagen1 copia 4.png
2014-10-28 11:07:05.921 hazelworker[16739] imagen1 copia 5.png: Rule Throw away if duplicate matched.
2014-10-28 11:07:05.921 hazelworker[16739] DEBUG: New rule signature. Executing actions.
Old signatures: (
)
New Signature:{TRUEPREDICATE}:{(move:/Users/edenexposito/Desktop/CARPETA 2,{
    keepFolderStructure = 0;
    replaceExisting = 2;
    throwAwayDupes = 1;
})}
2014-10-28 11:07:05.922 hazelworker[16739] [File Event] File moved: imagen1 copia 5.png moved from folder /Users/edenexposito/Desktop/CARPETA 1 to folder /Users/edenexposito/Desktop/CARPETA 2.
2014-10-28 11:07:05.922 hazelworker[16739] DEBUG: Action changed file: imagen1 copia 5.png
2014-10-28 11:07:05.924 hazelworker[16739] imagen1-1.png: Rule Throw away if duplicate matched.
2014-10-28 11:07:05.924 hazelworker[16739] DEBUG: New rule signature. Executing actions.
Old signatures: (
)
New Signature:{TRUEPREDICATE}:{(move:/Users/edenexposito/Desktop/CARPETA 2,{
    keepFolderStructure = 0;
    replaceExisting = 2;
    throwAwayDupes = 1;
})}
2014-10-28 11:07:05.924 hazelworker[16739] [File Event] File moved: imagen1-1.png moved from folder /Users/edenexposito/Desktop/CARPETA 1 to folder /Users/edenexposito/Desktop/CARPETA 2.
2014-10-28 11:07:05.925 hazelworker[16739] DEBUG: Action changed file: imagen1-1.png
2014-10-28 11:07:05.926 hazelworker[16739] imagen1-2.png: Rule Throw away if duplicate matched.
2014-10-28 11:07:05.926 hazelworker[16739] DEBUG: New rule signature. Executing actions.
Old signatures: (
)
New Signature:{TRUEPREDICATE}:{(move:/Users/edenexposito/Desktop/CARPETA 2,{
    keepFolderStructure = 0;
    replaceExisting = 2;
    throwAwayDupes = 1;
})}
2014-10-28 11:07:05.927 hazelworker[16739] [File Event] File moved: imagen1-2.png moved from folder /Users/edenexposito/Desktop/CARPETA 1 to folder /Users/edenexposito/Desktop/CARPETA 2.
2014-10-28 11:07:05.927 hazelworker[16739] DEBUG: Action changed file: imagen1-2.png
2014-10-28 11:07:05.928 hazelworker[16739] DEBUG: Writing out DB file: /Users/edenexposito/Desktop/CARPETA 1
2014-10-28 11:07:05.932 hazelworker[16739] DEBUG: Directory /Users/edenexposito/Desktop/CARPETA 1 processed in 0.026932 seconds
2014-10-28 11:07:05.932 HazelHelper[9196] DEBUG: Checking events for path /Users/edenexposito/Desktop/CARPETA 1, folder <ComNoodlesoft_HazelConcreteFolder: 0x7f8f13f383b0> "CARPETA 1"
2014-10-28 11:07:05.933 hazelworker[16739] Received abort event.
2014-10-28 11:07:05.933 hazelworker[16739] DEBUG: Sending metrics to scheduler. Next scheduled run:
2014-10-28 11:07:05.934 HazelHelper[9196] DEBUG: Received metrics for folder /Users/edenexposito/Desktop/CARPETA 1: {
    directoryDepth = 0;
    requestedSchedulingTime = "";
    triggerPaths = "<ComNoodlesoft_NoodlePathSet: 0x7f8f158744f0> - (\n)";
    unavailablePaths = "{(\n)}";
}
2014-10-28 11:07:05.934 HazelHelper[9196] DEBUG: Timer scheduled for folder /Users/edenexposito/Desktop/CARPETA 1 at
2014-10-28 11:07:05.934 hazelworker[16739] Done processing folder CARPETA 1
2014-10-28 11:07:05.938 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: Task removed: [16739]
2014-10-28 11:07:18.944 HazelHelper[9196] DEBUG: Deploy folders: (
    "<ComNoodlesoft_HazelConcreteFolder: 0x7f8f15f23d90> \"CARPETA 1\""
)
2014-10-28 11:07:18.944 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: Deploying worker for folder: /Users/edenexposito/Desktop/CARPETA 1
2014-10-28 11:07:18.944 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: FOLDERS SYNCED: (
    "<ComNoodlesoft_HazelConcreteFolder: 0x7f8f15f23d90> \"CARPETA 1\""
)
2014-10-28 11:07:48.947 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: Timer fired for folder: /Users/edenexposito/Desktop/CARPETA 1
2014-10-28 11:07:48.947 HazelHelper[9196] DEBUG: Thread 0x7f8f13c29690: Run worker for folder: /Users/edenexposito/Desktop/CARPETA 1
2014-10-28 11:07:48.974 hazelworker[16755] ###main load address: 0x10ed40000
2014-10-28 11:07:48.975 hazelworker[16755] ###Noodle load address: 0x10ee4e000
2014-10-28 11:07:48.975 hazelworker[16755] ###CK load address: 0x10ee13000
2014-10-28 11:07:48.987 hazelworker[16755] DEBUG: Program is licensed.
2014-10-28 11:07:48.992 hazelworker[16755] DEBUG: Unexpected type for Mail download URL: (null)
2014-10-28 11:07:48.999 hazelworker[16755] DEBUG: Could not find entry for default_directory in Chrome preference file.
2014-10-28 11:07:49.005 hazelworker[16755] Processing folder CARPETA 1
2014-10-28 11:07:49.005 hazelworker[16755] DEBUG: Initialized
2014-10-28 11:07:49.005 hazelworker[16755] DEBUG: Pausing to wait for things to settle down.
2014-10-28 11:07:51.104 hazelworker[16755] DEBUG: Processing directories: (
    "/Users/edenexposito/Desktop/CARPETA 1"
)
2014-10-28 11:07:51.106 HazelHelper[9196] DEBUG: Checking events for path /Users/edenexposito/Desktop/CARPETA 1, folder <ComNoodlesoft_HazelConcreteFolder: 0x7f8f15f23d90> "CARPETA 1"
2014-10-28 11:07:51.107 hazelworker[16755] DEBUG: Received file event: {
    date = "2014-10-28 10:07:48 +0000";
    path = "<ComNoodlesoft_NoodlePathSet: 0x7f97b3b01bd0> - (\n    \"/Users/edenexposito/Desktop/CARPETA 1\"\n)";
}
2014-10-28 11:07:51.107 hazelworker[16755] DEBUG: About to process directory /Users/edenexposito/Desktop/CARPETA 1
2014-10-28 11:07:51.108 hazelworker[16755] DEBUG: .DS_Store: File is hidden/invisible. Skipping.
2014-10-28 11:07:51.109 hazelworker[16755] DEBUG: Writing out DB file: /Users/edenexposito/Desktop/CARPETA 1

[Mr_Noodle]

I think the problem is that Hazel looks for the word "copy" but it's not localized so it won't pick it up in other languages (e.g. "copia"). I'm not sure if there's a generic way of picking that type of thing up. I'll have to look into it.

[edenexposito]

I think the problem is that Hazel looks for the word "copy" but it's not localized so it won't pick it up in other languages (e.g. "copia"). I'm not sure if there's a generic way of picking that type of thing up. I'll have to look into it.

As you can see in screencast I think that, for this reason I have rename some files other name schemes before: filename-#.ext , filename (#).ext.

None of these "normal" name schemes had been affected neither. I supposed that files (filename-#.ext , filename (#).ext) will be affected correctly but nothing has happened

[Mr_Noodle]

The naming schemes depend on which programs use that folder. If you click the + button to add a folder, you'll notice a pulldown called "Quick folders". That shows folders that Hazel recognizes which certain programs use. Each of those programs have a way of renaming files if the filename already exists but it only kicks in for the folders those programs have specified.

Also, that rule only affects when the file is moved. It won't remove anything after the file has already been moved and renamed.

[edenexposito]

The naming schemes depend on which programs use that folder. If you click the + button to add a folder, you'll notice a pulldown called "Quick folders". That shows folders that Hazel recognizes which certain programs use. Each of those programs have a way of renaming files if the filename already exists but it only kicks in for the folders those programs have specified.

Maybe I'm wrong but I understand that you are referring to "Duplicate files" from section "Throw away"



I understand that the section "Throw away" have a strong relationship with "Quick folders" and as you say "Hazel recognizes which certain programs use. Each of those programs have a way of renaming files if the filename already exists but it only kicks in for the folders those programs have specified."

But I'm referring now to Hazel actions "move", specifically option "Throw away if duplicate".



You say:

Also, that rule only affects when the file is moved. It won't remove anything after the file has already been moved and renamed.

I suppose that action "move" with "Throw away if duplicate" active should not move duplicate files.

I'm correct?

[Mr_Noodle]

Your video had a rule where you throw away duplicates on move. That only happens during the move operation. It doesn't do anything after the move (like when you renamed the files). That checkbox is different in that it will operate on files in the source folder.

[edenexposito]

I want do this only "throw away duplicates on move" but seems that this no happen. I dont want do anything after only avoid move file if duplicate. I try expose that in video. You don't see any strange behavior in that?

[Mr_Noodle]

It's hard for me to tell exactly what is happening there. It looks like you are editing the names of the files which confuses the issue. Are the files actual duplicates in that they have the same contents?

[edenexposito]

It's hard for me to tell exactly what is happening there. It looks like you are editing the names of the files which confuses the issue. Are the files actual duplicates in that they have the same contents?

Yes in screencast the files are been duplicate with ⌘+D in Finder. I don't touch the name of couple of them ("filename copia #") but for to test purpose i have rename some files with different name scheme ("filename-#" and "filename (#)"). The issue is that none of them is considered a duplicate by Hazel when all of them are duplicates. I made the same test in 3.2.7 a couple of weeks ago and would swear that worked well avoid copy duplicates (the filename seemed no matter).

[Mr_Noodle]

The rule you created doesn't affect files you made. It only applies at the time the move is happening and only affects the file being moved or the existing file, depending on your settings.

The checkbox on the other hand, does affect the files sitting there, but only on the source folder, not the destination. And it is dependent on the programs which use that folder as mentioned earlier.

[edenexposito]

The rule you created doesn't affect files you made. It only applies at the time the move is happening and only affects the file being moved or the existing file, depending on your settings.

In video you can see that the rule with action "Move" (with option Throw away if duplicate checked) is active in folder "Carpeta 1", after duplicate and rename files (in folder "Carpeta 2") I move manually duplicate files (less source file) to Carpeta 1 to being affected by this rule.

Teorically (I tought) when this rule runs Hazel must see the source file in folder "Carpeta 2" and then know that the files that are being procesed are duplicates of the existing file, and then don't move.

I'm correct?

The checkbox on the other hand, does affect the files sitting there, but only on the source folder, not the destination. And it is dependent on the programs which use that folder as mentioned earlier.

When you refer to "checkbox" here your are talking of "Duplicate files" in section "Throw away" or "Throw away if duplicate" in action "move"???.

Both are checkboxes. (By context I Suppose that you refer "Duplicate files" in section "Throw away"). In that case I know that this section is special and is program dependent, but as you can see in video i don't use it. Questions are allways about over "Throw away if duplicate" in action "move".

[Mr_Noodle]

Maybe you need to post a new video as, again, as mentioned earlier, you copying the files manually obscures whatever issue you are seeing. If you can show me Hazel moving the file without you doing anything else to the files and also showing the rule in the same video, that would be a much better illustration of the problem.

Also, in text, specify which file (the exact name) is being copied over and what you expect to see at the destination.

[Mr_Noodle]

Ok, I'm tracing through the code and I think I found a problem related to this. I'll put a fix in for the next patch. If you have time and can do the video, send it over so I can make sure your particular case is the same one.

[Mr_Noodle]

Actually, thinking about it more, maybe you should email support. Since you have a few bugs outstanding, maybe it's better if I send you a test build so you can confirm the fixes. If you have the time, that is.