Run rule when a file is moved OUT of a folder?

I wonder if I can tell hazel to run a rule when I remove a file from a filder on this certain file?
The acute case is: I let hazel set a blue label for all new downloads during the last 24 hours so I can find the newest / just downloaded files in my downloads folder. After 24 hours the label is removed. Fine so far.
Now if I work on the file right after downloading (usual case) and put it to it's destination, it keeps the blue label which I then have to remove manually. I don't like that. Can I tell hazel to remove the color label as soon as I put the file out of the download folder?
Thanks and best regards,
V
The acute case is: I let hazel set a blue label for all new downloads during the last 24 hours so I can find the newest / just downloaded files in my downloads folder. After 24 hours the label is removed. Fine so far.
Now if I work on the file right after downloading (usual case) and put it to it's destination, it keeps the blue label which I then have to remove manually. I don't like that. Can I tell hazel to remove the color label as soon as I put the file out of the download folder?
Thanks and best regards,
V