Color label rules not working

I have a simple rule on my Downloads folder - if the color label is purple, and the Date Added in not within 2 days then move the file to X folder. Conditions are set to All.
I have tested that the Date added part works by removing the color label section and looked under Rule Preview. Yep. The correct file is tagged as meeting rule criteria.
Then, I switched. I removed the Date added section of the rule, and left: If color label is Purple then Move to folder X. I looked at the Rule preview. No rules match even though there clearly is a file that is color labeled purple in the downloads folder.
What's going on?
I have tested that the Date added part works by removing the color label section and looked under Rule Preview. Yep. The correct file is tagged as meeting rule criteria.
Then, I switched. I removed the Date added section of the rule, and left: If color label is Purple then Move to folder X. I looked at the Rule preview. No rules match even though there clearly is a file that is color labeled purple in the downloads folder.
What's going on?