How to do regression testing on complex rule sets?
Posted: Wed Sep 25, 2024 11:41 amI'm trying to fully automate processing of our financial statements, including PDFs from banks, investments, utilities, etc. I have a "Drop Here" folder I can drop PDFs into and Hazel runs it through rules to classify the PDF based on content and then rename it using certain conventions, and moves them to a different "Renamed Files" folder.
There are almost 20 rules now, and I expect this to almost double before I'm done. I'm running into some friction points as I'm adding new rules because I need to confirm all the existing rules continue to work correctly. In addition, these financial institutions will periodically change their PDF formats so I need to stay on top of that.
I'd love to set up test area, e.g. "Drop Here TESTING" folder for input and "Renamed Files TESTING" for output. Then I could debug problems in that setting, and once validated, somehow move the updated rules to the "production" configuration. Is there a way to redirect an entire set of rules to work off of a different input folder AND send their output to a different output folder for testing, and then revert later on?
There are almost 20 rules now, and I expect this to almost double before I'm done. I'm running into some friction points as I'm adding new rules because I need to confirm all the existing rules continue to work correctly. In addition, these financial institutions will periodically change their PDF formats so I need to stay on top of that.
I'd love to set up test area, e.g. "Drop Here TESTING" folder for input and "Renamed Files TESTING" for output. Then I could debug problems in that setting, and once validated, somehow move the updated rules to the "production" configuration. Is there a way to redirect an entire set of rules to work off of a different input folder AND send their output to a different output folder for testing, and then revert later on?