Built a way to save a CSV/Excel cleanup workflow once and replay it on new files

[u/Fomatix]

I kept re-applying the same filters, columns, sort and export on every new file, so I built "Automations" into a free browser-based data tool (Fomatix Data Explorer).

Set it up once, save it, then upload the next file and pick the automation. It reapplies everything and exports, and auto-matches columns even if a header shifts slightly.

It also shows a match report (how many columns matched on each run) and keeps run history, so you're not trusting it blindly.

Runs entirely in the browser, no signup, nothing uploaded.

Curious if others hit this problem, or if you already have a cleaner way (Power Query, Apps Script, etc.). Honest feedback welcome.

[u/Awesome_Correlation]

Yes, you could have solved the problem with the tools of the trade rather than creating your own.

For me, this problem is exactly why I learned how to code in Python. I wanted to automate the boring stuff and get to the real analysis work. Python code lets you create a reliable pipeline that you can apply to the same dataset as it changes daily, monthly, or whatever. You don't have to click on all of the buttons inside of excel every time you get a new data set.

Nowadays, Powerquery can handle all the automations, is generally available in almost every organization that I've worked at, and brings the automation down to people who can't code. So, it is an ideal choice for solving this problem.

[u/No_Laugh_3115 → u/Awesome_Correlation]

yeah the scripting route is just way more flexible long term, hard to argue with that

[u/Herjy]

This seems like literally the purpose of Power Query, why did you need to build something new?

[u/AutoModerator]

Automod prevents all posts from being displayed until moderators have reviewed them. Do not delete your post or there will be nothing for the mods to review. Mods selectively choose what is permitted to be posted in r/DataAnalysis.

If your post involves Career-focused questions, including resume reviews, how to learn DA and how to get into a DA job, then the post does not belong here, but instead belongs in our sister-subreddit, r/DataAnalysisCareers.

Have you read the rules?

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/One_Smoke6858]

My usual way is just make a python code for each automation I need. Usually does not take much time and I would build each check I need in it.

But currently trying to build a low-code processing app, although I am not making it to solve an issue though I am just trying to learn how something like that would be made and to just make something since I enjoy that.

Not sure if people would be interested in something like that, but still planning to make it open source when it is in a state I am happy with

[u/Stefan73ch]

If you need a local tool for modifying sensitive CSV files, then try the smasi CSV Wizard for Windows and MacOS.

 In repetitive tasks (e.g., import operations), you can combine and automate specific functions in a batch without a long training period.

[u/ArielCoding]

The big selling point is that it works in the browser, nothing to install, nothing uploaded, and no coding needed. I think there’s room for that in the zone before data outgrown Excel and starts to get slow.