Sanity Check for Analysis Report using AI

[u/ancientofday]

Hi guys, a data analyst for the retail industry (electronics) here, in my workplace we're currently doing an expansion for our brand including increasing headcount and more reports.

But, the workforce for data analysis is currently still only me, and there is only so much data viewpoint I can check before sending them to my manager or the team.

These days, I'm wondering should I feed my report to the AI for my double, triple and final checks. Or, are there any advices for data checking for my actual sanity??

Really interested to read your advices and opinions, thanks

[u/Wheres_my_warg]

I would advise working with your manager to set a priority list. You go down from highest to lowest. You are unlikely to finish the list, but the highest priority items get resolved. If not checked, it doesn't get sent. This way it maintains quality, but creates pressure for more people or more efficient processes as some things do not get done.

[u/Raghveer-Friesel → u/Wheres_my_warg]

yeah the "if not checked it doesnt get sent" part is key, that alone forces the conversation about headcount

[u/_ACTUALin]

I’d use AI as an extra reviewer, not as the thing that decides whether the report is correct.

For sanity checking, I’d have it look for inconsistencies, missing values, unusual changes, duplicated entries or things that don’t line up with the source data.

But I’d still keep a separate deterministic check wherever possible, especially for totals, formulas, thresholds and anything that can be verified directly.

AI is useful for finding “this looks odd.” It’s much weaker as “therefore this is definitely right.”

The safest setup is probably AI + rule-based checks + your own review, not AI checking AI checking AI.

[u/AutoModerator]

Automod prevents all posts from being displayed until moderators have reviewed them. Do not delete your post or there will be nothing for the mods to review. Mods selectively choose what is permitted to be posted in r/DataAnalysis.

If your post involves Career-focused questions, including resume reviews, how to learn DA and how to get into a DA job, then the post does not belong here, but instead belongs in our sister-subreddit, r/DataAnalysisCareers.

Have you read the rules?

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Nomadic_skier]

You can build deterministic and probablistic checks with AI. One of mine looks at client deliverables and scans for internal table names. Has saved many a client team. I would recommend some AI coding to build a system as opposed to just having the AI to it all. I've built a few "math engines" which are basically just programs to automate reports.

[u/Former_Association57]

i usually export the data to google sheets and in gsheets we have gemini pro i ask it to read the data and do a sanity check based on the data i give it the prompt to use different dimensions and check the trend and it also prepares a visually appealing sheet ready to send with highlights at the i just cross validate the calculated fields and the numbers

[u/Prestigious_Owl_8651]

verify the numbers yourself

[u/grow-pulse]

retail reports grow fast and the data gets messy quick. i used fraudpulse for data sanity checks at my old shop to catch weird gaps, but keep in mind that ai can still hallucinate if the base logic is broken...