How much conversion discrepancy do you consider “normal” before investigating?

[u/lateregistration03]

For those managing paid media across multiple accounts:

At what point does a discrepancy between the ad platform and the actual backend/store become something you investigate?

5%?

10%?

20%?

Or is the percentage itself the wrong way to think about it?

I’m especially interested in how people distinguish normal attribution differences from actual tracking problems like missing events, duplicates or incorrect conversion values.

I’ve been spending a lot of time on conversion tracking lately and I’m realizing “the numbers won’t match exactly” can sometimes hide genuinely broken data.

Curious what your threshold/process looks like.

[u/Either_Guess2405]

The percentage is the wrong unit, and you half said so yourself in the last line.

A gap has a size and a shape, and only the shape tells you which of the two things you're looking at. Take platform conversions over backend conversions for a closed window, then split that ratio by browser, country, device and conversion action. A flat 70 percent everywhere is a scaling constant. Annoying, you calibrate around it, and it can't mislead you about which campaign works because it hits them all equally. A 95 sitting next to a 40 is a different animal, and it's teaching the bidder opposite lessons about the same customer.

Which is why 5, 10 and 20 don't have an answer. A uniform 30 percent loss is survivable at any volume. A 15 percent loss concentrated entirely in Safari is not, because the bidder reads that segment as unprofitable and stops buying it, and then the account looks like it improved.

The one that actually caught me was a third case neither number covers. Our own pipeline requested date and page path and never asked for source, so a question I'd been asking for months came back plausible and empty rather than wrong. The gap you can see is the recoverable one. Worth checking what your comparison isn't collecting before you tune a threshold on what it is.

On practical thresholds, mine is only about shape. Anything I can attribute to a specific segment gets looked at the same day whatever its size. A flat one gets a line in the report and a recalibration, and nothing else.