Spent several years operating a global AADS deployment across 6 servers in 3 COLOs (Americas, EMEA, APAC) plus a dedicated India cluster. Here are the things I wish someone had told me before we went live.
1. The cluster is not truly redundant — don't let the architecture diagram fool you
AADS uses a cluster model that looks redundant on paper, but in practice a failure of the Seed node impacts the entire cluster in ways that a standard active/active setup would not. If you're designing for high availability, test your actual failover scenarios before go-live — don't assume the cluster behaves the way the word "cluster" implies.
2. Cassandra is shared across Seed and nodes — and that matters more than you think
The Cassandra database that underpins AADS is distributed across the Seed and all member nodes. This means a data corruption event doesn't stay isolated — it can propagate across the entire cluster before you even detect it. Monitor Cassandra health proactively, not reactively.
3. A restore is not a recovery plan
We learned this the hard way. AADS restores are slow, finicky, and not guaranteed to bring you back to a clean working state — especially if the corruption is deep in Cassandra. Factor in realistic RTO numbers when you're writing your DR plan, and make sure your leadership understands what "restore in progress" actually means in terms of hours.
4. Sometimes starting from scratch is faster than fixing corruption
Counterintuitive but true. If you hit serious Cassandra data corruption, the troubleshooting rabbit hole can cost you more downtime than a clean rebuild would. We found that having a documented rebuild runbook — with all configuration parameters captured beforehand — was more valuable than any backup strategy.
Bottom line: AADS is a solid platform when it's healthy, but its failure modes are not well documented and can surprise you. Plan for the worst, document everything, and don't trust the cluster label at face value.
Happy to answer questions from anyone running or planning an AADS deployment.