Evictions and Monitoring TTL for Real-time Recommendations | Real-time Data Summit 2024

Albert Autin, Lead for Database Reliability Engineering, The Trade Desk, talks about the issues of evictions and storage in data management. Try Aerospike Cloud for free: https://auth.control.aerospike.cloud/...

Discover a compelling behind-the-scenes look at handling data evictions, TTL monitoring, and storage optimization in large-scale, high-throughput environments.

In this technical talk, Albert discusses a real-world incident where The Trade Desk ran out of storage on their deduplication namespace, impacting their billing system due to unexpected data evictions. Learn how his team responded, the strategies they implemented to maintain data accuracy, and how they now intentionally run storage at full capacity for optimal hardware utilization.

You’ll also discover:
✅ Why recency in data is crucial for AdTech performance
✅ How eviction-based architectures enable 100% storage utilization
✅ The benefits of pairing Aerospike TTL metrics with Prometheus heatmaps and histograms
✅ How to be both reactive and strategic with real-time and projected capacity planning
✅ The design and use of a custom TTL Prometheus exporter for visibility into record aging

This video is ideal for SREs, platform engineers, data infrastructure architects, and anyone working with NoSQL databases, especially Aerospike, Cassandra, or ScyllaDB.

📌 Tools & Concepts Covered:

Aerospike Evictions

LRU Caching

Deduplication Storage

TTL Metrics & Observability

Prometheus Monitoring

Strategic Capacity Forecasting

Distributed Systems in Ad Tech

Explore Aerospike: https://www.aerospike.com

Aerospike Database
https://aerospike.com/products/database/

Aerospike Documentation Guide
https://aerospike.com/docs/

Build with Aerospike
https://aerospike.com/docs/develop/

#DatabaseReliability #Aerospike #StorageOptimization