July 14, 2022 | 8 min read
Implementing a Real-Time Analytics Engine Using Big Data Principles
Discover how we helped a client scale their in-transit entertainment system's analytics by building data pipelines using Apache Spark and other big data tools. Our approach included creating a data warehouse with multiple data marts, denormalizing the schema, managing slowly changing dimensions, deduplication, and type conversion. With the new system, the client saw a significant reduction in query response time and improved data-driven decision making.