Case Study: NBCUniversal Simplifies Metadata Integration with Etlworks

NBCUniversal Automates Metadata Integration and API Management with Scalable Pipelines in Etlworks.

Introduction

NBCUniversal, a global leader in media and entertainment, needed a robust and scalable solution to integrate metadata for movies and shows from various sources into MongoDB and internal systems. With Etlworks, they implemented flexible pipelines capable of handling data from diverse formats and managing hundreds of thousands of API calls daily, all within a horizontally scalable cluster.

The Challenge

NBCUniversal’s key challenges included:

Data Source Variety: Metadata was provided in multiple formats—CSV, JSON, XML, and Excel—by both internal teams and external partners.

High API Traffic: The system needed to support hundreds of thousands of API calls daily to retrieve metadata for various applications.

Scalability and Performance: As a major media company, NBCUniversal required a solution that could scale horizontally and maintain performance under heavy loads.

Existing solutions lacked the flexibility, scalability, and simplicity needed for these complex requirements.

Why Etlworks

NBCUniversal chose Etlworks for its unmatched flexibility, scalability, and ease of use:

Multi-Format Support: Seamlessly handled metadata in CSV, JSON, XML, and Excel formats.

Scalable Architecture: Etlworks’ horizontally scalable cluster with multiple symmetrical nodes ensured reliability and performance at scale.

Flexible Pipelines: Highly adaptable pipelines made it easy to load data into MongoDB and other internal systems via APIs.

Efficient API Management: Handled hundreds of thousands of API calls daily with ease.

The Solution

NBCUniversal implemented Etlworks to build a comprehensive and scalable metadata integration system:

Flexible Pipelines: Created robust pipelines to ingest data from CSV, JSON, XML, and Excel files, loading it directly into MongoDB and internal systems.

API Integration: Built scalable pipelines to manage and process hundreds of thousands of API calls daily for metadata retrieval.

Horizontally Scalable Cluster: Utilized Etlworks’ multi-node architecture to ensure high availability and handle increasing workloads.

Results

Seamless Metadata Integration: Unified data from diverse formats and sources into MongoDB and internal systems efficiently.

High API Performance: Supported hundreds of thousands of API calls daily, ensuring reliable metadata retrieval.

Scalability: Etlworks’ horizontally scalable architecture allowed NBCUniversal to handle growing data volumes and API traffic effortlessly.

Flexibility: The adaptable pipelines simplified maintenance and quickly accommodated changes in data sources or formats.

Customer Quote

“With Etlworks, we built flexible, scalable pipelines that seamlessly handle diverse data formats and support hundreds of thousands of API calls daily. The horizontally scalable architecture ensures reliable performance as our needs grow, making Etlworks an indispensable part of our data ecosystem.”

Key Takeaways

Multi-Format Integration: Etlworks enabled seamless processing of CSV, JSON, XML, and Excel files from internal and external sources.

Scalable API Management: Efficiently handled hundreds of thousands of API calls daily with a horizontally scalable architecture.

Flexibility and Performance: Etlworks’ adaptable pipelines and clustered architecture met NBCUniversal’s complex requirements effortlessly.

Ready to tackle your most complex data challenges? Discover how Etlworks can transform your data integration workflows. Start your free trial today or request a demo.