Content Delivery Network analytics

Azure Data Explorer
Azure Logic Apps
Azure Storage

Solution ideas

This article describes a solution idea. Your cloud architect can use this guidance to help visualize the major components for a typical implementation of this architecture. Use this article as a starting point to design a well-architected solution that aligns with your workload's specific requirements.

This solution idea demonstrates low-latency, high-throughput ingestion of large volumes of Content Delivery Network (CDN) logs. You can use this data to create near real-time analytics dashboards.

Architecture

Content delivery network analytics with Azure Data Explorer.

Download a Visio file of this architecture.

Dataflow

  1. Content Delivery Network providers such as Verizon and Fastly ingest huge amounts of CDN logs into Azure Data Explorer to analyze latencies, health, and performance of CDN assets.
  2. Most CDN scenarios ingest data through Azure Storage (Blob or ADLS Gen2), which uses Azure Event Grid and triggers the ingestion pipeline to Azure Data Explorer. Alternatively you can bulk ingest the data using the LightIngest tool. You can also continuously export data to Azure Storage in compressed, partitioned parquet format and seamlessly query that data as detailed in Continuous data export overview.
  3. Azure Data Explorer provides easy to use native operators and functions to process, aggregate, and analyze time series and log data, as well as supply insights at lightning speed. You can build near real-time analytics dashboards using Azure Data Explorer dashboards, Power BI, or Grafana.
  4. Create and schedule alerts and notifications using Azure Data Explorer connector for Azure Logic Apps.

Components

Scenario details

You can use this solution to ingest large volumes of CDN logs for the purpose of creating near real-time analytics dashboards.

Potential use cases

  • Log analytics
  • Time series analytics
  • IoT
  • General-purpose exploratory analytics

Contributors

This article is maintained by Microsoft. It was originally written by the following contributors.

Principal author:

Next steps

For more information, see Azure Data Explorer documentation.