Cloud data pipeline documentation

Master the architectural design and operational routing of modern observability pipelines. This collection showcases event-driven data flows through a combination of detailed ingestion API references, high-fidelity visual diagrams, and standard operating procedures for building resilient event streams.

📄️Before you begin

Prerequisites, tooling, and context for working with Datadog log pipelines and Galileo large language model (LLM) observability.

📄️Event streams and observability pipelines

Conceptual overview of event streams, observability pipeline architecture, and how Datadog and Galileo fit into a modern telemetry stack.

📄️Log Ingestion API

API reference for sending log and event data into Datadog for processing, pipeline routing, and downstream delivery.

📄️Route cloud app logs

Step-by-step guide to sending a JSON log from a cloud app into the pipeline and verifying ingestion.

📄️Create a Postman mock server

Set up a Postman mock server to simulate the Datadog Log Ingestion API. Test request formats and pipeline workflows without sending live data.