Ingesting logs using Grafana Loki push API

You can receive logs from Grafana Agent or Promtail using the OpenTelemetry Collector Loki receiver and then export the data to Uptrace using the OpenTelemetry protocol.

OpenTelemetry Collector

OpenTelemetry Collector is an agent that pulls telemetry data from systems you want to monitor and sends it to tracing tools using the OpenTelemetry protocol (OTLP).

You can use OpenTelemetry Collector to monitor host metrics, PostgreSQL, MySQL, Redis, and more.

Loki receiver

The Loki receiver implements the Loki push api as specified here. It allows Promtail instances to specify the Open telemetry Collector as their lokiAddress.

To receive logs from Promtail and export them to Uptrace, add the following to your OpenTelemetry Collector configuration file:

yaml

receivers:
  loki:
    protocols:
      http:
      grpc:
    use_incoming_timestamp: true

exporters:
  otlp/uptrace:
    endpoint: api.uptrace.dev:4317
    headers:
      uptrace-dsn: '<FIXME>'

processors:
  batch:

service:
  pipelines:
    logs:
      receivers: [loki]
      processors: [batch]
      exporters: [otlp/uptrace]

You can then configure Promtail to export data to OpenTelemetry Collector:

yaml

clients:
  - url: http://otelcol:3500/loki/api/v1/push

FlientBitFluentBit is an open-source and multi-platform log processor and forwarder that allows you to collect data/logs from different sources, unify and filter them, and send them to multiple destinations.

VercelVercel is a cloud platform that provides serverless deployment and hosting for web applications. It provides a seamless way to build, deploy and scale websites or web applications with a focus on front-end development.