Docs Guides Components Download Blog Support
Twitter icon and link
GitHub icon and link
Chat icon and link
RSS icon and link
Docs Guides Components Download Blog Support
Twitter icon and link
GitHub icon and link
Chat icon and link
RSS icon and link
Docs home
About
What is Vector? Concepts
Under the hood
Architecture
Data model
Log events Metric events
End-to-end Acknowledgements Pipeline model Buffering model Concurrency model Runtime Model
Networking
ARC
Guarantees
Setup
Quickstart
Deployment
Roles Topologies
Going to Production
Reference Architectures
Aggregator Architecture Agent Architecture Unified Architecture
Architecting Hardening High Availability Rollout Sizing and Capacity Planning
Installation
Package managers
APT dpkg Helm Homebrew MSI Nix pacman RPM YUM
Platforms
Docker Kubernetes
Operating systems
Amazon Linux Arch Linux CentOS Debian macOS NixOS Raspbian RHEL Ubuntu Windows
Manual
From archives From source Vector installer
Reference
Vector Remap Language
Functions Errors Examples Expressions
Configuration
Sources
AMQP Apache Metrics AWS ECS metrics AWS Kinesis Firehose AWS S3 AWS SQS Datadog agent Demo Logs dnstap Docker logs EventStoreDB metrics Exec File File Descriptor Fluent GCP PubSub Heroku Logplex Host metrics HTTP Client HTTP Server Internal logs Internal metrics JournalD Kafka Kubernetes logs Logstash MongoDB metrics NATS NGINX metrics OpenTelemetry PostgreSQL metrics Prometheus remote write Prometheus scrape Redis Socket Splunk HEC StatsD stdin Syslog Vector
Transforms
Remap with VRL Aggregate AWS EC2 metadata Dedupe Filter Log to metric Lua Metric to log Reduce Route Sample Tag cardinality limit Throttle
Sinks
AMQP AWS Cloudwatch logs AWS Cloudwatch metrics AWS Kinesis Data Firehose logs AWS Kinesis Streams logs AWS S3 AWS SQS Axiom Azure Blob Storage Azure Monitor Logs Blackhole ClickHouse Console Databend Datadog events Datadog logs Datadog metrics Datadog traces Elasticsearch File GCP Chronicle Unstructured GCP Cloud Monitoring (formerly Stackdriver) GCP Cloud Storage GCP Stackdriver GCP PubSub Honeycomb HTTP Humio logs Humio metrics InfluxDB logs InfluxDB metrics Kafka Loki Mezmo (formerly LogDNA) NATS New Relic Papertrail Prometheus Exporter Prometheus remote write Pulsar Redis Sematext logs Sematext metrics Socket Splunk HEC logs Splunk HEC metrics StatsD Vector WebHDFS Websocket
Global options Unit tests Template syntax
API CLI Glossary
Administration
Management Monitoring Tuning Validating

Meta

Security

Releases

Versioning

  1. Vector
  2. Docs home
  3. Reference
  4. Configuration
  5. Transforms

Transforms reference

Shape your data as it moves through your Vector topology

Page source Edit this page

Available transforms

Remap with VRL transform
remap
Modify your observability data as it passes through your topology using Vector Remap Language (VRL)
Aggregate transform
aggregate
Aggregate metrics passing through a topology
AWS EC2 metadata transform
aws_ec2_metadata
Parse metadata emitted by AWS EC2 instances
Dedupe transform
dedupe
Deduplicate logs passing through a topology
Filter transform
filter
Filter events based on a set of conditions
Log to metric transform
log_to_metric
Convert log events to metric events
Lua transform
lua
Modify event data using the Lua programming language
Metric to log transform
metric_to_log
Convert metric events to log events
Reduce transform
reduce
Collapse multiple log events into a single event based on a set of conditions and merge strategies
Route transform
route
Split a stream of events into multiple sub-streams based on user-supplied conditions
Sample transform
sample
Sample events from an event stream based on supplied criteria and at a configurable rate
Tag cardinality limit transform
tag_cardinality_limit
Limit the cardinality of tags on metrics events as a safeguard against cardinality explosion
Throttle transform
throttle
Rate limit logs passing through a topology
Docs home
About
What is Vector? Concepts
Under the hood
Architecture
Data model
Log events Metric events
End-to-end Acknowledgements Pipeline model Buffering model Concurrency model Runtime Model
Networking
ARC
Guarantees
Setup
Quickstart
Deployment
Roles Topologies
Going to Production
Reference Architectures
Aggregator Architecture Agent Architecture Unified Architecture
Architecting Hardening High Availability Rollout Sizing and Capacity Planning
Installation
Package managers
APT dpkg Helm Homebrew MSI Nix pacman RPM YUM
Platforms
Docker Kubernetes
Operating systems
Amazon Linux Arch Linux CentOS Debian macOS NixOS Raspbian RHEL Ubuntu Windows
Manual
From archives From source Vector installer
Reference
Vector Remap Language
Functions Errors Examples Expressions
Configuration
Sources
AMQP Apache Metrics AWS ECS metrics AWS Kinesis Firehose AWS S3 AWS SQS Datadog agent Demo Logs dnstap Docker logs EventStoreDB metrics Exec File File Descriptor Fluent GCP PubSub Heroku Logplex Host metrics HTTP Client HTTP Server Internal logs Internal metrics JournalD Kafka Kubernetes logs Logstash MongoDB metrics NATS NGINX metrics OpenTelemetry PostgreSQL metrics Prometheus remote write Prometheus scrape Redis Socket Splunk HEC StatsD stdin Syslog Vector
Transforms
Remap with VRL Aggregate AWS EC2 metadata Dedupe Filter Log to metric Lua Metric to log Reduce Route Sample Tag cardinality limit Throttle
Sinks
AMQP AWS Cloudwatch logs AWS Cloudwatch metrics AWS Kinesis Data Firehose logs AWS Kinesis Streams logs AWS S3 AWS SQS Axiom Azure Blob Storage Azure Monitor Logs Blackhole ClickHouse Console Databend Datadog events Datadog logs Datadog metrics Datadog traces Elasticsearch File GCP Chronicle Unstructured GCP Cloud Monitoring (formerly Stackdriver) GCP Cloud Storage GCP Stackdriver GCP PubSub Honeycomb HTTP Humio logs Humio metrics InfluxDB logs InfluxDB metrics Kafka Loki Mezmo (formerly LogDNA) NATS New Relic Papertrail Prometheus Exporter Prometheus remote write Pulsar Redis Sematext logs Sematext metrics Socket Splunk HEC logs Splunk HEC metrics StatsD Vector WebHDFS Websocket
Global options Unit tests Template syntax
API CLI Glossary
Administration
Management Monitoring Tuning Validating

Meta

Security

Releases

Versioning

Sign up to receive emails on the latest Vector content and new releases

Thank you for joining our Updates Newsletter

Vector site footer

About

  • What is Vector?
  • Contact us
  • Privacy

Components

  • Sources
  • Transforms
  • Sinks

Setup

  • Installation
  • Deployment
  • Configuration
  • Administration
  • Going to Prod

Community

  • GitHub
  • Twitter
  • Chat

Download

  • Releases
Twitter icon and link
GitHub icon and link
Chat icon and link
RSS icon and link

© 2023 Datadog, Inc. All rights reserved.

Sidebar