AWS S3 Destination

​

Supported Data Types

​

Configuration

​

Advanced Options

​

Output Format

• OTLP JSON (default): The OpenTelemetry Protocol format represented as JSON.
• OTLP (Protobuf): The OpenTelemetry Protocol format represented as Protocol Buffers. A single protobuf message is written into each object.
• Sumo Logic (JSON): The Sumo Logic Installed Collector Archive format (logs only).
• Raw payload: Exports the log body as a string (logs only).
• NDJSON (.json.gz): Newline-delimited JSON, gzipped, hourly-partitioned (dt=YYYYMMDD/hour=HH/…). One log record per line. Compatible with Datadog Logs Rehydration, Splunk Generic S3 input, AWS Glue / Splunk FSS3, and other archive readers. (Logs only.)
• Parquet: Apache Parquet files, hourly-partitioned. Compatible with Splunk FSS3, Snowflake, AWS Athena, and other analytics tools. (Logs only.)

​

Snowflake Table Schema for Parquet

CREATE TABLE PARQUET_LOGS (
    Date TIMESTAMP_LTZ,
    Service VARCHAR,
    Source VARCHAR,
    Host VARCHAR,
    Status VARCHAR,
    Message VARCHAR,
    Attributes OBJECT,
    Tags OBJECT
);

​

AWS Credential Configuration

extraEnvs:
  - name: AWS_ACCESS_KEY_ID
    value: "<YOUR AWS ACCESS KEY>"
  - name: AWS_SECRET_ACCESS_KEY
    value: "<YOUR AWS SECRET ACCESS KEY>"