Data Transports

Panther integrates with various common data transport log ingestion sources

Overview

A Data Transport is a type of log source that is used to send log types that are not natively supported by Panther. Data Transports aim to successfully process custom data types through Panther’s log processing pipeline, map existing detections to custom data types, and map data models to custom data types. In addition to using a Data Transport to onboard your custom logs, you'll need to create a custom schema to normalize and classify the data.

Panther Supported Data Transports

Panther currently supports the following Data Transport methods:

• HTTP (Webhook)

• AWS

  • S3

  • CloudWatch

  • SQS

    • SNS

  • Amazon EventBridge

• Google Cloud

  • Cloud Storage (GCS)

  • Pub/Sub

• Azure Blob Storage

Ingesting compressed data in Panther

The following Data Transport mechanisms support ingesting compressed data (according to one of the below algorithms):

• HTTP
• Azure Blob Storage
• AWS S3
• GCS

Panther will transparently decompress compressed data, meaning no extra headers are required. Panther's decompression works by first determining the compression algorithm each file was compressed with. This is not inferred from the file extension or metadata, but rather the content of the file itself.

The inner data of a compressed payload must match the stream type you've configured for your Data Transport source.

Supported compression algorithms

Panther supports the following compression formats:

• Gzip
• Zstd

  • Note: Panther only supports Zstd data that was compressed without the use of a dictionary.

Troubleshooting Data Transports

Visit the Panther Knowledge Base to view articles about data transports that answer frequently asked questions and help you resolve common errors and issues.