- Print
- DarkLight
Article Summary
Share feedback
Thanks for sharing your feedback!
Overview
This adapter allows you to ingest files/blobs stored in AWS S3.
Note that this adapter operates as a sink by default, meaning it will "consume" files from the S3 bucket by deleting them once ingested.
Configurations
Adapter Type: s3
client_options
: common configuration for adapter as defined here.bucket_name
: the name of the bucket to ingest from.access_key
: an Access Key from S3 used to access the bucket.secret_key
: the secret key associated with theaccess_key
used to access the bucket.prefix
: only ingest files with a given path prefix.single_load
: iftrue
, the adapter will not operate as a sink, it will ingest all files in the bucket once and will then exit.
API Doc
See the official documentation.
Was this article helpful?