- Print
- DarkLight
This documentation version is deprecated, please click here for the latest version.
Article summary
Did you find this summary helpful?
Thank you for your feedback
Overview
This adapter allows you to ingest files/blobs stored in AWS S3.
Note that this adapter operates as a sink by default, meaning it will "consume" files from the S3 bucket by deleting them once ingested.
Configurations
Adapter Type: s3
client_options
: common configuration for adapter as defined here.bucket_name
: the name of the bucket to ingest from.access_key
: an Access Key from S3 used to access the bucket.secret_key
: the secret key associated with theaccess_key
used to access the bucket.prefix
: only ingest files with a given path prefix. Do not include a leading/
in the prefix.single_load
: iftrue
, the adapter will not operate as a sink, it will ingest all files in the bucket once and will then exit.
API Doc
See the official documentation.
Was this article helpful?