Amazon AWS S3

the amazon aws s3 connector allows for seamless integration with aws's secure, durable, and highly scalable object storage service amazon aws s3 is a scalable object storage service that allows users to store and retrieve any amount of data this connector enables swimlane turbine users to automate key s3 operations such as file uploads, downloads, and management of objects and buckets by integrating with amazon aws s3, swimlane turbine users can streamline data management tasks, enforce governance, and enhance incident response workflows without writing any code asset setup this integration authenticates with aws s3 using the following input values prerequisites to utilize the amazon aws s3 connector with swimlane turbine, ensure you have the following aws credentials for authentication region name the specific geographic region where the s3 bucket is hosted obtaining aws credentials to use this integration, you will need to have an aws account and obtain the necessary aws credentials you can obtain these credentials by following the steps below log in to your aws account and navigate to the iam console in the left navigation pane, click on the "users" tab and select the user for which you want to create credentials click on the "security credentials" tab, and then click on "create access key" make sure to save the access key id and secret access key in a secure location, as you will not be able to see the secret access key again after this step if you want to use an aws iam role to access the s3 bucket, you will need to have the arn of the role and an optional external id, if one was specified by the aws account administrator capabilities the aws s3 connector provides the following capabilities delete object download file get buckets get object get objects upload file configurations aws s3 authenticates using aws credentials configuration parameters parameter description type required access key aws access key, see https //docs aws amazon com/general/latest/gr/managing aws access keys html https //docs aws amazon com/general/latest/gr/managing aws access keys html for more information string optional secret key aws secret key, see https //docs aws amazon com/general/latest/gr/managing aws access keys html https //docs aws amazon com/general/latest/gr/managing aws access keys html for more information string optional region name the aws region where you want to create new connections string required role arn optional role arn to assume leave blank unless tasks need to assume a different role see https //docs aws amazon com/sts/latest/apireference/api assumerole html https //docs aws amazon com/sts/latest/apireference/api assumerole html for more information string optional external id external id to assume iam role optional value used for assuming roles can be added, or removed in trusted relationships of target role string optional session token use if a session token is provided when switching roles string optional role session name defaults to sessionfromswimlane \<hash> when no value is provide string optional actions delete object removes a specified object from an amazon s3 bucket, requiring the bucket name and object key as inputs input argument name type required description bucket string required parameter for delete object key string required parameter for delete object mfa string optional parameter for delete object versionid string optional unique identifier requestpayer string optional parameter for delete object bypassgovernanceretention boolean optional parameter for delete object expectedbucketowner string optional parameter for delete object output parameter type description responsemetadata object response data requestid string unique identifier hostid string unique identifier httpstatuscode number status value httpheaders object http headers for the request x amz id 2 string unique identifier x amz request id string unique identifier date string date value server string output field server retryattempts number output field retryattempts example \[ { "responsemetadata" { "requestid" "string", "hostid" "string", "httpstatuscode" 204, "httpheaders" {}, "retryattempts" 0 } } ] download file retrieves a specified file from an amazon aws s3 bucket using the provided bucket name and file key endpoint method get input argument name type required description bucket string required parameter for download file key string required parameter for download file output parameter type description status code number http status code of the response reason string response reason phrase file array output field file example \[ { "status code" 200, "response headers" { "content type" "application/json", "date" "thu, 01 jan 2024 00 00 00 gmt" }, "reason" "ok", "file" { "file data" "string", "filename" "example name" } } ] get buckets retrieve a list of all amazon aws s3 buckets available to the authenticated user output parameter type description responsemetadata object response data requestid string unique identifier hostid string unique identifier httpstatuscode number status value httpheaders object http headers for the request x amz id 2 string unique identifier x amz request id string unique identifier date string date value content type string type of the resource transfer encoding string output field transfer encoding server string output field server retryattempts number output field retryattempts buckets array output field buckets name string name of the resource creationdate string date value owner object output field owner displayname string name of the resource id string unique identifier example \[ { "responsemetadata" { "requestid" "string", "hostid" "string", "httpstatuscode" 123, "httpheaders" {}, "retryattempts" 123 }, "buckets" \[], "owner" { "displayname" "example name", "id" "12345678 1234 1234 1234 123456789abc" } } ] get object retrieves a specified object from an amazon aws s3 bucket using the provided bucket name and key endpoint method get input argument name type required description bucket string required parameter for get object ifmatch string optional parameter for get object ifmodifiedsince string optional parameter for get object ifnonematch string optional parameter for get object ifunmodifiedsince string optional parameter for get object key string required parameter for get object range string optional parameter for get object responsecachecontrol string optional parameter for get object responsecontentdisposition string optional response content responsecontentencoding string optional response content responsecontentlanguage string optional response content responsecontenttype string optional type of the resource responseexpires string optional parameter for get object versionid string optional unique identifier ssecustomeralgorithm string optional parameter for get object ssecustomerkey string optional parameter for get object requestpayer string optional parameter for get object partnumber number optional parameter for get object expectedbucketowner string optional parameter for get object checksummode string optional parameter for get object output parameter type description status code number http status code of the response reason string response reason phrase response object output field response deletemarker boolean output field deletemarker acceptranges string output field acceptranges expiration string output field expiration restore string output field restore lastmodified string output field lastmodified contentlength number response content etag string output field etag checksumcrc32 string output field checksumcrc32 checksumcrc32c string output field checksumcrc32c checksumsha1 string output field checksumsha1 checksumsha256 string output field checksumsha256 missingmeta number output field missingmeta versionid string unique identifier cachecontrol string output field cachecontrol contentdisposition string response content contentencoding string response content contentlanguage string response content contentrange string response content contenttype string type of the resource expires string output field expires websiteredirectlocation string output field websiteredirectlocation serversideencryption string unique identifier example \[ { "status code" 200, "response headers" null, "reason" "ok", "response" { "deletemarker" true, "acceptranges" "string", "expiration" "string", "restore" "string", "lastmodified" "2015 01 01t00 00 00", "contentlength" 123, "etag" "string", "checksumcrc32" "string", "checksumcrc32c" "string", "checksumsha1" "string", "checksumsha256" "string", "missingmeta" 123, "versionid" "string", "cachecontrol" "string", "contentdisposition" "string" } } ] get objects retrieve a list of objects from a specified amazon aws s3 bucket a 'bucket' name is required endpoint method get input argument name type required description bucket string required parameter for get objects delimiter string optional parameter for get objects encodingtype string optional type of the resource maxkeys number optional parameter for get objects prefix string optional parameter for get objects continuationtoken string optional parameter for get objects fetchowner boolean optional parameter for get objects startafter string optional parameter for get objects requestpayer string optional parameter for get objects expectedbucketowner string optional parameter for get objects output parameter type description responsemetadata object response data requestid string unique identifier hostid string unique identifier httpstatuscode number status value httpheaders object http headers for the request x amz id 2 string unique identifier x amz request id string unique identifier date string date value x amz bucket region string output field x amz bucket region content type string type of the resource transfer encoding string output field transfer encoding server string output field server retryattempts number output field retryattempts istruncated boolean output field istruncated contents array response content key string output field key lastmodified string output field lastmodified etag string output field etag checksumalgorithm array output field checksumalgorithm size number output field size storageclass string output field storageclass name string name of the resource prefix string output field prefix maxkeys number output field maxkeys encodingtype string type of the resource example \[ { "responsemetadata" { "requestid" "c5b5w1qcy041z8qz", "hostid" "zcy127cyg9grhk0uekvyzsbphro2dzjefgh84prjhxh1svzgr1jdr8br+kehf/n5u8nltukw0nnlki0w\ ", "httpstatuscode" 200, "httpheaders" {}, "retryattempts" 0 }, "istruncated" false, "contents" \[ { "key" "1737969960000/1/smdrs9c2b/d06b9865 0ead 065d 4ba2 00bdef3f68fe/0/a33adf24f570b06c88a2857d9329bb6f/38501848", "lastmodified" "2025 03 17 20 39 59", "etag" "\\"c4ca4238a0b923820dcc509a6f75849b\\"", "checksumalgorithm" \[ "crc64nvme" ], "size" 1, "storageclass" "standard" }, { "key" "1737969960000/1/smdrs9c2b/d06b9865 0ead 065d 4ba2 00bdef3f68fe/0/a33adf24f570b06c88a2857d9329bb6f/459921059", "lastmodified" "2025 03 17 20 39 56", "etag" "\\"c4ca4238a0b923820dcc509a6f75849b\\"", "checksumalgorithm" \[ "crc64nvme" ], "size" 1, "storageclass" "standard" }, { "key" "1737969960000/1/smdrs9c2b/d06b9865 0ead 065d 4ba2 00bdef3f68fe/0/a33adf24f570b06c88a2857d9329bb6f/50904023", "lastmodified" "2025 03 17 20 39 52", "etag" "\\"c4ca4238a0b923820dcc509a6f75849b\\"", "checksumalgorithm" \[ "crc64nvme" ], "size" 1, "storageclass" "standard" } ], "name" "tds reporting telemetry", "prefix" "", "maxkeys" 1000, "encodingtype" "url", "keycount" 6 } ] upload file uploads a specified file to an amazon aws s3 bucket, requiring the file and bucket name as inputs input argument name type required description file object required file that you want to submit file string required parameter for upload file file name string required name of the resource bucket string required parameter for upload file object name string optional s3 object name if not specified then file name is used output parameter type description success boolean whether the operation was successful example \[ { "json body" { "success" true } } ] response headers header description example content type the media type of the resource application/json date the date and time at which the message was originated thu, 01 jan 2024 00 00 00 gmt