upload directory or Multiple Files to S3

abhi97660

Hi,

I am using (RM Server and RM Studio) 8.2

I am developing an extension in which I am downloading multiple files (eg: 10 files) sequentially for processing and want to upload processed files to S3

I want to upload whole directory containing these files to S3.

Do we have any operator to upload Directory to S3...? I triedWrite Amazon S3it takes individual file at once but we can useloop files operatorto do that.

如果我want to save upload time,我想上传file as soon as it is downloaded and processed rather than upload all at once.

I triedouputPort.deliver((IOObject) FileObject)method inside the loop but it is waiting for whole process to get completed.

Any suggestions on how to achieve this simultaneously in rapidminer where operator is downloading rest of the files and the already downloaded files can be uploaded...?

Thomas_Ott

@abhi97660I've never done this before but one idea is to connect the RM SFTP operaters to an S3 bucket. You should be able to load up the entire directory then.