git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Do I still need hadoop-aws libs when using Flink 1.5 and Presto?


Hi,

what are you using as the FileSystem scheme? s3 or s3a?

Also, could you also post the full stack trace, please?

Best,
Aljoscha

On 2. Jun 2018, at 07:34, Hao Sun <hasun@xxxxxxxxxxx> wrote:

I am trying to figure out how to use S3 as state storage.

Seems like I only have to do two things:
1. Put flink-s3-fs-presto to the lib
2. Configure
s3.access-key: your-access-key
s3.secret-key: your-secret-key

But I see this exception: ClassNotFoundException: NativeS3FileSystem/S3AFileSystem Not Found


Add it is suggested to add more libs.
So I am confused here, is there a step 3 needed? Isn't the presto jar is all self contained?

Thanks