sorry, yes, you don't have to add any of the Hadoop dependencies. Everything that's needed comes in the presto s3 jar.
You should use "s3:" as the prefix, the Presto S3 filesystem will not be used if you use s3a. And yes, you add config values to the flink config as s3.xxx.
Thanks for pick up my question. I had s3a in the config now I removed it.
I will post a full trace soon, but want to get some questions answered to help me understand this better.
3. If yes, how to do it? Just add s3.xxx to flink-config?
like s3.server-side-encryption-algorithm: AES256
I will post more logs when I get one. Thanks
what are you using as the FileSystem scheme? s3 or s3a?
Also, could you also post the full stack trace, please?
I am trying to figure out how to use S3 as state storage.
Seems like I only have to do two things:1. Put flink-s3-fs-presto to the lib2. Configure
But I see this exception: ClassNotFoundException: NativeS3FileSystem/S3AFileSystem Not Found
Add it is suggested to add more libs.
So I am confused here, is there a step 3 needed? Isn't the presto jar is all self contained?