git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: Java compatibility issues with parquet-mr project


Hi Masayuki,

I changed the arrow version to be 0.1.0 on my project and managed to continue pass the error

I'll need to continue to monitor this so I can use newer arrow versions later on

Thanks,
TY

-----Original Message-----
From: Masayuki Takahashi <masayuki038@xxxxxxxxx> 
Sent: Wednesday, 8 August 2018 13:07
To: dev@xxxxxxxxxxxxxxxx
Subject: Re: Java compatibility issues with parquet-mr project

Hi Tal,

parquet-arrow version 1.10.0 depends arrow-(vector|memory|format)-0.1.0.jar.
https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fparquet-mr%2Fblob%2Fapache-parquet-1.10.0%2Fparquet-arrow%2Fpom.xml%23L36&amp;data=01%7C01%7CTalY%40radcom.com%7Cc96bdbe1473a4c5988fb08d5fd16bf4c%7C0eb9e2d98763412e97093f539e9e25bc%7C1&amp;sdata=xwqOCk7b3PGaUBg0To4oAlpPFIGKjoKXYwzEiHpxsAE%3D&amp;reserved=0

I upgraded arrow version to 0.8.0(PARQUET-1128), but reported Java version mismatching between arrow and parquet later(PARQUET-1278).

https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FPARQUET-1128&amp;data=01%7C01%7CTalY%40radcom.com%7Cc96bdbe1473a4c5988fb08d5fd16bf4c%7C0eb9e2d98763412e97093f539e9e25bc%7C1&amp;sdata=O785wAeMolNYWBeLW0xG3OczP8HesoDvTMnMx2o6LoU%3D&amp;reserved=0
https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FPARQUET-1278&amp;data=01%7C01%7CTalY%40radcom.com%7Cc96bdbe1473a4c5988fb08d5fd16bf4c%7C0eb9e2d98763412e97093f539e9e25bc%7C1&amp;sdata=p4lj5m9f8SbMIoVBg2ZKlqfIB50UPwDsDLt89iWyPxM%3D&amp;reserved=0

Although PARQUET-1128 is merged to parquet-mr master branch,
PARQUET-1278 is still opened.

I have tried to change the parquet-arrow dependencies from arrow-0.8.0 to arrow-0.10.0 of master.
But compile failed since added ArrowType to FixedSizeBinary. It may need to implement some methods for it.

Sorry I could not suggest to address this issue right now.

2018年8月8日(水) 17:42 Tal Yaniv <TalY@xxxxxxxxxx>:
>
> Hi,
>
> I’m still facing issue – 
> https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fjir
> a.apache.org%2Fjira%2Fbrowse%2FARROW-2498&amp;data=01%7C01%7CTalY%40ra
> dcom.com%7Cc96bdbe1473a4c5988fb08d5fd16bf4c%7C0eb9e2d98763412e97093f53
> 9e9e25bc%7C1&amp;sdata=pCMKRjBRAZfTlbh2ZsEq2SVVj3s4lephLxcO9s4XvVY%3D&
> amp;reserved=0
>
> Although working with JDK 1.8 , Arrow version 0.10.0 and parquet-arrow 
> version 1.10.0
>
> Error occurs when trying to create SchemaConverter
>
> Any idea what else need to be done?
>
> Thanks,
> TY
>


--
高橋 真之


( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-arrow-development/msg05425.html on line 126
Call Stack
#TimeMemoryFunctionLocation
10.0006368696{main}( ).../msg05425.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-arrow-development/msg05425.html on line 126
Call Stack
#TimeMemoryFunctionLocation
10.0006368696{main}( ).../msg05425.html:0