[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: Java compatibility issues with parquet-mr project

Hi Masayuki,

I changed the arrow version to be 0.1.0 on my project and managed to continue pass the error

I'll need to continue to monitor this so I can use newer arrow versions later on


-----Original Message-----
From: Masayuki Takahashi <masayuki038@xxxxxxxxx> 
Sent: Wednesday, 8 August 2018 13:07
To: dev@xxxxxxxxxxxxxxxx
Subject: Re: Java compatibility issues with parquet-mr project

Hi Tal,

parquet-arrow version 1.10.0 depends arrow-(vector|memory|format)-0.1.0.jar.;;sdata=xwqOCk7b3PGaUBg0To4oAlpPFIGKjoKXYwzEiHpxsAE%3D&amp;reserved=0

I upgraded arrow version to 0.8.0(PARQUET-1128), but reported Java version mismatching between arrow and parquet later(PARQUET-1278).;;sdata=O785wAeMolNYWBeLW0xG3OczP8HesoDvTMnMx2o6LoU%3D&amp;reserved=0;;sdata=p4lj5m9f8SbMIoVBg2ZKlqfIB50UPwDsDLt89iWyPxM%3D&amp;reserved=0

Although PARQUET-1128 is merged to parquet-mr master branch,
PARQUET-1278 is still opened.

I have tried to change the parquet-arrow dependencies from arrow-0.8.0 to arrow-0.10.0 of master.
But compile failed since added ArrowType to FixedSizeBinary. It may need to implement some methods for it.

Sorry I could not suggest to address this issue right now.

2018年8月8日(水) 17:42 Tal Yaniv <TalY@xxxxxxxxxx>:
> Hi,
> I’m still facing issue – 
> 9e9e25bc%7C1&amp;sdata=pCMKRjBRAZfTlbh2ZsEq2SVVj3s4lephLxcO9s4XvVY%3D&
> amp;reserved=0
> Although working with JDK 1.8 , Arrow version 0.10.0 and parquet-arrow 
> version 1.10.0
> Error occurs when trying to create SchemaConverter
> Any idea what else need to be done?
> Thanks,
> TY

高橋 真之