git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (ARROW-2555) [Python] Provide an option to convert on coerce_timestamps instead of error


Uwe L. Korn created ARROW-2555:
----------------------------------

             Summary: [Python] Provide an option to convert on coerce_timestamps instead of error
                 Key: ARROW-2555
                 URL: https://issues.apache.org/jira/browse/ARROW-2555
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
            Reporter: Uwe L. Korn
             Fix For: 0.10.0


At the moment, we error out on {{coerce_timestamps='ms'}} on {{pyarrow.parquet.write_table}} if the data contains a timestamp that would loose information when converted to milliseconds. In a lot of cases the user does not care about this granularity and rather wants the comfort functionality that the timestamp are stored regardlessly in Parquet. Thus we should provide an option to ignore the error and do the lossy conversion.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)