git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (ARROW-3899) [Python] Table.to_pandas converts Arrow date32[day] to pandas datetime64[ns]


Wes McKinney created ARROW-3899:
-----------------------------------

             Summary: [Python] Table.to_pandas converts Arrow date32[day] to pandas datetime64[ns]
                 Key: ARROW-3899
                 URL: https://issues.apache.org/jira/browse/ARROW-3899
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
            Reporter: Wes McKinney
             Fix For: 0.13.0


This issue was raised here:

https://github.com/wesm/feather/issues/359

I explored this minimally against Arrow master:

https://gist.github.com/wesm/2ebe0ca2461d1ecfba6185777238ad1f

While it's pretty memory-wasteful, it might be better to preserve the intent of the data type when converting to pandas data structures. It also allows the data to round trip successfully



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)