git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: How to model massive nested data


This is not directly relevant here, but has anyone looked into oamap (
https://github.com/diana-hep/oamap ), which is capable of using numba to
compile python functions which traverse nested data structures down to the
basic leaf nodes, without creating intermediate python objects. Then the person
doing the analysis may not need to go to C++ at all. oamap has POC loaders
for arrow and parquet, but it’s original focus was ROOT, from the high-energy
physics world.



—
Martin Durant
martin.durant@xxxxxxxxxxx