git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Questions about lattice


Our team is also looking into using lattice to improve the performance of our applications that are built on top of calcite. We also have the concern of the in memory limitation concern. It’ll be really nice if we could make use of some external cache options. 

I wonder if there’s any production seriously using calcite’s lattice capability. 

-JD

> On May 3, 2018, at 10:56 AM, Zhongwei Wu <zhwwu@xxxxxxxxxxx> wrote:
> 
> Hello –
> 
> I am new to calcite, and I am looking at using lattice to speed up OLAP query against a SQL compatible database.
> 
> I do have a couple of questions I hope someone with deep knowledge of calcite can shed some lights on.
> 
>  1.  My understanding is tile is materialized in-memory, and it is natural to wonder if there is any provider model in place to choose an external cache/storage to manage materialized aggregates (and share them among connections) for the purpose of scale in a cluster environment.
>  2.  I can manage populating aggregates in a SQL table or view as part of my nightly ETL process, so what is the best way to use calcite lattice only for query optimization and rewrite, but not for aggregates materialization.
> 
> Thanks in advance.
> --Zhongwei
>