You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Jun 29, 2021. It is now read-only.
sdesikan6 edited this page Feb 11, 2018
·
1 revision
Ingesting data into SNAP
There are two parts to indexing data
Indexing past data( historical from past X months/years)
Indexing new data as it comes in
There may be cases where you want to go back and re-index old data as well.
Once you have created an OLAP index, inserting data into the index is done as follows.
insert olap index sales_snap of sales_demo partitions order_year = “2016” order_month = “03”``
insert overwrite olap index sales_snap of sales_demo partitions order_year = “2016” order_month = “03”``
To index past historical data across all partitions or if your data is not partitioned you can use
insert overwrite olap index sales_snap of sales_demo
The overwrite is used when you want to reindex an existing partition or recreate the entire index.