Skip to content
This repository has been archived by the owner on Jun 29, 2021. It is now read-only.

Quick Intro to getting data in SNAP

sdesikan6 edited this page Feb 11, 2018 · 1 revision

Ingesting data into SNAP

There are two parts to indexing data

  • Indexing past data( historical from past X months/years)
  • Indexing new data as it comes in

There may be cases where you want to go back and re-index old data as well. Once you have created an OLAP index, inserting data into the index is done as follows.

insert olap index sales_snap of sales_demo partitions order_year = “2016” order_month = “03”``
insert overwrite olap index sales_snap of sales_demo partitions order_year = “2016” order_month = “03”``

To index past historical data across all partitions or if your data is not partitioned you can use

insert overwrite olap index sales_snap of sales_demo

The overwrite is used when you want to reindex an existing partition or recreate the entire index.

SNAPIndexing- A video overview

Clone this wiki locally