Skip to content

Example on how to load nested data, starting from non-nested (CSV) data

License

Notifications You must be signed in to change notification settings

rcongiu/spark-nested-example

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Creating nested data programmatically in spark

code example to show how to load nested data (usually in parquet) starting from flat data.

Building

sue sbt (sbt package)

Running

You need to change the file locations in your code but you can run the submit.sh script after you build the example.

About

Example on how to load nested data, starting from non-nested (CSV) data

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published