Skip to content

pivotal/outsourcer

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

README file for Outsourcer
***********************************************************************************
Site: http://www.PivotalGuru.com
Author: Jon Roberts
Email: [email protected]
***********************************************************************************
Outsourcer automates the tasks typically done manually by ETL developers to source 
data from SQL Server and Oracle and load into Greenplum or HAWQ database.  

* Connects to Source databases (SQL Server or Oracle)
* Converts Source DDL to Greenplum/HAWQ syntax and creates target schema and table
* Loads data into Greenplum/HAWQ automatically
* Supports multiple job types:
	* Refresh (truncate and reload)
	* Append (add only new data from source)
	* Replication (tracks changes in the source and applies the changes)
	* Transform (SQL commands to execute in Greenplum/HAWQ)
* Multi-threaded with dynamic number of jobs to execute concurrently
* Scheduler for recurring job execution
* Open Source!
* Automatic data cleansing
* Utilizes gpfdist for fast data loading

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 82.2%
  • Shell 11.2%
  • PLpgSQL 6.6%