Skip to content

parth-ghinaiya/MADE-ETL-Pipeline

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

52 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Analysis Report: Correlations of Gold Price and Crude Oil Price Among Major Economies (1983-2020)

Overview

This project focuses on analyzing the correlations between gold prices and crude oil prices across major economies from 1983 to 2020. The dataset for this analysis is sourced from Kaggle, and authentication is required to access the dataset.

Technologies Used

  • Python: Data analysis and visualization are performed using Python programming language.
  • Pandas: For data manipulation and analysis.
  • Matplotlib and Seaborn: Used for creating visualizations to better understand the trends.
  • Kaggle API: Utilized for accessing the dataset.

Kaggle Authentication

To access the dataset from Kaggle, follow these steps:

  1. Go to Kaggle Account Settings.
  2. Download your Kaggle API key as a kaggle.json file.
  3. Place the kaggle.json file inside the /project/ directory.

Filepath: /project/kaggle.json

{
  "username": "par****a",
  "key": "dc5c*******************01"
}

Set Execute Permissions for the Pipeline Script

Before running the analysis pipeline, ensure that the pipeline script has execute permissions. Run the following command:

chmod +x ./project/pipeline.sh

Run the Analysis Pipeline

Navigate to the project directory and execute the pipeline script:

cd project && ./pipeline.sh

Set Execute Permissions for the Test Pipeline Script

If you want to run the test pipeline, grant execute permissions to the test script:

chmod +x ./project/tests.sh

Run the Test Pipeline

Navigate to the project directory and execute the test script:

cd project && ./tests.sh

Analysis Report

Explore the detailed analysis report here.

This project aims to provide insights into the relationships between gold and crude oil prices, offering a comprehensive analysis of economic trends over the specified period. Feel free to explore and contribute to the analysis.

About

Template repository for the Methods of Advanced Data Engineering course at FAU

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 96.6%
  • Python 3.2%
  • Shell 0.2%