Data warehouse: Amazon Sales

Small project about data warehouse

Resources

• Amazon Sales Report Note: Install data and move it to data folder

Installation

Create python env

  python -m venv my-env

Install packages

  pip install -r requirements.txt

Running Airflow & Database

  MacOS: docker-compose up
  Window: docker compose up

Access Database

  # Access container
  docker exec -it <container_id_or_name> bash

  # Access psql
  psql -U <username> -d <database_name>

Create User in Airflow

  airflow users create \
    --username john_doe \
    --firstname John \
    --lastname Doe \
    --role Admin \
    --email [email protected] \
    --password abc

Data pipeline

  initial_database >> insert_data_to_db >> create_dim >> create_fact