Skip to content

yossigolan/data-mining-project

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

66 Commits
 
 
 
 
 
 

Repository files navigation

CMP-Mining : CoinMarketCap Data Mining Project

Project by: Aviad ([email protected]) & Yossi Golan ([email protected])

CMP-M is a data mining project, done on popular CoinMarketCap site, one of the most popular crypto-ecosystems sites. The project offers a method of mining data about crypot-coins which are listed on CMP.

Right now the project is in develop and offers only some of its features.

Features:

  • printing information and details for each coin listed in MCP. The information includes short info + statistics of the coin market including prices.

Installation

The project runs on python3. To use the code, download the code .py file and run it using python3. See requirements.txt for list of packages needed to run the code.

pip install -r requirements.txt 

Usage

Use the following command line:

python crypto.py [-h] < coin_name > < data_type > < attribute >

positional arguments:

< coin_name > in which coin are you interested?

(supported coins: bitcoin, ethereum, tether, binance-coin, cardano, dogecoin, xrp, usd-coin, polkadot-new, uniswap
 litecoin, solana, theta)

< data type > specify the type of information: (today, yesterday, history, info, about)

< attribute > specify the attribute based on the type:

  for type 'today': (price, price_change, low, high, volume, volume_market_cap, market_dominance, rank, cap, fully_diluted_market_cap)

  for type 'yesterday': (low, high, open, close, change, volume)

  for type 'history': (7d_low, 7d_high, 30d_low, 30d_high, 90d_low, 90d_high, 52w_low, 52w_high, all_time_low, all_time_high, roi)

How the function works?

First it will create the url out of https://coinmarketcap.com/currencies/ and add the coin name to it. eg:bitcoin - https://coinmarketcap.com/currencies/bitcoin/.

Then it will scrap the information on the page and display it on the screen.

DB Documentation

ERD:

alt text

DataBase name: crypto

Table coins include these columns:

  •               "id INT AUTO_INCREMENT PRIMARY KEY," 
    
  •               "name VARCHAR,"
    

Table coin_price_today include these columns:

  •               "id INT AUTO_INCREMENT PRIMARY KEY," 
    
  •               "coin_id INT," 
    
  •               "price FLOAT," 
    
  •               "price_change FLOAT," 
    
  •               "low FLOAT," 
    
  •               "high FLOAT," 
    
  •               "volume FLOAT," 
    
  •               "volume_market_cap FLOAT," 
    
  •               "market_dominance FLOAT," 
    
  •               "market_cap FLOAT," 
    
  •               "fully_diluted_market_cap FLOAT," 
    
  •               "rank INT," 
    
  •               "data_summery VARCHAR," 
    

Table coin_price_yesterday include these columns:

  •               "id INT AUTO_INCREMENT PRIMARY KEY," 
    
  •               "coin_id INT," 
    
  •               "price FLOAT," 
    
  •               "low FLOAT," 
    
  •               "high FLOAT," 
    
  •               "open FLOAT," 
    
  •               "close FLOAT," 
    
  •               "change FLOAT," 
    
  •               "volume FLOAT,"              
    

Table coin_price_history include these columns:

  •               "id INT AUTO_INCREMENT PRIMARY KEY," 
    
  •               "coin_id INT," 
    
  •               "7d_low FLOAT," 
    
  •               "7d_high FLOAT," 
    
  •               "30d_low FLOAT," 
    
  •               "30d_high FLOAT," 
    
  •               "90d_low FLOAT," 
    
  •               "90d_high FLOAT," 
    
  •               "52w_low FLOAT," 
    
  •               "52w_high FLOAT," 
    
  •               "all_time_low FLOAT," 
    
  •               "all_time_high FLOAT," 
    
  •               "roi FLOAT," 
    

Table coin_information include these columns:

  •               "id INT AUTO_INCREMENT PRIMARY KEY," 
    
  •               "info VARCHAR," 
    

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

License

Free to use :)

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages