- Golang is chosen for its excellent concurrency support, performance, and simplicity, making it ideal for web scraping tasks.
- Colly is a fast and easy-to-use web scraping framework in Go, with built-in support for crawling, data extraction, and parallelism.
- Gin is light-weight, high performance HTTP request handling framework which has in built features of logging, error handling, and authentication.
- Scrape match schedules, team standings, and player stats for IPL.
- Data extraction from official IPL websites or other cricketing platforms.
- Storage of data in JSON format for easy processing and usage.
- Concurrency for scraping large data sets efficiently.
- Fork the Repo
- Clone the Repo:
$ git clone https://github.com/Hari-Kumar-A/web-scraping.git
cd IPL_2024_CSK/
- Install Go Modules( Run the following ):
go mod tidy
- Run the Web Scraper
go run .\IPL_2024_CSK\
- The go server will be running in PORT 8080.

