Getting started

Simple news data scraping tool for web development project.

Create virtual environment with pipenv

pipenv install

pipenv shell

or virtualenv

Run command

From root directory, run command

scrapy runspider ./spider/zingnews_spider.py --set=FEED_EXPORT_ENCODING=utf-8 -O ./data/raw-data.json

Notice: Some posts may be duplicated, descriptions may have some unexpected escape characters.