Skip to content

Latest commit

 

History

History
16 lines (13 loc) · 324 Bytes

README.md

File metadata and controls

16 lines (13 loc) · 324 Bytes

scrapy

set up

cd into working folder
run command to output data into .json file
scrapy crawl event
Todo:
  • Secondary parse to get full description
  • [√] Date parsing to ISO-8601
  • Allow auth to .env variables for DB pipeline
  • Finalize incremental update logic
  • tests