Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

recreate full open access data in sqlite3 db format AND expose it to the web using the http range/sqlite hosting "trick" #6

Open
gregsadetsky opened this issue Oct 20, 2023 · 0 comments

Comments

@gregsadetsky
Copy link
Owner

goal: create a front-end "api" to all of the open access data, including the image urls, and host it all for free on github pages as a static site.

plan / how to do it:

  • download latest openaccess datasets from met & chicago (still being distributed as giant csv files..?)
  • merge them with known image urls from this repo
  • shove everything into a sqlite3 database file
  • test/implement/demo a way of querying this database from static/front-end only sites using the technique described here i.e. the database being hosted on github pages as a static file, and sql.js + a lot of magic code doing sql queries against this database over the network using http range requests (i.e. being super efficient in the network queries they do, allowing them to read from the db without downloading the whole file)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant