forked from ckan/datapusher
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
4 changed files
with
101 additions
and
31 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1 @@ | ||
include README.rst | ||
include README.markdown |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,99 @@ | ||
[](https://travis-ci.org/ckan/datapusher) | ||
[](https://coveralls.io/r/ckan/datapusher?branch=master) | ||
[](https://pypi.python.org/pypi/datapusher/) | ||
[](https://pypi.python.org/pypi/datapusher/) | ||
[](https://pypi.python.org/pypi/datapusher/) | ||
[](https://pypi.python.org/pypi/datapusher/) | ||
[](https://pypi.python.org/pypi/datapusher/) | ||
|
||
[PyPI]: https://pypi.python.org/pypi/datapusher | ||
[DataStorer]: https://github.com/ckan/ckanext-datastorer | ||
[DataPusher documentation]: http://docs.ckan.org/projects/datapusher | ||
[CKAN Service Provider]: https://github.com/ckan/ckan-service-provider | ||
[Messytables]: https://github.com/okfn/messytables | ||
|
||
|
||
DataPusher - Automatically add Data to the CKAN DataStore | ||
========================================================= | ||
|
||
DataPusher is a standalone web service that automatically downloads any CSV or | ||
XLS (Excel) data files from a CKAN site's resources when they are added to the | ||
CKAN site, parses them to pull out the actual data, then uses the DataStore API | ||
to push the data into the CKAN site's DataStore. | ||
|
||
This makes the data from the resource files available via CKAN's DataStore API. | ||
In particular, many of CKAN's data preview and visualization plugins will only | ||
work (or will work much better) with files whose contents are in the DataStore. | ||
|
||
To get it working you have to: | ||
|
||
1. Deploy a DataPusher instance to a server (or use an existing DataPusher | ||
instance) | ||
2. Enable and configure the `datastore` plugin on your CKAN site. | ||
3. Enable and configure the `datapusher` plugin on your CKAN site. | ||
|
||
For details see the [DataPusher documentation][]. | ||
|
||
Note that if you installed CKAN using the _package install_ option then a | ||
DataPusher instance should be automatically installed and configured to work | ||
with your CKAN site. | ||
|
||
DataPusher is a replacement for [DataStorer][]. | ||
It's built using [CKAN Service Provider][] and [Messytables][]. | ||
|
||
The original author of DataPusher was | ||
Dominik Moritz <[email protected]>. For the current list of contributors | ||
see [github.com/ckan/datapusher/contributors](https://github.com/ckan/datapusher/contributors) | ||
|
||
|
||
## Development | ||
|
||
To install DataPusher for development: | ||
|
||
```bash | ||
git clone https://github.com/ckan/datapusher.git | ||
cd datapusher | ||
pip install -r requirements-dev.txt | ||
``` | ||
|
||
To run the tests: | ||
|
||
```bash | ||
nosetests | ||
``` | ||
|
||
To build the documentation: | ||
|
||
```bash | ||
python setup.py build_sphinx | ||
``` | ||
|
||
## Releasing a New Version | ||
|
||
To release a new version of DataPusher: | ||
|
||
1. Increment the version number in [setup.py](setup.py) | ||
|
||
2. Build a source distribution of the new version and publish it to | ||
[PyPI][]: | ||
|
||
```bash | ||
python setup.py sdist | ||
python setup.py sdist upload | ||
``` | ||
|
||
You may want to test installing and running the new version from PyPI in a | ||
clean virtualenv before continuing to the next step. | ||
|
||
3. Commit your setup.py changes to git, tag the release, and push the changes | ||
and the tag to GitHub: | ||
|
||
```bash | ||
git commit setup.py -m "Bump version number" | ||
git tag 0.0.1 | ||
git push | ||
git push origin 0.0.1 | ||
``` | ||
|
||
(Replace both instances of 0.0.1 with the number of the version you're | ||
releasing.) |
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters