Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New features for upcoming version 4 #262

Merged
merged 27 commits into from
Aug 17, 2024
Merged

New features for upcoming version 4 #262

merged 27 commits into from
Aug 17, 2024

Conversation

lonvia
Copy link
Member

@lonvia lonvia commented Aug 17, 2024

This adds the API changes and new features for the upcoming new major version:

  • persistent OSM objects: handlers can now add information to objects to be used by later handlers
  • new filters: TagFilter, EntityFilter, IdFilter (Provide pre-filtering by id, tags etc. #218), GeoInterfaceFilter (Python __geo_interface__ support #11)
  • improved SimpleWriter
    • can be used as a Handler
    • can be used as context manager
    • new overwrite parameter to automatically overwrite files
    • generic add() function that takes any object
  • improved FileProcessor
    • allow separate filters for area processing
    • new handler for filtered objects
  • new BackReferenceWriter and ForwardReferenceWriter which automatically complete file with referenced objects
  • expose osmium's IdSet
  • new haversine function for two points

Documentation and usage examples fof these new features to follow.

@lonvia
do not release GIL
7611dd7 
Costs up to 10% performance.
@lonvia
make Python wrappers around osmium objects persistent
43d255d 
Python wrappers now stay alive throughout handler chains.
This allows to carry over information from one handler to
the next.

Also generalizes reporting for enabled types.
@lonvia
split out FileProcessor tests
713500d
@lonvia
add tests for passing extra data
72d43af
@lonvia
disallow overwriting attributes read from osmium buffer
8fdb4a8
@lonvia
add haversine functions for two points
851681d
@lonvia
add direct access to lat/lon for nodes
3664d5d
@lonvia
add entity filter
99c4220
@lonvia
add tag filter
704e519
@lonvia
simplify internal module structure
68fa406 
area and filter don't need extra Python module code.
@lonvia
add ID filter
c62d3b5
@lonvia
use keyword args for SimpleWriter
61b620d 
This is backwards compatible but allows more flexibility to add new
parameters.
@lonvia
make Reader and SimpleWriter context managers
3cd53b2
@lonvia
add overwrite parameter to simple writer
0cfe339
@lonvia
add generic add function to SimpleWriter
180fb27
@lonvia
expose osmium's IdSet
9020a52
@lonvia
move BaseFilter into osmium base module
7dd484f 
This way filters can also be implemented outside the filter module.
@lonvia
add Id tracker
ad9ef05
@lonvia
add special writer for including backreferences
5e977c4
@lonvia
add option to change file type to get_updates
cc84490
@lonvia
make SimpleWriter a handler and remove WriteHandler
160f1ba 
Keep an alias for backward compatibility.
@lonvia
add a function to set a handler for filtered objects
6aad78b
@lonvia
defer initialisation of reader in FileProcessor
59d0555 
The reader will immediatedly start reading, thus making the
FileProcessor construction slow. It also means that the FileProcessor
cannot be reused.
@lonvia
split filters for area first pass processing off
ea0657f
@lonvia
add GeoInterfaceFilter
467b7a3
@lonvia
add forward-referencing writer
1188098
@lonvia
CI: work around homebrew oddness
89d0a32
@lonvia lonvia merged commit c20da5a into osmcode:master Aug 17, 2024
21 checks passed
@lonvia lonvia deleted the v4 branch August 17, 2024 18:47
@lonvia lonvia mentioned this pull request Sep 15, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@lonvia