Skip to content

Commit

Permalink
Simplify retrieve (#420)
Browse files Browse the repository at this point in the history
* parallelize validate

* use fixed annotate query param from delta to reduce retrieval to max 2 requests instead of 4

* rm redundant

* drop async request for one retrieve

* force close tcp connection

* client session per task

* retrieve schema when loading shapes, todo figure out when to call retrieve for ontologies

* retrieve schema, if fail retrieve resource

* fix flag

* rm retrieve schema specialized call after extension of delta's retrieve resource endpoint

* batch resources per client session

* cleanup

* session timeout

* rm threadpool exec

* cleanup

* lint

* bump request v

* rm retrieve schema implementation
  • Loading branch information
ssssarah authored Oct 2, 2024
1 parent 4a0ee65 commit ff61956
Show file tree
Hide file tree
Showing 4 changed files with 222 additions and 251 deletions.
2 changes: 1 addition & 1 deletion kgforge/specializations/models/rdf_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@

DEFAULT_TYPE_ORDER = [str, float, int, bool, datetime.date, datetime.time]

VALIDATION_PARALLELISM = None
VALIDATION_PARALLELISM = 10


class RdfModel(Model):
Expand Down
Loading

0 comments on commit ff61956

Please sign in to comment.