Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Translate morph into fix and switch to fix #450

Merged
merged 106 commits into from
Sep 18, 2023
Merged
Changes from 1 commit
Commits
Show all changes
106 commits
Select commit Hold shift + click to select a range
91d31d0
Translate morph into fixes, first steps
TobiasNx Jun 12, 2023
cee2b15
Add sbt-mocha dependency
dr0i Jun 20, 2023
5a7291b
Prepare to succesiv metafix switch (#452)
TobiasNx Jun 21, 2023
94f79b2
Update fixes for lobid organisations
TobiasNx Jun 21, 2023
b09f73f
Update metafacture fix depencendy #452
TobiasNx Jun 21, 2023
15da42c
Add building mf-core 5.5.1-rc1 locally
dr0i Jun 22, 2023
deb3c65
Use Snapshot of metafix
dr0i Jun 22, 2023
61bbc34
Try fix with TransformDbs and TransformSigel
TobiasNx Jun 23, 2023
8571244
Update workflows to make them run
TobiasNx Jun 23, 2023
97d13a3
Update fix-enriched and add local maps
TobiasNx Jun 23, 2023
9a9ceef
Only use fix
TobiasNx Jun 23, 2023
e0de892
Try to reajust dependencies and use RDFConverter from lobid-resources
TobiasNx Jul 3, 2023
1021acc
Rename package
TobiasNx Jul 3, 2023
9753cb1
Use old code from lobid-organisation instead of lobid resources
TobiasNx Jul 3, 2023
318f375
Update fix and TransformALl.java
TobiasNx Jul 3, 2023
a165c6e
Update API description test
TobiasNx Jul 4, 2023
79c35a4
Update .gitignore for better testing
TobiasNx Jul 4, 2023
74ea894
Adjuste email element
TobiasNx Jul 4, 2023
731c665
Fix rdf_lookups in fix-enriched.fix
TobiasNx Jul 4, 2023
e755b4c
Fix rdf lookups
TobiasNx Jul 4, 2023
f6989f2
Use uri-encode
TobiasNx Jul 4, 2023
50be61d
Use prettyPrinted files for better tracking of changes
TobiasNx Jul 4, 2023
fa26784
Out-Comment uri-encode
TobiasNx Jul 4, 2023
3c5de2a
Add morph-output for comparison
TobiasNx Jul 4, 2023
f81218c
Tee json
dr0i Jul 4, 2023
4e05c82
Use option delete for wikidata lookup
TobiasNx Jul 4, 2023
bed1b43
Use blacklist workaround
TobiasNx Jul 4, 2023
abd0873
Redo add_field functions
TobiasNx Jul 4, 2023
5028051
Adjust lookups
TobiasNx Jul 4, 2023
d43c196
Add morph output pretty printed
TobiasNx Jul 5, 2023
a2440e6
update tests
TobiasNx Jul 5, 2023
8819089
Adjust add_field function if not always needed
TobiasNx Jul 5, 2023
c3246b5
Retain @context
TobiasNx Jul 5, 2023
4a2c22a
Fix lookup for addressCountry
TobiasNx Jul 5, 2023
2f86b8e
Fix collects.extent
TobiasNx Jul 5, 2023
a12a802
Fix linkedTo
TobiasNx Jul 5, 2023
e0b9f3b
Fix containedIn link
TobiasNx Jul 5, 2023
8ae0a8c
Fix openingHours
TobiasNx Jul 5, 2023
f0b3c98
Fix mainEntityOfPage.dateModified
TobiasNx Jul 5, 2023
18120fe
Adjust add_field functions
TobiasNx Jul 5, 2023
4078be0
Rename funderType to fundertype
TobiasNx Jul 5, 2023
8d0de1b
Make location mapping more resilient
TobiasNx Jul 5, 2023
93b0295
Revert "Tee json"
TobiasNx Jul 5, 2023
910347d
Fix github actions build
TobiasNx Jul 5, 2023
b74f621
Only create @geoLookupDbs if all element exist
TobiasNx Jul 6, 2023
8d7101d
Iterate over 032P for @rs and @ags
TobiasNx Jul 6, 2023
e26599a
Add vacuum function to fixes
TobiasNx Jul 6, 2023
89322ae
Workaround for uri_encode
TobiasNx Jul 6, 2023
d8f129b
Don't add type if name starts with "früher"
TobiasNx Jul 6, 2023
d313f70
Test data order changed
TobiasNx Jul 7, 2023
e9b8db1
Use https instead of http for https://ld.zdb-services.de #428
TobiasNx Jul 7, 2023
360f249
Reject test-records #269
TobiasNx Jul 7, 2023
afa7886
Add sigil #411
TobiasNx Jul 7, 2023
a9f6396
Add worldcatRegistryId
TobiasNx Jul 10, 2023
979d5d5
Rename "sigil" property to "sigel" #411
TobiasNx Jul 10, 2023
107cb71
Add note[] #458
TobiasNx Jul 10, 2023
34b4228
Add the element `replaces` #457
TobiasNx Jul 10, 2023
f50f4bc
Add the element `replacedBy` #457
TobiasNx Jul 10, 2023
e225bf6
Add `dissolutionDate`#76
TobiasNx Jul 10, 2023
d51b2ed
Fix replacement pattern #457
TobiasNx Jul 10, 2023
75ff68c
Adjust `replacedBy` and `replaces` if ZDB-collection #457
TobiasNx Jul 10, 2023
3ada696
Add libraries.org Id and links #99
TobiasNx Jul 11, 2023
0fb551d
Add picaPPN for Sigil-Records
TobiasNx Jul 11, 2023
2ba72b4
Add provenance information #128
TobiasNx Jul 11, 2023
9bd607b
Add parentOrganization #309
TobiasNx Jul 11, 2023
aa7ec76
Use new lookup file for wikidata mapping
TobiasNx Jul 12, 2023
2eddc47
Add `gndId` and links to lobid/gnd #361
TobiasNx Jul 12, 2023
2478844
Clean up fixes from old morph code
TobiasNx Jul 12, 2023
cf24483
Fix telephone element
TobiasNx Jul 13, 2023
271c940
Change property to gndIdentifier Add GND links #361
TobiasNx Jul 14, 2023
a728939
Update context with missing properties
TobiasNx Jul 14, 2023
0e819d1
Merge remote-tracking branch 'origin/useFixInsteadOfMorph' into 128-p…
TobiasNx Jul 18, 2023
ae14c90
Delete space in countryCode of phonenr
TobiasNx Aug 7, 2023
87746f9
Merge commit 'ae14c9080c53753f5e9570503069788e426f2efa' into 128-prov…
TobiasNx Aug 8, 2023
2008b82
Delete metafacture strings in used #128
TobiasNx Aug 8, 2023
df0ad93
Merge pull request #463 from hbz/128-provenanceInfo
TobiasNx Aug 8, 2023
4cd2035
Only add dissolutionDate if record has deleted status
TobiasNx Aug 8, 2023
d30c842
Use 035E.a instead of früher to identify deprecated records #461
TobiasNx Aug 8, 2023
7dacdbb
Change properties and adjust regexp for predecessor/succesor #457
TobiasNx Aug 10, 2023
fdef76b
Only keep one ISIL from DBS source data #467
TobiasNx Aug 10, 2023
20d530a
Change GND Link #361
TobiasNx Aug 10, 2023
0e06faf
Add sparql query for the wikidataLookup #361
TobiasNx Aug 10, 2023
88d290c
Change workflows and fixes so that no triples are needed
TobiasNx Aug 7, 2023
f63f951
Update filter mechanism and add comments
TobiasNx Aug 8, 2023
f96fa93
Use pica dat instead of xml dump #462
TobiasNx Jul 18, 2023
bf2d271
Split processes for bulk and updates of sigel #462
TobiasNx Jul 19, 2023
a374840
Update tests for sigil dump processing #462
TobiasNx Jul 19, 2023
f8c5f5a
Delete NULL strings from DBS Data with MF #478
TobiasNx Aug 10, 2023
e041411
Change property for note #458
TobiasNx Aug 10, 2023
2f43a09
Change property name to sourceOrganization in transformation #128
TobiasNx Aug 10, 2023
ec41d83
Update test in test/index/TestStemming.java #462
TobiasNx Aug 10, 2023
412be36
Merge remote-tracking branch 'origin/useFixInsteadOfMorph' into getRi…
TobiasNx Aug 11, 2023
8e10206
Merge remote-tracking branch 'origin/getRidOfTriples' into 462-sigilP…
TobiasNx Aug 11, 2023
2c99f0d
Remove unnecessary imports
dr0i Aug 11, 2023
84ddb4a
Merge pull request #473 from hbz/getRidOfTriples
TobiasNx Aug 11, 2023
5f0c73b
Merge remote-tracking branch 'origin/useFixInsteadOfMorph' into 462-s…
TobiasNx Aug 14, 2023
b210a04
Delete vsCode settings file
TobiasNx Aug 14, 2023
778b560
Add and delete comments #462
TobiasNx Aug 17, 2023
f4352f2
Improve a lot of minor things
dr0i Aug 18, 2023
e0b99ab
Merge pull request #472 from hbz/462-sigilProcessNew
TobiasNx Aug 18, 2023
7cf6758
Only take first instance of 009Q for the url-group-macro #487
TobiasNx Aug 22, 2023
538b2e6
Merge pull request #488 from hbz/487-brokenUpdates
TobiasNx Aug 22, 2023
814c2e9
Merge remote-tracking branch 'origin' into useFixInsteadOfMorph
dr0i Aug 22, 2023
7d58a56
Fix geolookup
TobiasNx Aug 22, 2023
6471376
Increasing the interval-size as workaround #487
TobiasNx Aug 23, 2023
67c96c1
Merge #490 from branch '487-workaroundForMissingUpdates' of https://g…
dr0i Aug 24, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update fixes for lobid organisations
TobiasNx committed Jun 21, 2023
commit 94f79b2e64e2ba67891e7a745743bfdc28c23283
19 changes: 13 additions & 6 deletions conf/morph-dbs.fix
Original file line number Diff line number Diff line change
@@ -1,6 +1,14 @@
# <?xml version="1.0" encoding="UTF-8"?>
# <!-- Copyright 2014-2016, hbz. Licensed under the Eclipse Public License 1.0 -->
#
# <maps>
# <filemap name="iso3-iso2-map"
# files="http://lobid.org/download/lookup-tables/data/iso3-iso2-map.csv" />
# </maps>
do once("maps")
put_filemap("http://lobid.org/download/lookup-tables/data/iso3-iso2-map.csv","iso3-iso2-map", sep_char:"\t")
end

# <metamorph xmlns="http://www.culturegraph.org/metamorph"
# xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" version="1"
# entityMarker=".">
@@ -12,6 +20,8 @@
# <data source="inr" name="inr">
# <replace pattern=" " with=""/>
# </data>


replace_all("inr"," ","")
copy_field("inr","_id")

@@ -20,7 +30,7 @@
if any_match("isil","NULL")
remove_field("isil")
end
<urlencode/>
uri_encode("isil")



@@ -47,14 +57,11 @@

if exists("iso")
copy_field("iso","addressCountry")
lookup("iso","http://lobid.org/download/lookup-tables/data/iso3-iso2-map.csv")
lookup("iso","iso3-iso2-map")
else
add_field("addressCountry","DE")
end

# </rules>
# <maps>
# <filemap name="iso3-iso2-map"
# files="http://lobid.org/download/lookup-tables/data/iso3-iso2-map.csv" />
# </maps>

# </metamorph>
Loading