Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ZWJ missing from name ? #42

Open
subins2000 opened this issue Oct 31, 2021 · 3 comments
Open

ZWJ missing from name ? #42

subins2000 opened this issue Oct 31, 2021 · 3 comments

Comments

@subins2000
Copy link

subins2000 commented Oct 31, 2021

Awesome work! Just checked it out. Found that the placenames in website has ZWJ missing in it. This gives incorrect place names. I checked OSM node, the chil used there is ല + ് + ZWJ : https://www.openstreetmap.org/relation/11312298

Maybe all chil in OSM names should be migrated to atomic chil ? Doesn't the current use of ZWJ in names of OSM affect searching ? or just fix the script that made this webpage

Screenshot_20211031_214936
Screenshot_20211031_215001
Screenshot_20211031_215437

@manojkmohan
Copy link
Member

Yes. Known issue with Wikidata. Need to check all attributes with running a bot. Data entry issue. Its better with osm i think.
@naveenpf @jinoytommanjaly

@manojkmohan
Copy link
Member

Ohh. OSM also have same issue!. Mostly the things came via wikidata. There is no normalization scrip working in wikidata like ml.wikipedia

@gnoeee
Copy link
Member

gnoeee commented Nov 1, 2021

Most of the labels of the panchayat were fetched into Wikidata from Malayalam wiki long before by bots or by users. So most of them will have ZWJ characters on the labels. In WD we can have one label for every entity as well as several names can be added to Aliases. So we can use the names without ZWJ characters in the label filed and with ZWJ characters as aliases.

I have created a Google sheet that lists the panchayat labels from Wikidata which doesn't match the label in Wikipedia. https://docs.google.com/spreadsheets/d/1U8cCNhUx7u_nKOvuLbuwvTjpOW-2GAnS/edit#gid=1579957521

@asdofindia asdofindia transferred this issue from opendatakerala/map.opendatakerala.org Aug 6, 2024
@asdofindia asdofindia transferred this issue from another repository Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants