Releases: manami-project/anime-offline-database
2020-04
Number of sources | Number of entries in database |
---|---|
1 | 7986 |
2 | 2238 |
3 | 3073 |
4 | 4242 |
5 | 5984 |
6 | 7 |
Verified entries
2828 entries have been verified. In-depth changes down below.
In-depth changes
Dirty Pair Flash
Anidb lists all OVA in one entry.
https://anidb.net/anime/402
https://anilist.co/anime/1802
https://kitsu.io/anime/1621
https://myanimelist.net/anime/1802
https://notify.moe/anime/7KJf5KmiR
https://anilist.co/anime/12343
https://myanimelist.net/anime/12343
https://notify.moe/anime/eJ5HpFimR
https://kitsu.io/anime/6708
https://anilist.co/anime/12347
https://myanimelist.net/anime/12347
https://notify.moe/anime/2E5NpKmmg
https://kitsu.io/anime/6709
Black Jack OVA
Anidb and anilist list the OVA from 2011 separately
https://anidb.net/anime/2544
https://anilist.co/anime/1520
https://anidb.net/anime/8845
https://anilist.co/anime/108339
https://kitsu.io/anime/1364
https://notify.moe/anime/NQ2acKimR
https://myanimelist.net/anime/1520
Maken-ki OVA
Anidb lists both OVA episodes in different entries.
https://anidb.net/anime/10191
https://anidb.net/anime/8566
https://anilist.co/anime/11209
https://kitsu.io/anime/6474
https://myanimelist.net/anime/11209
https://notify.moe/anime/03vItKmmg
Megazone 23
Anidb lists the OVA separately.
https://anidb.net/anime/1729
https://anidb.net/anime/3545
https://anidb.net/anime/3544
https://anilist.co/anime/1935
https://kitsu.io/anime/1744
https://myanimelist.net/anime/1935
https://notify.moe/anime/IvmL5Fiig
Noragami Aragoto OVA
Anilist lists Noragami OVA and Noragami Aragoto OVA in one entry.
https://anilist.co/anime/20494
https://anidb.net/anime/11860
https://myanimelist.net/anime/30885
https://notify.moe/anime/YLzrpFiiR
https://kitsu.io/anime/11243
https://anidb.net/anime/10179
https://kitsu.io/anime/8152
https://myanimelist.net/anime/20767
https://notify.moe/anime/zEZotKiig
2020-03
Verified entries
I was able to verify 2487 entries. In-depth changes down below.
Number of sources | Number of entries in database | Comment |
---|---|---|
1 | 7921 | |
2 | 2232 | |
3 | 3072 | |
4 | 4236 | |
5 | 5984 | |
6 | 8 | verified |
In-depth changes
Break Blade
Anidb lists all movies in one entry.
https://anidb.net/anime/7103
https://anilist.co/anime/6772
https://kitsu.io/anime/4708
https://myanimelist.net/anime/6772
https://notify.moe/anime/z7wecFmmg
https://anilist.co/anime/8514
https://kitsu.io/anime/5366
https://myanimelist.net/anime/8514
https://notify.moe/anime/noJmtFmiR
https://anilist.co/anime/9252
https://kitsu.io/anime/5645
https://notify.moe/anime/qnUZtFimg
https://myanimelist.net/anime/9252
https://anilist.co/anime/9465
https://kitsu.io/anime/5743
https://myanimelist.net/anime/9465
https://notify.moe/anime/l5WMpKmmg
https://anilist.co/anime/9724
https://kitsu.io/anime/5837
https://myanimelist.net/anime/9724
https://notify.moe/anime/FATGtKiiR
https://anilist.co/anime/10092
https://kitsu.io/anime/6031
https://myanimelist.net/anime/10092
https://notify.moe/anime/t_FntKmig
Bunbuku Chagama
Had to separate the three different versions.
https://anidb.net/anime/6840
https://myanimelist.net/anime/23181
https://notify.moe/anime/GZuftFmiR
https://kitsu.io/anime/9523
https://anidb.net/anime/6839
https://myanimelist.net/anime/24881
https://notify.moe/anime/hTK-pFmmg
https://kitsu.io/anime/9139
https://anidb.net/anime/12870
https://myanimelist.net/anime/35399
https://anilist.co/anime/111794
https://kitsu.io/anime/40750
https://notify.moe/anime/UU3vhKiig
https://anidb.net/anime/14338
https://myanimelist.net/anime/29921
https://anilist.co/anime/114439
https://notify.moe/anime/L-gwpFiiR
https://kitsu.io/anime/10546
Chain Chronicle
Anidb lists the three movies in one entry.
https://anidb.net/anime/12291
https://anilist.co/anime/87505
https://kitsu.io/anime/12463
https://myanimelist.net/anime/33728
https://notify.moe/anime/I0xz2FimR
https://anilist.co/anime/87506
https://kitsu.io/anime/12461
https://myanimelist.net/anime/33729
https://notify.moe/anime/3nxzhFimg
https://anilist.co/anime/87507
https://kitsu.io/anime/12462
https://myanimelist.net/anime/33730
https://notify.moe/anime/wdbkhFiiR
Code Geass: Boukoku no Akito
Anidb lists all movies in one entry together with the picture dramas.
https://anidb.net/anime/7508
https://anilist.co/anime/8888
https://kitsu.io/anime/5518
https://myanimelist.net/anime/8888
https://notify.moe/anime/tVVWtKimR
https://kitsu.io/anime/7227
https://notify.moe/anime/uEydtFmig
https://anilist.co/anime/15197
https://myanimelist.net/anime/15197
https://kitsu.io/anime/7228
https://notify.moe/anime/BrsOpKimR
https://myanimelist.net/anime/15199
https://anilist.co/anime/15199
https://kitsu.io/anime/7229
https://notify.moe/anime/2I8OtKmmR
https://anilist.co/anime/15201
https://myanimelist.net/anime/15201
https://notify.moe/anime/Ipb_pFiiR
https://anilist.co/anime/21178
https://myanimelist.net/anime/30711
https://kitsu.io/anime/10904
https://anilist.co/anime/109002
https://kitsu.io/anime/8583
https://myanimelist.net/anime/23359
https://notify.moe/anime/Hp60tKmiR
https://kitsu.io/anime/11201
https://myanimelist.net/anime/31145
https://notify.moe/anime/ka_XtFimg
https://anilist.co/anime/109003
https://anilist.co/anime/109004
https://kitsu.io/anime/11671
https://myanimelist.net/anime/32240
https://notify.moe/anime/EuM3tFmmg
https://anilist.co/anime/109005
https://myanimelist.net/anime/33360
https://kitsu.io/anime/12752
https://notify.moe/anime/9FXm2KmmR
Gekijou Soushuuhen Code Geass: Hangyaku no Lelouch
Anidb lists all movies in one entry.
https://anidb.net/anime/12567
https://anilist.co/anime/101811
https://kitsu.io/anime/13850
https://myanimelist.net/anime/34438
https://notify.moe/anime/qsAS2Kmig
https://anilist.co/anime/101812
https://kitsu.io/anime/13851
https://myanimelist.net/anime/34439
https://notify.moe/anime/j9AShFmig
https://anilist.co/anime/101813
https://kitsu.io/anime/13852
https://myanimelist.net/anime/34440
https://notify.moe/anime/zZJS2FmiR
Cyborg 009: Call of Justice
Anidb lists the movies in one entry.
https://anidb.net/anime/12277
https://anilist.co/anime/87481
https://kitsu.io/anime/12543
https://myanimelist.net/anime/33685
https://notify.moe/anime/jgezhKmiR
https://anilist.co/anime/87482
https://kitsu.io/anime/12577
https://myanimelist.net/anime/33686
https://notify.moe/anime/HoMm2Fiig
https://anilist.co/anime/87483
https://kitsu.io/anime/12578
https://myanimelist.net/anime/33687
https://notify.moe/anime/haMm2KiiR
Cynical Hysterie Hour
Anidb lists all four movies in one entry.
https://anidb.net/anime/7706
https://anilist.co/anime/6760
https://kitsu.io/anime/4702
https://myanimelist.net/anime/6760
https://notify.moe/anime/Ld86cFimR
https://anilist.co/anime/6759
https://kitsu.io/anime/4701
https://myanimelist.net/anime/6759
https://notify.moe/anime/LV8ecFimR
https://anilist.co/anime/6762
https://kitsu.io/anime/4704
https://myanimelist.net/anime/6762
https://notify.moe/anime/i-8e5Kmmg
https://anilist.co/anime/6761
https://kitsu.io/anime/4703
https://myanimelist.net/anime/6761
https://notify.moe/anime/Kh865KmmR
Nanbo no Monjai! Yankee Gurentai
Anidb lists both OVAs in one entry.
https://anidb.net/anime/7690
https://anilist.co/anime/19783
https://kitsu.io/anime/9477
https://myanimelist.net/anime/19783
https://notify.moe/anime/92LfpKmig
https://anilist.co/anime/19797
https://kitsu.io/anime/9476
https://notify.moe/anime/SKLfpKmmR
https://myanimelist.net/anime/19797
Haikyuu!!: vs. Akaten and Haikyuu!!: Lev Genzan!
Had to separate the different OVAs. Anidb has a single entry for both.
https://anidb.net/anime/10954
https://anilist.co/anime/21348
https://myanimelist.net/anime/35806
https://notify.moe/anime/7_B9pKmmg
https://kitsu.io/anime/11374
https://anilist.co/anime/20884
https://myanimelist.net/anime/25303
https://notify.moe/anime/vRn1pFmiR
https://kitsu.io/anime/8626
Street Fighter IV OVA
I have no idea if this Round One: Fight! OVA on notify and kitsu is a duplicate or not.
https://anilist.co/anime/5369
https://myanimelist.net/anime/5369
https://anidb.net/anime/6283
https://notify.moe/anime/nncC5KmmR
https://kitsu.io/anime/4074
https://kitsu.io/anime/13732
https://notify.moe/anime/ULkShKmmg
2020-01
Verified entries
I was able to verify 1890 entries. At the moment I'm very content with the results. In-depth changes down below.
Number of sources | Number of entries in database |
---|---|
1 | 7834 |
2 | 2256 |
3 | 3057 |
4 | 4270 |
5 | 5941 |
6 | 6 |
General splitting
If one site combines releases whereas the other lists them separately, I will split them.
Example: One site lists a special with two episodes and the other site lists both episodes as individual specials, then I will not merge them, but create separate entries.
In-depth changes
Short Peace and Tsukumo
I've split those into separate entries:
https://anidb.net/anime/9125
https://myanimelist.net/anime/19573
https://anilist.co/anime/19573
https://notify.moe/anime/Kl5TtFmiR
https://kitsu.io/anime/8215
https://anilist.co/anime/14853
https://kitsu.io/anime/7177
https://myanimelist.net/anime/14853
https://notify.moe/anime/-SAdpFiiR
https://anilist.co/anime/13639
https://kitsu.io/anime/7003
https://myanimelist.net/anime/13639
https://notify.moe/anime/RHLDpKmmR
https://anilist.co/anime/17679
https://kitsu.io/anime/8280
https://myanimelist.net/anime/17679
https://notify.moe/anime/f-YTpKmiR
https://anilist.co/anime/17677
https://kitsu.io/anime/7682
https://myanimelist.net/anime/17677
https://notify.moe/anime/wFXcpFmig
Kaguya-hime
https://anidb.net/anime/6821 had been falsely merged with (and also links to) https://myanimelist.net/anime/29927. However one is a puppet animation and one is a paper-cut animation, judging by the picture. And there are 20 years difference in release. Correct entry is https://anidb.net/anime/13072. I created a separated entry for https://anidb.net/anime/6821. The rest is merged together correctly.
https://anidb.net/anime/6821
https://anidb.net/anime/13072
https://anilist.co/anime/109352
https://kitsu.io/anime/10552
https://myanimelist.net/anime/29927
https://notify.moe/anime/2KzwtFmmR
Walking Meat and Force of Will The Movie
Seems like Force of Will had been cancelled, but walking meat which was originally planned to be part of that movie has been released separately. Had to split the entries accordingly:
https://anilist.co/anime/97661
https://kitsu.io/anime/12550
https://anidb.net/anime/12220
https://anilist.co/anime/104746
https://kitsu.io/anime/42331
https://myanimelist.net/anime/33438
https://notify.moe/anime/sngm2KimR
Yakusoku
Had to split up the anilist entry, because it's a totally different release.
https://anilist.co/anime/107191
https://anilist.co/anime/102300
https://kitsu.io/anime/11416
https://myanimelist.net/anime/30400
https://notify.moe/anime/Yr9rpFimg
Kuroko no Basket NG-shuu
Season one and two had been merged together, so I separated them.
https://anilist.co/anime/15487
https://kitsu.io/anime/7262
https://myanimelist.net/anime/15487
https://notify.moe/anime/WPjdpKiiR
https://anilist.co/anime/98703
https://kitsu.io/anime/8717
https://myanimelist.net/anime/22673
https://notify.moe/anime/7-PJpFmmR
Yobanashi Deceive and Mekakucity Records
From my understanding is Yobanashi Deceive part of Mekakucity Records. Therefore the entries for Yobanashi Deceive on kitsu and notify are strictly speaking duplicates.
https://anidb.net/anime/14006
https://anilist.co/anime/102734
https://kitsu.io/anime/40956
https://myanimelist.net/anime/36494
https://notify.moe/anime/m9sd2Fmmg
https://kitsu.io/anime/13604
https://notify.moe/anime/dBoVhFimR
Persona 5 the Animation
Anilist, kitsu and notify.moe list the episodes in separate entries.
https://anidb.net/anime/14421
https://myanimelist.net/anime/38431
https://anilist.co/anime/106169
https://notify.moe/anime/-2eFTf-mR
https://kitsu.io/anime/41972
https://anilist.co/anime/106896
https://kitsu.io/anime/42090
https://notify.moe/anime/nM2ZpxUmg
Rurouni Kenshin Recap
Had to split different recaps.
https://anilist.co/anime/10334
https://kitsu.io/anime/6132
https://myanimelist.net/anime/10334
https://notify.moe/anime/qP_7pFiig
https://anilist.co/anime/12067
https://kitsu.io/anime/6659
https://myanimelist.net/anime/12067
https://notify.moe/anime/UHnHtKmmR
Terra Formars OVA
Had to split two different OVAs
https://anilist.co/anime/20630
https://kitsu.io/anime/8355
https://notify.moe/anime/Ye6opFiiR
https://myanimelist.net/anime/22689
https://anidb.net/anime/10456
https://anilist.co/anime/97989
https://kitsu.io/anime/40609
https://notify.moe/anime/dbpDhFmmg
https://myanimelist.net/anime/34532
https://anidb.net/anime/14382
Yurumates OVA
MAL and notify.moe list the OVAs separately.
https://anidb.net/anime/9144
https://anilist.co/anime/14949
https://kitsu.io/anime/7187
https://myanimelist.net/anime/14949
https://notify.moe/anime/VuJdpKiig
https://myanimelist.net/anime/31551
https://notify.moe/anime/TFBrpFmiR
Aikatsu
Anilist and notify.moe split the season in two.
https://anilist.co/anime/15061
https://kitsu.io/anime/7205
https://myanimelist.net/anime/15061
https://notify.moe/anime/qTBdtFmig
https://anidb.net/anime/9348
https://anilist.co/anime/20181
https://notify.moe/anime/bqHhtFimR
Bavi Stock
Anidb lists the two episodes as individual entries.
https://anidb.net/anime/5007
https://anidb.net/anime/8633
https://myanimelist.net/anime/10105
https://anilist.co/anime/10105
https://kitsu.io/anime/6035
https://notify.moe/anime/3H57pFmmg
Beelzebub Specials
Different specials. The 7 episode special is not listed on MAL.
https://anilist.co/anime/13067
https://kitsu.io/anime/6875
https://notify.moe/anime/bcZDpKimg
https://kitsu.io/anime/6199
https://myanimelist.net/anime/10479
https://notify.moe/anime/HLZVpKmig
https://anilist.co/anime/10479
Cosmo Warrior Zero
Had to split the special from the actual season.
https://anidb.net/anime/816
https://anilist.co/anime/1676
https://kitsu.io/anime/1506
https://myanimelist.net/anime/1676
https://notify.moe/anime/QUif5Fimg
https://anilist.co/anime/1677
https://myanimelist.net/anime/1677
https://notify.moe/anime/8riB5KmmR
https://kitsu.io/anime/1507
Answer
Split different music videos having the same title.
https://anilist.co/anime/103514
https://kitsu.io/anime/12206
https://myanimelist.net/anime/32789
https://notify.moe/anime/VD2g2Fmig
https://anilist.co/anime/102293
https://kitsu.io/anime/13198
https://myanimelist.net/anime/34611
https://notify.moe/anime/DrBM2Fmig
Cinderella Girls Gekijou: Kayou Cinderella Theater
Had to split season one and two.
https://anilist.co/anime/100225
https://kitsu.io/anime/13896
https://myanimelist.net/anime/36500
https://notify.moe/anime/sssI2Kimg
https://notify.moe/anime/iWF7hFmmR
https://myanimelist.net/anime/35346
https://anilist.co/anime/98556
https://kitsu.io/anime/13327
Tales of the Rays
MAL combines both ONA in one entry.
https://kitsu.io/anime/13527
https://notify.moe/anime/XXM4hFmmR
https://kitsu.io/anime/40577
https://notify.moe/anime/naDvhFmiR
https://myanimelist.net/anime/34939
Digimon Adventure Movie
Two different movies had been merged together.
https://anilist.co/anime/2961
https://myanimelist.net/anime/2961
https://kitsu.io/anime/7826
https://notify.moe/anime/44-ptKmmg
https://anidb.net/anime/1148
https://kitsu.io/anime/13736
https://notify.moe/anime/_7iS2KimR
Gintama.
Had to split season four and five from each other and anidb lists Porori-hen and Shirogane no Tamashii-hen in one entry. So that one was separated from the other as well.
https://anidb.net/anime/12419
https://anilist.co/anime/97889
https://kitsu.io/anime/12553
https://myanimelist.net/anime/34096
https://notify.moe/anime/NBRihFmig
https://anidb.net/anime/13263
https://myanimelist.net/anime/35843
https://notify.moe/anime/scRI2Kmig
https://kitsu.io/anime/13726
https://anilist.co/anime/99714
https://myanimelist.net/anime/36838
https://notify.moe/anime/XxJHhKmig
https://anilist.co/anime/100784
https://kitsu.io/anime/14095
Koi to Senkyo to Chocolate Special
Had to separate picture drama and unaired 13th episode.
https://anilist.co/anime/18045
https://myanimelist.net/anime/18045
https://notify.moe/anime/mA4tpKiiR
https://kitsu.io/anime/7737
https://anilist.co/anime/18053
https://kitsu.io/anime/8815
https://myanimelist.net/anime/18053
https://notify.moe/anime/UMZbtFmiR
Koukou Butouden Crows
Anidb lists this in two entries.
https://anidb.net/anime/9345
https://anilist.co/anime/6293
https://kitsu.io/anime/4511
https://myanimelist.net/anime/6293
https://notify.moe/anime/tGCq5KmiR
https://anidb.net/anime/5183
Kuroshitsuji Special
Separated recap episode and special.
https://anilist.co/anime/6793
https://kitsu.io/anime/4717
https://notify.moe/anime/iy_6cKiiR
https://myanimelist.net/anime/6793
https://kitsu.io/anime/4453
https://myanimelist.net/anime/6163
https://notify.moe/anime/0mLqcFmig
Manyuu Hikenchou Specials
Different specials by number of epsiodes and air date.
https://anilist.co/anime/10845
https://kitsu.io/anime/6379
https://notify.moe/anime/swrVpFmmR
https://kitsu.io/anime/41579
https://myanimelist.net/anime/10845
https://notify.moe/anime/7pD7mKumg
Mekakucity V's and Yuukei Yesterday
From my understanding is Yuukei Yesterday part of Mekakucity V's. Therefore the entries for Yuukei Yesterday on kitsu and notify are strictly speaking duplicates.
...
2019-50
Music titles from notify.moe
Working on the merging quality, I realized that notify.moe actually lists anime of type 'music'. Those have been missing in previous updates, but are now included. That explains the sudden increase of notify.moe entries.
Merging
This week I was able to improve the merging even further. You can compare those numbers to the previous week.
Number of sources | Number of entries in database | Comment |
---|---|---|
1 | 7821 | Improved |
2 | 2196 | Improved |
3 | 3021 | Improved |
4 | 4332 | Improved |
5 | 5855 | Improved |
6 | 19 | Got worse |
7 | 4 | Got worse |
8 | 1 | Improved |
While working on this I also realized that the cluster having 4 sources is not always missing an entry.
- There is often a case in which the "missing" entry simply doesn't exist on the respective website
- anidb.net doesn't list specials as separate entries. => In these cases I decided not to add the link of the parent. In my opinion this would be hard to achieve, confusing during data analysis and it just doesn't seem right
2019-49
Until 2019-48 I used deterministic matching for merging the records. This update is the first using probabilistic matching. I started experimenting on that, because my hope was that a lot of false negatives would vanish and the merging rate could improve. In my opinion the first results are pretty good:
This week's data if deterministic matching was still used:
Number of sources | Number of entries in database | Comment |
---|---|---|
1 | 15688 | This is bad. These entries haven't been matched with anything. |
2 | 3671 | 2 Entries merged together |
3 | 4660 | 3 Entries merged together |
4 | 5660 | Almost. Missing out on one entry. |
5 | 1476 | This is where the most entries should be, because there are 5 meta data providers which are supported at the moment. |
6 | 2 | Probably contains duplicates or false positives |
7 | 1 | Probably contains duplicates or false positives |
This week's data using probabilistic matching:
Number of sources | Number of entries in database | Comment |
---|---|---|
1 | 9071 | Got a lot better |
2 | 2247 | Improved as well |
3 | 3243 | Improved as well |
4 | 4690 | Improved as well |
5 | 4978 | Better |
6 | 14 | Got worse |
7 | 3 | Got worse |
8 | 2 | Got worse, because it didn't exist before |
10 | 1 | Got worse, because it didn't exist before |
It's not perfect, but you can see that I am working on it and that there is already improvement. It will get even better over time.
2019-48
Merge locks have been removed. There haven't been any contributions since I introduced it, so it doesn't seem necessary. During reimplementation of my tool, I decided to save my time on reimplementing this part and just throw it away.
2019-46
Added a new field 'status'
This indicates whether an anime
FINISHED
releasing/airing,
is CURRENTLY
releasing/airing or
has an UPCOMING
release/airing.
Otherwise the status is UNKNOWN
.
2019-45
Release Notes
With this week's update I decided to create release notes. I missed out on that in the past whenever I made crucial changes. That's a disadvantageous, because it makes it hard to track those over time. I try to create release notes in the future whenever I make significant changes, but not for every simple update.
And here are the changes for this week.
New meta data provider notify.moe
I added notify.moe as additional meta data provider.
Removed type 'Music'
When I added notify.moe I noticed that they only provide the basic types: TV
, Movie
OVA
, ONA
and Special
. I kind of liked that, because I never really understood why there is a type Music
for a few meta data providers. At least on MAL it does not only contain music videos and in my opinion it's not really a type, but a genre. So I decided to get rid of that type and map everything from Music
to Special
.
Fixed Bug 'MAL: synonyms which include a comma are split incorrectly' (#26)
Synonyms from MAL containing a comma should be correct now.