http://www.andrewheiss.com/blog/2018/12/28/tidytext-pos-arabic/

[andrewheiss]

Tidy text, parts of speech, and unique words in the Qur'an | Andrew Heiss
http://www.andrewheiss.com/blog/2018/12/28/tidytext-pos-arabic/

[andrewheiss]

Originally posted by Nour on 2018-12-29 19:31:01

Hey Andrew,
Thank you for this post, very insightful.
I'm trying to reproduce the steps but I'm struggling to initialize the
CoreNLP Arabic tagging engine.
Could you please provide me with any hint ?

https://uploads.disquscdn.c...

Many thanks,
Nour

[andrewheiss]

Originally posted on 2018-12-29 20:46:17

Huh. Try running `system.file("extdata", package = "cleanNLP")`
to
see what the full path is on your computer, and then open that in
terminal or Finder/File Explorer. You should have a folder named
"stanford-corenlp-full-2018-10-05" and in there, there should be a
large
60+ MB file named "stanford-arabic-corenlp-2018-10-05-models.jar"

If it's not there, try running `cnlp_download_corenlp(type = "ar")`
in R to make it download just the Arabic models

[andrewheiss]

Originally posted by Nour on 2018-12-29 22:45:59

Thanks Andrew, the initialization of the CoreNLP Arabic tagging engine
is OK after downloading the Arabic models as suggested.

Now the Arabic words are not displayed as expected :

https://uploads.disquscdn.c...

Do have any tips to fix this please?

> sessionInfo()
R version 3.5.2 (2018-12-20)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 7 x64 (build 7601) Service Pack 1

Matrix products: default

locale:
[1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252
[3] LC_MONETARY=English_United States.1252 LC_NUMERIC=C
[5] LC_TIME=English_United States.1252

attached base packages:
[1] stats graphics grDevices utils datasets methods base

other attached packages:
[1] bindrcpp_0.2.2 arabicStemR_1.2 tidytext_0.2.0 quRan_0.1.0 forcats_0.3.0
[6] stringr_1.3.1 dplyr_0.7.8 purrr_0.2.5 readr_1.3.1 tidyr_0.8.2
[11] tibble_1.4.2 ggplot2_3.1.0 tidyverse_1.2.1 cleanNLP_2.3.0

loaded via a namespace (and not attached):
[1] tidyselect_0.2.5 rJava_0.9-10 haven_2.0.0 lattice_0.20-38
[5] colorspace_1.3-2 generics_0.0.2 SnowballC_0.5.1 yaml_2.2.0
[9] utf8_1.1.4 rlang_0.3.0.1 pillar_1.3.1 glue_1.3.0
[13] withr_2.1.2 modelr_0.1.2 readxl_1.2.0 bindr_0.1.1
[17] plyr_1.8.4 munsell_0.5.0 gtable_0.2.0 cellranger_1.1.0
[21] rvest_0.3.2 fansi_0.4.0 broom_0.5.1 tokenizers_0.2.1
[25] Rcpp_1.0.0 scales_1.0.0 backports_1.1.3 jsonlite_1.6
[29] hms_0.4.2 stringi_1.2.4 grid_3.5.2 cli_1.0.1
[33] tools_3.5.2 magrittr_1.5 lazyeval_0.2.1 janeaustenr_0.1.5
[37] crayon_1.3.4 pkgconfig_2.0.2 Matrix_1.2-15 xml2_1.2.0
[41] lubridate_1.7.4 assertthat_0.2.0 httr_1.4.0 rstudioapi_0.8
[45] R6_2.3.0 nlme_3.1-137 compiler_3.5.2\

Thanks a lot for your help on this,
Nour

[andrewheiss]

Originally posted on 2018-12-29 23:29:25

That's an issue with RStudio, I think. If you look at the data in a new
tab, like with View(fatiha_terms), they should show up fine

[andrewheiss]

Originally posted by Nour on 2018-12-30 19:21:21

These characters are created by the function cnlp_annotate :

https://uploads.disquscdn.c...

[andrewheiss]

Originally posted by Nour on 2018-12-30 19:37:12

Seems there is an encoding issue ?

https://uploads.disquscdn.c...