Test crawler and report issue.

[kcubeterm]

procedure.

Add single or multiple directory in DirToIndex array in config.json.
and then call crawler.js with node.
node crawler.js

It will output a single file name Indexofdata.jsonl once crawler scanned all files and directories which has specified in config.json.

IndexofData.jsonl contains 1 json object per line.
Json objects contains following data.

{
    "filename": "sample.pdf",
    "abspath": "/root/sample.pdf",
    "atime":      "atime ofthat file",
    "mtime":     "mtime..",
    "ctime":       "ctime"
    "content":    "extracted text from files",
    "filetype":     "types or mimetype"
}

[cauerego]

to be edited

https://github.com/kcubeterm/achoz/releases/tag/2021firstalpha

downloading it now...

[cauerego]

not good... 🤣

gotta continue it another time.

internal/modules/cjs/loader.js:883
  throw err;
  ^

Error: Cannot find module 'officeparser'
Require stack:
- /storage/emulated/0/achoz/run/crawler/crawler.js
    at Function.Module._resolveFilename (internal/modules/cjs/loader.js:880:15)
    at Function.Module._load (internal/modules/cjs/loader.js:725:27)
    at Module.require (internal/modules/cjs/loader.js:952:19)
    at require (internal/modules/cjs/helpers.js:88:18)
    at Object.<anonymous> (/storage/emulated/0/achoz/run/crawler/crawler.js:4:22)
    at Module._compile (internal/modules/cjs/loader.js:1063:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1092:10)
    at Module.load (internal/modules/cjs/loader.js:928:32)
    at Function.Module._load (internal/modules/cjs/loader.js:769:14)
    at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:72:12) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [ '/storage/emulated/0/achoz/run/crawler/crawler.js' ]
}

[cauerego]

well, this is a nasty issue.

it's obviously not about permission, i guess.

i'll try it more tomorrow.

[kcubeterm]

May i know why are you keeping source code in interal storage where symlink and unix file permissions has restrictions. Drag it into termux home and do npm install

[kcubeterm]

it's obviously not about permission, i guess.

It's permission issue. Symbolic link is not allowed in internel storage of android.

[cauerego]

lol, i hate that... and always forget it.

i try to avoid using termux storage as it's not syncthinged and it's easier to lose...

came here to report i was trying this now
https://blog.dniccumdesign.com/troubleshooting-nodejs-compatibility-issues/

To fix this, simply remove any prepended ^ or ~ marks within your package.json file, purge the node_modules directory and the retrying the install and run commands.

still a good hint to follow...

[cauerego]

error looks much better already!

[cauerego]

not a big fan of https://semver.org/

but i might read it later to see if they have a point or not.

big releases should happen once per year and have distinct names. the rest is for dev only and would probably be better served with a simple full iso timestamp.

[kcubeterm]

I follow similar semantic