Migrate ILLiad OCR Process to use hosted Illiad

[tpendragon]

Summary

The library will be switching to hosted Illiad in August. @kevinreiss says we will need to do two things:

1. Change the folder that Figgy's FileWatcher looks at for new ingests - it'll be in a different place. (/mnt/hosted_illiad/ILL_OCR_Scans/ocr_scan)
2. Change the folder that Figgy's FileWatcher outputs files, it'll be in a different place. (/mnt/hosted_illiad/ILL_OCR_Scans/images)

Acceptance Criteria

• Have a new env variable for the new IN path. (https://github.com/pulibrary/princeton_ansible/pull/5646/files#diff-0f58efb46ddf3c9dc6d5fa14ee24707f8731f06302a3b0f05a2c9663b1ab43f4R138-R139 has the initial implementation, we'll have to change the path) (/mnt/hosted_illiad/ILL_OCR_Scans/ocr_scan)
• Have a new env variable for the new OUT path. (/mnt/hosted_illiad/ILL_OCR_Scans/images)
• Remove all the SFTP variables we don't need now.
• The IN/OUT paths are provisioned
• The code looks at those new variables.

Impact

We're switching to hosted ILLiad early 2025. We need to have this ready to go before then.

Priority recommendation

• asap
• within the next 3 weeks
• PO will prioritize

[tpendragon]

Note:

Their SFTP server has IP restrictions, so you have to tunnel traffic. To do so:

ssh -L 2222:princeton.illiad.oclc.org:222 pulsys@figgy-web-staging2

Then in FileZilla (or however you want to connect to sftp), you connect to localhost:2222, using the correct auth info.

[tpendragon]

@kevinreiss I've no idea where to put these things. Is it this uploads directory? I don't know how Illiad works. It used to be an images directory.

[VickieKarasic]

@tpendragon here is ILLiad's response - let me know if this makes sense to you:

We utilize the ILLiad default location for PDF files that get delivered to patrons:

c:\inetpub\wwwroot\illiad\pdf\

And thus the URL to access them would look like this:

https://princeton.illiad.oclc.org/illiad/pdf/[TN#].pdf

And when you are accessing your OCLC hosted ILLiad web server via SFTP .. there is an additional folder due to the storage file system we utilize:

/cygdrive/c/Inetpub/wwwroot/illiad/pdf

During the actual migration, we can add the PDF files to the correct location.