Unable to use remote machine learning

[pippo73]

Hi all,
I have 2 devices running machine learning.

if I try to use only the second device and I remove the first string (the localhost ML) in the docker composer log I get only the following errors:

[Nest] 7  - 01/24/2025, 9:08:55 PM   ERROR [Microservices:JobService] Unable to run job handler (smartSearch/smart-search): Error: Machine learning request '{"clip":{"visual":{"modelName":"ViT-H-14-378-quickgelu__dfn5b"}}}' failed for all URLs
[Nest] 7  - 01/24/2025, 9:08:55 PM   ERROR [Microservices:JobService] Error: Machine learning request '{"clip":{"visual":{"modelName":"ViT-H-14-378-quickgelu__dfn5b"}}}' failed for all URLs
    at MachineLearningRepository.predict (/usr/src/app/dist/repositories/machine-learning.repository.js:38:15)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async MachineLearningRepository.encodeImage (/usr/src/app/dist/repositories/machine-learning.repository.js:56:26)
    at async SmartInfoService.handleEncodeClip (/usr/src/app/dist/services/smart-info.service.js:104:27)
    at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:148:28)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:130:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 7  - 01/24/2025, 9:08:55 PM   ERROR [Microservices:JobService] Object:
{
  "id": "560358ae-4f0f-4546-bdbe-082ea0186387",
  "source": "upload"
}

On the second server I get the following logs when I start it in the ML logs I get this:

[01/24/25 20:17:28] INFO     Starting gunicorn 23.0.0
[01/24/25 20:17:28] INFO     Listening at: http://[::]:3003 (4)
[01/24/25 20:17:28] INFO     Using worker: app.config.CustomUvicornWorker
[01/24/25 20:17:28] INFO     Booting worker with pid: 5
[01/24/25 20:17:30] INFO     Started server process [5]
[01/24/25 20:17:30] INFO     Waiting for application startup.
[01/24/25 20:17:30] INFO     Created in-memory cache with unloading after 300s
                             of inactivity.
[01/24/25 20:17:30] INFO     Initialized request thread pool with 5 threads.
[01/24/25 20:17:30] INFO     Application startup complete.

I think this means is working on a 0.0.0.0:3003 address, and should accept external connections

what I'm doing wrong?

[bo0tzz]

Are you sure the Immich server can actually reach that host, and that there's no firewall or such blocking it?

[pippo73]

I can ping it from 1 to 2. Are there any other tests I can do?