[HW Accel Support]: Cannot get Coral to be detected by Frigate

[jjosephcuc]

Describe the problem you are having

I've been fighting this issue for over a week now and am pulling my hair out over it. Coral is detected on my Proxmox and in docker, but when I run lsusb in the frigate all I get is this is no device name. Frigate crashes saying there's no edgeTPU found. On hardware acceleration with GPU it works just fine.

Frigate container:

Bus 001 Device 003: ID 0573:1573 CSCTEK USB Audio and HID
Bus 001 Device 002: ID 0bda:c821 Realtek  Bluetooth Radio 
Bus 001 Device 001: ID 1d6b:0002 Linux 6.8.12-4-pve xhci-hcd xHCI Host Controller
Bus 002 Device 002: ID 18d1:9302
Bus 002 Device 001: ID 1d6b:0003 Linux 6.8.12-4-pve xhci-hcd xHCI Host Controller

On Proxmox with lsusb:

Bus 002 Device 002: ID 18d1:9302 Google Inc.
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 003: ID 0573:1573 Zoran Co. Personal Media Division (Nogatech) USB Audio and HID
Bus 001 Device 002: ID 0bda:c821 Realtek Semiconductor Corp. Bluetooth Radio 
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

In Docker with lsusb:

Bus 002 Device 002: ID 18d1:9302 Google Inc.
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 003: ID 0573:1573 Zoran Co. Personal Media Division (Nogatech) USB Audio and HID
Bus 001 Device 002: ID 0bda:c821 Realtek Semiconductor Corp. Bluetooth Radio 
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

My mappings all correctly point to bus 002 and device 002, however frigate cannot detect coral. I've tried multiple USB cables and my Mini PC USB 3.0 port should power Coral enough to be used.

Version

0.14.1-f4f3cfa

Frigate config file

mqtt:
  host: 192.168.*.***
  port: 1883
  user: mqtt-user
  password: ***
  topic_prefix: frigate

ffmpeg:
  hwaccel_args:
    - preset-vaapi
    - hwaccel_device

environment_vars:
  LIBVA_DRIVER_NAME: iHD

detectors:
  coral:
    type: edgetpu
    device: usb
#  ov:
#    type: openvino
#    device: GPU


model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  path: /openvino-model/ssdlite_mobilenet_v2.xml
  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

#detectors:
 # ov:
  # - type: openvino
  #   device: GPU
 # coral:
   # type: edgetpu
    #device: usb

#Global Object Settings
objects:
  track:
    - person
  filters:
    person:
      min_area: 5000
      max_area: 100000

cameras:
  Driveway:
    ffmpeg:
      inputs:
        # High Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - record
        # Low Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - detect
    record:
      enabled: true
      retain:
        days: 0
        mode: all
      events:
        retain:
          default: 30
          mode: active_objects
    detect:
      width: 640
      height: 360
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
    objects:
      track:
        - person
        - cat
        - dog
        - sheep
        - car
        - motorcycle
        - bus

  Front_Yard:
    ffmpeg:
      inputs:
        # High Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - record
        # Low Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - detect
    record:
      enabled: true
      retain:
        days: 0
        mode: all
      events:
        retain:
          default: 30
          mode: active_objects
    detect:
      width: 640
      height: 360
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
    objects:
      track:
        - person
        - cat
        - dog
        - sheep
        - car
        - motorcycle
        - bus

  Front_Door:
    ffmpeg:
      inputs:
        # High Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - record
        # Low Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - detect
    record:
      enabled: true
      retain:
        days: 0
        mode: all
      events:
        retain:
          default: 30
          mode: active_objects
    detect:
      width: 640
      height: 360
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
    objects:
      track:
        - person
        - cat
        - dog
        - sheep
        - car
        - bus

  House_Side:
    ffmpeg:
      inputs:
        # High Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - record
        # Low Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - detect
    record:
      enabled: true
      retain:
        days: 0
        mode: all
      events:
        retain:
          default: 30
          mode: active_objects
    detect:
      width: 640
      height: 360
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
    objects:
      track:
        - person
        - cat
        - dog
        - sheep
        - car
        - bus

  Office:
    ffmpeg:
      inputs:
        # High Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - record
        # Low Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - detect
    record:
      enabled: true
      retain:
        days: 0
        mode: all
      events:
        retain:
          default: 30
          mode: active_objects
    detect:
      width: 640
      height: 360
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
    objects:
      track:
        - person

  Garage:
    ffmpeg:
      inputs:
        # High Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - record
        # Low Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - detect
    record:
      enabled: true
      retain:
        days: 0
        mode: all
      events:
        retain:
          default: 30
          mode: active_objects
    detect:
      width: 640
      height: 360
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
    objects:
      track:
        - person
        - cat
        - dog
        - motorcycle

  Workshop:
    ffmpeg:
      inputs:
        # High Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - record
        # Low Resolution Stream
        - path: ***
          hwaccel_args: preset-vaapi
          roles:
            - detect
    record:
      enabled: true
      retain:
        days: 0
        mode: all
      events:
        retain:
          default: 30
          mode: active_objects
    detect:
      width: 640
      height: 360
      fps: 5
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
    objects:
      track:
        - person
        - cat
        - dog
        - sheep
        - motorcycle

version: 0.14
#camera_groups:
 # Test_Group:
  #  order: 1
   # icon: LuActivity
   # cameras:
    #  - birdseye
    #  - Driveway

docker-compose file or Docker CLI command

version: '3.9'

services:

  frigate:
    container_name: frigate
    privileged: true
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "128mb" # update for your cameras based on calculation above
    devices:
      - /dev/bus/usb:/dev/bus/usb
      - /dev/bus/usb/002/003:/dev/bus/usb/002/003
      - /dev/bus/usb/002/002:/dev/bus/usb/002/002
      - /dev/coral_usb:/dev/coral_usb # coral usb pass through
      - /dev/dri/renderD128 # for intel hwaccel, needs to be updated for your hardware
    volumes:
      - /dev/bus/usb:/dev/bus/usb
      - /dev/bus/usb/002/003:/dev/bus/usb/002/003
      - /dev/bus/usb/002/002:/dev/bus/usb/002/002
      - /etc/localtime:/etc/localtime
      - /opt/frigate/config:/config
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "5000:5000"
      - "1935:1935" # RTMP feeds
    environment:
      FRIGATE_RTSP_PASSWORD: "***"

Relevant Frigate log output

2024-12-21 17:16:40.958731342  [INFO] Preparing Frigate...
2024-12-21 17:16:40.959949304  [INFO] Preparing new go2rtc config...
2024-12-21 17:16:40.961765364  [INFO] Starting NGINX...
2024-12-21 17:16:40.970093629  [INFO] Starting Frigate...
s6-rc: info: service nginx successfully started
s6-rc: info: service certsync: starting
s6-rc: info: service certsync successfully started
s6-rc: info: service legacy-services: starting
2024-12-21 17:16:41.070139892  [INFO] Starting certsync...
s6-rc: info: service legacy-services successfully started
2024-12-21 17:16:41.268468546  127.0.0.1 - - [21/Dec/2024:17:16:41 -0500] "" 400 0 "-" "-" "-"
2024-12-21 17:16:41.321558392  [INFO] Starting go2rtc...
2024-12-21 17:16:41.420107636  17:16:41.419 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2024-12-21 17:16:41.420112759  17:16:41.419 INF config path=/dev/shm/go2rtc.yaml
2024-12-21 17:16:41.421101126  17:16:41.420 INF [api] listen addr=:1984
2024-12-21 17:16:41.421398204  17:16:41.420 INF [rtsp] listen addr=:8554
2024-12-21 17:16:41.421853861  17:16:41.421 INF [webrtc] listen addr=:8555/tcp
2024-12-21 17:16:41.887084705  2024/12/21 17:16:41 [error] 162#162: *2 connect() failed (111: Connection refused) while connecting to upstream, client: 192.168.1.105, server: , request: "GET /ws HTTP/1.1", subrequest: "/auth", upstream: "http://127.0.0.1:5001/auth", host: "192.168.1.148:5000"
2024-12-21 17:16:41.887090569  2024/12/21 17:16:41 [error] 162#162: *2 auth request unexpected status: 502 while sending to client, client: 192.168.1.105, server: , request: "GET /ws HTTP/1.1", host: "192.168.1.148:5000"
2024-12-21 17:16:41.887092861  192.168.1.105 - - [21/Dec/2024:17:16:41 -0500] "GET /ws HTTP/1.1" 500 177 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:133.0) Gecko/20100101 Firefox/133.0" "-"
2024-12-21 17:16:42.378429011  [2024-12-21 17:16:42] frigate.app                    INFO    : Starting Frigate (0.14.1-f4f3cfa)
2024-12-21 17:16:42.378507425  [2024-12-21 17:16:42] frigate.util.config            INFO    : Checking if frigate config needs migration...
2024-12-21 17:16:42.437513125  [2024-12-21 17:16:42] frigate.util.config            INFO    : frigate config does not need migration...
2024-12-21 17:16:42.485094664  [2024-12-21 17:16:42] peewee_migrate.logs            INFO    : Starting migrations
2024-12-21 17:16:42.485198193  [2024-12-21 17:16:42] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-12-21 17:16:42.496621421  [2024-12-21 17:16:42] frigate.app                    INFO    : Recording process started: 339
2024-12-21 17:16:42.502714994  [2024-12-21 17:16:42] frigate.app                    INFO    : Recording process started: 348
2024-12-21 17:16:42.505369545  [2024-12-21 17:16:42] frigate.app                    INFO    : go2rtc process pid: 103
2024-12-21 17:16:42.535415596  [2024-12-21 17:16:42] detector.coral                 INFO    : Starting detection process: 368
2024-12-21 17:16:42.540579332  [2024-12-21 17:16:42] frigate.app                    INFO    : Output process started: 371
2024-12-21 17:16:42.586565138  [2024-12-21 17:16:42] frigate.app                    INFO    : Camera processor started for Driveway: 387
2024-12-21 17:16:42.601027733  [2024-12-21 17:16:42] frigate.app                    INFO    : Camera processor started for Front_Yard: 393
2024-12-21 17:16:42.602292880  [2024-12-21 17:16:42] frigate.app                    INFO    : Camera processor started for Front_Door: 401
2024-12-21 17:16:42.611104162  [2024-12-21 17:16:42] frigate.app                    INFO    : Camera processor started for House_Side: 409
2024-12-21 17:16:42.625429554  [2024-12-21 17:16:42] frigate.app                    INFO    : Camera processor started for Office: 417
2024-12-21 17:16:42.626724668  [2024-12-21 17:16:42] frigate.app                    INFO    : Camera processor started for Garage: 425
2024-12-21 17:16:42.663516176  [2024-12-21 17:16:42] frigate.app                    INFO    : Camera processor started for Workshop: 433
2024-12-21 17:16:42.663521392  [2024-12-21 17:16:42] frigate.app                    INFO    : Capture process started for Driveway: 441
2024-12-21 17:16:42.663526356  [2024-12-21 17:16:42] frigate.app                    INFO    : Capture process started for Front_Yard: 446
2024-12-21 17:16:42.700831840  [2024-12-21 17:16:42] frigate.app                    INFO    : Capture process started for Front_Door: 450
2024-12-21 17:16:42.700836791  [2024-12-21 17:16:42] frigate.app                    INFO    : Capture process started for House_Side: 456
2024-12-21 17:16:42.700838252  [2024-12-21 17:16:42] frigate.app                    INFO    : Capture process started for Office: 464
2024-12-21 17:16:42.716590936  [2024-12-21 17:16:42] frigate.app                    INFO    : Capture process started for Garage: 469
2024-12-21 17:16:42.718527591  [2024-12-21 17:16:42] frigate.app                    INFO    : Capture process started for Workshop: 482
2024-12-21 17:16:45.150699605  [2024-12-21 17:16:42] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-12-21 17:16:45.152424233  Process detector:coral:
2024-12-21 17:16:45.152428722  [2024-12-21 17:16:45] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-12-21 17:16:45.152433758  [2024-12-21 17:16:45] frigate.detectors.plugins.edgetpu_tfl ERROR   : No EdgeTPU was detected. If you do not have a Coral device yet, you must configure CPU detectors.
2024-12-21 17:16:45.152434871  Traceback (most recent call last):
2024-12-21 17:16:45.152436035    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
2024-12-21 17:16:45.152460046      self.run()
2024-12-21 17:16:45.152461447    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
2024-12-21 17:16:45.152463166      self._target(*self._args, **self._kwargs)
2024-12-21 17:16:45.152464364    File "/opt/frigate/frigate/object_detection.py", line 102, in run_detector
2024-12-21 17:16:45.152465660      object_detector = LocalObjectDetector(detector_config=detector_config)
2024-12-21 17:16:45.152466608    File "/opt/frigate/frigate/object_detection.py", line 53, in __init__
2024-12-21 17:16:45.152489275      self.detect_api = create_detector(detector_config)
2024-12-21 17:16:45.152490574    File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
2024-12-21 17:16:45.152503218      return api(detector_config)
2024-12-21 17:16:45.152504431    File "/opt/frigate/frigate/detectors/plugins/edgetpu_tfl.py", line 43, in __init__
2024-12-21 17:16:45.152505468      self.interpreter = Interpreter(
2024-12-21 17:16:45.152506593    File "/usr/lib/python3/dist-packages/tflite_runtime/interpreter.py", line 348, in __init__
2024-12-21 17:16:45.152507617      _interpreter_wrapper.CreateWrapperFromFile(
2024-12-21 17:16:45.152508598  ValueError: Model provided has model identifier 'l ve', should be 'TFL3'
2024-12-21 17:16:45.152509310  
2024-12-21 17:16:45.833339998  [2024-12-21 17:16:45] frigate.video                  ERROR   : Office: Unable to read frames from ffmpeg process.
2024-12-21 17:16:45.833437545  [2024-12-21 17:16:45] frigate.video                  ERROR   : Office: ffmpeg process is not running. exiting capture thread...

Relevant go2rtc log output

N/A

FFprobe output from your camera

N/A

Install method

Docker Compose

Object Detector

Coral

Network connection

Wired

Camera make and model

Wyze

Screenshots of the Frigate UI's System metrics pages

No screenshots needed

Any other information that may be helpful

No response

[NickM-27]

definitely shouldn't be mapping /dev/bus/usb as a volume and device at the same time. Does it work if you do either by itself?

[jjosephcuc]

definitely shouldn't be mapping /dev/bus/usb as a volume and device at the same time. Does it work if you do either by itself?

I've tried both to no success. More of a hail marry at trying to get it to work on my end.

[reidprichard]

I'm having a similar issue. I can get the Coral to work with /dev/bus/usb/003/00X passed through to the container, but I'm encountering some issues due to USB bus numbers changing on me. I made a udev rule to symlink the device to /dev/coral1, but I can't seem to get Frigate to see that device. I've tried mapping /dev/coral1 to /dev/coral1 in the container or /dev/bus/usb/003/002 in the container. In both cases, removing the AddDevice=/dev/bus/usb/003/002:/dev/bus/usb/003/002 causes Frigate to repeatedly restart due to not finding the Coral.

~/.config/containers/systemd/frigate.container

# frigate.container
[Container]
# Have to alternate the below two lines depending on what bus it decides to be
AddDevice=/dev/bus/usb/003/002:/dev/bus/usb/003/002
#AddDevice=/dev/bus/usb/003/003:/dev/bus/usb/003/003
# This is the device symlink - doesn't seem to do anything
AddDevice=/dev/coral1:/dev/coral1
ContainerName=frigate
Environment=FRIGATE_RTSP_PASSWORD=xxxxxxx OPENCV_LOG_LEVEL=FATAL
Image=ghcr.io/blakeblackshear/frigate:0.14.1
Network=frigate_default
PodmanArgs=--group-add keep-groups --network-alias frigate
PublishPort=8971:8971
PublishPort=8554:8554
PublishPort=1984:1984
ShmSize=256mb
Tmpfs=/tmp/cache:size=1000000000
Volume=/etc/localtime:/etc/localtime:ro
Volume=frigate_config:/config/:z
Volume=/mnt/Frigate:/media/frigate
Volume=frigate_database:/database:z

[Service]
Restart=always

[Install]
WantedBy=default.target

[Unit]
StartLimitIntervalSec=0

/etc/udev/rules.d/90-coral.rules

SUBSYSTEMS=="usb", ATTRS{idVendor}=="18d1", ATTRS{idProduct}=="9302", MODE="0666", GROUP="coral", SYMLINK+="coral%n"
SUBSYSTEMS=="usb", ATTRS{idVendor}=="1a6e", ATTRS{idProduct}=="089a", MODE="0666", GROUP="coral", SYMLINK+="coral_2%n"

[jjosephcuc]

Remove your model parameters if you have them. This ended up being my issue.