[Config Support]: How can I use a camera for audio?

[The-Dark-Mode]

Describe the problem you are having

I have 2 cameras. One has a microphone (Door), and the other just has video (Room). How can I use the audio from the Door in Room's recordings and playback?

PROBLEM: I just discovered this when making this post: I can view clips from other cameras (removed for privacy in this post), but not from Room. I used the same configuration for the Room cam as the working cam.

Version

0.14.1-f4f3cfa

Frigate config file

mqtt:
  host: 192.168.0.31
  user: frigate
  password: frigate

detectors:
  coral:
    type: edgetpu
    device: pci

cameras:
  Room:
    ffmpeg:
      inputs:
        - path: 
            rtsp://192.168.0.203:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
          input_args: preset-rtsp-restream
          roles:
            - record
            - detect
    detect:
      width: 1280
      height: 720
      fps: 5
    objects:
      track:
        - person
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      crop: true
      height: 500
      retain:
        default: 90
    record:
      enabled: true
      retain:
        days: 14
      events:
        retain:
          mode: motion
        pre_capture: 5
        post_capture: 10

  Door:
    ffmpeg:
      inputs:
        - path: rtsp://admin:[email protected]:554/h264_hd.sdp
          input_args: preset-rtsp-restream
          roles:
            - detect
            - audio
    detect:
      width: 1280
      height: 720
      fps: 5
    objects:
      track:
        - person
    audio:
      enabled: True
      listen:
        - bark
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      crop: true
      height: 500
      retain:
        default: 90
    record:
      enabled: true
      retain:
        days: 1
      events:
        retain:
          mode: motion
        pre_capture: 5
        post_capture: 10
    motion:
      mask: 0,0.09,0.126,0.091,0.128,0.05,0.476,0.045,0.479,0,0.003,0
    zones:
      Door_Zone:
        coordinates: 0.227,0.053,0.294,0.994,0.663,0.997,0.709,0.003,0.487,0.005,0.486,0.049
        loitering_time: 0

version: 0.14

Relevant Frigate log output

2025-01-05 11:31:17.691314364  [INFO] Preparing Frigate...
2025-01-05 11:31:17.713734551  [INFO] Starting Frigate...
2025-01-05 11:31:18.916579292  [2025-01-05 11:31:18] frigate.app                    INFO    : Starting Frigate (0.14.1-f4f3cfa)
2025-01-05 11:31:18.916973677  [2025-01-05 11:31:18] frigate.util.config            INFO    : Checking if frigate config needs migration...
2025-01-05 11:31:18.938360646  [2025-01-05 11:31:18] frigate.util.config            INFO    : frigate config does not need migration...
2025-01-05 11:31:18.985014528  [2025-01-05 11:31:18] frigate.util.services          WARNING : Did not detect hwaccel, using a GPU for accelerated video decoding is highly recommended
2025-01-05 11:31:19.005661945  [2025-01-05 11:31:19] peewee_migrate.logs            INFO    : Starting migrations
2025-01-05 11:31:19.006119927  [2025-01-05 11:31:19] peewee_migrate.logs            INFO    : There is nothing to migrate
2025-01-05 11:31:19.025335160  [2025-01-05 11:31:19] frigate.app                    INFO    : Recording process started: 357
2025-01-05 11:31:19.028981188  [2025-01-05 11:31:19] frigate.app                    INFO    : Recording process started: 358
2025-01-05 11:31:19.030717346  [2025-01-05 11:31:19] frigate.app                    INFO    : go2rtc process pid: 97
2025-01-05 11:31:19.087761904  [2025-01-05 11:31:19] detector.coral                 INFO    : Starting detection process: 386
2025-01-05 11:31:19.096348426  [2025-01-05 11:31:19] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as pci
2025-01-05 11:31:19.105176005  [2025-01-05 11:31:19] frigate.app                    INFO    : Output process started: 388
2025-01-05 11:31:19.111452808  [2025-01-05 11:31:19] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2025-01-05 11:31:19.178294739  [2025-01-05 11:31:19] frigate.app                    INFO    : Camera processor started for Room: 415
2025-01-05 11:31:19.194328384  [2025-01-05 11:31:19] frigate.app                    INFO    : Camera processor started for Door: 422
2025-01-05 11:31:19.209260755  [2025-01-05 11:31:19] frigate.app                    INFO    : Capture process started for Room: 430
2025-01-05 11:31:19.213660947  [2025-01-05 11:31:19] frigate.app                    INFO    : Capture process started for Door: 435
2025-01-05 11:31:19.218938351  [2025-01-05 11:31:19] frigate.app                    INFO    : Audio process started: 436

Relevant go2rtc log output

2025-01-05 11:31:17.692045086  [INFO] Preparing new go2rtc config...
2025-01-05 11:31:18.012361583  [INFO] Starting go2rtc...
2025-01-05 11:31:18.124567029  11:31:18.124 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2025-01-05 11:31:18.124589214  11:31:18.124 INF config path=/dev/shm/go2rtc.yaml
2025-01-05 11:31:18.125830910  11:31:18.124 INF [api] listen addr=:1984
2025-01-05 11:31:18.125834388  11:31:18.125 INF [rtsp] listen addr=:8554
2025-01-05 11:31:18.125838377  11:31:18.125 INF [webrtc] listen addr=:8555/tcp
2025-01-05 11:31:27.691063618  [INFO] Starting go2rtc healthcheck service...

Frigate stats

System is healthy

Operating system

Debian

Install method

Docker Compose

docker-compose file or Docker CLI command

version: "3.9"
services:
  frigate:
    container_name: frigate
    privileged: true # this may not be necessary for all setups
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "512mb" # update for your cameras based on calculation above
    devices:
      - /dev/apex_0:/dev/apex_0
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /opt/frigate/config:/config
      - /media/frigate:/media/frigate
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "8971:8971"
      - "5000:5000" # Internal unauthenticated access. Expose carefully.
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
      - "1935:1935"
    environment:
      FRIGATE_RTSP_PASSWORD: "frigate"

Object Detector

Coral

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

I can view clips from other cameras (removed for privacy in this post), but not from Room. I used the same config for the Room cam as the working cam.

[hawkeye217]

How can I use the audio from the Door in Room's recordings and playback?

This is possible if you use go2rtc, but you might want to reevaluate the reason behind it because there's no guarantee that the audio and video between the streams from different cameras will be synchronized.