[Config Support]: TensorRt Large number of false positives and general detection issues #10817

hollanbm · 2024-04-04T01:53:18Z

hollanbm
Apr 4, 2024

Describe the problem you are having

I'm having some issues with my detections in Frigate. I suspect it's due to a lack of understanding of how the detections are actually happening, leading to a less-than-stellar configuration.

I believe I read that if you look in the debug screen of a camera, the motion boxes are what are sent in for detection. So it's better for a model to have a lower resolution? I also saw that the detect resolution itself wasn't too important, as the additional bitrate and image quality didn't have any net positive on the object detection rates.

Initially, I was using the primary high full-resolution stream for object detection. But while troubleshooting, I added a second medium 720p stream solely for detections. I have also masked off areas where motion should be ignored.

I've tried different yolov7 models. From what I've read yolo-v7x is supposed to be the most accurate; but when I use that model, everything is detected as a "Person".

My inference speed is around 4.5ms

System:
2x Xeon E5-2687wv4
128GB DDR4
Nvidia RTX A4000

Version

0.13.2-6476f8a

Frigate config file

# yaml-language-server: $schema=http://10.254.1.77:5000/api/config/schema.json

mqtt:
  enabled: false

detectors:
  tensorrt:
    type: tensorrt
    device: 0 #This is the default, select the first GPU

model:
  path: /config/model_cache/tensorrt/yolov7-320.trt
  input_tensor: nchw
  input_pixel_format: rgb
  width: 320
  height: 320

record:
  enabled: true
  retain:
    days: 1
    mode: motion
  events:
    retain:
      default: 1
      mode: active_objects

snapshots:
  enabled: true
  bounding_box: true
  timestamp: false
  crop: false
  quality: 100
  retain:
    default: 30

detect:
  enabled: true
  fps: 5

audio:
  enabled: false
  min_volume: 500
  listen:
    - bark

ffmpeg:
  hwaccel_args: preset-nvidia-h264
  output_args:
    record: preset-record-ubiquiti #preset-record-generic-audio-copy

live:
  height: 1080
  quality: 1

birdseye:
  quality: 1

go2rtc:
  streams:
    back_driveway:
      - rtspx://10.254.15.2:7441/2HmyMRarR9xUXYB7
    back_driveway_med:
      - rtspx://10.254.15.2:7441/iWjfzQBqzMyTNE3W
    back_porch:
      - rtspx://10.254.15.2:7441/W6744vv3WmVYboJv
    back_porch_med:
      - rtspx://10.254.15.2:7441/RXH2vWlIMRWrUkWd
    back_yard:
      - rtspx://10.254.15.2:7441/SGZRCKsW6D4i0jWd
    back_yard_med:
      - rtsps://10.254.15.2:7441/Vv1PTR75u1cNngIJ
    bear_roof:
      - rtspx://10.254.15.2:7441/NsycYa8Vy93sN9Mb
    bear_roof_med:
      - rtspx://10.254.15.2:7441/IaFIPXGG4lLUFq4o
    front_porch:
      - rtspx://10.254.15.2:7441/X68oQnxtEaGPpHyd
    front_porch_med:
      - rtspx://10.254.15.2:7441/66OBUm2m2Ntulraz
    front_yard:
      - rtspx://10.254.15.2:7441/PoSOR67kIdCMXG4Y
    front_yard_med:
      - rtspx://10.254.15.2:7441/p54u2PVlyxHoBo7c
    garage_driveway:
      - rtspx://10.254.15.2:7441/lwbS2B4Q5Tj1aLwX
    garage_driveway_med:
      - rtspx://10.254.15.2:7441/Nj0Eh1nO8OY9CLtI
    side_yard:
      - rtspx://10.254.15.2:7441/zjLRxxvTghHyKHfz
    side_yard_med:
      - rtspx://10.254.15.2:7441/LRbMhmUXq2llA0pt
cameras:
  front_yard: # g5 pro
    ui:
      order: 1
    detect:
      width: 1280
      height: 720
    live:
      stream_name: front_yard
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/front_yard
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/front_yard_med
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - detect
    objects:
      track:
        - bicycle
        - car
        - dog
        - motorcycle
        - person
        - package
        - ups
        - fedex
        - amazon
    motion:
      mask:
        - 1003,720,1065,638,922,450,791,434,630,720
        - 255,0,477,0,562,90,422,180,308,188,190,107
        - 1036,510,1139,563,1226,366,1188,343
        - 1280,229,1242,344,1212,321,1252,199
        - 1101,285,1146,309,1151,252,1127,254
        - 917,173,1007,216,1035,177,949,137
        - 693,140,714,104,779,109,758,150
        - 84,149,197,102,283,0,0,0,0,204
  front_porch: # g5 flex
    ui:
      order: 2
    detect:
      width: 1280
      height: 720
    live:
      stream_name: front_porch
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/front_porch
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/front_porch_med
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - detect
    objects:
      track:
        - bicycle
        - car
        - dog
        - motorcycle
        - person
        - face
        - package
    motion:
      mask:
        - 1280,333,1280,143,1108,62,1057,245,861,396,727,491,593,627,726,720,1074,720,1177,508
        - 203,720,156,661,166,632,187,600,211,559,263,510,321,474,405,482,415,528,357,635,370,720
        - 1024,140,1067,149,1074,102,1031,81
        - 757,48,800,27,921,29,917,75
        - 497,69,490,83,570,77,576,53
  back_driveway: # g3 bullet
    ui:
      order: 3
    detect:
      width: 1024
      height: 576
    live:
      stream_name: back_driveway
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/back_driveway
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/back_driveway_med
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - detect
    objects:
      track:
        - dog
        - person
        - bicycle
  garage_driveway: # g4 bullet
    ui:
      order: 4
    detect:
      width: 1280
      height: 720
    live:
      stream_name: garage_driveway
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/garage_driveway
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/garage_driveway_med
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - detect
            - audio
    objects:
      track:
        - bicycle
        - dog
        - person
  back_porch: # g5 flex
    ui:
      order: 5
    detect:
      width: 1280
      height: 720
    live:
      stream_name: back_porch
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/back_porch
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/back_porch_med
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - detect
            - audio
    objects:
      track:
        - dog
        - person
        - face
    motion:
      mask:
        - 973,201,789,135,724,98,793,42,1022,0,1233,96,1199,244
  back_yard: # g5 pr # g3 bullet
    ui:
      order: 6
    detect:
      width: 1280
      height: 720
    live:
      stream_name: back_yard
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/back_yard
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/back_yard_med
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - detect
            - audio
    objects:
      track:
        - dog
        - person
    motion:
      mask:
        - 1032,158,1016,94,1072,63,1280,129,1280,294
  side_yard: # g3 bullet
    ui:
      order: 7
    detect:
      width: 1024
      height: 576
    live:
      stream_name: side_yard
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/side_yard
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/side_yard_med
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - detect
    objects:
      track:
        - bicycle
        - dog
        - person
    motion:
      mask:
        - 694,301,764,196,824,147,961,212,842,395
        - 0,0,0,21,189,24,190,0
  bear_roof: # g3 bullet
    ui:
      order: 8
    detect:
      width: 1024
      height: 576
    live:
      stream_name: bear_roof
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/bear_roof
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/bear_roof_med
          input_args: preset-rtsp-restream #preset-rtsp-restream-low-latency
          roles:
            - detect
    objects:
      track:
        - person

Relevant log output

2024-04-04 01:51:38.614342369  [INFO] Preparing Frigate...
2024-04-04 01:51:38.651146810  [INFO] Starting Frigate...
2024-04-04 01:51:40.911535574  [2024-04-04 01:51:40] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-04-04 01:51:41.168088900  [2024-04-04 01:51:41] peewee_migrate.logs            INFO    : Starting migrations
2024-04-04 01:51:41.174528814  [2024-04-04 01:51:41] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-04-04 01:51:41.185996754  [2024-04-04 01:51:41] frigate.app                    INFO    : Recording process started: 1899
2024-04-04 01:51:41.189029943  [2024-04-04 01:51:41] frigate.app                    INFO    : go2rtc process pid: 103
2024-04-04 01:51:41.220097363  [2024-04-04 01:51:41] frigate.app                    INFO    : Output process started: 1908
2024-04-04 01:51:41.230223217  [2024-04-04 01:51:41] detector.tensorrt              INFO    : Starting detection process: 1907
2024-04-04 01:51:41.444604467  [2024-04-04 01:51:41] frigate.app                    INFO    : Camera processor started for front_yard: 1922
2024-04-04 01:51:41.445423558  [2024-04-04 01:51:41] frigate.app                    INFO    : Camera processor started for front_porch: 1924
2024-04-04 01:51:41.445483569  [2024-04-04 01:51:41] frigate.app                    INFO    : Camera processor started for back_driveway: 1926
2024-04-04 01:51:41.445547412  [2024-04-04 01:51:41] frigate.app                    INFO    : Camera processor started for garage_driveway: 1929
2024-04-04 01:51:41.445606773  [2024-04-04 01:51:41] frigate.app                    INFO    : Camera processor started for back_porch: 1932
2024-04-04 01:51:41.445662007  [2024-04-04 01:51:41] frigate.app                    INFO    : Camera processor started for back_yard: 1934
2024-04-04 01:51:41.445715626  [2024-04-04 01:51:41] frigate.app                    INFO    : Camera processor started for side_yard: 1955
2024-04-04 01:51:41.445768621  [2024-04-04 01:51:41] frigate.app                    INFO    : Camera processor started for bear_roof: 1958
2024-04-04 01:51:41.445821757  [2024-04-04 01:51:41] frigate.app                    INFO    : Capture process started for front_yard: 1959
2024-04-04 01:51:41.445874646  [2024-04-04 01:51:41] frigate.app                    INFO    : Capture process started for front_porch: 1963
2024-04-04 01:51:41.445927220  [2024-04-04 01:51:41] frigate.app                    INFO    : Capture process started for back_driveway: 1967
2024-04-04 01:51:41.445980447  [2024-04-04 01:51:41] frigate.app                    INFO    : Capture process started for garage_driveway: 1970
2024-04-04 01:51:41.446043062  [2024-04-04 01:51:41] frigate.app                    INFO    : Capture process started for back_porch: 1973
2024-04-04 01:51:41.446095273  [2024-04-04 01:51:41] frigate.app                    INFO    : Capture process started for back_yard: 1977
2024-04-04 01:51:41.446146957  [2024-04-04 01:51:41] frigate.app                    INFO    : Capture process started for side_yard: 1984
2024-04-04 01:51:41.446200721  [2024-04-04 01:51:41] frigate.app                    INFO    : Capture process started for bear_roof: 1989
2024-04-04 01:51:41.511617622  [2024-04-04 01:51:41] frigate.detectors.plugins.tensorrt INFO    : Loaded engine size: 72 MiB
2024-04-04 01:51:41.930128174  [2024-04-04 01:51:41] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +6, GPU +8, now: CPU 213, GPU 247 (MiB)
2024-04-04 01:51:41.941237482  [2024-04-04 01:51:41] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +2, GPU +10, now: CPU 215, GPU 257 (MiB)
2024-04-04 01:51:41.954129399  [2024-04-04 01:51:41] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +70, now: CPU 0, GPU 70 (MiB)
2024-04-04 01:51:41.960781299  [2024-04-04 01:51:41] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 142, GPU 249 (MiB)
2024-04-04 01:51:41.961817105  [2024-04-04 01:51:41] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 142, GPU 257 (MiB)
2024-04-04 01:51:41.961973018  [2024-04-04 01:51:41] frigate.detectors.plugins.tensorrt INFO    : [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +15, now: CPU 0, GPU 85 (MiB)

Frigate stats

{"cameras":{"back_driveway":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":4.63,"capture_pid":1966,"detection_enabled":1,"detection_fps":7.37,"ffmpeg_pid":2004,"pid":1947,"process_fps":4.08,"skipped_fps":0.46},"back_porch":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":4.5,"capture_pid":1973,"detection_enabled":1,"detection_fps":2.21,"ffmpeg_pid":1978,"pid":1951,"process_fps":2.98,"skipped_fps":1.5},"back_yard":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":4.65,"capture_pid":1976,"detection_enabled":1,"detection_fps":3.52,"ffmpeg_pid":1989,"pid":1953,"process_fps":3.42,"skipped_fps":1.2},"bear_roof":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":4.77,"capture_pid":1988,"detection_enabled":1,"detection_fps":9.41,"ffmpeg_pid":1999,"pid":1957,"process_fps":4.09,"skipped_fps":0.61},"front_porch":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":4.5,"capture_pid":1961,"detection_enabled":1,"detection_fps":2.33,"ffmpeg_pid":1991,"pid":1945,"process_fps":2.91,"skipped_fps":1.55},"front_yard":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":4.61,"capture_pid":1959,"detection_enabled":1,"detection_fps":7.44,"ffmpeg_pid":2003,"pid":1944,"process_fps":2.88,"skipped_fps":1.69},"garage_driveway":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":4.12,"capture_pid":1968,"detection_enabled":1,"detection_fps":2.46,"ffmpeg_pid":1977,"pid":1949,"process_fps":2.73,"skipped_fps":1.37},"side_yard":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":4.81,"capture_pid":1981,"detection_enabled":1,"detection_fps":6.0,"ffmpeg_pid":1996,"pid":1955,"process_fps":4.12,"skipped_fps":0.6}},"cpu_usages":{"1":{"cmdline":"/package/admin/s6/command/s6-svscan -d4 -- /run/service","cpu":"0.0","cpu_average":"0","mem":"0.0"},"14":{"cmdline":"s6-supervise s6-linux-init-shutdownd","cpu":"0.0","cpu_average":"0","mem":"0.0"},"16":{"cmdline":"/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B","cpu":"0.0","cpu_average":"0","mem":"0.0"},"23":{"cmdline":"s6-supervise go2rtc-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"24":{"cmdline":"s6-supervise s6rc-oneshot-runner","cpu":"0.0","cpu_average":"0","mem":"0.0"},"25":{"cmdline":"s6-supervise frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"26":{"cmdline":"s6-supervise nginx-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"27":{"cmdline":"s6-supervise go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"28":{"cmdline":"s6-supervise nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"29":{"cmdline":"s6-supervise frigate-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"30":{"cmdline":"s6-supervise s6rc-fdholder","cpu":"0.0","cpu_average":"0","mem":"0.0"},"31":{"cmdline":"s6-supervise go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"42":{"cmdline":"/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --","cpu":"0.0","cpu_average":"0","mem":"0.0"},"43":{"cmdline":"/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules","cpu":"0.0","cpu_average":"0","mem":"0.0"},"89":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"90":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"93":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"102":{"cmdline":"/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml","cpu":"0.0","cpu_average":"0","mem":"0.0"},"113":{"cmdline":"bash ./run.user go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"131":{"cmdline":"sleep 10s","cpu":"0.0","cpu_average":"0","mem":"0.0"},"133":{"cmdline":"python3 -u -m frigate","cpu":"0.0","cpu_average":"100","mem":"0.2"},"138":{"cmdline":"nginx: master process nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"160":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"161":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"162":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"163":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"180":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"199":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"226":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"258":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"285":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"312":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"347":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"383":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"422":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"469":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"505":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"545":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"584":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"616":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"646":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"676":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"715":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"756":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"791":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"819":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"851":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"866":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"909":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"949":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"993":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1025":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1057":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1092":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1123":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1164":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1199":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1237":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1270":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1301":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1330":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1365":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1397":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1430":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1460":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1499":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1539":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1579":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1610":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1639":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1670":{"cmdline":"nginx: cache manager process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1708":{"cmdline":"nginx: cache loader process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1897":{"cmdline":"frigate.logger       ","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1899":{"cmdline":"frigate.recording_manager","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1906":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(66)","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1907":{"cmdline":"frigate.detector.tensorrt","cpu":"0.0","cpu_average":"0","mem":"0.4"},"1909":{"cmdline":"frigate.output       ","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1914":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1920x1080 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1916":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1920x1080 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1917":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1024x576 -i pipe: -f mpegts -s 1920x1080 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1918":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1920x1080 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1919":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1920x1080 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1920":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1920x1080 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1921":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1024x576 -i pipe: -f mpegts -s 1920x1080 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1922":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1024x576 -i pipe: -f mpegts -s 1920x1080 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1923":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 1 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1944":{"cmdline":"frigate.process:front_yard","cpu":"0.0","cpu_average":"28","mem":"0.1"},"1945":{"cmdline":"frigate.process:front_porch","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1947":{"cmdline":"frigate.process:back_driveway","cpu":"0.0","cpu_average":"71","mem":"0.1"},"1949":{"cmdline":"frigate.process:garage_driveway","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1951":{"cmdline":"frigate.process:back_porch","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1953":{"cmdline":"frigate.process:back_yard","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1955":{"cmdline":"frigate.process:side_yard","cpu":"0.0","cpu_average":"42","mem":"0.1"},"1957":{"cmdline":"frigate.process:bear_roof","cpu":"0.0","cpu_average":"85","mem":"0.1"},"1959":{"cmdline":"frigate.capture:front_yard","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1961":{"cmdline":"frigate.capture:front_porch","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1966":{"cmdline":"frigate.capture:back_driveway","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1968":{"cmdline":"frigate.capture:garage_driveway","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1973":{"cmdline":"frigate.capture:back_porch","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1976":{"cmdline":"frigate.capture:back_yard","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1977":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/garage_driveway_med -r 5 -vf fps=5,scale_cuda=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1978":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/back_porch_med -r 5 -vf fps=5,scale_cuda=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1981":{"cmdline":"frigate.capture:side_yard","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1988":{"cmdline":"frigate.capture:bear_roof","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1989":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/back_yard_med -r 5 -vf fps=5,scale_cuda=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1991":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/front_porch_med -r 5 -vf fps=5,scale_cuda=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1992":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/garage_driveway -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac /tmp/cache/garage_driveway@%Y%m%d%H%M%S%z.mp4","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1994":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/back_porch -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac /tmp/cache/back_porch@%Y%m%d%H%M%S%z.mp4","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1996":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/side_yard_med -r 5 -vf fps=5,scale_cuda=w=1024:h=576:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1999":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/bear_roof_med -r 5 -vf fps=5,scale_cuda=w=1024:h=576:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"2003":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/front_yard_med -r 5 -vf fps=5,scale_cuda=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"2004":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/back_driveway_med -r 5 -vf fps=5,scale_cuda=w=1024:h=576:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"2006":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/back_yard -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac /tmp/cache/back_yard@%Y%m%d%H%M%S%z.mp4","cpu":"0.0","cpu_average":"0","mem":"0.0"},"2010":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/side_yard -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac /tmp/cache/side_yard@%Y%m%d%H%M%S%z.mp4","cpu":"0.0","cpu_average":"0","mem":"0.0"},"2011":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/front_porch -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac /tmp/cache/front_porch@%Y%m%d%H%M%S%z.mp4","cpu":"0.0","cpu_average":"0","mem":"0.0"},"2016":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/bear_roof -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac /tmp/cache/bear_roof@%Y%m%d%H%M%S%z.mp4","cpu":"0.0","cpu_average":"0","mem":"0.0"},"2017":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/front_yard -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac /tmp/cache/front_yard@%Y%m%d%H%M%S%z.mp4","cpu":"0.0","cpu_average":"0","mem":"0.0"},"2018":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel cuda -hwaccel_output_format cuda -user_agent FFmpeg Frigate/0.13.2-6476f8a -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/back_driveway -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c:v copy -ar 44100 -c:a aac /tmp/cache/back_driveway@%Y%m%d%H%M%S%z.mp4","cpu":"0.0","cpu_average":"0","mem":"0.0"}},"detection_fps":40.73,"detectors":{"tensorrt":{"detection_start":1712186123.024164,"inference_speed":3.93,"pid":1907}},"gpu_usages":{"NVIDIA RTX A4000":{"dec":"7.0%","enc":"0.0%","gpu":"25.0%","mem":"13.2%"}},"processes":{"go2rtc":{"pid":102},"logger":{"pid":1897},"recording":{"pid":1899}},"service":{"last_updated":1712186123,"latest_version":"0.13.2","storage":{"/dev/shm":{"free":498.3,"mount_type":"tmpfs","total":512.0,"used":13.7},"/media/frigate/clips":{"free":786614.0,"mount_type":"zfs","total":992285.0,"used":205671.0},"/media/frigate/recordings":{"free":786614.0,"mount_type":"zfs","total":992285.0,"used":205671.0},"/tmp/cache":{"free":1884.6,"mount_type":"tmpfs","total":1907.4,"used":22.8}},"temperatures":{},"uptime":7,"version":"0.13.2-6476f8a"}}

Operating system

Debian

Install method

Docker Compose

Coral version

Other

Any other information that may be helpful

~ nvidia-smi
Wed Apr  3 19:11:44 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.67                 Driver Version: 550.67         CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA RTX A4000               Off |   00000000:05:00.0 Off |                  Off |
| 41%   53C    P2             37W /  140W |    1749MiB /  16376MiB |      4%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

services:
  frigate:
    container_name: frigate
    privileged: true # this may not be necessary for all setups
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable-tensorrt
    shm_size: "512mb" # update for your cameras based on calculation above
    volumes:
      - ${HOME:?err}/Frigate/config:/config
      - ${SERVICES:?err}/Frigate/config.yml:/config/config.yml
      - ${HOME:?err}/Frigate/data:/media/frigate
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 2000000000
    ports:
      - "5000:5000"
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
    environment:
      FRIGATE_RTSP_PASSWORD: "FrigateRTSP"
      PLUS_API_KEY: <SNIP>
      USE_FP16: true
      YOLO_MODELS: yolov7-tiny-288,yolov7-tiny-416,yolov7-640,yolov7-320,yolov7x-640,yolov7x-320
    deploy:
      resources:
        reservations:
          devices:
            - device_ids: ["GPU-490e97b7-980a-1f19-146f-155937241671"] # nvidia-smi -L
              driver: nvidia
              capabilities: [gpu]

Answered by NickM-27

Apr 4, 2024

some of these could definitely be alleviated with a min_area filter. Others maybe a max_ratio filter

View full answer

NickM-27 · 2024-04-04T16:27:45Z

NickM-27
Apr 4, 2024
Collaborator Sponsor

I believe I read that if you look in the debug screen of a camera, the motion boxes are what are sent in for detection.

No, regions are what are sent to object detection. Motion boxes as well as tracked objects boxes are combined into regions.

If you have some examples of FPs it might be easier to make a suggestion, but frigate docs offers guides on how to apply filters

3 replies

hollanbm Apr 4, 2024
Author

I've tried to get as many false positives from around my house as possible. This is a pretty decent sample set.

https://imgur.com/a/PsbWeIq

NickM-27 Apr 4, 2024
Collaborator Sponsor

some of these could definitely be alleviated with a min_area filter. Others maybe a max_ratio filter

Answer selected by hollanbm

hollanbm Apr 5, 2024
Author

Thanks for the tips and guidance, I'll take a look at the filters and see if I can't improve my detections

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Config Support]: TensorRt Large number of false positives and general detection issues #10817

{{title}}

Replies: 1 comment 3 replies

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Config Support]: TensorRt Large number of false positives and general detection issues #10817

hollanbm Apr 4, 2024

Describe the problem you are having

Version

Frigate config file

Relevant log output

Frigate stats

Operating system

Install method

Coral version

Any other information that may be helpful

Replies: 1 comment · 3 replies

NickM-27 Apr 4, 2024 Collaborator Sponsor

hollanbm Apr 4, 2024 Author

NickM-27 Apr 4, 2024 Collaborator Sponsor

hollanbm Apr 5, 2024 Author

hollanbm
Apr 4, 2024

Replies: 1 comment 3 replies

NickM-27
Apr 4, 2024
Collaborator Sponsor

hollanbm Apr 4, 2024
Author

NickM-27 Apr 4, 2024
Collaborator Sponsor

hollanbm Apr 5, 2024
Author