[Config Support]: Intel QSV on sub stream for 360 camera fails but works directly from ffmpeg #15861
-
Describe the problem you are havingHi! First I managed to make qsv work on my 12th gen Intel i5-12500 that I bought specifically for Frigate server.
And everything would've been great if not one issue with sub stream from FE-P (fisheye 360 camera that I will try to dewarp since I have qsv encoder). The main stream works fine, but I don't want to detect on 2560x2560 30fps stream. Here is how this stream plays in the Frigate docker container
Please see below how ffmpeg crashes when I try to use hall_sub stream. Version0.15-beta4 Frigate config fileffmpeg:
hwaccel_args:
- -bsf:v
- dump_extra
- -hwaccel_output_format
- qsv
- -c:v
- h264_qsv
detectors:
ov:
type: openvino
device: GPU
model:
path: plus://id
model:
path: plus://id
go2rtc:
streams:
# reolink cx410
carport:
- ffmpeg:https://192.168.2.184/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=admin&password=pass#video=copy#audio=copy#audio=opus
carport_sub:
- ffmpeg:https://192.168.2.184/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=admin&password=pass
# reolink 360
hall:
- ffmpeg:https://192.168.2.204/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=admin&password=pass#video=copy#audio=copy#audio=opus
hall_sub:
- ffmpeg:https://192.168.2.204/flv?port=1935&app=bcs&stream=channel0_sub.bcs&user=admin&password=pass
doorbell:
- ffmpeg:rtsp://admin:[email protected]/Streaming/Channels/101/
doorbell_sub:
- ffmpeg:rtsp://admin:[email protected]/Streaming/Channels/102/
cameras:
doorbell:
record:
enabled: true
retain:
days: 3
mode: motion
objects:
track:
- amazon
- dhl
- usps
- ups
- fedex
- gls
- dpd
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/doorbell
input_args: preset-rtsp-restream
roles:
- audio
- record
- path: rtsp://127.0.0.1:8554/doorbell_sub
input_args: preset-rtsp-restream
roles:
- detect
motion:
mask: 0.673,0.767,0.974,0.764,0.974,0.826,0.674,0.825
hall:
detect:
width: 1024
height: 1024
fps: 10
record:
enabled: true
retain:
days: 3
mode: motion
objects:
track:
- person
- cat
- face
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/hall
input_args: preset-rtsp-restream
roles:
- audio
- record
#- path: rtsp://127.0.0.1:8554/hall_sub
# input_args: preset-rtsp-restream
# roles:
# - detect
carport:
objects:
track:
- person
- cat
- car
- dog
- bicycle
- fox
- raccoon
- squirrel
- rabbit
- umbrella
- motorcycle
- license_plate
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/carport
input_args: preset-rtsp-restream
roles:
- audio
- record
- path: rtsp://127.0.0.1:8554/carport_sub
input_args: preset-rtsp-restream
roles:
- detect
motion:
mask:
- 0.708,0,0.707,0.079,0.287,0.08,0.285,0
- 0.187,0.379,0.193,0.452,0.136,0.492,0.114,0.197,0.35,0.192,0.355,0.281
threshold: 40
contour_area: 20
improve_contrast: true
zones:
Carport:
coordinates:
0.132,0.497,0.197,0.462,0.185,0.386,0.269,0.323,0.355,0.292,1,0.736,0.997,0.997,0.215,0.993
loitering_time: 0
inertia: 3
review:
alerts:
required_zones: Carport
detections:
required_zones: Carport
record:
enabled: true
retain:
days: 3
mode: all
snapshots:
enabled: true
bounding_box: true
timestamp: true
crop: true
quality: 100
retain:
default: 60
version: 0.15-4
semantic_search:
enabled: true
reindex: true
model_size: small Relevant Frigate log outputfrigate | 2025-01-06 18:34:07.642735607 [2025-01-06 18:34:07] frigate.embeddings.embeddings INFO : Indexing tracked object embeddings...
frigate | 2025-01-06 18:34:12.127575525 [2025-01-06 18:34:12] frigate.video ERROR : hall: Unable to read frames from ffmpeg process.
frigate | 2025-01-06 18:34:12.127671565 [2025-01-06 18:34:12] frigate.video ERROR : hall: ffmpeg process is not running. exiting capture thread...
frigate | 2025-01-06 18:34:27.036958313 [2025-01-06 18:34:27] watchdog.hall ERROR : Ffmpeg process crashed unexpectedly for hall.
frigate | 2025-01-06 18:34:27.037062040 [2025-01-06 18:34:27] watchdog.hall ERROR : The following ffmpeg logs include the last 100 lines prior to exit.
frigate | 2025-01-06 18:34:27.037064334 [2025-01-06 18:34:27] ffmpeg.hall.detect ERROR : [in#0 @ 0x640d59594cc0] Error opening input: Invalid data found when processing input
frigate | 2025-01-06 18:34:27.037067049 [2025-01-06 18:34:27] ffmpeg.hall.detect ERROR : Error opening input file rtsp://127.0.0.1:8554/hall_sub.
frigate | 2025-01-06 18:34:27.037068749 [2025-01-06 18:34:27] ffmpeg.hall.detect ERROR : Error opening input files: Invalid data found when processing input
frigate | 2025-01-06 18:34:32.161867688 [2025-01-06 18:34:32] frigate.video ERROR : hall: Unable to read frames from ffmpeg process.
frigate | 2025-01-06 18:34:32.161957021 [2025-01-06 18:34:32] frigate.video ERROR : hall: ffmpeg process is not running. exiting capture thread...
frigate | 2025-01-06 18:34:37.051326422 [2025-01-06 18:34:37] watchdog.hall ERROR : Ffmpeg process crashed unexpectedly for hall.
frigate | 2025-01-06 18:34:37.051377450 [2025-01-06 18:34:37] watchdog.hall ERROR : The following ffmpeg logs include the last 100 lines prior to exit.
frigate | 2025-01-06 18:34:37.051400537 [2025-01-06 18:34:37] ffmpeg.hall.detect ERROR : [in#0 @ 0x5de433bdccc0] Error opening input: Invalid data found when processing input
frigate | 2025-01-06 18:34:37.051460305 [2025-01-06 18:34:37] ffmpeg.hall.detect ERROR : Error opening input file rtsp://127.0.0.1:8554/hall_sub.
frigate | 2025-01-06 18:34:37.051463116 [2025-01-06 18:34:37] ffmpeg.hall.detect ERROR : Error opening input files: Invalid data found when processing input Relevant go2rtc log outputno logs here Frigate statsNo response Operating systemOther Linux Install methodDocker Compose docker-compose file or Docker CLI commandservices:
frigate:
container_name: frigate
privileged: true # this may not be necessary for all setups
restart: unless-stopped
image: ghcr.io/blakeblackshear/frigate:0.15.0-beta4
shm_size: "512mb" # update for your cameras based on calculation above
devices:
- /dev/dri/renderD128:/dev/dri/renderD128 # For intel hwaccel
volumes:
- /etc/localtime:/etc/localtime:ro
- /home/damirca/frigate/config:/config
- /home/damirca/frigate/storage:/media/frigate
- type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
target: /tmp/cache
tmpfs:
size: 1000000000
ports:
- "8971:8971"
- "5000:5000" # Internal unauthenticated access. Expose carefully.
- "8554:8554" # RTSP feeds
- "8555:8555/tcp" # WebRTC over tcp
- "8555:8555/udp" # WebRTC over udp
environment:
- PLUS_API_KEY=blah Object DetectorOpenVino Screenshots of the Frigate UI's System metrics pagesNo response Any other information that may be helpfulNo response |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
you'll need to adjust input_args to change the timeout. With that said I would be curious to know if |
Beta Was this translation helpful? Give feedback.
yes, both your suggestions worked!
qsv is working with this setup
and specifying higher timeout like so
fixed the stream
thank a lot!