Intel QSV hardware encoder does not work #4538

OskarPepryk · 2024-09-18T18:32:38Z

OskarPepryk
Sep 18, 2024

Hi. I have a problem with getting HW encoding to work. My hardware is a Intel N97 iGPU. I followed the guides and many other problem reports found online but I'm still getting the No VA display found for device /dev/dri/renderD128 error when transcoding.

I tried setting photoprism UID and GID same as my user outside the container or as root, that did not help. I was successful with transcoding on the host using h264_qsv. More details below.

I would be grateful for some help.

/dev/dri is attached to the cotainer
ls output from the host side and my user:

oskar@odroidh4:~$ id
uid=1000(oskar) gid=100(users) groups=100(users),27(sudo),44(video),105(render),109(_ssh),990(docker),993(openmediavault-admin),1000(oskar)
oskar@odroidh4:~$ ls -hlan /dev/dri
total 0
drwxr-xr-x  3 0   0      100 Sep 17 22:26 .
drwxr-xr-x 17 0   0     3.7K Sep 17 23:57 ..
drwxr-xr-x  2 0   0       80 Sep 17 22:26 by-path
crw-rw-rw-  1 0  44 226,   0 Sep 17 22:26 card0
crw-rw-rw-  1 0 105 226, 128 Sep 17 22:26 renderD128
oskar@odroidh4:~$

My current container configuration:

services:
  photoprism:
    restart: unless-stopped
    # Use photoprism/photoprism:preview instead for testing preview builds:
    image: photoprism/photoprism:latest
    container_name: photoprism
    # Only enable automatic restarts once your installation is properly
    # configured as it otherwise may get stuck in a restart loop:
    # https://docs.photoprism.org/getting-started/faq/#why-is-photoprism-getting-stuck-in-a-restart-loop
    # restart: unless-stopped
    security_opt:
      - seccomp:unconfined
      - apparmor:unconfined
    ports:
      - "2342:2342" # [local port]:[container port]
    environment:
      PHOTOPRISM_ADMIN_PASSWORD: ""          # PLEASE CHANGE: Your initial admin password (min 4 characters)
      PHOTOPRISM_ORIGINALS_LIMIT: 5000               # File size limit for originals in MB (increase for high-res video)
      PHOTOPRISM_HTTP_COMPRESSION: "gzip"            # Improves transfer speed and bandwidth utilization (none or gzip)
      PHOTOPRISM_DEBUG: "false"                      # Run in debug mode (shows additional log messages)
      PHOTOPRISM_PUBLIC: "false"                     # No authentication required (disables password protection)
      PHOTOPRISM_READONLY: "false"                   # Don't modify originals directory (reduced functionality)
      PHOTOPRISM_EXPERIMENTAL: "false"               # Enables experimental features
      PHOTOPRISM_DISABLE_WEBDAV: "false"             # Disables built-in WebDAV server
      PHOTOPRISM_DISABLE_SETTINGS: "false"           # Disables Settings in Web UI
      PHOTOPRISM_DISABLE_TENSORFLOW: "false"         # Disables using TensorFlow for image classification
      PHOTOPRISM_DARKTABLE_PRESETS: "false"          # Enables Darktable presets and disables concurrent RAW conversion
      PHOTOPRISM_DETECT_NSFW: "true"                # Flag photos as private that MAY be offensive (requires TensorFlow)
      PHOTOPRISM_UPLOAD_NSFW: "true"                 # Allow uploads that MAY be offensive
      # PHOTOPRISM_DATABASE_DRIVER: "sqlite"         # SQLite is an embedded database that doesn't require a server
      PHOTOPRISM_DATABASE_DRIVER: "mysql"            # Use MariaDB (or MySQL) instead of SQLite for improved performance
      PHOTOPRISM_DATABASE_SERVER: "mariadb:3306"     # MariaDB database server (hostname:port)
      PHOTOPRISM_DATABASE_NAME: "photoprism"         # MariaDB database schema name
      PHOTOPRISM_DATABASE_USER: "photoprism"         # MariaDB database user name
      PHOTOPRISM_DATABASE_PASSWORD: ""       # MariaDB database user password
      PHOTOPRISM_SITE_URL:   # Public PhotoPrism URL
      PHOTOPRISM_SITE_TITLE: "PhotoPrism"
      PHOTOPRISM_SITE_CAPTION: "Browse Your Life"
      PHOTOPRISM_SITE_DESCRIPTION: ""
      PHOTOPRISM_SITE_AUTHOR: ""
      PHOTOPRISM_THUMB_SIZE: 800
      PHOTOPRISM_THUMB_UNCACHED: "true"
      PHOTOPRISM_JPEG_QUALITY: 80
      PHOTOPRISM_FFMPEG_ENCODER: "intel"
      PHOTOPRISM_INIT: "intel"
      PHOTOPRISM_LOG_LEVEL : "trace"
      # You may optionally set a user / group id using environment variables if your Docker version or NAS does not
      # support this natively (see next example):
      PHOTOPRISM_UID: 1000
      PHOTOPRISM_GID: 105
      # UMASK: 0000
    # Uncomment and edit the following line to set a specific user / group id (native):
    user: "1000:105"
    volumes:
      # Your photo and video files ([local path]:[container path]):
      - "/srv/dev-disk-by-uuid-337cf411-3cd3-4b75-b177-9a8d62503917/Backups/Zdjęcia:/photoprism/originals" # SKIP_BACKUP
      # Multiple folders can be indexed by mounting them as sub-folders of /photoprism/originals:
      # - "/mnt/Family:/photoprism/originals/Family"    # [folder_1]:/photoprism/originals/[folder_1]
      # - "/mnt/Friends:/photoprism/originals/Friends"  # [folder_2]:/photoprism/originals/[folder_2]
      # Mounting an import folder is optional (see docs):
      # - "./photoprism/Import:/photoprism/import"
      # Permanent storage for settings, index & sidecar files (DON'T REMOVE):
      - "./photoprism/storage:/photoprism/storage" # BACKUP
      - "/dev/dri:/dev/dri" # SKIP_BACKUP
    labels:
      - "traefik.enable=true"
      - "traefik.http.routers.photoprism.rule=Host(``)"
      - "traefik.http.routers.photoprism.tls=true"
      #- "traefik.http.routers.photoprism.tls.certresolver=myresolver"
      - "traefik.http.routers.photoprism.entrypoints=websecure"

  mariadb:
    image: mariadb:10.10
    container_name: mariadb
    restart: unless-stopped
    security_opt:
      - seccomp:unconfined
      - apparmor:unconfined
    command: mysqld --transaction-isolation=READ-COMMITTED --character-set-server=utf8mb4 --collation-server=utf8mb4_unicode_ci --max-connections=512 --innodb-rollback-on-timeout=OFF --innodb-lock-wait-timeout=50
    volumes: # Don't remove permanent storage for index database files!
      - "./photoprism-database:/var/lib/mysql" # BACKUP
    environment:
      MYSQL_ROOT_PASSWORD: 
      MYSQL_DATABASE: photoprism
      MYSQL_USER: photoprism
      MYSQL_PASSWORD:

Trace log from the container.

time="2024-09-18T17:59:34Z" level=info msg="h264_qsv: transcoding Zdjęcia realme/20240713_154159.mp4 to avc"
time="2024-09-18T17:59:34Z" level=trace msg="/usr/bin/ffmpeg -hwaccel qsv -hwaccel_output_format qsv -qsv_device /dev/dri/renderD128 -i /photoprism/originals/Zdjęcia realme/20240713_154159.mp4 -c:a aac -vf scale_qsv=w='if(gte(iw,ih), min(4096, iw), -1)':h='if(gte(iw,ih), -1, min(4096, ih))':format=nv12 -c:v h264_qsv -map 0:v:0 -map 0:a:0? -r 30 -b:v 25M -bitrate 25M -f mp4 -movflags +faststart -y /photoprism/storage/sidecar/Zdjęcia realme/20240713_154159.mp4.avc"
time="2024-09-18T17:59:34Z" level=debug msg="ffmpeg version 6.1.1-3ubuntu5 Copyright (c) 2000-2023 the FFmpeg developers\n  built with gcc 13 (Ubuntu 13.2.0-23ubuntu3)\n  configuration: --prefix=/usr --extra-version=3ubuntu5 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --disable-omx --enable-gnutls --enable-libaom --enable-libass --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libharfbuzz --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-openal --enable-opencl --enable-opengl --disable-sndio --enable-libvpl --disable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-ladspa --enable-libbluray --enable-libjack --enable-libpulse --enable-librabbitmq --enable-librist --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libx264 --enable-libzmq --enable-libzvbi --enable-lv2 --enable-sdl2 --enable-libplacebo --enable-librav1e --enable-pocketsphinx --enable-librsvg --enable-libjxl --enable-shared\n  WARNING: library configuration mismatch\n  avcodec     configuration: --prefix=/usr --extra-version=3ubuntu5 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --disable-omx --enable-gnutls --enable-libaom --enable-libass --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libharfbuzz --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-openal --enable-opencl --enable-opengl --disable-sndio --enable-libvpl --disable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-ladspa --enable-libbluray --enable-libjack --enable-libpulse --enable-librabbitmq --enable-librist --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libx264 --enable-libzmq --enable-libzvbi --enable-lv2 --enable-sdl2 --enable-libplacebo --enable-librav1e --enable-pocketsphinx --enable-librsvg --enable-libjxl --enable-shared --enable-version3 --disable-doc --disable-programs --disable-static --enable-libaribb24 --enable-libopencore_amrnb --enable-libopencore_amrwb --enable-libtesseract --enable-libvo_amrwbenc --enable-libsmbclient\n  avformat    configuration: --prefix=/usr --extra-version=3ubuntu5 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --disable-omx --enable-gnutls --enable-libaom --enable-libass --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libharfbuzz --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-openal --enable-opencl --enable-opengl --disable-sndio --enable-libvpl --disable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-ladspa --enable-libbluray --enable-libjack --enable-libpulse --enable-librabbitmq --enable-librist --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libx264 --enable-libzmq --enable-libzvbi --enable-lv2 --enable-sdl2 --enable-libplacebo --enable-librav1e --enable-pocketsphinx --enable-librsvg --enable-libjxl --enable-shared --enable-version3 --disable-doc --disable-programs --disable-static --enable-libaribb24 --enable-libopencore_amrnb --enable-libopencore_amrwb --enable-libtesseract --enable-libvo_amrwbenc --enable-libsmbclient\n  avfilter    configuration: --prefix=/usr --extra-version=3ubuntu5 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --disable-omx --enable-gnutls --enable-libaom --enable-libass --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libharfbuzz --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-openal --enable-opencl --enable-opengl --disable-sndio --enable-libvpl --disable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-ladspa --enable-libbluray --enable-libjack --enable-libpulse --enable-librabbitmq --enable-librist --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libx264 --enable-libzmq --enable-libzvbi --enable-lv2 --enable-sdl2 --enable-libplacebo --enable-librav1e --enable-pocketsphinx --enable-librsvg --enable-libjxl --enable-shared --enable-version3 --disable-doc --disable-programs --disable-static --enable-libaribb24 --enable-libopencore_amrnb --enable-libopencore_amrwb --enable-libtesseract --enable-libvo_amrwbenc --enable-libsmbclient\n  libavutil      58. 29.100 / 58. 29.100\n  libavcodec     60. 31.102 / 60. 31.102\n  libavformat    60. 16.100 / 60. 16.100\n  libavdevice    60.  3.100 / 60.  3.100\n  libavfilter     9. 12.100 /  9. 12.100\n  libswscale      7.  5.100 /  7.  5.100\n  libswresample   4. 12.100 /  4. 12.100\n  libpostproc    57.  3.100 / 57.  3.100\n
[AVHWDeviceContext @ 0x564d6d451f80] No VA display found for device /dev/dri/renderD128.\nDevice creation failed: -22.\nFailed to set value '/dev/dri/renderD128' for option 'qsv_device': Invalid argument\nError parsing global options: Invalid argument\n"
time="2024-09-18T17:59:34Z" level=warning msg="h264_qsv: failed to transcode Zdjęcia realme/20240713_154159.mp4 [95.180593ms]"
time="2024-09-18T17:59:34Z" level=info msg="libx264: transcoding Zdjęcia realme/20240713_154159.mp4 to avc"
time="2024-09-18T17:59:34Z" level=trace msg="/usr/bin/ffmpeg -i /photoprism/originals/Zdjęcia realme/20240713_154159.mp4 -c:v libx264 -map 0:v:0 -map 0:a:0? -c:a aac -vf scale='if(gte(iw,ih), min(4096, iw), -2):if(gte(iw,ih), -2, min(4096, ih))',format=yuv420p -max_muxing_queue_size 1024 -crf 23 -r 30 -b:v 25M -f mp4 -movflags +faststart -y /photoprism/storage/sidecar/Zdjęcia realme/20240713_154159.mp4.avc"

Example of ffmpeg encoding that works on my host is below. In my case option -low_power 1 was neccesary but that did not help when I tried from within the container.

ffmpeg -hwaccel qsv -hwaccel_output_format qsv -qsv_device /dev/dri/renderD128 -i "./Zdjęcia realme/20240819_195738.mp4" -c:a aac -c:v h264_qsv -low_power 1 -y ./test.mp4

Answered by lastzero

Sep 18, 2024

You mounted it as volume, not as device.

View full answer

srett · 2024-09-18T18:42:31Z

srett
Sep 18, 2024

Example of ffmpeg encoding that works on my host is below. In my case option -low_power 1 was neccesary but that did not help when I tried from within the container.

So you're already trying directly with a shell inside a container. Can you verify the packages intel-media-va-driver-non-free and libmfx1 are installed inside?

Also if that doesn't help, can you try this variation for transcoding (adapt vars to your local env):

ffmpeg -init_hw_device vaapi=intel:/dev/dri/renderD128 \
   -hwaccel vaapi -hwaccel_output_format vaapi -hwaccel_device intel -filter_hw_device intel \
   -i "$infile" \
   -c:a copy \
   -vf 'scale_vaapi,hwmap=derive_device=qsv,format=qsv' \
   -c:v h264_qsv \
   -b:v 10M -maxrate 10M \
   -movflags +faststart \
   "$outfile"

4 replies

OskarPepryk Sep 18, 2024
Author

Both packages are installed. I also tried installing free intel-media-va-driver inside.

Your command produced similar errors:

[AVHWDeviceContext @ 0x55adad321cc0] No VA display found for device /dev/dri/renderD128.
Device creation failed: -22.
Failed to set value 'vaapi=intel:/dev/dri/renderD128' for option 'init_hw_device': Invalid argument

lastzero Sep 18, 2024
Maintainer

You mounted it as volume, not as device.

Answer selected by OskarPepryk

OskarPepryk Sep 18, 2024
Author

Thanks, that was it.

Sometimes the problem solution is so easy that I feel like maybe I would rather not know the answer 😅

srett Sep 18, 2024

Sometimes the problem solution is so easy that I feel like maybe I would rather not know the answer 😅

Well, I completely missed it too if that helps. ;-)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Intel QSV hardware encoder does not work #4538

{{title}}

Replies: 1 comment 4 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Intel QSV hardware encoder does not work #4538

OskarPepryk Sep 18, 2024

Replies: 1 comment · 4 replies

srett Sep 18, 2024

OskarPepryk Sep 18, 2024 Author

lastzero Sep 18, 2024 Maintainer

OskarPepryk Sep 18, 2024 Author

srett Sep 18, 2024

OskarPepryk
Sep 18, 2024

Replies: 1 comment 4 replies

srett
Sep 18, 2024

OskarPepryk Sep 18, 2024
Author

lastzero Sep 18, 2024
Maintainer

OskarPepryk Sep 18, 2024
Author