radv/video: Disable H264 encode 8x8 transform when CABAC is disabled

VCN5 only supports it with CABAC enabled.

Fixes: 960f63596f ("radv/video: Add VCN5 encode support")
Reviewed-by: Ruijing Dong <ruijing.dong@amd.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/36881>
This commit is contained in:
David Rosca 2025-08-20 15:56:41 +02:00 committed by Marge Bot
parent 2e400fc099
commit 8ac9a9afee

View file

@ -3089,7 +3089,8 @@ radv_video_patch_encode_session_parameters(struct radv_device *device, struct vk
for (unsigned i = 0; i < params->h264_enc.h264_pps_count; i++) {
params->h264_enc.h264_pps[i].base.pic_init_qp_minus26 = 0;
params->h264_enc.h264_pps[i].base.pic_init_qs_minus26 = 0;
if (pdev->enc_hw_ver < RADV_VIDEO_ENC_HW_5)
if (pdev->enc_hw_ver < RADV_VIDEO_ENC_HW_5 ||
!params->h264_enc.h264_pps[i].base.flags.entropy_coding_mode_flag)
params->h264_enc.h264_pps[i].base.flags.transform_8x8_mode_flag = 0;
}
break;