20134 commits

Author	SHA1	Message	Date
Samuel Pitoiset	13e6d2ba00	radv: make sure to zero-initialize MSB of accel struct descriptor ... RADV only uses the first 8 bytes but zero-initializing it make sure the descriptor is invariant. Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35763>	2025-06-27 06:39:17 +00:00
Marek Olšák	1754507d49	nir: rename nir_lower_io_to_temporaries -> nir_lower_io_vars_to_temporaries ... Acked-by: Alyssa Rosenzweig <alyssa@rosenzweig.io> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35760>	2025-06-26 18:20:54 +00:00
Marek Olšák	1e03827c77	nir: rename nir_lower_io_arrays_to_elements -> nir_lower_io_array_vars_to_elements ... same for *_no_indirects Acked-by: Alyssa Rosenzweig <alyssa@rosenzweig.io> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35760>	2025-06-26 18:20:54 +00:00
Marek Olšák	3713e2d580	nir: rename nir_lower_clip_cull_distance_arrays -> nir_lower_clip_cull_distance_array_vars ... Acked-by: Alyssa Rosenzweig <alyssa@rosenzweig.io> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35760>	2025-06-26 18:20:53 +00:00
Marek Olšák	12df9b3def	nir: rename nir_vectorize_tess_levels -> nir_lower_tess_level_array_vars_to_vec ... Acked-by: Alyssa Rosenzweig <alyssa@rosenzweig.io> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35760>	2025-06-26 18:20:50 +00:00
Marek Olšák	2aa94caf82	nir: rename nir_lower_io_to_vector -> nir_opt_vectorize_io_vars ... Acked-by: Alyssa Rosenzweig <alyssa@rosenzweig.io> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35760>	2025-06-26 18:20:50 +00:00
Marek Olšák	439d805291	nir: rename nir_lower_io_to_scalar_early -> nir_lower_io_vars_to_scalar ... Acked-by: Alyssa Rosenzweig <alyssa@rosenzweig.io> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35760>	2025-06-26 18:20:49 +00:00
Dave Airlie	37e71a5cb2	radv/video: add support for AV1 encoding ... Co-authored-by: Charlie Turner <cturner@igalia.com> Co-authored-by: Benjamin Cheng <benjamin.cheng@amd.com> Co-authored-by: David Rosca <david.rosca@amd.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/32440>	2025-06-26 15:41:01 +00:00
Dave Airlie	ee9ec055d9	radv/video: move session defines to header as encode needs more. ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/32440>	2025-06-26 15:41:01 +00:00
Natalie Vock	af86cc37d5	aco/spill: Don't spill scratch_rsrc-related temps ... These temps are used to create the scratch_rsrc. Spilling them will never benefit anything, because assign_spill_slots will insert code that keeps them live. Since the spiller assumes all spilled variables to be dead, this can cause more variables being live than intended and spilling to fail. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:53 +00:00
Natalie Vock	acf29e403a	aco/spill: Add a null scratch offset if no scratch_offset arg exists ... Function callees' scratch_rsrc comes with the scratch offset pre-applied. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:53 +00:00
Natalie Vock	630913e1b4	aco: Introduce static_scratch_rsrc program member ... Function callees get their scratch resource as a parameter instead of generating it on-the-fly. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:53 +00:00
Natalie Vock	e006f68b11	aco/isel: Don't add scratch offset as gfx8- soffset if no offsets exist ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:53 +00:00
Natalie Vock	a5eba11657	aco/isel: Use stack pointer parameter in load/store_scratch ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:53 +00:00
Natalie Vock	4a62b342f3	aco: Add common utility to load scratch descriptor ... Also modifies the scratch descriptor to take the stack pointer into account. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:52 +00:00
Natalie Vock	cd2caa5e2b	aco/spill: Use scratch stack pointer ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:52 +00:00
Natalie Vock	22624d6f12	aco: Add scratch stack pointer ... Function callees shouldn't overwrite caller's stacks. Track where to write scratch data with a stack pointer. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:52 +00:00
Natalie Vock	be89c02be5	aco: Add pseudo instr to calculate a function callee's stack pointer ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35031>	2025-06-26 11:02:52 +00:00
Daniel Schürmann	7620957193	aco/ra: always set fill_operands=true when handling operands ... This makes the behavior consistent and less prone to error. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35735>	2025-06-26 10:05:07 +00:00
Daniel Schürmann	ee8424d839	aco/ra: always fill moved operands when handling vector-operands ... update_renames() assumes that killed operands are already removed from the register file, except for precolored and copy-kill operands. When dealing with vector-operands, however, unrelated operands might also be moved, in order to make space. Fixes: fb689f133e ('aco/ra: handle register assignment of vector-aligned operands') Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35735>	2025-06-26 10:05:07 +00:00
Georg Lehmann	7de352e99e	nir,radv: add an option to not move 8/16bit vecs ... ACO will overestimate the register demand of the sources, so we don't want to create the vector later. Foz-DB Navi48: Totals from 240 (0.30% of 80265) affected shaders: MaxWaves: 6429 -> 6435 (+0.09%) Instrs: 3406069 -> 3406646 (+0.02%); split: -0.01%, +0.03% CodeSize: 18231596 -> 18233288 (+0.01%); split: -0.01%, +0.02% VGPRs: 14768 -> 14732 (-0.24%) Latency: 18981274 -> 18979170 (-0.01%); split: -0.02%, +0.01% InvThroughput: 4247331 -> 4246634 (-0.02%); split: -0.02%, +0.01% VClause: 85453 -> 85458 (+0.01%); split: -0.01%, +0.01% Copies: 262046 -> 261971 (-0.03%); split: -0.06%, +0.03% PreVGPRs: 10899 -> 10775 (-1.14%) VALU: 1923441 -> 1923485 (+0.00%); split: -0.01%, +0.01% SALU: 457983 -> 457982 (-0.00%) VOPD: 4980 -> 4861 (-2.39%); split: +0.48%, -2.87% Reviewed-by: Alyssa Rosenzweig <alyssa@rosenzweig.io> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35729>	2025-06-26 09:29:43 +00:00
Pierre-Eric Pelloux-Prayer	ca0ed07588	ac/pm4: determine spi_shader_pgm_lo_reg when PKT3_SET_SH_REG_PAIRS is used ... Reviewed-by: Marek Olšák <marek.olsak@amd.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35582>	2025-06-26 07:06:51 +00:00
Samuel Pitoiset	30ccd97cd2	radv: gather nir shader info at the end of radv_optimize_nir() ... Otherwise, outputs_read/outputs_written might not be up-to-date (mostly after nir_remove_dead_variables) and remove_point_size() might reach an assertion later because the output variable isn't found. It seems better to run nir_shader_gather_info() at the very end of radv_optimize_nir() which can change a lot of things anyways. No fossils-db changes. Cc: mesa-stable Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35707>	2025-06-26 06:11:54 +00:00
Samuel Pitoiset	e91029c82d	aco: consider that nir_tex_src_{coord,ddx} can be the first source ... Only -1 means it's not found, but 0 is still valid. Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35736>	2025-06-25 17:20:02 +00:00
Georg Lehmann	01d20680e2	aco/optimizer: generalize p_create_vector of split vector opt ... Foz-DB Navi48: Totals from 116 (0.14% of 80251) affected shaders: MaxWaves: 2965 -> 2972 (+0.24%) Instrs: 145933 -> 144632 (-0.89%); split: -0.91%, +0.02% CodeSize: 815968 -> 806512 (-1.16%); split: -1.20%, +0.04% VGPRs: 7240 -> 7144 (-1.33%); split: -1.66%, +0.33% Latency: 3065858 -> 3063802 (-0.07%); split: -0.11%, +0.05% InvThroughput: 745395 -> 743506 (-0.25%); split: -0.26%, +0.01% VClause: 3702 -> 3694 (-0.22%); split: -0.65%, +0.43% SClause: 3187 -> 3191 (+0.13%) Copies: 12716 -> 11804 (-7.17%); split: -7.42%, +0.25% Branches: 3501 -> 3503 (+0.06%) PreVGPRs: 5400 -> 5327 (-1.35%); split: -1.41%, +0.06% VALU: 76455 -> 75492 (-1.26%); split: -1.30%, +0.04% SALU: 23594 -> 23595 (+0.00%); split: -0.00%, +0.01% VOPD: 1478 -> 1527 (+3.32%); split: +4.67%, -1.35% Mostly helps FSR4. Reviewed-by: Daniel Schürmann <daniel@schuermann.dev> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35674>	2025-06-25 11:03:30 +00:00
David Rosca	189bf9fe9a	radv/video: Prefer visible VRAM for host visible context buffers ... In most cases this has little to no effect, but AV1 decode on VCN5 is up to 40% slower when the context buffer is in GTT. Reviewed-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35684>	2025-06-25 09:39:11 +00:00
Samuel Pitoiset	2d4b4a296e	radv: move pipeline layout implementation to radv_pipeline_layout.c/h ... Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35708>	2025-06-25 07:52:12 +00:00
Samuel Pitoiset	46f78b40f0	radv: simplify add_descriptor_set() ... Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35708>	2025-06-25 07:52:12 +00:00
Samuel Pitoiset	f5a71a1262	radv: rename border_color_slot to border_color_index ... To match future work. Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35708>	2025-06-25 07:52:12 +00:00
Samuel Pitoiset	c08a97633c	radv: remove an useless check about custom border color ... The Vulkan spec is pretty clear and says: "VUID-VkSamplerCreateInfo-None-04012 The maximum number of samplers with custom border colors which can be simultaneously created on a device is implementation-dependent and specified by the maxCustomBorderColorSamplers member of the VkPhysicalDeviceCustomBorderColorPropertiesEXT structure" So this check can be removed because it would be an application bug otherwise. Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35708>	2025-06-25 07:52:12 +00:00
Valentine Burley	a7f970ee6d	zink/ci: Add glcts and piglit job on Cezanne with RADV ... AMD Cezanne is Vega, where we already have radeonsi coverage on Raven. Signed-off-by: Valentine Burley <valentine.burley@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35682>	2025-06-25 07:09:08 +00:00
Valentine Burley	57f97ad64a	radeonsi/ci: Add glcts and piglit job on Mendocino ... Like Van Gogh, Mendocino is RDNA 2. This new job is intended to replace the existing radeonsi-vangogh-glcts job, which couldn't run the full test suite pre-merge. Signed-off-by: Valentine Burley <valentine.burley@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35682>	2025-06-25 07:09:07 +00:00
Valentine Burley	e5323ff07b	radeonsi/ci: Rename radeonsi Collabora rule to make it unambiguous ... Signed-off-by: Valentine Burley <valentine.burley@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35682>	2025-06-25 07:09:06 +00:00
Valentine Burley	1e31ebc21e	radeonsi/ci: Move full radeonsi-stoney-glcts-piglit job to pre-merge ... The full job previously ran in the nightly pipeline, but its runtime is within the recommended 10-minute limit reported by deqp-runner. This allows us to run it pre-merge and remove the separate nightly job. Signed-off-by: Valentine Burley <valentine.burley@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35682>	2025-06-25 07:09:05 +00:00
Georg Lehmann	1819e1caef	radv: keep fp8 conversions vectorized ... Totals from 11 (0.01% of 80265) affected shaders: MaxWaves: 102 -> 104 (+1.96%) Instrs: 24105 -> 21027 (-12.77%) CodeSize: 190744 -> 167480 (-12.20%) VGPRs: 1968 -> 1920 (-2.44%) Latency: 91890 -> 90302 (-1.73%); split: -2.86%, +1.13% InvThroughput: 100616 -> 98496 (-2.11%); split: -2.24%, +0.13% VClause: 802 -> 759 (-5.36%); split: -6.48%, +1.12% Copies: 3131 -> 3329 (+6.32%); split: -0.48%, +6.80% PreVGPRs: 1816 -> 1802 (-0.77%) VALU: 12543 -> 11399 (-9.12%) SALU: 4635 -> 2859 (-38.32%) VOPD: 1133 -> 1195 (+5.47%); split: +7.33%, -1.85% Reviewed-by: Daniel Schürmann <daniel@schuermann.dev> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35676>	2025-06-25 05:34:48 +00:00
Georg Lehmann	21523dad96	radv/nir/lower_cmat: use nir_src_as_deref ... Reviewed-by: Rhys Perry <pendingchaos02@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35633>	2025-06-24 17:12:34 +00:00
Georg Lehmann	48fc8c8d1c	radv/nir/lower_cmat: set optimal load/store alignment ... Allows vectorizing load/stores with sub dword types or with robustness. Reviewed-by: Rhys Perry <pendingchaos02@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35633>	2025-06-24 17:12:33 +00:00
Georg Lehmann	ed2ecf9ef8	radv/nir/lower_cmat: share cmat_load/cmat_store code ... Reviewed-by: Rhys Perry <pendingchaos02@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35633>	2025-06-24 17:12:33 +00:00
Georg Lehmann	4ac6aae3a4	radv/nir/lower_cmat: fix gfx11 B->ACC conversion ... Of course I messed up the one path that's not tested by CTS. Fixes: 249ccc6b4c ("radv/nir/lower_cmat: implement use conversions/transpose") Reviewed-by: Rhys Perry <pendingchaos02@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35713>	2025-06-24 15:53:52 +00:00
Georg Lehmann	a61b564cf5	radv/ci: test VK_NV_cooperative_matrix2 ... Reviewed-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Reviewed-by: Rhys Perry <pendingchaos02@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/34793>	2025-06-24 07:14:36 +00:00
Georg Lehmann	8256097c0c	radv: advertise VK_NV_cooperative_matrix2/cooperativeMatrixConversions behind an env var ... Reviewed-by: Samuel Pitoiset <samuel.pitoiset@gmail.com> Reviewed-by: Rhys Perry <pendingchaos02@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/34793>	2025-06-24 07:14:35 +00:00
Georg Lehmann	249ccc6b4c	radv/nir/lower_cmat: implement use conversions/transpose ... This could potentially be improved using packed 32bit subgroup ops, but what we actually care about (gfx12 ACC -> B) is free. Reviewed-by: Rhys Perry <pendingchaos02@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/34793>	2025-06-24 07:14:34 +00:00
Konstantin Seurer	4cbbdc0a50	vulkan: Pass a structure to most BVH build callbacks ... It is annoying to change all function signatures when a driver needs more information. There are also some callbacks that have a lot of parameters and there have already been bugs related to that. This patch tries to clean the interface by adding a struct that contains all information that might be relevant for the driver and passing that to most callbacks. radv changes are: Reviewed-by: Natalie Vock <natalie.vock@gmx.de> anv changes are: Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com> turnip changes are: Reviewed-by: Connor Abbott <cwabbott0@gmail.com> vulkan runtime changes are: Reviewed-by: Natalie Vock <natalie.vock@gmx.de> Reviewed-by: Connor Abbott <cwabbott0@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35385>	2025-06-23 20:43:43 +00:00
Konstantin Seurer	28713789ad	vulkan: Replace get_*_key with get_build_config ... It is a cleaner API and gives more control about the build to the driver. Reviewed-by: Natalie Vock <natalie.vock@gmx.de> Reviewed-by: Connor Abbott <cwabbott0@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35385>	2025-06-23 20:43:43 +00:00
Eric Engestrom	4052348d09	radv/ci: document recent flakes ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35693>	2025-06-23 16:58:19 +00:00
Eric Engestrom	8fa443b3a8	radeonsi/ci: document recent flakes ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35693>	2025-06-23 16:58:19 +00:00
Bas Nieuwenhuizen	b53602ce71	radv: Use packed invocation ids for newer CDNA. ... From inspection. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/33963>	2025-06-23 11:23:40 +00:00
Bas Nieuwenhuizen	9574089ea2	radv: Add CDNA register settings. ... From inspection. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/33963>	2025-06-23 11:23:40 +00:00
Bas Nieuwenhuizen	098770ec51	radv: Don't init gfx preamble without gfx support. ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/33963>	2025-06-23 11:23:40 +00:00
Bas Nieuwenhuizen	d2e69dc734	radv: Add support for not having gfx queues. ... Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/33963>	2025-06-23 11:23:40 +00:00