Error occurred on GPUID: 100 - nvlddmkm, crashing in exclusively DX12 Games.

Event Viewer:
"The description for Event ID 0 from source nvlddmkm cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer.
If the event originated on another computer, the display information had to be saved with the event.
The following information was included with the event:
\Device\Video3
Error occurred on GPUID: 100"

I typically see about three of these same errors in event viewer all happening in the span of around 5 seconds. My PC freezes, the game crashes and I also get an "application has been blocked from accessing graphics hardware" notification from windows, specifying the game I was playing at the time.

The crashes are extremely frequent: happening anywhere in 5-30 minutes from starting a directx12 game. These crashes literally do not happen on any other game I've tested running a different api, there hasn't been a single game running on dx12 that this issue doesn't happen.

I have uninstalled my drivers in DDU while in safe mode twice now, down-clocked my GPU, back to founders, and then all the way -500mhz in afterburner to no avail, enabled debug mode in nvidia's control panel, disabled HAGS, and rebar. Along with re-seating my GPU, Tested RAM, no errors. GPU also never surpasses 75c temp wise.

XMP is disabled.

Specs:

I7 12700KF
32GB TEAMGROUP ELITE 4800Mhz CL40

MSI B760 GAMING PLUS WIFI
Corsair RM850x
ZOTAC GAMING GeForce RTX 3060 Ti Twin Edge OC

I initially thought my GPU was faulty, although the fact that this only happens in DirectX12 games makes me really second guess that, I feel like I've tried everything but is there anything else people can recommend I could try?