NV_ENC_ERR_INVALID_DEVICE Crash / High Frames Missed Due to Rendering Lag / High Average time to Render Frame, but Encoding and Network Frames fine

HARDHEAD7WD

New Member
Here a few logs i collected trying to reproduce the issue

this wasnt a issue within the first couple months of me having my setup as is and running my games without limiting my frames but lately within the last 2 to 3 weeks OBS itself as an application seems to be dropping frames and the average time to render a frame skyrockets even in minimal scene situations. Ive even gone so far as to remove every single plugin and create a new install of OBS. It only seems to happen when im streaming using Enhanced Broadcasting no matter what game i am playing, I am running my game at the same settings i was using before the issue began. I was wondering if anyone else had ran into this at all and had any solutions because it just started randomly happening the past 2 or 3 weeks but everything was perfectly fine prior for months now. Only the stream crashes not OBS as a whole, and it pretty much seizes up my entire computer to begin running slow. The only thing i cant IMMEDIATELY and consistently produce is the actual crash but the second i start streaming with enhanced broadcasting the rest happens. and as ive stated the stream itself looks fine (when the issue started that the stream would mess up too) here is a VOD of a recent stream where i had the issue the entire time until it crashed https://www.twitch.tv/videos/2443466462 and here is a VOD from before i did my troubleshooting of attempting DDU (twice) which resolved the issue as a whole for a single day but u can see how bad the stream was running before i even did that https://www.twitch.tv/videos/2439311701 . If i turn off enhanced broadcasting the issues go away fine. Im not sure if its possible OBS is using the wrong "GPU" device since i have a X3D CPU either.

Edit: added image of 3D graph on GPU spiking during issue
 

Attachments

  • ihmage.png
    ihmage.png
    31 KB · Views: 8
  • iumage.png
    iumage.png
    42.8 KB · Views: 8

prgmitchell

Forum Moderator
Here a few logs i collected trying to reproduce the issue

this wasnt a issue within the first couple months of me having my setup as is and running my games without limiting my frames but lately within the last 2 to 3 weeks OBS itself as an application seems to be dropping frames and the average time to render a frame skyrockets even in minimal scene situations. Ive even gone so far as to remove every single plugin and create a new install of OBS. It only seems to happen when im streaming using Enhanced Broadcasting no matter what game i am playing, I am running my game at the same settings i was using before the issue began. I was wondering if anyone else had ran into this at all and had any solutions because it just started randomly happening the past 2 or 3 weeks but everything was perfectly fine prior for months now. Only the stream crashes not OBS as a whole, and it pretty much seizes up my entire computer to begin running slow. The only thing i cant IMMEDIATELY and consistently produce is the actual crash but the second i start streaming with enhanced broadcasting the rest happens. and as ive stated the stream itself looks fine (when the issue started that the stream would mess up too) here is a VOD of a recent stream where i had the issue the entire time until it crashed https://www.twitch.tv/videos/2443466462 and here is a VOD from before i did my troubleshooting of attempting DDU (twice) which resolved the issue as a whole for a single day but u can see how bad the stream was running before i even did that https://www.twitch.tv/videos/2439311701 . If i turn off enhanced broadcasting the issues go away fine. Im not sure if its possible OBS is using the wrong "GPU" device since i have a X3D CPU either.

Edit: added image of 3D graph on GPU spiking during issue

probably an issue with your GPU driver, the "invalid device" error you mentioned is 100% your GPU driver crashing so I'd assume the two are related until that part is fixed

 

crouch1n

New Member
Here a few logs i collected trying to reproduce the issue

this wasnt a issue within the first couple months of me having my setup as is and running my games without limiting my frames but lately within the last 2 to 3 weeks OBS itself as an application seems to be dropping frames and the average time to render a frame skyrockets even in minimal scene situations. Ive even gone so far as to remove every single plugin and create a new install of OBS. It only seems to happen when im streaming using Enhanced Broadcasting no matter what game i am playing, I am running my game at the same settings i was using before the issue began. I was wondering if anyone else had ran into this at all and had any solutions because it just started randomly happening the past 2 or 3 weeks but everything was perfectly fine prior for months now. Only the stream crashes not OBS as a whole, and it pretty much seizes up my entire computer to begin running slow. The only thing i cant IMMEDIATELY and consistently produce is the actual crash but the second i start streaming with enhanced broadcasting the rest happens. and as ive stated the stream itself looks fine (when the issue started that the stream would mess up too) here is a VOD of a recent stream where i had the issue the entire time until it crashed https://www.twitch.tv/videos/2443466462 and here is a VOD from before i did my troubleshooting of attempting DDU (twice) which resolved the issue as a whole for a single day but u can see how bad the stream was running before i even did that https://www.twitch.tv/videos/2439311701 . If i turn off enhanced broadcasting the issues go away fine. Im not sure if its possible OBS is using the wrong "GPU" device since i have a X3D CPU either.

Edit: added image of 3D graph on GPU spiking during issue
I was able to fix this issue by unchecking "Enable Enhanced Broadcasting" as it forces the old NVIDIA encoder that is deprecated (but they say is compatible) in the 5000 series cards. Then select NVIDIA NVENC H.264 video encoder in "Output". That is the new native encoder for the 5000 series.
 

HARDHEAD7WD

New Member
I was able to fix this issue by unchecking "Enable Enhanced Broadcasting" as it forces the old NVIDIA encoder that is deprecated (but they say is compatible) in the 5000 series cards. Then select NVIDIA NVENC H.264 video encoder in "Output". That is the new native encoder for the 5000 series.
Honestly i feel like that makes the most sense out of this whole thing and why it works fine on my 3080 with nothing else being changed, I highly doubt the OBS team would make the necessary adjustment, even with AV1 on the way for Twitch
 

crouch1n

New Member
Honestly i feel like that makes the most sense out of this whole thing and why it works fine on my 3080 with nothing else being changed, I highly doubt the OBS team would make the necessary adjustment, even with AV1 on the way for Twitch
I couldn’t say for sure if it’s the OBS team or Twitch that would need to submit the changes for something to happen on OBS’ side. OBS itself does seem to recognize the older encoder is deprecated for the 5000 series, but is firmly locked from changing when enhanced broadcasting is checked.

Either way, I hope that helps your issue.
 

HARDHEAD7WD

New Member
I couldn’t say for sure if it’s the OBS team or Twitch that would need to submit the changes for something to happen on OBS’ side. OBS itself does seem to recognize the older encoder is deprecated for the 5000 series, but is firmly locked from changing when enhanced broadcasting is checked.

Either way, I hope that helps your issue.
It does because it lets me know i wasnt crazy in just disabling it because the main thing i noticed was the rendering skyrocketing and encoding seeing no change. I was able to run a 6 hour 1440p/120fps test stream for 6 hours that had no issues while using games uncompromised unless a game ran shader comp. Hopefully the Twitch broacast team and OBS team can get together and figure this out because the only time i got some level of reply from them they blamed the drivers and left it at that
 

sandrix

Member
It does because it lets me know i wasnt crazy in just disabling it because the main thing i noticed was the rendering skyrocketing and encoding seeing no change. I was able to run a 6 hour 1440p/120fps test stream for 6 hours that had no issues while using games uncompromised unless a game ran shader comp. Hopefully the Twitch broacast team and OBS team can get together and figure this out because the only time i got some level of reply from them they blamed the drivers and left it at that
It was a NVIDIA driver issue and they knew it. Many people have reported issues with RTX 5000 cards on this forum. In your report, you were using driver 576.15 and it was still unstable. The stable driver is 576.40 and newer.
 

sandrix

Member
Regarding AV1, the head of Twitch (Dan Clancy) said at twitchcon that work is underway and nothing more. We have been hearing these tales since 2019. This year they only promised to implement HEVC, which is currently being actively tested.
 

HARDHEAD7WD

New Member
It was a NVIDIA driver issue and they knew it. Many people have reported issues with RTX 5000 cards on this forum. In your report, you were using driver 576.15 and it was still unstable. The stable driver is 576.40 and newer.
Thats not true at all i have used every one of the newest drivers as they dropped and the issue persisted. Its not simply a driver issue. I just rolled back again after trying the one u mentioned for weeks https://imgur.com/QBjgqaZ
 
Top