Internet is great, but I still get packet loss. Will this help?

I have a weird issue that I can't find anyone else online having.

I have an innate packet loss issue over my internet, but in a weird way. I just moved into a new apartment with its own room internet box. It's right next to my Series X.

When playing online games I get packet loss related latency stuttering and lag that, when the game becomes kind of intense and visually cluttered, drops massively to 20% packet loss etc.

I've changed my DNS and done the connection checks and it tells me it's running at 1% packet loss – which is true for most of my time in online games, but it will often spike randomly, and again, when things become overloaded.

We have no other devices being used. My internet connection on other applications, my other devices and everything else is GREAT. I get 100 mbps download speeds on Xbox wifi but these online games are often unplayable.

Would grabbing an ethernet cable directly solve this issue? If not, anything else?