Unless you happen to be an audiophile & an acoustic purist, I'd suggest that you get some high quality Bluetooth headphones or Buds.
Personally I've tried Samsung's Buds, but for a variety of reasons I prefer Jabra Elite Active series. You may however have your own preference.
As for the annoying audio issue with your wired headphones, you could open the Samsung Members app & Click on Support, run the Diagnostics for the USB Port and Wired Headphones. See if you get any error messages?
Also inspect both the USB port & the Type C adapter for any debris or damage, even moisture.
Do you have someone else around you that has a phone that you can test it with? Or maybe a tablet?