Your setup sounds good. Make sure you hard reset your console just in case the game isn’t getting confused.
What’s your NAT status on the console? (Not the actual game)
You could try adding manual port forwarding rules or putting your XBOX in a DMZ too, but if UPNP is enabled you shouldn’t be having any problems.
I hope you meant hard reboot. I don't want to reset (and erase) my console
Anyways, I thought I had done a hard reboot already but I must've just did a simple reboot. Hard reboot seems to have fixed it. NAT Type 2/Open again.
Thanks for the response and suggestion!