Xbox and Windows builds currently have a bug that defaults with 'Xbox Multiplayer Only' and you can't uncheck it unless you leave the session list and enter a second time.
— ARK: Survival Ascended (@survivetheark) December 8, 2023
To fix: Exit the Join Session list, re-enter it and then disable the 'Xbox-Only Multiplayer' button