If a small floating window is not sufficient for you, you can make the app switcher full-screen as well. Press Windows-Tab to open the Task View, which shows a list of all open apps in full-screen.

Full-screen Xbox handheld UI is coming to all Windows PCs “starting next year” Microsoft has been experimenting with "handheld mode" for Windows 11 since 2022.