iPhone XR : How to turn off an app

New iPhoneXR. Apps are installed. When I am finished using an app I swipe the screen from the bottom to the top and the app disappears from view. I may use several apps and do that swipe thing to all when I done using them. Before I power off the phone I swipe one last time from the bottom to see if there's an app which needs to be closed. I power off the phone. Later, I power up the phone and those apps I thought were swiped away are totally opened on the screen. I have to swipe them off all over one by one. I tried twice with Apple chat to figure this out without having to remove everything and reinstall everything. The first Apple chat person kept asking if the issue was how to remove an app.

Does anyone know if there is a setting which will allow an app on a new iPhoneXR to be shut down (not removed) by merely swiping on the screen from bottom to top?