Configurator 2 is removing existing apps from iPhones that I try to supervise

I am trying to test creating manually supervised iPhone profiles for a client using Configurator 2. Unlike Configurator, Configurator 2 does not have the option to deselect "Remove apps and profiles configurator did not install". I haven't been able to find the equivalent setting in Configurator 2. How can I prevent configurator 2 from removing pre-existing apps when the device is prepared/supervised?