It will be goofy as the config files will still stick around between desktops.

I would runs desktop in a container or VM.