You can certainly use a GUI to manage your packages.
In my experience I've never had issues with leftover files or dependencies. The package manager used in Linux works really well.
But if you are still concerned about this you can install a lot of programs using a packaging format called Flatpak. Basically it's bundle of the executable along with every dependency it needs to run, and it runs isolated from the rest of the system. In fact some preinstalled apps in Zorin are flatpaks.
As usual there are pros and cons to this, with many in favor or against, and it's a big topic in general. Here's a video that explains a bit of the history and use of these packaging formats AppImage and Snap being the other two most popular.
