Most software I download from the software store has windows-like window management buttons (minimize, shrink, close) buttons. I'm wondering how I can make them look like the nice default Zorin OS ones. The one I have taken a screenshot of is OnlyOffice
Welcome to the Forum!
When You use Flatpaks, it can be that they bring own Icons with it. You could try it with the .deb Version instead.
Might try this, given that OnlyOffice uses QT:
I am not sure if the version in use in this thread is QT5 or QT6, though...
I just edited that guide to include QT6 instructions.
At least the flatpak Version uses the Freedesktop Platform.