I was specifically referring to the additional data. There must be a way to force an application to take responsibility for it's stuff.
Also on Linux it seems to be more than one file or folder. I had to delete some ~/.local/usr/share/application entries as well as the application icons. I felt like this more involved than it needed to be process reminded me of old-school windows 98 uninstalls of unruly applications and for non-power users this could be a big problem for users.
I am of course open to alternatives, others having opinions that contradict my own.