Yes. You just have to delete the application. Instructions below are for Windows machines.
In Control Panel, look for an "Uninstall Program" option. It may be slightly different depending on your platform.
Search for the program you want to delete, select it and click "Uninstall".