Well fine, I figured it out myself. 🙂
Right-click on the little speaker in the bottom right of the screen, choose Sound settings. Scroll down to More sound settings and something will pop up, go to Sounds, and then click on either “Device Connect” or “Device Disconnect” and on the bottom change its sound to (None).