Luckily for you, there's a wide range of software solutions that can help you in this situation without significant efforts.
If you own a Windows computer, you probably understand and appreciate that some of your applications might have no icon or might have icons that irritate you, which might trigger you to wanting them replaced as soon as possible.