How to install WordPress, PHP, Apache & MySQL on Windows

When developing for WordPress locally on Windows, we need to have Apache, PHP and MySQL installed. There are web development environments available such as EasyPHP or WampServer, but I always prefer to install them manually. The experience you gain from it becomes useful when you encounter a problem with either PHP, Apache, or MySQL database as you will have a better idea where to look for the issues.