They are different kind of capacitors, selection for one capacitor varies depending on application. A good read app note from Analog Devices. Link here (PDF)
Capacitors are underrated. They do not have transistor counts in the billions nor do they use the latest submicron fabrication technology. In the minds of many engineers, a capacitor is simply two conductors separated by a dielectric. In short, they are one of the lowliest electronic components.
It is common for engineers to add a few capacitors to solve noise problems. This is because capacitors are widely seen by engineers as a panacea for solving noise related issues. Other than the capacitance and voltage rating, little thought is given to any other parameter. However, like all electronic components, capacitors are not perfect and possess parasitic resistance, inductance, capacitance variation over temperature and voltage bias, and other nonideal properties.
These factors must be considered when selecting a capacitor for many bypassing applications or where the actual value of the capacitor is important. Choosing the wrong capacitor can lead to circuit instability, excessive noise or power dissipation, shortened product life, or unpredictable circuit behavior.