This app note from Linear Technology describes why ceramic capacitors aren’t an ideal replacement for tantalum based caps. The higher internal inductance of ceramic capacitors creates high voltage spikes:
Applying a voltage step to a ceramic capacitor causes a large current surge that stores energy in the inductances of the power leads. A large voltage spike is created when the stored energy is transferred from these inductances into the ceramic capacitor. These voltage spikes can easily be twice the amplitude of the input voltage step.