App note from ROHM Semiconductor about various start up problem on 3 pins linear regulator. Link here (PDF)

Although linear regulators can be used to easily configure power supplies, the linear regulators may cause startup problems depending on the type of loads. This application note introduces cases where the power supplies do not start correctly in the linear regulators.