There are several reasons why you often see capacitors, particularly electrolytics, connected in parallel:

EEVblog #742 – Why Electrolytic Capacitors Are Connected In Parallel