They're not wired in series, it just looks that way. You have a positive supply and a negative supply referenced to ground, (sometimes called a 'split rail' supply), the capacitors are positioned to smooth the +ve rail and the -ve rail. Obviously the -ve rail capacitor is wired with its positive to ground because ground is considered more positive than any negative voltage.
Very common n00b mistake to think they should be in parallel, even when it is clear the unit has been working wired as it is for decades.