It's all about the frequency.I once connected an electrolytic in the wrong polarity, and it gave me horrible headaches until I realized my mistake. So yes, I can see why a polarized capacitor would be wrong for this application. On the other hand... electrolytics are bad for suppressing very quick transients, for that, small ceramic ones should be used... so maybe that's another reason for the circuit's behavior.
<Off Topic> When I was a kid I got a big bag of surplus 8uf polarized electrolytic capacitors. Keep in mind, when I was a kid was just following the ice age. My father had just finished the attic into two bedrooms one for me and one for my 2 sisters. He wired a few switched outlets where the night tables were beside the beds. My sister had her lamp on the table plugged into a switched outlet. With power off I would carefully place a cap across the outlet, poking the cap leads into the outlet slots. My sister would walk in the room at night, flip the wall switch on and give it a few seconds and BANG! Those little caps went off like a good firecracker. </OFF TOPIC>
Ron