I agree , i've simulated with those conditions and seen that data too.Your emitter resistor is way to large. When the transistor is off, this is the only path to ground for the speaker, so the negative half of the cycle is severely attenuated, giving you a very distorted output.
Change the emitter resistor to 8 Ohms and the output capacitor to 1000uF. According to my simulation, this gives you about 450mV on the output.
Bob