Your simple circuit feeds DC to the speaker which must never be done. Speakers work with AC, not DC.
Is the noise caused by the DC destroying the speaker?
Please describe the noise (low frequency hum, high frequency hiss, distortion or crackling).
Here is a simulation showing extreme distortion and lower distortion with better biasing:
Hi Bertus, I did not notice that the old 2SC1505 was high voltage and low current.
My simulation first wrongly used a little 2N3904 transistor that produced a current of 1000mA with no problems.