The speaker is really inaudible. Only some noise comes out when I use a 10K pot.
And even then, it's not actual words or anything. Just a bunch of noise.
If you don't want to use LM386, you can get extra current output with a Class-B push-pull output stage.
This is just a sample drawing. Substitute one stage of TL072 for LM741. Use your +9V and -9V supplies instead of ±15V.
This should work better with what you have but the TL072 is not designed to power a speaker as all others have mentioned.
EDIT: Add filter caps on the supply lines. Limit gain from 2 to 12 max.