Yes, you only need one fuse for each bulb.
And here's the schematic laid out more like you should lay it out in real life, so that there is no wire that can short without a fuse.
[EDIT]
Look at Wookies picture in his post, it's probably better.

 

You need to use at least one main fuse by the battery positive terminal to protect the wiring.

F2 and F3 are optional. The switches are also optional, but they will be much more convenient to turn the lamps on and off with instead of having to connect and disconnect wires.