Ok, change of plan - that original reverse protection circuit does work - once you realise the MOSFET is being used 'upside down' which for a normal transistor would mean instant destruction but, counter-intuitively, is apparently OK for a MOSFET. The difficulty is finding a P-Channel MOSFET with a turn-on voltage < 1.5v, Jaycar have nothing and Mouser only 1 (IPP120P04P4L-03) but we can be clever and turn the whole circuit 'upside down' and use an N-channel MOSFET for which there are many more choices... though none from Jaycar, but plenty from Mouser, and my pick is the cheapest one SUP40012EL-GE3 at AU$3.31
Here's the circuit - note the MOSFET is in the battery - lead but that doesn't matter as the whole thing is floating... and only 1 component!

And just to show it works, here's the output from a simulation... battery volts go negative - nothing goes to the board, goes positive, board draws current...

Here is how you wire it up...

Here's the circuit - note the MOSFET is in the battery - lead but that doesn't matter as the whole thing is floating... and only 1 component!

And just to show it works, here's the output from a simulation... battery volts go negative - nothing goes to the board, goes positive, board draws current...

Here is how you wire it up...

