Yes, normally that is what you would do.Each RCA plug has a tip and a shield. Just to baseline what an audio signal looks like, how do I attach the multimeter to it?
Red on the tip and black on the shield?
In your case, the DMM is hand-held (it is isolated or "floating") and therefore has no absolute voltage reference.
Therefore it does not matter which way you connect the test leads.


