@lippyf
You are not considering that your meter counts from 0 to 1999, That is all you meter can display. Next, look at the range setting. You are NOT using the x.xxx setting with the selected DMM.
Round your calculation to the nearest x.xx value. Then it's +2 digits or counts.
I've yet to see a specification that had -2 digits.
If you were reading 1V, you could read 0.995 to 0.997 on the low end or 1.005 to 1.007 on the high end with a half percent tolerance and 2 counts (digits).
On edit,
Design World offers this tutorial on DMMs accuracy.
You are not considering that your meter counts from 0 to 1999, That is all you meter can display. Next, look at the range setting. You are NOT using the x.xxx setting with the selected DMM.
Round your calculation to the nearest x.xx value. Then it's +2 digits or counts.
I've yet to see a specification that had -2 digits.
If you were reading 1V, you could read 0.995 to 0.997 on the low end or 1.005 to 1.007 on the high end with a half percent tolerance and 2 counts (digits).
On edit,
Design World offers this tutorial on DMMs accuracy.
Last edited:
