Monte Carlo-based estimation of uncertainty owing to limited resolution of digital instruments

Publication Type:
Journal Article
Metrologia, 2005, 42 (5)
Issue Date:
Filename Description Size
Thumbnail2005000825.pdf1.53 MB
Adobe PDF
Full metadata record
We have used a Monte Carlo simulation for investigating the output of a digital instrument, of resolution half-width a, when its analogue input is a Gaussian signal. The digitizing process converts an actual mean to an observed mean and an actual variance to an observed variance. The resulting relationships are plotted as two sets of graphs, in one of which the observed mean is the parameter, while in the other the observed variance is the parameter. Given an observed mean and an observed variance, it is then easy to infer from the graphs the corresponding actual mean and actual variance. The graphs illustrate, for example, that unless the observed variance is very low, the actual variance can be recovered from the observed variance by subtracting a 2 /3 from the observed variance. © 2005 BIPM and IOP Publishing Ltd.
Please use this identifier to cite or link to this item: