You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When converting physical to digital values, the input values are
floating-point and therefore may have rounding errors. We want to
round each value to the nearest integer before calling istype, in
order to avoid adding a bias towards zero.
This applies to adc in all four modes: expanded and not expanded,
in-place and not-in-place.
("In-place" here means both that we can overwrite the original
floating-point arrays, and that the record attributes will be updated
afterwards. In "not-in-place" mode, we are operating on copies of the
original arrays.)
0 commit comments