Uncertainty in Raptor Guide
Before using a refined pose in a sensor-fusion framework, always check that the Confidence field of the result is above your acceptance threshold.
The covariance alone is not sufficient — it only describes uncertainty assuming the pose was estimated correctly.
What the SDK returns
updatePose() / updatePosition() return a std::variant of either a
successful PoseOutput / PositionOutput or a PoseEstimationError. On
success the output carries, in decreasing order of practical importance, a
Confidence score and an optional output covariance: a 6×6 matrix on
PoseOutput::covariance or a 3×3 matrix on PositionOutput::covariance,
always expressed in the camera frame (DIN 9300: x forward, y right,
z down).
An error is returned when no pose could be produced at all — for example when large portions of the image are sky, contrast is too low, or the prior pose lies outside the loaded map.
Confidence score
Confidence reflects how well the algorithm matched the camera image to the
rendered map. It accounts for the number of established correspondences and
how well those correspondences predict the position of image features after
the refined pose is applied.
A low Confidence indicates few correspondences were used, or the
correspondences had a high probability of being wrong. Results below ~0.5
typically have very large position error and should be rejected.
Output covariance
The output covariance is derived by estimating an image correspondence covariance from the matcher's correlation scores and propagating it to the pose parameters via the Jacobian of the pose estimate. It therefore reflects:
- the uncertainty of each correspondence (large in low-contrast or motion-blurred regions, smaller in high-contrast regions), and
- the geometric configuration of correspondences in the image. Points clustered in one image region produce a large position covariance; points on a near-collinear arrangement produce uncertainty primarily orthogonal to that line.
Limitations
The covariance is a best-effort Gaussian approximation conditioned on the pose being roughly correct. It assumes:
- the residual error is Gaussian,
- the camera is a perfect pinhole, and
- all point correspondences are correctly matched.
In practice, none of these hold exactly. In particular, calibration error
(lens distortion, principal-point offset, inaccurate field of view) is
not modelled by either the covariance or the Confidence score; the
further the real camera deviates from a calibrated pinhole, the larger the
unmodelled component of the position error.