In applied mathematics, Wahba's problem, first posed by Grace Wahba in 1965, seeks to find a rotation matrix (special orthogonal matrix) between two coordinate systems from a set of (weighted) vector observations. Solutions to Wahba's problem are often used in satellite attitude determination utilising sensors such as magnetometers and multi-antenna GPS receivers. The cost function that Wahba's problem seeks to minimise is as follows:

where ${\displaystyle \mathbf {w} _{k}}$ is the k-th 3-vector measurement in the reference frame, ${\displaystyle \mathbf {v} _{k}}$ is the corresponding k-th 3-vector measurement in the body frame and ${\displaystyle \mathbf {R} }$ is a 3 by 3 rotation matrix between the coordinate frames. ${\displaystyle a_{k}}$ is an optional set of weights for each observation.

A number of solutions to the problem have appeared in literature, notably Davenport's q-method, QUEST and methods based on the singular value decomposition (SVD). Several methods for solving Wahba's problem are discussed by Markley and Mortari.

This is an alternative formulation of the orthogonal Procrustes problem (consider all the vectors multiplied by the square-roots of the corresponding weights as columns of two matrices with N columns to obtain the alternative formulation). A compact and elegant derivation can be found in Appel (2015).

One solution can be found using a singular value decomposition (SVD).

1. Obtain a matrix ${\displaystyle \mathbf {B} }$ as follows:

2. Find the singular value decomposition of ${\displaystyle \mathbf {B} }$

3. The rotation matrix is simply: