Tensor formalism (and its special case—vector formalism) is a mathematical technique that is widely used in physical and engineering problems. Even though this formalism is fairy universal and suitable for describing many spaces, the application of other special mathematical techniques is sometimes required. For example, the problem of rotation in a 3D space is not very well described in tensor representation, and it is reasonable to use the formalism of Clifford algebra, in particular, quaternions and geometric algebra representations for its solution. In this paper, computer algebra is used to demonstrate the solution of the problem of rotation in a 3D space using both the quaternion and geometric algebra formalisms. It is shown that although these formalisms are fundamentally similar, the latter one seems to be clearer both for computations and interpretation of results.