This way we avoid having to maintain consistency between track_matrix and the wolf tree each time kfs are created / removed or frames are changed key/auxiliar/non_estimated status