Skeletons and Bounding Boxes should always target the media, not the timeline
These annotations are only valid for a specific perspective.
I have found annotations with bounding boxes targeting the timeline, so please check again and make sure these target the correct IDs.