Disable automatic scrolling after scrolling manually (while playing a video)...
...and show an "enable automatic scrolling"-button in the annotation stream. If there are many annotations in a small time range it is impossible to read them because the automatic scrolling is way too fast.
According to the (manual) scroll position the button should be placed either at the upper or lower edge: