Systems Frontend issueshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues2022-11-29T20:38:05+01:00https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1822navigate video with arrow keys2022-11-29T20:38:05+01:00Milan Gressnavigate video with arrow keysAs a user, I would like to navigate the video with my arrow keys. Primarily because that is (at least for me) expected/conventional behavior from a video player (YouTube, Vimeo, etc.), but I also believe that it would be quite useful (an...As a user, I would like to navigate the video with my arrow keys. Primarily because that is (at least for me) expected/conventional behavior from a video player (YouTube, Vimeo, etc.), but I also believe that it would be quite useful (and much faster) for finding specific frames.
I feel like there is also a broader case for more keyboard navigation, (Jumping to next Annotation… toggling layers… start/stop video) but I would argue that for now arrow keys are definitely the least technical / most accessible
The open question would be about the timeframe that video should jump: We currently use `+/- 1 frame` and `+/- 1 Second` in the video player, so it probably should be one of those. (YouTube uses 15 Seconds, but I feel like that maybe less useful for our use case)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1813Add Stop/Exit-Button for the Video Analysis Tools?2022-11-28T16:04:17+01:00Stefanie HampelAdd Stop/Exit-Button for the Video Analysis Tools?Maybe it would be helpful to add a Stop/Exit-Button which is close to the Video-Analysis Tools so that the process can be stopped in case that it takes too long, must be restarted or something like that? As far as I can see, it is now on...Maybe it would be helpful to add a Stop/Exit-Button which is close to the Video-Analysis Tools so that the process can be stopped in case that it takes too long, must be restarted or something like that? As far as I can see, it is now only possible via Files->Edit->Video Analysis, which might be a bit hard to find?Feature: Data ViewsMilan GressMilan Gresshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1818Add opportunity to correct tracked persons whose ID switched during the peopl...2022-11-25T18:03:25+01:00Hansen, ChristianAdd opportunity to correct tracked persons whose ID switched during the people detectionIt is possible that bad light in a video, leaving the scenario and coming back etc. causes an ID change, "Person 1" could become "Person 15" after a while. The user should be able to say "Okay Person 1 is also Person 15".It is possible that bad light in a video, leaving the scenario and coming back etc. causes an ID change, "Person 1" could become "Person 15" after a while. The user should be able to say "Okay Person 1 is also Person 15".Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1081Post-Annotator: add option to automatically play back audio-annotations2022-11-25T12:18:11+01:00Rittershaus, DavidPost-Annotator: add option to automatically play back audio-annotationsThis is a use case brought up by several students in the HZT workshop independently:
If you add a voice/audio recording (as annotation) it would be great if you could choose a setting to automatically trigger the audio playback as soon ...This is a use case brought up by several students in the HZT workshop independently:
If you add a voice/audio recording (as annotation) it would be great if you could choose a setting to automatically trigger the audio playback as soon as the video reaches the timestamp of the audio-annotation.
The concrete use case:
Students asked musicians to react to their video. The musicians added audio recordings exactly to the moment in the video where the file should start playing. For now, the students manually pushed the play button in the annotation as soon as the annotation was the current one/highlighted to achieve this. But I guess it could be automated.
I think this could generally also be interesting for voice comments/voice overs: they could be played in parallel to video in that way.
I think an extra option to select whether the audio of the audio-annotation should overlap with the audio of the video or if the video should be mutet in the moment the audio of the annotation is played could be nice.Usability UX Improvementshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1795Post Annotator: add "select all annotations" to annotations stream on multipl...2022-11-21T14:35:16+01:00Hansen, ChristianPost Annotator: add "select all annotations" to annotations stream on multiple selectExample: I want to remove all transcribed annotations, so I filter them. At the moment I have to select every annotation from the filtered annotation list on my own. To have a "select all" checkbox would be a benefit now, see the files t...Example: I want to remove all transcribed annotations, so I filter them. At the moment I have to select every annotation from the filtered annotation list on my own. To have a "select all" checkbox would be a benefit now, see the files table in /files.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1750Distinguish job states in UI2022-11-18T19:04:22+01:00Koch, AntonDistinguish job states in UIThe jobs should now have 4 distinguishable states:
1. Waiting: There is no progress object
2. Started: There is a progress object, but percent is anything but 100
3. Completed: Progress percent equals 100
4. Errored: There is a message ...The jobs should now have 4 distinguishable states:
1. Waiting: There is no progress object
2. Started: There is a progress object, but percent is anything but 100
3. Completed: Progress percent equals 100
4. Errored: There is a message object on the progress objectFeature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1788Files: remove preview image animation in table2022-11-18T12:55:49+01:00Hansen, ChristianFiles: remove preview image animation in tableWhen loading the page the preview images are animated. This is wrong, and it annoys me for a long time now.
<br /><br />
![Bildschirmaufnahme_2022-11-18_um_12.15.16](/uploads/7c660c59966684de60295c0a69aae8b4/Bildschirmaufnahme_2022-11-18...When loading the page the preview images are animated. This is wrong, and it annoys me for a long time now.
<br /><br />
![Bildschirmaufnahme_2022-11-18_um_12.15.16](/uploads/7c660c59966684de60295c0a69aae8b4/Bildschirmaufnahme_2022-11-18_um_12.15.16.mov)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1785Add general (video) image annotation (svg) option?2022-11-17T15:21:20+01:00Rittershaus, DavidAdd general (video) image annotation (svg) option?I stumbled over this one here: https://recogito.github.io/annotorious/
![Bildschirmfoto_2022-11-17_um_15.18.13](/uploads/a5c43163723c28acfed5c4e62169bc60/Bildschirmfoto_2022-11-17_um_15.18.13.png)
Further, there was some feedback form ...I stumbled over this one here: https://recogito.github.io/annotorious/
![Bildschirmfoto_2022-11-17_um_15.18.13](/uploads/a5c43163723c28acfed5c4e62169bc60/Bildschirmfoto_2022-11-17_um_15.18.13.png)
Further, there was some feedback form Cologne that it would be great to display comments on images in the Timeline Viewer next to the image (similar to the video annotations) and not below in the comment section. That does not really fit into our logic but might be solved by offering the possibility to annotate images.
It could be of interest for video images (one frame) as well as static images.
Not sure if this works with our timeline concept but it felt like the most recent changes (body parts) are somehow linked to that and maybe now it's not such a big thing. However, it's not a priority at the moment.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1765Access pose visualisation2022-11-17T14:18:10+01:00Koch, AntonAccess pose visualisationYou can access the pose visualisation (once it exists) with:
```javascript
const fileUrl = `${process.env.API_HOST}/files/${encodeURIComponent(asset.blobId)}?pose=1`
const source = [{
src: fileUrl,
type: asse...You can access the pose visualisation (once it exists) with:
```javascript
const fileUrl = `${process.env.API_HOST}/files/${encodeURIComponent(asset.blobId)}?pose=1`
const source = [{
src: fileUrl,
type: asset.mimeType
}]
```
Note: This only works for new uploads/processings starting now. And the visualisation currently shows a mesh but will soon be switched to a skeleton. Audio is also still to be added.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1780Does it make sense to change the start time of a live annotation if the annot...2022-11-17T12:42:44+01:00Hansen, ChristianDoes it make sense to change the start time of a live annotation if the annotations won't be moved as well?In my opinion this edit feature can be disabled to prevent misunderstandings if you do not read the text properly:
<br /><br />
![Bildschirmfoto_2022-11-16_um_19.55.50](/uploads/ac1ba386e7f27fc75a902a344a0cf3c3/Bildschirmfoto_2022-11-16_...In my opinion this edit feature can be disabled to prevent misunderstandings if you do not read the text properly:
<br /><br />
![Bildschirmfoto_2022-11-16_um_19.55.50](/uploads/ac1ba386e7f27fc75a902a344a0cf3c3/Bildschirmfoto_2022-11-16_um_19.55.50.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1779"Draw on video"/Sketch-annotation doesn't save selected bounding box2022-11-16T19:49:06+01:00Hansen, Christian"Draw on video"/Sketch-annotation doesn't save selected bounding box![Bildschirmfoto_2022-11-16_um_19.47.21](/uploads/70614ca9d9f26745507d898e8a8b93d2/Bildschirmfoto_2022-11-16_um_19.47.21.png)![Bildschirmfoto_2022-11-16_um_19.47.21](/uploads/70614ca9d9f26745507d898e8a8b93d2/Bildschirmfoto_2022-11-16_um_19.47.21.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1777"Add filter" button overlays "Comments" button from last annotation item2022-11-16T19:23:38+01:00Hansen, Christian"Add filter" button overlays "Comments" button from last annotation item![Bildschirmfoto_2022-11-16_um_19.21.04](/uploads/a9febfe64b8af2c83e645c57df522de8/Bildschirmfoto_2022-11-16_um_19.21.04.png)
<br />
<br />
![Bildschirmfoto_2022-11-16_um_19.21.12](/uploads/61623733af3956d56c996d6877d01e38/Bildschirmfoto...![Bildschirmfoto_2022-11-16_um_19.21.04](/uploads/a9febfe64b8af2c83e645c57df522de8/Bildschirmfoto_2022-11-16_um_19.21.04.png)
<br />
<br />
![Bildschirmfoto_2022-11-16_um_19.21.12](/uploads/61623733af3956d56c996d6877d01e38/Bildschirmfoto_2022-11-16_um_19.21.12.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1710Add mb-skeleton as background when "waiting for conversion" in annotation item2022-11-15T20:05:41+01:00Hansen, ChristianAdd mb-skeleton as background when "waiting for conversion" in annotation itemTimeline viewer:
<br /><br />
![Bildschirmfoto_2022-10-19_um_14.55.35](/uploads/adb9fa6052d36911f245949a7637924d/Bildschirmfoto_2022-10-19_um_14.55.35.png)Timeline viewer:
<br /><br />
![Bildschirmfoto_2022-10-19_um_14.55.35](/uploads/adb9fa6052d36911f245949a7637924d/Bildschirmfoto_2022-10-19_um_14.55.35.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1661Swimlane: Dragging Annotations broken on Safari if Swimlane not entirely visible2022-11-15T18:08:02+01:00Mittermeier, MaximilianSwimlane: Dragging Annotations broken on Safari if Swimlane not entirely visibleUsing Safari and having changed the Swimlane vertical size to less than the vertical height of all Lanes, when dragging a Point Annotation the browser automatically scrolls down in the Swimlane, resulting in unintended change of Annotati...Using Safari and having changed the Swimlane vertical size to less than the vertical height of all Lanes, when dragging a Point Annotation the browser automatically scrolls down in the Swimlane, resulting in unintended change of Annotation type to Ranged via the drag'n'drop mechanic.
Issue gets worse the bigger the out of view part of the Swimlane is.Feature: SwimlaneMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1761Store min, max, average values from ML analysis for Timline Viewer2022-11-15T11:42:36+01:00Rittershaus, DavidStore min, max, average values from ML analysis for Timline ViewerNot a priority at the moment, just adding it to the feature list: I think it would be great to make use of the calculations in the Timeline Viewer as well for the bigger overview in the future. Would be interesting to see how many people...Not a priority at the moment, just adding it to the feature list: I think it would be great to make use of the calculations in the Timeline Viewer as well for the bigger overview in the future. Would be interesting to see how many people (max bounding boxes) are in the videos and how that changes over time. Also for movement dynamic such a zoomed out perspective could be interesting.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1676Swimlane: Lane Menu arrangement broken after switching between Light/Dark theme2022-11-10T18:58:48+01:00Mittermeier, MaximilianSwimlane: Lane Menu arrangement broken after switching between Light/Dark themeAfter switching between Light and Dark theme via main menu the Lane Menu buttons seem to be misaligned.
Misalignment does not appear on Lanes created after the theme switch.
![Screenshot_2022-10-10_at_12.48.02](/uploads/18c5623c59da1da...After switching between Light and Dark theme via main menu the Lane Menu buttons seem to be misaligned.
Misalignment does not appear on Lanes created after the theme switch.
![Screenshot_2022-10-10_at_12.48.02](/uploads/18c5623c59da1da12f9b2d64e0225c39/Screenshot_2022-10-10_at_12.48.02.png)Feature: SwimlaneMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1756Feature: Create editable skeletons?2022-11-09T20:17:40+01:00Hansen, ChristianFeature: Create editable skeletons?Use case: I see a student has a body posture fault in his uploaded video. I activate the skeletons. Then I duplicate the skeleton with which I can edit/move joints or whole bodyparts to show the student what he or she did wrong. Save it ...Use case: I see a student has a body posture fault in his uploaded video. I activate the skeletons. Then I duplicate the skeleton with which I can edit/move joints or whole bodyparts to show the student what he or she did wrong. Save it as annotation or comment.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1754Annotations with "live" tag and "automatically transcribed" tag: how to deal ...2022-11-08T16:58:11+01:00Rittershaus, DavidAnnotations with "live" tag and "automatically transcribed" tag: how to deal with modification?Now annotations created via Live Annotator and automatically/software generated annotations get visible tag to make their origin/context of creation more transparent.
However, we do not track changes at the moment. If a software generat...Now annotations created via Live Annotator and automatically/software generated annotations get visible tag to make their origin/context of creation more transparent.
However, we do not track changes at the moment. If a software generated annotation is edited it will still appear as if it is one of those automatically generated ones. Not sure how we could solve that without introducing some sort of versioning.
Only simple idea that comes to my mind: if date of creation and last modified are not the same, this is somehow visible in the UI...https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1751Pass a job sequence2022-11-08T09:43:44+01:00Koch, AntonPass a job sequenceAllow passing a sequence of jobs to request a later stage that initially isn't available (e.g. Kinesphere) and needs to have other jobs run before it.Allow passing a sequence of jobs to request a later stage that initially isn't available (e.g. Kinesphere) and needs to have other jobs run before it.Feature: Data ViewsKoch, AntonKoch, Antonhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1739moving playhead-handel in the swimlane produces sometimes buggy bounding boxes2022-10-31T13:47:29+01:00Milan Gressmoving playhead-handel in the swimlane produces sometimes buggy bounding boxesThe real bug (wrong BB at current frame) is mostly non-breaking and easily fixed by a quick play/pause
![Kapture_2022-10-29_at_11.57.15](/uploads/9b23dca81e8c162c542182b8910cd773/Kapture_2022-10-29_at_11.57.15.mp4)The real bug (wrong BB at current frame) is mostly non-breaking and easily fixed by a quick play/pause
![Kapture_2022-10-29_at_11.57.15](/uploads/9b23dca81e8c162c542182b8910cd773/Kapture_2022-10-29_at_11.57.15.mp4)Feature: Swimlane