Systems Frontend issueshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues2024-01-10T17:41:38+01:00https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2209post annotator: automatic transcription after video file (not audio file) upl...2024-01-10T17:41:38+01:00Hansen, Christianpost annotator: automatic transcription after video file (not audio file) upload in post-annotator-input is missing![Bildschirmfoto_2023-12-19_um_12.14.21](/uploads/a45b020040dfa35a6825de54baada53e/Bildschirmfoto_2023-12-19_um_12.14.21.png)![Bildschirmfoto_2023-12-19_um_12.14.21](/uploads/a45b020040dfa35a6825de54baada53e/Bildschirmfoto_2023-12-19_um_12.14.21.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2060Timeline Viewer: Simplify changing timestamps2023-06-02T12:29:13+02:00Hansen, ChristianTimeline Viewer: Simplify changing timestampsChanging timestamp is a bit too complicated. The wish for a more simple workflow (like drag & drop) came up.Changing timestamp is a bit too complicated. The wish for a more simple workflow (like drag & drop) came up.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2039Remove "people tracking" from magic menu?2023-05-05T17:49:22+02:00Rittershaus, DavidRemove "people tracking" from magic menu?This came up before but it still seems to be a little bit confusing why there is an option that does not offer anything new compared to "people detection". I know that the data in the background has the IDs when the tracking has be proce...This came up before but it still seems to be a little bit confusing why there is an option that does not offer anything new compared to "people detection". I know that the data in the background has the IDs when the tracking has be processed but this has no effect for users in the vortanz version. My suggestion is to remove it from the menu and to just run it in the background when pose recognition etc. is requested and only use the IDs for the bboxes if they were created through further processing (via pose recognition, kinesphere etc.).https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1860Post-annotator menus makeover (logic of filtering & displaying)2024-01-09T15:04:55+01:00Rittershaus, DavidPost-annotator menus makeover (logic of filtering & displaying)1. "Video Analysis" aka "Magic Menu": From my point of view it can (or even should) remain as simple as it is. The question here is more if it has some influence on the rest of the UI. If I toggle the bounding boxes or the pose recogitio...1. "Video Analysis" aka "Magic Menu": From my point of view it can (or even should) remain as simple as it is. The question here is more if it has some influence on the rest of the UI. If I toggle the bounding boxes or the pose recogition I can immediately see the video overlay but not the data visualisation in the swimlane. In the last system dev meeting we said that the siwmlane should autmatically show up with the corresponding data visualisation (for example: people detection --> bboxes are shown as overlays in the video + people count lane is shown as well).
2. Swimlane menu: I suppose that this menu should become simpler and we all agreed on that in the last system dev meeting.
First, in regard to the video analysis features I would suggest to use the same icons and also group lanes that you can toggle under each feature (e.g. Kinesphere --> 1. Follow selected person; 2. All IDs). These features could also be grouped under one main "data visualisation" menu item, which can also contain the annotation density lane. In the swimlane menu only those menu items should be visible that are already available. If kinesphere hasn't been processed yet it should not show up as an option in the swimlane menu.
Second, I would suggest to think about one menu item that is simply called "new custom lane" which opens an overlay where you can configure a new lane. This configuration could include the decision if the custom lane combines the annotations of all users or if it is split per user. It could also allow you to set a filter for this new lane.
But maybe @maximilian.mittermei can think of an even smarter solution based on the discussion in the last system dev meeting.
3. Filter menu: in general it could remain the same. The text filter should also have an effect for all lanes in the swim lane with annotations no matter if split by user or combined in one lane. If we allow people to create custom lanes with a text filter applied (see 2.), they should nevertheless be affected as well, so it's clear that the filter in the annotation list will always have an effect on all annotation lanes in the swimlane.
There is still an open question for me in regard to automatically generated annotations (at the moment transcript, but it might also include Kinesphere labels or others in the future). They always get a seperate lane by default but are always shown together with alll other annotations in the annotation list by default. So they are handled differently in the list and in the swimlane. But this is maybe another issue.
Here is screenshot with all 3 menus visible:
![Bildschirmfoto_2022-12-08_um_10.17.15](/uploads/d0bb1ca9deb5ddd50bff3e6323a34787/Bildschirmfoto_2022-12-08_um_10.17.15.png)Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1785Add general (video) image annotation (svg) option?2022-11-17T15:21:20+01:00Rittershaus, DavidAdd general (video) image annotation (svg) option?I stumbled over this one here: https://recogito.github.io/annotorious/
![Bildschirmfoto_2022-11-17_um_15.18.13](/uploads/a5c43163723c28acfed5c4e62169bc60/Bildschirmfoto_2022-11-17_um_15.18.13.png)
Further, there was some feedback form ...I stumbled over this one here: https://recogito.github.io/annotorious/
![Bildschirmfoto_2022-11-17_um_15.18.13](/uploads/a5c43163723c28acfed5c4e62169bc60/Bildschirmfoto_2022-11-17_um_15.18.13.png)
Further, there was some feedback form Cologne that it would be great to display comments on images in the Timeline Viewer next to the image (similar to the video annotations) and not below in the comment section. That does not really fit into our logic but might be solved by offering the possibility to annotate images.
It could be of interest for video images (one frame) as well as static images.
Not sure if this works with our timeline concept but it felt like the most recent changes (body parts) are somehow linked to that and maybe now it's not such a big thing. However, it's not a priority at the moment.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1780Does it make sense to change the start time of a live annotation if the annot...2022-11-17T12:42:44+01:00Hansen, ChristianDoes it make sense to change the start time of a live annotation if the annotations won't be moved as well?In my opinion this edit feature can be disabled to prevent misunderstandings if you do not read the text properly:
<br /><br />
![Bildschirmfoto_2022-11-16_um_19.55.50](/uploads/ac1ba386e7f27fc75a902a344a0cf3c3/Bildschirmfoto_2022-11-16_...In my opinion this edit feature can be disabled to prevent misunderstandings if you do not read the text properly:
<br /><br />
![Bildschirmfoto_2022-11-16_um_19.55.50](/uploads/ac1ba386e7f27fc75a902a344a0cf3c3/Bildschirmfoto_2022-11-16_um_19.55.50.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1754Annotations with "live" tag and "automatically transcribed" tag: how to deal ...2022-11-08T16:58:11+01:00Rittershaus, DavidAnnotations with "live" tag and "automatically transcribed" tag: how to deal with modification?Now annotations created via Live Annotator and automatically/software generated annotations get visible tag to make their origin/context of creation more transparent.
However, we do not track changes at the moment. If a software generat...Now annotations created via Live Annotator and automatically/software generated annotations get visible tag to make their origin/context of creation more transparent.
However, we do not track changes at the moment. If a software generated annotation is edited it will still appear as if it is one of those automatically generated ones. Not sure how we could solve that without introducing some sort of versioning.
Only simple idea that comes to my mind: if date of creation and last modified are not the same, this is somehow visible in the UI...https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1693Add "persons" to system2022-10-17T11:10:36+02:00Rittershaus, DavidAdd "persons" to systemAs soon as the bounding boxes come along with tracking, it makes sense to offer the possibility to add a person's name to the box (see
#1673). However, as @anton.koch said the last Zoom meeting, it would make sense to really have perso...As soon as the bounding boxes come along with tracking, it makes sense to offer the possibility to add a person's name to the box (see
#1673). However, as @anton.koch said the last Zoom meeting, it would make sense to really have persons as entities in the system.
Not sure how this should be best implemented but from my understanding it could be similar to how we want to implement tags? So persons would be a more specified variant of a tag? Could thus be the first step towards introducing tagging...?!Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1691Add OSC messaging to system?2022-10-17T11:41:39+02:00Rittershaus, DavidAdd OSC messaging to system?@anton.koch, @maximilian.mittermei: this not for the next months but maybe something we might look at during a next CCL or whenever there is some time for such things.
It came to my mind when I was using the swimlane a bit more. Would...@anton.koch, @maximilian.mittermei: this not for the next months but maybe something we might look at during a next CCL or whenever there is some time for such things.
It came to my mind when I was using the swimlane a bit more. Would it be possible to use annotations as "triggers" that emit OSC messages? So we could for example send triggers to other software like Ableton or lightning desks/computers or a creative coding framework?
Also, both in Berlin and Frankfurt, we've been once speculating with the dance students about the possibility of adding annotations as a sort of "preset" or "score". The context was slightly different, but it might be linked, since you maybe want to use the swimlane without a video if you use it to emit triggers for another software. So you actually would only need a timeline with "trigger annotations". The live annotator already let's you add annotations without a video to which they have to refer but doesn't allow you do anything further with the captured set of annotations, and without syncing a video you don't have access to the swimlane...
Might also be interesting for creative use to make use of the ML-created data. So you could for example stream pose (estimation) data to another application...https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1686Swimlane: Add handlers for zoom bar2022-10-19T14:48:12+02:00Rittershaus, DavidSwimlane: Add handlers for zoom bar@maximilian.mittermei: I would suggest to add the possibility to use the zoom with handlers to the left and right of the navigation bar (like in the previous version of the system):
![Bildschirmfoto_2022-10-17_um_09.42.01](/uploads/fca0...@maximilian.mittermei: I would suggest to add the possibility to use the zoom with handlers to the left and right of the navigation bar (like in the previous version of the system):
![Bildschirmfoto_2022-10-17_um_09.42.01](/uploads/fca018d8d155b977dd563e90636c3881/Bildschirmfoto_2022-10-17_um_09.42.01.png)
![Bildschirmfoto_2022-10-17_um_09.44.01](/uploads/d9b46563ee431157315c2c36df4ef850/Bildschirmfoto_2022-10-17_um_09.44.01.png)Feature: Swimlanehttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1675Rethink AI Features in Files2022-10-17T15:37:09+02:00Dieterich, MaikaRethink AI Features in FilesAdd bounding boxes to feature list there?
Do we need the option to start AI features in the files? Are there possible use cases for the infos on AI features in the files?Add bounding boxes to feature list there?
Do we need the option to start AI features in the files? Are there possible use cases for the infos on AI features in the files?Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1663Swimlane: copy/duplicate annotation2022-10-07T12:23:47+02:00Hansen, ChristianSwimlane: copy/duplicate annotationQ:
<br />
Is it important that a copied annotation is pushed immediately at a certain time, or is it primarily about duplicating?
<br /><br />
A:
<br />
1.
<br />
I think especially with the work in the swimlane it doesn't have to be put...Q:
<br />
Is it important that a copied annotation is pushed immediately at a certain time, or is it primarily about duplicating?
<br /><br />
A:
<br />
1.
<br />
I think especially with the work in the swimlane it doesn't have to be put directly on a certain point of time and - as I said - that didn't seem so clear at the time, what the option actually does
<br /><br />
2.
<br />
I have the following idea (works only on desktop): Click on "Copy", a temporary, slightly transparent marker appears which moves on the x-axis with the cursor. Click to fix the marker at the corresponding position. Same as "copy and paste at position x" in a more visual way.
<br />
"Duplicate" as second option in the context menu could be used to copy a marker and paste it at the same position immediately.Feature: Swimlanehttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1656Zoom minimum makes overlapping annotations inaccessible2022-11-30T17:18:37+01:00Hansen, ChristianZoom minimum makes overlapping annotations inaccessibleAt the moment the swimlane zoom level has a zoom minimum. But this means that still bundled overlapping annotations can't be reached.
<br /><br />
![Bildschirmaufnahme_2022-09-30_um_16.54.07](/uploads/a31782a48ca2bb68fedded6eb74eaaa0/Bil...At the moment the swimlane zoom level has a zoom minimum. But this means that still bundled overlapping annotations can't be reached.
<br /><br />
![Bildschirmaufnahme_2022-09-30_um_16.54.07](/uploads/a31782a48ca2bb68fedded6eb74eaaa0/Bildschirmaufnahme_2022-09-30_um_16.54.07.mov)Feature: SwimlaneMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1648Add possibility to show annotation input field as overlay in video fullscreen...2022-10-05T15:36:04+02:00Rittershaus, DavidAdd possibility to show annotation input field as overlay in video fullscreen mode?I don't know if that's possible and/or difficult to implement but I think this might be a great option to really focus on the video and its details. In Word this is called "focus" mode (focus on writing).I don't know if that's possible and/or difficult to implement but I think this might be a great option to really focus on the video and its details. In Word this is called "focus" mode (focus on writing).https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1535Helena Miko: "Revision" how to display edited annotations2022-06-03T10:55:32+02:00Böhm, JeanHelena Miko: "Revision" how to display edited annotationsHow to make it clear that someone else has edited an annotation?How to make it clear that someone else has edited an annotation?https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1534Helena Miko: Duplicating a timeline makes you the author of all annotations i...2022-06-03T10:54:24+02:00Böhm, JeanHelena Miko: Duplicating a timeline makes you the author of all annotations in the timeline.After a timeline is duplicated, all annotation get the person which duplicated the timeline as creator. Even if annotation had been written by other people.After a timeline is duplicated, all annotation get the person which duplicated the timeline as creator. Even if annotation had been written by other people.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1349Scrolling Behaviour Post-Annotator2022-03-02T10:34:42+01:00Böhm, JeanScrolling Behaviour Post-AnnotatorWe need to discuss the scrolling in the post-annotator should work. Currently it's always scrolling to the last annotation by the time of the video.
Is this always the best solution? Sometimes it is scrolling a lot, at least for me in m...We need to discuss the scrolling in the post-annotator should work. Currently it's always scrolling to the last annotation by the time of the video.
Is this always the best solution? Sometimes it is scrolling a lot, at least for me in my testing scenarios :smile:
There is also this issue: #859Usability UX Improvementshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1163show timeline time in sync screen?2021-12-07T17:13:43+01:00Hansen, Christianshow timeline time in sync screen?Does it make sense to show the timeline time in the sync screen to have a better connection to the timeline?
<br />
![Bildschirmfoto_2021-11-30_um_11.30.16](/uploads/fa19deae8318f78362768827c6a119ee/Bildschirmfoto_2021-11-30_um_11.30.16....Does it make sense to show the timeline time in the sync screen to have a better connection to the timeline?
<br />
![Bildschirmfoto_2021-11-30_um_11.30.16](/uploads/fa19deae8318f78362768827c6a119ee/Bildschirmfoto_2021-11-30_um_11.30.16.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1126Enable tag-based file collections on Files page2021-11-25T09:54:45+01:00Rittershaus, DavidEnable tag-based file collections on Files pageHaven't been so much into the details behind the concept, but I remember that we said that tags (and collections) will allow us to offer some sort of "folder structure" for the files page.Haven't been so much into the details behind the concept, but I remember that we said that tags (and collections) will allow us to offer some sort of "folder structure" for the files page.Feature: Tagginghttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1119Sync Media Wording: Target Media is too technical / Problems with the sync me...2021-11-24T16:11:59+01:00Isabela DimarcoSync Media Wording: Target Media is too technical / Problems with the sync media selection flowThe main usability problem our two users had with the sync media dialog were related with selecting the target media. The issue was that they couldn't tell which if the target videos were clickable or not as their appearance does not cha...The main usability problem our two users had with the sync media dialog were related with selecting the target media. The issue was that they couldn't tell which if the target videos were clickable or not as their appearance does not change when hovering over or clicking on them. On our opinion, there are two ways to fix this:
1. Changing the wording:
**Target media** to **Select** target media / or **Select** media to sync - Select being the keyword here :)
2. Adding hover states to the available media
(The videos thumbnails are missing because my internet is really bad today)
![Bildschirmfoto_2021-11-24_um_15.43.20](/uploads/43dfbb6f829ded5cd8a811b0520262f0/Bildschirmfoto_2021-11-24_um_15.43.20.png)Usability UX Improvements