Systems Frontend issueshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues2022-12-01T11:16:16+01:00https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1837Speech to Text-Annotations only partially show up2022-12-01T11:16:16+01:00Stefanie HampelSpeech to Text-Annotations only partially show upI tried to make Speech to Text-Annotations for a video of about 50 min. The Speech to Text-Analysis ran through and at first, all the annotations (ca. 600) showed up in the overlay. I selected them all in order to save them as annotation...I tried to make Speech to Text-Annotations for a video of about 50 min. The Speech to Text-Analysis ran through and at first, all the annotations (ca. 600) showed up in the overlay. I selected them all in order to save them as annotations (with duration), but only about half of them made it through. I retried and even less annotations showed up.
I retried with a different video (annotations without duration), and about one sixth of the annotations showed up, after I got logged out and logged in again.Feature: Data ViewsMilan GressMilan Gresshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1834Comments should only be loaded when displayed2022-11-30T15:57:08+01:00Koch, AntonComments should only be loaded when displayedUntil now, the annotation item would always send a request for comment annotations, no matter if they are visible or even existing.
I already added an if-statement that prevents loading annotations if `_related === 0` on the annotation....Until now, the annotation item would always send a request for comment annotations, no matter if they are visible or even existing.
I already added an if-statement that prevents loading annotations if `_related === 0` on the annotation.
Now I think even when there are comments on annotations, they only need to be loaded once the comment thread is expanded.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1833Filter has no effect on swimlane at the moment?2022-11-30T18:41:04+01:00Rittershaus, DavidFilter has no effect on swimlane at the moment?@maximilian.mittermei: I'm not really up to date anymore. I know we recognised that there is somehow no solid logic (filter versus adding "filtered" lanes etc.) but I thought that the filter still filters the annotations in the swimlane ...@maximilian.mittermei: I'm not really up to date anymore. I know we recognised that there is somehow no solid logic (filter versus adding "filtered" lanes etc.) but I thought that the filter still filters the annotations in the swimlane as well or am I wrong?https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1831Upload issues (maybe linked to being logged out automatically)2023-01-25T12:28:33+01:00Rittershaus, DavidUpload issues (maybe linked to being logged out automatically)I know this is very difficult to evaluate and reproduce but I still want to record it somehow, because users running into this issue really tend to give up using the software.
Nina, who is doing the documentation class together with me ...I know this is very difficult to evaluate and reproduce but I still want to record it somehow, because users running into this issue really tend to give up using the software.
Nina, who is doing the documentation class together with me at HZT can't manage to upload videos. They are not super large (around 400MB-1GB). The upload always fails with different files. It's hard to tell what's going on, because she has very little time and I can't really debug with her. Will try to take a closer look when I'm back to Berlin. However, using another device and browser didn't change anything for her (she tried it with her computer and both firefox+chrome and using her android phone). Files were normal mp4 videos. I'll ask her to send the files to me via WeTransfer, so I can maybe test it with her videos.
However, @stefanie.hampel also had trouble with uploading to hfmdk.vortanz.ai (bit longer videos but not too large) last week and reported that she also was logged out from time to time, but until now she can't tell if this was the problem when she tried to upload the files. Steffi will try to "reproduce" it and check the console and network tabs to see if she can find out what's going on.
I can also report that I'm sometimes logged out again and again. I will also try to find out more but it's really difficult to reproduce. Sometimes it's not happening at all, sometimes I'm kicked out frequently.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1830Low performance issues (on load)2023-01-25T12:28:21+01:00Rittershaus, DavidLow performance issues (on load)At the moment I often have some serious issues with loading time (working branches). If I open a video with c. 70 annotations it really takes some time to load them (see screenshot below). Firefox sometimes even prompts that the website ...At the moment I often have some serious issues with loading time (working branches). If I open a video with c. 70 annotations it really takes some time to load them (see screenshot below). Firefox sometimes even prompts that the website is slow and asks me if I want to stop it (hard to reproduce, but happened regulary when I was looking into the "Effect" videos with around 70-120 annotations in about 2 hour long videos).
Maybe it is mostly related to longer videos. I also noticed that loading video previews in the Timeline Viewer takes quite long if the videos are long (I guess it takes some time if they are ready to play?).
However, Helena also reported that in the previous system working with videos (hosted on our server) was much more fluent. She has a good direct comparison because she was first annotating videos in the other version for the ML training set and is now reviewing the ML results in vortanz version in a very similar annotation process.
![Bildschirmfoto_2022-11-30_um_13.00.00](/uploads/080a82fe30f9287e96b20eaa8d26dc93/Bildschirmfoto_2022-11-30_um_13.00.00.png)Koch, AntonKoch, Antonhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1822navigate video with arrow keys2022-11-29T20:38:05+01:00Milan Gressnavigate video with arrow keysAs a user, I would like to navigate the video with my arrow keys. Primarily because that is (at least for me) expected/conventional behavior from a video player (YouTube, Vimeo, etc.), but I also believe that it would be quite useful (an...As a user, I would like to navigate the video with my arrow keys. Primarily because that is (at least for me) expected/conventional behavior from a video player (YouTube, Vimeo, etc.), but I also believe that it would be quite useful (and much faster) for finding specific frames.
I feel like there is also a broader case for more keyboard navigation, (Jumping to next Annotation… toggling layers… start/stop video) but I would argue that for now arrow keys are definitely the least technical / most accessible
The open question would be about the timeframe that video should jump: We currently use `+/- 1 frame` and `+/- 1 Second` in the video player, so it probably should be one of those. (YouTube uses 15 Seconds, but I feel like that maybe less useful for our use case)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1818Add opportunity to correct tracked persons whose ID switched during the peopl...2022-11-25T18:03:25+01:00Hansen, ChristianAdd opportunity to correct tracked persons whose ID switched during the people detectionIt is possible that bad light in a video, leaving the scenario and coming back etc. causes an ID change, "Person 1" could become "Person 15" after a while. The user should be able to say "Okay Person 1 is also Person 15".It is possible that bad light in a video, leaving the scenario and coming back etc. causes an ID change, "Person 1" could become "Person 15" after a while. The user should be able to say "Okay Person 1 is also Person 15".Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1813Add Stop/Exit-Button for the Video Analysis Tools?2022-11-28T16:04:17+01:00Stefanie HampelAdd Stop/Exit-Button for the Video Analysis Tools?Maybe it would be helpful to add a Stop/Exit-Button which is close to the Video-Analysis Tools so that the process can be stopped in case that it takes too long, must be restarted or something like that? As far as I can see, it is now on...Maybe it would be helpful to add a Stop/Exit-Button which is close to the Video-Analysis Tools so that the process can be stopped in case that it takes too long, must be restarted or something like that? As far as I can see, it is now only possible via Files->Edit->Video Analysis, which might be a bit hard to find?Feature: Data ViewsMilan GressMilan Gresshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1795Post Annotator: add "select all annotations" to annotations stream on multipl...2022-11-21T14:35:16+01:00Hansen, ChristianPost Annotator: add "select all annotations" to annotations stream on multiple selectExample: I want to remove all transcribed annotations, so I filter them. At the moment I have to select every annotation from the filtered annotation list on my own. To have a "select all" checkbox would be a benefit now, see the files t...Example: I want to remove all transcribed annotations, so I filter them. At the moment I have to select every annotation from the filtered annotation list on my own. To have a "select all" checkbox would be a benefit now, see the files table in /files.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1788Files: remove preview image animation in table2022-11-18T12:55:49+01:00Hansen, ChristianFiles: remove preview image animation in tableWhen loading the page the preview images are animated. This is wrong, and it annoys me for a long time now.
<br /><br />
![Bildschirmaufnahme_2022-11-18_um_12.15.16](/uploads/7c660c59966684de60295c0a69aae8b4/Bildschirmaufnahme_2022-11-18...When loading the page the preview images are animated. This is wrong, and it annoys me for a long time now.
<br /><br />
![Bildschirmaufnahme_2022-11-18_um_12.15.16](/uploads/7c660c59966684de60295c0a69aae8b4/Bildschirmaufnahme_2022-11-18_um_12.15.16.mov)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1785Add general (video) image annotation (svg) option?2022-11-17T15:21:20+01:00Rittershaus, DavidAdd general (video) image annotation (svg) option?I stumbled over this one here: https://recogito.github.io/annotorious/
![Bildschirmfoto_2022-11-17_um_15.18.13](/uploads/a5c43163723c28acfed5c4e62169bc60/Bildschirmfoto_2022-11-17_um_15.18.13.png)
Further, there was some feedback form ...I stumbled over this one here: https://recogito.github.io/annotorious/
![Bildschirmfoto_2022-11-17_um_15.18.13](/uploads/a5c43163723c28acfed5c4e62169bc60/Bildschirmfoto_2022-11-17_um_15.18.13.png)
Further, there was some feedback form Cologne that it would be great to display comments on images in the Timeline Viewer next to the image (similar to the video annotations) and not below in the comment section. That does not really fit into our logic but might be solved by offering the possibility to annotate images.
It could be of interest for video images (one frame) as well as static images.
Not sure if this works with our timeline concept but it felt like the most recent changes (body parts) are somehow linked to that and maybe now it's not such a big thing. However, it's not a priority at the moment.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1780Does it make sense to change the start time of a live annotation if the annot...2022-11-17T12:42:44+01:00Hansen, ChristianDoes it make sense to change the start time of a live annotation if the annotations won't be moved as well?In my opinion this edit feature can be disabled to prevent misunderstandings if you do not read the text properly:
<br /><br />
![Bildschirmfoto_2022-11-16_um_19.55.50](/uploads/ac1ba386e7f27fc75a902a344a0cf3c3/Bildschirmfoto_2022-11-16_...In my opinion this edit feature can be disabled to prevent misunderstandings if you do not read the text properly:
<br /><br />
![Bildschirmfoto_2022-11-16_um_19.55.50](/uploads/ac1ba386e7f27fc75a902a344a0cf3c3/Bildschirmfoto_2022-11-16_um_19.55.50.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1779"Draw on video"/Sketch-annotation doesn't save selected bounding box2022-11-16T19:49:06+01:00Hansen, Christian"Draw on video"/Sketch-annotation doesn't save selected bounding box![Bildschirmfoto_2022-11-16_um_19.47.21](/uploads/70614ca9d9f26745507d898e8a8b93d2/Bildschirmfoto_2022-11-16_um_19.47.21.png)![Bildschirmfoto_2022-11-16_um_19.47.21](/uploads/70614ca9d9f26745507d898e8a8b93d2/Bildschirmfoto_2022-11-16_um_19.47.21.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1777"Add filter" button overlays "Comments" button from last annotation item2022-11-16T19:23:38+01:00Hansen, Christian"Add filter" button overlays "Comments" button from last annotation item![Bildschirmfoto_2022-11-16_um_19.21.04](/uploads/a9febfe64b8af2c83e645c57df522de8/Bildschirmfoto_2022-11-16_um_19.21.04.png)
<br />
<br />
![Bildschirmfoto_2022-11-16_um_19.21.12](/uploads/61623733af3956d56c996d6877d01e38/Bildschirmfoto...![Bildschirmfoto_2022-11-16_um_19.21.04](/uploads/a9febfe64b8af2c83e645c57df522de8/Bildschirmfoto_2022-11-16_um_19.21.04.png)
<br />
<br />
![Bildschirmfoto_2022-11-16_um_19.21.12](/uploads/61623733af3956d56c996d6877d01e38/Bildschirmfoto_2022-11-16_um_19.21.12.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1765Access pose visualisation2022-11-17T14:18:10+01:00Koch, AntonAccess pose visualisationYou can access the pose visualisation (once it exists) with:
```javascript
const fileUrl = `${process.env.API_HOST}/files/${encodeURIComponent(asset.blobId)}?pose=1`
const source = [{
src: fileUrl,
type: asse...You can access the pose visualisation (once it exists) with:
```javascript
const fileUrl = `${process.env.API_HOST}/files/${encodeURIComponent(asset.blobId)}?pose=1`
const source = [{
src: fileUrl,
type: asset.mimeType
}]
```
Note: This only works for new uploads/processings starting now. And the visualisation currently shows a mesh but will soon be switched to a skeleton. Audio is also still to be added.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1761Store min, max, average values from ML analysis for Timline Viewer2022-11-15T11:42:36+01:00Rittershaus, DavidStore min, max, average values from ML analysis for Timline ViewerNot a priority at the moment, just adding it to the feature list: I think it would be great to make use of the calculations in the Timeline Viewer as well for the bigger overview in the future. Would be interesting to see how many people...Not a priority at the moment, just adding it to the feature list: I think it would be great to make use of the calculations in the Timeline Viewer as well for the bigger overview in the future. Would be interesting to see how many people (max bounding boxes) are in the videos and how that changes over time. Also for movement dynamic such a zoomed out perspective could be interesting.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1756Feature: Create editable skeletons?2022-11-09T20:17:40+01:00Hansen, ChristianFeature: Create editable skeletons?Use case: I see a student has a body posture fault in his uploaded video. I activate the skeletons. Then I duplicate the skeleton with which I can edit/move joints or whole bodyparts to show the student what he or she did wrong. Save it ...Use case: I see a student has a body posture fault in his uploaded video. I activate the skeletons. Then I duplicate the skeleton with which I can edit/move joints or whole bodyparts to show the student what he or she did wrong. Save it as annotation or comment.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1754Annotations with "live" tag and "automatically transcribed" tag: how to deal ...2022-11-08T16:58:11+01:00Rittershaus, DavidAnnotations with "live" tag and "automatically transcribed" tag: how to deal with modification?Now annotations created via Live Annotator and automatically/software generated annotations get visible tag to make their origin/context of creation more transparent.
However, we do not track changes at the moment. If a software generat...Now annotations created via Live Annotator and automatically/software generated annotations get visible tag to make their origin/context of creation more transparent.
However, we do not track changes at the moment. If a software generated annotation is edited it will still appear as if it is one of those automatically generated ones. Not sure how we could solve that without introducing some sort of versioning.
Only simple idea that comes to my mind: if date of creation and last modified are not the same, this is somehow visible in the UI...https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1751Pass a job sequence2022-11-08T09:43:44+01:00Koch, AntonPass a job sequenceAllow passing a sequence of jobs to request a later stage that initially isn't available (e.g. Kinesphere) and needs to have other jobs run before it.Allow passing a sequence of jobs to request a later stage that initially isn't available (e.g. Kinesphere) and needs to have other jobs run before it.Feature: Data ViewsKoch, AntonKoch, Antonhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1750Distinguish job states in UI2022-11-18T19:04:22+01:00Koch, AntonDistinguish job states in UIThe jobs should now have 4 distinguishable states:
1. Waiting: There is no progress object
2. Started: There is a progress object, but percent is anything but 100
3. Completed: Progress percent equals 100
4. Errored: There is a message ...The jobs should now have 4 distinguishable states:
1. Waiting: There is no progress object
2. Started: There is a progress object, but percent is anything but 100
3. Completed: Progress percent equals 100
4. Errored: There is a message object on the progress objectFeature: Data Views