Systems Frontend issueshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues2022-11-17T12:42:44+01:00https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1780Does it make sense to change the start time of a live annotation if the annot...2022-11-17T12:42:44+01:00Hansen, ChristianDoes it make sense to change the start time of a live annotation if the annotations won't be moved as well?In my opinion this edit feature can be disabled to prevent misunderstandings if you do not read the text properly:
<br /><br />
![Bildschirmfoto_2022-11-16_um_19.55.50](/uploads/ac1ba386e7f27fc75a902a344a0cf3c3/Bildschirmfoto_2022-11-16_...In my opinion this edit feature can be disabled to prevent misunderstandings if you do not read the text properly:
<br /><br />
![Bildschirmfoto_2022-11-16_um_19.55.50](/uploads/ac1ba386e7f27fc75a902a344a0cf3c3/Bildschirmfoto_2022-11-16_um_19.55.50.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1779"Draw on video"/Sketch-annotation doesn't save selected bounding box2022-11-16T19:49:06+01:00Hansen, Christian"Draw on video"/Sketch-annotation doesn't save selected bounding box![Bildschirmfoto_2022-11-16_um_19.47.21](/uploads/70614ca9d9f26745507d898e8a8b93d2/Bildschirmfoto_2022-11-16_um_19.47.21.png)![Bildschirmfoto_2022-11-16_um_19.47.21](/uploads/70614ca9d9f26745507d898e8a8b93d2/Bildschirmfoto_2022-11-16_um_19.47.21.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1777"Add filter" button overlays "Comments" button from last annotation item2022-11-16T19:23:38+01:00Hansen, Christian"Add filter" button overlays "Comments" button from last annotation item![Bildschirmfoto_2022-11-16_um_19.21.04](/uploads/a9febfe64b8af2c83e645c57df522de8/Bildschirmfoto_2022-11-16_um_19.21.04.png)
<br />
<br />
![Bildschirmfoto_2022-11-16_um_19.21.12](/uploads/61623733af3956d56c996d6877d01e38/Bildschirmfoto...![Bildschirmfoto_2022-11-16_um_19.21.04](/uploads/a9febfe64b8af2c83e645c57df522de8/Bildschirmfoto_2022-11-16_um_19.21.04.png)
<br />
<br />
![Bildschirmfoto_2022-11-16_um_19.21.12](/uploads/61623733af3956d56c996d6877d01e38/Bildschirmfoto_2022-11-16_um_19.21.12.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1765Access pose visualisation2022-11-17T14:18:10+01:00Koch, AntonAccess pose visualisationYou can access the pose visualisation (once it exists) with:
```javascript
const fileUrl = `${process.env.API_HOST}/files/${encodeURIComponent(asset.blobId)}?pose=1`
const source = [{
src: fileUrl,
type: asse...You can access the pose visualisation (once it exists) with:
```javascript
const fileUrl = `${process.env.API_HOST}/files/${encodeURIComponent(asset.blobId)}?pose=1`
const source = [{
src: fileUrl,
type: asset.mimeType
}]
```
Note: This only works for new uploads/processings starting now. And the visualisation currently shows a mesh but will soon be switched to a skeleton. Audio is also still to be added.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1761Store min, max, average values from ML analysis for Timline Viewer2022-11-15T11:42:36+01:00Rittershaus, DavidStore min, max, average values from ML analysis for Timline ViewerNot a priority at the moment, just adding it to the feature list: I think it would be great to make use of the calculations in the Timeline Viewer as well for the bigger overview in the future. Would be interesting to see how many people...Not a priority at the moment, just adding it to the feature list: I think it would be great to make use of the calculations in the Timeline Viewer as well for the bigger overview in the future. Would be interesting to see how many people (max bounding boxes) are in the videos and how that changes over time. Also for movement dynamic such a zoomed out perspective could be interesting.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1756Feature: Create editable skeletons?2022-11-09T20:17:40+01:00Hansen, ChristianFeature: Create editable skeletons?Use case: I see a student has a body posture fault in his uploaded video. I activate the skeletons. Then I duplicate the skeleton with which I can edit/move joints or whole bodyparts to show the student what he or she did wrong. Save it ...Use case: I see a student has a body posture fault in his uploaded video. I activate the skeletons. Then I duplicate the skeleton with which I can edit/move joints or whole bodyparts to show the student what he or she did wrong. Save it as annotation or comment.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1754Annotations with "live" tag and "automatically transcribed" tag: how to deal ...2022-11-08T16:58:11+01:00Rittershaus, DavidAnnotations with "live" tag and "automatically transcribed" tag: how to deal with modification?Now annotations created via Live Annotator and automatically/software generated annotations get visible tag to make their origin/context of creation more transparent.
However, we do not track changes at the moment. If a software generat...Now annotations created via Live Annotator and automatically/software generated annotations get visible tag to make their origin/context of creation more transparent.
However, we do not track changes at the moment. If a software generated annotation is edited it will still appear as if it is one of those automatically generated ones. Not sure how we could solve that without introducing some sort of versioning.
Only simple idea that comes to my mind: if date of creation and last modified are not the same, this is somehow visible in the UI...https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1751Pass a job sequence2022-11-08T09:43:44+01:00Koch, AntonPass a job sequenceAllow passing a sequence of jobs to request a later stage that initially isn't available (e.g. Kinesphere) and needs to have other jobs run before it.Allow passing a sequence of jobs to request a later stage that initially isn't available (e.g. Kinesphere) and needs to have other jobs run before it.Feature: Data ViewsKoch, AntonKoch, Antonhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1750Distinguish job states in UI2022-11-18T19:04:22+01:00Koch, AntonDistinguish job states in UIThe jobs should now have 4 distinguishable states:
1. Waiting: There is no progress object
2. Started: There is a progress object, but percent is anything but 100
3. Completed: Progress percent equals 100
4. Errored: There is a message ...The jobs should now have 4 distinguishable states:
1. Waiting: There is no progress object
2. Started: There is a progress object, but percent is anything but 100
3. Completed: Progress percent equals 100
4. Errored: There is a message object on the progress objectFeature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1746fix polling of running $jobs in asset page2024-01-09T15:21:18+01:00Milan Gressfix polling of running $jobs in asset pageThe polling is currently only done for the update of the preview but not for the running $jobs so sometimes the updating doesn't work
https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1745#note_350456The polling is currently only done for the update of the preview but not for the running $jobs so sometimes the updating doesn't work
https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1745#note_350456https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1739moving playhead-handel in the swimlane produces sometimes buggy bounding boxes2022-10-31T13:47:29+01:00Milan Gressmoving playhead-handel in the swimlane produces sometimes buggy bounding boxesThe real bug (wrong BB at current frame) is mostly non-breaking and easily fixed by a quick play/pause
![Kapture_2022-10-29_at_11.57.15](/uploads/9b23dca81e8c162c542182b8910cd773/Kapture_2022-10-29_at_11.57.15.mp4)The real bug (wrong BB at current frame) is mostly non-breaking and easily fixed by a quick play/pause
![Kapture_2022-10-29_at_11.57.15](/uploads/9b23dca81e8c162c542182b8910cd773/Kapture_2022-10-29_at_11.57.15.mp4)Feature: Swimlanehttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1735Timeline Viewer: optional "remove from files"-question if removing video from...2022-10-26T15:07:32+02:00Hansen, ChristianTimeline Viewer: optional "remove from files"-question if removing video from timeline?No extra navigating to /files needed after uploading a video accidentally:
<br /><br />
![Bildschirmfoto_2022-10-26_um_15.01.50](/uploads/58669a0997bffd4df5b9fda0debe8436/Bildschirmfoto_2022-10-26_um_15.01.50.png)No extra navigating to /files needed after uploading a video accidentally:
<br /><br />
![Bildschirmfoto_2022-10-26_um_15.01.50](/uploads/58669a0997bffd4df5b9fda0debe8436/Bildschirmfoto_2022-10-26_um_15.01.50.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1731Use tracking information in front end2024-01-10T16:37:38+01:00Koch, AntonUse tracking information in front endThe tracking information is returned in place of the bounding box info once the tracking job completes.
You can currently distinguish a simple bounding box from a tracking bounding box like this:
```javascript
// Simple bounding box (4...The tracking information is returned in place of the bounding box info once the tracking job completes.
You can currently distinguish a simple bounding box from a tracking bounding box like this:
```javascript
// Simple bounding box (4x spatial, 2x param)
[x, y, w, h, confidence, class] = data
// Tracking bounding box (4x spatial, 1x param)
[x, y, w, h, id] = data
````
You can also explicitly add `type=bounding_box` or `type=tracking`, the former will query the Seldon Core service, and the latter will throw a 404 if no data exists.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1728Jobs interval keeps polling2024-01-09T15:21:18+01:00Koch, AntonJobs interval keeps pollingJust noticed this yesterday, no info yet on if and how to reproduce.
The interval polling the jobs on the files page did not stop after the last job was complete and kept polling (job array was empty).Just noticed this yesterday, no info yet on if and how to reproduce.
The interval polling the jobs on the files page did not stop after the last job was complete and kept polling (job array was empty).https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1727Feature request: (visually) connect two or more bounding boxes2022-10-25T18:28:53+02:00Rittershaus, DavidFeature request: (visually) connect two or more bounding boxesThis was a question brought up by the students in Berlin when demonstrating the bounding boxes: if it is possible to connect two or more bounding boxes and to show these connections graphically (question was probably inspired by looking ...This was a question brought up by the students in Berlin when demonstrating the bounding boxes: if it is possible to connect two or more bounding boxes and to show these connections graphically (question was probably inspired by looking at Synchronous Objects). They clearly had in mind that those lines (and therefore also the bounding boxes) are still visible when the video is playing.
I find it interesting to think about what you would annotate: the relation between two or more persons, so in the end something like "person 1 is giving a cue to person 2" is modelled on the data level but also illustrated graphically on top of the video in the front end. Could also be of interest in the analytical work of the MACoDE students (maybe).
Maybe a bit beyond what's possible to achieve within the short remaining timeframe.
Center to center makes more sense compared to this quick mock up:
![Bildschirmfoto_2022-10-25_um_18.16.08](/uploads/d8c8a0dc3a6e104d0b42648c1c5ad558/Bildschirmfoto_2022-10-25_um_18.16.08.png)Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1726Feature request: BG substraction and video overlay ("trio generator")2022-10-25T18:14:39+02:00Rittershaus, DavidFeature request: BG substraction and video overlay ("trio generator")This also came up in Berlin, looking at the Motion Bank "trio generator" for Deborah Hay:
![Bildschirmfoto_2022-10-25_um_17.59.15](/uploads/273a147249f594dabe8b87e6a9dcecd0/Bildschirmfoto_2022-10-25_um_17.59.15.png)
https://vimeo.com/...This also came up in Berlin, looking at the Motion Bank "trio generator" for Deborah Hay:
![Bildschirmfoto_2022-10-25_um_17.59.15](/uploads/273a147249f594dabe8b87e6a9dcecd0/Bildschirmfoto_2022-10-25_um_17.59.15.png)
https://vimeo.com/29619105
Or also the 21 solos versions with the white background:
![1_h1EUZC7SDWmHs7PRh1FIRg](/uploads/e6576d405dd32f641d81a59c59a9fe10/1_h1EUZC7SDWmHs7PRh1FIRg.png)
Something similar seems to be of interest, but maybe the use case is too specific.
However, something that could match the DSHS use case with the comparison (accuracy/ voher-nachher) could make use of it and/or provide the better use case. Comparing two videos by watching them simultaneously is not really possible, because you can't keep an eye on the movement in both videos at the same time. Subtracting the background and overlaying them could be of interest here as well (although the alignment has to be solved as well).
Could potentially be also something that renders stick figures from pose estimation data.
In Berlin they would of course be interested in getting a newly rendered video out of it, which is something that we discussed critically in other contexts (we don't want to turn it into a video editing tool etc.)Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1725Feature request: render travel paths based on selected time range and boundin...2022-10-25T17:48:45+02:00Rittershaus, DavidFeature request: render travel paths based on selected time range and bounding boxesI was showing examples of the work with Deborah Hay + Between Us and talked about what ML can do, so the the students in Berlin started to come up with feature wishes.
I turned one of their ideas into a feature request (which I think i...I was showing examples of the work with Deborah Hay + Between Us and talked about what ML can do, so the the students in Berlin started to come up with feature wishes.
I turned one of their ideas into a feature request (which I think is not too far from things we've discussed before), which is based on the tracking.
1) First, you select a time range
2) Second, you select one or several persons based on the bounding boxes
3) A graphic with the travel paths of these people within the selected timerange is created and saved as an image annotation:
![Bildschirmfoto_2022-10-25_um_17.42.52](/uploads/ef0c2fb8cd11f59633f5fa8129f339cb/Bildschirmfoto_2022-10-25_um_17.42.52.png)
I'm aware that it won't bring the same results compared to using the tracking system and also talked about the limitations to the students, but we think that it might be worth to see if the results are good enough to make use of it in comparisons (like with Deborah Hay) and/or as output that is anyway used creatively outside of the annotation tool.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1723Cache AnnotationElements in AnnotationTrack2022-10-24T12:32:12+02:00Mittermeier, MaximilianCache AnnotationElements in AnnotationTrackMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1722Implement FrameGrid as svg pattern in RulerTrack2022-10-24T12:32:33+02:00Mittermeier, MaximilianImplement FrameGrid as svg pattern in RulerTrackMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1720Swimlane performance needs to be optimized for mobile2022-10-25T13:23:31+02:00Mittermeier, MaximilianSwimlane performance needs to be optimized for mobileZooming and navigating the Swimlane is fairly low-fps on mobile, especially when zoomed in far enough for the framebased grid to be visible.
Profiling shows the following distribution of spent time for dragging the Swimlane:
- 72% - Ev...Zooming and navigating the Swimlane is fairly low-fps on mobile, especially when zoomed in far enough for the framebased grid to be visible.
Profiling shows the following distribution of spent time for dragging the Swimlane:
- 72% - EventHandler for the drag
- 13% - Painting
- 5,3% - Styles
- 3,5% - Reflow
Time within EventHandler is split between (% of total Time)
- 43% - Updating the Ruler Grid/Ticks
- 28% - Updating the AnnotationElements
Within Updating Ruler Grid (% of total Time)
- 23% - buildRulerGridSvgElement > toFormat() (creating the label-string for Ruler Ticks)
- 4,4% - Node.removeChild
Within Updating AnnotationElements
- 25% - buildAnnotationElements > mostly spent on fromISO() and toDuration()
- 3,5% - arrangeAnnotationElements > mostly spent on fromISO()
![Screenshot_2022-10-24_at_12.10.42](/uploads/61ab1239e12207ed444276e6e32b532f/Screenshot_2022-10-24_at_12.10.42.png)Feature: SwimlaneMittermeier, MaximilianMittermeier, Maximilian