Systems Frontend issueshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues2022-11-24T15:50:39+01:00https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1741Create switchable skeleton overlay2022-11-24T15:50:39+01:00Hansen, ChristianCreate switchable skeleton overlayFeature: Data ViewsHansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1740Use pose estimation data (3D) to calculate and visualise movement data in swi...2023-05-02T17:55:07+02:00Rittershaus, DavidUse pose estimation data (3D) to calculate and visualise movement data in swimlaneThis motion data might be of interest:
* quantity of motion
* contraction index
* speed and/or acceleration
And for those it would be interesting to be able to render it a) per (selected) person or b) average for everyone in the video....This motion data might be of interest:
* quantity of motion
* contraction index
* speed and/or acceleration
And for those it would be interesting to be able to render it a) per (selected) person or b) average for everyone in the video.
I guess it first needs some calculation in the back end (@anton.koch), delivering those values (in combination with an ID?) to the front end where it can be used for graphs in the swimlane (@maximilian.mittermei).Feature: Data ViewsMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1739moving playhead-handel in the swimlane produces sometimes buggy bounding boxes2022-10-31T13:47:29+01:00Milan Gressmoving playhead-handel in the swimlane produces sometimes buggy bounding boxesThe real bug (wrong BB at current frame) is mostly non-breaking and easily fixed by a quick play/pause
![Kapture_2022-10-29_at_11.57.15](/uploads/9b23dca81e8c162c542182b8910cd773/Kapture_2022-10-29_at_11.57.15.mp4)The real bug (wrong BB at current frame) is mostly non-breaking and easily fixed by a quick play/pause
![Kapture_2022-10-29_at_11.57.15](/uploads/9b23dca81e8c162c542182b8910cd773/Kapture_2022-10-29_at_11.57.15.mp4)Feature: Swimlanehttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1738Remove unnecessary reloading of Annotations from Server on changes2022-10-27T14:58:21+02:00Mittermeier, MaximilianRemove unnecessary reloading of Annotations from Server on changesstore/postAnnotator/loadAnnotations() is only necessary once when opening postAnnotator to initially populate internal vuex-store with Annotations from server.
the .annotations computed property on post-annotate.vue automatically update...store/postAnnotator/loadAnnotations() is only necessary once when opening postAnnotator to initially populate internal vuex-store with Annotations from server.
the .annotations computed property on post-annotate.vue automatically updates when Annotations are added/edited/removed.Mittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1737Post Annotator does not load more than 50 Annotations2022-10-27T09:05:41+02:00Mittermeier, MaximilianPost Annotator does not load more than 50 AnnotationsMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1736Error "file not found" shows up as long as jobs "preview" and "standard-versi...2023-01-18T14:56:57+01:00Hansen, ChristianError "file not found" shows up as long as jobs "preview" and "standard-version" are runningEmpty `fileUrl` in MbDisplayFile.vue (l.157) causes this error. Error handling needs adjustment.
<br /><br />
![Bildschirmfoto_2022-10-26_um_17.47.38](/uploads/1e1a3ba2c57d1ae1fbbabeb6992a79b0/Bildschirmfoto_2022-10-26_um_17.47.38.png)Empty `fileUrl` in MbDisplayFile.vue (l.157) causes this error. Error handling needs adjustment.
<br /><br />
![Bildschirmfoto_2022-10-26_um_17.47.38](/uploads/1e1a3ba2c57d1ae1fbbabeb6992a79b0/Bildschirmfoto_2022-10-26_um_17.47.38.png)Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1735Timeline Viewer: optional "remove from files"-question if removing video from...2022-10-26T15:07:32+02:00Hansen, ChristianTimeline Viewer: optional "remove from files"-question if removing video from timeline?No extra navigating to /files needed after uploading a video accidentally:
<br /><br />
![Bildschirmfoto_2022-10-26_um_15.01.50](/uploads/58669a0997bffd4df5b9fda0debe8436/Bildschirmfoto_2022-10-26_um_15.01.50.png)No extra navigating to /files needed after uploading a video accidentally:
<br /><br />
![Bildschirmfoto_2022-10-26_um_15.01.50](/uploads/58669a0997bffd4df5b9fda0debe8436/Bildschirmfoto_2022-10-26_um_15.01.50.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1734Swimlane should offer one lane for each creator2022-11-14T13:41:10+01:00Rittershaus, DavidSwimlane should offer one lane for each creatorThis has already been implemented in the current app.motionbank.org version and should be re-introduced. Enabling one lane for each creator of annotation via lane manager would make sense.This has already been implemented in the current app.motionbank.org version and should be re-introduced. Enabling one lane for each creator of annotation via lane manager would make sense.Feature: SwimlaneMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1733Show "running process"-indicator in the video analyses menu2023-01-17T11:42:02+01:00Hansen, ChristianShow "running process"-indicator in the video analyses menuThe red one is a loading spinner.
<br /><br />
![Bildschirmfoto_2022-10-26_um_11.11.26](/uploads/9bc829c439707fd33a315daa7eb5cfc4/Bildschirmfoto_2022-10-26_um_11.11.26.png)The red one is a loading spinner.
<br /><br />
![Bildschirmfoto_2022-10-26_um_11.11.26](/uploads/9bc829c439707fd33a315daa7eb5cfc4/Bildschirmfoto_2022-10-26_um_11.11.26.png)Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1732Use transcript information in the front end2022-11-07T09:52:33+01:00Koch, AntonUse transcript information in the front endYou can query the transcript info (after the job is finished) by calling the `/analysis` endpoint as for a bounding box, but without the `time` param and instead specifying `type=transcript`. If data exists, it will return an array conta...You can query the transcript info (after the job is finished) by calling the `/analysis` endpoint as for a bounding box, but without the `time` param and instead specifying `type=transcript`. If data exists, it will return an array containing transcription items with a local timecode for the media file.Feature: Data ViewsMilan GressMilan Gresshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1731Use tracking information in front end2024-01-10T16:37:38+01:00Koch, AntonUse tracking information in front endThe tracking information is returned in place of the bounding box info once the tracking job completes.
You can currently distinguish a simple bounding box from a tracking bounding box like this:
```javascript
// Simple bounding box (4...The tracking information is returned in place of the bounding box info once the tracking job completes.
You can currently distinguish a simple bounding box from a tracking bounding box like this:
```javascript
// Simple bounding box (4x spatial, 2x param)
[x, y, w, h, confidence, class] = data
// Tracking bounding box (4x spatial, 1x param)
[x, y, w, h, id] = data
````
You can also explicitly add `type=bounding_box` or `type=tracking`, the former will query the Seldon Core service, and the latter will throw a 404 if no data exists.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1730Show analysis jobs in the frontend2022-11-07T09:55:08+01:00Koch, AntonShow analysis jobs in the frontendThe jobs `bounding_box`, `tracking` and `transcript` now show up in the `$jobs` array.The jobs `bounding_box`, `tracking` and `transcript` now show up in the `$jobs` array.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1729Analysis jobs should not block the annotation option2022-10-26T16:41:07+02:00Koch, AntonAnalysis jobs should not block the annotation optionAs the bounding_box, tracking and transcript jobs now run and are reported in the `$jobs` array, the media file cannot be annotated until all jobs are finished. This needs to be changed to only block annotation until `preview` and `stand...As the bounding_box, tracking and transcript jobs now run and are reported in the `$jobs` array, the media file cannot be annotated until all jobs are finished. This needs to be changed to only block annotation until `preview` and `standard-version` are done.Feature: Data ViewsHansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1728Jobs interval keeps polling2024-01-09T15:21:18+01:00Koch, AntonJobs interval keeps pollingJust noticed this yesterday, no info yet on if and how to reproduce.
The interval polling the jobs on the files page did not stop after the last job was complete and kept polling (job array was empty).Just noticed this yesterday, no info yet on if and how to reproduce.
The interval polling the jobs on the files page did not stop after the last job was complete and kept polling (job array was empty).https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1727Feature request: (visually) connect two or more bounding boxes2022-10-25T18:28:53+02:00Rittershaus, DavidFeature request: (visually) connect two or more bounding boxesThis was a question brought up by the students in Berlin when demonstrating the bounding boxes: if it is possible to connect two or more bounding boxes and to show these connections graphically (question was probably inspired by looking ...This was a question brought up by the students in Berlin when demonstrating the bounding boxes: if it is possible to connect two or more bounding boxes and to show these connections graphically (question was probably inspired by looking at Synchronous Objects). They clearly had in mind that those lines (and therefore also the bounding boxes) are still visible when the video is playing.
I find it interesting to think about what you would annotate: the relation between two or more persons, so in the end something like "person 1 is giving a cue to person 2" is modelled on the data level but also illustrated graphically on top of the video in the front end. Could also be of interest in the analytical work of the MACoDE students (maybe).
Maybe a bit beyond what's possible to achieve within the short remaining timeframe.
Center to center makes more sense compared to this quick mock up:
![Bildschirmfoto_2022-10-25_um_18.16.08](/uploads/d8c8a0dc3a6e104d0b42648c1c5ad558/Bildschirmfoto_2022-10-25_um_18.16.08.png)Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1726Feature request: BG substraction and video overlay ("trio generator")2022-10-25T18:14:39+02:00Rittershaus, DavidFeature request: BG substraction and video overlay ("trio generator")This also came up in Berlin, looking at the Motion Bank "trio generator" for Deborah Hay:
![Bildschirmfoto_2022-10-25_um_17.59.15](/uploads/273a147249f594dabe8b87e6a9dcecd0/Bildschirmfoto_2022-10-25_um_17.59.15.png)
https://vimeo.com/...This also came up in Berlin, looking at the Motion Bank "trio generator" for Deborah Hay:
![Bildschirmfoto_2022-10-25_um_17.59.15](/uploads/273a147249f594dabe8b87e6a9dcecd0/Bildschirmfoto_2022-10-25_um_17.59.15.png)
https://vimeo.com/29619105
Or also the 21 solos versions with the white background:
![1_h1EUZC7SDWmHs7PRh1FIRg](/uploads/e6576d405dd32f641d81a59c59a9fe10/1_h1EUZC7SDWmHs7PRh1FIRg.png)
Something similar seems to be of interest, but maybe the use case is too specific.
However, something that could match the DSHS use case with the comparison (accuracy/ voher-nachher) could make use of it and/or provide the better use case. Comparing two videos by watching them simultaneously is not really possible, because you can't keep an eye on the movement in both videos at the same time. Subtracting the background and overlaying them could be of interest here as well (although the alignment has to be solved as well).
Could potentially be also something that renders stick figures from pose estimation data.
In Berlin they would of course be interested in getting a newly rendered video out of it, which is something that we discussed critically in other contexts (we don't want to turn it into a video editing tool etc.)Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1725Feature request: render travel paths based on selected time range and boundin...2022-10-25T17:48:45+02:00Rittershaus, DavidFeature request: render travel paths based on selected time range and bounding boxesI was showing examples of the work with Deborah Hay + Between Us and talked about what ML can do, so the the students in Berlin started to come up with feature wishes.
I turned one of their ideas into a feature request (which I think i...I was showing examples of the work with Deborah Hay + Between Us and talked about what ML can do, so the the students in Berlin started to come up with feature wishes.
I turned one of their ideas into a feature request (which I think is not too far from things we've discussed before), which is based on the tracking.
1) First, you select a time range
2) Second, you select one or several persons based on the bounding boxes
3) A graphic with the travel paths of these people within the selected timerange is created and saved as an image annotation:
![Bildschirmfoto_2022-10-25_um_17.42.52](/uploads/ef0c2fb8cd11f59633f5fa8129f339cb/Bildschirmfoto_2022-10-25_um_17.42.52.png)
I'm aware that it won't bring the same results compared to using the tracking system and also talked about the limitations to the students, but we think that it might be worth to see if the results are good enough to make use of it in comparisons (like with Deborah Hay) and/or as output that is anyway used creatively outside of the annotation tool.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1724Offer download option for files2022-10-25T17:22:45+02:00Rittershaus, DavidOffer download option for filesActual usecase: draw on video has been used and the drawing is supposed to be used outside of the software.
Might also be relevant if you don't have your video files anymore that you uploaded (e.g. from your phone).Actual usecase: draw on video has been used and the drawing is supposed to be used outside of the software.
Might also be relevant if you don't have your video files anymore that you uploaded (e.g. from your phone).Hansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1723Cache AnnotationElements in AnnotationTrack2022-10-24T12:32:12+02:00Mittermeier, MaximilianCache AnnotationElements in AnnotationTrackMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1722Implement FrameGrid as svg pattern in RulerTrack2022-10-24T12:32:33+02:00Mittermeier, MaximilianImplement FrameGrid as svg pattern in RulerTrackMittermeier, MaximilianMittermeier, Maximilian