Systems Frontend issueshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues2024-01-09T15:21:18+01:00https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1728Jobs interval keeps polling2024-01-09T15:21:18+01:00Koch, AntonJobs interval keeps pollingJust noticed this yesterday, no info yet on if and how to reproduce.
The interval polling the jobs on the files page did not stop after the last job was complete and kept polling (job array was empty).Just noticed this yesterday, no info yet on if and how to reproduce.
The interval polling the jobs on the files page did not stop after the last job was complete and kept polling (job array was empty).https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1746fix polling of running $jobs in asset page2024-01-09T15:21:18+01:00Milan Gressfix polling of running $jobs in asset pageThe polling is currently only done for the update of the preview but not for the running $jobs so sometimes the updating doesn't work
https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1745#note_350456The polling is currently only done for the update of the preview but not for the running $jobs so sometimes the updating doesn't work
https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1745#note_350456https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1866Open "zoomed skeleton"-dialog after right click/long tap on bounding box?2024-01-09T15:04:55+01:00Hansen, ChristianOpen "zoomed skeleton"-dialog after right click/long tap on bounding box?When skeletons are available:
<br /><br />
![Bildschirmfoto_2022-12-09_um_18.00.35](/uploads/9df8f539ade16114a9e52c923b8c9330/Bildschirmfoto_2022-12-09_um_18.00.35.png)
<br />
leads to
<br />
![Bildschirmfoto_2022-12-09_um_18.02.51](/upl...When skeletons are available:
<br /><br />
![Bildschirmfoto_2022-12-09_um_18.00.35](/uploads/9df8f539ade16114a9e52c923b8c9330/Bildschirmfoto_2022-12-09_um_18.00.35.png)
<br />
leads to
<br />
![Bildschirmfoto_2022-12-09_um_18.02.51](/uploads/06e2eb6f05c219b39f7f759e1c0e979c/Bildschirmfoto_2022-12-09_um_18.02.51.png)
<br /><br />
Would reduce the amount of clicks to select a bodypart.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1860Post-annotator menus makeover (logic of filtering & displaying)2024-01-09T15:04:55+01:00Rittershaus, DavidPost-annotator menus makeover (logic of filtering & displaying)1. "Video Analysis" aka "Magic Menu": From my point of view it can (or even should) remain as simple as it is. The question here is more if it has some influence on the rest of the UI. If I toggle the bounding boxes or the pose recogitio...1. "Video Analysis" aka "Magic Menu": From my point of view it can (or even should) remain as simple as it is. The question here is more if it has some influence on the rest of the UI. If I toggle the bounding boxes or the pose recogition I can immediately see the video overlay but not the data visualisation in the swimlane. In the last system dev meeting we said that the siwmlane should autmatically show up with the corresponding data visualisation (for example: people detection --> bboxes are shown as overlays in the video + people count lane is shown as well).
2. Swimlane menu: I suppose that this menu should become simpler and we all agreed on that in the last system dev meeting.
First, in regard to the video analysis features I would suggest to use the same icons and also group lanes that you can toggle under each feature (e.g. Kinesphere --> 1. Follow selected person; 2. All IDs). These features could also be grouped under one main "data visualisation" menu item, which can also contain the annotation density lane. In the swimlane menu only those menu items should be visible that are already available. If kinesphere hasn't been processed yet it should not show up as an option in the swimlane menu.
Second, I would suggest to think about one menu item that is simply called "new custom lane" which opens an overlay where you can configure a new lane. This configuration could include the decision if the custom lane combines the annotations of all users or if it is split per user. It could also allow you to set a filter for this new lane.
But maybe @maximilian.mittermei can think of an even smarter solution based on the discussion in the last system dev meeting.
3. Filter menu: in general it could remain the same. The text filter should also have an effect for all lanes in the swim lane with annotations no matter if split by user or combined in one lane. If we allow people to create custom lanes with a text filter applied (see 2.), they should nevertheless be affected as well, so it's clear that the filter in the annotation list will always have an effect on all annotation lanes in the swimlane.
There is still an open question for me in regard to automatically generated annotations (at the moment transcript, but it might also include Kinesphere labels or others in the future). They always get a seperate lane by default but are always shown together with alll other annotations in the annotation list by default. So they are handled differently in the list and in the swimlane. But this is maybe another issue.
Here is screenshot with all 3 menus visible:
![Bildschirmfoto_2022-12-08_um_10.17.15](/uploads/d0bb1ca9deb5ddd50bff3e6323a34787/Bildschirmfoto_2022-12-08_um_10.17.15.png)Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1881redo the polling of jobs and batchjobs2024-01-09T15:02:01+01:00Milan Gressredo the polling of jobs and batchjobsMultiple problems:
currently, if there is a significant pause between the jobs, (but a batch job is still running) the polling stops because it thinks everything is done
There are two implementations of the polling (magic menu and file...Multiple problems:
currently, if there is a significant pause between the jobs, (but a batch job is still running) the polling stops because it thinks everything is done
There are two implementations of the polling (magic menu and files) which I find annoying, so probably it should move to the store? Or at the very least abstracted away into a general function.
Currently, it is implemented as a recursive function (seemed sensible at the time) but in fact if it is called from multiple sources then obviously multiple polling call stacks are created so likely a `setInterval()` with a clean start/stop interface makes more sense.
Oh and there should probably a very slow default polling mode for even if it thinks nothing happens/runs to avoid getting stuck in dysfunctional state.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1906Sort by filename causes error: "list.forEach is not a function" on files page2024-01-09T14:59:36+01:00Rittershaus, DavidSort by filename causes error: "list.forEach is not a function" on files pageClicking on the "filename" chip on the files page (sort by filename) causes the error "TypeError: list.forEach is not a function" (and sorting does not work).
There is a second case where this error popped up which I wasn't able to trac...Clicking on the "filename" chip on the files page (sort by filename) causes the error "TypeError: list.forEach is not a function" (and sorting does not work).
There is a second case where this error popped up which I wasn't able to trace sofar because it only happened a few times and I wasn't able to debug. In that case the file list was not listing the existing files (looked as if no files were uploaded yet). Happened 2-3 times on file page and 2 times when I was trying to add files to the timeline (via "add file" menu). Might be the same issue, at least in both cases the same error message showed up. Files are listed again after several reloads.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2210magic menu: "3d" button is missing suddenly2024-01-09T12:48:48+01:00Hansen, Christianmagic menu: "3d" button is missing suddenly![Bildschirmfoto_2023-12-19_um_17.35.39](/uploads/c202da6d87b82be0adc65c6bea0b4ed8/Bildschirmfoto_2023-12-19_um_17.35.39.png)![Bildschirmfoto_2023-12-19_um_17.35.39](/uploads/c202da6d87b82be0adc65c6bea0b4ed8/Bildschirmfoto_2023-12-19_um_17.35.39.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2206Dark mode: darken text in #ffffff a little bit2023-12-15T13:14:20+01:00Hansen, ChristianDark mode: darken text in #ffffff a little bitAt the moment the text in #ffffff on dark background is screaming in the users face, so it has to be darken a very little bit:
<br /><br />![Bildschirmfoto_2023-12-15_um_13.10.19](/uploads/581a3b4702bb2305251fbebd00953e89/Bildschirmfoto_...At the moment the text in #ffffff on dark background is screaming in the users face, so it has to be darken a very little bit:
<br /><br />![Bildschirmfoto_2023-12-15_um_13.10.19](/uploads/581a3b4702bb2305251fbebd00953e89/Bildschirmfoto_2023-12-15_um_13.10.19.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2200input field -> voice input: add "running process" indicator (spinner) after s...2023-12-13T14:53:08+01:00Hansen, Christianinput field -> voice input: add "running process" indicator (spinner) after stopping a record until record is readySometimes between record stop and having access to this record in the input field (= submit/clear buttons appear) some seconds go by without any indicator, that a converting process is running in the background. This confused me several ...Sometimes between record stop and having access to this record in the input field (= submit/clear buttons appear) some seconds go by without any indicator, that a converting process is running in the background. This confused me several time, because I thought the record broke in some way. That's why we need an "something is happening" indicator as done in the magic menu.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2197after rewrite: replace icon for "speech to text"2023-11-28T14:46:17+01:00Hansen, Christianafter rewrite: replace icon for "speech to text"In quasar v1.x some google icons aren't available, so the "speech to text" icon. Should be replaced after updating.
![Bildschirmfoto_2023-11-28_um_14.19.12](/uploads/aff19e232a48c97a5688ebb002722848/Bildschirmfoto_2023-11-28_um_14.19.12....In quasar v1.x some google icons aren't available, so the "speech to text" icon. Should be replaced after updating.
![Bildschirmfoto_2023-11-28_um_14.19.12](/uploads/aff19e232a48c97a5688ebb002722848/Bildschirmfoto_2023-11-28_um_14.19.12.png)
![Bildschirmfoto_2023-11-28_um_14.18.57](/uploads/b6ca64be3dd9ff1d3e9a7ad74a3eff49/Bildschirmfoto_2023-11-28_um_14.18.57.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2015Implement movement qualities2023-11-20T15:12:19+01:00Koch, AntonImplement movement qualitiesIf you now run the "pose" batch target, then "pose-analysis" will quietly be run afterwards.
The analysis creates 1024 buckets, like for the statistics and then contains:
```javascript
const poseAnalysis = [
{
"1.0": {
// C...If you now run the "pose" batch target, then "pose-analysis" will quietly be run afterwards.
The analysis creates 1024 buckets, like for the statistics and then contains:
```javascript
const poseAnalysis = [
{
"1.0": {
// Contraction Index - Volume of 3D bounding box around points divided by volume of convex hull around points (Mean for bucket)
ci: 0.2728578488838945,
// Quantity of Motion - Area of last convex hull around points divided by area of current convex hull around points (Mean for bucket)
qom: 0.5128582826100107,
// Travel - Distance X/Z-plane in units per frame (Mean for bucket)
tr: 0.005136737396878106
}
}
]
```
The analysis can be retrieved using type `pose-analysis`.Mittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2188transcription strings have double spaces between words2023-11-13T15:26:16+01:00Hansen, Christiantranscription strings have double spaces between words![Bildschirmfoto_2023-11-10_um_16.06.53](/uploads/cd57c546e1789140825e94cfc338b16d/Bildschirmfoto_2023-11-10_um_16.06.53.png)
<br /><br />
use single spaces instead![Bildschirmfoto_2023-11-10_um_16.06.53](/uploads/cd57c546e1789140825e94cfc338b16d/Bildschirmfoto_2023-11-10_um_16.06.53.png)
<br /><br />
use single spaces insteadhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2186Add segementation mode to post annotator2023-11-08T09:42:12+01:00Rittershaus, DavidAdd segementation mode to post annotatorThis came up when Helena was using the post annotator for the "inter-rater reliability test" where she wanted to label periodic segements of the video of the exact same length. There was also some feedback of more "pro" users from the di...This came up when Helena was using the post annotator for the "inter-rater reliability test" where she wanted to label periodic segements of the video of the exact same length. There was also some feedback of more "pro" users from the digital humanities field who were wondering why annotations do not have a length by default.
From what I can tell, two different ways of implementing better options for rigid segementation could be helpful:
1) Option to segment the video in a predefined interval (e.g. 1 second). The swimlane then offers "empty" bars. If you select one and add an annotations via input field, you add an annotation which has the start and end time of the selected segment. Visually I'm thinking about something similar to the kinesphere visualisation in the swimlane.
2) Option to switch to a way of annotating that is still more "free". However, you will add annotations with duration by default. The duration is always from the start time to the start time of the next annotation or to the end of the video if there is no other annotation behind the one you add.
Not sure how to best implement this without introducing too much complexity to the UI. However, since these are more "pro" features, they might be a little bit more hidden.
@maximilian.mittermei: do you think that this is more for the rewirte? There is not really a use case within the vortanz project at the moment, so the priority is not very high. However, it would be great to test and improve it.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2174Bounding boxes: add possibility to select more than one bounding box at once?2023-10-25T16:53:56+02:00Hansen, ChristianBounding boxes: add possibility to select more than one bounding box at once?Example "Effect": "Person A and Person B are looking at each other"Example "Effect": "Person A and Person B are looking at each other"https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2180Abstraction of skeleton in series2023-10-25T16:41:19+02:00Hansen, ChristianAbstraction of skeleton in seriesAdd optional, customizable skeleton abstraction feature (as seen in the original Mr. Griddle) to series player.Add optional, customizable skeleton abstraction feature (as seen in the original Mr. Griddle) to series player.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2176add loading-skeleton for videos2023-10-11T12:00:53+02:00Hansen, Christianadd loading-skeleton for videos![Bildschirmfoto_2023-10-11_um_11.59.01](/uploads/084c06fbfbb837c6c412bde222ecc4c6/Bildschirmfoto_2023-10-11_um_11.59.01.png)![Bildschirmfoto_2023-10-11_um_11.59.01](/uploads/084c06fbfbb837c6c412bde222ecc4c6/Bildschirmfoto_2023-10-11_um_11.59.01.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2154Rewrite: Add OpenID authentication2023-10-04T13:00:25+02:00Koch, AntonRewrite: Add OpenID authenticationFrontend RewriteKoch, AntonKoch, Antonhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2136Keep selected bodypart in skeleton series?2023-09-21T11:55:33+02:00Hansen, ChristianKeep selected bodypart in skeleton series?Like this:
<br /><br />
![Bildschirmfoto_2023-09-21_um_11.54.25](/uploads/ec83cd6cd7679e4e8fcbb1b51cb0a36c/Bildschirmfoto_2023-09-21_um_11.54.25.png)Like this:
<br /><br />
![Bildschirmfoto_2023-09-21_um_11.54.25](/uploads/ec83cd6cd7679e4e8fcbb1b51cb0a36c/Bildschirmfoto_2023-09-21_um_11.54.25.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2128live session preview image needs makeover2023-09-11T16:01:19+02:00Hansen, Christianlive session preview image needs makeoverAt the moment a "No Thumbnail" shows up as preview image, I think at least using an icon (or a "LIVE"-label/"**"/...) would be better:
<br /><br />![Bildschirmfoto_2023-09-11_um_15.07.05](/uploads/9799f72eabe4b06e59cee041bbfe5020/Bildsch...At the moment a "No Thumbnail" shows up as preview image, I think at least using an icon (or a "LIVE"-label/"**"/...) would be better:
<br /><br />![Bildschirmfoto_2023-09-11_um_15.07.05](/uploads/9799f72eabe4b06e59cee041bbfe5020/Bildschirmfoto_2023-09-11_um_15.07.05.png)
<br /><br />![Bildschirmfoto_2023-09-11_um_16.00.32](/uploads/661b073130aec422786db43ebf60a4b1/Bildschirmfoto_2023-09-11_um_16.00.32.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2116File page does not update after file got deleted2023-09-11T13:32:24+02:00Rittershaus, DavidFile page does not update after file got deletedPage refresh is required. If you refresh too early not all selected files are deleted (if multiple files were selected). No confirmation that files were successfully deleted (like with annotations on the timeline etc).Page refresh is required. If you refresh too early not all selected files are deleted (if multiple files were selected). No confirmation that files were successfully deleted (like with annotations on the timeline etc).