Systems Frontend issueshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues2022-11-16T14:43:11+01:00https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1768Update MongoDB aggregation pipeline2022-11-16T14:43:11+01:00Koch, AntonUpdate MongoDB aggregation pipelinehttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1767Update model in backend2022-11-16T14:42:59+01:00Koch, AntonUpdate model in backendhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1766Migrate target.selector to Array2022-11-17T14:18:41+01:00Koch, AntonMigrate target.selector to ArrayTo support the coexistence of a temporal fragment selection with an SVG selector, `target.selector` needs to become an Array.To support the coexistence of a temporal fragment selection with an SVG selector, `target.selector` needs to become an Array.Feature: Data ViewsMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1764Setting selector types2022-11-23T19:14:13+01:00Koch, AntonSetting selector typesSelectors now have to be created either like this:
```javascript
{
type: 'FragmentSelector',
conformsTo: 'http://www.w3.org/TR/media-frags/'
value: YOUR_SELECTOR_VALUE
}
```
or the new SVG version:
```javascript
{
type: 'SvgS...Selectors now have to be created either like this:
```javascript
{
type: 'FragmentSelector',
conformsTo: 'http://www.w3.org/TR/media-frags/'
value: YOUR_SELECTOR_VALUE
}
```
or the new SVG version:
```javascript
{
type: 'SvgSelector',
value: YOUR_SELECTOR_VALUE // <-- inline SVG code like '<svg>...</svg>'
}
```Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1763Always check for selector type2022-11-17T14:21:25+01:00Koch, AntonAlways check for selector typeSelector types are now going to be either "FragmentSelector" for the currently used variant or "SvgSelector" for the body part overlays.
This needs to be checked everywhere where selectors are used (e.g. parsing, modifying) and must be ...Selector types are now going to be either "FragmentSelector" for the currently used variant or "SvgSelector" for the body part overlays.
This needs to be checked everywhere where selectors are used (e.g. parsing, modifying) and must be explicitly set on the annotation object on creation.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1762Refactor DetailedAnnotationView2022-11-16T13:16:35+01:00Koch, AntonRefactor DetailedAnnotationViewThe component uses the term "fragmentSelectorType", which distinguishes range from point.
This should be renamed to fragmentSelectorValueType (also in constants.js) to be clear that it refers to a value and not the selector.The component uses the term "fragmentSelectorType", which distinguishes range from point.
This should be renamed to fragmentSelectorValueType (also in constants.js) to be clear that it refers to a value and not the selector.Feature: SwimlaneMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1760Integrate pose data2022-11-15T19:40:13+01:00Koch, AntonIntegrate pose dataThe 2D pose data can now be fetched like the bounding boxes, but with the `type=pp_2d` parameter supplied.The 2D pose data can now be fetched like the bounding boxes, but with the `type=pp_2d` parameter supplied.Feature: Data ViewsHansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1759Show zoomed skeleton in popup after right click?2022-11-15T19:40:45+01:00Hansen, ChristianShow zoomed skeleton in popup after right click?I'm not sure how important this is, but bodyparts from small skeletons could be hard to reach on mobiles:
<br /><br />
![Bildschirmfoto_2022-11-10_um_13.01.30](/uploads/3d8c48f7ce993229b2c5499fada10669/Bildschirmfoto_2022-11-10_um_13.01....I'm not sure how important this is, but bodyparts from small skeletons could be hard to reach on mobiles:
<br /><br />
![Bildschirmfoto_2022-11-10_um_13.01.30](/uploads/3d8c48f7ce993229b2c5499fada10669/Bildschirmfoto_2022-11-10_um_13.01.30.png)
<br /><br /><br />
Maybe we could open a dialog/popup on right-click/long tap with an enlarged version to have a better accessibility to the bodyparts?
<br /><br />
![Bildschirmfoto_2022-11-10_um_13.01.36](/uploads/91b2a2bb56fab3e76907a324c9e4e8f9/Bildschirmfoto_2022-11-10_um_13.01.36.png)Feature: Data ViewsHansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1758change bodyparts as mentioned by david2022-11-10T12:39:00+01:00Hansen, Christianchange bodyparts as mentioned by davidhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1757clear "selected bodypart" when asset time changes2022-11-10T16:51:42+01:00Hansen, Christianclear "selected bodypart" when asset time changeshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1755Swimlane: software generated annotations should also get a separate track2022-11-14T13:40:19+01:00Rittershaus, DavidSwimlane: software generated annotations should also get a separate track@maximilian.mittermei: maybe this could be considered in #1734? Since adding an automatic transcipt will make it more difficult to keep an overview we should make use of the possibilities of the swimlane and might handle a "generator" (s...@maximilian.mittermei: maybe this could be considered in #1734? Since adding an automatic transcipt will make it more difficult to keep an overview we should make use of the possibilities of the swimlane and might handle a "generator" (software; whisper) like a "creator" with a seperate lane?Feature: SwimlaneMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1753rethink filter for speech-to-text annotations2023-06-28T16:35:15+02:00Milan Gressrethink filter for speech-to-text annotationsFeature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1752Transcription only provides the transcript for the first 30 seconds or so2022-11-08T17:36:01+01:00Rittershaus, DavidTranscription only provides the transcript for the first 30 seconds or so@anton.koch No matter for which video I start the transcription, I only get the transcipt for the first 30 seconds at the moment.Hasn't been the case last week.@anton.koch No matter for which video I start the transcription, I only get the transcipt for the first 30 seconds at the moment.Hasn't been the case last week.Milan GressMilan Gresshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1749handle failed analyses in frontend2022-11-08T17:10:04+01:00Milan Gresshandle failed analyses in frontendI just found out that the analyses could fail :D :dagger: :cry:
→ I deleted `tracking` before `pose` finished, but the frontend shows `pose` as running
`progress.message = "Analysis failed"` should be surfaced
```js
{
"creator": {
...I just found out that the analyses could fail :D :dagger: :cry:
→ I deleted `tracking` before `pose` finished, but the frontend shows `pose` as running
`progress.message = "Analysis failed"` should be surfaced
```js
{
"creator": {
"name": "Milan 🫠 Gress",
"id": "http://id.motionbank.org/users/e43e0a07-91ae-4589-a9ad-c425ae7da706"
},
"config": {
"path": "pose"
},
"data": {
"asset": {
"creator": {
"name": "Milan 🫠 Gress",
"id": "http://id.motionbank.org/users/e43e0a07-91ae-4589-a9ad-c425ae7da706"
},
"filename": "ITB_1113IF_006_2_01.mp4",
"mimeType": "video/mp4",
"size": 11672433,
"tags": [],
"blobId": "e43e0a07-91ae-4589-a9ad-c425ae7da706/cfffad136c348bf6e643c9841af89478.mp4",
"_acl": [],
"created": "2022-09-01T22:28:53.830Z",
"modified": "2022-09-01T22:28:53.830Z",
"__v": 0,
"_creatorIds": [
"http://id.motionbank.org/users/e43e0a07-91ae-4589-a9ad-c425ae7da706",
"http://id.motionbank.org/users/e43e0a07-91ae-4589-a9ad-c425ae7da706",
"http://id.motionbank.org/users/e43e0a07-91ae-4589-a9ad-c425ae7da706"
],
"id": "http://id.motionbank.org/assets/17dbf19a-d732-4d4c-9bc1-955cb62dbe9e"
},
"assetUri": "http://10.200.14.86:9000/vortanz-beta/e43e0a07-91ae-4589-a9ad-c425ae7da706/cfffad136c348bf6e643c9841af89478-standard.mp4?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=minio%2F20221107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20221107T190248Z&X-Amz-Expires=86400&X-Amz-SignedHeaders=host&X-Amz-Signature=7cb58d9de352dfb75f6c28bfa226d82d05cab6dc1ed5823c4b87e6298702900e",
"assetsBucket": "vortanz-beta",
"blobId": "e43e0a07-91ae-4589-a9ad-c425ae7da706/cfffad136c348bf6e643c9841af89478-standard.mp4"
},
"created": "2022-11-07T19:05:27.678Z",
"modified": "2022-11-07T19:05:37.398Z",
"__v": 0,
"progress": {
"message": "Analysis failed" // FAILED
},
"id": "636956f702298c6da2afd28d"
}
```Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1748Add (transcript) tag to annotations created by software agent2022-11-08T17:32:16+01:00Rittershaus, DavidAdd (transcript) tag to annotations created by software agentThe transcipt annotations should have a tag (like "live annotations") that shows they are genernated automatically. We could either add a specific "automatically transcribed" tag or a more general "generated automaticallly" or "software ...The transcipt annotations should have a tag (like "live annotations") that shows they are genernated automatically. We could either add a specific "automatically transcribed" tag or a more general "generated automaticallly" or "software generated" tag.Milan GressMilan Gresshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1747Swimlane Tooltips stick when zooming/scrolling via trackpad on desktop2022-11-14T13:40:38+01:00Mittermeier, MaximilianSwimlane Tooltips stick when zooming/scrolling via trackpad on desktopNote to self: caused by: AnnotationElement Svg DOM elements get recreated and old ones do not fire mouseleave events on destruction, thus not closing the tooltipNote to self: caused by: AnnotationElement Svg DOM elements get recreated and old ones do not fire mouseleave events on destruction, thus not closing the tooltipMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1745Feedback in post annotator about ongoing transcriptions does not update2022-11-08T12:24:18+01:00Milan GressFeedback in post annotator about ongoing transcriptions does not updatehttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/merge_requests/703#note_349614
> Data-views branch is going to be merged into master now. The fix should be based on master.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/merge_requests/703#note_349614
> Data-views branch is going to be merged into master now. The fix should be based on master.https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1744Fix parsing of xywh selector param2022-11-07T13:40:42+01:00Koch, AntonFix parsing of xywh selector paramThis code will break if the selector value contains more than one param:
https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/blob/milestone-feature-data-views/src/components/content/AnnotationsStream.vue#L109
It should rat...This code will break if the selector value contains more than one param:
https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/blob/milestone-feature-data-views/src/components/content/AnnotationsStream.vue#L109
It should rather use the pre-parsed data found in `_metadata`.Feature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1743Allow the annotation of audio files?2022-11-07T09:53:01+01:00Rittershaus, DavidAllow the annotation of audio files?I think this has already been a feature request in the past and you are sort of able to do it if you turn your audio file into a video file. With the transcript option this seems now to be even more interesting. Would be kind of cool if ...I think this has already been a feature request in the past and you are sort of able to do it if you turn your audio file into a video file. With the transcript option this seems now to be even more interesting. Would be kind of cool if you can add an audio file to your timeline and then annotate it like a video.
Video frame in post annotator could simply show the waveform image. Image related features (bouding boxes etc.) should probably be hidden. Maybe the whisper container is set to process only video files at the moment?
@anton.kochMilan GressMilan Gresshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1742Add option to run Bounding box / Tracking analysis triggered by the user2022-11-22T11:37:03+01:00Koch, AntonAdd option to run Bounding box / Tracking analysis triggered by the userAs we're going to turn off automatic analysis for longer videos (maybe even altogether), we need functionality to allow the user to trigger this.
There is only one job that is needed to be created, the other automatically runs after it:...As we're going to turn off automatic analysis for longer videos (maybe even altogether), we need functionality to allow the user to trigger this.
There is only one job that is needed to be created, the other automatically runs after it:
```javascript
await this.$store.dispatch('jobs/create', {
config: {
path: 'bounding-box'
},
data: {
assetId: this.asset.id
}
})
```Feature: Data ViewsHansen, ChristianHansen, Christian