Systems Frontend issueshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues2024-01-09T12:51:34+01:00https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2108create overlay on video2024-01-09T12:51:34+01:00Hansen, Christiancreate overlay on videohttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2109use dropdown menu for skeleton selection in overlay2024-01-09T12:51:27+01:00Hansen, Christianuse dropdown menu for skeleton selection in overlayhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2135feature: optional stroke-width2024-01-09T12:51:09+01:00Hansen, Christianfeature: optional stroke-widthhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2144to do: buttons position revision (especially mobile)2024-01-09T12:50:22+01:00Hansen, Christianto do: buttons position revision (especially mobile)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2145feature: show asset time (optional)2024-01-09T12:50:18+01:00Hansen, Christianfeature: show asset time (optional)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2151feature: save poses as series or every pose as standalone image2024-01-09T12:49:48+01:00Hansen, Christianfeature: save poses as series or every pose as standalone imagehttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2208post annotator: time zone error2024-01-08T15:14:34+01:00Hansen, Christianpost annotator: time zone error![Bildschirmfoto_2023-12-19_um_11.18.52](/uploads/ddae8aa4d9dec613b509fd658cab44dc/Bildschirmfoto_2023-12-19_um_11.18.52.png)![Bildschirmfoto_2023-12-19_um_11.18.52](/uploads/ddae8aa4d9dec613b509fd658cab44dc/Bildschirmfoto_2023-12-19_um_11.18.52.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2082Invisible dark player buttons on dark underground2023-12-18T16:52:55+01:00Hansen, ChristianInvisible dark player buttons on dark underground![Bildschirmfoto_2023-07-12_um_15.34.15](/uploads/d505ca2f222a15f8be8ebacbd9853ee5/Bildschirmfoto_2023-07-12_um_15.34.15.png)![Bildschirmfoto_2023-07-12_um_15.34.15](/uploads/d505ca2f222a15f8be8ebacbd9853ee5/Bildschirmfoto_2023-07-12_um_15.34.15.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1658annotation item dark mode: line color needs adjustment2023-12-18T15:57:09+01:00Hansen, Christianannotation item dark mode: line color needs adjustmentIt's to dark at the moment:
<br /><br />
![Bildschirmfoto_2022-10-05_um_11.12.05](/uploads/057bf00d61e63ddf8a60984f90e6a564/Bildschirmfoto_2022-10-05_um_11.12.05.png)It's to dark at the moment:
<br /><br />
![Bildschirmfoto_2022-10-05_um_11.12.05](/uploads/057bf00d61e63ddf8a60984f90e6a564/Bildschirmfoto_2022-10-05_um_11.12.05.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2195Video ration of (many) videos misrecognized? Bounding boxes do not match2023-12-13T16:32:01+01:00Rittershaus, DavidVideo ration of (many) videos misrecognized? Bounding boxes do not matchBboxes are only displayed correctly for one video in the whole HfMDK class. I think it might be related to the camera that they have used or something like that, but we can't change the videos anymore. There are already plenty of manual ...Bboxes are only displayed correctly for one video in the whole HfMDK class. I think it might be related to the camera that they have used or something like that, but we can't change the videos anymore. There are already plenty of manual annotations and we are in the middle of the process.
I've uploaded one of the videos here: https://assets.motionbank.org/vortanz/MACoDE/bug-reports/Anouk-van-Dijk-LAG-cam-1.mp4
![Bildschirmfoto_2023-11-22_um_13.26.06](/uploads/feaa18a0264c537b2b6b42d65f8512be/Bildschirmfoto_2023-11-22_um_13.26.06.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2046Comparison: optional chunk size for analysis2023-12-13T16:30:28+01:00Hansen, ChristianComparison: optional chunk size for analysisCurrently 3s are fixed.
Waiting for feedback from Cologne.Currently 3s are fixed.
Waiting for feedback from Cologne.Hansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1942highlight active subtitle in list2023-12-13T15:00:32+01:00Hansen, Christianhighlight active subtitle in listFeature: Data Viewshttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2127Integrate CCL spaghetti drawing feauture in 3d pose viewer (at least for HZT ...2023-12-13T14:56:19+01:00Rittershaus, DavidIntegrate CCL spaghetti drawing feauture in 3d pose viewer (at least for HZT version)@christian.hansen: similar to the idea described in #2126, I would like to offer the HZT students in the October (12th-14th) workshop a few options beyond selecting joints and limbs to annotate them. It would be great if we could impleme...@christian.hansen: similar to the idea described in #2126, I would like to offer the HZT students in the October (12th-14th) workshop a few options beyond selecting joints and limbs to annotate them. It would be great if we could implement the 3D viewer (so that's basically this one: #2072) but also add the option to draw the spaghettis like in you CCL prototpye. Maybe saving + dowloading a png of the drawing you created would be great (would also be great just for the 3d viewer, so you can for example look at a pose from the top and save it as an image).
However, in a next step you could continue towards creating the 3d sculpture you planned to create. Maybe you could make it optional: If someone prefers spaghettis that's the basic drawing in space option. If one wishes to turn it into a full 3d sculpture this an additional option that can be selected.
Both the 3D viewer and the spaghetti drawing (or even 3d object generation) does not have to be perfect and perfectly work with all kinds of data. It's just a test to see if that's something the students in Berlin would like to work with (in the future) or how we could turn into a useful creative feature.Hansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2192deleted transcriptions still appear in post annotator2023-12-11T10:26:39+01:00Hansen, Christiandeleted transcriptions still appear in post annotatorAs you can see: no more transcription listed after deletion
<br /><br />
![Bildschirmfoto_2023-11-16_um_15.28.18](/uploads/da4ca2261f430e8e406bcd914e317c59/Bildschirmfoto_2023-11-16_um_15.28.18.png)
<br /><br />
The deleted transciption ...As you can see: no more transcription listed after deletion
<br /><br />
![Bildschirmfoto_2023-11-16_um_15.28.18](/uploads/da4ca2261f430e8e406bcd914e317c59/Bildschirmfoto_2023-11-16_um_15.28.18.png)
<br /><br />
The deleted transciption still appears in Post Annotator:
<br /><br />
![Bildschirmfoto_2023-11-16_um_15.29.15](/uploads/467c11e96a8f9e8f4e1833c00588ef7a/Bildschirmfoto_2023-11-16_um_15.29.15.png)
<br /><br />![Bildschirmfoto_2023-11-16_um_15.32.22](/uploads/6b88f9d681c1ed88aaf718518f76e581/Bildschirmfoto_2023-11-16_um_15.32.22.png)https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2198"Speech to text" broken again!2023-12-05T15:18:01+01:00Hansen, Christian"Speech to text" broken again!Have to analyze https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/merge_requests/806 againHave to analyze https://gitlab.rlp.net/motionbank/applications/systems-frontend/-/merge_requests/806 againHansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1835"Start transcription" throws error (still working)2023-12-05T14:21:49+01:00Hansen, Christian"Start transcription" throws error (still working)Seems not to have any effect on the functionality, but would be more beautiful to have no error : )
<br />
![Bildschirmfoto_2022-11-30_um_16.02.58](/uploads/c41934306172bd9490669ac00e7a473e/Bildschirmfoto_2022-11-30_um_16.02.58.png)Seems not to have any effect on the functionality, but would be more beautiful to have no error : )
<br />
![Bildschirmfoto_2022-11-30_um_16.02.58](/uploads/c41934306172bd9490669ac00e7a473e/Bildschirmfoto_2022-11-30_um_16.02.58.png)Hansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2196Annotations with duration can be set as Bookmark2023-11-30T18:47:54+01:00Mittermeier, MaximilianAnnotations with duration can be set as BookmarkInitially, bookmarks were not supposed to have a duration and adding one to a bookmark is prevented.
Annotations with duration can be toggled to bookmark in AnnotationItem though. This leads to the annotation not showing up in neither ...Initially, bookmarks were not supposed to have a duration and adding one to a bookmark is prevented.
Annotations with duration can be toggled to bookmark in AnnotationItem though. This leads to the annotation not showing up in neither the regular annotations lane nor in the bookmarks lane.
A fix that would not break current data that now might contain bookmarks with duration and still prevent further creation of such bookmarks would be to:
- grey out the bookmark toggle in AnnotationItem for annotations with duration, with explaining tooltip
- show bookmarks with duration as regular bookmarks in the bookmarks lane to keep existing invalid bookmarks usableMittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2190term frequency analysis: multilingual stopwords2023-11-28T13:48:27+01:00Hansen, Christianterm frequency analysis: multilingual stopwordsHansen, ChristianHansen, Christianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/1436Introduce "bookmarking" annotations and table of contents2023-11-23T16:09:52+01:00Rittershaus, DavidIntroduce "bookmarking" annotations and table of contentsThe data model allows the use of the purpose "bookmarking". I see two possibilities to make use of it:
1) Use it in the Post-Annotator (show them "only" in the Post-Annotator). The students in Frankfurt would have been very happy about ...The data model allows the use of the purpose "bookmarking". I see two possibilities to make use of it:
1) Use it in the Post-Annotator (show them "only" in the Post-Annotator). The students in Frankfurt would have been very happy about that possibility and I would consider it to be useful for archival work. The Pina Bausch Archive has something like that for structuring interviews (oral history) in combination with a table of contents. For structuring and revisiting longer recordings, this might be very helpful for our users as well. Not sure how "subchapters" could be handled with the data model, but maybe that's not necessary.
![Bildschirmfoto_2022-03-25_um_08.59.15](/uploads/ff65fa27ecdef957318da6df18dea77c/Bildschirmfoto_2022-03-25_um_08.59.15.png)
2) Another use case could be for the Timeline Viewer. Here it could be very helpful to either really set some bookmarks to easily come back to a few moments you consider to be important (or to continue "reading" at a specific moment). But it would also allow you to add some sort of titles to the Timeline which can be helpful in addition to dthe ate, e.g. "First rehearsal week", "Monday morning training", "working on 'figure 8'", "second show in Mainz" etc. Especially for Timelines with a lot of annotations a table of contents might also be helpful.
To use both, we can use the "scope" parameter (annotations with purpose "bookmarking" and the scope Post-Annnotator; annotations with the purpose "bookmarking" and the scope of the Timeline).Mittermeier, MaximilianMittermeier, Maximilianhttps://gitlab.rlp.net/motionbank/applications/systems-frontend/-/issues/2193broken: start new speech-to-text2023-11-21T13:12:25+01:00Hansen, Christianbroken: start new speech-to-textwrong language code:
<br /><br />
`ffmpeg version 4.3 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 7.3.0 (crosstool-NG 1.23.0.449-a04d0)
configuration: --prefix=/opt/conda --cc=/opt/conda/conda-bld/ffmpeg_15971786654...wrong language code:
<br /><br />
`ffmpeg version 4.3 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 7.3.0 (crosstool-NG 1.23.0.449-a04d0)
configuration: --prefix=/opt/conda --cc=/opt/conda/conda-bld/ffmpeg_1597178665428/_build_env/bin/x86_64-conda_cos6-linux-gnu-cc --disable-doc --disable-openssl --enable-avresample --enable-gnutls --enable-hardcoded-tables --enable-libfreetype --enable-libopenh264 --enable-pic --enable-pthreads --enable-shared --disable-static --enable-version3 --enable-zlib --enable-libmp3lame
libavutil 56. 51.100 / 56. 51.100
libavcodec 58. 91.100 / 58. 91.100
libavformat 58. 45.100 / 58. 45.100
libavdevice 58. 10.100 / 58. 10.100
libavfilter 7. 85.100 / 7. 85.100
libavresample 4. 0. 0 / 4. 0. 0
libswscale 5. 7.100 / 5. 7.100
libswresample 3. 7.100 / 3. 7.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'http://10.14.14.86:9000/vortanz-beta/4d70c1ed-a2f0-466e-8a0a-4d68b097d5c6/22619f531f09556ca44344a6b545cb51-standard.mp4?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=minio%2F20231116%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231116T145826Z&X-Amz-Expires=86400&X-Amz-SignedHeaders=host&X-Amz-Signature=10dcb1ac6a371021e561183d81e3cc97513ca911d7e842f21379b48c71dce487':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf59.27.100
location-eng : +50.9336+006.8693/
location : +50.9336+006.8693/
Duration: 00:00:17.12, start: 0.000000, bitrate: 2789 kb/s
Stream #0:0(eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p(tv, bt709), 1600x720, 2654 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandle
encoder : Lavc59.37.100 libx264
Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 129 kb/s (default)
Metadata:
handler_name : SoundHandle
Stream mapping:
Stream #0:1 -> #0:0 (aac (native) -> pcm_s16le (native))
Press [q] to stop, [?] for help
Output #0, wav, to '/workspace/22619f531f09556ca44344a6b545cb51-standard.wav':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
location : +50.9336+006.8693/
location-eng : +50.9336+006.8693/
ISFT : Lavf58.45.100
Stream #0:0(eng): Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, stereo, s16, 1411 kb/s (default)
Metadata:
handler_name : SoundHandle
encoder : Lavc58.91.100 pcm_s16le
size= 2940kB time=00:00:17.10 bitrate=1408.0kbits/s speed= 306x
video:0kB audio:2940kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.002591%
Traceback (most recent call last):
File "/workspace/SpeechWhisper.py", line 353, in <module>
main()
File "/workspace/SpeechWhisper.py", line 348, in main
result = sw.predict(args)
File "/workspace/shared/model_wrapper_util/metrics.py", line 155, in __call__
result = self.func(self.instance_, *args, **kwargs)
File "/workspace/SpeechWhisper.py", line 292, in predict
segments, info = self.model.transcribe(v['audio'],
File "/opt/conda/lib/python3.8/site-packages/faster_whisper/transcribe.py", line 332, in transcribe
tokenizer = Tokenizer(
File "/opt/conda/lib/python3.8/site-packages/faster_whisper/tokenizer.py", line 29, in __init__
raise ValueError(
ValueError: 'French' is not a valid language code (accepted language codes: af, am, ar, as, az, ba, be, bg, bn, bo, br, bs, ca, cs, cy, da, de, el, en, es, et, eu, fa, fi, fo, fr, gl, gu, ha, haw, he, hi, hr, ht, hu, hy, id, is, it, ja, jw, ka, kk, km, kn, ko, la, lb, ln, lo, lt, lv, mg, mi, mk, ml, mn, mr, ms, mt, my, ne, nl, nn, no, oc, pa, pl, ps, pt, ro, ru, sa, sd, si, sk, sl, sn, so, sq, sr, su, sv, sw, ta, te, tg, th, tk, tl, tr, tt, uk, ur, uz, vi, yi, yo, zh)`Hansen, ChristianHansen, Christian