Text-to-movie authoring of anatomy lessons - Authoring and directing story worlds
Article Dans Une Revue Artificial Intelligence in Medicine Année : 2023

Text-to-movie authoring of anatomy lessons

Résumé

There is a need for a simple yet comprehensive tool to produce and edit pedagogical anatomy video courses, given the widespread usage of multimedia and 3D content in anatomy instruction. Anatomy teachers have minimal control over the present anatomical content generation pipeline. In this research, we provide an authoring tool for instructors that takes text written in the Anatomy Storyboard Language (ASL), a novel domain-specific language (DSL) and produces an animated video. ASL is a formal language that allows users to describe video shots as individual sentences while referencing anatomic structures from a large-scale ontology linked to 3D models. We describe an authoring tool that translates anatomy lessons written in ASL to finite state machines, which are then used to automatically generate 3D animation with the Unity 3D game engine. The proposed text-to-movie authoring tool was evaluated by four anatomy professors to create short lessons on the knee. Preliminary results demonstrate the ease of use and effectiveness of the tool for quickly drafting narrated video lessons in realistic medical anatomy teaching scenarios.
Fichier principal
Vignette du fichier
Text_to_movie_JAIME_preprint.pdf (5.74 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04301065 , version 1 (23-11-2023)

Licence

Identifiants

Citer

Vaishnavi Ameya Murukutla, Elie Cattan, Benjamin Lecouteux, Remi Ronfard, Olivier Palombi. Text-to-movie authoring of anatomy lessons. Artificial Intelligence in Medicine, 2023, 146, pp.102717. ⟨10.1016/j.artmed.2023.102717⟩. ⟨hal-04301065⟩
249 Consultations
155 Téléchargements

Altmetric

Partager

More