KR100773832B1 - Production and Editing Method of Narrator Multimedia Local Data Using 3D Module and TTS Module and Its System - Google Patents

Abstract

The present invention relates to a system for producing presentation materials, and in particular, a first step of loading any presentation material having a specific format; A second step of setting a narration script for the presentation material loaded in the first step and converting the narration script into sound data according to the development; A third step of producing a 3D animation by selecting predetermined data for each head, lips, and body part at an arbitrary time point to form a 3D avatar narrator for the presentation material loaded in the first process; Process; A fourth step of arbitrarily selecting a presentation time point for the sound data converted in the second step and the three-dimensional (3D) animation produced in the third step in response to the presentation data loaded in the first step; A fifth process of collecting the results performed through the first to fourth processes into one narrator multimedia data; And a sixth display of the three-dimensional (3D) animation and sound data to the outside on the basis of the time point when the three-dimensional (3D) animation and sound data are selected during the presentation of the narrator multimedia data collected through the fifth process. Providing a method for editing and producing a narrator multimedia local material using a 3D module and a TTS module, including a process, and a system therefor, the display according to the slide method of the presentation material 3 The dimensional avatar can be placed in an arbitrary virtual space to act as a presenter, and at the same time, the voice and sound (including background music) can be synchronized with the producer at random, and the presentation material and various surrounding environments can be edited as needed.

Therefore, even if the presenter is not mastered, the contents of the presentation can be delivered accurately to any subject, and because it is not a monotonous presentation, the curiosity of the subject is stimulated, and thus the presentation contents are delivered.

In addition, by adding a configuration for implementing a sign language operation of a 3D avatar, the hearing impaired person can fully understand the contents of the presentation.

3D Engine, TTS, Virtual Space, Presentation, Avatar

Description

Manufacture production method for narrator multi-media data using 3D and TTS module and system for the same}

1 is an exemplary configuration of a system for producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention.

2 is an exemplary configuration diagram of a 3D (3D) engine module for generating a 3D (3D) avatar according to the present invention.

3 is an exemplary diagram for explaining a process of generating an avatar using a 3D engine module according to the present invention.

Figure 4 is an exemplary view of the characteristics of each area displayed on the screen according to the operation of the production editing system of the narrator multimedia local material using the 3D (3D) module and TTS module according to the present invention

5 is to provide a text source for driving a TTS module according to an operation of a production editing system for narrator multimedia local material using a 3D module and a TTS module according to the present invention. Illustrated diagram to illustrate the process

FIG. 6 is an exemplary view for explaining a process for matching synchronization between modules according to the operation of a system for producing and editing a multimedia data local material using a 3D module and a TTS module according to the present invention.

7 and 8 are exemplary diagrams for explaining the final use example using the local production and editing system of the narrator multimedia data using the 3D (3D) module and TTS module.

9 is an exemplary configuration diagram of a system for producing and editing a narrator multimedia local material using a 3D module for hearing-impaired people and a TTS module according to the present invention.

FIG. 10 is an exemplary configuration diagram of a sign language operation engine module for a hearing impaired person in FIG. 9.
* Explanation of symbols for the main parts of the drawings
100: loading material loading module
200: sound source loading module
300: 3D (3D) engine module
400: TTS module
500: Database
600: control module
700: Production Editing Module
800: result generation and loading module

The present invention relates to a system for producing presentation materials. In particular, a 3D avatar is placed in an arbitrary virtual space with a display according to a slide method of the presentation material, and at the same time, voice and sound (including background music) are performed. And editing system of Narrator multimedia local material using 3D module and TTS module to synchronize the author's discretion and to edit the presentation materials and various surrounding environments as needed. It is about.

In addition, the present invention is a three-dimensional (3D) that allows a speaker unfamiliar with sign language to be used by a 3D avatar that is placed as a presenter in a virtual space to express the sign language, thereby delivering the contents of the presentation material to the hearing impaired. The present invention relates to a method for producing and editing a narrator multimedia local data using a module and a TTS module, and a system thereof.

BACKGROUND ART In general, a document composed of text, a still image image, and a moving picture obtained by synthesizing audio and video are used as means for transmitting knowledge information to the Internet.

Adobe's PDF document is used as a method of delivering text-oriented documents without modification. When a read-only PDF document is transmitted to the Internet, the recipient uses a method of displaying a dedicated document window on his or her computer screen. When still image images are included in an HTML document and transmitted to the Internet, recipients view them using a web browser or attach and receive e-mails.

In order to transmit digital video information, a video is transmitted in a streaming manner. In general, a receiver generally displays a Microsoft Windows Media Player window on a computer screen.

However, this method of transmitting knowledge information separates and transmits each information, and the research results show that in general, 10% of reading, 20% of hearing, 30% of hearing, and 50% of hearing and hearing are remembered. As can be seen, integrating various multimedia elements is inevitably lower than the knowledge transfer effect.

Therefore, in the case of presentations that collectively include the presentation of research contents, the presentation of plans or project descriptions, and the presentations in seminars, the visual and auditory elements should be combined as appropriate to achieve the purpose of conveying arbitrary information more effectively. do.

For this purpose, even if the presentation is to a large number or to a few specific persons, it is common to make a pair of presenters and presentation assistants. This is because the efficiency of information transmission decreases when operations such as manipulation of used equipment are performed.

However, even if the presentation is conducted by a pair of two people, the presentation screen should change according to the presenter's progress. As the two people proceed, the presenter and the helper need to make efforts to match these motivations with glances or hand signals. There was a ham.

In order to solve this problem, the proposed techniques have been proposed in which a presentation of the presentation contents to be presented is made into a moving picture.

The distinctive feature of these methods is that the presentation is provided in a movie-like time frame, so that a skilled presenter is not required, and the audience can focus on the presentation during the presentation.

Therefore, the disadvantage of this method is that when the presentation changes or changes to the presentation occur, the current video material is discarded and must be made from scratch.

In addition, it cannot respond appropriately to the situation that occurs suddenly during the presentation, and because the general user has a lot of difficulties in the production process, it is difficult to use it directly as a production tool according to the taste or characteristics of the presentation. have.

SUMMARY OF THE INVENTION An object of the present invention for solving the above problems relates to a system for producing presentation materials, and in particular, to arrange a 3D avatar in an arbitrary virtual space together with a display according to a slide method of the presentation material to serve as a presenter. At the same time, Narrator multimedia local material using 3D module and TTS module to synchronize voices and sounds (including background music) to the producers and to edit the presentation materials and various surrounding environments as needed. To provide a production editing method and system accordingly.

A prior art object of the present invention for achieving the above object of the present invention, the producer convenience for the production editing of narrator multimedia local material that allows the producer to arbitrarily edit and set the operation of the three-dimensional avatar disposed in the virtual space as the presenter To provide a three-dimensional engine module.

In addition, another prior object of the present invention for achieving the above object of the present invention, the display of the presentation material for the presentation of the speech to explain the presentation material during the display operation process according to the slide method of the presentation material by the producer arbitrarily The present invention provides a text-to-speech (TTS) interworking module for the producer's convenience for producing and editing narrator multimedia local materials for converting and outputting text such as edited and set annotations into voice.

In addition, an additional object of the prior art object of the present invention for achieving the above object of the present invention is a three-dimensional engine module and TTS including sound (including background music) for enhancing the effect of the presentation material. (Text-To-Speech) It is to provide a producer-friendly synchronization module for the production and editing of narrator multimedia local material that can be arbitrarily edited by the producer and various sound sources, and each is executed by one synchronization.

In addition, another object of the present invention is to create and edit a narrator multimedia local data using the 3D (3D) module and TTS module and the system according to the three-dimensional avatar is placed in the virtual space as a presenter sign language Narrator multimedia local materials using the 3D module and TTS module, which can be used by presenters who are not familiar with sign language by delivering the contents of the presentation materials to the hearing impaired by expressing (手 話). To provide a production editing method and a system accordingly.

A feature of the method of producing and editing a Narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object is to load any presentation material having a specific format. The first process; A second step of setting a narration script for the presentation material loaded in the first step and converting the narration script into sound data according to the development; A third step of producing a 3D animation by selecting predetermined data for each head, lips, and body part at an arbitrary time point to form a 3D avatar narrator for the presentation material loaded in the first process; Process; A fourth step of arbitrarily selecting a presentation time point for the sound data converted in the second step and the three-dimensional (3D) animation produced in the third step in response to the presentation data loaded in the first step; A fifth process of collecting the results performed through the first to fourth processes into one narrator multimedia data; And a sixth display of the three-dimensional (3D) animation and sound data to the outside on the basis of the time point when the three-dimensional (3D) animation and sound data are selected during the presentation of the narrator multimedia data collected through the fifth process. It involves the process.

An additional feature of the method for producing and editing the Narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object is the Narrator multimedia collected in the fifth step. The method further includes a seventh process of presenting the presentation material and sound data to the outside based on the time point selected in the fourth process during the main display of the 3D animation when the material is displayed.

In order to achieve the above object, another additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention is the fifth step in the first process. In the case of loading the narrator multimedia data collected through the process, the narration script is editable through the second process.

An additional feature of the method for producing and editing a Narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object is the first step. In the case of loading the narrator multimedia data collected through the fifth process, the predetermined data for each head, lips, and body parts can be reselected at an arbitrary time point in order to form a 3D avatar narrator through the third process. .

In another aspect of the present invention, a third method of producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention may be achieved. A first step of setting data of basic appearance of the shape; A second step of setting data of a gender of the human figure set in the first step and a plurality of clothes corresponding to each gender; A third step of dividing the body motion into a plurality of forms and setting data according to the human shape set in the first step; A fourth step of dividing the association operation between the lips and the mouth around the face into a plurality of forms and setting data according to the human shape set in the first step; A fifth step of dividing the movements of other parts of the face other than the mouth area into a plurality of forms and setting data according to the human shape set in the first step; A sixth step of loading a corresponding data and setting a reference avatar when a gender and costume of a human figure set in the first and second steps are set by an avatar generation request; And when the operator arbitrarily designates the various operations previously set through the third to fifth steps by the avatar's movement request after the sixth step, the first avatar data to the reference avatar data set through the sixth step. And a seventh step of forming a real-time avatar movement in response to a worker's request as various operations previously set through steps 3 to 5 are linked and merged.

In another aspect of the present invention, a method of producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention is provided. The method further includes a virtual space setting step of implementing an arbitrary virtual space in three dimensions and setting an arbitrary virtual space among preset virtual spaces by an operator.

An additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object is set in the virtual space setting step. And presenting an avatar moving in real time through the seventh step in any virtual space, and enabling the avatar to navigate the movement in the virtual space.

In another aspect of the present invention, a third method of producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention, the third process is performed. (3D) MAX, Head, Lips and Body parts are made of separate data network meshes for each part, and the produced characters are Bipad bones suitable for human animation. It is to create a 3D animation by linking a previously created mesh and bone using a biped bone.

As another additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object, it is converted in the second process. Acoustic data are classified by gender or age and are selectable by an operator.

In order to achieve the above object, an additional feature of the method of producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention is described. A first step having a time slot having a temporal length of; Through the third process, data of basic appearance of the human figure, data of the gender of the human figure and a plurality of clothes corresponding to each gender are set, and then the association between the body motion, the head motion, the lips and the mouth around the human shape A second step of arranging the operation at an arbitrary position of the time slot provided in the first step; A third step of disposing text corresponding to a script to be fostered and converted through the second process at an arbitrary position of a time slot provided in the first step; And a fourth step of displaying various types of data existing at the same location through the time slot having the arbitrary temporal length simultaneously with the operation of the associated module.

As another additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object, by loading arbitrary sound data The method may further include disposing at an arbitrary position of the time slot provided in the first step.

In order to achieve the above object, a feature of the editing and editing system for narrator multimedia local material using the 3D module and the TTS module according to the present invention is generated using various tools for presentation. A presentation material loading module for loading presentation materials and temporarily storing the presentation materials; A sound source loading module for loading and temporarily storing sound sources (sound data, background music data); A 3D engine module for forming a virtual space and generating a three-dimensional image according to the implementation of the avatar and the operation of the avatar in the virtual space; A TTS module which converts and optionally provides texts into nurturing texts; A database storing source data for supporting the operation of the 3D engine module and the TTS module; By predicting and editing the results of the presentation by automatically merging and synchronizing the sources provided by the presentation loading module, the sound source loading module, the 3D engine module, and the TTS module by external request. A production editing module for modifying; A result generation and loading module for generating presentation data edited through the production editing module as one independent result or loading the generated result to the production editing module; And a control module for arbitrarily controlling the production editing module by an external request.

In order to achieve the above object, an additional feature of a production editing system for narrator multimedia local material using a 3D module and a TTS module according to the present invention is provided. Access the presentation materials to be produced and edited and the materials to be modified through the result generation and loading module, collect the necessary materials through the process of accessing the necessary sound source through the sound source loading module, A production edit control module for generating a final product edited through an editing module as a result through the result generation and loading module; A TTS conversion script setting module for inputting and modifying text data desired to be expressed by the production editing module as a source for the operation of the TTS module; 3D for selecting various virtual spaces and avatars that can be provided by the 3D engine module through the production editing module, and setting the motions and facial expressions of the corresponding avatars at random times by the producer. 3D) Avatar setting module; And a synchronization point setting module for setting the operation point of the TTS conversion script setting module and the operation point of the 3D avatar setting module through the production editing module.

Another feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object is to load any presentation material having a specific format. A first process of doing; A second step of setting a narration script for the presentation material loaded in the first step and converting the narration script into sound data according to the development; A third step of generating narration data for communication by recognizing a narration script converted into sound data through the second step; In order to form a three-dimensional (3D) avatar narrator for the presentation material loaded in the first process, predetermined data for each head, lips, and body are selected at an arbitrary time, and the data of the hand motion generated in the third process is selected. A fourth step of merging to create a three-dimensional (3D) animation; A fifth step of arbitrarily selecting a presentation time point for the sound data converted in the second step and the three-dimensional (3D) animation produced in the fourth step in response to the presentation data loaded in the first step; A sixth process of collecting the results performed through the first to fifth processes into one narrator multimedia data; And a seventh output of the narrator multimedia data collected through the sixth process to the outside on the basis of the point in time when the 3D animation and sound data are selected in the fifth process during the main display of the presentation material. To include the process.

An additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object is the narrator multimedia collected in the sixth step. The method further includes an eighth process of presenting the presentation material and sound data to the outside based on a time point selected in the fifth process during the main display of the 3D animation when the material is displayed.

In order to achieve the above object, an additional feature of the method for producing and editing a Narrator multimedia local material using the 3D module and the TTS module according to the present invention is the sixth step. In the case of loading the narrator multimedia data collected through the process, the narration script is editable through the second process.

In another aspect of the present invention, a third method of producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention, the third process is to communicate. A first step of setting data about a hand gesture for the first step; A second step of recognizing a narration script converted into sound data through the second process; And a third step of extracting data corresponding to the narration script recognized in the second step from the data on the hand gesture set through the first step.

An additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object is set through the first step. The data on hand gestures for communication is composed of hand gestures divided into consonants, vowels, and numbers.

An additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object is set through the first step. Data on hand gestures for communication is composed of hand gestures divided into words and surveys.

In another aspect of the present invention, a third method of producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention, the fourth process is a human figure. A first step of setting data of a basic appearance; A second step of setting data of a gender of the human figure set in the first step and a plurality of clothes corresponding to each gender; A third step of dividing the association operation between the lips and the mouth around the face into a plurality of forms and setting the data according to the human shape set in the first step; A fourth step of dividing the movements of other parts of the face other than the mouth around the human shape set in the first step into a plurality of forms and setting data accordingly; A fifth step of classifying hand gestures for communication in a plurality of forms and setting data according to the human shape set in the first step; A sixth step of loading a corresponding data and setting a reference avatar when the gender and clothes of the human figure set in the first and second steps are set by the avatar generation request; And after the sixth step, the operator arbitrarily designates a variety of motions previously set through the third and fourth steps by the avatar's movement request and based on the data on the hand motions generated through the third step. The hand gesture set in advance through the fifth step is automatically assigned, and various operations preset through the third through fifth steps are linked to and merged with data of the reference avatar set through the sixth step. And a seventh step of forming a real-time avatar movement at the request of the worker.

In another aspect of the present invention, a method of producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention is provided. The method may further include a virtual space setting step of implementing an arbitrary virtual space in three dimensions and setting an arbitrary virtual space among preset virtual spaces by an operator.

As another additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object, it is converted in the second process. Acoustic data are classified by gender or age and are selectable by an operator.

In another aspect of the present invention, the third method of producing and editing a Narrator multimedia local material using the 3D module and the TTS module according to the present invention, the fifth process is optional. A first step having a time slot having a temporal length; Through the fourth process, data of basic appearance of the human figure, data of the gender of the human figure and a plurality of clothes corresponding to each gender are set, and then the association between the body motion, the head motion, the lips and the mouth around the human shape A second step of arranging the operation at an arbitrary position of the time slot provided in the first step; A third step of disposing text corresponding to a script to be fostered and converted through the second process at an arbitrary position of a time slot provided in the first step; And a fourth step of displaying various types of data existing at the same location through the time slot having the arbitrary temporal length simultaneously with the operation of the associated module.

As another additional feature of the method for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object, by loading arbitrary sound data The method may further include disposing at an arbitrary position of the time slot provided in the first step.

Another feature of the system for producing and editing narrator multimedia local materials using the 3D module and the TTS module according to the present invention for achieving the above object is generated using various tools for presentation. A presentation material loading module for loading and temporarily storing the presentation data; A sound source loading module for loading and temporarily storing sound sources (sound data, background music data); A TTS module which converts and optionally provides texts into nurturing texts; A sign language operation engine module configured to generate data of a hand gesture for communication corresponding to text provided to the TTS module; Three-dimensional (3D) to form a virtual space and to create a three-dimensional image in accordance with the implementation of the avatar and the operation of the avatar in the virtual space, the hand gesture to perform the hand motion generated by the sign language engine module An engine module; A database storing source data for supporting operations of the 3D engine module, the TTS module, and the sign language operation engine module; By predicting and editing the results of the presentation by automatically merging and synchronizing the sources provided by the presentation loading module, the sound source loading module, the 3D engine module, and the TTS module by external request. A production editing module for modifying; A result generation and loading module for generating presentation data edited through the production editing module as one independent result or loading the generated result to the production editing module; And a control module for arbitrarily controlling the production editing module by an external request.

In order to achieve the above object, an additional feature of a production editing system for narrator multimedia local material using a 3D module and a TTS module according to the present invention is provided. Access the presentation materials to be produced and edited and the materials to be modified through the result generation and loading module, collect the necessary materials through the process of accessing the necessary sound source through the sound source loading module, A production edit control module for generating a final version edited through an editing module as a result through the result generation and loading module; A TTS conversion script setting module configured to input and change text data desired to be expressed by the production editing module as a source for the operation of the TTS module; 3D for selecting various virtual spaces and avatars that can be provided by the 3D engine module through the production editing module and for setting the movement and facial expression of the avatar at any time. Avatar setting module; And a synchronization point setting module for setting the operation point of the TTS conversion script setting module and the operation point of the 3D avatar setting module through the production editing module.

As another additional feature of the system for producing and editing a narrator multimedia local material using the 3D module and the TTS module according to the present invention for achieving the above object, the sign language operation engine module A script recognition module for receiving and recognizing a narration script set through a conversion script setting module (TTS) when it is transmitted to a TTS module; A sign language data loading module for accessing data on a sign language operation according to a gesture based on a word and a survey in a database according to an input request signal; A localization data loading module for accessing data on a localization operation according to a gesture based on consonants and vowels in a database according to an input request signal; A data synthesizing module for synthesizing data according to a hand gesture accessed from the sign language data loading module and the geosig data loading module according to a control signal, and transferring the data to the 3D engine module; And based on the script recognized through the script recognition module, whether the sign language should be performed in sign language or whether the speech should be made by hand gestures to the hearing impaired person and requests the sign language data loading module and the sign data data loading module accordingly. And a sign language determination control module for controlling the combination of access data of the sign language data loading module and the ground data loading module through the data synthesis module to generate final data suitable for the original script.

An additional feature of the narration multimedia local material production and editing system using the 3D (3D) module and TTS module according to the present invention for achieving the above object is, through the synchronization time setting module The narration synchronization module is further configured to provide a synchronization signal to the sign language determination control module so that the sign language operation is performed in accordance with the driving synchronization of the TTS module.

The above object and various advantages of the present invention will become more apparent from the preferred embodiments of the present invention described below with reference to the accompanying drawings by those skilled in the art.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Attached Figure 1 is a simplified configuration example of a system for editing and editing the narrator multimedia local material using the 3D (3D) module and TTS module according to the present invention, the avatar of virtual reality through any narration nurturing narration As shown in FIG. 1 attached as a configuration for presenting the presentation material, the presentation materials (MS PowerPoint, HTML, PDF, image files, etc.) generated using various tools for presentation are loaded and Presentation material loading module 100 for temporarily storing, the sound source loading module 200 for temporarily storing the sound source (sound data, background music data) by loading, to form a virtual space and to implement the avatar in the virtual space and the corresponding Three-D (3D) engine module 300 for generating a three-dimensional image according to the operation of the avatar, and TTS (TTS) for converting and supplying the text provided arbitrarily A module 500, a database 500 that stores source data for supporting operations of the 3D engine module 300 and the TTS module 400, and a producer (user). The producer by merging and synchronizing the sources provided from the presentation material loading module 100, the sound source loading module 200, the 3D (3D) engine module 300 and the TTS module 400 by request Editing module 700 for automatically predicting and editing, editing, and outputting the presentation of the presentation, and generating or outputting presentation data edited through the production editing module 700 as one independent result. It is composed of a result generation and loading module 800 for loading the generated result to provide to the production editing module 700, and a control module 600 to allow the producer to arbitrarily control the production editing module 700 do.

The control module 600 accesses the presentation material to be produced and edited through the production editing module 700 and the material to be modified through the result generation and loading module 800, and the necessary sound source is loaded into the sound source loading module ( Production editing control module for collecting the necessary data through the process such as access through 200) and to produce the final text edited through the production editing module 700 as a result through the result generation and loading module 800 TTS (TTS) for inputting and changing text data that is desired to be expressed by fostering through the production editing module 700 and providing the source for the operation of the TTS module 400. A variety of virtual spaces and avatars that can be provided by the 3D engine module 300 through the conversion script setting module 630 and the production editing module 700 are selected. 3D (3D) Avatar setting module 640 for setting the movement and facial expressions of the other at any point in time, and the TTS conversion script setting module 630 through the production editing module 700 It is composed of a synchronization point setting module 620 for allowing the manufacturer to arbitrarily set the operation point of time and the operation point of the 3D (3D) avatar setting module 640.

Briefly referring to Figures 2 and 3 attached to the configuration and operation principle of the 3D (3D) engine module 300 of the above configuration, Figure 2 is attached to create a 3D (3D) avatar in accordance with the present invention 3 is an exemplary configuration diagram of a 3D engine module, and FIG. 3 is an exemplary diagram for describing a process of generating an avatar using a 3D engine module according to the present invention.

As shown in FIG. 2 and FIG. 3, the 3D (3D) engine module according to the present invention is a multi-skeletal control method, and includes a plurality of body motions, head motions, and movements of the 3D avatars. It is stored in the specification.

For example, the movement of the lips is based on the movements of the lips according to the pronunciation of "ah", "ya", "uh", "yo", and the movements of the lips according to the expressions such as "smile" and "bright smile". Data for each individual.

In addition, the movement of the head is separately provided with data on the motion of the face other than the lips such as "winking", "blinking eyes", "nodding the head", and the like.

In addition, the body movement separately includes data on natural movements as a presenter such as "walking", "greeting", "right hand lifting", "left hand lifting", and the like.

Therefore, the author requests to access and combine the data of each part that is set to most naturally express the behavior of the 3D avatar that is suitable for the contents of each slide that is presented in the slide.The 3D engine module ( In 300) it is combined to enable the operator to check through the production editing module (700).

The data according to the presenter's motion processed by the animation is not processed as a video, but is processed in real time by the 3D character synthesis and the request module in the 3D engine module 300. The volume can be significantly reduced compared to 3D animation videos.

In other words, the character uses 3D Max to create Head, Lips, and Body parts for each part as meshes, which are separate data networks. Using a biped bone suitable for human animation, a 3D animation is produced by linking a previously produced mesh and bone.

Then, in order to efficiently represent characters and animations, the optimal data is extracted using self-made extractors, and the generated characters are made of bones that are affected by the meshes that form each part. Information will be extracted together.
The extractor is configured to perform a 3D character modeling operation, a 2D image mapping operation, a skin / mesh operation by bipad, and a 3D character motion (motion keyframe).

In addition, when affected by multiple bones, each weight information is also extracted to extract a smooth animation. For the animation of each part, the animation of the character is extracted for each part.

Therefore, the animation data is extracted according to the sampling rate specified for all the bones of the biped bone, so that the optimal animation data can be secured at a small capacity. In case of character using bone), animation data can be shared without special production.

The data difference between the three-dimensional (3D) engine module 300 according to the present invention and the existing method is that the number of vertex of the facial region is 500, the number of vertices of the lips is 300, Assuming that the number of vertices is 1200 and the total number of vertices of 3D avatars is 2000, the data size of each vertex is 32Kbytes, and the number of operations is 50 for each part. Since the key is 30 frames, it is summarized in Table 1 below.

Existing Method 3D (3D) engine according to the present invention Gesture 24,000,000 42,000 Lips 14,400,000 42,000 Gesture 57,600,000 42,000 sum 96,000,000 (96MB) 126,000 (126 KB)

An example of the production editing screen 700A displayed on the producer's screen in accordance with the operation of the production and editing system of the presentation material using the virtual reality according to the present invention having the above-described configuration is shown in FIG. 4.

As shown in FIG. 4, when the production and editing system of the presentation material using the virtual reality is driven, a production editing screen 700A is shown on the producer's computer screen, and the production editing screen ( Each portion of 700A is shown to be associated with the control module 600.

Therefore, the producer may control the parts 610A, 630A, and 640A associated with the control module 600 to generate a presentation result using virtual reality according to the intention of the producer. Reference numeral 100A in FIG. The referred area is an area where a table of contents and the like of a presentation material accessed through the presentation material loading module 100 are displayed by a producer under the control of the production editing control module 610.

In addition, in the accompanying FIG. 4, an area designated by reference numeral 640A includes a worker selecting a gender of the avatar under the control of the 3D avatar setting module 640, and the attire of the gender and the avatar operating. Detailed body movements, lips movements, and head movements are areas for selecting a required operation from among preset operation modes.

In addition, the area indicated by reference numeral 610A in FIG. 4 is an area in which the operator displays and links various tools for using the production editing control module 610.

In addition, in the accompanying FIG. 4, an area referred to by reference numeral 620A refers to the position of the script that is expressed by the voice through the TTS module 400, the movement setting and the effect sound of the avatar (including background music) accordingly. This is an area for selecting a synchronization point setting for visually recognizing a display position of each information in order to provide convenience of operator operation of the synchronization point setting module 620 for adjusting the synchronization of the user.

In the production editing screen 700A as described above, the producer preferentially describes the slides for each slide with respect to the presentation material in order to explain the presentation material by using the TTS module 400 (hereinafter, Script), which is called script editing, and as shown in the accompanying FIG. 5, a script is written in the area of reference numeral 630A.

At this time, the area of the reference number 630A is controlled by the TTS conversion script setting module 630.

In addition, in the accompanying FIG. 5, the same reference numerals are assigned to the parts performing the same functions as the attached FIG. In FIG. 5, a region referred to by reference number 100B is a view binder for examining the contents of the loaded presentation material, and when a page shown in reference number 100A is clicked on, a region that is previously displayed on the page is displayed. .

Therefore, the TTS module 400 loads the text input by the operator in the area 630A and expresses the fostering data for the corresponding text, and the page switching is performed by the sliding method due to the nature of the presentation material. Therefore, each page of the presentation will be discontinuous on the script describing the page.

In other words, if the page is not converted, only the TTS conversion of the page is performed.

In addition, since the TTS module 400 classifies the training data according to gender and age groups, it is linked to the gender and age of the avatar set by the operator's setting or the control of the 3D avatar setting module 640. Is set.

After the script has been edited as described above, returning to the production edit screen 700A shown in FIG. 4 is displayed on the screen as shown in FIG.

In FIG. 6, reference numerals are omitted since the same screen as in FIG. 4 is described. In the following description, the operation of the synchronization control module will be described by referring to the reference numerals of FIG. 4.

The user may operate the 3D avatar by including the synchronization source (the sound (including background music) for enhancing the effect of the presentation material) located in the area related to the synchronization point setting module 630 referred to by reference number 620A. ) Will be adjusted.

At this time, the method of adjusting the synchronization time point is displayed in an area referred to by reference numeral 620A, and the data linked with each module can be moved by using a computer mouse or the like in a drawing manner.

Therefore, as shown in FIG. 6 to which the operator attaches the synchronization point, if the operator has set the presentation contents and the time point according to the "script", "action", "expression", "effect", and "effect sound", the progress according to the overall synchronization is It proceeds with the video timeline, and at the time point referred to as TA, the TTS module 400 and the 3D engine module 300 do not operate, and the MP3 (e.g. .MP3) files are provided as background sounds.

Afterwards, when the time is referred to as the reference TB, the MP3 (e.g., MP3) file designated as the sound effect is provided as the background sound, and the TTS module 400 is linked to the script. Introducing Brain City. ”The fostering expression of certain syllables takes place simultaneously.

Thereafter, when time passes and is referred to as a reference number TC, only one of the 3D engine modules 300 is operated, which is a point in time during which the user requests the "greeting and clapping" operation.

The operator repeatedly performs such a process to complete the production of the avatar motion as a presenter, the presentation contents, and the various sounds for enhancing the presentation effect, and then to produce the final result. Will be requested.

Accordingly, the production editing control module 610 controls the production editing module, which is referred to by the reference number 700, to request that the contents set by the operator to date are generated as one integrated presentation material.

Then, the materials edited in the production editing module 700 generates the actual integrated presentation data through the result generation and loading module, which is referred to by reference number 800 together with the link information.

The result generation and loading module 800 also plays a role of reading in order to modify the integrated presentation material previously prepared through the above-described process.

When the integrated presentation data is executed through the above-described process, the avatar animation and the presentation data are simultaneously displayed in the area divided into the main screen and the sub screen as shown in FIG. 7 and the table of contents or the script (comment) in the space of the margin. Etc. are displayed.

In this case, synchronized guidance and sound are expressed through speakers.

In addition, FIG. 7 illustrates an example in which an avatar animation is displayed on a sub screen of a presentation material on the main screen, and FIG. 8 is a view in which a narration mode is displayed at the request of a user. This is an example in which the presentation data is displayed on the sub screen by the PIP method.

As an example of applying the editing and editing system of the narrator multimedia local material using the 3D module and the TTS module according to the present invention operating as described above, the avatar for narration has a sign language operation. You will also be familiar with the presentation.

An example is shown in FIG. 9 attached.

9 is another exemplary embodiment of the configuration of a system for producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention. It was developed for the hearing impaired by adding (310).

Since the configuration and operation illustrated in FIG. 9 are not substantially different from those of FIG. 1, the description of the overall operation is omitted, and the operation and features of the sign language operation engine module 310 are described with reference to FIG. 10. Let's take a look.

FIG. 10 is an exemplary configuration diagram of a sign language operation engine module 310 for the hearing impaired in FIG. 9, wherein the narration script set through the TTS conversion script setting module 630 is a TTS module 400. Sign language data loading to access the data for the sign language operation based on the words and the search based on the word and the search in the database 500 according to the input request signal and the script recognition module 311 that receives the input when recognized to the side Module 314, a localization data loading module 313 for accessing data on a gesture operation based on consonants and vowels based on consonants and vowels in the database 500 according to an input request signal, and the sign language according to a control signal A data synthesizing module 315 for synthesizing the data according to the hand motions accessed by the data loading module 314 and the localized data loading module 313 and transferring the data to the 3D engine module 300A. On the basis of the script recognized through the script recognition module 311, it is determined whether the sign language should be performed or a sign language among the gestures for communicating the message to the hearing impaired, and the data according to the sign language data loading module 314 is localized. Request the data loading module 313 and combine the access data of the sign language data loading module 314 and the geospatial data loading module 313 through the data synthesizing module 315 to generate final data suitable for the original script. It is composed of a sign language control module 312 to control whether or not.

In this case, the reason why the reference number of the 3D engine module is referred to as 300A in FIG. 9 is that the 3D engine module 300A when the sign language operation engine module 310 is driven by a user. Is not performed by the user through the three-dimensional (3D) avatar setting module 640, but by a request for a hand gesture provided by the data synthesis module 315 of the sign language operation engine module 310. Because.

In addition, the narration synchronization module referred to by reference numeral 316 which is not described in FIG. 10 is a sign language operation in accordance with the driving synchronization of the TTS module during synchronization of various data set through the synchronization point setting module 620. This is a configuration for providing a synchronization signal to the sign language determination control module 312 to be made, but is not an essential configuration.

Accordingly, the operation of the sign language operation engine module 310 is not normally operated. Referring to FIG. 1 to FIG. 8, the user may use the 3D module and the TTS according to the description of FIGS. 1 to 8. The narrator uses the (TTS) module to produce and edit the local multimedia materials, which are then used for presentations to the audience.

In this case, when the hearing impaired person is present in the audience, the user operates the production editing control module 610 to drive the sign language operation engine module 310.

Therefore, the 3D engine module 300A stops performing the previously set operation through the 3D avatar setting module 640 and maintains the most natural preset position for expressing sign language.

Subsequently, when the narration script set through the TTS conversion script setting module 630 is delivered to the TTS module 400 in the process of producing the presentation material, the script recognition module 311 receives the script recognition module 311. After recognizing the script, it is transmitted to the decision control module 312 whether or not the sign language is possible.

The sign language determination control module 312 determines whether to perform a sign language or a sign language among gestures for communicating the message to the hearing impaired, and sends the data according to the sign language data loading module 314 and the ground data loading module 313. First, and the access data of the sign language data loading module 314 and the branch data loading module 313 through the data synthesizing module 315 to control the final data suitable for the original script. do.

At this time, the screening criteria for sign language and paper currency includes a list of data for sign language operation stored in the database by the sign language determination control module 312, and based on the script recognized by the script recognition module 311, Compare the data list and ask for sign language information if it is in the data list, and request localization information if it is not in the data list.

Accordingly, the sign language data loading module 314 sequentially accesses the hand gesture corresponding to the sign language requested by the sign language determination control module 312 by accessing the database 500, and sequentially outputs the sign language data loading module 313. ) Also accesses the hand gesture corresponding to the paper requested by the sign language determination control module 312 in the database 500 to sequentially output.

In the case of localization, because it has data (including numbers) according to hand gestures based on consonants and vowels, the amount of data is small, while it takes a lot of time to convey the same meaning as compared to sign language. Sign language has the disadvantage of having a large amount of data because it has data according to hand gestures based on words and surveys, but it takes less time to convey the same meaning compared to paper.

Therefore, the present invention has been described with reference to preferably mixing hydration and localization, but any one of them may be selected.

Thereafter, the data according to the hand gesture accessed by the sign language data loading module 314 and the branch data loading module 313 is transferred to the data synthesizing module 315, and the data synthesizing module 315 is the sign language determination control module. Data for the final hand gesture suitable for the original script by receiving only one of the data transmitted from the sign language data loading module 314 and the ground data data loading module 313 at an arbitrary time point according to the control signal provided by 312. After generating the 3D (3D) is transmitted to the engine module (300A) side.

The 3D engine module 300A synthesizes the data of the hand gesture and the appearance of the avatar, generates a 3D animation as if the avatar is a sign language, and delivers the 3D animation to the production editing module 700.

Therefore, the sign language action of the avatar is effective to fully understand the contents of the presentation even for the hearing impaired.

Each module shown in FIG. 1 or FIG. 2 described above or each module shown in FIG. 9 or FIG. 10 and a module providing a working environment shown in FIGS. The method of producing and editing a narrator multimedia local data using the TTS module and a system thereof may be stored and distributed on an arbitrary nonvolatile recording medium.

While the invention has been shown and described in connection with specific embodiments thereof, it is well known in the art that various modifications and changes can be made without departing from the spirit and scope of the invention as indicated by the claims. Anyone who owns it can easily find out.

As described above, if a method for producing and editing a narrator multimedia local material using a 3D module and a TTS module according to the present invention and a system according to the present invention are provided, together with a display according to a slide method of a presentation material The 3D avatar can be placed in a virtual space to play the role of a presenter. At the same time, the voice and sound (including background music) can be synchronized with the producer, and the presentation materials and various surrounding environments can be edited as needed.

Therefore, even if the presenter is not mastered, the contents of the presentation can be delivered accurately to any subject, and because it is not a monotonous presentation, the curiosity of the subject is stimulated, and thus the presentation contents are delivered.

In addition, adding a configuration for implementing a sign language operation of a 3D avatar enables the hearing impaired to fully understand the contents of the presentation.

Claims (30)

A first step of loading any presentation material having a particular format; A second step of setting a narration script for the presentation material loaded in the first step and converting the narration script into sound data according to the development; A third step of producing a 3D animation by selecting predetermined data for each head, lips, and body part at an arbitrary time point to form a 3D avatar narrator for the presentation material loaded in the first process; Process; A fourth step of arbitrarily selecting a presentation time point for the sound data converted in the second step and the three-dimensional (3D) animation produced in the third step in response to the presentation data loaded in the first step; A fifth process of collecting the results performed through the first to fourth processes into one narrator multimedia data; And A sixth process in which the 3D animation and sound data are externally displayed based on a time point selected in the fourth process during the presentation of the narrator multimedia data collected through the fifth process; Method of producing and editing Narrator multimedia local material using a 3D (3D) module and TTS (TTS) module, characterized in that it comprises a. The method of claim 1, During the presentation of the narrator multimedia data collected in the fifth process, the seventh process of externally presenting the presentation material and sound data on the basis of the time point selected in the fourth process during the main display of the 3D animation. Method for producing and editing the Narrator multimedia local material using the 3D (3D) module and TTS module, characterized in that it further comprises. delete The method of claim 1, In the case of loading the narrator multimedia data collected through the fifth process in the first process, the predetermined data for each head, lips, and body part may be randomly formed to form a 3D avatar narrator through the third process. Method of producing and editing Narrator multimedia local material using a 3D module and a TTS module, which are reselectable by view point. The method of claim 1, The third process includes a first step of setting data of a basic appearance of a human figure; A second step of setting data of a gender of the human figure set in the first step and a plurality of clothes corresponding to each gender; A third step of dividing the body motion into a plurality of forms and setting data according to the human shape set in the first step; A fourth step of dividing the association operation between the lips and the mouth around the face into a plurality of forms and setting data according to the human shape set in the first step; A fifth step of dividing the movements of other parts of the face other than the mouth area into a plurality of forms and setting data according to the human shape set in the first step; A sixth step of loading a corresponding data and setting a reference avatar when a gender and costume of a human figure set in the first and second steps are set by an avatar generation request; And After the sixth step, if a worker arbitrarily designates the various operations previously set through the third to fifth steps by the avatar's movement request, the third avatar is set to the reference avatar data set through the sixth step. The three-dimensional (3D) module and the TTS comprising a seventh step of forming a real-time avatar movement in response to the request of the worker as the various operations previously set through the steps to the fifth step is linked and merged How to create and edit Narrator multimedia local data using (TTS) module. delete delete delete The method of claim 1, The sound data converted in the second process is classified by gender or age and is produced and edited by the 3D module and TTS module. . The method of claim 1, The fourth process includes a first step having a time slot having an arbitrary length of time; Through the third process, data of basic appearance of the human shape, data of the sex of the human shape and a plurality of clothes corresponding to each gender are set, and then the association between the body motion, the head motion, the lips and the mouth around the human shape A second step of arranging the operation at an arbitrary position of the time slot provided in the first step; A third step of disposing text corresponding to a script to be fostered and converted through the second process at an arbitrary position of a time slot provided in the first step; And The three-dimensional (3D) module and the TS comprises a fourth step of displaying a variety of data present in the same position through the time slot having an arbitrary time length to be simultaneously displayed in conjunction with the operation of the relevant module. How to create and edit Narrator multimedia local data using (TTS) module. delete A presentation material loading module for loading and temporarily storing presentation materials generated using various tools for presentations; A sound source loading module for loading and temporarily storing sound sources (sound data, background music data); A 3D engine module for forming a virtual space and generating a 3D image according to the implementation of the avatar and the operation of the avatar in the virtual space; A TTS module which converts and optionally provides texts into nurturing texts; A database storing source data for supporting the operation of the 3D engine module and the TTS module; By predicting and editing the results of the presentation by automatically merging and synchronizing the sources provided by the presentation loading module, the sound source loading module, the 3D engine module, and the TTS module by external request. A production editing module for modifying; A result generation and loading module for generating presentation data edited through the production editing module as one independent result or loading the generated result to the production editing module; And The production and editing system of a narrator multimedia local material using a 3D module and a TTS module, characterized in that it comprises a control module for arbitrarily controlling the production editing module by an external request. The method of claim 12, The control module accesses the presentation data to be produced and edited through the production editing module and the data to be modified through the result generation and loading module, and accesses the necessary sound source through the sound source loading module. A production editing control module for gathering necessary materials and generating a final version edited by the production editing module as a result through the result generation and loading module; A TTS conversion script setting module for inputting and modifying text data desired to be expressed by the production editing module as a source for the operation of the TTS module; 3D for selecting various virtual spaces and avatars that can be provided by the 3D engine module through the production editing module and for setting the movement and facial expression of the avatar at any time. Avatar setting module; And The synchronizing time setting module is configured to set the operation time of the TTS conversion script setting module and the operation time of the 3D avatar setting module through the production editing module. A system for producing and editing Narrator multimedia local materials using a 3D module and a TTS module. A storage medium, wherein each module according to claim 12 or 13 is stored. A first step of loading any presentation material having a particular format; A second step of setting a narration script for the presentation material loaded in the first step and converting the narration script into sound data according to the development; A third step of generating narration data for communication by recognizing a narration script converted into sound data through the second step; In order to form a three-dimensional (3D) avatar narrator for the presentation material loaded in the first process, predetermined data for each head, lips, and body are selected at an arbitrary time, and the data of the hand motion generated in the third process is selected. A fourth step of merging to create a three-dimensional (3D) animation; A fifth step of arbitrarily selecting a presentation time point for the sound data converted in the second step and the three-dimensional (3D) animation produced in the fourth step in response to the presentation data loaded in the first step; A sixth process of collecting the results performed through the first to fifth processes into one narrator multimedia data; And A seventh process in which the 3D animation and sound data are externally displayed based on a time point selected in the fifth process during the presentation of the narrator multimedia data collected through the sixth process; Method of producing and editing Narrator multimedia local material using a 3D (3D) module and TTS (TTS) module, characterized in that it comprises a. The method of claim 15, During the presentation of the narrator multimedia data collected in the sixth process, the eighth process of displaying the presentation data and sound data to the outside based on the time point selected in the fifth process during the main display of the 3D animation. Method for producing and editing the Narrator multimedia local material using the 3D (3D) module and TTS module, characterized in that it further comprises. The method of claim 15, In the case of loading the narrator multimedia data collected through the sixth process in the first process, the narration script can be edited through the second process, using a 3D module and a TTS module. Narrator Create and edit local multimedia materials. The method of claim 15, The third process includes a first step of setting data on hand gestures for communication; A second step of recognizing a narration script converted into sound data through the second process; And And a third step of extracting data corresponding to the narration script recognized in the second step from the data on the hand gesture set through the first step. 3D module and TTS How to create and edit Narrator multimedia local data using module. The method of claim 18, Narrator multimedia local using a 3D (3D) module and TTS (TTS) module characterized in that the data for the hand gesture for communication set through the first step comprises a hand gesture divided into consonants, vowels and numbers How to make and edit materials. The method of claim 18, The data on hand gestures for communication set up through the first step may include hand gestures divided into words and surveys, and the narrator multimedia local data using the 3D module and TTS module may be used. Production editing method. The method of claim 15, The fourth process includes a first step of setting data of a basic appearance of a human figure; A second step of setting data of a gender of the human figure set in the first step and a plurality of clothes corresponding to each gender; A third step of dividing the association operation between the lips and the mouth around the face into a plurality of forms and setting the data according to the human shape set in the first step; A fourth step of dividing the movements of other parts of the face other than the mouth around the human shape set in the first step into a plurality of forms and setting data accordingly; A fifth step of classifying hand gestures for communication in a plurality of forms and setting data according to the human shape set in the first step; A sixth step of loading a corresponding data and setting a reference avatar when a gender and costume of a human figure set in the first and second steps are set by an avatar generation request; And After the sixth step, the operator arbitrarily designates a variety of motions previously set through the third and fourth steps by the avatar's motion request and based on the data on the hand motions generated through the third step. The hand gesture set in advance through the fifth step is automatically assigned and various operations preset through the third through fifth steps are linked to and merged with the data of the reference avatar set through the sixth step. And a seventh step of forming a real-time avatar movement at the request of an operator. 3. The method of claim 3, wherein the narrator multimedia local material is edited using a 3D module and a TTS module. delete The method of claim 15, The sound data converted in the second process is classified by gender or age and is produced and edited by the 3D module and TTS module. . The method of claim 15, The fifth process includes a first step having a time slot having an arbitrary length of time; Through the fourth process, data of basic appearance of the human figure, data of the gender of the human figure and a plurality of clothes corresponding to each gender are set, and then the association between the body motion, the head motion, the lips and the mouth around the human shape A second step of arranging the operation at an arbitrary position of the time slot provided in the first step; A third step of disposing text corresponding to a script to be fostered and converted through the second process at an arbitrary position of a time slot provided in the first step; And The three-dimensional (3D) module and the TS comprises a fourth step of displaying a variety of data present in the same position through the time slot having an arbitrary time length to be simultaneously displayed in conjunction with the operation of the relevant module. How to create and edit Narrator multimedia local data using (TTS) module. The method of claim 24, Loading an arbitrary sound data and arranging at an arbitrary position of the time slot provided in the first step, Narrator multimedia local using the 3D (3D) module and TTS module, characterized in that it further comprises How to make and edit materials. A presentation material loading module for loading and temporarily storing presentation materials generated using various tools for presentations; A sound source loading module for loading and temporarily storing sound sources (sound data, background music data); A TTS module which converts and optionally provides texts into nurturing texts; A sign language operation engine module configured to generate data of a hand gesture for communication corresponding to text provided to the TTS module; Three-dimensional (3D) to form a virtual space and to create a three-dimensional image in accordance with the implementation of the avatar and the operation of the avatar in the virtual space, the hand gesture to perform a hand gesture generated by the sign language engine module An engine module; A database storing source data for supporting operations of the 3D engine module, the TTS module, and the sign language operation engine module; By predicting and editing the results of the presentation by automatically merging and synchronizing the sources provided by the presentation loading module, the sound source loading module, the 3D engine module, and the TTS module by external request. A production editing module for modifying; A result generation and loading module for generating presentation data edited through the production editing module as one independent result or loading the generated result to the production editing module; And The production and editing system of a narrator multimedia local material using a 3D module and a TTS module, characterized in that it comprises a control module for arbitrarily controlling the production editing module by an external request. The method of claim 26, The control module accesses the presentation data to be produced and edited through the production editing module and the data to be modified through the result generation and loading module, and accesses the necessary sound source through the sound source loading module. A production editing control module for gathering necessary materials and generating a final version edited by the production editing module as a result through the result generation and loading module; A TTS conversion script setting module for inputting and modifying text data desired to be expressed by the production editing module as a source for the operation of the TTS module; 3D for selecting various virtual spaces and avatars that can be provided by the 3D engine module through the production editing module and for setting the movement and facial expression of the avatar at any time. Avatar setting module; And The synchronizing time setting module is configured to set the operation time of the TTS conversion script setting module and the operation time of the 3D avatar setting module through the production editing module. A system for producing and editing Narrator multimedia local materials using a 3D module and a TTS module. The method of claim 26 or 27, The sign language operation engine module includes: a script recognition module that receives a narration script set through a TTS conversion script setting module and recognizes the narration script when it is transmitted to the TTS module; A sign language data loading module for accessing data on a sign language operation according to a gesture based on a word and a survey in a database according to an input request signal; A localization data loading module for accessing data on a localization operation according to a gesture based on consonants and vowels in a database according to an input request signal; A data synthesizing module for synthesizing data according to a hand gesture accessed from the sign language data loading module and the geosig data loading module according to a control signal, and transferring the data to the 3D engine module; And Based on the script recognized through the script recognition module, it is determined whether a sign language or a sign language should be performed among hand gestures that communicate to the hearing impaired, and requests the sign language data loading module and the sign data data loading module accordingly. 3D comprises a sign language determination control module for controlling the combination of the access data of the sign language data loading module and geospatial data loading module through the data synthesis module to generate the final data suitable for the original script. A system for producing and editing Narrator multimedia local materials using (3D) and TTS modules. The method of claim 28, A narration synchronization module for providing a synchronization signal to the sign language determination control module to perform a sign language operation in accordance with the driving synchronization of the TTS module among the synchronization of various data set through the synchronization time setting module is further performed. A system for producing and editing Narrator multimedia local materials using a 3D module and a TTS module. A storage medium, wherein each module according to claim 26 or 27 is stored.

Images