JP6647512B1 - Program production device, program production method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program production apparatus or the like suitable for reflecting information of people who distribute / broadcast or view a program in the program. SOLUTION: A program production device 1 generates moving image data using characters. The effect determination unit 5 determines an effect using a character. The moving image creation unit 7 generates the moving image data using the effect determined by the effect determination unit 5. The effect determination unit 5 adjusts the movement of the character according to the file format of the moving image data created by the moving image creating unit 7 and / or adjusts at least one of the character dialogue, BGM, and sound effect, Decide the production. [Selection diagram] Fig. 1

Description

  The present invention relates to a program production device, a program production method, and a program, and more particularly, to a program production device that generates moving image data using characters.

  The applicant is researching and developing a system for producing a program using characters using information input by a creator, as described in Patent Documents 1 and 2, for example.

Japanese Patent No. 4725936 Japanese Patent No. 4725918

  However, the techniques described in Patent Literatures 1 and 2 and the like have been sufficiently studied to reflect information of people (such as broadcasters) and viewers who distribute or broadcast a program in the program. Did not.

  Therefore, an object of the present invention is to propose a program production device or the like suitable for reflecting information of people who distribute / broadcast or view a program on the program.

  A first aspect of the present invention is a program production device that generates moving image data using a character, an effect determining unit that determines an effect using the character, and generates the moving image data using the effect. A moving image creating unit, wherein the effect deciding unit adjusts the movement of the character according to a file format of the moving image data and / or adjusts at least one of dialogue, BGM, and sound effect of the character. To determine the effect.

  A second aspect of the present invention is the program production device according to the first aspect, wherein if the creator gives an instruction not to make adjustments in accordance with the file format, the effect determination unit is common to a plurality of file formats. If the effect is determined and the creator gives an instruction to make an adjustment according to a file format, the effect determination unit adjusts the movement of the character according to each file format, and / or The effect is determined by adjusting at least one of the words, BGM, and sound effects of the character.

  A third aspect of the present invention is the program production device according to the second aspect, wherein, if the creator gives an instruction not to perform adjustment according to a file format, the moving image creating unit uses the effect, It generates first moving image data in a file format related to an operating system of a computer for realizing the program production device, and converts the first moving image data to generate moving image data in another file format.

  A fourth aspect of the present invention is the program production device according to the third aspect, wherein the moving image creating unit converts the first moving image data to generate moving image data in another file format. The display of subtitles in the first moving image data is adjusted according to the converted file format.

  A fifth aspect of the present invention is a program production method for generating moving image data using a character, wherein an effect determination unit provided in the information processing device determines an effect using the character, A moving image creating unit included in a processing device includes a moving image creating step of generating the moving image data using the effect, and in the effect determining step, the effect determining unit determines the character according to a file format of the moving image data. And / or adjust at least one of the character's dialogue, BGM and sound effect to determine the effect.

  A sixth aspect of the present invention is a program for causing a computer to function as a program production device that generates moving image data using characters, wherein the program production device determines an effect using the characters. A determining unit, and a moving image creating unit that generates the moving image data using the effect, wherein the effect determining unit adjusts the movement of the character according to a file format of the moving image data, and / or The effect is determined by adjusting at least one of the words, BGM, and sound effects of the character.

  Note that the present invention may be regarded as a computer-readable recording medium that records the program according to the sixth aspect of the present invention.

  The applicant has paid attention to the fact that the environment in which a moving image is distributed / broadcasted or viewed by a viewer is expressed in a file format of moving image data. According to each aspect of the present invention, it is possible to appropriately determine an effect using a character according to the file format of moving image data.

  Further, for example, in the case of broadcasting on a television, it is necessary to conform to a predetermined standard. According to the present invention, it is possible to generate moving image data according to the file format of the moving image data. For example, it is possible to generate a moving image and distribute it on the Internet, and simultaneously perform live broadcasting on a television.

2A is a block diagram illustrating an example of a configuration of a program production device 1 according to an embodiment of the present invention, and FIG. 2B is a flowchart illustrating an example of an operation.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to this embodiment.

  FIG. 1 is a block diagram showing an example of the configuration (a) of the program production device 1 according to the embodiment of the present invention, and a flowchart showing an example of the operation (b).

  The program production device 1 includes an input unit 3, an effect determination unit 5 (an example of an “effect determination unit” in the claims of the present application), a moving image creating unit 7 (an example of a “moving image creating unit” in the claims of the present application), and an output. It comprises a unit 9, an input data storage unit 11, an effect data storage unit 13, a material data storage unit 15, and a moving image data storage unit 17.

  In the input unit 3, a creator inputs input data. The input data storage unit 11 stores input data. The input data includes program creation data for producing a program and output designation data relating to the file format of the moving image data to be output.

  The effect data storage unit 13 stores effect data used by the effect determination unit 5 to determine an effect. The effect data is, for example, information for emotion analysis of information on characters and the like in the program creation data (designation of characters and movements of the characters, information on materials presented together with the characters, etc.), and characters for expressing specific emotions. Information that specifies the movement of a person (expressions, gestures, etc.), information that specifies the shape of the mouth when expressing specific emotions and speaking lines, inflections when vocalizing words that express specific emotions, etc. The information includes information such as BGM for expressing a specific emotion and sound effect.

  The effect determination unit 5 analyzes the emotion information and the like to be expressed by using the information input by the creator and refers to the effect data to determine the effect of the character and the effect such as dialogue, BGM, and sound effects. (See Patent Document 1, etc.). The effect may include, for example, lighting, camera position, and the like.

  The material data storage unit 15 stores material data used by the moving image creating unit 7 to create moving image data. The material data includes, for example, information for specifying the shape of the character, voice information for producing dialogue, sound information such as BGM and sound effects, and the like.

  The moving image creation unit 7 uses the material data stored in the material data storage unit 15 to generate moving image data according to the effect determined by the effect determination unit 5. The moving image data storage unit 17 stores the moving image data created by the moving image creation unit 7 (see Patent Document 1 and the like).

  The output unit 9 distributes the moving image data stored in the moving image data storage unit 17 to an information processing terminal (smartphone or the like) used by a viewer using the Internet, or broadcasts it to a television through a broadcaster. , Displayed to the viewer.

  The moving image data includes at least video data, sound data, and subtitle data. The video data is data for specifying a display image to be displayed as time passes. The sound data is data for specifying a sound to be reproduced as time passes. The caption data is data for specifying a caption to be displayed together with the video data.

In this embodiment, the moving image data storage unit 17 stores N pieces of moving image data in different file formats (N is a natural number of 2 or more). The moving image data in the n-th file format (n is a natural number from 1 to N) is referred to as “n-th moving image data”. The n-th moving image data 21 _n includes n-th video data 23 _n , n-th sound data 25 _n, and n-th subtitle data 27 _n . Hereinafter, it is assumed that N is 3.

The first moving image data 21 ₁ is associated with the operating system of the computer (OS) for realizing the program production apparatus 1. For example, when the operating system (OS) is Windows (registered trademark), the format is Windows Media format. On a PC using Windows as an OS, it is expected that a process of generating such moving image data in a file format is easily realized.

  The second moving image data is generally used when distributed on the Internet, such as the MP4 video file format. Usually, the amount of information is smaller than that of the first moving image data in order to reduce the file capacity.

  The third moving image data conforms to a standard set in each industry. For example, moving image data in the MXF file format in the broadcasting industry. Various standards are defined in the MXF file format. For example, the range of the loudness of the sound is determined so that the loudness of the sound does not extremely differ depending on the program. Further, the display range of the subtitle is determined so that the subtitle is appropriately displayed on a television or the like. Such a standard is not defined in the first moving image data, the second moving image data, and the like.

  Usually, the first moving image data and the second moving image data are not restricted by the standard. Therefore, if the first moving image data suitable for the OS is generated and converted to the second moving image data, the first moving image data and the second moving image data can be obtained.

  On the other hand, for the third moving image data, for example, in the case of television broadcasting, it is necessary to change the sound volume or the display method of the subtitles so as to conform to the standard of the MXF file format. Usually, simple conversion was not enough, and was manually changed to meet the standard. As a result, even if the first moving image data is created, it is practically difficult to convert the first moving image data to the third moving image data and broadcast it live on a television.

  It is also conceivable to create third moving image data and convert it into first moving image data and second moving image data. However, in the MXF file format, there are unique restrictions on sound, subtitles, and the like, and the first moving image data and the second moving image data are unnecessarily restricted.

  The inventor has paid attention to the fact that the file format of the moving image data is related to the environment for distribution / broadcasting and the environment for viewers to view. For example, the tempo spoken by the moderator will be significantly different from that in a television program and in an environment where the audience is in front of you, such as on a stage. Similarly, it is highly likely that the current viewer will feel uncomfortable even if the video data suitable for viewing on the Internet is reproduced on the television as it is. In this embodiment, the moving image creating unit 7 reduces the work of the broadcaster or the like by creating the moving image data using the effect determined by the effect determining unit 5 in consideration of the file format of the generated moving image data. At the same time, it is possible to create moving image data reflecting the viewing environment of the viewer.

  However, depending on the program, for example, in the case of simultaneous distribution and broadcasting, it may be desirable to make it possible to view the same content as moving image data on the Internet on a television or the like. Therefore, in the present embodiment, the creator of the program production device 1 can also instruct to create moving image data having contents common to a plurality of file formats. In this case, the moving image creation unit 7 creates moving image data having common contents after satisfying the restrictions required by each file format.

  An example of the operation of the program production device 1 in FIG. 1A will be described with reference to FIG.

  First, the creator inputs at least program creation data and output designation data using the input unit 3 (step ST1). In the following, for the sake of specific description, the program creation data is assumed to be such that a character speaks a line saying “Thank you very much.” And the subtitle is displayed. The output designation data is output in the MP4 video file format and the MXF file format. The case where the creator specifies creation of moving image data having common contents and the case where the creator does not specify it will be described.

  The moving image creation unit 7 determines whether creation of moving image data having common contents is specified in the output designation data (step ST2).

  A case where creation of moving image data having common contents is designated in the output designation data will be described. In this case, the determination in step ST2 is “YES”.

  The effect determination unit 5 determines an effect common to a plurality of file formats (step ST3). For example, first analyze the words "Thank you for always being nice to me." From the “always” (always in English) part, the fact that repetition and continuous human relationships are formed is extracted. From "thank you" (thank you in English), extract positive emotions such as "thank you". The effect deciding unit 5 decides to perform a “convey thanks” based on the continued trust relationship as an effect using the character, and to say a word “always thank you”. Then, a BGM and a sound effect that match this are determined.

Moving image creating unit 7 in accordance with production which effect determination unit 5 is determined, to generate the first video data 21 ₁ (step ST4). Specifically, as the first image data 23 _1, "the continued trust relationship based convey appreciation" in correspondence with the operation moving the character. As the first sound data 25 ₁ , a voice of a line saying “Thank you always.” Is reproduced, and “BGM” and sound effects are reproduced, such as “Thank you based on continued trust.” As the first subtitle data 27 ₁ , a subtitle “Always thank you.” Is displayed.

The moving image creation unit 7 converts the first moving image data 21 ₁ into the second moving image data 21 ₂ and the third moving image data 21 ₃ (step ST5). The process of converting the first moving image data 21 ₁ into the second moving image data 21 ₂ can be realized by a process of converting a general file format. In the process of converting the third moving image data 21 _3, to fit the standard, for example, with a third sound data 25 ₃ by adjusting the first sound data 25 ₁ size, the first subtitle data display 27 ₁ and adjusting the display position and the third subtitle data 27 _3. Thus, the first moving image data 21 ₁ , the second moving image data 21 _2, and the third moving image data 21 ₃ are moving image data having a common effect.

  Note that a plurality of file format moving image data may be created based on the same effect. In this case, a plurality of moving image data may be created in parallel.

  A case where creation of moving image data having common contents is not specified in the output specification data will be described. In this case, the determination in step ST2 is “NO”.

  The effect determination unit 5 determines an effect for the second moving image file (step ST6). From the words "Thank you always.", "Continued relationship of trust" and "Emotion of thanks" are extracted. The second moving image file is used for distribution on the Internet and the like. In this case, for example, when viewing with a smartphone, there is a possibility that the screen is not continuously viewed in order to view in an environment where the viewer is moving. Then, the auditory information becomes important, and the visual information is desirably in a mode in which the emotion that the user wants to convey the most when viewed partially. Therefore, it is considered effective for the character to strongly and continuously express positive emotions such as “thanks” to be conveyed by the action and the dialogue. Therefore, the effect determination unit 5 expresses the feeling of "thank you" by the movement of the character and the dialogue, BGM, sound effects, etc., including the "always" stage, and expresses the "trust relationship" in an auxiliary manner. Decide the production.

The moving image creating unit 7 generates the first video data 23 ₁ , the first sound data 25 _1, and the first subtitle data 27 ₁ according to the effect determined by the effect determining unit 5 to generate the first moving image data 21 ₁ . The moving image creation unit 7 converts the first video data 23 ₁ , the first sound data 25 _1, and the first subtitle data 27 ₁ of the first moving image data 21 ₁ , and respectively converts the second video data of the second moving image data 21 ₂ . The second moving image data 21 ₂ is generated as the data 23 ₂ , the second sound data 25 _2, and the second subtitle data 27 ₂ (step ST7).

  The moving image creation unit 7 determines whether or not moving image data of all file formats has been generated (step ST8). When all the file formats have been generated, the process ends. If there is a file format that has not been generated, the process returns to step ST6.

In this example, since the third moving image data 21 ₃ has not been generated, “NO” is returned, and the process returns to step ST6.

The effect determination unit 5 determines an effect for the third moving image file (step ST6). From the words "Thank you always.", "Continued relationship of trust" and "Emotion of thanks" are extracted. The third video data 21 _3, for example, is used for television broadcasting. In this case, there is a high possibility that the viewer is in an environment of continuous viewing and grasps the visual information as a whole. Then, the character can convey “thanks” after confirming the “trust relationship” with the viewer. For this reason, it is effective for the character to form a serious and serious atmosphere in the words "always" and to carefully express positive emotions such as "thanks" in the "thank you." For this reason, the effect determination unit 5 expresses the trusting relationship at the “always” stage and strongly expresses “thanks” at the “thank you” stage, based on the character's movements, dialogue, BGM, sound effects, and the like.

The moving image creating unit 7 converts the first video data 23 ₁ , the first sound data 25 _1, and the first subtitle data 27 ₁ according to the effect determined by the effect determining unit 5 so as to conform to the standard of the third moving image data 21 _3. generated for generating a first video data 21 _1. The moving image creating unit 7 converts the first video data 23 ₁ , the first sound data 25 _1, and the first subtitle data 27 ₁ of the first moving image data 21 ₁ , and respectively converts the third video of the third moving image data 21 ₃ . The third moving image data 21 ₃ is generated as the data 23 ₃ , the third sound data 25 _3, and the third subtitle data 27 ₃ (step ST7).

  The moving image creation unit 7 determines whether or not moving image data of all file formats has been generated (step ST8). All file formats have been generated, and the process ends.

The moving image data storage unit 17 may store, for example, the same file format but different compression degrees as different moving image data. Further, in the example of FIG. 1, a case has been described where the second moving image data 21 ₂ and the third moving image data 21 ₃ are sequentially generated, but a plurality of moving image data may be generated in parallel.

Reference Signs List 1 program production device, 3 input unit, 5 effect determination unit, 7 moving image creation unit, 9 output unit, 11 input data storage unit, 13 effect data storage unit, 15 material data storage unit, 17 moving image data storage unit, 21 _n n video data, 23 _n the n-th video data, 25 _n the n-th sound data, 27 _n the n-th subtitle data

Claims (6)

A program production device that generates moving image data using characters,
An effect determination unit that determines an effect using the character,
A moving image creating unit that generates the moving image data using the effect,
The effect deciding unit adjusts the movement of the character according to the file format of the moving image data and / or adjusts at least one of the character's dialogue, BGM, and sound effect to determine the effect. , Program production equipment. If the creator instructed not to make adjustments according to the file format, the effect determination unit determines the effect common to a plurality of file formats,
If the creator gives an instruction to make an adjustment according to the file format, the effect determination unit adjusts the movement of the character according to the respective file format, and / or the words, BGM, and the like of the character. The program production device according to claim 1, wherein the effect is determined by adjusting at least one of sound effects. If the creator has instructed not to make adjustments according to the file format, the video creation unit:
Using the effect, generate first video data in a file format associated with an operating system of a computer for realizing the program production device,
The program production device according to claim 2, wherein the first moving image data is converted to generate moving image data in another file format.   The moving image creator, when converting the first moving image data to generate moving image data in another file format, adjusts the display of subtitles in the first moving image data according to the converted file format. The program production device according to claim 3. A program production method for generating moving image data using characters,
An effect determination unit provided in the information processing device, an effect determination step of determining an effect using the character,
A moving image creating unit included in the information processing apparatus includes a moving image creating step of generating the moving image data using the effect,
In the effect deciding step, the effect deciding unit adjusts the movement of the character according to a file format of the moving image data and / or adjusts at least one of dialogue, BGM, and sound effect of the character. A program production method for determining the effect. A program for causing a computer to function as a program production device that generates moving image data using characters,
The program production device,
An effect determination unit that determines an effect using the character,
A moving image creating unit that generates the moving image data using the effect,
The effect deciding unit adjusts the movement of the character according to the file format of the moving image data and / or adjusts at least one of the character's dialogue, BGM, and sound effect to determine the effect. ,program.

Images