JP2025065491A - A system, a method and a program for distributing moving images including animations of character objects generated based on the movements of actors - Google Patents

Abstract

To prevent selection of another attachment object to be attached to a portion overlapping to a decorative object attached to a character object, in a decorative object selection screen.SOLUTION: A server device 20 distributes a moving image including animation of a character object which is generated on the basis of a motion of an actor. In the moving image, a first decorative object is displayed in association with a first portion of the character object. The server device 20 generates a decorative object selection screen including an image of a second decorative object, according to reception of a display request for requesting display of the second decorative object from a viewing user. When the second decorative object is an object to be displayed in association with a second portion different from the first portion of the character object, the decorative object selection screen includes a display element for selecting the second decorative object.SELECTED DRAWING: Figure 1

Description

The disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program that distribute videos that include animations of character objects generated based on the movements of actors.

There has been known a video distribution system that generates animation of a character object based on the movement of an actor and distributes a video including the animation of the character object. Such a video distribution system is disclosed, for example, in JP 2015-184689 A (Patent Document 1).

There is also known a content distribution system that displays a gift object corresponding to an item purchased by a viewing user on a display screen in response to a request from the viewing user who is viewing content. For example, in the video distribution system disclosed in JP 2012-120098 A (Patent Document 2), a viewing user can purchase a gift item and provide the purchased gift item as a gift to a performer (content distributor). In this publication, it is considered desirable for the gift object to be displayed in the background area of the distribution screen so as not to interfere with the video.

JP 2015-184689 A JP 2012-120098 A

Displaying gift objects overlapping with video may result in a poor viewing experience for the viewing user. For example, if the main part of a video is obscured by a gift object, the viewer may feel that their viewing of the video is being interrupted. In particular, this problem may become more serious if a large number of gift objects are displayed overlapping with the video. For this reason, in the above-mentioned Patent Document 2, the gift objects are not displayed in the content display area where the video is displayed, but are displayed in the background area outside the content display area.

The objective of the present disclosure is to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above. One of the more specific objectives of the present disclosure is to provide a video distribution system, a video distribution method, and a video distribution program that can display a gift object overlapping with a video without degrading the viewing experience of the viewing user.

A video distribution system according to one embodiment distributes videos including animations of character objects generated based on the movements of actors, and includes one or more computer processors, which execute computer-readable instructions to cause a decorative object for which a first display request has been made by a viewing user viewing the video to be displayed in association with a body part of the character object that is determined based on mounting position information set for the decorative object when the decorative object is selected by someone other than the viewing user.

In one embodiment, the decorative object is selected by someone other than the viewing user.

In one embodiment, the decorative object is selected by a supporter who supports the distribution of the video.

In one embodiment, the decorative object is selected by the actor.

In one aspect, the one or more computer processors display the first object in the video in response to receiving a second display request from a viewing user who is viewing the video, the second display requesting the display of a first object different from the decorative object.

In one aspect, the second display request includes a display position designation parameter that designates a display position of the first object, and the first object is displayed in the video at a position designated by the display position designation parameter.

In one aspect, a movement direction parameter is included that specifies the movement direction of the first object, and the first object is displayed in the video as moving in the direction specified by the movement direction parameter.

In one aspect, the second display request includes trajectory parameters that specify a trajectory of the first object, and the first object is displayed in the video moving along the trajectory specified by the trajectory parameters.

In one aspect, an object display prohibition period is set within the distribution period of the video, and the first object and the decorative object are displayed in the video at a timing other than the object display prohibition period during the distribution period of the video.

In one embodiment, if the second display request is received during the object display prohibition period, the first object is displayed in the video after the object display prohibition period has elapsed.

In one aspect, the one or more computer processors accept a purchase request from the viewing user to purchase the decorative object, perform a payment process in response to the purchase request, and cancel the payment process if the decorative object is not selected by the end of the distribution of the video.

In one aspect, the one or more computer processors accept a purchase request from the viewing user to purchase the decorative object, perform a payment process in response to the purchase request, and, if the decorative object is not selected by the end of the distribution of the video, grant points to the viewing user.

In one aspect, the one or more computer processors receive a purchase request from the viewing user to purchase the decorative object, add the decorative object to a holding list that is a list of objects held by the viewing user in response to the purchase request, delete the decorative object from the holding list in response to receiving the first display request from the viewing user requesting display of the decorative object, and add the decorative object to the holding list if the decorative object is not selected by the end of distribution of the video.

In one aspect, the one or more computer processors provide the viewing user with purchasing information for purchasing a gift object that is purchasable in association with the video, the gift object including the decorative object, and the gift object including a unique gift object that is purchasable only in the video and a common gift object that is purchasable in videos other than the video.

One aspect relates to a video distribution method for distributing a video including an animation of a character object generated based on a movement of an actor by executing computer-readable instructions by one or more computer processors. The video distribution method includes a step of receiving a first display request for requesting display of a decorative object from a viewing user who views the video, and a step of displaying the decorative object in the video in association with a body part of the character object that is determined based on mounting position information set for the decorative object, when the decorative object is selected by a user other than the viewing user.

One aspect relates to a video distribution program that distributes a video including an animation of a character object generated based on the movement of an actor. The distribution program causes one or more computer processors to execute the steps of: accepting a first display request for requesting display of a decorative object from a viewing user who is viewing the video; and, when the decorative object is selected by someone other than the viewing user, displaying the decorative object in the video in association with a body part of the character object that is determined based on attachment position information set for the decorative object.

According to an embodiment of the present invention, gift objects can be displayed overlapping with video without degrading the viewing experience of the viewing user.

1 is a block diagram showing a video distribution system according to an embodiment. 2 is a schematic diagram showing the facilities of a studio for producing videos to be distributed by the video distribution system of FIG. 1. 2 is a diagram illustrating a possession list stored in the video distribution system of FIG. 1. 2 is a diagram illustrating a candidate list stored in the video distribution system of FIG. 1. 5 is a diagram showing an example of a moving image displayed on a client device 10a in one embodiment. FIG. 5 includes an animation of a character object. 6 is a diagram showing an example of a video displayed on a client device 10a in an embodiment. FIG. 6 includes a normal object. 7 is a diagram showing an example of a video displayed on a client device 10a in an embodiment, in which decorative objects are included. 13 is a schematic diagram showing an example of a decorative object selection screen for selecting a desired decorative object from among decorative objects included in a candidate list. FIG. FIG. 11 is a flow diagram showing a flow of a video distribution process in one embodiment. FIG. 11 is a flowchart showing a process for displaying a normal object in an embodiment. FIG. 11 is a flow diagram showing a process for displaying a decorative object in an embodiment. 2 is a diagram for explaining an object display prohibition period set in a video distributed in the video distribution system of FIG. 1 . FIG.

Various embodiments of the present invention will be described below with reference to the drawings. The same reference numerals are used to designate the same or similar components in multiple drawings.

A video distribution system according to one embodiment will be described with reference to Figures 1 to 4. Figure 1 is a block diagram showing a video distribution system 1 according to one embodiment, Figure 2 is a schematic diagram showing the equipment of a studio where videos to be distributed by the video distribution system 1 are produced, and Figures 3 and 4 are diagrams for explaining information stored in the video distribution system 1.

The video distribution system 1 includes client devices 10a-10c, a server device 20, a studio unit 30, and a storage 60. The client devices 10a-10c, the server device 20, and the storage 60 are connected to each other via a network 50 so that they can communicate with each other. The server device 20 is configured to distribute videos that include character animations, as described below. The characters included in the videos may be motion-controlled within a virtual space.

This video can be distributed from server device 20 to each of client devices 10a to 10c. A first viewing user who is a user of client device 10a, a second viewing user who is a user of client device 10b, and a third viewing user who is a user of client device 10c can view the distributed video on each client device. Video distribution system 1 may include fewer than three client devices, or may include more than three client devices.

The client devices 10a to 10c are information processing devices such as smartphones. In addition to smartphones, the client devices 10a to 10c may be mobile phones, tablet terminals, personal computers, e-book readers, wearable computers, game consoles, and various other information processing devices capable of playing videos. Each of the client devices 10a to 10c may be equipped with a computer processor, memory, a communication I/F, a display, a sensor unit equipped with various sensors such as a gyro sensor, a sound collection device such as a microphone, and storage for storing various information.

In the illustrated embodiment, the server device 20 includes a computer processor 21, a communication I/F 22, and storage 23.

The computer processor 21 is an arithmetic device that loads an operating system or various programs that realize various functions from the storage 23 or other storage into memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various other arithmetic devices, or a combination of these. The computer processor 21 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. In FIG. 1, the computer processor 21 is illustrated as a single component, but the computer processor 21 may be a collection of multiple physically separate computer processors. In this specification, a program described as being executed by the computer processor 21 or instructions included in the program may be executed by a single computer processor, or may be executed in a distributed manner by multiple computer processors. In addition, a program executed by the computer processor 21 or instructions included in the program may be executed by multiple virtual computer processors.

The communication I/F 22 is implemented as hardware, firmware, or communication software such as a TCP/IP driver or a PPP driver, or a combination of these. The server device 20 can send and receive data to and from other devices via the communication I/F 22.

Storage 23 is a storage device accessed by computer processor 21. Storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or any other storage device capable of storing data. Various programs may be stored in storage 23. At least a portion of the programs and various data that may be stored in storage 23 may be stored in storage (e.g., storage 60) that is physically separate from server device 20.

Many of the components of the studio unit 30 are arranged, for example, in studio room R shown in FIG. 2. As shown in the figure, actors A1 and A2 are performing in studio room R. The studio unit 30 is configured to detect the movements and facial expressions of actors A1 and A2 and output the detected information to the server device 20.

Actor A1 and actor A2 are both subjects whose movements and expressions are captured by a group of sensors (described below) provided in studio unit 30. Actor A1 and actor A2 are, for example, performing humans, animals, or moving objects. Actor A1 and actor A2 may be, for example, robots capable of independent movement. The number of actors in studio room R may be one, or three or more.

The studio unit 30 has six motion sensors 31a to 31f attached to the actor A1, a controller 33a held in the left hand of the actor A1, a controller 33b held in the right hand of the actor A1, and a camera 37a attached to the head of the actor A1 via a mounting 37b. The studio unit 30 also has six motion sensors 32a to 32f attached to the actor A2, a controller 34a held in the left hand of the actor A2, a controller 34b held in the right hand of the actor A2, and a camera 38a attached to the head of the actor A2 via a mounting 38b. Each of the mountings 37b and 38b may be equipped with a microphone for acquiring voice data. The microphone can acquire the speech of the actors A1 and A2 as voice data. The microphones may be wearable microphones attached to actor A1 and actor A2 via mounting fixtures 37b and 38b, or may be stationary microphones installed on the floor, wall, or ceiling of studio room R. In addition to the above components, studio unit 30 has base station 35a, base station 35b, tracking sensor 36a, tracking sensor 36b, and display 39. Supporter computer 40 is installed in an adjacent room separated from studio room R by a glass window. Server device 20 may be installed in the same room as supporter computer 40.

The motion sensors 31a to 31f and the motion sensors 32a to 32f detect their own position and orientation in cooperation with the base station 35a and the base station 35b. In one embodiment, the base station 35a and the base station 35b are multi-axis laser emitters. The base station 35a emits a flashing light for synchronization, and then scans the laser light, for example, around a vertical axis. The base station 35b scans the laser light, for example, around a horizontal axis. The motion sensors 31a to 31f and the motion sensors 32a to 32f may each include a plurality of optical sensors that detect the incidence of the flashing light and the laser light from the base station 35a and the base station 35b. The motion sensors 31a to 31f and the motion sensors 32a to 32f may each detect their own position and orientation based on the time difference between the incidence timing of the flashing light and the incidence timing of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as necessary. The motion sensors 31a to 31f and the motion sensors 32a to 32f may be, for example, Vive Trackers provided by HTC CORPORATION. The base station 35a and the base station 35b may be, for example, base stations provided by HTC CORPORATION.

Detection information indicating the position and orientation of each motion sensor calculated by each of the motion sensors 31a to 31f and 32a to 32f is transmitted to the server device 20. This detection information may be wirelessly transmitted from each of the motion sensors 31a to 31f and 32a to 32f to the server device 20. Since the base station 35a and the base station 35b emit blinking light and perform laser light scanning at regular intervals, the detection information of each motion sensor is updated at each interval.

In the illustrated embodiment, actor A1 wears six motion sensors 31a-31f. Motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are respectively worn on actor A1's left wrist, right wrist, left instep, right instep, waist, and top of the head. Motion sensors 31a-31f may be worn on actor A1 via a wearing device. Actor A2 wears six motion sensors 32a-32f. Motion sensors 32a-32f may be worn in the same positions as motion sensors 31a-31f on actor A2. Motion sensors 31a-31f and motion sensors 32a-32f shown in FIG. 2 are examples. Motion sensors 31a-31f may be worn on various parts of actor A1, and motion sensors 32a-32f may be worn on various parts of actor A2. The number of motion sensors attached to actor A1 and actor A2 may be five or less, or seven or more. In this way, by detecting the positions and orientations of motion sensors 31a-31f and motion sensors 32a-32f attached to various parts of the bodies of actor A1 and actor A2, the body movements of actor A1 and actor A2 can be detected.

In one embodiment, multiple infrared LEDs may be mounted on each of the multiple motion sensors attached to actor A1 and actor A2, and the position and orientation of each of the motion sensors may be detected by detecting light from the infrared LEDs with an infrared camera installed on the floor or wall of studio room R. Visible light LEDs may be used instead of infrared LEDs, and the position and orientation of each of the motion sensors may be detected by detecting light from the visible light LEDs with a visible light camera. In this way, each of the multiple motion sensors attached to the actors may be provided with a light-emitting unit (e.g., an infrared LED or visible light LED), and the position and orientation of each of the motion sensors may be detected by detecting light from the light-emitting unit with a light-receiving unit (e.g., an infrared camera or visible light camera) installed in studio room R.

In one embodiment, a plurality of reflective markers can be used instead of the motion sensors 31a-31f and the motion sensors 32a-32f. The reflective markers are attached to each of the actors A1 and A2 with adhesive tape or the like. The actors A1 and A2 to which the reflective markers are attached are photographed to generate photographic data, and the photographic data is subjected to image processing to detect the positions and orientations of the reflective markers.

The controllers 33a and 33b output control signals corresponding to the operation of actor A1 to the server device 20. Similarly, the controllers 34a and 34b output control signals corresponding to the operation of actor A2 to the server device 20.

The tracking sensors 36a and 36b generate tracking information for determining setting information for a virtual camera for constructing a virtual space included in the video. The tracking information of the tracking sensors 36a and 36b is calculated as the position in each three-dimensional Cartesian coordinate system and the angle around each axis. The position and orientation of the tracking sensor 36a can be changed according to the operation of the operator. The tracking sensor 36a transmits tracking information indicating its position and orientation to the tracking information server device 20. Similarly, the position and orientation of the tracking sensor 36b are set according to the operation of the operator. The tracking sensor 36b transmits tracking information indicating its position and orientation to the tracking information server device 20.

As described above, camera 37a is attached to the head of actor A1. For example, camera 37a is positioned so as to capture an image of actor A1's face. Camera 37a continuously captures images of actor A1's face and acquires image data of actor A1's face. Similarly, camera 38a is attached to the head of actor A2. Camera 38a is positioned so as to capture images of actor A2's face and continuously captures images of actor A2's face and acquires image data of actor A2's face. Camera 37a transmits image data of actor A1's face to server device 20, and camera 38a transmits image data of actor A1's face to server device 20. Cameras 37a and 38a may be 3D cameras capable of detecting the depth of a person's face.

The display 39 is configured to display information received from the support computer 40. Information transmitted from the support computer 40 to the display 39 may include, for example, text information, image information, and various other types of information. The display 39 is disposed in a position visible to the actor A1 and the actor A2.

In the illustrated embodiment, the supporter computer 40 is installed in a room next to the studio room R. The room in which the supporter computer 40 is installed is separated from the studio room R by a glass window, so that the operator of the supporter computer 40 (sometimes referred to as the "supporter" in this specification) can see the actors A1 and A2. In the illustrated embodiment, supporter B1 and supporter B2 are present in the room as operators of the supporter computer 40.

The supporter computer 40 may be configured to be able to change the settings of the components of the studio unit 30 in response to the operations of supporter B1 and supporter B2. The supporter computer 40 can, for example, set the scanning intervals of base station 35a and base station 35b, set the positions or orientations of tracking sensors 36a and tracking sensors 36b, and change various settings of various other devices. At least one of supporter B1 and supporter B2 can input a message to the supporter computer 40 and display the input message on the display 39.

The components and functions of the studio unit 30 shown in FIG. 2 are exemplary. A studio unit 30 applicable to the present invention may include various components not shown. For example, the studio unit 30 may include a projector. The projector can project a video onto a screen S that is distributed to the client device 10a or other client devices.

Next, in one aspect, information stored in storage 23 will be described. In the illustrated embodiment, storage 23 stores model data 23a, object data 23b, possession list 23c, candidate list 23d, and various other information required for generating and distributing distribution videos.

The model data 23a is model data for generating animation of a character. The model data 23a may be three-dimensional model data for generating three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 23a includes, for example, rig data (sometimes called "skeleton data") indicating the skeleton of a character, and surface data indicating the shape and texture of the surface of the character. The model data 23a may include a plurality of model data that are different from each other. The plurality of model data may have different rig data from each other, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data. In the illustrated embodiment, in order to generate a character object corresponding to actor A1 and a character object corresponding to actor A2, the model data 23a has at least two different types of model data. The model data for the character object corresponding to actor A1 and the model data for the character object corresponding to actor A2 may have the same rig data but different surface data, for example.

Object data 23b includes asset data for constructing a virtual space that constitutes the video. Object data 23b includes data for drawing the background of the virtual space that constitutes the video, data for drawing various objects that are displayed in the video, and data for drawing various other objects that are displayed in the video. Object data 23a may include object position information that indicates the position of an object in the virtual space.

In addition to the above, object data 23b may also include gift objects that are displayed in the video based on a display request from a viewing user of client devices 10a to 10c. Gift objects may include effect objects, normal objects, and decorative objects. Viewing users can purchase the gift objects they desire.

An effect object is an object that affects the overall impression of the viewing screen of the distributed video, such as an object that resembles confetti. The confetti object may be displayed across the entire viewing screen, thereby changing the overall impression of the viewing screen before and after it is displayed. Effect objects may be displayed so as to overlap with character objects, but differ from decorative objects in that they are not displayed in association with any particular part of the character object.

A normal object is an object that is a digital gift from a viewing user to an actor (e.g., actor A1 or actor A2), and is, for example, an object that resembles a stuffed animal or a bouquet of flowers. In one aspect, a normal object is displayed on the video display screen so as not to come into contact with a character object. In one aspect, a normal object is displayed on the video display screen so as not to overlap with a character object. A normal object may be displayed so as to overlap with an object other than a character object in the virtual space. A normal object may be displayed so as to overlap with a character object, but differs from a decorative object in that it is not displayed in association with a specific part of the character object. In one aspect, when a normal object is displayed so as to overlap with a character object, the normal object is displayed so as to overlap with a part of the character object other than the head, including the face, and not to overlap with the head of the character object.

A decorative object is an object that is displayed on the display screen in association with a specific part of a character object. In one aspect, a decorative object that is displayed on the display screen in association with a specific part of a character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, a decorative object that is displayed on the display screen in association with a specific part of a character object is displayed on the display screen so as to cover a part or all of the specific part of the character object. The specific part may be specified by three-dimensional position information indicating a position in a three-dimensional coordinate space, or may be associated with position information in a three-dimensional coordinate space. For example, in the case of a character's head, the specific parts may be defined in units of the front left side, front right side, rear left side, rear right side, front center, rear center, left eye, right eye, left ear, right ear, and all of the hair.

The decorative object is, for example, an accessory (headband, necklace, earring, etc.) worn by a character object, clothing (T-shirt, etc.), costume, and other objects that can be worn by a character object. The object data 23b corresponding to the decorative object may include wearing position information indicating which part of the character object the decorative object is associated with. The wearing position information of a certain decorative object can indicate which part of the character object the decorative object is worn on. For example, if the decorative object is a headband, the wearing position information of the decorative object may indicate that the decorative object is worn on the "head" of the character object. If the wearing position information of the decorative object is specified as a position in a three-dimensional coordinate space, the wearing position information may be associated with multiple positions in the three-dimensional coordinate space. For example, the wearing position information indicating the position where a decorative object indicating a "headband" is worn may be associated with two parts of the character object, the "left rear of the head" and the "right rear of the head". In other words, the decorative object indicating a "headband" may be worn on both the "left rear of the head" and the "right rear of the head". If the decorative object is a T-shirt, the attachment position information for the decorative object may indicate that the decorative object is attached to the "torso" of the character object.

Each gift object may have a display time set according to its type. In one embodiment, the display time of a decorative object may be set longer than the display time of an effect object and the display time of a normal object. For example, the display time of a decorative object may be set to 60 seconds, the display time of an effect object may be set to 5 seconds, and the display time of a normal object may be set to 10 seconds.

The possession list 23c is a list showing gift objects possessed by a viewing user of a video. An example of the possession list 23c is shown in FIG. 3. As shown, the possession list 23c stores object IDs that identify gift objects possessed by a viewing user in association with the viewing user's account information (e.g., the viewing user's user ID). These viewing users include, for example, the first to third viewing users of client devices 10a to 10c.

Candidate list 23d is a list of decorative objects for which a viewing user has made a display request. As described below, a viewing user who owns a decorative object can make a display request for the decorative object that he or she owns. In candidate list 23d, an object ID that identifies the decorative object is stored in association with the account information of the viewing user who has made the display request for the decorative object. This candidate list 23d may be created for each broadcaster. Candidate list 23d may be stored, for example, in association with broadcaster identification information that identifies the broadcaster (actor A1, actor A2, supporter B1, and/or supporter B2).

Next, the functions realized by the computer processor 21 will be described in more detail. The computer processor 21 executes computer-readable instructions included in the distribution program to function as a body motion data generating unit 21a, a face motion data generating unit 21b, an animation generating unit 21c, a video generating unit 21d, a video distribution unit 21e, a display request processing unit 21f, a decorative object selecting unit 21g, and an object purchase processing unit 21h. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the video distribution system 1. At least a part of the functions realized by the computer processor 21 may be realized by, for example, a computer processor installed in the supporter computer 40.

The body motion data generation unit 21a generates first body motion data for each part of the body of actor A1 based on the detection information of each of the motion sensors 31a to 31f, and generates second body motion data, which is a digital representation of the position and orientation of each part of the body of actor A2, based on the detection information of each of the motion sensors 32a to 32f. In this specification, the first body motion data and the second body motion data may be collectively referred to simply as "body motion data". The body motion data is generated as time passes. For example, the body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data can represent the body movements of actor A1 and actor A2 in time series as digital data. In the illustrated embodiment, the motion sensors 31a-31f and 32a-32f are attached to the left and right limbs, waist, and head of each of the actors A1 and A2, so that it is possible to digitally represent the approximate positions and orientations of the entire bodies of the actors A1 and A2 over time based on the detection information of the motion sensors 31a-31f and 32a-32f. The body motion data can, for example, specify the positions and rotation angles of the bones that make up the rig data included in the model data 23a.

The facial motion data generating unit 21b generates first facial motion data, which is a digital representation of the facial movement of actor A1, based on the imaging data of camera 37a, and also generates second facial motion data, which is a digital representation of the facial movement of actor A2, based on the imaging data of each of cameras 38a. In this specification, the first facial motion data and the second facial motion data may be collectively referred to simply as "facial motion data". The facial motion data is generated as time passes. For example, the facial motion data may be generated at predetermined sampling time intervals. In this way, the facial motion data can digitally represent actor A2 and the facial movement (changes in facial expression) of actor A2 in a chronological order.

The animation generation unit 21c is configured to generate animation of a character object that moves in a virtual space and changes its facial expression by applying the body motion data generated by the body motion data generation unit 21a and the facial motion data generated by the facial motion data generation unit 21b to predetermined model data included in the model data 23a. Specifically, the animation generation unit 21c can generate animation of a character object that moves in synchronization with the body and facial expression movements of actor A1 based on the first body motion data and first facial motion data related to actor A1, and generate animation of a character object that moves in synchronization with the body and facial expression movements of actor A2 based on the second body motion data and second facial motion data related to actor A2. In this specification, a character object generated based on the movement and facial expression of actor A1 may be referred to as a "first character object," and a character object generated based on the movement and facial expression of actor A2 may be referred to as a "second character object."

The video generator 21d constructs a virtual space using the object data 23b, and generates a video including this virtual space, an animation of a first character object corresponding to actor A1, and an animation of a second character object corresponding to actor A2. The first character object is placed in the virtual space so as to match the position of actor A1 relative to the tracking sensor 36a, and the second character object is placed in the virtual space so as to match the position of actor A2 relative to the tracking sensor 36a. Therefore, by changing the position or orientation of the tracking sensor 36a, the positions and orientations of the first character object and the second character object in the virtual space can be changed.

In one aspect, the video generating unit 21d constructs a virtual space based on tracking information from the tracking sensor 36a. For example, the video generating unit 21d determines setting information for a virtual camera (position in the virtual space, gaze position, gaze direction, and angle of view) based on the tracking information from the tracking sensor 36a, determines a drawing area of the entire virtual space based on the setting information for the virtual camera, and generates video information for displaying the drawing area of the virtual space.

The video generating unit 21d may be configured to determine the positions and orientations of the first character object and the second character object in the virtual space, as well as the setting information of the virtual camera, based on the tracking information of the tracking sensor 36b instead of or in addition to the tracking information of the tracking sensor 36a.

The video generation unit 21d can synthesize the voices of actors A1 and A2 acquired from the microphone of the studio unit 30 into the generated video.

In this way, the video generation unit 21d generates an animation of a first character object that moves in sync with the body and facial movements of actor A1, and an animation of a second character object that moves in sync with the body and facial movements of actor A2, and can generate a video for distribution in which the animations are mixed with the voices of actors A1 and A2.

The video distribution unit 21e distributes the video generated by the video generation unit 21d. This video is distributed to the client devices 10a to 10c and other client devices via the network 50. The received video is played on the client devices 10a to 10c.

This video may be distributed to a client device (not shown) installed in studio room R, and projected from this client device onto screen S via a short focus projector. This video may also be distributed to supporter computer 40. This allows supporter B1 and supporter B2 to check the viewing screen of the distributed video.

5 shows an example of a video display that is distributed from the server device 20 to the client device 10a and is being played on the client device 10a. As shown in the figure, a display image 70 of the video distributed from the server device 20 is displayed on the display of the client device 10a. The display image 70 displayed on the client device 10a includes, in a virtual space, a character object 71A corresponding to the actor A1, a character object 71B corresponding to the actor A2, and an object 72 showing a table. The object 72 is not a gift object, but is one of the objects for constructing a virtual space included in the object data 23b. The character object 71A is generated by applying the first body motion data and the first face motion data of the actor A1 to the model data for the actor A1 included in the model data 23a. The character object 71A is motion-controlled based on the first body motion data and the first face motion data. The character object 71B is generated by applying the second body motion data and the second face motion data of the actor A2 to the model data for the actor A2 included in the model data 23a. Character object 71B is motion-controlled based on the second body motion data and the second face motion data. Therefore, character object 71A is controlled to move within the screen in synchronization with the body and facial movement of actor A1, and character object 71B is controlled to move within the screen in synchronization with the body and facial movement of actor A2.

As described above, the video distributed from the server device 20 may be distributed to the supporter computer 40. The video distributed to the supporter computer 40 is displayed on the supporter computer 40 in the same manner as in FIG. 5. The supporter B1 and the supporter B2 can change the settings of the components of the studio unit 30 by watching the video being played on the supporter computer 40. In one embodiment, when the supporter B1 and the supporter B2 want to change the angle of the character object 71A and the character object 71B in the video being distributed, they can send an instruction signal from the supporter computer 40 to the tracking sensor 36a instructing the change in the orientation of the tracking sensor 36a. The tracking sensor 36a can change its orientation in response to the instruction signal. For example, the tracking sensor 36a is attached to a stand so as to be rotatable around its axis via a rotation mechanism having an actuator built in, and when the tracking sensor 36a receives an instruction signal instructing the change in its orientation, the actuator of the rotation mechanism is driven based on the instruction signal, and the tracking sensor 36a may be rotated by an angle corresponding to the instruction signal. In one embodiment, supporter B1 and supporter B2 may send instructions from supporter computer 40 to tracking sensor 36a and tracking sensor 36b to use tracking information from tracking sensor 36b instead of tracking information from tracking sensor 36a.

In one embodiment, when supporter B1 and supporter B2 view the video being played on supporter computer 40 and determine that instructions to actor A1 or actor A2 are necessary, they can input a message indicating the instruction to supporter computer 40 and output this message on display 39. For example, supporter B1 and supporter B2 can instruct actor A1 or actor A2 to change their position through a message displayed on display 39.

The display request processing unit 21f receives a display request for a gift object from a viewing user's client device and performs processing according to the display request. Each viewing user can transmit a display request for a gift object to the server device 20 by operating their own client device. For example, the first viewing user can transmit a display request for a gift object to the server device 20 by operating the client device 10a. The display request for a gift object may include the user ID of the viewing user and identification information (object ID) that specifies the object requested to be displayed.

As described above, gift objects may include effect objects, normal objects, and decorative objects. Effect objects and normal objects are examples of first objects. A display request requesting the display of an effect object or a normal object is an example of a second display request.

In one aspect, when the display request processing unit 21f receives a display request from a viewing user for a specific effect object, the display request processing unit 21f performs processing for displaying the effect object requested to be displayed in the display image 70 of the video based on the display request. For example, when a display request is made for an effect object corresponding to confetti, the display request processing unit 21f displays an effect object 73 representing confetti in the display image 70 based on the display request, as shown in FIG. 6.

In one aspect, when the display request processing unit 21f receives a display request from a viewing user to display a specific normal object, the display request processing unit 21f performs processing for displaying the normal object requested to be displayed in the video 70 based on the display request. For example, when a display request is made for a normal object showing a stuffed bear, the display request processing unit 21f displays a normal object 74 showing a stuffed bear in the display image 70 based on the display request, as shown in FIG. 6.

The display request for the normal object 74 may include a display position designation parameter that designates the display position of the normal object 74 in the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at the position designated by the display position designation parameter in the virtual space. For example, the display position designation parameter can designate above the object 72 representing a table as the display position for the normal object 74. By using the display position designation parameter, the viewing user can view the display of the character object 71A, character object 71B, gift object, and other objects included in the video 70 and designate the position at which he or she wants to display the normal object.

In one aspect, the normal object 74 may be displayed to move within the display image 70 of the video. For example, the normal object 74 may be displayed to fall from the top to the bottom of the screen. In this case, the normal object 74 may be displayed within the display image 70 from the start of the fall to the floor of the virtual space constituting the video 70, and may disappear from the display image 70 after falling to the floor. The viewing user can see the falling normal object 74 from the start of the fall to the end of the fall. The movement direction of the normal object 74 within the screen may be set arbitrarily. For example, the normal object 74 may be displayed in the display image 70 to move from left to right, right to left, upper left to lower left of the video 70, or in a direction other than these. The normal object 74 can move on various trajectories. For example, the normal object 74 can move on a straight trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or on a trajectory other than these. In addition to or instead of the display position designation parameter, the viewing user can include at least one of a movement direction parameter that designates the movement direction of the normal object 74 and a trajectory parameter that designates the trajectory along which the normal object 74 moves, in the display request for the normal object. In one embodiment, among the effect objects and normal objects, those whose size in the virtual space is smaller than the reference size (for example, the confetti pieces of the effect object 73) may be displayed by overlapping part or all of them with the character object 71A and the character object 71B. In one embodiment, among the effect objects and normal objects, those whose size in the virtual space is larger than the reference size (for example, the normal object 74 (a stuffed bear)) are displayed at a position that does not overlap with the character object. In one embodiment, among the effect objects and normal objects, those whose size in the virtual space is larger than the reference size (for example, the normal object 74 (a stuffed bear)) are displayed behind the character object that is displayed overlapping, when they overlap at least one of the character object 71A or the character object 71B.

In one aspect, when the display request processing unit 21f receives a display request for a specific decorative object from a viewing user, it adds the decorative object requested to be displayed to the candidate list 23d based on the display request. The display request for a decorative object is an example of a first display request. For example, the display request processing unit 21f can store in the candidate list 23d, in association with the user ID of the viewing user, identification information (object ID) that identifies the specific decorative object requested to be displayed by the viewing user (see FIG. 4). When multiple display requests for decorative objects are made, the user ID of the viewing user who made the display request and the decorative object ID of the decorative object requested to be displayed by the viewing user are stored in association with each of the multiple display requests in the candidate list 23d.

In one aspect, in response to the selection of one or more of the decorative objects included in the candidate list 23d, the decorative object selection unit 21g performs processing for displaying the selected decorative objects in the video display image 70. In this specification, a decorative object selected from the candidate list 23d may be referred to as a "selected decorative object."

The selection of a decorative object from the candidate list 23d is performed, for example, by the supporter B1 and the supporter B2 operating the supporter computer 40. In one embodiment, a decorative object selection screen is displayed on the supporter computer 40. FIG. 8 shows an example of a decorative object selection screen 80 in one embodiment. This decorative object selection screen 80 is displayed, for example, on the display of the supporter computer 40. The decorative object selection screen 80 displays, for example, each of the multiple decorative objects included in the candidate list 23d in a table format. As shown in the figure, the decorative object selection screen 80 in one embodiment has a first column 81 that displays the type of decorative object, a second column 82 that displays an image of the decorative object, and a third column 83 that displays the part of the character object with which the decorative object is associated. In addition, the decorative object selection screen 80 displays selection buttons 84a to 84c for selecting each decorative object. In this way, the decorative object selection screen 80 displays decorative objects that are candidates for the selected decorative object.

The supporter B1 and the supporter B2 can select one or more of the decorative objects included in the decorative object selection screen 80. For example, the supporter B1 and the supporter B2 can select a headband by selecting the selection button 84a. When the decorative object selection unit 21g detects that a headband has been selected, the display request processing unit 21f displays a selected decorative object 75 representing the selected headband on the video display screen 70, as shown in FIG. 7. The selected decorative object 75 is displayed on the display image 70 in association with a specific part of the character object. The selected decorative object 75 may be displayed so as to be in contact with the specific part of the character object. For example, the selected decorative object 75 representing a headband is associated with the head of the character object, and is therefore attached to the head of the character object 71A, as shown in FIG. 7. The decorative object may be displayed on the display screen 70 so as to move in conjunction with the movement of the specific part of the character object. For example, when the head of character object 71A wearing a headband moves, the selected decoration object 75 representing the headband also moves along with the head of character object 71A, as if the headband were being worn on the head of character object 71A.

As described above, the object data 23b may include attachment position information indicating which part of the character object the decorative object is associated with. In one aspect, the decorative object selection unit 21g may prevent the selection as the selected decorative object 75 of a decorative object included in the candidate list 23d that is attached to a part that overlaps with a part indicated by the attachment position information of a decorative object already attached to the character object. For example, a headband associated with the "left rear of the head" and the "right rear of the head" and a hair accessory associated with the "left rear of the head" cannot be worn at the same time because the "left rear of the head" overlaps. On the other hand, a headband associated with the "left rear of the head" and the "right rear of the head" and an earring associated with the "left ear (of the head)" and the "right ear (of the head)" can be worn at the same time because specific parts of the character object do not overlap.

The selected decorative object 75 may be displayed on the display screen 70 in association with the character object 71B, rather than with the character object 71A. The selected decorative object 75 may be displayed on the display screen 70 in association with the character object 71A and the character object 71B.

In one embodiment, the decorative object selection screen 80 may be configured not to include information that can identify the user who owns each decorative object or the user who requested the display of each decorative object. This can prevent the selector from favoring a particular user when selecting a decorative object.

In one embodiment, the decorative object selection screen 80 may display information about a user who owns each decorative object, or about a user who has made a display request for each decorative object. For example, for each decorative object, the number of times that the user who made the display request for the decorative object has made a display request for the decorative object and the number of times that the decorative object has been selected (for example, information indicating that the user has made a display request for the decorative object five times and selected the decorative object twice), the number of times that the user has viewed at least one of the videos of the character object 71A and the character object B, the number of times that the user has viewed a video (regardless of whether the character object 71A and the character object B appear) in the video distribution system 1, the purchase amount of the gift object by the user, the number of times that the user has purchased an object, the points that the user owns and can use in the video distribution system 1, the level of the user in the video distribution system 1, and various other information about the user who made the display request for each decorative object may be displayed. According to this embodiment, the decorative object can be selected based on the behavior and viewing history of the user who made the display request for the decorative object in the video distribution system 1.

In one embodiment, restrictions may be imposed on the display of decorative objects to prevent overlapping. For example, if a decorative object associated with a specific part of character object 71A has already been selected, selection of other decorative objects associated with the specific part may be prohibited. As shown in the embodiment of FIG. 7, if a headband associated with the "head" of character object 71B has already been selected, other decorative objects associated with the "head" (e.g., a decorative object representing a "hat" associated with the head) may not be displayed on the decorative object selection screen 80, or a selection button for selecting the decorative object representing the hat may be made unselectable on the selection screen 80. According to this embodiment, it is possible to prevent decorative objects from being displayed overlappingly on a specific part of a character object.

The decorative object selection screen 80 may be displayed on another device instead of or in addition to the supporter computer 40. For example, the decorative object selection screen 80 may be displayed on at least one of the display 39 and the screen S in the studio room R. In this case, the actors A1 and A2 can select the desired decorative object based on the decorative object selection screen 80 displayed on the display 39 or the screen S. The selection of the decorative object by the actors A1 and A2 can be performed, for example, by operating the controller 33a, the controller 33b, the controller 34a, or the controller 34b.

In one aspect, the object purchase processing unit 21h transmits, in response to a request from a viewing user of a video, purchase information for each of a plurality of gift objects that can be purchased in relation to the video to the viewing user's client device (e.g., client device 10a). The purchase information for each gift object may include the type of the gift object (effect object, normal object, or decorative object), an image of the gift object, the price of the gift object, and other information necessary for purchasing the gift object. The viewing user can select a gift object to purchase based on the purchase information of the gift object displayed on the client device 10a. The selection of the gift object to be purchased may be performed by operating the client device 10a. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 20. The object purchase processing unit 21h performs a payment process based on the purchase request. When this payment process is completed, the purchased gift object is owned by the viewing user. In this case, the object ID of the purchased gift object is stored in the ownership list 23c in association with the user ID of the viewing user who purchased it.

The purchasable gift objects may be different for each video. The purchasable gift objects may be purchasable across multiple videos. That is, the purchasable gift objects may include unique gift objects that are unique to each video and common gift objects that are purchasable across multiple videos. For example, an effect object showing confetti may be a common gift object that is purchasable across multiple videos.

In one aspect, when an effect object is purchased while watching a specific video, the effect object to be purchased may be automatically displayed in the video being watched in response to completion of the payment process to purchase the effect object. When a normal object is purchased while watching a specific video, similar to the above, the normal gift object to be purchased may be automatically displayed in the video being watched in response to completion of the payment process to purchase the normal object.

In another aspect, in response to the completion of the payment process in the object purchase processing unit 21h for the effect object to be purchased, a payment completion notification may be sent to the client device 10a, and a confirmation screen may be displayed on the client device 10a to confirm with the viewing user whether or not to make a display request for the purchased effect object. If the viewing user selects to make a display request for the purchased effect object, a display request requesting the display of the purchased effect object may be sent from the viewing user's client device to the display request processing unit 21f, and the display request processing unit 21f may perform processing to display the purchased effect object in the video 70. When the object to be purchased is a normal object, a confirmation screen may be displayed on the client device 10a to confirm with the viewing user whether or not to make a display request for the purchased normal object, as described above.

Next, a video distribution process according to one aspect will be described with reference to Figs. 9 to 11. Fig. 9 is a flow diagram showing the flow of video distribution process in one embodiment, Fig. 10 is a flow diagram showing the flow of process for displaying normal objects in one embodiment, and Fig. 11 is a flow diagram showing the flow of process for displaying decorative objects in one embodiment. In the video distribution process, it is assumed that actors A1 and A2 are performing in studio room R.

First, in step S11, body motion data, which is a digital representation of the body movements of actor A1 and actor A2, and face motion data, which is a digital representation of the facial movements (facial expressions) of actor A1 and actor A2, are generated. The body motion data is generated, for example, by the body motion data generation unit 21a, and the face motion data is generated, for example, by the face motion data generation unit 21b.

Next, in step S12, the body motion data and facial motion data of actor A1 are applied to the model data for actor A1 to generate an animation of a first character object that moves in synchronization with the body and facial movement of actor A1. Similarly, the body motion data and facial motion data of actor A2 are applied to the model data for actor A2 to generate an animation of a second character object that moves in synchronization with the body and facial movement of actor A2. This animation is generated, for example, by the animation generation unit 21c described above.

Next, in step S13, a video is generated that includes an animation of a first character object corresponding to actor A1 and an animation of a second character object corresponding to actor A2. The audio of actors A1 and A2 may be synthesized into this video. The animation of the first character object and the animation of the second character object may be placed in a virtual space. The generation of this video is performed, for example, by the video generation unit 21d described above.

Next, the process moves to step S14, where the video generated in step S13 is distributed. This video is distributed to client devices 10a to 10c and other client devices via network 50. This video is distributed to supporter computer 40, and may also be projected onto a screen S in studio room R. The video is distributed continuously for a specified distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, or any other time.

Next, the process proceeds to step S15, where it is determined whether or not the end condition for ending the distribution of the video has been met. The end condition may be, for example, that the end time of the distribution has been reached, that an instruction to end the distribution has been given by the supporter computer 40, or other conditions. If the end condition has not been met, the process of steps S11 to S14 is repeated, and the distribution of the video including animation synchronized with the movements of actors A1 and A2 continues. If it is determined that the end condition has been met for the video, the distribution process of that video is terminated.

Next, with further reference to FIG. 10, the display process of normal objects performed during video distribution will be described. The display process of normal objects is performed in parallel with the video distribution process shown in FIG. 9.

During the distribution of the video, in step S21, it is determined whether a display request for a normal object has been made. For example, the first viewing user can select one or more specific normal objects from among the normal objects he or she owns, and transmit a display request for displaying the selected normal objects from the client device 10a to the server device 20. As described above, a display request for a specific normal object may be generated in response to a purchase process or payment process for the specific normal object.

When a request to display a normal object is made, the display process proceeds to step S22. In step S22, a process is performed to display the normal object requested to be displayed in the video being distributed based on the display request. For example, when a request to display a normal object 74 is made during the distribution of a specific video, the normal object 74 requested to be displayed is displayed on the display screen 70 of the video, as shown in FIG. 6.

If no request for displaying a normal object has been made, the display process for the normal object ends. The display process for the normal object shown in FIG. 10 is repeated during the distribution period of the video.

The display process of an effect object can be performed in the same procedure as the display process of a normal object described above. For example, when a display request for an effect object 73 is made during the distribution of a specific video, the effect object 73 requested to be displayed is displayed on the display screen 70 of the video, as shown in FIG. 6. The effect object 73 shown in FIG. 6 is an object that resembles confetti. The effect object 73 that resembles confetti is displayed so as to overlap (or touch) the character objects 71A and 71B, but differs from a decorative object in that it is not associated with any specific part of the character objects 71A and 71B.

Next, with further reference to FIG. 11, the display process of decorative objects performed during video distribution will be described. The display process of decorative objects is performed in parallel with the video distribution process shown in FIG. 9. The display process of decorative objects may also be performed in parallel with the display process of normal objects shown in FIG. 10.

During distribution of the video, in step S31, it is determined whether a display request for a decorative object has been made. For example, the first viewing user can select a first decorative object from among his or her decorative objects, and transmit a display request for displaying the selected first decorative object from the client device 10a to the server device 20.

When a request to display the first decorative object is made, the display process proceeds to step S32. In step S32, the first decorative object requested to be displayed is added to a candidate list based on the display request. The candidate list is a list of objects that are candidates for decorative objects to be displayed in the video being distributed, and is, for example, the candidate list 23d described above.

Next, in step S33, it is determined whether a specific decorative object has been selected from among the decorative objects stored in the candidate list.

When a specific decorative object is selected, in step S34, the selected specific decorative object (the "selected decorative object") is deleted from the candidate list, and processing is performed to display the selected decorative object on the display screen of the video being distributed. For example, when decorative object 75 is selected from the candidate list during the distribution of video 70 shown in FIG. 5, the selected decorative object 75 is displayed in display image 70, as shown in FIG. 7. The first decorative object for which a display request was made in step S31 is displayed in display image 70 if it is selected from the candidate list during the distribution of the video, but is not displayed in display image 70 if it is not selected.

If no decorative object is selected from the candidate list in step S33, and if the display process of the selected decorative object is completed in step S34, the display process of the decorative object proceeds to step S35. In step S35, it is determined whether or not the distribution of the video being distributed has ended. In this step S35, the determination may be made, for example, based on the same criteria as in step S15. If it is determined in step S35 that the distribution has not ended, the display process of the decorative object returns to step S31, and the processes of steps S31 to S35 are repeatedly executed. If it is determined that the distribution has ended, the display process of the decorative object proceeds to step S36.

In step S36, processing is performed on the decorative objects (sometimes referred to as "non-selected objects" in this specification) that remain in the candidate list when the video distribution ends. In this specification, the processing performed in step S36 is sometimes referred to as non-selected object processing.

The non-selected objects are objects that have been purchased by a viewing user and have been requested to be displayed during distribution of the video. Therefore, the non-selected object processing executed in step S36 may be processing for refunding the purchase cost of the non-selected object to the viewing user who has requested the display of the non-selected object. In another aspect, the non-selected object processing may be processing for canceling the payment processing for purchasing the non-selected object. In another aspect, the non-selected object processing may be processing for providing a decorative object different from the non-selected object to the viewing user who has requested the display of the non-selected object.

In another aspect, the non-selected object processing may be processing for granting points that can be used in the video distribution system 1 to the user of the non-selected object, instead of refunding the purchase cost or canceling the payment processing. The video distribution system 1 may be configured to consume points to watch videos. The points granted to the user of the non-selected object by the non-selected object processing may be points that can be used to watch videos in the video distribution system 1.

In another aspect, the non-selected object process may be a process of adding the non-selected object to the possession list as an object possessed by the first viewing user. This allows the first viewing user to receive the return of the non-selected object.

In another aspect, the non-selected object processing may be processing for retaining the candidate list at the end of video distribution until the next time the same distributor distributes a video. This allows the distributor to inherit the candidate list used in the previous video distribution when distributing the next video. This inherited candidate list includes decorative objects (i.e., non-selected objects) that were requested to be displayed in the previous video distribution but were not actually displayed in the video. This allows the next video distribution to be performed using the candidate list including the non-selected objects from the previous video distribution. These non-selected objects may be selected in the next video distribution and displayed in the video.

After the processing in step S36 is completed, the display processing of the decorative object ends.

In one embodiment, an object display prohibition period in which the display of a gift object is prohibited may be provided in a video distribution. FIG. 12 is a diagram for explaining a schematic object display prohibition period. FIG. 12 shows that a video is distributed between time t1 and time t2. That is, time t1 is the start time of the video distribution, and time t2 is the end time of the video distribution. In the video distribution period, the object display prohibition period 81 is between time t3 and time t4. Even if a display request r1 of a gift object is made during this object display prohibition period 81, the gift object is not displayed in the display image of the video during the object display prohibition period 81. Specifically, when a display request of an effect object or a normal object among gift objects is made during the object display prohibition period 81, the effect object or normal object requested to be displayed is not displayed in the video being distributed during the object display prohibition period 81, and is displayed in the video after the object display prohibition period 81 has elapsed (i.e., after time t4). Furthermore, when a decorative object is selected from the candidate list during object display prohibition period 81, the selected decorative object is not displayed in the video being distributed during object display prohibition period 81, but is displayed in the video at a point in time after the object display prohibition period 81 has elapsed. A request to display a decorative object may be accepted during object display prohibition period 81. In other words, when a request to display a decorative object is made during object display prohibition period 81, the decorative object for which the display request has been made may be added to the candidate list even during object display prohibition period 81.

According to the above embodiment, the gift object includes three types of objects: decorative objects, normal objects, and effect objects. Of these, only decorative objects are displayed in association with character objects. In a video in which animation of a character object is displayed, the animation of the character object is considered to be an element that attracts the attention of a viewing user. For example, in the video shown in Figures 5 to 7, attention is considered to be focused on character object 71A and character object 71B. In the above embodiment, even if there is a display request for a decorative object displayed in association with character object 71A and character object 71B, the decorative object is not displayed in the video until the decorative object is selected from candidate list 23d, thereby preventing the decorative objects from being displayed cluttered around or overlapping the character object. This prevents a deterioration in the viewing experience of the viewing user.

In conventional video distribution systems, gift objects, regardless of type, are displayed in a video in response to a request to display the object in the video. Therefore, if multiple gift objects are allowed to be displayed in a video, a large number of gift objects will be displayed in the video, degrading the viewing experience of the user watching the video. In the above embodiment, a category of decorative objects that are displayed in association with character objects is provided for gift objects, making it possible to reduce the number (display amount) of decorative objects displayed in association with character objects, which are the main part of the video.

A normal object 74 among the gift objects is displayed in the video in response to a display request from the viewing user. In the above embodiment, the normal object 74 is displayed on the video display screen 70 so as not to contact or overlap with the character objects 71A and 71B, so that the effect on the visibility of the character objects 71A and 71B is small. According to this aspect, it is possible to prevent a deterioration in the user's viewing experience due to a deterioration in the visibility of the character objects.

The effect object 73 and normal object 74 among the gift objects are displayed in the video in response to a display request from the viewing user. In the above embodiment, the effect object 73 and normal object 74 are displayed on the display screen 70 for a shorter period of time than the decorative object 75, and therefore have less impact on the visibility of the character object 71A and the character object 71B. According to this aspect, it is possible to prevent a deterioration in the user's viewing experience due to a deterioration in the visibility of the character objects.

In the above embodiment, the selection of a decorative object from the candidate list 23d is made by a person other than the viewing user who requested the display of the decorative object (e.g., supporter B1, supporter B2, actor A1, or actor A2), making it possible to reduce the number of decorative objects displayed.

According to the above embodiment, the gift object is not displayed in the video during the object display prohibition period 81. This allows the created video to be viewed without being interrupted by the gift object. For example, by setting the time period during which actor A1 and actor A2 perform a visual performance in the video as the object display prohibition period 81, the audience can see the performance by the actors without being interrupted by the first object and the decorative object.

According to the above embodiment, it is considered that a viewing user who views a video including a character object such as character object 71A or character object 71B has an attachment to the character object. Therefore, satisfaction is increased by having the character object wear a decorative object rather than an effect object or a normal object. In this way, a decorative object that can be worn by a character object can provide a user with an incentive to repeatedly watch a video including the character object.

In the video distribution system 1 according to the above embodiment, a user can give decorative objects to a character. This makes it possible to provide a more unique system compared to a system in which such decorative objects cannot be given, and this system can provide a more unique service. This makes it possible to attract more users to the video distribution system 1, thereby increasing the number of views of videos in the video distribution system 1.

The embodiments of the present invention are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present invention. For example, the video to be distributed may be filmed and generated outside of the studio room R. For example, filming for generating the video to be distributed may be performed at the home of an actor or supporter.

In the processing procedures described in this specification, particularly in processing procedures described using flow diagrams, it is possible to omit some of the processes (steps) that make up the processing procedures, to add processes that are not explicitly stated as processes that make up the processing procedures, and/or to change the order of the steps, and processing procedures in which such omissions, additions, or changes in order have been made are also included within the scope of the present invention as long as they do not deviate from the spirit of the present invention.

The inventions described in the claims of the original application of this application are set forth below.
[1]
A video distribution server that distributes videos including animations of character objects generated based on the movements of actors,
one or more computer processors;
The one or more computer processors execute the computer readable instructions to:
receiving a display request from a viewing user who is viewing the video, the display request requesting that a decorative object be displayed on the video during distribution of the video;
In response to receiving the display request, a decorative object selection screen is generated, the decorative object selection screen including a display element for selecting the decorative object, but not including user identification information that can identify the viewing user;
In response to the selection of the display element, displaying the decorative object in the video in association with the character object.
Video distribution server.
[2]
The decorative object selection screen is displayed on a display visible to the actor.
The video distribution server according to [1].
[3]
the decorative object selection screen is displayed on a supporter computer used by a supporter who supports the distribution of the video during the distribution of the video.
A video distribution server according to [1] or [2].
[4]
the decorative object is associated with a specific part of the character object, and the decorative object selection screen includes an area for displaying an image of the decorative object and an area for displaying a name of the specific part of the decorative object;
A video distribution server according to any one of [1] to [3].
[5]
In response to receiving another display request from another viewing user who views the video, requesting that another decorative object be displayed on the video, the one or more computer processors update the decorative object selection screen to include another display element for selecting the other decorative object, but not to include user identification information that can identify the other viewing user.
A video distribution server according to any one of [1] to [4].
[6]
when a specific part of the character object with which the other decorative object is associated is the same as a specific part of the character object with which the other decorative object is associated, other display elements of the other decorative object are made unselectable on the decorative object selection screen.
[5] A video distribution server according to the present invention.
[7]
Further comprising one or more storages for storing the decorative objects.
A video distribution server according to any one of [1] to [6].
[8]
the display request includes object identification information that identifies the decorative object;
[7] A video distribution server according to the present invention.
[9]
the one or more computer processors:
accepting a purchase request from the viewing user to purchase the decorative object;
adding the decorative object to a holding list, which is a list of objects held by the viewing user, in response to the purchase request;
In response to receiving a display request from the viewing user to display the decorative object, delete the decorative object from the holding list;
adding the decorative object to the holding list if the decorative object has not been selected by the end of distribution of the video;
A video distribution system according to any one of claims [1] to [8].
[10]
1. A video distribution method for distributing a video including an animation of a character object generated based on a movement of an actor to a plurality of viewing users including a first viewing user by executing computer readable instructions by one or more computer processors, the method comprising:
receiving a display request from the first viewing user requesting display of a decorative object;
generating a decorative object selection screen configured to include display elements for selecting the decorative object in response to receiving the display request, but not to include user identification information capable of identifying the viewing user;
displaying the decorative object in the video in association with the character object in response to the display element being selected;
A video distribution method comprising:
[11]
A video distribution program for distributing a video including an animation of a character object generated based on a movement of an actor to a plurality of viewing users including a first viewing user, the program comprising:
one or more computer processors,
storing a decorative object to be displayed in association with a specific part of the character object in the video, and mounting position information defining the specific part;
receiving a display request from the first viewing user requesting display of the decorative object;
generating a decorative object selection screen configured to include display elements for selecting the decorative object in response to receiving the display request, but not to include user identification information capable of identifying the viewing user;
displaying the decorative object in the video in association with the character object in response to the display element being selected;
A video distribution program that executes the following.

1 Video distribution system

Claims (11)

A video distribution server having one or more computer processors,
The one or more computer processors execute the computer readable instructions to:
Distributing a moving image including an animation of a character object generated based on a movement of an actor and a first decorative object displayed in association with a first portion of the character object;
receiving a display request from a viewing user who is viewing the video, the display requesting display of a second decorative object on the video during distribution of the video;
when the second decorative object is an object displayed in association with a second part different from the first part of the character object, generating a decorative object selection screen to include an image of the second decorative object and a display element for selecting the second decorative object in response to receiving the display request;
In response to the selection of the display element, displaying the second decorative object in the video in association with the second part of the character object;
when the second decorative object is an object displayed in association with the first part of the character object, generating a decorative object selection screen in response to receiving the display request, the decorative object selection screen including an image of the second decorative object but not including a display element for selecting the second decorative object.
Video distribution server. A video distribution server having one or more computer processors,
The one or more computer processors execute the computer readable instructions to:
Distributing a moving image including an animation of a character object generated based on a movement of an actor and a first decorative object displayed in association with a first portion of the character object;
receiving a display request from a viewing user who is viewing the video, the display requesting display of a second decorative object on the video during distribution of the video;
generating a decorative object selection screen including an image of the second decorative object and a display element for selecting the second decorative object in response to receiving the display request;
In response to the selection of the display element, displaying the second decorative object in the video in association with a second body part different from the first body part of the character object;
When the second decorative object is an object displayed in association with the second part of the character object, the display element is displayed selectably on the decorative object selection screen;
When the second decorative object is an object displayed in association with the first portion of the character object, the display element is displayed on the decorative object selection screen as being unselectable.
Video distribution server. the decorative object selection screen includes an area for displaying an image of the second decorative object, and an area for displaying a name of the second body part associated with the second decorative object;
3. The video distribution server according to claim 1 or 2. the one or more computer processors transmit purchasing information to the viewing user's client device for purchasing a purchasable gift object associated with the video;
The gift objects include a unique gift object that can be purchased only in the video, and a common gift object that can be purchased in videos other than the video.
The video distribution server according to any one of claims 1 to 3. The second decorative object is included in the gift object.
The video distribution server according to claim 4. Further comprising one or more storages for storing the second decorative object.
The video distribution server according to any one of claims 1 to 5. the display request includes object identification information that identifies the second decorative object;
The video distribution server according to claim 6. 1. A video distribution method for distributing video to a plurality of viewing users, including a first viewing user, by executing computer-readable instructions by one or more computer processors, the method comprising:
the video includes an animation of a character object generated based on a movement of an actor, and a first decorative object displayed in association with a first portion of the character object;
receiving a display request from the first viewing user requesting display of a second decorative object on the video;
generating a decorative object selection screen including an image of the second decorative object and a display element for selecting the second decorative object in response to receiving the display request, when the second decorative object is an object displayed in association with a second part different from the first part of the character object;
displaying the second decorative object in the video in association with the second part of the character object in response to the display element being selected;
generating a decorative object selection screen in response to receiving the display request, the decorative object selection screen including an image of the second decorative object but not including a display element for selecting the second decorative object, when the second decorative object is an object displayed in association with the first portion of the character object;
A video distribution method comprising: A video distribution method for distributing video to a plurality of viewing users including a first viewing user by executing computer-readable instructions by one or more computer processors, the video including an animation of a character object generated based on a movement of an actor, and a first decorative object displayed in association with a first part of the character object;
receiving a display request from the first viewing user requesting display of a second decorative object on the video;
generating a decorative object selection screen including an image of the second decorative object and a display element for selecting the second decorative object in response to receiving the display request;
In response to the selection of the display element, displaying the second decorative object in the video in association with a second part of the character object that is different from the first part;
Equipped with
When the second decorative object is an object displayed in association with the second part of the character object, the display element is displayed selectably on the decorative object selection screen;
When the second decorative object is an object displayed in association with the first portion of the character object, the display element is displayed on the decorative object selection screen as being unselectable.
Video distribution methods. A video distribution program for distributing a video to a plurality of viewing users including a first viewing user,
the video includes an animation of a character object generated based on a movement of an actor, and a first decorative object displayed in association with a first portion of the character object;
one or more computer processors,
receiving a display request from the first viewing user requesting display of a second decorative object on the video;
generating a decorative object selection screen including an image of the second decorative object and a display element for selecting the decorative object in response to receiving the display request, when the second decorative object is an object displayed in association with a second part different from the first part of the character object;
displaying the second decorative object in the video in association with the second part of the character object in response to the display element being selected;
generating a decorative object selection screen in response to receiving the display request, the decorative object selection screen including an image of the second decorative object but not including a display element for selecting the second decorative object, when the second decorative object is an object displayed in association with the first portion of the character object;
A video distribution program that executes the following: A video distribution program for distributing a video to a plurality of viewing users including a first viewing user,
the video includes an animation of a character object generated based on a movement of an actor, and a first decorative object displayed in association with a first portion of the character object;
one or more computer processors,
receiving a display request from the first viewing user requesting display of a second decorative object on the video;
generating a decorative object selection screen including an image of the second decorative object and a display element for selecting the second decorative object in response to receiving the display request;
In response to the selection of the display element, displaying the second decorative object in the video s in association with a second part different from the first part of the character object;
Run the command,
When the second decorative object is an object displayed in association with the second part of the character object, the display element is displayed selectably on the decorative object selection screen;
When the second decorative object is an object displayed in association with the first portion of the character object, the display element is displayed on the decorative object selection screen as being unselectable.
Video streaming program.

Images