JP7608242B2 - Content playback control system and program - Google Patents

Description

The present invention relates to a content playback control system and program.

Content playback systems have been developed that assign voice data to text contained in content such as manga, rather than just text, and allow the text to be read aloud using a variety of voices.

In particular, recently, a system has been known that accepts the selection of audio data for outputting the lines of characters in manga data as audio, and when the manga data is displayed, outputs the lines of the characters in the displayed manga data as audio based on the selected audio data (for example, Patent Document 1).

JP 2018-169691 A

However, the system described in Patent Document 1 simply assigns voice data to text, and it is considered difficult to ensure profits for content providers and to allow users to listen to or watch content using their preferred voice without being restricted to the voices of characters predetermined by conventional content providers.

The present invention has been made to solve the above problems, and its purpose is to provide a content playback control system that eliminates various limitations, including realistic circumstances such as the production costs of the content itself, and provides a more realistic casting experience that matches the preferences of listeners and viewers, thereby increasing the user's interest in the content.

(1) In order to solve the above problems, the present invention provides
a user information management means for managing information stored in the storage means, the user information being related to a user and speech phoneme information being associated with the user information and being composed of phoneme data collected from a speaker;
a content management means for managing content information including content data including at least text data obtained by converting a text to be spoken by the voice of the speaker into data and character data related to a character who speaks the text;
a generation processing means for executing a generation process of assigning the phoneme data to the character data based on a given instruction to generate speech language data for converting the text of the content into speech language;
a provision control means for executing a provision control process for providing the generated speech language data to a reproduction output means for reproducing and outputting the voice of the character along with the text of the content data;
a cost management means for managing a cost parameter that defines a cost related to the use of any one of phoneme data, character data, and text data used in the generation process;
a cost calculation unit that executes a calculation process to calculate an execution cost for executing the generation process based on the cost parameters;
a permission determination processing means for executing an execution permission determination process for determining whether or not to permit execution of at least one of the generation process and the provision control process based on whether or not the user has paid the execution cost calculated by the calculation process;
The present invention has a configuration comprising:

With this configuration, the present invention is capable of preventing the generation, provision, or both of speech language data from being executed if the execution cost is not paid by the user, and of executing the generation, provision, or both of speech language data from being executed if the execution cost is paid by the user.

In other words, the present invention can restrict the use of speech language data depending on whether or not the user pays the cost, thereby ensuring profits for businesses that provide content and phoneme data, and allowing users to listen to and watch content using their preferred voice, without being limited to the voices of characters (such as voice actors and actors) predetermined by conventional content providers.

The present invention therefore eliminates various limitations, including practical considerations such as the production costs of the content itself, and provides a more realistic casting experience that matches the preferences of listeners and viewers, thereby increasing users' interest in the content.

Note that "speaker" refers to the person who actually produces the voice, such as a voice actor, actor, or announcer.

The term "phoneme data" refers to data that defines the phonemes, such as consonants, vowels, and semivowels, the pitch including tones and intonations that indicate the relationships between the phonemes, stress and accent, dialect type, language type (Japanese or English), and the connections between consonants and vowels between characters (i.e., connecting elements).

In addition, "character data" refers to data of a character that recites (i.e. speaks) text as dialogue, and refers to data about characters that appear in content such as movies, manga, games, animation, or novels.

Furthermore, the "content data" stored here is content data that is composed of images (including still images and moving images) such as games, animations, movies, or manga, character data about characters that appear in the content, and text data such as lines of each character that match the images. However, the "content data" may also include data that does not contain images and is composed of text data and character data.

"Management of content information" refers to content information being readably stored in a database, or being obtained from an external source such as a network.

In addition to the above, "cost parameters" refer to parameters that define the cost of data or the consumption of items, etc., required to generate speech language data, such as character data, text data, or phoneme data.

In particular, the "cost parameter" is a consumption amount or a billing amount that is defined based on the currency in the system or the items (for example, item type or number) used in the system.

The "provision control process" also includes a process of providing various data for downloading to a playback output means (e.g., a user's terminal device) and controlling playback on the terminal device, or a process of providing content information including speech language data by a streaming method in which the playback output data is provided to the user's terminal device in real time. However, the playback output means may be a means incorporated into the system, in which case a control process for controlling the playback output means is executed as the provision control process.

(2) In order to solve the above problems, the present invention provides
a user information management means for managing information stored in the storage means, the user information being related to a user and speech phoneme information being associated with the user information and being composed of phoneme data collected from a speaker;
a content management means for managing content information including content data including at least text data obtained by converting a text to be spoken by the voice of the speaker into data and character data related to a character who speaks the text;
a generation processing means for executing a generation process of assigning the phoneme data to the character data based on a given instruction to generate speech language data for converting the text of the content into speech language;
a provision control means for executing a provision control process for providing the generated speech language data to a reproduction output means for reproducing and outputting the voice of the character along with the text of the content data;
a cost management means for managing a cost parameter that defines a cost related to the use of any one of phoneme data, character data, and text data used in the generation process;
a permission determination processing means for executing an execution permission determination process for permitting execution of at least one of the generation process and the provision control process when the cost parameter and a preset cost limit value satisfy a given relational condition;
The present invention has a configuration comprising:

With this configuration, the present invention can, for example, not generate or provide speech language data, or both, if a relationship condition is not met, such as when the cost of the phoneme data used in the generation process exceeds a cost limit value held by the user or a cost limit value set in the content, and can generate or provide speech language data, or both, if the relationship condition is met, such as when the cost of the phoneme data used in the generation process is within a limit value.

In other words, the present invention can restrict the use of speech language data depending on, for example, whether it is within the range of what the user has already paid in advance (whether it is within a predetermined payment amount such as a subscription), thereby ensuring profits for businesses that provide content and phoneme data, and allowing users to listen to and watch content purely using their preferred voice, without being limited to the voices of characters (such as voice actors and actors) predetermined by conventional content providers.

Therefore, the present invention can eliminate various limitations, including those in realistic situations, provide a more realistic casting experience that matches the preferences of listeners and viewers, and increase users' interest in the content.

In addition, the "predetermined cost limit value" refers to, for example, an upper limit value of a cost paid in advance by a user or a value corresponding thereto, and may be a value set in association with the content (for example, a value set for each content) or a value associated with the user.

(3) The present invention also provides
The method further comprises: detecting a given state of the user related to the content;
The cost management means:
The system is configured to execute a variation control process for controlling a variation of the cost parameter based on the detected user situation.

With this configuration, the present invention can execute the execution permission determination process based on the execution cost calculated using the changed cost parameter, or by comparing the changed cost parameter with the cost limit value.

In other words, the present invention can change the execution cost or the cost of using phoneme data depending on predetermined conditions such as the amount charged to the user, or, in the case of controlling playback of content by logging in to a service for listening to or viewing the content, the login status, for example.

The present invention therefore makes it possible to vary the cost paid by users of such services, the number of phoneme data that can be assigned, or the number of available contents, thereby enhancing services for users and improving their satisfaction with content usage.

As a result, the present invention can encourage long-term use of services, ensure the profitability of operators, and create an appropriate business environment.

In addition, "user status" may include, for example,
(A1) The total amount charged to the user to date;
(A2) In the case where content playback control is performed by logging in to a service for listening to or viewing content, the login status (login frequency, total login time, or number, type, and amount of benefits acquired by logging in),
(A3) The amount of time spent using the content up to now (listening time or viewing time) or the points earned through using the content, and
(A4) A degree of superiority indicating the superiority of the user over other users, such as the user's rank or level,
etc.

In addition, "controlling the variation of the cost parameter based on the detected user's situation" refers to determining the variation value by referencing table data in which the variation value and the cost parameter are associated, or calculating the variation value based on the user's situation using a given arithmetic formula.

(4) The present invention also provides
The cost management means:
The apparatus is configured to execute a variation control process for controlling a variation of the cost parameter based on related information indicating information on any one of the content data, character data, and text data.

With this configuration, the present invention can change the execution cost depending on attributes such as the number of times a character speaks and its popularity, thereby increasing user interest while ensuring profits for businesses that provide content, etc.

In the case of content data, "related information" includes, for example, genre information indicating the genre of the content, and in the case of text data or character data, attribute information indicating the attributes of the text or character.

In the case of phoneme data, "related information" includes attribute information indicating the speaker's attributes when generating the phoneme data, such as the genre, gender, age or generation of the speaker (such as a voice actor or announcer), or popularity level.

Text attributes include, for example, the type of text (such as novel, manga, non-fiction, newspaper, etc.) and the attributes of the character to which the text belongs (the character who speaks the text).

Furthermore, the character's attributes (i.e., the character's attributes) include attributes such as type (e.g., animal, robot, human, etc.), gender, age, dialect, type of language of the text (other languages), popularity, etc.

(5) The present invention also provides
A combination detection means for detecting a combination of phoneme data assigned by the generation process is further provided,
The cost management means:
The apparatus is configured to execute a variation control process for controlling the variation of the cost parameter based on information on the detected combination of phoneme data.

With this configuration, the present invention can reduce execution costs by combining phoneme data such as data collected by the same attributes (e.g., speakers in the same genre, or speakers belonging to the same organization (group)), or the same speaker, and can provide an easy-to-use environment for users.

In addition, "combined information" includes, for example, the same attributes (for example, the speaker's genre is the same, or the speaker belongs to the same organization (group), etc.), or data collected by the same speaker, etc.

(6) The present invention also provides
The generation processing means
The configuration is such that, when a character to which no phoneme data is assigned is detected as a specific character based on the user's instruction as the given instruction, predetermined phoneme data is set to the specific character.

With this configuration, the present invention eliminates the need to assign phoneme data to all characters set in the content data, improving user operability, and also reducing the burden on the user by allowing the user to listen to or watch the content even if the user is unable to assign phoneme data to a character, and by not incurring costs for phoneme data assigned to characters not specified by the user.

Therefore, the present invention can provide users with an easy-to-use environment.

(7) The present invention also provides
The generation processing means
executing the generation process for generating the speech language data in accordance with model information indicating a data model of phoneme data generated based on at least one of the attributes of the character and the attributes of the text;
A learning process is executed to learn the model information based on the generated speech language data;
The cost management means:
The system is configured to execute a variation control process for controlling the variation of the cost parameter based on the status of the learning process of the model information.

With this configuration, the present invention can execute the execution permission determination process based on the execution cost calculated using the changed cost parameter, or by comparing the changed cost parameter with the cost limit value.

In other words, the present invention can reduce or increase costs the more speech language data is generated, i.e., the more it is used, so that benefits can be passed on to users or better quality data can be provided with added value.

Note that "model information indicating a data model of phoneme data generated based on attribute information" refers to model information using artificial intelligence (AI) technology, and refers to model information of phoneme data generated, for example, when generating speech data by constructing speech sounds (i.e., sounds spoken as voice) by assigning phoneme data to text, by extracting features such as the amount and mode of change of each phoneme in association with the attribute information of each text or content, and by performing machine learning on the extracted features.

In addition, "learning process" refers to a process of performing machine learning including deep learning such as support vector machines and neural networks (e.g., recurrent neural networks) that use evaluated speech language data (i.e., spoken sounds) as training data, or deep learning without training data such as GAN (generative adversarial network) and association analysis.

Furthermore, the "learning status" includes, for example, the number of times learning has been done, the learning progress (the number of times learning has been done in a given period of time), the evaluation value of the learned speech language data (including, for example, the number of times it has been used, such as its popularity), etc.

(8) In order to solve the above problems, the present invention provides
a user information management means for managing information stored in the storage means, the user information relating to a user and speech phoneme information associated with the user information and composed of phoneme data collected from a speaker;
a content management means for managing content information including content data including at least text data obtained by converting a text to be spoken by the voice of the speaker into data and character data related to a character who speaks the text;
a generation processing means for executing a generation process of assigning the phoneme data to the character data based on a given instruction, and generating speech language data for converting the text of the content into speech language;
a provision control means for executing a provision control process for providing the generated speech language data to a reproduction output means for reproducing and outputting the voice of the character along with the text of the content data;
a cost management means for managing a cost parameter that defines a cost related to the use of any one of the phoneme data, the character data, and the text data used in the generation process;
a cost calculation unit that calculates an execution cost of the generation process based on the cost parameters; and
a permission determination processing means for executing an execution permission determination process for determining whether or not to permit execution of at least one of the generation process and the provision control process based on whether or not the user has paid the execution cost calculated by the calculation process;
The present invention has a configuration that functions as a

With this configuration, the present invention can restrict the use of speech language data depending on whether or not the user pays the cost, thereby ensuring profits for businesses that provide content and phoneme data, and allowing users to listen to and watch content using their preferred voice, without being limited to the voices of characters (such as voice actors and actors) predetermined by conventional content providers.

The present invention therefore eliminates various limitations, including practical considerations such as the production costs of the content itself, and provides a more realistic casting experience that matches the preferences of listeners and viewers, thereby increasing users' interest in the content.

(9) In order to solve the above problems, the present invention provides
a user information management means for managing information stored in the storage means, the user information relating to a user and speech phoneme information associated with the user information and composed of phoneme data collected from a speaker;
a content management means for managing content information including content data including at least text data obtained by converting a text to be spoken by the voice of the speaker into data and character data related to a character who speaks the text;
a generation processing means for executing a generation process of assigning the phoneme data to the character data based on a given instruction, and generating speech language data for converting the text of the content into speech language;
a provision control means for executing a provision control process for providing the generated speech language data to a reproduction output means for reproducing and outputting the voice of the character along with the text of the content data;
a cost management means for managing a cost parameter that defines a cost related to the use of any one of the phoneme data, the character data, and the text data used in the generation process; and
a permission determination processing means for executing an execution permission determination process for permitting execution of at least one of the generation process and the provision control process when the cost parameter and a preset cost limit value satisfy a given relational condition;
The present invention has a configuration that functions as a

With this configuration, the present invention can restrict the use of speech language data depending on, for example, whether it is within the range of what the user has already paid in advance (whether it is within the range of a predetermined payment amount such as a subscription), thereby ensuring profits for businesses that provide content and phoneme data, and allowing users to listen to and watch content purely using their preferred voice, without being limited to the voices of characters (such as voice actors and actors) predetermined by conventional content providers.

Therefore, the present invention can eliminate various limitations, including those in realistic situations, provide a more realistic casting experience that matches the preferences of listeners and viewers, and increase users' interest in content.

FIG. 1 is a diagram illustrating an example of a system configuration showing the configuration of a game system according to an embodiment. FIG. 2 illustrates functional blocks of a server device according to an embodiment. FIG. 2 is a diagram illustrating functional blocks of a terminal device according to an embodiment. FIG. 11 is a diagram (part 1) for explaining the execution permission determination process according to an embodiment. FIG. 11 is a diagram (part 2) for explaining the execution permission determination process according to an embodiment. 3A and 3B are diagrams illustrating an example of content information or phoneme information stored in a content information storage unit or a phoneme information storage unit of an embodiment; FIG. 4 is a diagram illustrating an example of user information stored in a user information storage unit of the embodiment. FIG. 11 is a diagram (part 1) for explaining an execution permission determination process based on an execution cost including an execution cost calculation process according to an embodiment; FIG. 2 is a diagram (part 2) for explaining the execution permission determination process based on the execution cost including the execution cost calculation process according to an embodiment. FIG. 11 is a diagram (part 1) for explaining the execution permission determination process based on the execution cost and the limit value according to an embodiment; FIG. 11 is a diagram (part 2) for explaining the execution permission determination process based on the execution cost and the limit value according to an embodiment; 11 is a flowchart (part 1) showing the operation of a content preview start process when starting viewing of content, including a speech language data generation process executed by a server device of one embodiment and an execution permission determination process based on an execution cost. This is a flowchart (part 2) showing the operation of a content preview start process when starting viewing of content, including a speech language data generation process executed by a server device of one embodiment and an execution permission determination process based on an execution cost.

The present embodiment will be described below. Note that the present embodiment described below does not unduly limit the content of the present invention described in the claims. Furthermore, not all of the configurations described in the present embodiment are necessarily essential components of the present invention.

[1] Content Providing System First, an overview and a general configuration of a content providing system 1 according to the present embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of a system configuration showing the configuration of the content providing system 1 according to the present embodiment.

As shown in FIG. 1, the content providing system 1 of this embodiment is configured to include a server device 10 that provides a service that allows users to view (hereinafter, this also includes only "listening") to content such as manga (animation), movies, or games, and a terminal device 20 (e.g., terminal devices 20A, 20B, 20C) that users use to view the content, and is connectable to the Internet (an example of a network).

By accessing the server device 10 from the terminal device 20, the user can receive various data transmitted from the server device 10 via the Internet and view the content.

The user can then communicate with other users by accessing the server device 10 from the terminal device 20.

The server device 10 is an information processing device capable of providing a service (hereinafter also referred to as a “content viewing service”) that allows (provides) content to users using a terminal device 20 that is communicatively connected via the Internet.

The server device 10 may also function as an SNS server that provides communication-type services.

An SNS server is an information processing device that provides a service that allows multiple users to communicate with each other.

In particular, when the server device 10 functions as an SNS server, for example, it is capable of providing content (specifically, content data configured for viewing the content) by utilizing the operating environment (API (Application Programming Interface), platform, etc.) of the SNS it provides.

Specifically, the server device 10 is capable of providing the information via a web browser of the terminal device 20, for example, a browser written in various languages such as HTML, FLASH (registered trademark), CGI, PHP, shockwave, Java (registered trademark) applet, JavaScript (registered trademark), or a dedicated application.

On the other hand, the server device 10 may be composed of one (device, processor) or multiple (devices, processors).

The billing information, login information, and content-related information stored in the memory area (memory unit 140 described below) of server device 10 may be stored in a database (broadly speaking, a storage device, memory) connected via a network (intranet or the Internet), and when functioning as an SNS server, information stored in the memory area of user information storage unit 148, etc. may be stored in a database (broadly speaking, a storage device, memory) connected via a network (intranet or the Internet).

Specifically, the server device 10 of this embodiment receives input information based on the operation of the user of the terminal device 20 (i.e., the user who wishes to view the content), and performs various processes related to the provision and viewing of the content based on the received input information.

The server device 10 then transmits data (i.e., content data) for viewing the content selected by the user to the terminal device 20, and the terminal device 20 performs various processes to provide the content data received from the server device 10 to the terminal device 20 so that the user can view it.

When allowing a user to view content via the terminal device 20, the server device 10 may provide the content data by streaming or by downloading.

The terminal device 20 is an information processing device such as a smartphone, a mobile phone, a PHS, a computer, a game device, a PDA, or an image generating device, and is a device that can be connected to the server device 10 via a network such as the Internet (WAN) or a LAN. The communication line between the terminal device 20 and the server device 10 may be wired or wireless.

In particular, the terminal device 20 has a web browser capable of browsing web pages (data in HTML format). That is, the terminal device 20 has a communication control function for communicating with the server device 10, and a web browser function for controlling display using data received from the server device 10 (web data, data created in HTML format, etc.) and transmitting data of user operations to the server device 10.

Then, the terminal device 20 uses the web browser function to obtain content data and control information for viewing the content provided by the server device 10, executes a predetermined process, and allows the user to view the content.

Specifically, when the terminal device 20 makes a request to the server device 10 to view a specific content, the terminal device 20 is connected to a site that provides the content of the server device 10, and viewing of the content begins.

The terminal device 20 is configured to use the API as necessary to cause the server device 10 functioning as an SNS server to perform a specified process, or to obtain the user information storage unit 148 managed by the server device 10 functioning as an SNS server and provide content in conjunction with various SNSs, etc.

[2] Server Device Next, the server device 10 of this embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing functional blocks of the server device 10 of this embodiment. Also, the server device 10 of this embodiment may have a configuration in which some of the components (parts) of Fig. 2 are omitted.

The server device 10 includes an input unit 120 for use in administrator and other input, a display unit 130 for performing predetermined displays, an information storage medium 180 in which predetermined information is stored, a communication unit 196 for communicating with the terminal device 20 and others, a processing unit 100 that mainly executes processing related to the content to be provided, and a storage unit 140 that mainly stores various data used for the content.

The input unit 120 is used by a system administrator or the like to input content-related settings and other necessary settings and data. For example, the input unit 120 in this embodiment is configured with a mouse, keyboard, etc.

The display unit 130 displays an operation screen for the system administrator. For example, the display unit 130 in this embodiment is configured with a liquid crystal display or the like.

The information storage medium 180 (a computer-readable medium) stores programs, data, etc., and its functions are realized by optical disks (CD, DVD), magneto-optical disks (MO), magnetic disks, hard disks, magnetic tapes, or memory (ROM), etc.

The communication unit 196 performs various controls for communicating with the outside (e.g., terminals, other servers, or other network systems), and its functions are configured by hardware such as various processors or communication ASICs, programs, etc.

The memory unit 140 serves as a work area for the processing unit 100, communication unit 196, etc., and its functions are realized by RAM (VRAM) etc.

The information stored in the storage unit 140 may be managed in a database. The storage unit 140 in this embodiment constitutes the storage means of the present invention.

In addition to the main memory unit 142, the memory unit 140 of this embodiment includes:
(A1) a content information storage unit 144 having data on each content (hereinafter referred to as "content data") and storing content information including information on the cost of viewing the content based on each content data (hereinafter referred to as "content cost information");
(A2) a phoneme information storage unit 146 for storing phoneme information that is assigned to a character appearing in content when the content is played back, has phoneme data (e.g., a data model described later) collected in advance from a speaker, and includes information regarding the cost of using the phoneme data (hereinafter referred to as "phoneme data cost information");
(A3) a user information storage unit 148 in which user information including information on content owned by each user (including content that can be viewed regardless of whether the content is owned by the user) and information on phoneme data that can be used by the user (including phoneme data that can be used regardless of whether the content is owned by the user), and information on each user, and information on management of costs paid when each user views the content (hereinafter also referred to as "user cost information") are stored in association with each user;
(A4) an application information storage unit 149 in which data (e.g., table data, etc.) necessary for viewing content, such as applications for executing various processes, including a generation process for generating speech language data for converting the text of the content into speech language (hereinafter referred to as "speech language data generation process"), is stored;
It has.

The processing unit 100 performs various processes using the main memory unit 142 in the memory unit 140 as a work area. The functions of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.) and ASICs (gate arrays, etc.), or by programs.

The processing unit 100 performs various processes of this embodiment based on programs (data) stored in the information storage medium 180. That is, the information storage medium 180 stores programs for causing a computer to function as each part of this embodiment (programs for causing a computer to execute the processes of each part).

For example, the processing unit 100 (processor) controls the entire server device 10 based on a program stored in an information storage medium, and performs various processes such as controlling the transfer of data between each unit. Furthermore, it performs processes to provide various services in response to requests from the terminal device 20.

Specifically, the processing unit 100 of this embodiment has at least a communication control unit 101, a Web processing unit 102, a login management unit 103, a user management unit 104, a content management unit 105, a speech generation processing unit 106, a cost management unit 107, a timer management unit 109, and an information provision unit 110.

For example, the user management unit 104 of this embodiment constitutes the user information management means and user status detection means of the present invention, the content management unit 105 constitutes the content management means and provision control processing means of the present invention, the speech sound generation processing unit 106 constitutes the generation processing means and combination detection means of the present invention, and the cost management unit 107 constitutes the cost calculation means, cost management means, and permission determination processing means of the present invention.

The communication control unit 101 performs processing to transmit and receive data to and from the terminal device 20 via the network. That is, the server device 10 performs various processing based on information received from the terminal device 20, etc. by the communication control unit 101.

In particular, the communication control unit 101 of this embodiment performs processing for transmitting content data and data and information used for reproducing the content data to the terminal device 20 of the user, based on a request from the terminal device 20 of the user.

The communication control unit 101 also performs various processes to accept user instructions input to the terminal device 20.

The web processing unit 102 functions as a web server. For example, the web processing unit 102 performs a process of transmitting data in response to a request from a web browser 211 installed in the terminal device 20, and a process of receiving data transmitted by the web browser 211 of the terminal device 20, via a communication protocol such as HTTP (Hypertext Transfer Protocol).

The server device 10 of this embodiment may be configured with a server for content and a server for SNS separately, or may be configured with the same server. Also, the various processes for allowing users to view and receive the content of this embodiment may be executed in part or in whole by the server device 10, or part of them may be executed by each user's terminal device 20.

The login management unit 103 manages each user's login to the content viewing service.

Specifically, the login management unit 103 registers the number of logins (total number of logins/number of logins within a specified period) and number of consecutive days of login for each user, as well as the total viewing time of content and the viewing period within a specified period (e.g., the past week or month) in the user information storage unit 148, and manages them as player-related information for each player.

The user management unit 104 records and manages user information and user cost information for each user in the user information storage unit 148.

The content management unit 105 manages the content information for each piece of content stored in the content information storage unit 144 and the speech phoneme information stored in the phoneme information storage unit 146.

In particular, the content management unit 105 provides content information including content data to the terminal device 20, and performs processing related to the provision of content data to each user and control of playback.

The speech generation processing unit 106 executes a speech language data generation process that assigns phoneme data included in the speech phoneme information to a character included in the content data based on the player's instructions or in accordance with a program, and generates speech language data for converting text spoken by the character in the content data into speech language.

The cost management unit 107 manages parameters (hereinafter also referred to as "cost parameters") that define the costs associated with the use of phoneme data, character data, and text data used in the generation process.

In particular, the cost management unit 107 executes a calculation process to calculate the cost (hereinafter referred to as "execution cost") of executing a process for allowing a user to view content, such as a generation process.

The timer management unit 109 has a timer function and is configured to manage the terminal device 20 by streaming or the like.
The timer management unit 109 is used to manage the playback status of the content when providing the content to the terminal device 20. In particular, the timer management unit 109 works in conjunction with the content management unit 105 to output the current time and a preset time to each unit. The timer management unit 109 is also used to synchronize with each terminal device 20.

The information providing unit 110 generates various content information to enable the terminal device 20 to play the content, and provides the information to the corresponding terminal device 20.

[3] Terminal Device Next, the terminal device 20 of this embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing functional blocks of the terminal device 20 of this embodiment. Also, the terminal device 20 of this embodiment may have a configuration in which some of the components (parts) of Fig. 2 are omitted.

The input unit 260 is a device for inputting input information from the user, and outputs the user's input information to the processing unit 200. In this embodiment, the input unit 260 includes a detection unit 262 that detects the user's input information (input signal). Examples of the input unit 260 include a lever, a button, a steering wheel, a microphone, a touch panel display, a keyboard, and a mouse.

The memory unit 270 serves as a work area for the processing unit 200, the communication unit 296, etc., and its functions can be realized by a RAM (VRAM) or the like. The memory unit 270 of this embodiment includes a main memory unit 271 used as a work area, and an image buffer 272 in which the final display image, etc. are stored. Note that some of these may be omitted.

The information storage medium 280 (a computer-readable medium) stores programs, data, etc., and its functions can be realized by optical disks (CD, DVD), magneto-optical disks (MO), magnetic disks, hard disks, magnetic tapes, or memory (ROM), etc.

The processing unit 200 performs various processes of this embodiment based on programs (data) stored in the information storage medium 280. The information storage medium 280 can store programs for causing a computer to function as each part of this embodiment (programs for causing a computer to execute the processing of each part).

In this embodiment, content information including programs and content data for causing a computer to function as each part of this embodiment, which are stored in the information storage medium 180 and storage unit 140 of the server device 10, is received via a network, and the received programs and data are stored in the information storage medium 280.

The storage unit 270 stores programs and data received from the server device 10. The scope of the present invention also includes cases where a network system functions by receiving programs and data in this manner.

The display unit 290 outputs the image generated by this embodiment, and its function can be realized by a CRT, LCD, touch panel display, or HMD (head mounted display), etc.

The sound output unit 292 outputs the sound generated by this embodiment, and this function can be realized by a speaker or headphones, etc.

The communication unit 296 performs various controls for communicating with the outside (e.g., other terminals, servers), and its functions can be realized by hardware such as various processors or communication ASICs, programs, etc.

The processing unit 200 (processor) performs processing such as content processing, display control, image generation processing, or sound generation processing based on information related to the content, including content data acquired from the server device 10 via the communication unit 296, input information acquired from the input unit 260, or a program, etc.

The processing unit 200 performs various processes using the main memory unit 271 in the memory unit 270 as a work area. The functions of the processing unit 200 can be realized by hardware such as various processors (CPU, DSP, etc.) and ASICs (gate arrays, etc.), or by programs.

The processing unit 200 includes a communication control unit 210, a web browser 211, a content processing unit 212, a display control unit 213, a drawing unit 220, and a sound processing unit 230. Note that some of these may be omitted.

The communication control unit 210 performs processing to transmit and receive data to and from each of the server devices 10. The communication control unit 210 also performs processing to store data received from the server device 10 in the storage unit 270, to analyze the received data, and to control processing related to the transmission and reception of other data.

The communication control unit 210 may store and manage the destination information (IP address, port number) of the server in the information storage medium 280. The communication control unit 210 may communicate with the server device 10 when it receives input information from the user to start communication.

In particular, the communication control unit 210 transmits user identification information and operation information to the server device 10, and performs processing to receive information about the content (user information, content information (content data including speech language data and text data, etc.)) and the user's web page from the server device 10.

The communication control unit 210 may transmit and receive data to and from the server device 10 at a predetermined interval, or may transmit and receive data to and from the server device 10 when input information is received from the input unit 260.

The web browser 211 is an application program for viewing web pages (content display screens), downloading HTML files, image files, etc. from a web server (server device 10), analyzing the layout, and controlling the display. The web browser 211 also transmits data to the web server (server device 10) using input forms (links, buttons, text boxes, etc.).

The web browser 211 of this embodiment can realize browser content. For example, the web browser 211 may execute a program written in JavaScript (registered trademark), FLASH (registered trademark), Java (registered trademark), or the like, received from a web server (server device 10).

The terminal device 20 can display information from a web server specified by a URL via the Internet using the web browser 211. For example, the terminal device 20 can display content (data such as HTML) received from the server device 10 using the web browser 211.

The content processing unit 212 executes various processes for displaying content. For example, the content processing unit 212 executes processes such as starting the content when a content start condition is satisfied, controlling the playback of the content based on the content data and speech language data, and ending the playback of the content when a content playback end condition is satisfied.

In particular, the content processing unit 212 generates images based on the content data, plays back speech language data according to the text indicated by the text data, and executes control processing for the character's speech in accordance with the playback of the images.

The display control unit 213 performs processing to display on the display unit 290. For example, the display control unit 213 may display using the web browser 211.

The drawing unit 220 performs drawing processing based on various processes (e.g., content processing) performed by the processing unit 200, thereby generating an image, which is output to the display unit 290 by the display control unit 213. The image generated by the drawing unit 220 may be a so-called two-dimensional image, or a so-called three-dimensional image.

The sound processing unit 230 performs sound processing based on the results of various processes performed in the processing unit 200, generates content sounds such as background music, sound effects, or voice, and outputs them to the sound output unit 292.

[4] Method of this embodiment [4.1] Overview
Next, an overview of the method (execution permission determination process) of this embodiment will be described with reference to FIG. 4 and FIG.

Note that Figures 4 and 5 are diagrams for explaining the method (execution permission determination process) of this embodiment.

The server device 10 of this embodiment is a device that works in conjunction with the terminal device 20 to provide each user with content that the user desires, and allows the user to view the content while having characters appearing in the content speak in the user's desired voice.

In other words, the server device 10 of this embodiment is configured to assign phoneme data to characters (specifically, character data) appearing in the content under the instruction of a user, execute a speech language data generation process to generate speech language data for speaking using the assigned phoneme data in accordance with the text of the character, provide content information including the generated speech language data and content data to the corresponding terminal device 20, and allow the user to view the content.

The server device 10 of this embodiment is configured to be able to restrict the use of speech language data when providing content including speech language data, depending on whether or not the user has paid the cost, or whether or not the cost is within the amount already paid.

Specifically, the server device 10, for example, as shown in FIG.
(A1) user information having information on phoneme data available to a user;
(A2) phoneme information including phoneme data to be assigned to the content;
(A3) content information including content data including text data in which a text to be converted into voice language is digitized and character data regarding a character who speaks the text;
(A4) phoneme data used in the speech language data generation process, character data of a character to which the phoneme data is assigned in the speech language data generation process, or text data of a text, or a cost parameter indicating a cost of two or more of these data;
The system has a configuration for managing the above.

Then, the server device 10 performs the following process, for example, as shown in FIG.
(B1) A speech language data generation process for generating speech language data for converting the text of the content into speech language by allocating phoneme data to character data (or text data) based on a given instruction such as an instruction from a player or an instruction from a program;
(B2) A process of providing the generated speech language data to the corresponding terminal device 20 that reproduces and outputs the voice of the character along with the text of the content (hereinafter referred to as a “content provision control process”);
(B3) an execution cost calculation process for calculating an execution cost for executing the speech language data generation process based on the cost parameters; and
(B4) an execution permission determination process for determining whether or not at least one of the speech language data generation process and the content provision control process is permitted to be executed based on whether or not the user has paid the execution cost calculated by the calculation process;
The present invention has a configuration for executing the above.

In addition, FIG. 4 shows that the server device 10 manages user information including phoneme data IDs as information on phoneme data that the user can use, phoneme information consisting of phoneme data and cost parameters associated with each phoneme data, and content information having character data and text data (see [1] Data Management in FIG. 4). However, FIG. 4 shows an example in which only the cost information included in the phoneme information is used.

Figure 4 also shows that phoneme data A, C, and E to be assigned to characters 1, 2, and 3 have been selected, and that the execution cost has been calculated from the cost information (i.e., cost parameters) of the selected phoneme data A, C, and E (see [2] Execution cost calculation process in Figure 4).

Figure 4 shows that the calculated execution cost is notified to the terminal device 20, and whether or not the user has paid the execution cost (paid or unpaid) is detected, and whether or not the speech language data generation process can be executed is determined based on the detection (see processes [3] and [4] in Figure 4), and if it is detected that the user has paid, phoneme data A, C, and E are assigned to characters 1, 2, and 3, and an instruction to generate speech language data is given and the generation is executed, and the generated speech language data is provided to the terminal device 20 (see processes [5] and [6] in Figure 4).

In particular, in the speech language generation process of FIG. 4, phoneme data A, phoneme data C, and phoneme data E are assigned to character 1 (character data 1 and text data 1), character 2 (character data 2 and text data 2), and character 3 (character data 3 and text data 3), respectively, and speech language data A, speech language data E, and speech language data C are generated.

On the other hand, instead of the process of (B4) above, the server device 10 may, for example, as shown in FIG. 5, in an execution permission determination process, compare the execution cost of the phoneme data calculated by the calculation process with a predetermined limit value (i.e., the upper limit value of the cost), and if the execution cost includes predetermined relationship information, execute an execution permission determination process to determine whether or not to permit the execution of at least one of the speech language data generation process and the content provision control process.

In addition, FIG. 5 shows that the server device 10 manages user information including a phoneme data ID as information on phoneme data available to the user, phoneme information consisting of phoneme data and cost parameters associated with each phoneme data, and content information including character data and text data, similar to the example shown in FIG. 4 (see [1] Data Management in FIG. 5).

Also, in FIG. 5, similar to the example shown in FIG. 4, phoneme data A, C, and E to be assigned to characters 1, 2, and 3 are selected, and the execution cost is calculated from the cost information (cost parameters) of the selected phoneme data A, C, and E (see [2] Data Management in FIG. 5).

Figure 5 shows that the execution cost is compared with a limit value to determine whether or not to execute the speech language data generation process (see process [4] in Figure 5), and if the execution cost is less than the limit value, phoneme data A, C, and E are assigned to characters 1, 2, and 3, and an instruction to generate speech language data is issued and executed, and the generated speech language data is provided to the terminal device 20 (see processes [5] and [6] in Figure 5).

In particular, in the speech language generation process of FIG. 5, similar to the example shown in FIG. 4, phoneme data A, phoneme data C, and phoneme data E are assigned to character 1 (character data 1 and text data 1), character 2 (character data 2 and text data 2), and character 3 (character data 3 and text data 3), respectively, and speech language data A, speech language data E, and speech language data C are generated.

In this embodiment, by having such a configuration, the use of speech language data and content can be restricted depending on whether or not the user pays the cost, which ensures profits for the business that provides the content and phoneme data, and allows the user to listen to and watch content using the voice of their choice, without being limited to the voice of a character (such as a voice actor or actor) predetermined by a conventional content provider.

In addition, in this embodiment, the use of speech language data can be restricted depending on whether or not it is within the range of what the user has already paid (whether or not it is within the range of a predetermined payment amount such as a subscription), for example, which ensures profits for businesses that provide content and phoneme data, and allows users to listen to and watch content purely using their favorite voice, without being limited to the voices of characters (such as voice actors and actors) predetermined by conventional content providers.

Therefore, in this embodiment, various limitations, including realistic circumstances such as the production costs (i.e., budget) of the content itself, are eliminated, and a more realistic casting experience that matches the preferences of listeners and viewers is provided, thereby increasing the user's interest in the content.

[4.2] Content Information, etc. Next, the content information, phoneme information, and user information of this embodiment will be described with reference to FIG.

6 shows the content information storage unit 144 or the phoneme information storage unit 14
FIG. 7 is a diagram showing an example of the content information or phoneme information stored in the user information storage unit 148 of the present embodiment.

(Content information)
Each piece of content information is information about content that a user views, such as movies, manga, games, animations, or novels, and has various data and information that can be viewed by the terminal device 20, is stored in the content information storage unit 144, and is managed by the content management unit 105.

For example, as shown in FIG. 6A, each piece of content information is associated with a content ID and includes the following:
(A1) Content data including image data, character data, and text data in which text has been digitized;
(A2) Cost-related information including content cost information that specifies the cost (including consumption of items, points, etc.) when viewing content and limit value information that indicates the limit value of the execution cost set at the time of the speech voice data generation process for each content,
(A3) playback control information including playback control data for assigning speech language data to the content data and playing the content data and text data on the terminal device 20; and
(A4) Additional information such as the title, synopsis, trailer, and advertising content (hereinafter referred to as "additional information");
etc.

In particular, character data refers to data about characters who speak text, and indicates data that specifies information about the attributes of characters that appear in content such as movies, manga, games, animation, or novels (i.e., attribute information).

For example, attributes include the character's type (such as animal, robot, or human) and role (role), the character's gender and age, the character's characteristics (personality), the dialect or language of the text (other languages) that the character uses, and the character's popularity.

Text data may be lines from each character appearing in the content, sentences explaining each scene (e.g., stage directions), one or more sentences, or data on text for each division such as a chapter, page, paragraph, or section.

Note that the text data may have already undergone natural language processing such as morphological analysis, syntactic analysis, semantic analysis, and contextual analysis, and information on the analysis results (hereinafter referred to as "text analysis information") and information indicating the attributes of the character for which the text is used (i.e., the attributes of the character speaking the text) (i.e., attribute information) may be specified.

For example, text analysis information includes information about parts of speech in each text, such as words, characters, strings of characters, and sentences, information about dependencies, information indicating meaning, and information about the targets of inferred pronouns and omitted nouns.

In other words, the text data may contain information about each text, such as parts of speech, dependencies, meanings, pronouns, and omitted objects.

On the other hand, in the content cost information, the cost information defining the character data may be parameters (i.e., cost parameters) defined for all characters appearing in the content, or may be cost parameters defined for the main character or for characters that are important in the content.

In addition, in the content cost information, the cost information defining the text data may be defined not only for the entire content data, but also for each predetermined part, such as for each scene, each line, or each character.

The content cost information is a cost such as a consumption amount defined based on the in-service currency used in the content viewing service or items used in the service (e.g., the number, or the type and the number of items), or a parameter that defines the charge amount corresponding to the cost (hereinafter also referred to as a "content cost parameter").

In this embodiment, content data does not include image data, but includes text data and character data.

In addition, the content information in this embodiment is stored in the content information storage unit 144, but may also be obtained from another database (not shown).

(Phoneme information)
Each piece of phoneme information is information about a phoneme that has been collected and generated in advance from a speaker, such as a voice actor, actor, or announcer, and is used when generating speech language data to be used when making the characters of the content speak based on text.

For example, as shown in FIG. 6B, each piece of phoneme information is associated with a phoneme data ID, and is stored as follows:
(B1) Phoneme data that specifies segmented phonemes such as consonants, vowels, and semivowels, pitch including tones and intonations that indicate the relationships between the segmented phonemes, stress and accent, dialect type, language type (Japanese or English), and connections between consonants and vowels between characters (i.e., connecting elements), etc.
(B2) phoneme cost information that specifies the cost (amount of items consumed or amount charged) when the phoneme data is used in the speech language data generation process; and
(B3) Additional information such as bibliographic information to explain the phoneme information to the user (hereinafter also referred to as "additional information");
Includes:

Note that, like content cost information, phoneme cost information is a parameter (hereinafter also referred to as a "phoneme cost parameter") that specifies a cost such as a consumption amount defined based on the in-service currency used in the content viewing service or items used in the service (e.g., the number, or the type and the number of items) or the billing amount corresponding to the cost.

(User Information)
As shown in FIG. 7, the user information includes, for each user, (C1) the user's nickname and user ID,
(C2) Information regarding attributes such as current rank, points, experience points, energy parameter values (life energy values, physical strength values, and power values in cases where game-like elements are included in the content viewing service, etc.) (hereinafter also referred to as "attribute information");
(C3) Information indicating availability of available content data, character data, text data, and phoneme information (hereinafter referred to as "availability information", for example, information indicating numerical restrictions such as the number of times of viewing, time restrictions such as viewing period, or individual restrictions for each user such as user level, associated with a phoneme ID or content ID);
(C4) Including the payment status for the content viewing service, etc. Information on charges such as the charge history and charge amount for the service (user cost information), and information indicating limit values such as payment restrictions at the time of speech voice data generation processing (hereinafter also referred to as "limit value information");
(C5) Information regarding the login history, such as the number of logins to the content viewing service, the time and frequency of logins (hereinafter referred to as "access history information");
(C6) Information regarding other users with whom you have a certain relationship, such as registered friends or followers (hereinafter also referred to as "related users") (hereinafter referred to as "related user information");
etc. are stored.

[4.3] Speech Language Data Generation Processing Next, the speech language data generation processing of this embodiment will be described.

(Outline of speech language data generation process)
The speech generation processing unit 106 executes a speech language data generation process, based on the result of the execution permission determination process, and in accordance with the player's instructions or a program, in which the phoneme data contained in the phoneme information is assigned to character data (i.e., characters) contained in the content data, to generate speech language data for converting the text of the content into speech language.

Specifically, when content information is selected by the player or automatically according to a program, the speech generation processing unit 106 extracts information on all characters that appear in the content or characters to which phoneme data can be assigned (i.e., character information) from the selected content information.

Then, based on each extracted character information, the speech generation processing unit 106 generates character selection information including the type of character for which phoneme data is to be assigned to the player and information about the character, and transmits the generated character selection information so that each selectable character is presented to the player for selection.

The speech generation processing unit 106 also acquires speech phoneme information of phoneme data that can be assigned by the player, generates assignable phoneme selection information including information indicating the type and characteristics of the phoneme data, and transmits the generated assigned phoneme selection information so that the assignable phoneme data can be presented to the player in a selectable manner.

Then, when the speech generation processing unit 106 acquires combination information indicating the combination of the character selected by the player and the phoneme data desired to be assigned to that character, it executes a speech language data generation process that generates speech language data for speechifying the text of the selected character based on the corresponding phoneme data based on the combination information and character data indicating each text for the corresponding character.

In particular, at this time, an execution permission determination process is executed, and if execution of the speech language data generation process is permitted (if it is determined that the execution cost has been paid by the user or if it is determined that the execution cost is within the limit value), the speech language generation processing unit 106 executes the speech language data generation process to generate speech language data that will become the speech of each character based on the phoneme data assigned by the player to each character data.

(Principles of speech data generation processing)
As part of the speech language data generation process, the speech generation processing unit 106 obtains analytical information on the text of the character selected by the player, or performs a predetermined analysis such as natural language processing (i.e., morphological analysis, syntactic analysis, etc.) on the text of the selected character to obtain the analytical information.

Then, the speech generation processing unit 106 assigns segmented phonemes such as consonants, vowels, and semivowels based on the selected phoneme data, in accordance with the analysis information in the corresponding text, and in line with each text (i.e., character strings or individual characters), and adjusts the pitch including tone and intonation that indicate the relationship between the segmented phonemes, stress and accent, dialect type, language type (Japanese or English), and the connections between consonants and vowels between characters (i.e., connecting elements), etc., to generate speech language data.

Specifically, when the speech generation processing unit 106 generates speech data by constructing speech sounds (i.e., sounds spoken as voice) by allocating phoneme data to text, it allocates segmental phonemes and adjusts pitch, stress, accent, and conjunctions, including tone and intonation, based on text analysis information, and generates speech language data using AI techniques such as machine learning, including the analysis information.

In other words, when the speech generation processor 106 assigns phonemes (segmented phonemes) to character strings or individual characters, and adjusts pitch, stress, accent, connection, etc., it uses analysis information from natural language processing, as well as phoneme data model information using artificial intelligence (AI) technology that is composed of a learnable data model of the phoneme data that is generated in advance based on the attributes of the character to which the phoneme data is assigned, or the attributes of the text.

In particular, the speech generation processing unit 106 extracts features such as the amount of change or the manner of change of each phoneme in association with each attribute of the content, character, text, etc. (in particular, the attributes of the character and the attributes of the text), and uses model information of the phoneme data generated by performing machine learning on the extracted features.

In other words, the speech generation processing unit 106 executes a speech language data generation process that generates speech language data for converting text into the voice of a speaker, based on analysis information in natural language processing and in accordance with model information indicating a data model of phoneme data generated based on at least one of the attributes of the character and the attributes of the text.

For example, the speech generation processing unit 106 uses model information of phoneme data on which machine learning including deep learning such as support vector machines and neural networks (e.g., recurrent neural networks) that use evaluated speech language data (i.e., spoken sounds) as training data, or machine learning including deep learning without training data such as GAN (generative adversarial network) and association analysis, has been performed.

The speech generation processing unit 106 then uses the model information of this phoneme data to perform the speech data generation process.

On the other hand, the speech generation processing unit 106 executes a learning process to learn model information for phoneme data based on the generated speech language data.

In other words, each time the speech speech generation processing unit 106 generates the speech language data, it learns the model information to generate new model information and updates it, and uses the updated model information to generate the next and subsequent speech language data.

(Handling characters with no phoneme data assigned)
If the speech generation processing unit 106 is unable to obtain combination information indicating combinations with phoneme information for all assignable characters (i.e., if there is a character to which the user does not wish to assign phoneme information), it may assign predetermined phoneme data as a default to the character, or it may perform matching between the character's characteristics and the phoneme data characteristics based on the speech phoneme information and character information to assign specific phoneme data to the character.

In other words, when the speech generation processing unit 106 detects a character to which no phoneme data is assigned as a specific character based on a user instruction, it may set predetermined phoneme data to the specific character.

[4.4] Execution permission judgment processing based on execution cost [4.4.1] Execution permission judgment processing based on execution cost including execution cost calculation processing Next, using Figures 8 and 9, the execution permission judgment processing based on execution cost including the execution cost calculation processing of this embodiment will be described.

Note that Figures 8 and 9 are diagrams for explaining the execution permission determination process based on the execution cost, including the execution cost calculation process of this embodiment.

(Basic Principles)
The cost management unit 107 performs an execution permission determination process that determines whether or not to execute the speech voice data generation process based on whether or not the user has paid the execution cost (consumption of items, etc.) of the phoneme data, while assuming management of cost parameters such as phoneme data.

In other words, the cost management unit 107 is configured to perform such an execution permission determination process so as not to execute the generation of speech language data, etc., if the execution cost is not paid by the user, but to execute the generation of speech language data, etc., if the execution cost is paid by the user.

Specifically, the cost management unit 107 manages a cost parameter that specifies the cost associated with using any one of the phoneme data, character data, and text data used in the generation process.

In particular, the cost management unit 107 manages the cost parameters (reference values) of each character included in the content cost information stored in the content information storage unit 144, and the cost parameters (reference values) of each text (including the text of the entire content or part of the text).

The cost management unit 107 also manages cost parameters (reference values) related to the use of each phoneme data included in the phoneme cost information stored in the phoneme information storage unit 146.

Then, the cost management unit 107 executes a calculation process (i.e., an execution cost calculation process) to calculate the total cost (i.e., the execution cost) of the speech language data generation process described above based on the respective cost parameters (reference values) of the phoneme data, character data, text data, or a combination of two or more of these selected by the user or automatically selected according to the program when the speech language data generation process is executed.

Then, based on the execution cost calculated in this manner, the content management unit 105 requests the relevant user to make payment in a predetermined manner (hereinafter also referred to as an "execution cost payment request"), and executes an execution permission determination process that determines whether or not the speech language data generation process can be executed based on whether or not the user has made payment.

(Execution cost calculation process)
In the execution cost calculation process, when one or more phoneme data to be assigned to a character or text are selected by a user or by a program, the cost management unit 107 reads out cost parameters managed in association with each selected phoneme data or with each character data or text data to which each phoneme data is expected to be assigned.

Then, the cost management unit 107 calculates the execution cost by performing a given calculation, such as adding up each of the read cost parameters.

In particular, as an execution cost calculation process, the cost management unit 107 performs a predetermined calculation (e.g., summation) based on the cost parameters defined for each phoneme data that the user wishes to assign, and calculates the result of the calculation as the execution cost (hereinafter referred to as the "phoneme data execution cost calculation process"), as shown in FIG. 8.

For example, as shown in FIG. 8, assume that phoneme data A (cost: 50 points), phoneme data B (cost: 50 points), phoneme data C (cost: 40 points), phoneme data D (cost: 60 points), and phoneme data E (cost: 45 points) are available to the user, and that phoneme data A, C, and E are selected from among them.

In this case, the cost management unit 107 executes the execution cost calculation process as shown in FIG. 8, and calculates 135 points as the execution cost.

On the other hand, instead of the above, the cost management unit 107 may execute an execution cost calculation process in which it performs a predetermined calculation (e.g., summation) based on the cost specified for each character to which the phoneme data desired by the user is assigned, and calculates the result of the calculation as the execution cost (hereinafter referred to as "character cost calculation process").

For example, as shown in FIG. 9, assume that phoneme data A, phoneme data B, phoneme data C, phoneme data D, and phoneme data E are available to the user, of which phoneme data A, C, and E are selected, and that the content to which the phoneme data is assigned includes characters 1 (cost: 100 points), 2 (cost: 50 points), and 3 (cost: 40 points), each of which has a set cost.

In this case, the cost management unit 107 executes the character cost calculation process as shown in FIG. 9, and calculates an execution cost of 190 points.

In this embodiment, the execution cost is calculated based on the phoneme data or characters, but the execution cost may also be calculated based on the cost specified in the text (including a part of it) to which the phoneme data is assigned, or the execution cost may be calculated based on the respective cost parameters of a combination of two or more of the phoneme data, characters, or text used in the speech language data generation process.

(Execution permission determination process)
When the content management unit 105 calculates the execution cost as described above, it presents to the terminal device 20 of the relevant user a request for payment of the execution cost, which is determined based on the system currency or items used in the system (e.g., number, or type and number), or a charge amount corresponding to the cost.

Specifically, the content management unit 105 transmits, via the information provision unit 110, to the relevant terminal device 20, information indicating the calculated consumption amount or charge amount of the item, as well as an execution cost payment request to prompt the user to pay the consumption or charge amount of the item.

Then, when the content management unit 105 receives information regarding payment of the presented price or information regarding billing via the terminal device 20, it executes an execution permission determination process that determines whether or not the user has made a payment based on the received information.

At this time, as shown in FIG. 4 above, for example, if the content management unit 105 receives information indicating that the payment for the execution cost has been properly made in the execution permission determination process, it permits the execution of the speech language data generation process, and if it receives information indicating that the payment for the fee has not been properly made, it executes a stop process to stop the speech language data generation process and generate information indicating the stop and provide it to the relevant terminal device 20.

[4.4.2] Execution Permission Determination Processing Based on Limit Values Next, the execution permission determination processing based on the execution cost and limit values of this embodiment will be described with reference to FIGS.

Note that Figures 10 and 11 are diagrams for explaining the execution permission determination process based on the execution cost and limit value in this embodiment.

Instead of the above-mentioned execution permission determination process, the cost management unit 107 may execute an execution permission determination process that permits the execution of the speech voice data generation process when it is determined that the execution cost calculated by the above-mentioned execution cost calculation process and a predetermined cost limit value satisfy a given relationship condition.

In particular, the content management unit 105 may set a preset cost limit value, for example, a cost paid in advance by the user (amount of items consumed in advance or a charge), or a limit amount (including the amount of items or points consumed; the same applies below) when a certain service can be enjoyed by paying a certain amount (such as a monthly charge or annual fee) for a subscription, or a value indicating a limit amount set in advance by a content provider, or an upper limit value or a corresponding value, which may be a value set in association with each piece of content (for example, a value set for each piece of content) or a value set in association with each user.

The content management unit 105 uses conditions such as the cost of the phoneme data used in the generation process not exceeding these limit values as a given relationship condition.

In other words, as an execution permission determination process based on a limit value, the content management unit 105 is configured to perform such an execution permission determination process in such a way that it does not allow the generation of speech language data, etc. to be executed when a given relationship condition is not met, such as when the cost of the phoneme data used in the generation process does not exceed a predetermined cost limit value, and allows the generation of speech language data, etc. to be executed when a given relationship condition is met, such as when the cost exceeds the limit value.

Specifically, the cost management unit 107 manages the cost parameters (reference values) of each phoneme data included in the phoneme cost information stored in the phoneme information storage unit 146, as described above.

In addition, the cost management unit 107 executes a calculation process (i.e., an execution cost calculation process) to calculate the total cost (i.e., the execution cost) of the speech language data generation process based on the cost parameters (reference values) of the phoneme data selected by the user or automatically selected according to the program when the above-mentioned speech language data generation process is executed.

Then, the content management unit 105 executes an execution permission determination process to determine whether the execution cost calculated in this manner is within a limit value based on, for example, the cost already paid by the user.

At this time, in the execution permission determination process, if the execution cost is within the limit value, the content management unit 105 permits the execution of the speech voice data generation process, and if the execution cost exceeds the limit value, it executes a stop process to stop the speech language data generation process and generate information indicating the stop and provide it to the relevant terminal device 20.

For example, as shown in FIG. 10, assume that a user has available phoneme data A (cost: 50 points), phoneme data B (cost: 50 points), phoneme data C (cost: 40 points), phoneme data D (cost: 60 points), and phoneme data E (cost: 45 points) and that the cost limit set for user A (points corresponding to the amount already paid by user A) is 150 pt.

In this case, as shown in FIG. 10, when phoneme data A, C, and E are selected, the cost management unit 107 calculates the execution cost to be 135 pt, which is within the upper limit of 150 pt, and therefore determines to permit the execution of the speech language data generation process.

On the other hand, even in a similar case to the above, when phoneme data A, B, and C are selected as shown in FIG. 10, the cost management unit 107 calculates the execution cost to be 160 pt, which exceeds the upper limit of 150 pt, and therefore determines to stop the execution of the speech language data generation process, and executes the stop process.

In addition, the limit value may be set for each content instead of for each user.

For example, in this case, as shown in FIG. 11, it is assumed that the user has available phoneme data A (cost: 50 points), phoneme data B (cost: 50 points), phoneme data C (cost: 40 points), phoneme data D (cost: 60 points), and phoneme data E (cost: 45 points), and the upper cost limit set for the content with content ID IDC0001 is 150 pt.

In this case, as shown in FIG. 11, when phoneme data A, C, and E are selected, the cost management unit 107 calculates the execution cost to be 135 pt, which is within the upper limit of 150 pt, and therefore determines to permit the execution of the speech language data generation process.

On the other hand, even in a similar case to the above, when phoneme data A, B, and C are selected as shown in FIG. 11, the cost management unit 107 calculates the execution cost to be 160 pt, which exceeds the upper limit of 150 pt, and therefore determines to stop the execution of the speech language data generation process, and executes the stop process.

[4.5] Content Provision Control Processing Next, the content provision control processing of this embodiment will be described.

The content management unit 105 works in conjunction with the information provision unit 110 to execute a provision control process that transmits (provides) the speech language data generated by the speech voice data generation process together with the content information to the terminal device 20 that plays and outputs the voice of the character along with the text of the content via the communication control unit 111.

In particular, as a provision control process, the content management unit 105 provides the relevant terminal device 20 with content information (including playback control information) that includes, together with the spoken voice data, speech control for making speech based on the spoken voice data in accordance with the text, and playback control data such as image generation control for displaying an image on the terminal device 20 in accordance with the text.

On the other hand, in this embodiment, the execution permission determination process determines whether or not to execute the speech voice data generation process, but instead of or in addition to the speech voice data generation process, the execution permission determination process may determine whether or not to execute the content provision control process based on the determination result of the execution permission determination process.

In other words, when the final judgment of the content provision control process is to stop the process, the content management unit 105 may also stop the execution of the provision control process instead of stopping the speech voice data generation process.

In this case, it is assumed that the spoken voice language data has been generated by the voice language data generation process, and the content management unit 105 performs the following in the execution permission determination process:
(A1) When it is determined that the payment for the execution cost calculated by the execution cost calculation process has been properly executed, or
(A2) If it is determined that the cost of the phoneme data used in the generation process and the predetermined limit value satisfy the above-mentioned relationship condition,
A provision control process is executed to provide the content information including the spoken speech language data generated by the speech language data generation process to the corresponding terminal device 20 .

In addition, the content management unit 105 performs the execution permission determination process as follows:
(B1) It is determined that the payment for the execution cost calculated by the execution cost calculation process has not been properly executed, or
(B2) If it is determined that the cost of the phoneme data used in the generation process and the predetermined limit value do not satisfy the above-mentioned relationship condition,
The provision control process of providing the content information including the spoken speech language data generated by the speech language data generation process to the corresponding terminal device 20 is stopped.

Note that if the provision control process is stopped, spoken language data may not be generated.

[4.6] Modifications Next, a first modification of the option status detection process of this embodiment (change status of specification change process) will be described.

(Execution permission determination process 1 in response to fluctuations in cost parameters/user status)
In this modified example, instead of using a cost parameter (reference value) when calculating the execution cost in the above embodiment, the execution permission determination process may be performed using a cost parameter that is varied from a reference value based on the content-related situation of the relevant user (i.e., the user situation).

In other words, in this modified example, the execution cost may be changed by varying the cost parameters in the phoneme data, character data, or text data from a reference value based on the user status, such as the login status for the content viewing service, and the execution permission determination process based on the execution cost or the execution permission determination process based on the limit value may be executed based on the changed execution cost.

Specifically, the user management unit 104 detects a given situation regarding the user's content.

For example, the user management unit 104 may store the following as the user status:
(A1) the amount charged to the user,
(A2) Login status (login frequency, total login time, or benefits acquired by logging in) for a service for listening to or viewing the content (i.e., a content viewing service),
(A3) The time spent using the content (listening time or viewing time) or the points earned through using the content, and
(A4) A degree of superiority indicating the superiority of the user over other users, such as the user's rank or level,
Detect etc.

The cost management unit 107 also executes a variation control process to determine the variation value of the cost parameter (cost parameter of phoneme data, character data, or text data) in the detected user situation based on the detected user situation and table data having variation values of the cost parameters (reference values) stored in association with each user situation, and calculates the execution cost of the phoneme data, etc., as described above, based on the determined variation value.

In this case, the content management unit 105 uses the execution cost calculated based on the variation value to perform various execution permission determination processes (i.e., execution permission determination processes based on the execution cost or execution permission determination processes based on the limit value).

Furthermore, by varying the execution cost in this way, it is possible to enhance discounts and other services for users of the content viewing service, thereby improving the user's satisfaction with content usage.

(Execution permission determination process 2 in response to fluctuations in cost parameters/content-related information)
In this modified example, in the above embodiment, when calculating the execution cost, the execution permission determination process may be performed using a cost parameter that is varied from a reference value based on content-related information such as the type of content or character attributes (hereinafter referred to as "content-related information") or phoneme-related information (hereinafter referred to as "phoneme data-related information").

In other words, in this modified example, the execution cost may be changed by varying a cost parameter in the phoneme data, character data or text data depending on attributes such as the number of times a character speaks or its popularity as related information, and an execution permission determination process based on the execution cost or an execution permission determination process based on a limit value may be executed based on the changed execution cost.

Specifically, the cost management unit 107 identifies content-related information from the relevant content information, including character and text information stored in the content information storage unit 144, or identifies phoneme data-related information from the relevant speech phoneme information stored in the phoneme information storage unit 146.

In particular, the cost management unit 107 identifies, as content-related information, genre information indicating the genre of the content (comedy, horror, romance, action, or action), attribute information indicating attributes of the text data such as novel, manga, non-fiction, newspaper, etc., or attribute information indicating attributes of the character data such as type (animal, robot, human, etc.), gender, age, dialect (standard Japanese, Kansai dialect, Tohoku dialect, Kyushu dialect, etc.), type of language of the text (other languages), and popularity.

In addition, the cost management unit 107 identifies attribute information such as the genre, gender, age or generation, or popularity of the speaker, such as a voice actor or announcer, as phoneme data-related information.

Then, the cost management unit 107 executes a variation control process to identify the variation values of the cost parameters (cost parameters of phoneme data, character data, or text data) corresponding to the content-related information or the phoneme data-related information based on the content-related information, the phoneme data-related information, or both, and table data having variation values of the cost parameters corresponding to the content-related information, the phoneme data-related information, or both, and calculates the execution cost of the phoneme data, etc., as described above, based on the identified variation values.

In this case, the content management unit 105 performs various execution permission determination processes (i.e., execution permission determination processes based on the execution cost or limit value) using the execution cost calculated based on the fluctuation value as described above.

Furthermore, by varying the execution cost in this way, it is possible to enhance discounts and other services for users of the content viewing service, thereby improving the user's satisfaction with content usage.

(Execution permission determination process 3 according to fluctuation of cost parameters/combination of phoneme data)
In this modified example, instead of using a cost parameter (reference value) when calculating the execution cost in the above embodiment, the execution permission determination process may be performed using a cost parameter that is varied from a reference value based on the combination of phoneme data used in the speech language data generation process (i.e., assigned to the character).

In other words, in this modified example, depending on the combination of phoneme data assigned to a character, such as data collected from the same speaker, the execution cost may be changed by varying the cost parameters in the phoneme data, and the execution permission determination process based on the execution cost or the execution permission determination process based on the limit value may be executed based on the changed execution cost.

Specifically, when the speech language data generation process is executed, the cost management unit 107 identifies phoneme data related information from the corresponding speech phoneme information stored in the phoneme information storage unit 146 for each phoneme data assigned to the character.

In particular, the cost management unit 107 identifies attribute information such as the genre, gender, age or generation, or popularity of the speaker such as a voice actor or announcer for each assigned phoneme data, as the phoneme data related information.

Then, the cost management unit 107 executes a variation control process to identify the variation value of the cost parameter in the combination based on the identified combination of phoneme data related information and table data having the variation value of the cost parameter corresponding to the combination of phoneme data related information, and calculates the execution cost of the phoneme data, etc., as described above, based on the identified variation value.

In this case, the content management unit 105 performs various execution permission determination processes (i.e., execution permission determination processes based on the execution cost or limit value) using the execution cost calculated based on the fluctuation value as described above.

Furthermore, by varying the execution cost in this way, it is possible to enhance discounts and other services for users of the content viewing service, thereby improving the user's satisfaction with content usage.

In addition, in this modified example, the execution cost may be changed by varying the cost parameters in the character data and text data depending on the combination of phoneme data assigned to the character, such as whether the data was collected from the same speaker.

(Execution permission determination process 4 in response to fluctuations in cost parameters/learning status of model information)
In this modified example, instead of using a cost parameter (reference value) when calculating the execution cost in the above embodiment, the execution permission determination process may be performed using a cost parameter that is varied from a reference value based on the learning status of the data model of the phoneme data when the speech language data generation process is repeatedly executed.

In other words, in this modified example, the execution cost may be changed by varying the cost parameters in the phoneme data depending on the learning situation, such as the number of times the model information has been learned, the learning progress (the number of times it has been learned in a given period), or the evaluation value of the learned speech language data (including, for example, the number of times it has been used, such as popularity), and the execution permission determination process based on the execution cost or the execution permission determination process based on the limit value may be executed based on the changed execution cost.

Specifically, when executing the speech language data generation process, the cost management unit 107 acquires learning status information indicating the learning status, such as the number of times learning has been performed and popularity, along with model information of the phoneme data stored in the phoneme information storage unit 146.

Then, the cost management unit 107 executes a variation control process to identify the variation value of the cost parameter in the generated spoken speech language data based on the learning status information and table data having the variation value of the cost parameter corresponding to the learning status information, and calculates the execution cost of the phoneme data, etc., as described above, based on the identified variation value.

In this case, the content management unit 105 performs various execution permission determination processes (i.e., execution permission determination processes based on the execution cost or limit value) using the execution cost calculated based on the fluctuation value as described above.

Furthermore, by varying the execution cost in this way, it is possible to enhance discounts and other services for users of the content viewing service, thereby improving users' satisfaction with content usage.

In addition, in this modified example, the execution cost may be changed by varying the cost parameters in the character data and text data depending on the combination of phoneme data assigned to the character, such as whether the data was collected from the same speaker.

(User's phoneme data)
In the above embodiment, phoneme data collected in advance by a speaker is used, but phoneme data may be generated from the user's own voice, and the generated phoneme data may be used to perform the speech language data generation process.

[5] Operation in this embodiment [5.1] Content viewing start processing including execution permission determination processing based on execution cost Next, using Figure 12, we will explain the operation of the speech language data generation processing executed by the server device 10 of this embodiment, and the content preview start processing when starting viewing of content including the execution permission determination processing based on execution cost.

Note that FIG. 12 is a flowchart showing the operation of the speech language data generation process executed by the server device 10 of this embodiment, and the content preview start process when starting to view content, including the execution permission determination process based on the execution cost.

This operation is performed when the phoneme data is assigned to a character in the content the user wishes to view by selection, subject to the user's payment of the cost, and the content is provided to the terminal device 20 via streaming so that it can be viewed.

In this operation, it is assumed that the content desired by the user is already stored in the content information storage unit 144, and that each piece of phoneme data to be assigned is already stored in the phoneme information storage unit 146, including a cost parameter indicating its cost.

Before starting this operation, the user is presented with information for selecting the content to be viewed and the phoneme information to be assigned.

First, when the content management unit 105 receives information regarding the content to be viewed and the phoneme data to be assigned to the characters appearing in the content (i.e., information regarding the phoneme data selected by the user) together with the user's instruction to view the content transmitted from the terminal device 20 via the communication control unit 101 (step S101), the cost management unit 107 reads the phoneme cost information of the assigned phoneme data from the phoneme information storage unit 146 and calculates the execution cost of generating speech language data using the assigned phoneme data (step S102).

Next, the information providing unit 110 transmits information to present the calculated execution cost to the relevant user via the communication control unit 101 to the terminal device 20 of the user, and waits to receive the user's next instruction (step S103).

Based on the execution cost calculated in this manner, the content management unit 105 requests payment from the relevant user in a predetermined manner (i.e., requests payment of the execution cost).

Next, when the content management unit 105 receives information regarding whether or not the execution cost has been paid, along with instructions regarding the execution cost provided by the terminal device 20 of the relevant user (step S104), it executes an execution permission determination process based on the received information to determine whether or not payment of the execution cost has been completed, i.e., whether or not the user has made payment, thereby determining whether or not the speech language data generation process can be executed (step S105).

At this time, if the content management unit 105 determines based on the received information that the user's execution cost has been paid (i.e., the execution of the speech language data generation process is not permitted), it proceeds to the processing of step S106, and if it determines based on the received information that the user's execution cost has not been paid, it terminates this operation.

Next, if the cost management unit 107 determines that the execution cost has been paid by the user (i.e., execution of the speech language data generation process is permitted), the speech generation processing unit 106 assigns the phoneme data selected by the user to a character in the content desired by the user, and executes the speech language data generation process to generate speech for the text belonging to that character (step S107).

Finally, the content management unit 105 starts transmitting various data for performing streaming playback to the corresponding terminal device 20 based on the content information of the content desired by the user and the generated speech voice data (step S108), and ends this operation.

[5.2] Content viewing start processing including execution permission determination processing based on limit values Next, using Figure 13, we will explain the operation of the speech language data generation processing executed by the server device 10 of this embodiment, and the content preview start processing when starting viewing of content including execution permission determination processing based on limit values.

Note that FIG. 13 is a flowchart showing the operation of the speech language data generation process executed by the server device 10 of this embodiment, and the content preview start process when starting to view content, including the execution permission determination process based on a limit value.

This operation involves assigning phoneme data to the character of the content the user wishes to view, based on the user's selection, and providing the content to the terminal device 20 via streaming so that it can be viewed if the execution cost of the phoneme data is within a preset limit value for the content.

In this operation, it is assumed that the content desired by the user is already stored in the content information storage unit 144, and that each piece of phoneme data to be assigned is already stored in the phoneme information storage unit 146, including a cost parameter indicating its cost.

In addition, in this operation, a limit value is set for each viewable content, which is the upper limit of the execution cost that can be allocated.

In addition, in this operation, the same processes as those in the content viewing start process, including the execution permission determination process based on the execution cost described above, are denoted by the same reference numerals and their explanations are omitted.

Before starting this operation, the user is presented with information for selecting the content to be viewed and the phoneme information to be assigned.

First, the content management unit 105 receives information on the content to be viewed and the phoneme data to be assigned to the characters appearing in the content (i.e., information on the phoneme data selected by the user) together with a content viewing instruction from the user transmitted from the terminal device 20 via the communication control unit 101 (step S101).
The cost management unit 107 reads out the phoneme cost information of the assigned phoneme data from the phoneme information storage unit 146, and calculates the execution cost when generating speech language data using the assigned phoneme data (step S102).

Next, the cost management unit 107 compares the calculated execution cost with a preset upper limit (i.e., limit value) of the allocable cost (step S203), and executes an execution permission determination process to determine whether or not they satisfy a relationship condition having a given relationship (e.g., whether or not the execution cost is within the upper limit) (step S204).

At this time, if the cost management unit 107 determines that the calculated execution cost is within the preset upper limit of the allocable cost, it proceeds to the processing of step S106, and if it determines that the calculated execution cost exceeds the preset upper limit of the allocable cost, it terminates this operation.

When this operation is completed, the user may be prompted to select the content and the phoneme data to be assigned again, and this operation may be performed from the beginning, assuming that the content and the phoneme data to be assigned have been selected.

Next, if the speech generation processing unit 106 determines that the execution cost is within a preset upper limit of the allocable cost, it assigns the phoneme data selected by the user to a character in the content desired by the user, and executes a speech language data generation process that becomes the speech for the text belonging to that character (step S106).

Finally, the content management unit 105 starts transmitting various data for performing streaming playback to the corresponding terminal device 20 based on the content information of the content desired by the user and the generated speech voice data (step S107), and ends this operation.

[6] Others The present invention is not limited to the above-described embodiment, and various modifications are possible. For example, a term cited in the description of the specification or drawings as a term with a broad meaning or synonymous meaning can be replaced with a term with a broad meaning or synonymous meaning in other descriptions of the specification or drawings.

In this embodiment, each content may be provided to the terminal device 20 by a single server device 10, or multiple server devices 10 may be linked together to form a server system and provide each content to a terminal device.

In addition, in this embodiment, the above processes and content playback may be realized by a single content playback device having the functions of the server device 10, i.e., by a device that acquires content information and phoneme information via a network, without dividing the device into a server device and a terminal device.

In particular, in this case, the content playback device has an internal playback output unit that displays an image of the content on the display unit while outputting voice from the character based on the voice language data.

It is also possible to realize a system using multiple content devices by connecting multiple such content terminal devices via wired or wireless connections, with one content device functioning as the server device 10.

In addition, in this embodiment, the content providing system of the present invention is applied to a server device 10 that operates in conjunction with a terminal device 20 via a network, but it can also be applied to a terminal device such as a tablet information terminal device or a personal computer.

In this case, the terminal device has each of the functions of the server device 10 described above and a playback function for playing content data, and is configured to play content data together with speech language data to which phoneme data is assigned.

The present invention includes configurations that are substantially the same as the configurations described in the embodiments (for example, configurations with the same functions, methods, and results, or configurations with the same purpose and effect). The present invention also includes configurations that replace non-essential parts of the configurations described in the embodiments. The present invention also includes configurations that achieve the same effects as the configurations described in the embodiments, or that can achieve the same purpose. The present invention also includes configurations that add publicly known technology to the configurations described in the embodiments.

Although the embodiments of the present invention have been described in detail above, it will be readily apparent to those skilled in the art that many modifications are possible that do not substantially depart from the novel aspects and effects of the present invention. Therefore, all such modifications are intended to be included within the scope of the present invention.

1: Content providing system 10: Server device 20: Terminal device 100: Processing unit 101: Communication control unit 102: Web processing unit 103: Login management unit 104: User management unit 105: Content management unit 106: Speech generation processing unit 107: Cost management unit 109: Timer management unit 110: Information providing unit 111: Communication control unit 120: Input unit 130: Display unit 140: Storage unit 142: Main storage unit 144: Content information storage unit 146: Phoneme information storage unit 148: User information storage unit 149: Application information storage unit 180: Information storage medium 196: Communication unit 200: Processing unit 210: Communication control unit 211: Web browser 212: Content processing unit 213: Display control unit 220: Drawing unit 230: Sound processing unit 260 : Input unit 262 : Detection unit 270 : Storage unit 271 : Main storage unit 272 : Image buffer 280 : Information storage medium 290 : Display unit 292 : Sound output unit 296 : Communication unit

Claims (11)

a user information management means for managing information stored in the storage means, the user information being related to a user and speech phoneme information being associated with the user information and being composed of phoneme data collected from a speaker;
a content management means for managing information related to the content as content information, the information being composed of content data including at least text data obtained by converting the text to be spoken by the voice of the speaker and character data related to a character who speaks the text;
a generation processing means for executing a generation process of assigning the phoneme data to the character data based on a given instruction, and generating speech language data for converting text of the text data included in the content information into speech language ;
a provision control means for executing a provision control process for providing the generated speech language data to a reproduction output means for reproducing and outputting the voice of the character along with the text of the content data;
a cost management means for managing a cost parameter that defines a cost of any one of the phoneme data, the character data, and the text data used in the generation process;
a cost calculation unit that executes a calculation process to calculate an execution cost for executing the generation process based on the cost parameters;
a presentation means for presenting the execution cost calculated by the calculation process to a user who wishes to view the content;
A content playback control system comprising: 2. The content playback control system according to claim 1,
The content playback control system further comprises an permission determination processing means for executing an execution permission determination process that determines whether or not to permit execution of at least one of the generation process and the provision control process based on whether or not the user has paid the execution cost calculated by the calculation process. a user information management means for managing information stored in the storage means, the user information being related to a user and speech phoneme information being associated with the user information and being composed of phoneme data collected from a speaker;
a content management means for managing information related to the content as content information, the information being composed of content data including at least text data obtained by converting the text to be spoken by the voice of the speaker and character data related to a character who speaks the text;
a generation processing means for executing a generation process of assigning the phoneme data to the character data based on a given instruction, and generating speech language data for converting text of the text data included in the content information into speech language ;
a provision control means for executing a provision control process for providing the generated speech language data to a reproduction output means for reproducing and outputting the voice of the character along with the text of the content data;
a cost management means for managing a cost parameter that defines a cost related to the use of any one of phoneme data, character data, and text data used in the generation process;
a permission determination processing means for executing an execution permission determination process for permitting execution of at least one of the generation process and the provision control process when the cost parameter and a preset cost limit value satisfy a given relational condition;
A content playback control system comprising: In the content playback control system according to any one of claims 1 to 3 ,
The method further comprises: detecting a given state of the user related to the content;
The cost management means:
A content playback control system that executes a variation control process for controlling a variation of the cost parameter based on the detected user's situation regarding the content. The content playback control system according to any one of claims 1 to 4 ,
The cost management means:
The content playback control system executes a variation control process for controlling a variation of the cost parameter based on related information indicating information relating to any one of the content data, the character data, and the text data. The content playback control system according to any one of claims 1 to 5 ,
A combination detection means for detecting a combination of phoneme data assigned by the generation process is further provided,
The cost management means:
A content playback control system that executes a variation control process for controlling a variation of the cost parameter based on information on the detected combination of phoneme data. The content playback control system according to any one of claims 1 to 5 ,
The generation processing means
A content playback control system that, when a character to which no phoneme data is assigned is detected as a specific character based on the user's instruction as the given instruction, sets predetermined phoneme data to the specific character. The content playback control system according to any one of claims 1 to 5 ,
The generation processing means
executing the generation process for generating the speech language data in accordance with model information indicating a data model of phoneme data generated based on at least one of the attributes of the character and the attributes of the text;
A learning process is executed to learn the model information based on the generated speech language data;
The cost management means:
A content playback control system that executes a variation control process for controlling a variation of the cost parameter based on a state of a learning process of the model information. a user information management means for managing information stored in the storage means, the user information relating to a user and speech phoneme information associated with the user information and composed of phoneme data collected from a speaker;
a content management means for managing information related to the content as content information, the content information being composed of content data including at least text data obtained by converting a text to be spoken by the voice of the speaker and character data related to a character who speaks the text;
a generation processing means for executing a generation process of assigning the phoneme data to the character data based on a given instruction, and generating speech language data for converting text of the text data included in the content information into speech language ;
a provision control means for executing a provision control process for providing the generated speech language data to a reproduction output means for reproducing and outputting the voice of the character along with the text of the content data;
a cost management means for managing a cost parameter that defines the cost of any one of the phoneme data, character data, and text data used in the generation process;
a cost calculation unit that calculates an execution cost of the generation process based on the cost parameters; and
a presentation means for presenting the execution cost calculated by the calculation process to a user who wishes to view the content;
A program that causes a computer to function as a The program according to claim 9,
A program that further causes the computer to function as an execution permission determination processing means that executes an execution permission determination process that determines whether or not to permit execution of at least one of the generation process and the provision control process based on whether or not the user has paid the execution cost calculated by the calculation process. a user information management means for managing information stored in the storage means, the user information relating to a user and speech phoneme information associated with the user information and composed of phoneme data collected from a speaker;
a content management means for managing information related to the content as content information, the content information being composed of content data including at least text data obtained by converting a text to be spoken by the voice of the speaker and character data related to a character who speaks the text;
a generation processing means for executing a generation process of assigning the phoneme data to the character data based on a given instruction, and generating speech language data for converting text of the text data included in the content information into speech language ;
a provision control means for executing a provision control process for providing the generated speech language data to a reproduction output means for reproducing and outputting the voice of the character along with the text of the content data;
a cost management means for managing a cost parameter that defines a cost related to the use of any one of the phoneme data, the character data, and the text data used in the generation process; and
a permission determination processing means for executing an execution permission determination process for permitting execution of at least one of the generation process and the provision control process when the cost parameter and a preset cost limit value satisfy a given relational condition;
A program that causes a computer to function as a

Images