KR102785178B1 - Apparatus and method for providing joint performance based on network - Google Patents

Abstract

The present invention relates to a device and a method for providing a joint performance based on a network, wherein a server for providing a joint performance of a plurality of performer devices connected through a network of the present invention comprises a communication unit for receiving individual performance data in which an accompaniment sound source, a high-frequency beat, and a performer sound source are synthesized from each of the plurality of performer devices through the network in real time, a synchronization unit for performing synchronization correction by synchronizing the high-frequency beats included in each of the received plurality of individual performance data, and a sound source synthesis unit for generating joint performance data by mixing the plurality of performer sound sources based on the synchronized high-frequency beats.

Description

{APPARATUS AND METHOD FOR PROVIDING JOINT PERFORMANCE BASED ON NETWORK}

The present invention relates to a network-based joint performance providing live joint performances of remote performers online in real time, and a method therefor.

An orchestra or choir requires all musicians or singers to play simultaneously in the same space so that various tones can blend together without dissonance and create harmony. However, there is a limitation that multiple musicians from a distance must all gather in the same space at the same time.

Meanwhile, in order to escape from the above restrictions, it may be considered that remote performers each transmit their song and instrument performance sound files to a sound synthesizer through a network, and that the sound synthesizer synthesizes the multiple individual sound files into one complete joint performance sound file and provides it to the audience. When remote performers transmit all of their individual sound files to the sound synthesizer, the sound synthesizer can download and store the multiple individual sound files, and play them in sync to create one complete joint performance sound file.

However, if the above method is considered as being performed in real time, various problems will be encountered. First, when remote performers transmit individual sound source data through the network, the network path is different for each. Therefore, in a network environment that changes in real time, the time for each sound source data to arrive at the sound source synthesis device will change in real time. In addition, since the performance of the devices that record the performance sound source is different for each, the delay time that occurs during the recording process will also vary.

Therefore, it is not easy for a sound source synthesis device to provide joint performance sound source data online in real time without dissonance. Accordingly, in order to provide live joint performances of remote performers online in real time, a method is required that can synthesize multiple individual sound source data transmitted through a network in real time without dissonance.

The present invention provides a network-based joint performance device and method for providing a live joint performance of remote performers online in real time by synthesizing a plurality of performer sound sources transmitted through a network in real time by synchronizing high-frequency beats and playing the synthesized sound sources in real time.

According to one feature of the present invention, a server is a server that provides a joint performance of a plurality of player devices connected through a network, the server including a communication unit that receives individual performance data in which an accompaniment sound source, a high-frequency beat, and a player sound source are synthesized from each of the plurality of player devices through the network in real time, a synchronization unit that performs synchronization correction by synchronizing the high-frequency beats included in each of the received plurality of individual performance data, and a sound source synthesis unit that mixes the plurality of player sound sources included in the plurality of individual performance data based on the synchronized high-frequency beats to generate joint performance data, wherein the high-frequency beats include frequency beats in an inaudible frequency band.

The server further includes an accompaniment generation unit that generates accompaniment data by synthesizing a plurality of the high-frequency beats into the accompaniment sound source at a predetermined cycle, and the communication unit can simultaneously stream the accompaniment data to the plurality of performer devices when the joint performance begins.

The above communication unit can stream the joint performance data generated by the sound source synthesis unit to an output device.

The above-mentioned synchronization unit can perform real-time synchronization correction by synchronizing the high-frequency bits corresponding to the corresponding point in time whenever the cycle of the high-frequency bits arrives.

The above synchronization unit can temporarily store the plurality of individual performance data that have already been received until all of the plurality of individual performance data that constitute the joint performance data have been received, and perform synchronization correction by synchronizing the high-frequency bits included in the plurality of individual performance data that have already been received to the high-frequency bits included in the individual performance data that has finally arrived.

According to another aspect of the present invention, a method is provided as a method for providing a joint performance of a plurality of player devices connected to a server through a network, the method comprising the steps of: generating accompaniment data by synthesizing a plurality of high-frequency beats into an accompaniment sound source at a predetermined cycle; streaming the accompaniment data simultaneously to the plurality of player devices through the network when the joint performance starts; receiving individual performance data in which a player sound source is synthesized into the accompaniment data from each of the plurality of player devices through the network in real time; determining whether the sync of the high-frequency beats included in the plurality of received individual performance data matches; performing synchronization correction by aligning the sync of the high-frequency beats included in each of the plurality of individual performance data according to the determination result; and generating joint performance data by mixing the plurality of player sound sources included in the plurality of individual performance data based on the synchronized high-frequency beats.

The above high frequency bits may include frequency bits in an inaudible frequency band.

The step of performing the above synchronization correction may include temporarily storing the plurality of individual performance data that have already been received until all of the plurality of individual performance data constituting the joint performance data have been received, and performing synchronization correction by synchronizing the high-frequency bits included in the plurality of individual performance data that have already been received to the high-frequency bits included in the individual performance data that has finally arrived.

The step of determining whether the syncs of the high-frequency bits match can determine whether the syncs of the high-frequency bits corresponding to a point in time match each time the cycle of the high-frequency bits arrives.

The step of generating the above joint performance data can stream the generated joint performance data to an output device.

The present invention can accurately and quickly synchronize multiple performer sound sources by synthesizing multiple individual performance data by synchronizing each of multiple high-frequency beats.

The present invention can provide a live joint performance of remote performers online in real time without dissonance.

The present invention can save time and cost incurred by multiple performers moving to a designated location for a joint performance.

FIG. 1 is a diagram showing a network-based joint performance system according to one embodiment.
Figure 2 is a block diagram explaining the functions of the server of Figure 1.
FIG. 3 is a diagram explaining the cause of the arrival delay of individual performance data transmitted through a network according to one embodiment.
FIG. 4 is a diagram comparing and explaining the arrival delay status of a plurality of individual performance data transmitted through a network according to one embodiment.
FIG. 5 is a diagram illustrating generation of joint performance data after initial synchronization of multiple individual performance data according to one embodiment.
FIG. 6 is a diagram illustrating the generation of joint performance data after real-time synchronization of multiple individual performance data while a joint performance is in progress according to one embodiment.
FIG. 7 is a flowchart illustrating a network-based joint performance method according to one embodiment.

Hereinafter, the embodiments disclosed in this specification will be described in detail with reference to the attached drawings, and identical or similar components will be given the same or similar drawing reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and/or "part" used for components in the following description are given or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The terms are used only to distinguish one component from another.

When it is said that a component is "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components in between. On the other hand, when it is said that a component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

In this application, it should be understood that terms such as “comprises” or “has” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

FIG. 1 is a diagram showing a network-based joint performance system according to one embodiment.

Referring to FIG. 1, a network-based joint performance system (1) includes a plurality of performer devices (100a, 100b, ..., 100n), a server (200), and an output device (300).

The joint performance system (1) broadcasts live individual performances of multiple performers located in remote locations such as LA, Busan, and France as a single joint performance through a network. The joint performance system (1) includes multiple performer devices (100a, 100b, ..., 100n), a server (200), and an output device (300) connected to a network, and can transmit and receive accompaniment data, individual performance data, and joint performance data, which will be described below, in real time through a network.

The network includes, but is not limited to, a 5G network capable of transmitting accompaniment data, individual performance data, and joint performance data converted into digital signals at ultra-high speeds and ultra-low delays. The network includes mobile communication networks such as LTE networks, the Internet, and public telephone networks that follow various communication protocols that support digital music/video data transmission.

Each of the plurality of player devices (100a, 100b, ..., 100n) generates individual performance data by mixing the sound source of the player playing a song or an instrument with the accompaniment data transmitted from the server (200). Then, each of the plurality of player devices (100a, 100b, ..., 100n) feeds back the generated individual performance data to the server (200) in real time. At this time, the sound source of the player is not limited to the sound source itself, and may include a performance video including the sound source of the player.

In Fig. 1, each of the plurality of player devices (100a, 100b, ..., 100n) may be located remotely from each other, such as in LA, Busan, France, etc., where the player is located. For example, each of the plurality of player devices (100a, 100b, ..., 100n) may include a receiving unit that receives accompaniment data, a speaker that transmits the received accompaniment data to the player, a synthesis unit that receives the player's sound source (e.g., singing, playing an instrument, etc.) and mixes it with the accompaniment data in real time when the player sings/plays along with the transmitted accompaniment data, and a transmission unit that transmits individual performance data in which the player's sound source and accompaniment data are mixed to a server (200) in real time.

The server (200) performs synchronization correction on multiple individual performance data transmitted in real time and then synthesizes (mixes) them to stream joint performance data. For example, the server (200) can perform synchronization in real time based on high-frequency beats included in the accompaniment data, thereby live broadcasting the individual performances of multiple performers located at a distance as a single joint performance.

The output device (300) reproduces and outputs joint performance data transmitted from the server (200) in real time. For example, the output device (300) may include a TV installed in a concert hall, public place, or home, a mobile communication terminal, various display devices connected to a network, etc.

FIG. 2 is a block diagram illustrating the function of the server of FIG. 1, FIG. 3 is a diagram illustrating a cause of delay in arrival of individual performance data transmitted through a network according to one embodiment, FIG. 4 is a diagram comparing and explaining a state of delay in arrival of a plurality of individual performance data transmitted through a network according to one embodiment, FIG. 5 is a diagram illustrating generating joint performance data after initial synchronization of a plurality of individual performance data according to one embodiment, and FIG. 6 is a diagram illustrating generating joint performance data after real-time synchronization of a plurality of individual performance data while a joint performance is in progress according to one embodiment.

Referring to FIG. 2, the server (200) includes a communication unit (210), an accompaniment generation unit (220), a synchronization unit (230), and a sound source synthesis unit (240).

The communication unit (210) may include a module that enables wireless communication in a network located between the server (200) and a plurality of performer devices (100a, 100b, ..., 100n) and the server (200) and the output device (300) to transmit accompaniment data and joint performance data or receive individual performance data. For example, the communication unit (210) may include a mobile communication module (e.g., 5G, LTE, etc.), a wireless Internet module, and a short-range communication module.

When a joint performance begins, the communication unit (210) simultaneously streams accompaniment data to multiple performer devices (100a, 100b, ..., 100n) via a network. While the joint performance is in progress, the communication unit (210) receives individual performance data from each of the multiple performer devices (100a, 100b, ..., 100n) in real time and transmits it to the synchronization unit (230). In addition, the communication unit (210) streams joint performance data generated by the sound source synthesis unit (240) to the output device (300) while the joint performance is in progress.

The accompaniment generation unit (220) generates accompaniment data by synthesizing multiple high-frequency beats at a predetermined cycle for an accompaniment sound source for a joint performance. Referring to Fig. 3, the accompaniment generation unit (220) can generate accompaniment data (AD: accompaniment data) by synthesizing multiple high-frequency beats (bit1, bit2, ..., bitN) from the beginning to the end of the accompaniment sound source at a predetermined cycle (e.g., 1 ms).

The high-frequency beats are synthesized into the accompaniment data for synchronizing multiple individual performance data when generating joint performance data. When the joint performance starts, each of the multiple performer devices (100a, 100b, ..., 100n) mixes the performer's sound source into the same accompaniment data (AD) to generate individual performance data. Therefore, by mixing the performer's sound sources included in the multiple individual performance data by respectively matching the sync of the multiple periodically synthesized high-frequency beats, the performer's sound sources can also form a single harmony without delay. For example, the high-frequency beats can reduce discomfort to performers who sing or play instruments while listening to the accompaniment of a song by including frequency beats in the 30,000 Hz band, which is higher than the audible frequency (20 to 20,000 Hz).

Referring to FIGS. 1 and 3, a first delay (①), a second delay (②), and a third delay (③) may occur during the process in which individual performance data (VRF: video recording file) is transmitted in real time to a server (200) due to differences in network environment and performance of multiple performer devices (100a, 100b, ..., 100n).

Specifically, the accompaniment generation unit (220) simultaneously streams accompaniment data (AD) to a plurality of performer devices (100a, 100b, ..., 100n) via the communication unit (210) when a joint performance begins. However, since the path by which the accompaniment data (AD) reaches each of the plurality of performer devices (100a, 100b, ..., 100n) is different, a first delay (①) may occur depending on the network environment. In addition, since the performance or status of each of the plurality of performer devices (100a, 100b, ..., 100n) is different, a second delay (②) may occur in the process of mixing the performer's sound source with the accompaniment data. Thereafter, a third delay (③) may occur depending on the network environment even in the process of transmitting the individual performance data (VRF) to the server (200). Therefore, in order for the sound sources of multiple performers to harmonize into a single joint performance sound source (concert, choir, orchestra, etc.), synchronization is required before the multiple individual performance data transmitted in real time from each of the multiple performer devices (100a, 100b, ..., 100n) are mixed into a single joint performance data.

The synchronization unit (230) performs an initial synchronization correction to synchronize the initial high-frequency beats of a plurality of individual performance data. Each of the plurality of individual performance data includes an accompaniment sound source, a high-frequency beat, and a performer sound source. The performer sound source may include various sound sources such as songs and instrumental performances of each of the plurality of performers.

For example, the synchronization unit (230) temporarily stores a plurality of individual performance data that have already been received until the last individual performance data constituting the joint performance data is received, and synchronizes the first high-frequency bits (bit1) of the plurality of individual performance data that have already been received to the first high-frequency bit of the last arrived individual performance data.

Referring to Fig. 4, it is assumed that the first individual performance data (A) arrives with a delay of 3 ms, the second individual performance data (B) with a delay of 12 ms, the third individual performance data (C) with a delay of 8 ms, and the fourth individual performance data (D) with a delay of 0 ms based on the estimated time of arrival (ETA).

Referring to FIGS. 4 and 5, the synchronization unit (230) synchronizes the first high-frequency bits (bit1) of the first, third, and fourth individual performance data (A, C, D) to the first high-frequency bit (bit1) of the second individual performance data (B) that arrives last among the first to fourth individual performance data (A, B, C, D) to perform the initial synchronization correction. For example, the synchronization unit (230) stores the first, third, and fourth individual performance data (A, C, D) in a buffer until the second individual performance data (B) arrives, and when the second individual performance data (B) arrives, synchronizes the first high-frequency bits (bit1) of each of the first to fourth individual performance data (A, B, C, D) to perform the initial synchronization correction.

The synchronization unit (230) repeatedly performs synchronization correction to synchronize the high-frequency bits of the plurality of individual performance data whenever the cycle of the high-frequency bit arrives, even after the synchronization correction for the first high-frequency beat. For example, the synchronization unit (230) temporarily stores the plurality of individual performance data that have already been received until all of the plurality of individual performance data corresponding to the corresponding point in time have been received whenever the cycle of the high-frequency beat arrives, and synchronizes the high-frequency bits of the plurality of individual performance data that have already been received to the high-frequency bits of the individual performance data that have finally arrived.

Referring to FIG. 6, after synchronization correction corresponding to the first high-frequency bit (bit1) to the third high-frequency bit (bit3) is performed, it is assumed that, for example, the fourth individual performance data (D) among the first to fourth individual performance data (A, B, C, D) corresponding to the fourth high-frequency bit (bit4) arrives last with a predetermined time delay. The synchronization unit (230) temporarily stores the first, second, and third individual performance data (A, B, C) corresponding to the fourth high-frequency bit (bit4), and performs real-time synchronization correction by aligning the synchronization (SYNC) of the fourth high-frequency bit (bit4) at the time when the fourth individual performance data (D) arrives.

The sound source synthesis unit (240) mixes a plurality of individual performance data corresponding to the high-frequency beats at a given point in time based on synchronized high-frequency beats to generate joint performance data. For example, the sound source synthesis unit (240) receives a plurality of individual performance data whose high-frequency beats are synchronized in real time from the synchronization unit (230), and mixes a plurality of performer sound sources included in the plurality of individual performance data based on the synchronized high-frequency beats to generate joint performance data in real time.

Referring to FIG. 5, the sound source synthesis unit (240) mixes the performer sound sources included in each of the corresponding first to fourth individual performance data (A, B, C, D) based on the synchronized first high-frequency bits (bit1) to generate joint performance data (JPD). Referring to FIG. 6, the sound source synthesis unit (240) mixes the performer sound sources included in each of the corresponding first to fourth individual performance data (A, B, C, D) based on the synchronized fourth high-frequency bits (bit4) to generate joint performance data (JPD) in real time. Then, the sound sources of multiple performers can be broadcast in harmony as a single joint performance sound source without delay from the beginning to the end of the joint performance.

FIG. 7 is a flowchart illustrating a network-based joint performance method according to one embodiment.

The server (200) is connected to a plurality of player devices (100a, 100b, ..., 100n) and an output device (300) via a network to transmit and receive various data in real time. The network includes, but is not limited to, a 5G network capable of transmitting accompaniment data, individual performance data, and joint performance data converted into digital signals at ultra-high speed and ultra-low delay. The network includes a mobile communication network such as an LTE network that follows various communication protocol standards supporting digital music/video data transmission, the Internet, a public telephone network, etc.

Referring to FIG. 7, first, when a joint performance begins, the server (200) simultaneously streams accompaniment data to multiple performer devices (100a, 100b, ..., 100n) through a network (S100).

In step S100, the server (200) synthesizes a plurality of high-frequency beats at a predetermined cycle for an accompaniment sound source for a joint performance to generate accompaniment data for the joint performance. Referring to FIG. 3, the server (200) can generate accompaniment data (AD: accompaniment data) by synthesizing a plurality of high-frequency beats from the beginning to the end of the accompaniment sound source at a predetermined cycle (e.g., 1 ms). For example, the high-frequency beats can include frequency beats in the 30,000 Hz band, which is higher than the audible frequency (20 to 20,000 Hz), and thus can reduce discomfort to a performer who sings or plays an instrument while listening to the accompaniment of a song.

At step S100, the server (200) simultaneously streams accompaniment data to multiple performer devices (100a, 100b, ..., 100n) through the network when a joint performance begins. At this time, each of the multiple performer devices (100a, 100b, ..., 100n) mixes the performer's sound source with the accompaniment data (AD) to generate individual performance data, and feeds back the generated individual performance data to the server (200) in real time. Since remote performers sing or play instruments in accordance with the sound source of the same accompaniment data (AD), the sound sources of multiple performers included in the individual performance data form harmony at points corresponding to high-frequency beats.

Next, the server (200) receives in real time a plurality of individual performance data from each of a plurality of player devices (100a, 100b, ..., 100n) through the network (S110). Each of the plurality of individual performance data includes an accompaniment sound source, a high-frequency beat, and a sound source of each player. The sound source of the player may include a sound source of a song, a musical instrument performance, etc. of each of the plurality of players.

Referring to FIGS. 1 and 3, a first delay (①), a second delay (②), and a third delay (③) may occur during the process in which individual performance data (VRF: video recording file) is transmitted in real time to a server (200) due to differences in network environment and performance of multiple performer devices (100a, 100b, ..., 100n).

Specifically, when a joint performance begins, the server (200) simultaneously streams accompaniment data (AD) to a plurality of performer devices (100a, 100b, ..., 100n) via the communication unit (210). However, since the path by which the accompaniment data (AD) reaches each of the plurality of performer devices (100a, 100b, ..., 100n) is different, a first delay (①) may occur depending on the network environment. In addition, since the performance or status of each of the plurality of performer devices (100a, 100b, ..., 100n) is different, a second delay (②) may occur in the process of mixing the performer's sound source with the accompaniment data. Thereafter, a third delay (③) may occur depending on the network environment even in the process of transmitting individual performance data (VRF) to the server (200). Therefore, in order for the sound sources of multiple performers to harmonize into a single joint performance sound source (concert, choir, orchestra, etc.), synchronization is required before the multiple individual performance data transmitted in real time from each of the multiple performer devices (100a, 100b, ..., 100n) are mixed into a single joint performance data.

Next, the server (200) determines whether the sync of the high-frequency bits included in the plurality of individual performance data matches each time the cycle of the high-frequency bits arrives (S120).

Next, if the sync of the high-frequency bits does not match (S120, No), the server (200) performs synchronization correction by aligning the sync of the high-frequency bits of multiple individual performance data (S130).

For example, the server (200) may temporarily store a plurality of individual performance data that have already been received until the last individual performance data constituting the joint performance data is received, and perform synchronization correction by aligning the first high-frequency bits of the plurality of individual performance data that have already been received with the first high-frequency bits of the last arrived individual performance data.

The server (200) may repeatedly perform synchronization correction to synchronize the high-frequency bits of a plurality of individual performance data whenever a period of a high-frequency bit arrives, even after the synchronization correction for the first high-frequency bit. For example, the synchronization unit (230) temporarily stores the plurality of individual performance data that have already been received until all of the plurality of individual performance data corresponding to the corresponding point in time have been received whenever a period of a high-frequency bit arrives, and synchronizes the high-frequency bits of the plurality of individual performance data that have already been received to the high-frequency bits of the individual performance data that have finally arrived.

Next, if the sync of the high-frequency beats matches (S120, Yes) or synchronization correction is performed at step S130, the server (200) mixes multiple performer sound sources included in multiple individual performance data based on the synchronized high-frequency beats to generate joint performance data in real time, and streams the generated joint performance data to the output device (300) (140).

Next, the server (200) determines whether reception of individual performance data from multiple player devices (100a, 100b, ..., 100n) has ended (S150).

When the reception of individual performance data is terminated (S150, Yes), the server (200) stops streaming the joint performance data to the output device (300). When the reception of individual performance data is not terminated (S150, No), the server (200) repeats from step S120 every time a high-frequency beat cycle arrives.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements made by those skilled in the art in the art to which the present invention pertains also fall within the scope of the present invention.

Claims (10)

As a server providing joint performance of multiple performer devices connected through a network,
A communication unit that receives individual performance data in real time, in which accompaniment sound sources, high-frequency beats, and performer sound sources are synthesized from each of the plurality of performer devices through a network;
A synchronization unit that performs synchronization correction by synchronizing the high-frequency bits included in each of the plurality of individual performance data received above, and
A sound source synthesis unit is included that mixes the plurality of performer sound sources included in the plurality of individual performance data based on the synchronized high-frequency beats to generate joint performance data.
The above high frequency bits include frequency bits in the inaudible frequency band.
Server. In the first paragraph,
The accompaniment generating unit further comprises an accompaniment sound source for generating accompaniment data by synthesizing a plurality of high-frequency beats at a predetermined cycle,
The above communication department,
When the above joint performance starts, the above accompaniment data is simultaneously streamed to the multiple performer devices.
Server. In the first paragraph,
The above communication department,
Streaming the joint performance data generated in the above sound source synthesis unit to an output device.
Server. In the third paragraph,
The above synchronization part,
When the cycle of the above high-frequency bits arrives, real-time synchronization correction is performed to match the sync of the above high-frequency bits corresponding to that point in time.
Server. In paragraph 4,
The above synchronization part,
Temporarily storing the previously received plurality of individual performance data until all of the plurality of individual performance data constituting the above joint performance data are received, and performing synchronization correction by synchronizing the high-frequency bits included in the previously received plurality of individual performance data to the high-frequency bits included in the finally arrived individual performance data.
Server. A method for providing joint performance of multiple performer devices connected to a server through a network,
A step for generating accompaniment data by synthesizing multiple high-frequency beats at a predetermined cycle into an accompaniment sound source.
When the above joint performance starts, a step of simultaneously streaming the accompaniment data to the multiple performer devices through the above network;
A step of receiving individual performance data in which a performer sound source is synthesized into the accompaniment data in real time from each of the plurality of performer devices through the above network;
A step of determining whether the sync of high-frequency bits included in the plurality of individual performance data received above matches;
A step of performing synchronization correction by synchronizing the high-frequency bits included in each of the plurality of individual performance data according to the judgment result, and
A step of generating joint performance data by mixing the plurality of performer sound sources included in the plurality of individual performance data based on the synchronized high-frequency beats,
method. In Article 6,
The above high frequency bits are,
Containing frequency bits in the inaudible frequency band,
method. In Article 6,
The steps for performing the above synchronization correction are:
Temporarily storing the previously received plurality of individual performance data until all of the plurality of individual performance data constituting the above joint performance data are received, and performing synchronization correction by synchronizing the high-frequency bits included in the previously received plurality of individual performance data to the high-frequency bits included in the finally arrived individual performance data.
method. In Article 8,
The step of determining whether the sync of the above high-frequency bits matches is:
Whenever the cycle of the above high-frequency bit arrives, it is determined whether the sync of the corresponding high-frequency bits matches at that time.
method. In Article 6,
The step of generating the above joint performance data is:
Streaming the above generated joint performance data to an output device,
method.

Images