CN111862912B - Music score display method, device, server and storage medium - Google Patents
Music score display method, device, server and storage medium Download PDFInfo
- Publication number
- CN111862912B CN111862912B CN202010662778.4A CN202010662778A CN111862912B CN 111862912 B CN111862912 B CN 111862912B CN 202010662778 A CN202010662778 A CN 202010662778A CN 111862912 B CN111862912 B CN 111862912B
- Authority
- CN
- China
- Prior art keywords
- time
- time delay
- note
- music score
- performance terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0008—Associated control or indicating means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Electrophonic Musical Instruments (AREA)
- Auxiliary Devices For Music (AREA)
Abstract
本发明实施方式涉及通信技术领域，公开了一种曲谱显示方法，包括：将曲谱分发至N个演奏终端，并在每一所述演奏终端按所述曲谱的时序显示所述曲谱中的每一音符，以供所述演奏终端的用户根据当前显示的音符进行演奏，其中，所述N为大于1的自然数；获取第k个演奏终端与所述曲谱服务器之间的时延作为第一时延，其中，所述k为从1到N的自然数；根据所述第一时延调整所述第k个演奏终端中每一音符开始显示的时间。本发明实施方式还提供了一种曲谱显示装置、服务器及存储介质。本发明实施方式提供的曲谱显示方法、装置、服务器及存储介质，使得在线合奏时合奏的同步效果提高，使合奏可以顺利进行。
The embodiments of the present invention relate to the field of communication technology, and disclose a music score display method, including: distributing the music score to N performance terminals, and displaying each note in the music score at each performance terminal according to the time sequence of the music score, so that the user of the performance terminal can perform according to the currently displayed note, wherein N is a natural number greater than 1; obtaining the time delay between the kth performance terminal and the music score server as the first time delay, wherein k is a natural number from 1 to N; adjusting the time when each note in the kth performance terminal starts to be displayed according to the first time delay. The embodiments of the present invention also provide a music score display device, server and storage medium. The music score display method, device, server and storage medium provided by the embodiments of the present invention improve the synchronization effect of the ensemble during online ensemble, so that the ensemble can proceed smoothly.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, a server, and a storage medium for displaying a music score.
Background
A music ensemble refers to a performance performed by a plurality of players on the same music score using the same or different musical instruments. In performing the ensemble, it is generally necessary to concentrate all players on a designated place after the contracted time, but the cost of the place is generally high, and the difficulty of organizing all players to reach the designated place at the contracted time is also high, so that the ensemble in this manner is generally difficult to perform smoothly.
At present, in order to break through the limitation of places and time in the ensemble, the method can be realized by using a multi-party call-like technology, namely, all players play on a network at the same time, so as to achieve the aim of the ensemble.
However, the inventor found that there are at least problems in the prior art that the network generally has time delays which can be tolerated in the multi-party call, but require the pace of each player in the ensemble, and the time delays cause the pace of each player to be previous and then not consistent, seriously affecting the effect of the ensemble, and making the ensemble difficult to be carried out smoothly.
Disclosure of Invention
An object of an embodiment of the present invention is to provide a music score display method, apparatus, server, and storage medium, which can improve the synchronization effect of an ensemble during online ensemble, and enable smooth ensemble.
In order to solve the technical problems, the embodiment of the invention provides a music score display method which is applied to a music score server and comprises the steps of distributing a music score to N playing terminals, displaying each note in the music score according to the time sequence of the music score at each playing terminal, enabling a user of the playing terminal to play according to the notes currently displayed, wherein N is a natural number larger than 1, acquiring time delay between a kth playing terminal and the music score server as a first time delay, wherein k is a natural number from 1 to N, and adjusting the time for starting to display each note in the kth playing terminal according to the first time delay.
The embodiment of the invention also provides a music score display device which comprises a distribution module, an acquisition module and an adjustment module, wherein the distribution module is used for distributing music scores to N playing terminals, displaying each note in the music score according to the time sequence of the music scores at each playing terminal, so that a user of the playing terminal plays according to the notes currently displayed, N is a natural number larger than 1, the acquisition module is used for acquiring the time delay between the kth playing terminal and the music score server as a first time delay, k is a natural number from 1 to N, and the adjustment module is used for adjusting the time for starting to display each note in the kth playing terminal according to the first time delay.
The embodiment of the invention also provides a server which comprises at least one processor and a memory which is in communication connection with the at least one processor, wherein the memory stores instructions which can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the music score display method.
The embodiment of the invention also provides a computer readable storage medium which stores a computer program, and the computer program realizes the method for displaying the music score when being executed by a processor.
Compared with the prior art, the method and the device have the advantages that the music score is distributed to the N playing terminals, each note in the music score is displayed at each playing terminal according to the time sequence of the music score, so that a user of the playing terminal plays according to the currently displayed note, the time delay between the kth playing terminal and the music score server is obtained as the first time delay, and the time for starting to display each note in the kth playing terminal is adjusted according to the first time delay. The music score server distributes the music score to a plurality of playing terminals, the time delay of each playing terminal is obtained after the music score is distributed, and the time for starting to display each note in each playing terminal is adjusted according to the time delay, so that the notes played by each playing terminal can be synchronous with the notes played by other playing terminals, the playing steps of each player can be kept consistent, the effect of ensemble is improved, and the ensemble can be smoothly carried out.
In addition, the time for starting to display each note in the kth playing terminal is adjusted according to the first time delay, wherein the time for starting to display each note in the kth playing terminal is adjusted according to the first time delay and the second time delay. The second time delay between the playing terminal and the mixing server also affects the final ensemble effect, so that when the time for starting the display of notes in the playing terminal is adjusted, the first time delay and the second time delay are combined for adjustment, the adjustment of the time for starting the display of each note in the playing terminal can be more accurate, and the ensemble synchronization effect is further improved.
In addition, adjusting the time at which each note in the kth performance terminal starts to be displayed according to the first delay includesCalculating the time for starting to display each note in the kth playing terminal, wherein T F (i) is the time for starting to display the ith note, T (i) is the expected time for starting to display the ith note without delay, deltat max is the largest first delay in the N playing terminals, deltat k is the first delay, and the ith note is displayed in the kth playing terminal according to T F (i). By calculating and adjusting the time for starting the display of the notes through the formula, the time for starting the display of the notes in the performance terminal with smaller time delay can be postponed more, and the time for starting the display of the notes in the performance terminal with larger time delay is postponed less, so that the display of the notes of all the performance terminals is synchronous, and the synchronization of the performance steps of each performance terminal is improved.
In addition, the time delay between the kth playing terminal and the music score server is obtained as a first time delay, specifically, the time delay between the kth playing terminal and the music score server is obtained as the first time delay according to a preset period. The time delay is obtained periodically according to a preset period, so that the dynamic change of the network speed can be obtained, a basis is provided for the follow-up real-time adjustment of the delay amplitude of the note display, and the note display adjustment effect is better.
In addition, the time for starting the display of each note in the kth performance terminal is adjusted according to the first time delay, specifically, the time for starting the display of each note in the kth performance terminal is adjusted according to the preset period and the first time delay. The time for starting the display of the notes can be dynamically adjusted along with the dynamic change of the network speed by adjusting the time for starting the display of the notes through the preset period and the first time delay, so that the time for starting the display of the notes is more in line with the actual network environment, and the synchronization effect of the ensemble is improved.
In addition, the time for starting to display each note in the kth playing terminal is adjusted according to the preset period and the first time delay, and the method comprises the steps of obtaining the relation between the first time delay of the current preset period and the first time delay of the previous preset period, and adjusting the time for starting to display each note in the kth playing terminal according to the relation.
In addition, the time for starting the display of each note in the kth performance terminal is adjusted according to the magnitude relation, including adjusting the time for starting the display of each note in the kth performance terminal according to the formula T F(i)＝(TL(i)-TC(i))*(1-R)+TC (i) if the first delay of the previous preset period is greater than or equal to the first delay of the current preset period, adjusting the time for starting the display of each note in the kth performance terminal according to the formula T F(i)＝(TC(i)-TL(i))*R+TL (i) if the first delay of the previous preset period is less than the first delay of the current preset period, wherein T F (i) is the time for starting the display of the ith note in the adjusted current preset period, T C (i) is the time for starting the display of the ith note in the adjusted current preset period, T L (i) is the time for starting the display of the ith note in the previous preset period, R is the adjustment proportion of the time for starting the display of each note in the current preset period, (T C(i)-Trecv)/ΔT),Trecv is the time for starting the current preset period), and DeltaT is the time for starting the preset period.
Drawings
One or more embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings.
Fig. 1 is an exemplary diagram of an application scenario of a music score display method according to a first embodiment of the present invention;
FIG. 2 is a timing flow diagram corresponding to FIG. 1;
fig. 3 is a schematic flow chart of a method for displaying a music score according to a first embodiment of the present invention;
fig. 4 is a schematic flow chart of a music score display method according to a second embodiment of the present invention;
fig. 5 is a schematic flow chart of a method for displaying a music score according to a third embodiment of the present invention;
Fig. 6 is a schematic block diagram of a music score display device according to a fourth embodiment of the present invention;
Fig. 7 is a schematic structural diagram of a server according to a fifth embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, embodiments of the present application will be described in detail below with reference to the accompanying drawings. However, those of ordinary skill in the art will understand that in various embodiments of the present application, numerous technical details have been set forth in order to provide a better understanding of the present application. The claimed application may be practiced without these specific details and with various changes and modifications based on the following embodiments.
A first embodiment of the invention relates to a music score display method, which comprises the steps of distributing music scores to N playing terminals, displaying each note in the music score at each playing terminal according to the time sequence of the music score, enabling a user of the playing terminal to play according to the currently displayed note, acquiring time delay between a kth playing terminal and a music score server as first time delay, and adjusting the time for starting to display each note in the kth playing terminal according to the first time delay. The music score server distributes the music score to a plurality of playing terminals, and each note in the music score is displayed at each playing terminal according to the time sequence of the music score, so that a user of the playing terminal can play according to the currently displayed notes, the playing rhythm of each player is controlled, the time delay of each playing terminal is acquired after the music score is distributed, the time for starting to display each note in each playing terminal is adjusted according to the time delay, the notes played by each playing terminal can be synchronized with the notes played by other playing terminals, the playing pace of each player is kept consistent, the effect of ensemble is improved, and the ensemble can be smoothly carried out.
It should be noted that, the method for displaying a music score provided in the embodiment of the present invention is applied to a music score server (i.e., a music library), that is, the execution body of the method for displaying a music score is the music score server.
Please refer to fig. 1, which is an exemplary diagram of an application scenario of a music score display method according to an embodiment of the present invention. Specifically, the music score server transmits the music score to N playing terminals, the playing terminals transmit audio output of a player during playing to the mixing server, and the mixing server mixes the audio output of the playing terminals and distributes the audio output to each playing terminal or listener terminal through a distribution system. The music score server, the playing terminal and the mixing server are connected through a network, and in order to improve the ensemble effect, the network used by connection should use a low-delay network, for example, a 5G network, a WIFI network, a ZigBee network or the like, and the music score server, the playing terminal and the mixing server can be specifically selected according to actual needs without specific limitation. For example, when the music score server transmits the music score to the performance terminal, a network channel of high quality of service (QOS) priority may be used, i.e., channel 1 in the figure uses a network channel of high QOS priority. It should be understood that the channel 2 in the figure is a network channel from the playing terminal to the mixing server, which is an uplink channel, and the channel 3 in the figure is a network channel from the mixing server to the playing terminal, which is a downlink channel, and the 1 st playing terminal to the nth playing terminal in two places in the figure are the same group of playing terminals. In order to further improve the synchronization effect of the ensemble, the performance terminal group may use an NTP (network time protocol) system, thereby ensuring that each performance terminal uses the same local clock, alternatively, the performance terminal group may employ a high-precision NTP system.
Please refer to fig. 2, which is a timing chart corresponding to fig. 1. Specifically, 1, a player accesses a music score server to select a music score and sends an ensemble request, 2, the music score server responds to the ensemble request and distributes the selected music score to each performance terminal after receiving the ensemble request, 3, a user (player) of the performance terminal performs performance according to the music score of the performance terminal, 4, the music score server detects time delay from the music score server to the performance terminal, 5, the music score server notifies the performance terminal of the detected time delay, 6, adjusts the time for starting displaying notes of the performance terminal according to the time delay, 7, the audio output of each performance terminal is obtained by the audio mixing server to mix, 8, the audio mixing server distributes the audio to each performance terminal or a client of a listener through a distribution service.
The specific flow of the music score display method provided by the embodiment of the invention is shown in the figure 3, and the method specifically comprises the following steps:
And S101, distributing the music score to N playing terminals, and displaying each note in the music score at each playing terminal according to the time sequence of the music score so as to be played by a user of the playing terminal according to the currently displayed note, wherein N is a natural number larger than 1.
It should be understood that when each performance terminal displays notes in the time sequence of the score, the total display time of notes is determined according to the score, for example, if a note is 1 beat in the score, the total display time of a note is 1 beat.
Alternatively, when the musical note is displayed by the performance terminal, the musical note that is currently required to be performed may be displayed in a preset format, for example, in a highlighted form, at which time the user (player) of the performance terminal performs the performance according to the currently highlighted musical note. Optionally, when the playing terminal displays the note to be played currently in the preset format, a plurality of notes before and after the note to be played currently may be displayed at the playing terminal at the same time, where the display format is different from the preset format, so as to prompt or assist the player to play, for example, display in gray.
Alternatively, when distributing the music score to the N performance terminals, the music score server divides the music score into a plurality of data packets, and distributes the same data packet to the N performance terminals at the same time, thereby facilitating control of performance rhythms of all the performance terminals.
S102, acquiring time delay between a kth playing terminal and a music score server as a first time delay, wherein k is a natural number from 1 to N.
Optionally, the music score server may send a ping packet to the kth performance terminal, and according to a difference between a time when the music score server receives a ping packet response and a time when the ping packet is sent, a time delay between the kth performance terminal and the music score server is measured as the first time delay.
Alternatively, when the score server acquires the time delay between the kth performance terminal and the score server, the time delay may be acquired specifically, without limitation, before or after the score is distributed to the performance terminal. In addition, the music score server may acquire the first time delay only once, or may acquire the first time delay multiple times, for example, after distributing the music score to the playing terminal, the first time delay may be acquired once at regular intervals, and the specific number of acquisitions may be set according to the actual needs, which is not limited herein.
And S103, adjusting the display starting time of each note in the kth playing terminal according to the first time delay.
The time when the note starts to be displayed is the time when the note starts to be displayed in the playing terminal, and if the note to be played is set with a preset format, the time when the note starts to be displayed is the time when the note starts to be displayed in the playing terminal with the preset format.
It will be appreciated that in order to achieve the effect of synchronizing the ensemble, the first delays of the other performance terminals may be combined to keep the performance pace of each performance terminal in conformity with the performance pace of the other performance terminals while adjusting the time at which each note in the kth performance terminal starts to be displayed in accordance with the first delay. Specifically, the time for which each note starts to be displayed in the kth performance terminal is delayed more and less if the first time delay of the kth performance terminal is greater in all performance terminals, and the time for which each note starts to be displayed in the kth performance terminal is delayed more and more if the first time delay of the kth performance terminal is smaller in all performance terminals.
Optionally, the score server adjusts the time at which each note in the kth playing terminal starts to be displayed according to the first time delay, in combination with at least part of the first time delays in all the playing terminals. For example, the maximum value of the first time delay of the 80% performance terminal is selected as a reference, and the time at which each note starts to be displayed in the kth performance terminal is adjusted. Alternatively, the maximum value of the first delays of all (100%) performance terminals may be selected as the reference.
In a specific example, S103 may specifically include:
the time at which each note starts to be displayed in the kth performance terminal is calculated according to the following formula (1):
Wherein T F (i) is the time at which the ith note starts to be displayed in the kth performance terminal, T (i) is the expected time at which the ith note starts to be displayed without delay, Δt max is the largest first delay in the N performance terminals, Δt k is the first delay in the kth performance terminal;
The ith note is displayed in the kth performance terminal according to T F (i).
In formula (1), T (i) is a point of time when a note appears in the score, and can be determined according to the score content, for example, a position of 10 seconds when a note a appears in the score, and a time of 12 seconds when a note B appears in the score.
Since the first time delay is detected by the music server according to the time from the sending time of the ping packet to the receiving time of the response, and is a bidirectional time delay, and the music server only involves the unidirectional time delay from the music server to the playing terminal when distributing the music to the playing terminal, the method is as follows in formula (1)Represented as a one-way delay.
As can be seen from the formula (1), if the first time delay of the kth performance terminal is larger, the time of starting to display each note in the kth performance terminal is less delayed, and if the first time delay of the kth performance terminal is smaller, the time of starting to display each note in the kth performance terminal is more delayed, so that the notes displayed by each performance terminal and the notes displayed by other performance terminals can be synchronized, and the performance steps of all the performance terminals can be kept consistent.
Compared with the prior art, the method for displaying the music score, which is provided by the embodiment of the invention, has the advantages that the music score is distributed to N playing terminals, each note in the music score is displayed at each playing terminal according to the time sequence of the music score, so that a user of the playing terminal plays according to the currently displayed note, the time delay between the kth playing terminal and the music score server is obtained as the first time delay, and the time for starting to display each note in the kth playing terminal is adjusted according to the first time delay. The music score server distributes the music score to a plurality of playing terminals, the time delay of each playing terminal is obtained after the music score is distributed, and the time for starting to display each note in each playing terminal is adjusted according to the time delay, so that the notes played by each playing terminal can be synchronous with the notes played by other playing terminals, the playing steps of each player can be kept consistent, the effect of ensemble is improved, and the ensemble can be smoothly carried out.
A second embodiment of the present invention relates to a music score display method. The second embodiment is substantially the same as the first embodiment, and is mainly different in that adjusting the time at which each note in the kth performance terminal starts to be displayed according to the first time delay includes acquiring the time delay between the kth performance terminal and the mixing server as the second time delay, and adjusting the time at which each note in the kth performance terminal starts to be displayed according to the first time delay and the second time delay. The time delay between the playing terminal and the mixing server also affects the effect of the ensemble, so that the effect of playing can be more synchronous by combining the first time delay and the second time delay to adjust the time when the notes begin to be displayed.
The specific flow of the music score display method provided by the embodiment of the invention is shown in fig. 4, and the method specifically comprises the following steps:
and S201, distributing the music score to N playing terminals, and displaying each note in the music score at each playing terminal according to the time sequence of the music score so as to be played by a user of the playing terminal according to the currently displayed note, wherein N is a natural number larger than 1.
S202, acquiring time delay between a kth playing terminal and a music score server as a first time delay, wherein k is a natural number from 1 to N.
And S203, acquiring time delay between the kth playing terminal and the mixing server as a second time delay, wherein the mixing server is used for acquiring audio outputs of the N playing terminals to mix.
And S204, adjusting the display starting time of each note in the kth playing terminal according to the first time delay and the second time delay.
The S201 to S202 are the same as S101 to S102 in the first embodiment, and specific reference may be made to the description in the first embodiment, so that the description is omitted here for avoiding repetition.
For S203-S204, specifically, the music score server obtains the second time delay between the kth playing terminal and the mixing server, and may send a request to the mixing server, where the mixing server obtains the second time delay by sending a ping, and sends the obtained second time delay to the music score server.
If the physical locations of the music score server and the mixing server are not far apart, for example, in the same machine room, the second delay is considered to be equal to the first delay, that is, the second delay=the first delay=Δt k, so that the influence of the second delay on the time of starting to display each note in the kth playing terminal is considered to be alsoIn this way, in the case where it is necessary to adjust the time at which each note starts to be displayed in the kth performance terminal by integrating the first time delay and the second time delay, the influence of the second time delay on the note start display time can be added on the basis of the formula (1), that is:
Thus, the following formula (2) is obtained:
TF(i)＝T(i)+(Δtmax-Δtk) (2);
Since the (Δt max-Δtk) in the formula (2) synthesizes the first time delay and the second time delay, the purpose of adjusting the time for which each note in the kth performance terminal starts to be displayed according to the first time delay and the second time delay can be achieved by adjusting the time for which each note in the kth performance terminal starts to be displayed according to the formula (2).
Compared with the prior art, the music score display method provided by the embodiment of the invention has the advantages that the time delay between the kth playing terminal and the mixing server is obtained as the second time delay, and the time for starting to display each note in the kth playing terminal is adjusted according to the first time delay and the second time delay. The time delay between the playing terminal and the mixing server also affects the final ensemble effect, so that when the time of starting to display the notes in the playing terminal is adjusted, the first time delay and the second time delay are combined for adjustment, the adjustment of the time of starting to display each note in the playing terminal can be more accurate, and the ensemble synchronization effect is further improved.
A third embodiment of the present invention relates to a music score display method. The third embodiment is substantially the same as the first embodiment, and is mainly different in that a time delay between the kth performance terminal and the music score server is obtained as a first time delay, specifically, the time delay between the kth performance terminal and the music score server is obtained as a first time delay according to a preset period, and a time for starting to display each note in the kth performance terminal is adjusted according to the first time delay, specifically, the time for starting to display each note in the kth performance terminal is adjusted according to the preset period and the first time delay. The time delay is obtained periodically according to the preset period, so that the dynamic change of the network speed can be obtained, a basis is provided for the follow-up real-time adjustment of the delay amplitude of the note display, the note display adjustment effect is better, and the time for starting the note display can be adjusted according to the dynamic change of the network speed through the preset period and the time for starting the note display by the first time delay, so that the time for starting the note display is more in line with the actual network environment, and the synchronization effect of the ensemble is improved.
The specific flow of the music score display method provided by the embodiment of the invention is shown in fig. 5, and the method specifically comprises the following steps:
and S301, distributing the music score to N playing terminals, and displaying each note in the music score at each playing terminal according to the time sequence of the music score so as to be played by a user of the playing terminal according to the currently displayed note, wherein N is a natural number larger than 1.
S301 is the same as S101 in the first embodiment, and specific reference may be made to the description in the first embodiment, and in order to avoid repetition, a description is omitted here.
S302, acquiring time delay between a kth playing terminal and a music score server as a first time delay according to a preset period.
The duration of the preset period may be set according to actual implementation, and may be, for example, 10 seconds, 15 seconds, 20 seconds, or the like, which is not particularly limited herein. It can be understood that the longer the preset period, the less the user of the playing terminal experiences the change of the tempo, and the smoother the adjustment, but if the preset period is too long, the display of notes in the playing terminal may not reflect the change of the time delay in time, resulting in poor synchronization effect of ensemble, so the preset period should be reasonably set for a long time.
Optionally, the music score server may obtain the first time delay of the kth playing terminal according to the preset period, detect the time delay multiple times in the preset period, and use the average value or the extremum of the time delays detected multiple times as the first time delay, or detect the time delay only in the preset period, and use the time delay as the first time delay, which may be specifically set according to the actual needs, without being limited specifically herein.
And S303, adjusting the display starting time of each note in the kth playing terminal according to the preset period and the first time delay.
The music score server needs to acquire the first time delay before the current preset period and the time when the first time delay adjustment notes start to be displayed according to the preset period and the time when the current adjustment can be performed. Optionally, the first delay of the current preset period may be a delay detected at the beginning of the current preset period, a delay detected at the end of the previous preset period, or an average value of delays detected multiple times in the previous preset period, which may be specifically set according to actual needs, and is not specifically limited herein.
It will be understood that adjusting the time for starting the display of each note in the kth playing terminal according to the preset period and the first delay means that the time for starting the display of the note is adjusted according to the first delay obtained in the current preset period in each preset period, so that the time for starting the display of the note accords with the current network environment.
However, when the first delay detected in the adjacent preset period is larger, if the time for starting to display the notes is directly adjusted according to the formula (1), the adjustment of the next preset period is abrupt, which is unfavorable for the performance of the player. For example, if the difference between the first delays of the preset periods adjacent to each other is 1 second, the time for starting to display the notes of the next preset period may need to be adjusted for 1 second, so that the player may obviously feel the change of the rhythm, and the adjustment is not smooth enough.
In order to make the adjustment of the time for starting the display of the notes smoother, in a specific example, the adjustment of the time for starting the display of each note in the kth performance terminal according to the preset period and the first time delay includes obtaining the magnitude relation between the first time delay of the current preset period and the first time delay of the previous preset period, and adjusting the time for starting the display of each note in the kth performance terminal according to the magnitude relation.
According to the formula (1), the time delay is larger, the time delay of the note beginning to be displayed is less, the time delay is smaller, the time delay of the note beginning to be displayed is more, therefore, if the time delay of the current preset period is larger than the time delay of the previous preset period, the time of the note beginning to be displayed is advanced on the basis of the adjustment of the previous preset period when the current preset period is adjusted, if the time delay of the current preset period is smaller than the time delay of the previous preset period, the time of the note beginning to be displayed is pushed on the basis of the adjustment of the previous preset period when the current preset period is adjusted, and if the time delay of the current preset period is equal to the time delay of the note beginning to be displayed, the adjustment of the previous preset period is kept unchanged.
In a specific example, the adjustment of the time at which each note starts to be displayed in the kth performance terminal according to the above-mentioned magnitude relation may specifically include:
if the first delay of the previous preset period is greater than or equal to the first delay of the current preset period, adjusting the time for starting to display each note in the kth playing terminal in the current preset period according to the following formula (3):
TF(i)＝(TL(i)-TC(i))*(1-R)+TC(i) (3);
If the first time delay of the previous preset period is smaller than the first time delay of the current preset period, the time for starting to display each note in the kth playing terminal in the current preset period is adjusted according to the following formula (4):
TF(i)＝(TC(i)-TL(i))*R+TL(i) (4);
Wherein T F (i) is the time when the i-th note starts to be displayed in the adjusted current preset period, T C (i) is the time when the i-th note starts to be displayed in the current preset period before adjustment, T L (i) is the time when the i-th note starts to be displayed in the previous preset period, R is the adjustment ratio of the time when each note starts to be displayed, r=min (1, (T C(i)-Trecv)/ΔT),Trecv is the time when the current preset period starts, Δt is the duration of the preset period).
It should be appreciated that T C (i) and T L (i) may be T F (i) calculated using equation (1) according to the first delay in the preset period in which they are located.
Specifically, in the expression r=min (1, (T C(i)-Trecv)/Δt), the meaning represented by (T C(i)-Trecv) is the difference between the time at which the note of the current preset period starts to be displayed and the time at which the current preset period starts, and the closer the note is, (T C(i)-Trecv), the smaller the note is, and the larger the note is, (T C(i)-Trecv) the more the note is.
When (T C(i)-Trecv) is less than Δt, (T C(i)-Trecv)/Δt is less than 1, where r= (T C(i)-Trecv)/Δt, particularly when T C(i)＝Trecv, where r=0, and when (T C(i)-Trecv) is greater than Δt, (T C(i)-Trecv)/Δt is greater than 1, where r=1, particularly when (T C(i)-Trecv) =Δt, (T C(i)-Trecv)/Δt is equal to 1, where r=1.
When the time at which the note starts to be displayed is adjusted according to the formula (3), the following cases are classified:
1. When the note at the beginning of the current preset period, T C(i)＝Trecv and r=0, T F(i)＝TL (i) indicates that the time of the note beginning to be displayed is not adjusted;
2. if a note, for example, r=0.5, is between the beginning of the current preset period and the ending of the preset period, T F(i)＝0.5TL(i)+0.5TC (i) represents that the note beginning display time is the combined effect of the first delay of the previous preset period and the first delay of the current preset period;
3. At the note immediately after or after the end of the current preset period, r=1, t F(i)＝TC (i) indicates that the following note is the time at which the note of the current preset period before adjustment starts to be displayed.
As can be seen from the analysis of the formula (3), the closer to the time of starting the display of the note in the previous preset period, the closer to the time of starting the display of the current preset period before adjustment, so that the adjustment of the time of starting the display of the note is smoother when the preset period is switched.
The same adjusting effect can be achieved by the same proving formula (4).
It should be noted that, the first time delay of the current preset period is equal to the first time delay of the current preset period, and may also be adjusted according to the formula (4).
Compared with the prior art, the music score display method provided by the embodiment of the invention can acquire the time delay periodically according to the preset period, can acquire the dynamic change of the network speed, provides a basis for the follow-up real-time adjustment of the delay amplitude of the note display, and enables the note display to have better adjustment effect, and can dynamically adjust the time of the note display along with the dynamic change of the network speed by adjusting the time of the note display according to the preset period and the first time delay, so that the time of the note display is more in line with the actual network environment, and the synchronization effect of ensemble is improved.
The above steps of the methods are divided into only for clarity of description, and may be combined into one step or split into multiple steps when implemented, so long as they contain the same logic relationship, and all the steps are within the scope of protection of the patent, and adding insignificant modification to the algorithm or the process or introducing insignificant design, but not changing the core design of the algorithm and the process.
A fourth embodiment of the present invention relates to a music score display apparatus 400, as shown in fig. 6, comprising a distribution module 401, an acquisition module 402, and an adjustment module 403. The functions of each module are described in detail as follows:
The distribution module 401 is configured to distribute a score to N performance terminals, and display each note in the score at each performance terminal according to a time sequence of the score, so that a user of the performance terminal performs a performance according to a currently displayed note, where N is a natural number greater than 1;
an obtaining module 402, configured to obtain, as a first time delay, a time delay between a kth performance terminal and a music score server, where k is a natural number from 1 to N;
an adjustment module 403 for adjusting the time at which each note in the kth playing terminal starts to be displayed according to the first delay.
Further, the adjustment module 403 is further configured to:
acquiring time delay between a kth playing terminal and a mixing server as second time delay, wherein the mixing server is used for acquiring audio output of N playing terminals to mix;
And adjusting the time for starting to display each note in the kth playing terminal according to the first time delay and the second time delay.
Further, the adjustment module 403 is further configured to:
According to the formula Calculating the time for starting to display each note in the kth playing terminal, wherein T F (i) is the time for starting to display the ith note, T (i) is the expected time for starting to display the ith note without delay, deltat max is the largest first delay in the N playing terminals, deltat k is the first delay;
The ith note is displayed in the kth performance terminal according to T F (i).
Further, the obtaining module 402 is further configured to:
and acquiring the time delay between the kth playing terminal and the music score server as a first time delay according to a preset period.
Further, the adjustment module 403 is further configured to:
And adjusting the time for starting to display each note in the kth playing terminal according to the preset period and the first time delay.
Further, the adjustment module 403 is further configured to:
Acquiring the relation between the first time delay of the current preset period and the first time delay of the previous preset period;
And adjusting the time for starting to display each note in the kth playing terminal according to the size relation.
Further, the adjustment module 403 is further configured to:
If the first time delay of the previous preset period is greater than or equal to the first time delay of the current preset period, adjusting the time for starting to display each note in the kth playing terminal in the current preset period according to a formula T F(i)＝(TL(i)-TC(i))*(1-R)+TC (i);
If the first delay of the previous preset period is smaller than the first delay of the current preset period, the time for starting to display each note in the kth playing terminal in the current preset period is adjusted according to the formula T F(i)＝(TC(i)-TL(i))*R+TL (i),
Wherein T F (i) is the time when the i-th note starts to be displayed in the adjusted current preset period, T C (i) is the time when the i-th note starts to be displayed in the current preset period before adjustment, T L (i) is the time when the i-th note starts to be displayed in the previous preset period, R is the adjustment ratio of the time when each note starts to be displayed, r=min (1, (T C(i)-Trecv)/ΔT),Trecv is the time when the current preset period starts, Δt is the duration of the preset period).
It is to be noted that this embodiment is an example of a device corresponding to the first, second, and third embodiments, and can be implemented in cooperation with the first, second, and third embodiments. The related technical details mentioned in the first embodiment, the second embodiment, and the third embodiment are still valid in this embodiment, and in order to reduce repetition, a detailed description is omitted here. Accordingly, the related technical details mentioned in the present embodiment can also be applied to the first embodiment, the second embodiment, and the third embodiment.
It should be noted that each module in this embodiment is a logic module, and in practical application, one logic unit may be one physical unit, or may be a part of one physical unit, or may be implemented by a combination of multiple physical units. In addition, in order to highlight the innovative part of the present invention, units that are not so close to solving the technical problem presented by the present invention are not introduced in the present embodiment, but this does not indicate that other units are not present in the present embodiment.
A fifth embodiment of the present invention relates to a server, as shown in fig. 7, comprising at least one processor 501, and a memory 502 communicatively coupled to the at least one processor 501, wherein the memory 502 stores instructions executable by the at least one processor 501, the instructions being executable by the at least one processor 501 to enable the at least one processor 501 to perform the above-described method of music score display.
Where the memory 502 and the processor 501 are connected by a bus, the bus may comprise any number of interconnected buses and bridges, the buses connecting the various circuits of the one or more processors 501 and the memory 502. The bus may also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or may be a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor 501 is transmitted over a wireless medium via an antenna, which further receives the data and transmits the data to the processor 501.
The processor 501 is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And memory 502 may be used to store data used by processor 501 in performing operations.
A sixth embodiment of the present invention relates to a computer-readable storage medium storing a computer program. The computer program implements the above-described method embodiments when executed by a processor.
That is, it will be understood by those skilled in the art that all or part of the steps in implementing the methods of the embodiments described above may be implemented by a program stored in a storage medium, where the program includes several instructions for causing a device (which may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps in the methods of the embodiments of the application. The storage medium includes a U disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, an optical disk, or other various media capable of storing program codes.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific examples of carrying out the invention and that various changes in form and details may be made therein without departing from the spirit and scope of the invention.
Claims (4)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010662778.4A CN111862912B (en) | 2020-07-10 | 2020-07-10 | Music score display method, device, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010662778.4A CN111862912B (en) | 2020-07-10 | 2020-07-10 | Music score display method, device, server and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111862912A CN111862912A (en) | 2020-10-30 |
| CN111862912B true CN111862912B (en) | 2025-04-01 |
Family
ID=73153189
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010662778.4A Active CN111862912B (en) | 2020-07-10 | 2020-07-10 | Music score display method, device, server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111862912B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI825576B (en) * | 2022-01-28 | 2023-12-11 | 中華電信股份有限公司 | Collaborative system, method, and computer-readable medium for realizing online off-site synchronized ensemble |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1433548A (en) * | 1999-12-20 | 2003-07-30 | 汉索尔索弗特有限公司 | Network based music playing/song accompanying service system and method |
| JP2005195982A (en) * | 2004-01-08 | 2005-07-21 | Yamaha Corp | Delay control electronic musical instrument and playing in concert system |
| CN108962202A (en) * | 2018-07-17 | 2018-12-07 | 广州丰谱信息技术有限公司 | The electronic command music score of Chinese operas unit installation broadcasted certainly based on synchronization field |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100819775B1 (en) * | 1999-12-20 | 2008-04-07 | (주)피앤아이비 | Network-based music performance / song accompaniment service apparatus, system, method and recording medium |
| JP2004085825A (en) * | 2002-08-26 | 2004-03-18 | T Tone:Kk | Electronic score display method, electronic score display system, electronic score display device |
| JP5585254B2 (en) * | 2010-07-08 | 2014-09-10 | ヤマハ株式会社 | Session terminal and network session system |
| CN105515915B (en) * | 2015-12-25 | 2019-03-08 | 厦门网宿软件科技有限公司 | Node detecting method and device, path selecting method and device and network system |
| JP2018146782A (en) * | 2017-03-06 | 2018-09-20 | ヤマハ株式会社 | Timing control method |
| CN108008930B (en) * | 2017-11-30 | 2020-06-30 | 广州酷狗计算机科技有限公司 | Method and device for determining K song score |
| WO2020019333A1 (en) * | 2018-07-27 | 2020-01-30 | 华为技术有限公司 | Different frequency measurement time delay determination method, device and storage medium |
| CN111245769B (en) * | 2018-11-28 | 2022-09-30 | 深圳技威时代科技有限公司 | Audio and video transmission method and device and storage medium |
-
2020
- 2020-07-10 CN CN202010662778.4A patent/CN111862912B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1433548A (en) * | 1999-12-20 | 2003-07-30 | 汉索尔索弗特有限公司 | Network based music playing/song accompanying service system and method |
| JP2005195982A (en) * | 2004-01-08 | 2005-07-21 | Yamaha Corp | Delay control electronic musical instrument and playing in concert system |
| CN108962202A (en) * | 2018-07-17 | 2018-12-07 | 广州丰谱信息技术有限公司 | The electronic command music score of Chinese operas unit installation broadcasted certainly based on synchronization field |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111862912A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10242693B2 (en) | Wireless audio synchronization | |
| CN104269182B (en) | The methods, devices and systems that a kind of audio sync is played | |
| CN102739661B (en) | Method and system for network audio sync output on basis of data statistics | |
| KR101657112B1 (en) | Method and apparatus for decreasing presentation latency | |
| CN105992025B (en) | System time calibration method, audio sync playback method and the device played based on audio sync | |
| US10298901B2 (en) | Method for synchronous playback by multiple smart devices, and apparatus | |
| US9837093B2 (en) | Packet based delivery of multi-channel audio over wireless links | |
| CN104467928B (en) | A kind of method and apparatus to cooperate between terminal device | |
| CN111405336B (en) | Multi-device synchronous playing method and system, electronic device and storage medium | |
| WO2016127687A1 (en) | Media file playback progress synchronization method, device and system | |
| US10341773B2 (en) | Packet based delivery of multi-channel audio over wireless links | |
| CN111862912B (en) | Music score display method, device, server and storage medium | |
| EP2695389B1 (en) | Processing media streams for synchronised output at multiple end points | |
| CN105721920B (en) | A kind of media cooperate with the method, apparatus and terminal of broadcasting in more equipment | |
| KR20210078985A (en) | Method of display playback synchronization of digital contents in multiple connected devices and apparatus using the same | |
| CN113115117B (en) | Interactive video playing method, device, storage medium and electronic equipment | |
| US10917465B2 (en) | Synchronization setting device and distribution system | |
| CN117528163A (en) | Method and device for performing audio/video synchronization between video device and wireless audio device | |
| US9635633B2 (en) | Multimedia synchronization system and method | |
| CN203166985U (en) | Network audio synchronization output system based on data statistics | |
| CN112235685A (en) | Sound box networking method and sound box system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |