JP2001147691A - Method and device for audio waveform processing, and computer-readable recording medium with program of this method recorded - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate the editing work of information indicating user's arbitrary control about reproducing of an audio waveform by displaying the reproduced audio waveform. SOLUTION: The method has a first processing where information indicating the condition of the change with time of a prescribed characteristic of the audio waveform is stored, a second processing where user's indication of arbitrary relative control to the prescribed characteristic of the audio waveform in an arbitrary position on the time base is inputted, a third processing where information indicating the condition of control with time to the prescribed characteristic of the audio waveform where the relative control is validated in the position on the time base in accordance with the indication of second processing is stored, a fourth processing where the condition of the change with time at the time of relative control of the prescribed characteristic of the audio waveform based on information stored in the first processing and the indication in the second processing is displayed, and a fifth processing where an indication of control to the prescribed characteristic of the audio waveform is outputted to a sound source means in accordance with the passage of time on the basis of information stored in the third processing.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an audio waveform processing method, an audio waveform processing apparatus, and a computer-readable recording medium on which a program for the audio waveform processing method is recorded. Displaying the state of an audio waveform that is finally reproduced in accordance with performance data that is information indicating control, and allowing the user to easily edit the performance data, that is, information indicating arbitrary control relating to reproduction of the audio waveform. The present invention relates to an audio waveform processing method, an audio waveform processing device, and a computer-readable recording medium storing a program of the audio waveform processing method.

[0002]

2. Description of the Related Art Generally, in an automatic performance apparatus, information indicating arbitrary control relating to reproduction of an audio waveform is
A performance data sequence in which various performance data such as a control amount of a characteristic such as a sound generation start timing, a sound generation stop timing, and a pitch, and a control timing of the characteristic is stored. 2. Description of the Related Art By reproducing data over time, a sound generation start instruction, a sound generation stop instruction, and a change instruction for changing characteristics such as a pitch of an audio waveform are supplied to a sound source device.

In the tone generator to which the above-mentioned various instructions are supplied, the reproduction of the audio waveform stored in advance is started in response to the supplied sound generation start instruction, and the sound generation device is supplied with the supplied sound generation stop instruction. Stops the playback of the audio waveform that is being played back in response to the change in the pitch and other characteristics of the supplied audio waveform, and changes the pitch and other characteristics of the audio waveform that is played back in response to the instruction. It is designed to output and play automatically.

Here, when performing an automatic performance as described above, when a user sets performance data relating to an instruction to change a characteristic such as a pitch in an automatic performance device,
Since the control amount to be set is displayed on the display device of the automatic performance device, the user can set a preferable control amount while visually recognizing the control amount displayed on the display device. is there.

[0005] By the way, in a conventional sound source device, a short audio waveform indicating one sound (note) is mainly handled. However, in recent years, a memory for storing an audio waveform has been reduced in price and large. With the increase in capacity, a recent sound source device has come to handle a long audio waveform composed of a plurality of continuous sounds (notes), such as a singing voice such as "Hallelujah".

For example, Japanese Patent Laid-Open Publication No. Hei 10-260687 deals with a long audio waveform as described above, and changes the pitch in accordance with the supplied sounding start instruction, sounding stop instruction, and pitch change instruction. A technique relating to a sound source device for reproducing an audio waveform has been disclosed.

Here, for example, in a long audio waveform such as the singing voice of "Hallelujah", "ha", "le",
Not only does the pitch and volume of each of the "Le" and "Ya" sounds differ, but also the vibrato and portamento are applied to each sound, and the pitch and volume of each sound change over time. Although it is normal that the audio waveform undergoes a pitch change, such an audio waveform is subjected to a pitch variation inherent in the audio waveform by a sound source device as a reproducing device. The pitch change effect is superimposed.

However, when setting performance data for instructing a change in pitch in a conventional automatic performance device, the control amount of characteristics such as pitch is displayed, but the audio waveform originally has it. There is no indication as to what kind of audio waveform is output as a result of the pitch change effect being superimposed on the pitch change.

For this reason, in some conventional automatic performance devices, it is necessary for a user to set performance data while predicting the characteristics of an audio signal finally output from a sound source device as a playback device. It is accompanied by difficulties, and a proposal for a technology capable of solving such difficulties has been expected.

That is, it is possible to supply performance data relating to the reproduction of a long audio waveform to a tone generator capable of handling a long audio waveform as described above, and cause the tone generator to automatically play the long audio waveform. Although desired, an automatic performance technique suitable for such a sound source device has not yet been proposed, and proposal of such a technique has been strongly desired.

Japanese Patent Application Laid-Open No. Hei 10-260685 discloses a method for real-time measurement of a stored audio waveform without changing the pitch in accordance with a time axis compression / expansion ratio instruction supplied during a performance. A technique related to a sound source device that reproduces an audio waveform by compressing / expanding an axis is described.

According to the sound source device described in Japanese Patent Application Laid-Open No. Hei 10-260687, for example, only the sound of "ha" of "hallelujah" can be compressed and expanded in real time.

On the other hand, in a conventional automatic performance device, the reproduction start timing, reproduction stop timing, and reproduction time of each sound of an audio waveform are displayed based on a performance data string.

In such a conventional automatic performance, in addition to a sound generation start instruction, a sound generation stop instruction, etc., a time axis compression / expansion ratio instruction of an audio waveform is disclosed in Japanese Patent Application Laid-Open No. 10-260686.
However, it is not possible to normally display the reproduction start timing, the reproduction stop timing, and the reproduction time of each sound of the audio waveform simply by doing so. Was.

That is, when the compression / expansion ratio of the time axis of the audio waveform is instructed, it is necessary to change the reproduction start timing, the reproduction stop timing, and the reproduction time of each sound of the audio waveform. Since the automatic performance device does not consider handling the compression / expansion ratio instruction on the time axis of the audio waveform, such a change is not performed, and a display corresponding to such a change cannot be performed. Was.

Also, US Pat. No. 5,792,971 discloses that a long audio waveform composed of a plurality of continuous sounds is used to start or stop the sounding of each sound, or change the pitch or pitch of each sound. To generate a first data group including note-on (instruction start instruction), note-off (instruction stop instruction) or pitch bend (pitch change instruction) including time information, A user edits the first data group to create a second data group as a target value, and generates an audio waveform based on a comparison result between the first data group and the second data group. There is disclosed a technique of changing the pitch of the audio data, compressing / expanding the audio waveform on the time axis, and outputting an audio signal of the pitch and time length indicated by the second data group.

However, US Pat.
In the technique disclosed in Japanese Patent No. 2,971, the target value data is set as the second group of data.

For example, if it is desired to make the length of a certain note equal to the length of a quarter note, the time interval between note-on and note-off corresponding to the note is set to the length of a quarter note. Thus, the time information included in the data is edited. In this case, the user simply sets the length of the quarter note as the time information without considering the original sound length of the audio waveform, and thereby sets the time information. Can be edited.

However, for the user, for example, to extend the length of a certain sound by 1.5 times,
In many cases, it is convenient to specify how much the audio waveform is changed from the original state.

However, when the user intends to extend the length of a certain sound by 1.5 times using the technique disclosed in the above-mentioned US Pat. No. 5,792,971, first, Recognizing the original duration of the sound, the user then calculates 1.5 times the perceived length, and furthermore, the user provides time information such that the duration of the sound is the calculated length. There is a problem that it is necessary to edit, and it is required for the user to perform an extremely complicated operation.

The above-mentioned problems relating to the technology disclosed in US Pat. No. 5,792,971 can be similarly applied to pitches and the like.

That is, US Pat. No. 5,792,971
According to the technology disclosed in Japanese Patent Application Laid-Open Publication No. H10-157, for example, when the audio waveform has a pitch variation such as vibrato, the first pitch bend data group corresponding to the pitch variation is changed. It is necessary to create a second pitch bend data group which is increased or decreased by a desired pitch change, and the user needs to perform extremely complicated operations.

[0023]

SUMMARY OF THE INVENTION The present invention has been made in view of the various needs and problems as described above.
The purpose is to respond to the various demands described above and to solve the various problems described above, in order to solve the above-mentioned various problems, sound source means storing audio waveforms (note that the sound source means
For example, it is realized by an individual device or a general-purpose computer. ), Automatic performance means for supplying various instructions based on performance data as information indicating arbitrary control relating to the reproduction of the audio waveform (the automatic performance means is realized by, for example, an individual device or a general-purpose computer). ), The user is notified of the appearance of the audio waveform reproduced from the sound source means, so that the performance data by the user, that is, information indicating an arbitrary control relating to the reproduction of the audio waveform. It is an object of the present invention to provide an audio waveform processing method, an audio waveform processing device, and a computer-readable recording medium storing a program of the audio waveform processing method, which can facilitate the editing work of the audio waveform processing apparatus.

[0024]

SUMMARY OF THE INVENTION In order to achieve the above object, the present invention provides a method for controlling a pitch or the like for reproducing an audio waveform based on performance data, that is, information indicating arbitrary control relating to reproduction of an audio waveform. In the instruction, the time-dependent change characteristic such as the pitch of the audio waveform and the time-dependent control characteristic such as the pitch set by the user as performance data are integrated to form the audio waveform of which the pitch is controlled. The time characteristic such as the pitch is displayed.

The present invention also provides an audio waveform reproduction speed instruction based on performance data, ie, information indicating arbitrary control relating to audio waveform reproduction. The timing, that is, the position on the time axis is changed, and the changed reproduction timing, that is, the position on the time axis, is displayed.

That is, in the audio waveform processing method according to the first aspect of the present invention, the audio waveform in the automatic performance means for instructing the sound source means storing the audio waveform to perform temporal control on the reproduction of the audio waveform is provided. In the processing method, a first process of storing information indicating a state of a temporal change of a predetermined characteristic of an audio waveform stored in a sound source means, and a predetermined process of the audio waveform at an arbitrary position on a time axis by a user. A second process of inputting an instruction of an arbitrary relative control on the characteristic, and an instruction of an arbitrary relative control on a predetermined characteristic of the audio waveform at an arbitrary position on the time axis by the user in the second processing. Audio such that the indicated relative control is effective at the indicated position on the time axis of the audio waveform. A third process for storing information indicating a state of control over time of a predetermined characteristic of the waveform, and information indicating a state of change over time of the predetermined characteristic of the audio waveform stored in the first process; The predetermined characteristic of the audio waveform is controlled based on the instruction of the relative control by the user in the second processing based on the instruction of the relative control for the predetermined characteristic of the audio waveform input in the second processing. A fourth process for displaying a state of a temporal change when the audio signal is processed, and information indicating a temporal control state for a predetermined characteristic of an audio waveform stored in the third process, and the time elapses. And a fifth process of outputting a control instruction for a predetermined characteristic of the audio waveform to the sound source means.

Here, in the third processing, the control instruction itself input in the second processing may be stored, or the control instruction input in the second processing and other information may be stored. , For example, the sum of the control instruction input in the second process and the information stored in the first process may be stored.

In the third process, when the control instruction itself input in the second process is stored, in the fourth process, the information stored in the first process is compared with the information stored in the first process. The calculation result of the control instruction input in the second process may be displayed, or the control instruction input in the third process and the information stored in the first process may be displayed in the third process. In the case where the calculation result is stored in the fourth process, the information stored in the third process may be displayed.

Further, in the fourth processing, when the state of the temporal change of the predetermined characteristic of the audio waveform is displayed, the state of the temporal change may be graphically displayed. That is, the numerical value indicating the state of the temporal change may be converted into the size or position of the graphic, and the graphic converted in this manner may be displayed.

In the fifth process, the information stored in the third process itself may be output as a control instruction, or the information stored in the third process and other information may be output. May be output.

The control instruction output in the fifth process may indicate an amount of change that relatively changes a predetermined characteristic of the audio waveform, or may indicate an absolute value of the predetermined characteristic of the audio waveform. It may indicate a value.

The audio waveform processing method according to claim 2 of the present invention is the audio waveform processing method according to claim 1 of the present invention. Of the relative control for the predetermined characteristic of the audio waveform at the arbitrary position of designates an arbitrary range on the time axis and an arbitrary increase / decrease amount, and the time stored in the third processing is stored. The information indicating the state of the typical control is, in response to an instruction for relative control by the user in the second processing, based on the increase / decrease amount designated by the instruction, the value of the information in the range designated by the instruction. Is increased or decreased according to a predetermined change shape.

Here, the predetermined change shape when increasing or decreasing the value of the information in the range specified by the user in the second process is, for example, a horizontal line shape for making a uniform change, a polygonal line shape, or the like. Triangular wave-like shape for making a general change, cosine (cosine) wave-like shape for making a cosine (cosine) wave-like change, sine
(Sine) sine (sine) to make a wavy change
It means a wavy shape.

According to a third aspect of the present invention, there is provided the audio waveform processing method according to the third aspect of the present invention, wherein the automatic performance means instructs the sound source means storing the audio waveform to control the reproduction of the audio waveform with time. In the processing method, a first process for storing information indicating a position on a time axis at which each sound of an audio waveform composed of a plurality of sounds stored in the sound source means is reproduced, and A second process for inputting an instruction for arbitrary control on the reproduction speed of the audio waveform at an arbitrary position, and an arbitrary control of the reproduction speed of the audio waveform at an arbitrary position on the time axis by the user in the second process In response to the instruction, such that the indicated control becomes effective at the indicated position on the time axis of the audio waveform. A third process for storing information indicating a temporal control of the reproduction speed of the audio waveform, and information indicating a position on a time axis at which each sound of the audio waveform stored in the first process is reproduced. When the reproduction speed of the audio waveform is controlled based on the user's control instruction in the second process, based on the arbitrary control instruction for the audio waveform reproduction speed input in the second process. A fourth process for displaying a position on the time axis at which each sound of the audio waveform is reproduced, and information indicating temporal control of the reproduction speed of the audio waveform stored in the third process. And a fifth process of outputting an instruction for controlling the reproduction speed of the audio waveform to the sound source means as time passes.

Here, the reproduction speed indicates the degree of compression / expansion on the time axis when the audio waveform is reproduced in the sound source device.

Here, in the third processing, the control instruction itself input in the second processing may be stored, or the control instruction input in the second processing may be stored. For example, if the playback speed control is previously specified for the audio waveform, the control instruction for the playback speed input by the second process and the previously specified playback speed May be stored.

Further, the instruction regarding the control of the reproduction speed is given by the second
In the case of only the control instruction input by the processing of the above, in the fourth processing, the display is performed based on the information stored by the first processing and the control instruction input by the second processing. Alternatively, if there is an instruction related to the control of the reproduction speed other than the control instruction input in the second process, in the fourth process, the information stored in the first process, the second May be displayed based on the change control instruction and other instructions input by the above processing.

In the fourth processing, when the position on the time axis at which each sound of the audio waveform is reproduced is displayed, the position on the time axis may be graphically displayed. That is, the numerical value indicating the position on the time axis may be converted into the size or position of the graphic, and the graphic converted in this manner may be displayed.

In the fifth process, the information itself stored in the third process may be output as a control instruction, or the information stored in the third process and other information may be output. May be output.

The control instruction output in the fifth process may indicate a change amount when the reproduction speed of the audio waveform is relatively changed, or may indicate an absolute value of the reproduction speed of the audio waveform. It may indicate a value.

The audio waveform processing method according to a fourth aspect of the present invention is the audio waveform processing method according to the third aspect of the present invention, further comprising: A sixth process for storing a position on the time axis at which a control instruction for the predetermined reproduction mode is output, and a time process for outputting the control instruction for the predetermined reproduction mode stored in the sixth process A seventh process of changing the position of the control unit based on the instruction of the change control by the user in the second process, and outputting the control instruction to the sound source means at the changed position on the time axis as time passes. Is provided.

Here, the control instruction for the predetermined reproduction mode of the audio waveform stored in the sound source means includes a pitch change instruction and a reproduction speed instruction.

The audio waveform processing method according to a fifth aspect of the present invention is the audio waveform processing method according to the third aspect of the present invention. The instruction for arbitrary change control on the reproduction speed of the audio waveform at an arbitrary position specifies an arbitrary range on the time axis and an arbitrary increase / decrease amount, and the audio waveform stored in the third process is designated. The information indicating the state of the control over the reproduction speed over time is specified by the instruction based on the increase / decrease amount specified by the instruction in response to the user's instruction to change the reproduction speed in the second process. The value of the information in the range is increased or decreased according to a predetermined change shape.

Here, the predetermined change shape when increasing or decreasing the value of the reproduction speed in the range specified by the user in the second processing is, for example, a horizontal linear shape for making a uniform change, A triangular wave shape for making a polygonal change, a cosine wave shape for making a cosine wave shape change, a si
This signifies a sine wave shape for changing the ne (sine) wave shape.

Next, an audio waveform processing apparatus according to a sixth aspect of the present invention is an audio waveform processing apparatus, wherein the audio performance in the automatic performance means for instructing the sound source means storing the audio waveform to perform temporal control on the reproduction of the audio waveform. In the waveform processing device, first storage means for storing information indicating a state of a predetermined characteristic of an audio waveform stored over time in a sound source means, and an audio waveform at an arbitrary position on a time axis by a user. An input unit for inputting an instruction of an arbitrary relative control for a predetermined characteristic; and a user's instruction for an arbitrary relative control for a predetermined characteristic of an audio waveform at an arbitrary position on a time axis input by the input unit. Responsively, such that the indicated relative control is effective at a position on the indicated time axis of an audio waveform. A second storage unit for storing information indicating a state of control over time of a predetermined characteristic of the audio waveform, and a state of a change over time of the predetermined characteristic of the audio waveform stored in the first storage unit. The predetermined characteristic of the audio waveform is input to the input means by the user based on the information shown and the instruction of the relative control for the predetermined characteristic of the audio waveform input by the input means. Display means for displaying a state of change over time when controlled based on the information based on information indicating a state of control over time for a predetermined characteristic of an audio waveform stored in the second storage means, Output means for outputting an instruction to control a predetermined characteristic of the audio waveform to the sound source means as time passes.

Here, the second storage means may store the control instruction itself input by the input means, or may calculate the control instruction input by the input means and other information. As a result, for example, the sum of the control instruction input by the input unit and the information stored in the first storage unit may be stored.

When the control instruction input by the input means is stored in the second storage means, the display means displays the information stored in the first storage means and the input means. The calculation result of the input control instruction may be displayed, or the calculation result of the control instruction input by the input means in the second storage means and the information stored in the first storage means may be displayed. May be displayed on the display means, the information stored in the second storage means may be displayed.

Further, when the state of the predetermined characteristic of the audio waveform over time is displayed on the display means, the state of the temporal change may be graphically displayed.
That is, the numerical value indicating the state of the temporal change may be converted into the size or position of the graphic, and the graphic converted in this manner may be displayed.

The output means may output the information itself stored in the second storage means as a control instruction, or may output the information stored in the second storage means and other information. May be output.

Further, the control instruction output from the output means may indicate a change amount that relatively changes a predetermined characteristic of the audio waveform, or may indicate an absolute value of the predetermined characteristic of the audio waveform. It may be shown.

According to a seventh aspect of the present invention, there is provided the audio waveform processing apparatus according to the sixth aspect of the present invention, wherein the time axis by the user input by the input means is used. The instruction for arbitrary relative control with respect to the predetermined characteristic of the audio waveform at the arbitrary position above designates an arbitrary range on the time axis and an arbitrary increase / decrease amount, and is stored in the second storage means. The information indicating the state of the control over time according to the relative control instruction input by the user through the input means, based on the increase / decrease amount designated by the instruction, the information of the range designated by the instruction. The value of the information is increased or decreased according to a predetermined change shape.

Here, the predetermined change shape when increasing or decreasing the value of the information in the range specified by the user is, for example, a horizontal line shape for making a uniform change or a polygonal line shape for making a polygonal change. Triangular wave shape or cosine
It means a cosine wave shape for changing a (cosine) wave shape, or a sine wave shape for changing a sine (sine) wave shape.

The audio waveform processing apparatus according to claim 8 of the present invention provides an audio waveform processing apparatus which instructs a sound source means storing an audio waveform to perform temporal control on reproduction of the audio waveform. In the processing device, first storage means for storing information indicating a position on a time axis at which each sound of an audio waveform composed of a plurality of sounds stored in the sound source means is reproduced; Input means for inputting an instruction for arbitrary control on the reproduction speed of the audio waveform at an arbitrary position, and arbitrary control of the reproduction speed of the audio waveform at an arbitrary position on the time axis by the user input by the input means In response to the instruction, the specified control is enabled at the position on the specified time axis of the audio waveform. A second storage unit for storing information indicating a state of temporal control over the reproduction speed of the audio waveform, and a position on the time axis at which each sound of the audio waveform stored in the first storage unit is reproduced The audio waveform playback speed is controlled based on the information indicating the audio waveform playback speed input by the input means and the user's control instruction input by the input means. Display means for displaying a position on the time axis at which each sound of the audio waveform at the time of reproduction is reproduced, and information indicating a state of temporal control over the reproduction speed of the audio waveform stored in the second storage means And output means for outputting an instruction for controlling the reproduction speed of the audio waveform to the sound source means in accordance with the passage of time.

Here, the reproduction speed indicates the degree of compression / expansion on the time axis when the audio waveform is reproduced in the sound source device.

Here, the second storage means may store the control instruction itself input by the input means, or may store the control instruction input by the input means and other information. For example, if the control of the playback speed is specified in advance for the audio waveform,
The product of the control instruction for the reproduction speed input by the input means and the reproduction speed specified in advance may be stored.

When the instruction related to the control of the reproduction speed is only the control instruction input by the input means,
In the display means, the display may be performed based on the information stored in the first storage means and the control instruction input by the input means, or the control relating to the control of the reproduction speed may be performed by the input means. If there is any other instruction than the above instruction, the display means may perform the display based on the information stored in the first storage means, the instruction of the change control input by the input means and other instructions.

When a position on the time axis at which each sound of the audio waveform is reproduced is displayed on the display means, the position on the time axis may be graphically displayed. That is, the numerical value indicating the position on the time axis may be converted into the size or position of the graphic, and the graphic converted in this manner may be displayed.

The output means may output the information stored in the second storage means itself as a control instruction, or may output the information stored in the second storage means and other information. May be output.

The control instruction output from the output means may indicate the amount of change when the playback speed of the audio waveform is relatively changed, or may indicate the absolute value of the playback speed of the audio waveform. It may be shown.

An audio waveform processing device according to a ninth aspect of the present invention is the audio waveform processing device according to the eighth aspect of the present invention, further comprising: Third storage means for storing a position on the time axis at which a control instruction for the predetermined reproduction mode is output, and a time at which the control instruction for the predetermined reproduction mode stored in the third storage means is output A second on-axis position is changed based on a user's change control instruction input by the input means, and the control instruction is output to the sound source means at the changed time-axis position as time passes. Output means.

Here, the control instruction for the predetermined reproduction mode of the audio waveform stored in the sound source means includes a pitch change instruction and a reproduction speed instruction.

According to a tenth aspect of the present invention, there is provided the audio waveform processing apparatus according to the eighth aspect of the present invention, and in the audio waveform processing apparatus according to the eighth aspect. The instruction of any change control on the reproduction speed of the audio waveform at an arbitrary position on the time axis by the user input by the input means specifies an arbitrary range on the time axis and an arbitrary increase / decrease amount. The information indicating the state of temporal control over the reproduction speed of the audio waveform stored in the second storage means is provided in response to a user's instruction to change the reproduction speed input by the input means. The information value in the range specified by the instruction is increased or decreased in accordance with a predetermined change shape based on the increase or decrease amount specified by.

Here, the predetermined change shape at the time of increasing or decreasing the value of the reproduction speed in the range designated by the user is, for example, a horizontal line shape for uniform change or a polygonal change. Triangular wave shape and cosin
e (cosine) cosine for making wavy changes
This means a (cosine) wavy shape or a sine (sine) wavy shape for changing a sine (sine) wavy shape.

Further, the recording medium according to the eleventh aspect of the present invention is the recording medium according to any one of the first, second, third, fourth and fifth aspects of the present invention. This is a computer-readable recording medium on which the program of the described audio waveform processing method is recorded.

[0065]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of an audio waveform processing method, an audio waveform processing apparatus and an audio waveform processing method according to the present invention; An example will be described in detail.

FIG. 1 is a basic block diagram of hardware for implementing the audio waveform processing method according to the present invention.

That is, the hardware for implementing the audio waveform processing method according to the present invention is a computer 10
And a sound source device 12. The computer 10 and the sound source device 12 communicate with each other using a MIDI signal, and the sound source device 12 outputs an audio signal.

Here, the computer 10 includes a central processing unit (CPU), a random access memory (RA).
M), read only memory (ROM), CD-RO
M device, hard disk, keyboard, mouse, CR
Equipped with a display device such as T and liquid crystal, as well as a MIDI interface, etc., "WINDOWS"
(Trademark) and "Macintosh (MACINTOS)
H) ”(trademark) and other operating systems (O
It is a general-purpose computer operating in S).

In the computer 10, various instructions corresponding to the operation of the keyboard and mouse by the user are made to the computer 10.

That is, the execution of the automatic performance application program, which is software for realizing the audio waveform processing method according to the present invention on the computer 10, will be described. The automatic performance application program stored on the CD-ROM is installed on the hard disk, and the automatic performance application program is transferred from the hard disk to the RAM in accordance with an instruction to start the automatic performance application program. Thus, the automatic performance application program is executed by the CPU.

The automatic performance application program includes processing for reading waveform-related data from the tone generator 12, processing for creating a performance data sequence based on the waveform-related data, processing for editing the performance data sequence, and performance. A program for various processes such as a process for reproducing a data string is stored. The details of these various processes will be described later with reference to flowcharts and the like.

As described above, the computer 10
The communication between the sound source device 12 and the sound source device 12 is performed by a MIDI signal.

Next, the sound source device 12 stores audio waveform data and waveform-related data of the audio waveform data in advance, and stores the waveform-related data in response to a MIDI signal indicating a request for waveform-related data from the computer 10. In addition to supplying the MIDI signal to the computer 10, note-on (pronunciation start instruction), note-off (pronunciation stop instruction), syllable number (syllable designation instruction for designating a syllable to start reproduction) and reproduction from the computer 10 In response to a MIDI signal indicating a speed designation (playback speed designation instruction), a pitch bend (pitch change instruction), etc., audio waveform data is reproduced and output as an audio signal. The details of these processes will be described later with reference to flowcharts and the like.

Here, the above-mentioned waveform-related data request, syllable number, and reproduction speed designation are communicated as a predetermined control change or a system exclusive message.

Next, the meaning of each of the above-mentioned data in this specification will be described in order.

(1) Audio Waveform Data The audio waveform data may be, for example, “halerya (hal)
-Le-lu-jah) ”or the like, which is an audio waveform data composed of a plurality of continuous sounds such as a singing voice. In this embodiment, the singing voice has been described as an example, but it includes all audio waveforms such as instrument sounds and sound effects, and is not limited to the singing voice.

In this specification, each of a plurality of sounds included in an audio waveform is referred to as “syllable” for convenience.
However, this is not limited to phonetic “syllables”, that is, “syllables”, but shall mean small pieces of an audio waveform.

The audio waveform can be varied in pitch and volume, and each syllable can have a different pitch and volume.

(2) Waveform-related data Waveform-related data includes “syllable address”, “original key”, “syllable original key”, “pitch fluctuation”, “tempo” and “character string”. , Will be described below.

(2-1) Syllable Address The syllable address indicates the start address of each syllable in the RAM storing audio waveform data.

Each syllable is assigned a syllable number in order from the syllable at the head of the audio waveform, and when the syllable number is designated for the sound source device 12, the syllable number designated in the sound source device 12 is assigned. The syllable address of the syllable corresponding to is determined.

The syllable address of each syllable,
That is, the start address of each syllable is simultaneously the end address of the syllable immediately before the syllable. Therefore, the difference between the syllable address of a certain first syllable and the syllable address of a second syllable immediately after the first syllable indicates the length of the first syllable.

(2-2) Original Key The original key indicates, in the form of a MIDI note number, a reference pitch for reproducing the audio waveform while changing the pitch. Therefore, in the tone generator 12, the pitch of the audio waveform data is changed in accordance with the pitch between the note number designated by the note-on and the note number indicated by the original key with respect to the tone generator 12. Will be played.

(2-3) Syllable Original Key The syllable original key quantizes the pitch of each syllable of the audio waveform in semitone units, and determines which note on the musical scale corresponds to a MIDI note. It is shown in the form of a number. That is, the syllable original key is
The pitch of the audio waveform is shown in semitone units for each syllable.

(2-4) Pitch Fluctuation The pitch fluctuation indicates the pitch fluctuation of the audio waveform. Specifically, the pitch of the audio waveform at a predetermined time interval is different from the pitch indicated by the syllable original key, that is, the minute pitch truncated when the pitch of each syllable is quantized in semitone units. The pitch is shown together with the address of the audio waveform of the pitch.

In some cases, the pitch of the audio waveform changes by more than a half tone in the syllable. At this time, pitch variation data indicating a pitch variation of more than a half tone is created.

(2-5) Tempo The tempo indicates the tempo of the performance sound of the audio waveform data stored in the sound source device 12. When performance data is created by the automatic performance application program, a time in ticks is determined in accordance with the tempo.

(2-6) Character String The character string is stored corresponding to each syllable, and indicates the contents of the corresponding syllable.

Here, the character string may be any character string as long as it indicates the contents of the syllable.
e-lu-jah) ”,“ hal ”,“ le ”,“ l ”indicating the lyrics of each syllable.
Each data such as "u" and "jah" can be a character string. If the audio waveform data is a drum set performance sound, each of the syllable performance sounds such as “bass drum”, “snare drum”, “ride cymbal”, etc. The data can be a string. Alternatively, in this case, data such as “Don”, “Tan”, and “Jan”, which simulate the performance sound of each syllable in words, may be used as a character string.

The automatic performance application program creates a character string corresponding to each syllable on the basis of a character string included in the waveform-related data in response to a user's instruction to create performance data. The character string of the corresponding syllable is overwritten and displayed at the center of the rectangle indicating each syllable on the performance data editing screen (see FIGS. 12 to 32) described later. Therefore, when the user edits the performance data while viewing the editing screen (see FIGS. 12 to 32), the user recognizes what each syllable is based on the displayed character string. Can be easily edited.

In the following description, the display area of various data on the editing screen will be described with reference to FIG. 12 or 13 as a representative in order to avoid complication.

In this embodiment, it is assumed that the syllable original key and the character string are set corresponding to each syllable in order from the first syllable. Therefore, the automatic performance application program uses the syllable original key, the syllable number corresponding to the character string, the syllable original key, the number of the syllable original key whose character string is counted from the beginning, and the character string. It can be grasped by counting whether it is.

In the following description, for ease of understanding the present invention, an example in which the pitch and the reproduction speed are controlled with respect to an audio waveform will be described. However, the present invention is not limited to this. Of course, the volume may be controlled by a similar method.

Next, referring to the flowchart showing the processing routine when a MIDI signal is input to the tone generator shown in FIG.
Sound source device 12 when a MIDI signal is input to the
Will be described.

That is, the computer 10 sends the sound source device 12
When the MIDI signal is input to the tone generator 12, the tone generator 12 determines what the data type of the MIDI signal input to the tone generator 12 is (step S202), and according to the data type of the input MIDI signal. Will be executed appropriately.

The processing executed according to the data type of the input MIDI signal will be described below for each data type.

(1) When the data type is a waveform-related data request (step S202 → step S204) In the above-described determination processing of step S202, the data type of the MIDI signal input to the tone generator 12 is the waveform-related data request. Is determined, the waveform-related data stored in the sound source device 12 is stored in the computer 1.
0 (step S204), and the processing of this flowchart ends.

(2) When the data type is a syllable number (step S202 → step S206) In the above-described determination processing of step S202, the data type of the MIDI signal input to the tone generator 12 is the syllable number to be reproduced. If it is determined that the syllable number designates a number, the designated syllable number is stored in the memory of the sound source device 12 (step S206), and the processing of this flowchart ends.

(3) In the case where the data type is the reproduction speed designation (step S202 → step S208) In the above-described determination processing of step S202, the data type of the MIDI signal input to the tone generator 12 indicates the reproduction speed. If it is determined that the designated reproduction speed is designated, the designated reproduction speed is stored in the memory of the sound source device 12, and the reading speed of the audio waveform data being reproduced is set to the reproduction speed designated by the reproduction speed designation. (Step S208), and the processing of this flowchart ends.

Here, the reciprocal of the reproduction speed indicates the ratio of the actual reproduction time to the original time of the audio waveform data. Therefore, when the playback speed is, for example, “1”, the audio waveform data is played back in the time that the audio waveform originally has, and the playback speed is, for example, “0.5”. in case of,
When the audio waveform data is reproduced by taking twice as long as the original time of the audio waveform, and when the reproduction speed is, for example, “2”, the audio waveform data is reproduced by the audio waveform. It is played back in half the time it originally has. That is, the reproduction speed indicates the degree of compression / expansion on the time axis when the audio waveform is reproduced in the sound source device 12.

(4) When the data type is note-on (playback start instruction) (step S202 → step S2)
10 → Step S212 or Step S202 → Step S210 → Step S214) In the above-described determination processing of step S202, the data type of the MIDI signal input to the sound source device 12 is the note-on which indicates the start of the reproduction of the audio waveform data. If it is determined that it is (playback start instruction), it is determined whether or not the audio waveform data is being played back (step S210). In this determination processing of step S210, it is determined that the audio waveform data is not being played back. If it is determined, the reproduction of the audio waveform data at the pitch indicated by the note-on at the stored reproduction speed is started from the address indicated by the syllable address corresponding to the stored syllable number ( Step S212), the processing of this flowchart ends.

At this time, the pitch of the audio waveform data is changed and reproduced based on the difference between the note number specified by note-on and the note number indicated by the original key. For example, the note number specified by Note On is the original
When the pitch is higher than the note number indicated by the key by one semitone, the audio waveform data is reproduced so that the pitch is semitone higher than the original pitch of the audio waveform data.

As described above, since the pitch is controlled relatively, the temporal fluctuation of the pitch originally contained in the audio waveform is directly reflected in the reproduction.

The technique of reproducing the audio waveform data by controlling the reproduction speed and the pitch as described above is a known technique described in Japanese Patent Application Laid-Open No. H10-260685. The detailed description thereof will be omitted by quoting 10-260687.

On the other hand, if it is determined in step S210 that the audio waveform data is being reproduced, the note number designated by the note-on and the note number indicated by the original key are used. Based on the difference, the pitch of the audio waveform data being reproduced is changed and the reproduction is continued (step S214), and the processing of this flowchart ends.

(4) When the data type is note-off (reproduction stop instruction) (step S202 → step S2)
16 → Step S218 or Step S202 → Step S216) In the above-described determination processing in step S202, the data type of the MIDI signal input to the tone generator 12 is a note-off (stop reproduction) instructing to stop reproduction of the audio waveform data. If it is determined to be (instruction), it is determined whether or not the note number indicated by the note-off is the same as the note number indicated by the last received note-on (step S216). Step S216
In the judgment process, the note that the note-off indicates
The note that the number indicates the last received note-on
If it is determined that the number is the same as the number, the reproduction of the audio waveform data is stopped (step S218), and the processing of this flowchart ends.

On the other hand, if it is determined in step S216 that the note number indicated by the note-off is not the same as the note number indicated by the last received note-on, the flow chart is continued. Is completed.

(4) If the data type is (1) described above,
If neither of (2) and (3) is satisfied (step S202 → step S220) In the determination process of step S202, the data type of the MIDI signal input to the tone generator 12 is (1) or (2) If neither of the steps (3) and (3) is satisfied, processing corresponding to the data type of the received MIDI signal is performed as other processing (step S220), and the processing of this flowchart ends.

Here, the processing according to the data type of the received MIDI signal means, for example, if the data type of the received MIDI signal indicates pitch bend, only the pitch indicated by the pitch bend value is used. The pitch of the audio waveform data is changed and played back. This allows you to specify a fine pitch change finer than a semitone. Vibrato can be realized, and a pitch fluctuation different from the original pitch fluctuation can be given to an audio waveform whose pitch originally fluctuates.

The specified pitch bend value is stored, and when the pitch control is subsequently performed by the received note-on, the stored pitch-bend value is used in addition to the pitch control based on the note-on note number. -The pitch is also controlled by the bend value.

As is clear from the processing described above with reference to FIG. 2 when the MIDI signal is input to the tone generator 12, a syllable number and a playback speed to start playback are designated for the tone generator 12. By supplying note-on after that, the audio waveform data can be reproduced at the specified reproduction speed from the syllable at the position specified by the syllable number, and the audio waveform data can be reproduced. By supplying the note-on when the sound is on, the pitch can be changed while the reproduction is continued.

Since the reproduction of the audio waveform started by receiving the note-on is continued until the note-off is received, if the note-off is not received at the time when the reproduction is performed to the end of the syllable, The reproduction is transferred to the next syllable.

Therefore, for example, a note-on indicating a first note number, a note-on indicating a second note number, a note-off indicating a first note number, and a second note number Note-offs in this order (notes indicating the first note number)
On → note-on indicating the second note number → note-off indicating the first note number → note-off indicating the second note number), the first note The playback of the audio waveform data is started at the pitch corresponding to the number, and the pitch is changed to the pitch corresponding to the second note number during the playback,
Then, the note-off indicating the first note number is ignored (ie, the reproduction of the audio waveform data is not stopped), and the note-off indicating the second note number is ignored.
The reproduction of the audio waveform data is stopped when the OFF signal is received.

Also, by specifying the playback speed during the playback of the audio waveform data, the playback speed of the audio waveform data being played back can be changed and played back. By designating the pitch bend, the pitch of the audio waveform data being reproduced can be changed and reproduced.

Next, the operation performed by the computer 10 by the automatic performance application program will be described.

First, a performance data string used in the automatic performance application program will be described with reference to FIG.

In this embodiment, the performance data string is stored in the RAM of the computer 10.
Each piece of performance data making up the performance data string is classified into syllable data and control data.

Here, FIG. 3 (a) graphically shows the format of performance data, and FIG. 3 (b) graphically shows the format of syllable data in the performance data. FIG. 3C graphically shows the format of control data in the performance data.

Then, any of the performance data, ie, both the syllable data and the control data, are shown in FIG.
(B) As is clear from (c), Clock, DfltClock, and Sta described later are used as parameters.
tus information, and “other information” as a parameter according to the type of data. Specifically, "Other information" about syllable data
Are Sylable, SylblO
rigKey, NoteOffset, Length,
DfltLength and GateRate,
Parameters of "other information" relating to control data include Value, DfltValue, and Type.

[0120] The performance data is DfltClock.
Are stored in chronological order in the order of

Hereinafter, the information of the Clock, DfltClock, and Status parameters will be described in detail.

(1) Clock Clock is information indicating the time at which performance data is reproduced (elapsed time from the start of reproduction of a performance data string).

(2) DfltClock DfltClock is information indicating a time at which performance data is reproduced in a state before editing. “Before editing”, all reproduction speeds of the audio waveform data are “1”, and all pitch bend values are “0”. In this specification, all reproduction speeds of audio waveform data are “1” and all pitch / bend values are “0”.
Is appropriately referred to as “before editing”.

(3) Status The Status is information indicating whether the performance data including the Status is syllable data or control data.

Next, Syllabl of syllable data is used.
e, SylblOrigKey, NoteOffse
t, Length, DfltLength and Gat
The information of the parameter of eRate will be described. The syllable data is data instructing the reproduction of a specific syllable.

(1) Sylable Sylable is information indicating a syllable to be reproduced by a syllable number.

(2) SylblOrigKey SylblOrigKey is information indicating the syllable original key of the syllable to be reproduced. That is,
SylblOrigKey indicates the pitch of the audio waveform of the corresponding syllable in semitone units. In addition,
SylblOrigKey is indicated in the form of a MIDI note number.

(3) NoteOffset NoteOffset is information indicating the pitch difference between the transmitted note-on and note-off note numbers and the original key, and indicates the pitch of the corresponding syllable audio waveform. This is information indicating how much to change the reproduction. Note that NoteOffset is the MI
It is shown in the form of a DI note number.

(4) Length Length is information indicating the reproduction duration of the syllable to be reproduced. That is, Length indicates how long the corresponding syllable is reproduced.

(5) DfltLength DfltLength is information indicating the reproduction duration before editing the syllable to be reproduced. That is, DfltLe
ngth indicates the original length of the corresponding syllable.

(6) GateRate GateRate is information indicating the ratio of the net playback time to Length. Therefore, the net playback time is “Net playback time = Length × GateRat
e ".

Next, information of the control data parameters Value, DfltValue, and Type will be described. The types of control data include reproduction speed data as data for specifying a reproduction speed for an audio waveform, and pitch bend. There is pitch bend data which is data for specifying

(1) Value Value is information indicating a control value, that is, information indicating a control amount of a reproduction mode of an audio waveform such as a pitch and a reproduction speed. By clicking the “control” column 100 located in the column with a mouse, the value can be selected.

(2) DfltValue DfltValue is information indicating an original value of the audio waveform, and can be clicked with the mouse on the “original” column 102 located at the lower left portion of the editing screen shown in FIG. By DfltValue
Can be selected.

(3) Type Type is information indicating the type of control data, that is, whether the control data is reproduction speed data or pitch bend data.

Then, the button 106 of the “Type” column 104 located at the center of the left column of the editing screen shown in FIG.
When the “time” column 108a is clicked and highlighted with a mouse, “Time” is displayed in the “Type” column 104, and the reproduction speed data can be selected (see FIGS. 23 to 32).

Further, a button 108 in the “Type” column 104 located at the center of the left column of the editing screen shown in FIG.
When the “tch” column 108 b is clicked with the mouse and highlighted, “Pitch” is displayed in the “Type” column 104.
Is displayed, and pitch bend data can be selected (see FIGS. 12 to 19). In FIG. 12,
The button 106 in the “Type” column 104 is clicked with a mouse to open a box 108, and the “Pitch” column 1
08b is clicked with the mouse to highlight it.

Further, a button 108 in the “Type” column 104 located at the center of the left column of the editing screen shown in FIG.
When the “transpose” column 108c is highlighted with a mouse click, “T” is displayed in the “Type” column 104.
"transpose" is displayed, and transpose data can be selected (see FIGS. 20 to 22).
In the transpose data, NoteOffset in the syllable data is displayed as transpose data, and there is no control data called transpose data. In the present specification, for the sake of convenience, in the following description regarding editing of data, transpose data will be described as one type of control data.

Here, in this embodiment, time is managed in units of “ticks”. The length of one tick is set to 1/480 of a quarter note, and the physical length of the tick is determined by the tempo. And the above Clock,
DfltClock, Length and DfltL
The length indicates time in units of ticks.

In this embodiment, when a MIDI signal indicating a request for waveform-related data is output from the computer 10 to the tone generator 12 in response to a user's instruction to create performance data, the waveform-related data is generated. The waveform-related data is output from the sound source device 12 to the computer 10 in response to the request, and the waveform-related data is supplied to the computer 10 (step S202 in FIG. 2,
Reference is made to the processing in step S204. ). The computer 10 creates performance data based on the supplied waveform-related data.

Here, the computer 10 creates each syllable data based on the waveform-related data of each syllable. That is, the value obtained by converting the syllable address in units of ticks is Clock, DfltClock.
k and the syllable number corresponding to each syllable is S
ylable is set.

Also, the value of the syllable original key is set to SylblOrigKey, and the difference between the syllable address of each syllable and the syllable address of the syllable immediately following it is Length, DfltLength.
Is set to

Further, "0" is set as an initial value in NoteOffset, and "1" is set as an initial value in GateRate.

The control data is arranged at the beginning of the performance data string, immediately before the start of each syllable, and at intervals of 20 ticks (corresponding to the length of the 96th note). You. In this embodiment, the leading performance data is always the reproduction speed data of the control data.

Then, the Clo of each control data is set.
ck and DfltClock are the control. The value corresponds to the time position where the data is arranged.

Here, it is assumed that the value of the control data other than the reproduction speed data is set to “0” as an initial value, and the value of the reproduction speed data is set to “1” as an initial value.

Also, Dflt of pitch bend data
Value contains DfltClock of waveform-related data.
It is assumed that a pitch variation value at a time position corresponding to is set.

It should be noted that the reproduction speed data is expressed by Dfl
It is assumed that “1” is set in tValue.

Also, since the control data is arranged at a time interval finer than the reproduction duration of the syllable,
By editing the value of the control data, it is possible to change the reproduction speed and pitch during the syllable.

Next, with reference to the flowchart of the performance data reproduction processing routine shown in FIG. 4, the performance data reproduction processing executed by the computer 10 functioning as an automatic performance device (sequencer) as automatic performance means. explain.

In the performance data reproduction process, NoteFLG indicating whether or not a note-off corresponding to the note-on transmitted to the tone generator 12 has been transmitted to the tone generator 12 is used as a variable. This Note
The FLG is set to “NoteFLG = 1” when the note-off corresponding to the note-on transmitted to the tone generator 12 is not transmitted to the tone generator 12, and corresponds to the note-on transmitted to the tone generator 12. It is assumed that “NoteFLG = 0” is set when the note-off is transmitted to the tone generator 12.

This performance data reproduction process is a process that is repeatedly executed each time a time corresponding to one tick elapses, when the user instructs the computer 10 to start reproducing the performance data sequence. The current time is cleared to "0" when an instruction to start playing the performance data string is issued.

That is, when the reproduction process of the performance data is started after a time corresponding to one tick has elapsed, first the current time is obtained (step S402), and the C of the performance data to be reproduced next is obtained.
It is determined whether or not the lock matches the current time, that is, whether or not it is the playback timing of the next performance data (step S404).

In the determination processing in step S404, when it is determined that the Clock of the performance data to be reproduced next coincides with the current time, that is, it is determined that the reproduction timing of the next performance data has come. If so, the next performance data is reproduced, and the process proceeds to step S406 and subsequent steps.

In the process of step S406,
It is determined whether the data type of the reproduced performance data is syllable data or control data.

If it is determined in step S406 that the data type of the reproduced performance data is syllable data, the value of NoteFLG is "0" or "1". Is determined (step S408).

In the process of step S408,
The value of “NoteFLG” is “0”, that is, “No”
If it is determined that teFLG = 0 ”,“ No ”
teFLG ”is set to“ 1 ”and“ NoteFLG =
1 ”(step S410), and after transmitting the syllable designation (syllable number) indicated by the syllable data, which is the reproduced performance data, to the tone generator 12 (step S41).
2), the note-on corresponding to the syllable data that is the reproduced performance data is transmitted to the tone generator 12 (step S414). At this time, the sum of the original key of the waveform-related data and the NoteOffset of the syllable data that is the reproduced performance data is used as the note-on note number transmitted to the tone generator 12.

When the processing in step S414 is completed, the flow advances to processing in step S416, where "Clock +" of the syllable data that is the reproduced performance data is read.
Note the calculated value of “Length × GateRate”
The same note as the transmitted note-on in the off table
It is registered in the number column (step S416), and then the next performance data is read out (step S41).
8).

Further, after that, the process loops back to the process of step S404, and it is determined whether or not it is the reproduction timing of the read next performance data, and the above process is repeated.

The note-off table stores the time at which note-off is transmitted for each note number.

On the other hand, in the processing of step S408,
The value of “NoteFLG” is “1”, that is, “No”
If it is determined that teFLG = 1 ”, NoteOf of the syllable data that is the reproduced performance data is used.
fset and NoteOffs of the immediately preceding syllable data
It is determined whether or not et is the same (step S42).
0).

In the determination processing of step S420, N of the syllable data which is the reproduced performance data is
noteOffset and Not of previous syllable data
If it is determined that eOffset is not the same as that of step S414, a note-on corresponding to the reproduced syllable data is transmitted to the tone generator 12, as in step S414 (step S422). Similarly to the above-described step S416, the time at which the note-off is transmitted is registered in the note-off table (step S4).
24). In this case, the syllable designation is not transmitted.

Then, a note-off corresponding to the syllable data immediately before the reproduced syllable data is transmitted to the tone generator 12 (step S42).
6) Further, the column corresponding to the same note number as the transmitted note-off in the note-off table is cleared (step S428), and the next performance data is read out (step S418).

Further, after that, the process loops back to the process of step S404, and it is determined whether or not it is the reproduction timing of the read next performance data, and the above process is repeated.

In the determination processing of step S420, N of the syllable data which is the reproduced performance data is determined.
noteOffset and Not of previous syllable data
If it is determined that eOffset is the same, that is, if “NoteFLG = 1”, but the NoteOffset of the reproduced syllable data is the same as the NoteOffset of the immediately preceding syllable data, the reproduction is performed. The note-on relating to the syllable data, which is the performance data, is not transmitted to the tone generator 12, but the note number corresponding to the reproduced syllable data in the note-off table (this note-
Number is NoteOffset of syllable data
And the original key. )), Register the time to send the note-off,
A note number corresponding to the note-off of the syllable data immediately before the reproduced performance data of the table (this note number is the NoteOf of the syllable data)
This is the sum of fset and the original key. ) Is cleared (step S420, but the processing content is not shown), and the process jumps to step S418 to read the next performance data (step S418).

Further, after that, the process loops back to the process of step S404, and it is determined whether or not it is the reproduction timing of the next read performance data, and the above process is repeated.

In the determination processing of step S406, the data type of the reproduced performance data is controlled.
If the control data is determined to be data, a MIDI signal corresponding to the type of the control data with the value of the control data being the reproduced performance data as a control value is transmitted to the tone generator 12 (step S430). Then, the process jumps to the process of step S418, and reads out the next performance data (step S418). As a result, the reproduction speed designation, pitch bend, and the like are transmitted.

Further, after that, the process loops back to the process of step S404, and it is determined whether or not the read timing of the next read performance data has come, and the above process is repeated.

On the other hand, if it is determined in the determination processing of step S404 that the timing for reproducing the next performance data has not come, the note number having the same time as the current time registered in the note-off table. It is determined whether or not there is, that is, whether or not it is the sound generation stop timing (step S432).

In the determination process of step S432, if it is determined that there is a note number in which the same time as the current time is registered in the note-off table, that is, it is determined that it is the sound generation stop timing, "NoteF
"LG" is set to "0" to set "NoteFLG = 0" (step S434), and the note-off data of the note number is transmitted to the tone generator 12 (step S4).
36), and the notes in the note-off table
Clear the column corresponding to the number (step S43)
8) Then, the reproduction process of the performance data is ended.

On the other hand, if it is determined in step S432 that there is no note number registered in the note-off table with the same time as the current time, that is, it is determined that it is not the sound generation stop timing, the performance is not changed. The data reproduction process ends.

Next, the editing process of the performance data will be described with reference to the editing screen displayed on the display device shown in FIGS.

That is, in this embodiment, the content of the created performance data is displayed on the display screen of the display device, and the user operates the mouse or keyboard to edit the performance data displayed on the display device. Is what is done. In this embodiment, the display screen of the display device on which the content of the performance data is displayed is referred to as an edit screen.

Here, in the syllable display area 120 located in the upper right column of the edit screen and the data display area 122 located in the lower right column of the edit screen, the horizontal axis indicates time and the vertical axis indicates performance. It shows a value based on the value of the data.

In the syllable display area 120, the pitch actually reproduced for each syllable is displayed based on the syllable data. In the syllable display area 120, each syllable is displayed as a rectangle,
Clock determines the position of the left end on the horizontal axis of the rectangle, Length determines the length of the horizontal axis of the rectangle, and sets Length and Gate from the left end of the rectangle.
Product with Rate (net playback time = Length × Ga
The rectangle is colored by the length of teRate).
The figure shows a state where all the rectangles are colored, that is, a case where “GateRate = 1”. Also, SylblOrigKey and NoteOff
The position on the vertical axis of the rectangle is determined by the sum with set. It is assumed that the length of the above-described rectangle in the vertical axis direction is fixed to a predetermined length.

In FIG. 12, rectangles 124a, 124b, 124c, and 1 correspond to the four syllables.
Four rectangles of 24d are displayed.

Here, before editing, NoteOffset
Is set to “0”, so that in the syllable display area 120 before editing, SylblOrigKe
The position on the vertical axis of the rectangle is displayed according to y, that is, the pitch originally possessed by each syllable.

In the data display area 122, display for editing syllable data and display for control data are performed.

As described above with reference to FIG. 12, when the button 106 located at the center of the left column of the user edit screen is clicked to open the box 108 in the “Type” column 104, the pitch bend data "Pitch" column 108b selected when displaying / editing, "Time" column 108a selected when displaying / editing the playback speed data, and "Transpose" selecting when displaying / editing the transpose data. Column 108c is displayed. Here, the user uses the mouse to select “Pitc
When the user clicks the "h" column 108b, pitch bend data is selected as control data to be displayed and edited.
Click a to display and edit the control
When reproduction speed data is selected as data, and the user clicks the "Transpose column 10c" with a mouse, transpose data is selected as control data to be displayed and edited.

[0180] Further, the user can set the "constant" column 13 located at the center of the left column of the editing screen shown in FIG.
When a mouse is clicked on either the “liner” column 132 or the “cosine” column 134, a predetermined change shape used when editing control data can be selected.

Here, the above-mentioned "predetermined change shape" indicates a characteristic when increasing or decreasing the value of the control data in the range designated by the user. In this embodiment, the following will be described. As shown in the figure, horizontal line shape for uniform change, triangular wave shape for polygonal change, cosine (cosine)
It means a cosine wave shape for changing the wave shape.

Here, when the user sets “constant”
When the column 130 is clicked with a mouse, a horizontal linear change shape (constanat) parallel to the horizontal axis of the edit screen for uniform change is selected as a predetermined change shape used when editing control data. be able to.

Further, when the user enters the “liner” column 132
Is clicked with a mouse, a triangular wave-shaped change shape (liner) that protrudes in the direction of the longitudinal axis of the edit screen as a predetermined change shape used when editing the control data can be selected.

Further, when the user enters the "cosine" column 1
When the mouse is clicked on 34, a cosine wave-shaped change shape (cosine) that protrudes in a curve in the vertical axis direction of the edit screen is selected as a predetermined change shape used when editing the control data. Can be.

Then, the user enters a "control" column 100 located at the lower part of the left column of the editing screen shown in FIG.
Is clicked with a mouse, the value of the control data can be selected and displayed as the display content to be displayed in the data display area 122 located in the lower right column of the edit screen. Specifically, when pitch bend data or playback speed data is selected as data to be displayed or edited, the value of the pitch bend data or playback speed data is displayed, and the display / editing value is displayed. If transpose data is selected as the data to be processed, the syllable data NoteOf
The value of fset is displayed.

[0186] Further, the "original" column 102 located at the lower part of the left column of the editing screen shown in FIG.
Is clicked with a mouse, the value of the characteristic originally possessed by the audio waveform can be selected and displayed as the display content to be displayed in the data display area 122 located in the lower right section of the edit screen. Specifically, when pitch bend data or playback speed data is selected as data to be displayed or edited, pitch bend data or playback speed data is selected.
The value of DfltValue of the data or the reproduction speed data is displayed, and when transpose data is selected as the data to be displayed / edited, the value of SylblOrigKey of the syllable data is displayed.

Further, when the user clicks the "result" column 110 located in the lower part of the left column of the editing screen shown in FIG. 12 with the mouse, the display contents displayed in the data display area 122 located in the lower right part of the editing screen are displayed. As a result, it is possible to select and display the result of the controlled editing of the audio waveform, that is, the value of the result of controlling the reproduction mode of the audio waveform. In this case, if pitch bend data or reproduction speed data is selected as data to be displayed / edited, the value of the value of pitch bend data or reproduction speed data and Dflt
A result obtained by adding the value of Value is displayed, and when transpose data is selected as data to be displayed and edited, NoteOffs of syllable data is displayed.
The result of adding the value of et and the value of SylblOrigKey is displayed. That is, when transpose data is selected as data to be displayed / edited, the same information as the syllable display area 120 is displayed as an edited result.

The “control” column 100, “o”
Regarding the “Riginal” column 102 and the “result” column 110, by clicking a plurality of columns, a plurality of values corresponding to the clicked columns can be displayed simultaneously.

Here, in order to facilitate understanding of the following description, the display states of the edit screens shown in FIGS. 12 to 32 will be described.

First, FIG. 12 shows an editing screen in which a box 108 is opened to select data to be edited. The display contents of the syllable display area 120 and the data display area 122 are the same as those in FIG.

Next, FIG. 13 shows the value of the control data (control signal) for the pitch bend data.
l) and the editing result (result) in the data display area 1
The editing screen in the state displayed at 22 is shown. In addition,
As the change shape of the control data value, a horizontal linear change shape (constanat) is selected.

Next, FIG. 14 shows the edit screen shown in FIG. 13 in which the edit range is highlighted by designating the edit range by operating a mouse described later.

Next, FIG. 15 shows that the editing result (result) is not displayed on the editing screen shown in FIG.
That is, the editing screen in which only the value (control) of the control data is displayed is shown.

Next, FIG. 16 shows the value of the control data (control) for the pitch bend data.
l) is displayed, the edit range is highlighted by designating the edit range by operating the mouse described later, and the mouse drag operation is performed (the state shown in FIG. 16 indicates that the mouse is being dragged). .) Shows the editing screen in a state where the value of the control data is changed in a horizontal linear change shape (constanat).

Next, in FIG. 17, when the mouse is dropped from the state shown in FIG. 16, the control data value (control) and the editing result (resul) are displayed.
t) is displayed in the data display area 122.

Next, FIG. 18 shows the value of control data (control) for pitch bend data.
l) is displayed, the edit range is highlighted by designating the edit range by operating the mouse described later, and the mouse drag operation is performed (the state shown in FIG. 18 indicates that the mouse is being dragged). ), The value of the control data is changed to the change shape (l
(inner), the editing screen in a changed state is shown.

Next, FIG. 19 shows the value (control) of the control data with respect to the pitch bend data.
l) is displayed, the editing range is highlighted by designating the editing range by operating the mouse described later, and the mouse is dragged (the state shown in FIG. 19 indicates that the mouse is being dragged). .), The value of the control data is cosine (cosin
e) The editing screen is shown in a state where it is changed in the wave change shape (cosine).

Next, FIG. 20 shows the transpose data with respect to the value (con) of the transpose data.
trol), ie, the syllable's NoteOffset
And the editing result (result), that is, the playback pitch of the syllable, is displayed in the data display area 122, and the editing range is highlighted by designating the editing range by operating a mouse described later. It is shown. Note that a horizontal linear change shape (constanat) is selected as the change shape of the value of the control data.

Next, FIG. 21 shows an editing result (re) by transposition data on the editing screen shown in FIG.
sound), ie, without displaying the playback pitch of the syllable,
Only the value (control) of the transpose data is displayed, and the value of the control data is displayed as a horizontal line by a mouse drag operation (the state shown in FIG. 21 indicates that the mouse is being dragged). The editing screen is shown in a state of being changed in a change shape (constanat).

Since the transpose data is actually NoteOffset of syllable data,
Editing is performed only in units of syllables in the horizontal axis direction, and is increased or decreased only in semitone units in the vertical axis direction.

Next, FIG. 22 shows the transpose mode when the mouse is dropped from the state shown in FIG.
Data value (control) and edit result (resul
t) is displayed in the data display area 122.

Next, in FIG. 23, regarding the reproduction speed data, the value (control) of the control data is displayed in the data display area 122, and the editing range is designated by operating the mouse to be described later. Is displayed on the editing screen in which is highlighted. Note that a horizontal linear change shape (constanat) is selected as the change shape of the value of the control data.

Next, in FIG. 24, on the editing screen shown in FIG. 23, the value of the control data is changed by a mouse drag operation (the state shown in FIG. 21 indicates that the mouse is being dragged). Is changed in a horizontal linear change shape (constanat).

Next, FIG. 25 shows an editing screen in which the value (control) of the control data is displayed in the data display area 122 when the mouse is dropped from the state shown in FIG.

Next, in FIG. 26, regarding the reproduction speed data, the value of the control data (control) is displayed in the data display area 122, and the editing range is designated by operating the mouse to be described later. Is displayed in reverse, and the value of the control data is changed in a triangular wave-shaped change shape (liner) by a mouse drag operation (the state shown in FIG. 26 indicates that the mouse is being dragged). The editing screen is shown in the state of being closed.

Next, FIG. 27 shows an editing screen in which the value of the control data (control) is displayed in the data display area 122 when the mouse is dropped from the state shown in FIG.

Next, in FIG. 28, regarding the reproduction speed data, the value (control) of the control data is displayed in the data display area 122, and the editing range is designated by operating the mouse, which will be described later. Is displayed in reverse, and the value of the control data is changed to a cosine wave shape (cosin) by a mouse drag operation (the state shown in FIG. 28 indicates that the mouse is being dragged).
The editing screen in the state changed in e) is shown.

Next, FIG. 29 shows an editing screen in which the value (control) of control data is displayed in the data display area 122 when the mouse is dropped from the state shown in FIG.

[0209] Next, in Fig. 30, regarding the reproduction speed data, the value (control) of the control data is displayed in the data display area 122, and "time" is displayed.
An editing screen is shown in which the edit range is highlighted by clicking the "keep" field 200 and then operating the mouse to be described later.
When the reproduction speed data is edited without clicking the “time keep” column 200, the information on the time of each data within the editing range and each data after the editing range is changed. When the reproduction speed data is edited after clicking the "time keep" field 200, the information on the time of each data within the editing range is changed, but the information on the time of each data after the editing range is changed. Is kept constant. That is, "time
When editing the reproduction speed data after clicking the "keep" column 200, the editing is performed while keeping the time at both ends of the editing range. Note that, as the change shape of the control data value, a triangular wave change shape (liner) is selected.

Next, FIG. 31 shows that the value of the control data is changed in a triangular waveform (liner) by a mouse drag operation (the state shown in FIG. 31 indicates that the mouse is being dragged). The editing screen in a changed state is shown.

Next, FIG. 32 shows an editing screen in which the value (control) of control data is displayed in the data display area 122 when the mouse is dropped from the state shown in FIG.

As described above, in the syllable display area 120 of the editing screen, a group of rectangles corresponding to each syllable of the audio waveform data is displayed in a horizontal line. The position on the vertical axis of each rectangle indicates the pitch of the corresponding syllable in semitone units.

As described above, the pitch of each syllable is edited by editing the transpose data. Transpose data corresponding to one of the syllables,
When the NoteOffset of one of the syllables is increased or decreased by operating the mouse, the rectangle of the syllable displayed in the syllable display area 120 becomes SylblOri.
It will be moved up and down to the position of the new sum of gKey and NoteOffset (FIGS. 20, 21 and 2).
2).

When the playback speed is edited for each syllable, the playback position on the time axis of each syllable, that is, the position or length on the horizontal axis of the rectangle in the syllable display area 120 changes. Therefore, each time the playback speed is edited, the syllable is redisplayed based on the new playback speed. The redisplay of such a syllable will be described later in detail.

Each control data is displayed as one line segment in the data display area 122, and the position of the display line corresponding to the control data on the horizontal axis is determined by the Clock. That is, the positions on the horizontal axis of the syllable display area 120 and the data display area 122 correspond to the same time, respectively, and it is easy to grasp what control data is set corresponding to each syllable. It has become.

Here, in the case of display relating to pitch fluctuation (P
When “itch” is selected, display is performed centering on the “0” position on the vertical axis in the data display area 122 (see FIGS. 12 to 19). When displaying the pitch variation characteristic originally possessed by the audio waveform, (or
(when original is selected) The position on the vertical axis of the display line segment is determined by DfltValue, and when displaying the pitch bend value (when control is selected)
The value determines the position on the vertical axis of the display line segment,
When displaying the pitch variation characteristic of the audio waveform as a result of the pitch control (when result is selected), Dfl
The position on the vertical axis of the display line segment is determined by the sum of tValue and Value.

In the display relating to the pitch of the syllable in semitone units (when Transpose is selected, FIGS. 20 to 22), the display is performed centering on the “1” position on the vertical axis in the data display area 122. . Then, when displaying the original pitch of each syllable (Origina
l), Sylbl of each syllable data
The position on the vertical axis of the display line segment is determined by the OrigKey. When displaying transpose data, (con
control), the No. of each syllable data
The position on the vertical axis of the display line segment is determined by teOffset, and when displaying the playback pitch of each syllable as a result of pitch control in semitone units, (result is selected. In this case, , The pitch control result by pitch bend is ignored.), Note of each syllable data
The position on the vertical axis of the display line segment is determined by the sum of Offset and SylblOrigKey.

Further, in the case of a display relating to the reproduction speed (T
im is selected, see FIGS. 23 to 32)
The display is performed centering on the "1" position on the vertical axis in the data display area 122. When displaying the reproduction speed value (when control is selected), the value on the vertical axis of the display line segment is determined by the Value. It is determined. When the reproduction speed is edited, the value of the Clock of each data is changed, so that the position on the horizontal axis of the display line in the data display area 122 is also changed. In the case of the display relating to the reproduction speed, when original is selected, "1" on the vertical axis is displayed.
A horizontal line is displayed at the position, and when "result" is selected, the same display as when "control" is selected is performed.

[0219] Each time the control data is edited, these displays are redisplayed based on the new control data.

Since the pitch bend value is set to “Value = 0” before editing, the pitch bend value is displayed at the “0” position on the vertical axis in the data display area 122 when displaying the pitch bend value. A horizontal straight line segment is displayed, and the pitch variation characteristic of the audio waveform originally having the audio waveform and the pitch variation characteristic of the audio waveform resulting from the pitch control are displayed in the same shape, for example. , A curved line segment is displayed.

Before editing, the transpose data value, that is, the NoteOffset value is "NoteOffset".
Since “set = 0”, a horizontal line segment is displayed at the “0” position on the vertical axis in the data display area 122 when displaying the transposed data value, and the original sound of each syllable is displayed. Regarding the display of the pitch and the pitch of each syllable as a result of the pitch control based on the transpose data, both have the same shape, for example, a step-shaped line segment.

Further, before editing, the reproduction speed is set to "Value
e = 1 ", when displaying the playback speed,
A horizontal straight line is displayed at the position of "1" on the vertical axis in the data display area 122.

As described above, the user can edit the control data by operating the mouse, and the procedure will be described below.

[Procedure for Editing Control Data] (1) With respect to the data displayed in the data display area 122, the user moves the cursor / icon to one end of the range to be edited by operating the mouse. When the cursor icon is positioned at one end of the area to be edited, the user can hold down the right mouse button and
Drag the mouse left and right on the edit screen so that the cursor icon reaches the other end of the range you want to edit,
When the cursor icon reaches the other end of the range to be edited, release the right button. As described above, the range in which the user drags the mouse becomes the editing range, and the range of editable values is displayed in different colors.

At this time, the left end of the editing range is the position of the control data immediately before the left end specified by the user's operation of the mouse, and the right end of the editing range is the position immediately after the right end specified by the user's operation of the mouse. This is the position immediately before the control data. That is, the following variables (To
pDfltClock and EndDfltClock
k) can be set.

Here, TopDfltClock is
DfltCl of control data at left end of edit range
and EndDfltClock is information indicating control data immediately after the right end of the edit range.
This is information indicating fltClock.

(2) Next, the user enters “consta
nt "column 130," liner "column 132 or" co "
By clicking on one of the “sine” fields 134 with a mouse, a predetermined change shape is selected.

(3) The user operates the mouse to
When the left button of the mouse is pressed after moving the cursor icon to one point in the editing range set in the above (1), a position serving as an editing reference on the time axis (horizontal axis) (editing reference position 300) Is determined and displayed. Then, while holding down the left button of the mouse, drag the mouse vertically on the editing screen so that the cursor icon moves vertically. By the user's operation, the following variable (TargetDfltClock)
And DeltaValue) can be set.

Here, TargetDfltClock
Is information indicating the DfltClock of the control data designated as the editing reference position 300;
eltaValue is information indicating the drag amount.

When the user enters the "constant" column 13
0, according to the change shape selected by clicking the mouse in either the “liner” column 132 or the “cosine” column 134, the Value of each control data within the editing range by the amount corresponding to the mouse drag amount
Is changed according to the following equation 1. In addition,
When transposing data is edited, NoteOffset is used in place of Value in the following equation.

Equation 1 Value = Value + Delt
aValue × f (DfltClock) Here, f (DfltClock) is information indicating a value obtained by DfltClock of each control data according to a predetermined change shape selected by the user.

Specifically, when the user sets “constan”
When the “t” column 130 is clicked on with a mouse and a horizontal linear change shape parallel to the horizontal axis of the edit screen for uniform change is selected, “f (DfltClock) =
In this case, the value of each control data within the editing range is uniformly increased or decreased by the calculation of Expression 1.

[0233] Also, when the user enters the "liner" column 132
Is clicked with the mouse to select a polygonal triangular wave-like change shape protruding in the vertical axis direction of the edit screen, DfltClock <TargetDfltClo
For ck, f (DfltClock) becomes f (DfltClock) = (DfltClock-T
opDfltClock) / (TargetDfltC
lock-TopDfltClock) and DfltClock ≧ TargetDfltC
At the time of lock, f (DfltClock) is obtained by f (DfltClock) = (DfltClock-E
ndDfltClock) / (TargetDfltC
lock-EndDfltClock), and the value of each control data within the editing range is increased or decreased in a triangular waveform by the calculation of Expression 1. At both ends of the editing range, “increase / decrease amount = 0”.

[0234] Further, the user sets the "cosine" column 1
When the cosine (cosine) wavy change shape protruding in the vertical axis direction of the edit screen is selected by clicking on the mouse with the mouse, TargetDfltClock-
TopDfltClock ≧ EndDfltClock
Hal when TargetDfltClock
fCycle = TargetDfltClock-T
opDfltClock and TargetDfl
tClock-TopDfltClock <EndDf
When ltClock-TargetDfltClock, HalfCycle = EndDfltClo
ck-TargetDfltClock and f
(DfltClock) is f (DfltClock) = (Cos (π × (DfltClock))
Clock-TargetDfltClock) / Ha
lfCycle) +1) / 2 (π represents pi (= 3.141592...)), and the value of each control data within the editing range is set to cosine ( It will be increased or decreased in a (cosine) wavy change shape. In addition,
At the end of the editing range farther from the point designated as the editing reference position of the editing range, “increase / decrease amount = 0”.

(4) On the editing screen, the above-mentioned expression 1
The display line segment of each control data is moved in the vertical direction based on the value obtained by (1).

When transposition data is edited, new transposition data (NoteO
ffset), the corresponding syllable rectangle in the syllable display area 120 is also moved in the vertical direction.

(5) When the reproduction speed is edited, information relating to the time of all performance data at a position subsequent to the edited reproduction speed data is changed accordingly.
The display position on the horizontal axis of the rectangle corresponding to each syllable in the syllable display area 120 is changed, and the display position of the reproduction speed data on the horizontal axis in the data display area 122 is changed. Will be described later in detail.

The display of each syllable is performed at any time during the dragging of the mouse.
Display is performed using k, and when the left mouse button is released and dragging is completed, display is performed using a new Clock edited by dragging. That is, regarding the reproduction speed, while dragging the mouse, only the display position on the vertical axis is changed while the display position on the horizontal axis is maintained, thereby preventing the user from feeling uncomfortable.

[0239] By doing so, only the display position on the vertical axis needs to be changed, so that the load on the CPU for display processing can be reduced, and the syllable redisplay processing can be performed smoothly. it can.

When the user uses the mouse to enter "time ke
When the user clicks on the “ep” column 200 and specifies that the reproduction speed within the edit range is to be edited while maintaining the time at both ends of the edit range, the edit range based on the reproduction speed before the current edit is performed Find the playback time length, then find the playback time length of the edit range based on the playback speed after this editing, and multiply the edited playback speed by dividing the latter by the former to obtain the final playback speed. Then, the reproduction time length of the editing range is made to match before and after editing.

Note that the time length in a range where a certain reproduction speed is valid is represented by “time length = time length before editing / reproduction speed”. The playback time length of the editing range is determined by performing the operation of this equation on each playback speed data of the editing range and accumulating them. Hereinafter, this procedure will be described in detail.

[Processing Procedure Regarding Reproduction Time Length] (I) The editing range and the change shape are determined (the same as the control data editing procedures (1) and (2) described above).

(II) The playback time length of the editing range at the current playback speed is obtained.

(III) Move the cursor icon to one point in the editing range, press the left button of the mouse, and drag vertically (the same as the control data editing procedure (3) described above).

(IV) According to the specified change shape,
The value of each reproduction speed data within the editing range is temporarily changed by an amount corresponding to the drag amount of the mouse (same as the above-described control data editing procedure (3)).

(V) The reproduction time length of the editing range is obtained based on the provisionally changed reproduction speed (calculation similar to the processing procedure (II) regarding the reproduction time length described above is performed).

(VI) The value of the playback speed (Value) is adjusted so that the playback time length of the editing range is kept constant.

(VII) The information on the time of the performance data is changed, and the syllable and the reproduction speed are displayed again (the same as the control data editing procedure (5) described above).

Next, the operation contents of the processing procedure (II) and (V) relating to the above-mentioned reproduction time length will be described with reference to a flowchart of a reproduction time length processing routine showing the operation contents (FIG. 5).
This will be described with reference to FIG.

First, variables used in the processing of the flowchart showing the reproduction time length processing routine shown in FIG. 5 will be described.

[Variables] Data: playback speed data of interest DfltClock [Data]: DfltClock Value of playback speed data of interest [Data]: value of playback speed data of interest (playback speed) PrevDfltClock: attention of DfltClock Integral of the reproduction speed data immediately before the reproduction speed data being reproduced: Cumulative value of the reproduction time TimeRate: Reproduction speed In the processing of the flowchart showing the reproduction time length processing routine shown in FIG. Is initialized (step S502). Specifically, Data is set to the reproduction speed data at the left end of the editing range (Data = reproduction speed data at the left end of the editing range), and PrevDfltClo is set.
ck is set to DfltClock [Data] (Pre
vDfltClock = DfltClock [Dat
a]) and set the Integral to “0” (Integal
gral = 0), and set TimeRate to Value [D
data] (TimeRate = Value [Da
ta]).

When the processing in step S502 is completed, the flow advances to step S504 to accumulate the reproduction time length to obtain an integral value (Integral) of the reproduction time. Specifically, Integral = Integral + (DfltCl
ock [Data] -PrevDfltClock) /
Perform TimeRate operation.

When the processing in step S504 is completed, the flow advances to step S506 to substitute the value of the focused playback speed data for a variable. Specifically, Time
Set Rate to Value [Data] (TimeR
ate = Value [Data]) and PrevDfl
Set tClock to DfltClock [Data] (PrevDfltClock = DfltClock)
[Data]).

When the processing in step S506 ends, the flow advances to step S508 to determine whether or not the reproduction speed data to be processed is the last reproduction speed data in the editing range.

If it is determined in step S508 that the playback speed data to be processed is not the last playback speed data in the editing range, Data is incremented by "1" (step S510).
The next playback speed data is selected as the playback speed data to be processed, and the process returns to step S504 to repeat the process.

On the other hand, if it is determined in step S508 that the playback speed data to be processed is the last playback speed data in the editing range, the process of the flowchart of the playback time length process ends. .

Next, the reproduction time (C
lock) and the change processing of the reproduction duration time (Length) will be described.

That is, when the reproduction speed is edited, the information relating to the time of all the performance data at a position subsequent to the reproduction speed data is changed accordingly. At this time, regarding the syllable data,
k and Length are changed, and Clock is changed for control data. Changed Cl
Based on the ock and the Length, a figure (rectangle) indicating each syllable is redisplayed in the syllable display area 120, and each line segment indicating the reproduction speed data is redisplayed in the data display area 122.

As described above, while the playback speed is set by dragging the mouse, the syllable is displayed at different positions on the horizontal axis, but the playback speed is displayed on the horizontal axis. The display is performed by changing only the position on the vertical axis while keeping the same, and when the dragging of the mouse is completed, the display is performed by changing the position on the horizontal axis of the reproduction speed.

Hereinafter, the processing contents described above will be described in detail with reference to a flowchart of a routine for changing the reproduction time (Clock) and the syllable reproduction duration (Length) accompanying the editing of the reproduction speed shown in FIG. I do.

First, the variables used in the processing of the flowchart of the routine for changing the reproduction time (Clock) and the syllable reproduction duration (Length) accompanying the editing of the reproduction speed shown in FIG. 6 will be described.

[Variable] Prev_TimeRate_Clock: Clock of the immediately preceding reproduction speed data Prev_TimeRate_DfltClock: DfltClock TimeRate of the immediately preceding reproduction speed data: Reproduction speed SylableFLG: Flag indicating whether or not syllable data has been processed “1” is set when data has been processed, and “0” is set when syllable data has not been processed.

Data: Performance data of interest. The leading performance data is indicated by “Data = 0”.

PrevSyl: The immediately preceding syllable data Curt_Length: The time length before editing during the measurement from the immediately preceding syllable data to the performance data of interest Prev_Length: The previously measured time length before editing Prev_DfltLength: The immediately preceding syllable data Time length before data editing Prev_Clock: Clock of previous performance data Prev_Sylable_Clock: Clock of previous syllable data Note that information of performance data specified by Data and PrevSyl is XXX [Data], XXX [Pre].
vSyl].

Here, the routine shown in the flowchart of FIG. 6 is for correcting the information on the time of the performance data in accordance with the change of the reproduction speed. Specifically, from the next performance data at the beginning to the performance data at the end,
Playback time (Clock) and playback duration (Len)
gth).

In the routine shown in the flowchart of FIG. 6, the correction is performed using the corrected playback time of the previous performance data, utilizing the fact that processing is performed sequentially from the previous performance data. Has been made. Through the processing of these routines, note-on, note-off, syllable designation, playback speed designation,
The transmission time such as pitch bend is changed.

More specifically, in the processing of the flowchart shown in FIG. 6, first, variables are initialized (step S602). Specifically, Prev_TimeRat
e_Clock is set to “0” (Prev_TimeR
ate_Clock = 0) and Prev_TimeRa
Set te_DfltClock to “0” (Prev_
TimeRate_DfltClock = 0) and Ti
meRate is set to Value [0], that is, the value of the playback speed data at the beginning (TimeRate =
Value [0]), set SylableFLG to “0” (SylableFLG = 0), and set Da
ta is set to “1” (Data = 1).

When the processing in step S602 is completed, the flow advances to step S604 to correct the reproduction time. The process of correcting the reproduction time in step S604 will be described later in detail with reference to FIG.

Upon completion of the process in step S604, the flow advances to the process in step S606, where the immediately preceding syllable
Performs the process of modifying the data playback duration. The process of correcting the reproduction time of the immediately preceding syllable data in step S606 will be described later in detail with reference to FIGS. 8, 9, 10, and 11.

When the processing in step S606 is completed, the flow advances to step S608 to determine whether or not the performance data to be processed is the final performance data.

If it is determined in step S608 that the performance data to be processed is not the final performance data, Data is incremented by "1" (step S610), and the performance data to be processed is increased. , The next performance data is selected, the process returns to step S604, and the process is repeated.

On the other hand, if it is determined in step S608 that the performance data to be processed is final performance data, final syllable processing is performed (step S612).

Here, in the process of correcting the reproduction duration of the syllable data immediately before in step S606, the process is performed on the syllable data immediately before the performance data of interest as described later. If the performance data of the last syllable exists before the end of the reproduction of the last syllable, the change of the reproduction duration for the last syllable is not completely performed.

Therefore, in the final syllable processing in step S612, it is assumed that there is further performance data after the time when the reproduction of the last syllable ends, and the reproduction duration of the immediately preceding syllable data is corrected in step S606. By performing the same processing, the reproduction duration is corrected for the final syllable.

When the final syllable processing in step S612 is completed, the processing in this flowchart ends.

Next, referring to FIG. 7, step S6 will be described.
The process of correcting the reproduction time in the step 04 will be described.

In the process of correcting the reproduction time in step S604, the fact that “time length after editing = time length before editing / reproduction speed after editing” is used by utilizing the fact that FIG.
As shown in (1), the time length after editing between the performance data of interest indicated by Data and the immediately preceding corrected playback speed data is obtained based on the time before editing of both data and the playback speed therebetween. By adding the corrected reproduction time of the immediately preceding reproduction speed data to this, the reproduction time of the performance data of interest is corrected.

More specifically, the reproduction time (Clock [Da
ta]), Clock [Data] = Prev_TimeRate
_Clock + (DfltClock [Data] -P
rev_TimeRate_DfltClock) / T
It is obtained by performing the operation of imRate.

[0279] Generally, Prev_TimeRa
Time indicated by te_Clock and Prev_TimeRa
Although the time indicated by te_DfltClock does not always match, in order to facilitate understanding, both are shown in agreement in FIG.

Next, FIG. 8, FIG. 9, FIG. 10 and FIG.
The process of correcting the playback duration of the immediately preceding syllable data in step S606 will be described with reference to FIG.

In the process of correcting the playback duration of the immediately preceding syllable data, the PrevSy located immediately before the performance data of interest indicated by Data is
The reproduction duration of the syllable data indicated by l is modified. This processing is performed when the performance data of interest is syllable data or when the performance data of interest is playback speed data. The processing contents differ depending on whether the data is data or reproduction speed data.

If the performance data of interest is neither syllable data nor reproduction speed data, the flow advances to step S608 without performing any processing.

First, in the case where the performance data of interest is the reproduction speed data, the process of correcting the reproduction duration of the immediately preceding syllable data will be described with reference to the flowchart shown in FIG. I will explain it.

In the flowchart shown in FIG. 8, it is first determined whether or not the first syllable has been processed, that is, whether or not “1” or “0” has been set in SylableFLG. (Step S802).

In the determination processing in step S802, the first syllable has been processed, that is, Syll
If it is determined that “1” has been set in “ableFLG”, the process proceeds to step S804, and the pre-editing time length measured up to the previous time is stored. That is, Prev_
Set Curt_Length to Length (Pre
v_Length = Curt_Length).

Next, the time length before editing from the immediately preceding syllable data to the performance data of interest is measured (step S806).

Specifically, the time length before editing (Curt_Length) during measurement from the immediately preceding syllable data to the performance data of interest is as follows: Curt_Length = Prev_Length +
(Clock [Data] -Prev_Clock) ×
It is obtained by performing TimeRate operation.

The processing of measuring the length of time before editing from the immediately preceding syllable data to the performance data of interest in step S806 will be described later with reference to FIG.

When the processing in step S806 is completed, the flow advances to step S808 in which the measured time length before editing is equal to or greater than the time length of the immediately preceding syllable data before editing. It is determined whether or not there is. That is, “Curt_Length ≧ Prev_Le”
ngth ”.

In the determination processing in step S808, the measured length of the time length before editing is equal to or longer than the length of the immediately preceding syllable data before editing, ie,
"Curt_Length≥Prev_Length"
If it is determined that the syllable data has been edited, the process proceeds to step S810, and the time length of the reproduction duration after the editing of the immediately preceding syllable data is obtained.

More specifically, the reproduction duration (Length [PrevSy] after editing the immediately preceding syllable data)
l]) is Length [PrevSyl] = (Prev_Clo)
ck-Prev_Sylable_Clock) +
(Prev_DfltLength-Prev_Len
gth) / TimeRate.

When the processing in step S810 is completed, the flow advances to step S812.

On the other hand, in the judgment processing in step S808, the measured length of the time length before editing is not longer than the length of the immediately preceding syllable data before editing, ie,
"Curt_Length≥Prev_Length"
If it is determined that it is not, step S81 is performed as it is.
Proceed to step 2.

Also, in the judgment processing of step S802, the first syllable has not been processed, that is, Syll
If it is determined that “0” is set in the ableFLG, the process jumps to the process of step S812 and proceeds.

Here, in the processing of step S812, the value of the reproduction speed data of interest is substituted for a variable. Specifically, Clock is added to Prev_Clock.
[Data] is substituted (Prev_Clock = Cloc)
k [Data]) and set TimeRa in TimeRate.
Substitute te_Value [Data] (TimeRat
e = TimeRate_Value [Data]),
Clock to Prev_TimeRate_Clock
Substitute [Data] (Prev_TimeRate_C
lock = Clock [Data]) and Prev_T
DfltClo to imRate_DfltClock
Substitute ck [Data] (Prev_TimeRate)
_DfltClock = DfltClock [Dat
a]).

When the processing in step S812 is completed, the processing for correcting the reproduction duration of the immediately preceding syllable data ends.

Next, referring to FIG. 9, step S8 will be described.
The process of measuring the time length before editing from the syllable data immediately before to the performance data of interest in 06 will be described.

In the process of measuring the length of time before editing from the immediately preceding syllable data to the performance data of interest in step S806, “time length before editing = time length after editing × reproduction speed” Utilizing that,
As shown in FIG. 9, the time length before editing between the performance data of interest indicated by Data and the immediately preceding performance data is obtained based on the time after editing of both data and the reproduction speed therebetween. The previous syllable is obtained by adding the length of time before the editing measured up to the previous time to this. It measures the length of time before editing from the data to the performance data of interest.

Then, “Curt_Length ≧ Pr”
In the case of “ev_DfltLength”, it indicates that the end of the immediately preceding syllable is before the performance data of interest, and the reproduction duration of the immediately preceding syllable after editing can be determined.

On the other hand, “Curt_Length ≧ Pre
If it is not “v_DfltLength”, it indicates that the end of the immediately preceding syllable is after the performance data of interest, and the reproduction duration of the immediately preceding syllable after editing cannot be determined yet.

Next, in the case where the performance data of interest is syllable data, the process of correcting the reproduction duration of the immediately preceding syllable data will be described with reference to the flowchart shown in FIG. explain.

In the flowchart shown in FIG. 10, first, it is determined whether or not the first syllable has been processed, that is, whether or not “1” is set in SylableFLG or “0” is set. (Step S1002).

In the determination processing in step S1002, the first syllable has been processed, that is, Syll
If it is determined that “1” has been set in “ableFLG”, the process proceeds to step S1004, and the time length before editing measured up to the previous time is stored. That is, Prev
Set Curt_Length to _Length (Pr
ev_Length = Curt_Length).

Next, the length of time before editing from the immediately preceding syllable data to the performance data of interest is measured (step S1006).

More specifically, the time length before measurement (Curt_Length) during measurement from the immediately preceding syllable data to the performance data of interest is as follows: Curt_Length = Prev_Length +
(Clock [Data] -Prev_Clock) ×
It is obtained by performing TimeRate operation.

The process of measuring the time length before editing from the immediately preceding syllable data to the performance data of interest in step S1006 is as described above with reference to FIG.

When the processing in step S1006 is completed, the flow advances to step S1008 in which the measured time length before editing is equal to or greater than the time length of the immediately preceding syllable data before editing. It is determined whether or not there is. That is, “Curt_Length ≧ Prev_
It is determined whether or not “Length”.

In the determination processing in step S1008, the measured time length before editing is not greater than or equal to the time length before editing of the immediately preceding syllable data, ie,
"Curt_Length≥Prev_Length"
If it is determined that the syllable data has not been edited, the process proceeds to step S1010, and the time length of the reproduction duration after editing of the immediately preceding syllable data is obtained.

[0309] Specifically, the reproduction duration (Length [PrevSy] after editing the immediately preceding syllable data)
l]) is Length [PrevSyl] = Clock [Dat
a] −Prev_Sylable_Clock.

When the processing in step S1010 is completed, the flow advances to step S1016.

[0311] The process of obtaining the duration of the reproduction duration after editing of the immediately preceding syllable data in step S1010 will be described later with reference to FIG.

On the other hand, in the determination processing in step S1008, the length of the measured time length before editing is equal to or longer than the length of the immediately preceding syllable data before editing, ie,
"Curt_Length≥Prev_Length"
If it is determined that is, the process proceeds to step S1012.

In the process of step S1012, a process of calculating the time length of the reproduction duration after editing of the immediately preceding syllable data is performed.

Specifically, the reproduction duration (Length [PrevSy] after editing the immediately preceding syllable data)
l]) is Length [PrevSyl] = (Prev_Clo)
ck-Prev_Sylable_Clock) +
(Prev_DfltLength-Prev_Len
gth) / TimeRate.

When the processing in step S1012 is completed, the flow advances to step S1016.

Also, in the determination processing of step S1002, the first syllable has not been processed, ie, Syl
If it is determined that “0” is set in the variable “FLAG”, the process proceeds to step S1014, and Syl
“1” is set in the variable “FLAG”.

When the processing in step S1014 is completed, the flow advances to step S1016.

Here, in the process of step S1016, the value of the syllable data of interest is assigned to a variable. Specifically, Clock is added to Prev_Clock.
[Data] is substituted (Prev_Clock = Cloc)
k [Data]) and Prev_Sylable_C
Clock [Data] is substituted for lock (Prev_
Sylable_Clock = Clock [Dat
a]) and Dflt is added to Prev_DfltLength.
Substitute Length [Data] (Prev_Dflt
Length = DfltLength [Data])
Then, assign “0” to Curt_Length (Curt_Length).
_Length = 0), and assigns Data to PrevSyl (PrevSyl = Data).

When the processing in step S1016 ends, the flowchart of the processing for correcting the reproduction duration of the immediately preceding syllable data ends.

Next, referring to FIG.
The process of 1010 for obtaining the length of the reproduction duration after editing the immediately preceding syllable data will be described.

Here, when the performance data of interest is syllable data, “Curt_Length ≧
If it is not “Prev_DfltLength”, it means that when the playback time of the syllable is editable, the playback start time of the next syllable is reached during the playback of the previous syllable. Therefore, in this case, the reproduction duration of the previous syllable is corrected so that the reproduction of the previous syllable is stopped when the reproduction start time of the next syllable comes.

As described above, in the above-described embodiment, the user can set pitch bend data, transpose data, and reproduction speed data at an arbitrary position on the time axis by operating the mouse. It has become. The pitch bend data and the transpose data are information indicating the state of temporal control of the pitch, and the reproduction speed data is information indicating the state of temporal control of the reproduction speed of the audio waveform. The pitch and reproduction speed of the audio waveform reproduced by the sound source device are controlled by the MIDI signal output to the sound source device based on these data.

The pitch bend data and transpose data do not absolutely specify the pitch but rather specify the pitch relatively. In the tone generator, the pitch originally contained in the audio waveform is not specified. The audio waveform is reproduced according to the pitch vent data and the transpose data. The playback speed data does not absolutely specify the playback time and playback duration of the audio waveform, but rather specifies the playback time and playback duration of the audio waveform. The audio waveform is reproduced according to the speed data. That is, the user sets data for relatively designating the reproduction mode of the audio waveform.

[0324] In the above-described embodiment, DfltValue and SylblOrigkey of pitch bend data are stored as information indicating a temporal change of the pitch of the audio waveform.

Then, in the edit screen for pitch bend data or transpose data,
By selecting “ol”, the value of the pitch bend data set by the user and the contents of the transpose data (NoteOffset) are displayed.
By selecting "result" on the edit screen,
DfltValue and Val of pitch vent data
Based on ue or SylblOrigkey and the transpose data (NoteOffset), the pitch at which the audio waveform controlled by the data set by the user is reproduced is displayed.

Similarly, DfltCl of syllable data
Information about the original playback time and playback duration of each syllable of the audio waveform is stored by ock and DfltLength.

[0327] By selecting "control" on the reproduction speed data edit screen, the contents of the reproduction speed data (Value) set by the user are displayed. In the syllable display area 120, DfltClock is displayed.
Based on Clock and Length, in which k and DfltLength are data changed by the playback speed data, the playback time and playback duration of the audio waveform controlled by the data set by the user are displayed. .

In the above-described embodiment, the information on the time of the syllable data, the pitch bend data, and the time of the reproduction speed data is changed according to the reproduction speed data. Therefore, the playback speed of the audio waveform is not only controlled by the playback speed data, but also
On, note off, pitch bend, syllable number,
The time at which the playback speed designation is output to the sound source device is also controlled by the playback speed data.

Note that the above-described embodiment may be appropriately modified as described below.

(1) In the above embodiment,
When the reproduction speed data is edited, the same processing is performed on all performance data.

However, it is not necessary to correct the playback time (Clock) for the performance data located before the edited playback speed data, and the playback speed data immediately after the edited playback speed data is not necessary. The playback time (Clock) for the performance data located after
Need only be increased or decreased by the same value uniformly, and it is not necessary to modify the reproduction duration (Length) for syllable data located after the reproduction speed data immediately after the edited reproduction speed data. Therefore, the processing contents of these performance data may be simplified by changing the correction procedure.

(2) In the above embodiment,
The reproduction timing of each performance data is represented by a reproduction time (Clock) indicating an elapsed time from the start of reproduction of the performance data sequence.
However, the present invention is not limited to this. The timing at which each piece of performance data is reproduced may be managed based on time information indicating the time interval between each piece of performance data.

In the above embodiment, the reproduction duration (Length) is included in the syllable data.
Although one syllable data manages both the note-on timing and the note-off timing, the present invention is not limited to this, and syllable data indicating note-on and note-off is indicated. The syllable data may be stored separately.

In short, as long as the timing of each data can be managed, any time management method may be adopted.

(3) In the above embodiment,
By modifying the reproduction time (Clock) and the reproduction duration (Length) with the editing of the reproduction speed, the timing at which each MIDI signal is output by reproducing the performance data sequence is changed. However, when the reproduction speed is regarded as information indicating a change with respect to the tempo, such a process need not be performed.

That is, when the performance data sequence is reproduced, the time length of one tick is changed based on the reproduced reproduction speed data, that is, the time for executing the reproduction process of the performance data shown in FIG. The interval may be changed.

In the above-described embodiment, only one audio waveform is reproduced at the same time. However, the present invention can be applied to a case where a plurality of audio waveforms are reproduced at the same time. In this case, the playback speed may be controlled commonly for all audio waveforms,
A performance data sequence may be separately created for each audio waveform, and the playback speed may be controlled independently for each audio waveform. In the latter case, when adopting a processing method in which the reproduction speed is regarded as information indicating a change with respect to the tempo, the reproduction processing of the performance data shown in FIG. 4 is executed at different time intervals for each audio waveform.

Even in this case, the output timing of each MIDI signal is changed.

However, in this case, when the graphic corresponding to each syllable is displayed on the time axis, the timing at which each syllable is reproduced and the timing at which each syllable is reproduced are determined by the same processing as described in the above embodiment. You need to find and display the playback duration.

In short, as the playback speed is edited, each M
Any processing method may be adopted as long as the timing at which the IDI signal is output is changed.

(4) In the above embodiment,
Although the audio waveform is composed of a plurality of continuous sounds, the present invention is not limited to this. The audio waveform only needs to be composed of a plurality of sounds. They need not necessarily be continuous. For example, a set of a plurality of independent sounds can be used as an audio waveform.

(5) In the above embodiment,
The case where pitch is mainly taken up as a characteristic of the audio waveform and the pitch of the audio waveform is controlled has been described,
The present invention is not limited to this, and may control the volume, frequency characteristics (formant, filter cutoff frequency, and the like) in addition to the pitch.

(6) In the above embodiment,
Although the result obtained by adding the original value of the audio waveform and the control value for the audio waveform is displayed, the present invention is not limited to this, and the result of multiplication of the two may be displayed.

(7) In the above embodiment,
Control data whose control value is a predetermined value before the editing is put in the performance data string, and the control value is changed according to the editing instruction.However, the present invention is not limited to this. At this time, the control data of the control value corresponding to the instruction may be entered in the performance data string.

(8) In the above embodiment,
When editing control data, the value of each control data within the editing range is changed according to the change shape selected by the user.
The data is changed according to the value obtained by DfltClock, but the present invention is not limited to this. For control data other than reproduction speed data, each control data is changed according to the change shape selected by the user. It may be changed according to a value obtained by Clock.

After editing the playback speed, DfltCl
Since “ock” is shifted from the actual position on the time axis when the waveform data is reproduced, “Value” is set by DfltClock.
Is changed, for example, even if the value of Value is intended to be increased linearly in the traveling direction on the time axis, the value does not actually change linearly. When the value is changed, the value changes linearly, and editing can be performed with a more preferable feeling.

(9) In the above embodiment,
When one syllable is being reproduced and another syllable is reproduced by a NoteOffset different from the NoteOffset of the syllable being reproduced, a note-on (sound generation start instruction) is transmitted to the sound source device 12. However, the present invention is not limited to this, and a signal for changing the pitch other than note-on may be transmitted. In this case, for a series of consecutive syllables, note-on is transmitted only at the beginning of the first syllable, and note-off is transmitted only at the end of the last syllable.

(10) In the above-described embodiment, the application programs running on the computer 10
Program (automatic performance application program)
However, the present invention is not limited to this, and the present invention may be implemented on a dedicated device. Also,
The dedicated device may include a sound source portion.

The storage medium on which the application program is stored is not limited to a CD-ROM, but may be a semiconductor memory or a magnetic disk.

Also, the application program is:
In addition to those directly read into the computer 10 from the storage medium, those read into the computer 10 from the storage medium via a communication line such as the Internet may be used.

(11) The waveform-related data output from the sound source device 12 to the automatic performance application program is not limited to the data disclosed in the above embodiment, but may be other than the data disclosed in the above embodiment. Things.

For example, the waveform-related data output from the sound source device 12 is converted into S data used in a general automatic performance.
MF (Standard MIDI File) format can be used.

However, in this case, the start position and the stop position on the time axis of each syllable are represented as a note-on event and a note-off event, and each pitch variation value is represented as a pitch bend event. , The original key, the tempo and the string are represented as specific meta-events. In the note numbers of the note-on event and the note-off event, the value of the syllable original key of the syllable corresponding to the event is set. Each event is attached with time information indicating the time interval between the immediately preceding event and the event in ticks.

Note that the note-on event, note-
As for the off event and the pitch bend event, the timing of the event is obtained from the address corresponding to the event in the audio waveform data, and the above-described time information is obtained from the timing based on the tempo. The event indicating the original key and the tempo is placed at the beginning of the SMF data, and the event indicating the character string is defined between the note-on event of the corresponding syllable and the note-on event of the syllable immediately after it. Place it at an appropriate location (eg, immediately after the corresponding syllable note-on event).

The automatic performance application program creates performance data based on the SMF format waveform-related data. In this case, the time of each event is obtained by accumulating the time information indicating the time interval between each event, and the time corresponding to the note-on event and the corresponding note-off event are determined based on the time interval. Ask for the playback duration of the syllable you want to play. Also, control data indicating a character string is created in the performance data based on the event of the character string, and a note-on event immediately before the control data indicating the character string is displayed on the performance data edit screen. The syllable corresponding to the character string is determined, and character display based on the character string is performed in a rectangle indicating the corresponding syllable on the editing screen.

(12) In the above embodiment, the editing range is specified regardless of the playback time of each syllable. In addition, the editing range is specified in relation to the playback time of each syllable. It may be specified.

For example, when the editing range is specified in the data display area, the editing range can be specified irrespective of the reproduction time of each syllable as described in the above embodiment, and the editing range can be specified in the syllable display area. When the editing range is designated, the reproduction start time of an arbitrary syllable or the reproduction end time of an arbitrary syllable is set as the time at both ends of the editing range. In this case, it is possible to easily designate a range from the beginning of an arbitrary syllable to the end of an arbitrary syllable as an editing range.

(13) In the above embodiment, while editing the reproduction speed by dragging the mouse, Clocks are obtained for all types of performance data, and rectangles corresponding to each syllable in the syllable display area 120 are obtained. Is displayed again, but the clock may be obtained only for the syllable data and the reproduction speed data, and the redisplay may be performed. In this case, the load of the process for obtaining the Clock is reduced, and the redisplay can be performed more smoothly.

(14) In the above embodiment, when editing the reproduction speed data, the control
Although the value, the original value, and the result value can be displayed, only the control value is significant for the reproduction speed data. Therefore, when editing the reproduction speed data, only the control value may be displayed.

(15) In the above embodiment, when editing the transpose data,
Although the roll value, the original value, and the result value can be displayed, the same value is displayed in the syllable display area 120 for the result value. Therefore, the result value is not displayed when editing the transposition data. It may be.

(16) In the above-described embodiment, the data itself set by the user is stored as the performance data for the pitch bend data and the transpose data.
The calculation result of the data set by the user and other data may be stored.

For example, regarding pitch bend data, instead of Value set by the user,
The sum of the value of Value and the value of DfltValue, that is, data indicating how the audio waveform is finally reproduced is stored. In this case, when control is selected on the edit screen, the difference obtained by subtracting the value of DfltValue from the stored sum is displayed, and when result is selected on the edit screen, the stored sum is displayed. Display and memorize sum D
The difference obtained by subtracting the value of fltValue is used as the pitch bend
Output to the sound source as data.

For example, regarding the transpose data, NoteOffs set by the user
Note, instead of the value of NoteOffset and Sylbl
The sum with the value of OrigKey, that is, data indicating how the audio waveform is finally reproduced is stored. In this case, when control is selected on the edit screen, Sylbl is calculated from the stored sum.
The difference obtained by subtracting the value of OrigKey is displayed. When result is selected on the edit screen, the stored sum is displayed. From the stored sum, SylblOri is displayed.
A note-on and a note-off with the sum of the difference obtained by subtracting the value of gKey and the value of the original key as the note number are output to the sound source.

Alternatively, regarding the transpose data, instead of the NoteOffset set by the user, the sum of the value of the NoteOffset and the value of the original key, that is, the note, which is finally output to the sound source,
Data indicating on / off note numbers is stored. In this case, on the edit screen
When "ol" is selected, the difference obtained by subtracting the value of the original key from the stored sum is displayed. When "result" is selected on the edit screen, the value of the original key is subtracted from the stored sum. And the difference is Syl
The sum obtained by adding the blOrigKey is displayed, and note-on and note-off using the stored sum as a note number are output to the sound source.

That is, it is not necessary to store the data itself set by the user, and other data that can reproduce the set data later may be stored.

(17) In the above-described embodiment, all the reproduction speed values are set to “1” before editing. However, the reproduction speed is already set and the reproduction speed value becomes Regarding the performance data string that is not "1",
Editing may be performed again.

In this case, the value of the reproduction speed that has been set is stored as DfltValue of the reproduction speed data, the newly set reproduction speed is stored as the Value of the reproduction speed data, and the product of the two is finally stored. Playback speed data.

Alternatively, the previously set reproduction speed value is stored as DfltValue of the reproduction speed data, and the product of the already set reproduction speed value and the newly set reproduction speed is stored.

In the latter case, the product of the stored playback speed value and the newly set playback speed is used as the final playback speed.

Also, by subtracting DfltValue from the stored final reproduction speed, a newly set reproduction speed can be obtained.

[0371]

Since the present invention is configured as described above, sound source means storing audio waveforms (note that the sound source means is realized by, for example, an individual device or a general-purpose computer). Automatic performance means for supplying various instructions based on performance data as information indicating arbitrary control relating to reproduction of the audio waveform (the automatic performance means is realized by, for example, an individual device or a general-purpose computer). )), The user is notified of the appearance of the audio waveform reproduced from the sound source means, so that the performance data of the user, that is, information indicating arbitrary control relating to the reproduction of the audio waveform is displayed. Audio waveform processing method, audio waveform processing apparatus, and audio waveform processing apparatus capable of facilitating editing work The present invention can provide a computer-readable recording medium on which a program of an audio waveform processing method is recorded, and can meet various demands of the related art, and can solve various problems of the related art. It has an excellent effect that the point can be solved.

[Brief description of the drawings]

FIG. 1 shows a basic configuration of hardware for implementing an audio waveform processing method according to the present invention.

FIG. 2 is a flowchart illustrating a processing routine when a MIDI signal is input to a tone generator.

FIGS. 3A and 3B graphically show performance data constituting a performance data string used in the present invention, and FIG. 3A graphically shows the format of performance data;
(B) graphically shows the format of syllable data in the performance data, and (c) graphically shows the format of control data in the performance data.

FIG. 4 is a flowchart showing a routine of performance data reproduction processing.

FIG. 5 is a flowchart showing a routine of a reproduction time length process.

FIG. 6 is a reproduction time (Clock) accompanying the editing of the reproduction speed.
15 is a flowchart of a routine showing a process of changing a syllable reproduction duration (Length).

FIG. 7 is an explanatory diagram of a process of correcting the reproduction duration of the immediately preceding syllable data.

FIG. 8 is a flowchart of a routine showing a process of correcting the reproduction duration of the immediately preceding syllable data when the performance data of interest is reproduction speed data.

FIG. 9 is an explanatory diagram of a process of measuring the length of time before editing from the immediately preceding syllable data to the performance data of interest.

FIG. 10 is a flowchart of a routine showing a process of correcting the reproduction duration of the immediately preceding syllable data when the performance data of interest is syllable data.

FIG. 11 is an explanatory diagram of a process for obtaining a time length of a reproduction duration time after editing of immediately preceding syllable data.

FIG. 12 is an explanatory diagram of an editing screen in a state where a box 108 is opened to select data to be edited. In addition,
Syllable display area 120 and data display area 122
Are the same as those shown in FIG.

FIG. 13 shows a control data value (control) and an edit result (re) for pitch bend data.
FIG. 10 is an explanatory diagram of an editing screen in a state where “sult” is displayed in the data display area 122. Note that the change shape of the control data value is a horizontal linear change shape (consta.
nat) is selected.

14 is an explanatory diagram of the editing screen in a state where the editing range is highlighted by designating the editing range by operating a mouse on the editing screen shown in FIG. 13;

FIG. 15 shows an editing result (r) on the editing screen shown in FIG. 14;
result), that is, the control
FIG. 9 is an explanatory diagram of an editing screen in a state where only a data value (control) is displayed.

FIG. 16 shows only the control data value (control) for pitch bend data, specifies the edit range by operating the mouse, highlights the edit range, and furthermore, performs a mouse drag operation ( FIG. 16 is an explanatory diagram of the editing screen in a state in which the value of the control data is changed in a horizontal linear change shape (constanat) by dragging the mouse.)

FIG. 17 shows a control data value (contr) when the mouse is dropped from the state shown in FIG. 16;
ol) and an editing result (result) are displayed on the data display area 122 in the editing screen.

FIG. 18 shows only the control data value (control) for pitch bend data, designates an edit range by operating the mouse, highlights the edit range, and further performs a mouse drag operation ( FIG. 18 is an explanatory diagram of an editing screen in which the value of control data is changed in a triangular wave change shape (liner) by dragging the mouse.

FIG. 19 shows only the control data value (control) with respect to pitch bend data, designates an edit range by operating a mouse, highlights the edit range, and further performs a mouse drag operation ( The state shown in FIG. 19 indicates that the mouse is being dragged.), The value of the control data is changed to the change shape (cosin) of the cosine wave.
It is explanatory drawing of the edit screen of the state changed in e).

FIG. 20 shows the transpose data value (Transpose), that is, the syllable pitch and the control data value (co).
(control) is displayed in the data display area 122, and the editing range is highlighted by designating the editing range by operating the mouse. Note that a horizontal linear change shape (constanat) is selected as the change shape of the value of the control data.

FIG. 21 shows the transposition data value (Transpose), ie, the syllable pitch without displaying the control data value (control) on the editing screen shown in FIG. FIG. 22 is an explanatory diagram of an editing screen in a state where the value of control data is changed in a horizontal linear change shape (constanat) by a drag operation (the state shown in FIG. 21 indicates that the mouse is being dragged).

FIG. 22 shows a state where the mouse is dropped from the state shown in FIG.
ol) and an editing result (result) are displayed on the data display area 122 in the editing screen.

FIG. 23 shows an editing screen in which the value (control) of control data is displayed in the data display area 122 with respect to the reproduction speed data, and the editing range is highlighted by designating the editing range by operating the mouse. FIG. Note that the change shape of the control data value is a horizontal linear change shape (consta.
nat) is selected.

24. In the editing screen shown in FIG. 23, the value of the control data is changed into a horizontal linear change shape (constanat) by a mouse drag operation (the state shown in FIG. 21 indicates that the mouse is being dragged). It is explanatory drawing of the edit screen of the state changed in FIG.

FIG. 25 shows a control data value (contr) in a state where the mouse is dropped from the state shown in FIG. 24;
ol) is an explanatory diagram of the editing screen in a state where the editing screen is displayed in the data display area 122.

FIG. 26 shows the value (control) of control data in the data display area 122 with respect to the reproduction speed data, and specifies the edit range by operating the mouse to highlight the edit range; FIG. 27 is an explanatory diagram of an editing screen in a state in which the value of control data is changed in a triangular wave shape (liner) by a drag operation (the state shown in FIG. 26 indicates that the mouse is being dragged).

FIG. 27 shows a control data value (contr) when the mouse is dropped from the state shown in FIG. 26;
ol) is an explanatory diagram of the editing screen in a state where the editing screen is displayed in the data display area 122.

FIG. 28 shows the value (control) of the control data in the data display area 122 with respect to the reproduction speed data, and designates the edit range by operating the mouse to highlight the edit range; FIG. 28 is an explanatory diagram of an editing screen in a state in which the value of control data is changed in a cosine (cosine) wavy change shape (cosine) by a drag operation (the state shown in FIG. 28 indicates that the mouse is being dragged). It is.

FIG. 29 is a diagram showing a state in which the mouse is dropped from the state shown in FIG. 28;
ol) is an explanatory diagram of the editing screen in a state where the editing screen is displayed in the data display area 122.

FIG. 30 shows the value of the control data (control) in the data display area 122 with respect to the reproduction speed data, and designates an editing range in which both ends are fixed by operating the mouse after clicking a “time keep” column 200 It is an explanatory view of an edit screen in a state where the edit range is highlighted. Note that, as the change shape of the control data value, a triangular wave change shape (liner) is selected.

FIG. 31 shows that the value of the control data is changed into a triangular wave-like change shape (line) by a mouse drag operation (the state shown in FIG.
It is explanatory drawing of the edit screen of the state changed in r).

FIG. 32 shows a state where the mouse is dropped from the state shown in FIG.
ol) is an explanatory diagram of the editing screen in a state where the editing screen is displayed in the data display area 122.

[Explanation of symbols]

 Reference Signs List 10 computer 12 sound source device 120 syllable display area 122 data display area

Continued on the front page F term (reference) 5D045 AA08 5D082 AA04 AA06 5D378 AD21 AD35 BB22 FF12 FF17 FF19 FF22 FF24 KK15 MM12 MM16 MM47 MM49 MM63 MM65 MM66 MM68 MM93 TT03 TT09 TT13 TT19 TT19 TT14 TT14 TT14 KK43

Claims (11)

[Claims] 1. An audio waveform processing method in an automatic performance means for instructing a sound source means storing an audio waveform to control the reproduction of the audio waveform with time, wherein the audio waveform processing means has a predetermined characteristic of the audio waveform stored in the sound source means. A first process of storing information indicating a state of a change with time, and a second process of inputting an instruction for arbitrary relative control of a predetermined characteristic of an audio waveform at an arbitrary position on a time axis by a user. In response to the user's instruction to perform any relative control on a predetermined characteristic of the audio waveform at an arbitrary position on the time axis in the second processing, the specified relative control is performed by the audio waveform. Stores information indicating how the control over time for a given characteristic of the audio waveform is effective at the position on the time axis. A third process, information indicating a temporal change of a predetermined characteristic of the audio waveform stored in the first process, and relative information with respect to the predetermined characteristic of the audio waveform input in the second process. A fourth process of displaying a temporal change when the predetermined characteristic of the audio waveform is controlled based on the relative control instruction by the user in the second process based on the control instruction; Outputting an instruction to control the predetermined characteristic of the audio waveform to the sound source means in accordance with the lapse of time based on the information indicating the state of the control over the predetermined characteristic of the audio waveform over time stored in the third processing. And a fifth processing. 2. The audio waveform processing method according to claim 1, wherein in the second processing, the user gives an arbitrary relative control instruction for a predetermined characteristic of the audio waveform at an arbitrary position on a time axis, and the instruction is a time. An arbitrary range on the axis and an arbitrary increase / decrease amount are designated. The information indicating the state of the temporal control stored in the third processing is the relative control of the user in the second processing. An audio waveform processing method in which, in response to an instruction, a value of information in a range specified by the instruction is increased or decreased according to a predetermined change shape, based on an increase or decrease amount specified by the instruction. 3. An audio waveform processing method in an automatic performance means for instructing a sound source means storing an audio waveform to control the reproduction of the audio waveform over time, comprising a plurality of sounds stored in the sound source means. First processing for storing information indicating a position on the time axis at which each sound of the audio waveform to be reproduced is reproduced, and inputting an arbitrary control instruction for a reproduction speed of the audio waveform at an arbitrary position on the time axis by the user A second process to be performed, and in response to a user's instruction for arbitrary control on a reproduction speed of the audio waveform at an arbitrary position on the time axis in the second process, the designated control is performed by the instruction of the audio waveform. Information indicating how the audio waveform playback speed is controlled over time so that it is effective at the position on the time axis A third process to store, information indicating a position on a time axis at which each sound of the audio waveform stored in the first process is reproduced, and an arbitrary value for a reproduction speed of the audio waveform input in the second process. The position on the time axis at which each sound of the audio waveform is reproduced when the reproduction speed of the audio waveform is controlled based on the control instruction by the user in the second process based on the control instruction And performing a control instruction on the reproduction speed of the audio waveform in accordance with the passage of time on the basis of the information indicating the temporal control of the reproduction speed of the audio waveform stored in the third process. And a fifth process for outputting to the means. 4. The audio waveform processing method according to claim 3, further comprising: storing a position on a time axis at which a control instruction for a predetermined reproduction mode of the audio waveform stored in the sound source unit is output. And the position on the time axis at which the control instruction for the predetermined reproduction mode stored in the sixth process is output to the second axis.
And a seventh processing of changing the control instruction to the sound source means at a changed position on the time axis as time elapses, based on a change control instruction issued by a user in the processing of step (a). 5. The audio waveform processing method according to claim 3, wherein, in the second processing, the user instructs the arbitrary change control on the reproduction speed of the audio waveform at an arbitrary position on the time axis. The information indicating the temporal control of the reproduction speed of the audio waveform stored in the third processing is specified by the user in the second processing. An audio waveform processing method in which a value of information in a range specified by an instruction is increased or decreased in accordance with a predetermined change shape based on an increase or decrease amount specified by the instruction in response to an instruction of a change control for a reproduction speed. 6. An audio waveform processing device in an automatic performance means for instructing a sound source means storing an audio waveform with time-dependent control regarding reproduction of the audio waveform, wherein the audio waveform processing device has a predetermined characteristic of the audio waveform stored in the sound source means. First storage means for storing information indicating a state of change over time; input means for inputting an instruction for arbitrary relative control of a predetermined characteristic of an audio waveform at an arbitrary position on a time axis by a user; In response to an instruction of an arbitrary relative control for a predetermined characteristic of the audio waveform at an arbitrary position on the time axis inputted by the user by the input means, the designated relative control is performed by the instruction of the audio waveform. Information showing how a predetermined characteristic of an audio waveform is controlled over time so as to be effective at a position on the time axis. A second storage unit for storing information, information indicating a state of a predetermined characteristic of the audio waveform stored in the first storage unit over time, and a predetermined value of the audio waveform input by the input unit. A state of a temporal change when a predetermined characteristic of an audio waveform is controlled based on a relative control instruction by a user input to the input means is displayed based on the relative control instruction for the characteristic. Display means for performing, based on information indicating a state of control over time of a predetermined characteristic of an audio waveform stored in the second storage means, instructs control of the predetermined characteristic of the audio waveform over time. An audio waveform processing device having an output unit for outputting to the sound source unit. 7. The audio waveform processing apparatus according to claim 6, wherein the user inputs an instruction for a relative control on a predetermined characteristic of an audio waveform at an arbitrary position on a time axis, which is input by the input unit, The information indicating an arbitrary range on the time axis and an arbitrary increase / decrease amount is stored in the second storage means, and the information indicating the state of the temporal control is stored in the second storage means. An audio waveform processing apparatus which increases or decreases the value of information in a range specified by an instruction in accordance with a predetermined change shape, based on an increase or decrease amount specified by the instruction, in response to an instruction of dynamic control. 8. An audio waveform processing device in an automatic performance means for instructing a sound source means storing an audio waveform to perform temporal control on reproduction of the audio waveform, comprising: a plurality of sounds stored in the sound source means. First storage means for storing information indicating a position on the time axis at which each sound of the audio waveform to be reproduced is reproduced, and an instruction by the user for an arbitrary control on a reproduction speed of the audio waveform at an arbitrary position on the time axis. Input means for inputting, and in response to a user's instruction to control the reproduction speed of the audio waveform at an arbitrary position on the time axis input by the input means, the designated control is instructed by the audio waveform. Shows how the audio waveform playback speed is controlled over time so that it is effective at the position on the time axis Second storage means for storing information, information indicating a position on a time axis at which each sound of the audio waveform stored in the first storage means is reproduced, and information of the audio waveform input by the input means. A time axis on which each sound of the audio waveform is reproduced when the reproduction speed of the audio waveform is controlled based on a user's control instruction input by the input means based on an arbitrary control instruction on the reproduction speed. Display means for displaying an upper position, and control over the reproduction speed of the audio waveform in accordance with the passage of time, based on information indicating the state of temporal control over the reproduction speed of the audio waveform stored in the second storage means. Output means for outputting the instruction to the sound source means. 9. The audio waveform processing apparatus according to claim 8, further comprising: a position on a time axis at which a control instruction for a predetermined reproduction mode of the audio waveform stored in said sound source means is output. And a position on the time axis at which the control instruction for the predetermined reproduction mode stored in the third storage unit is output, based on the user's change control instruction input by the input unit. An audio waveform processing apparatus comprising: a second output unit that outputs the control instruction to the sound source unit at a changed position on the time axis as time passes. 10. The audio waveform processing apparatus according to claim 8, wherein the user's instruction to change the reproduction speed of the audio waveform at an arbitrary position on the time axis input by the input means is a time axis. The above-mentioned arbitrary range and an arbitrary increase / decrease amount are designated, and information indicating a state of temporal control over the reproduction speed of the audio waveform stored in the second storage means is input by the input means. In response to a user's instruction to change the playback speed, an audio waveform that is obtained by increasing or decreasing the value of information in a range specified by the instruction according to a predetermined change shape based on the increase or decrease amount specified by the instruction. Processing equipment. 11. A computer-readable recording medium on which a program for the audio waveform processing method according to claim 1, 2, 3, 4, or 5 is recorded.