TWI769498B - How to change the action as the music transitions - Google Patents
How to change the action as the music transitions Download PDFInfo
- Publication number
- TWI769498B TWI769498B TW109127968A TW109127968A TWI769498B TW I769498 B TWI769498 B TW I769498B TW 109127968 A TW109127968 A TW 109127968A TW 109127968 A TW109127968 A TW 109127968A TW I769498 B TWI769498 B TW I769498B
- Authority
- TW
- Taiwan
- Prior art keywords
- action
- rhythm
- music
- sound signal
- signal
- Prior art date
Links
- 230000009471 action Effects 0.000 title claims abstract description 54
- 230000007704 transition Effects 0.000 title claims abstract description 11
- 230000008859 change Effects 0.000 title claims description 8
- 230000033764 rhythmic process Effects 0.000 claims abstract description 46
- 230000005236 sound signal Effects 0.000 claims abstract description 25
- 238000010586 diagram Methods 0.000 claims abstract description 16
- 238000000034 method Methods 0.000 claims abstract description 12
- 230000009466 transformation Effects 0.000 claims abstract description 6
- 230000000875 corresponding effect Effects 0.000 claims abstract description 5
- 239000007921 spray Substances 0.000 claims description 12
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 5
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 claims description 4
- 235000011089 carbon dioxide Nutrition 0.000 claims description 4
- 238000007562 laser obscuration time method Methods 0.000 abstract description 3
- 230000002708 enhancing effect Effects 0.000 abstract 1
- 230000000694 effects Effects 0.000 description 6
- 230000033001 locomotion Effects 0.000 description 5
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000001953 sensory effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000001795 light effect Effects 0.000 description 2
- 238000012827 research and development Methods 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Electrophonic Musical Instruments (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Auxiliary Devices For Music (AREA)
Abstract
本發明為有關一種隨著音樂轉場而改變動作之方法,該電子裝置為先對至少一種樂器發出的聲音訊號進行傅立葉級數轉換,以得到聲音訊號的節奏圖,並利用電子裝置來對聲音訊號中之節奏圖、強度波形圖及頻譜圖進行節奏段落點擷取動作,其節奏圖的強度、波形圖的強度及頻譜圖的大小若同時下降到預設百分比,並維持預設時間時,便會視此時間點為節奏段落點,此時,該音樂的聲音訊號便會消失,而該電子裝置即會於節奏段落點傳輸動作訊號至動作裝置,且該動作裝置接收到動作訊號後,便會依據動作訊號來執行相對應之動作,以使音樂於轉場時機可進行動作的變換,進而可提升音樂整體的演奏觀賞性。 The present invention relates to a method for changing actions with music transitions. The electronic device first performs Fourier series transformation on the sound signal emitted by at least one musical instrument to obtain a rhythm diagram of the sound signal, and uses the electronic device to adjust the sound signal. The rhythm graph, the intensity waveform graph and the spectrogram in the signal are used for rhythm segment point capture. If the intensity of the rhythm graph, the intensity of the waveform graph and the size of the spectrogram decrease to the preset percentage at the same time and maintain the preset time, It will regard this time point as a rhythm segment point, at this time, the sound signal of the music will disappear, and the electronic device will transmit an action signal to the action device at the rhythm segment point, and after the action device receives the action signal, Corresponding actions will be performed according to the action signal, so that the music can be changed at the time of transition, thereby enhancing the overall performance and viewing experience of the music.
Description
本發明是有關於一種隨著音樂轉場而改變動作之方法,尤指電子裝置先對至少一種樂器發出的聲音訊號進行傅立葉級數轉換,以得到聲音訊號的節奏圖,其節奏圖的強度與聲音訊號之波形圖的強度及頻譜圖的大小同時下降到預設百分比時,其動作裝置會執行動作,以使音樂於轉場時機可進行動作的變換。 The present invention relates to a method for changing the action with the transition of music, in particular, an electronic device first performs Fourier series transformation on the sound signal emitted by at least one musical instrument to obtain a rhythm diagram of the sound signal, and the intensity of the rhythm diagram is equal to that of the sound signal. When the intensity of the waveform graph of the sound signal and the size of the spectrogram drop to a preset percentage at the same time, the action device will execute the action, so that the music can change the action at the time of transition.
按,隨著科技的日新月異,單純的聽覺享受已經很難滿足人們感官上的需求,所以越來越多的音樂設備都會從視覺上寄予觀眾更多的體驗,以提供給觀眾在聽音樂的過程中增加更多的不同的氛圍,然而,大部分的音樂燈光互動設備都是燈光廠商通過系統預設的方式來對燈光效果進行控制,例如:事先於程式中隨著通過音樂的演奏,亦或是通過音樂的風格和音律進行燈光顔色和亮度的調節,等到演出時便可同時播送。 Press, with the rapid development of science and technology, pure listening enjoyment has been difficult to meet people's sensory needs, so more and more music equipment will visually entrust the audience with more experience to provide the audience in the process of listening to music. However, most of the music and lighting interactive devices are controlled by lighting manufacturers through system presets, for example: in the program in advance with the music playing, or It is to adjust the color and brightness of the light through the style and rhythm of the music, and it can be broadcast at the same time when the performance is on.
但是,這種通過預先設置好的方式,並無法使音樂與燈光結合達到最優的效果,同時也會可能會使感官體驗不佳,以致於降低現場的音樂氣氛,並且,若音樂的數量過多時,燈光廠商會耗費諸多時間及心力,所以大都不會為每一首音樂都提供一個燈光的互動,況且,目前燈光廠商都是根據聲音的大小聲及頻率高低的轉換位置來進行燈光顔色和亮度 的調節,但是,透過前述二種方式會使燈光互動過於紊亂,進而產生不適,然而,人們感受到音樂的組合變化是因為音樂中的節奏,其節奏是音樂的時間、順序、強弱的體現,透過節奏會使音樂井然有序的進行。 However, this pre-set method cannot make the combination of music and lighting achieve the optimal effect, and may also make the sensory experience unsatisfactory, so as to reduce the live music atmosphere, and if the number of music is too large At this time, lighting manufacturers will spend a lot of time and effort, so most of them will not provide a lighting interaction for each piece of music. Moreover, at present, lighting manufacturers are based on the size of the sound and the conversion position of the frequency. brightness However, through the above two methods, the interaction of the lights will be too disordered, which will cause discomfort. However, people feel that the combination of music changes because of the rhythm in the music, and the rhythm is the time, sequence, and strength of the music. The rhythm will make the music progress in an orderly manner.
然而,目前音樂在演奏或播送時,背景聲光效果都一成不變,其音樂(如:交響樂)在轉場時,都會進行曲目的更換,若背景聲光效果都沒有變化,其觀眾便會覺得視覺效果不佳,導致現場的音樂感官體驗不好、無趣,進而影響觀眾再次觀看之意願。 However, at present, when music is played or broadcast, the background sound and light effects remain unchanged. When the music (such as a symphony) transitions, the tracks will be replaced. If the background sound and light effects do not change, the audience will feel the visual effect. If it is not good, the sensory experience of the live music is not good and boring, which in turn affects the audience's willingness to watch it again.
是以,要如何從音樂中自動擷取出節奏,並配合節奏產生動作效果,即為從事此行業之相關業者所亟欲研究改善之方向所在。 Therefore, how to automatically extract the rhythm from the music and produce the action effect in accordance with the rhythm is the direction that the relevant industry in this industry is eager to study and improve.
故,發明人有鑑於上述缺失,乃搜集相關資料,經由多方評估及考量,並以從事於此行業累積之多年經驗,經由不斷試作及修改,始設計出此種隨著音樂轉場而改變動作之方法的發明專利者。 Therefore, in view of the above deficiencies, the inventor collects relevant information, evaluates and considers from various parties, and uses years of experience in this industry, through continuous trial production and modification, to design such a movement that changes with the transition of music. The invention patentee of the method.
本發明之主要目的乃在於該電子裝置為可先對至少一種樂器發出的聲音訊號進行傅立葉級數轉換,以得到聲音訊號的節奏圖,並利用電子裝置來對聲音訊號中之節奏圖、強度波形圖及頻譜圖進行節奏段落點擷取動作,其節奏圖的強度、波形圖的強度及頻譜圖的大小若同時下降到預設百分比,並維持預設時間時,便會視此時間點為節奏段落點,此時,該音樂的聲音訊號便會消失,而該電子裝置即會於節奏段落點傳輸動作訊號至動作裝置,且該動作裝置接收到動作訊號後,便會依據動作訊號來執行相對應之動作,即可使動作裝置可依據至少一種樂器所演奏出的節奏來執行動作,以使音樂於轉場時機可進行動作的變換,進而達到提升音樂 整體的演奏觀賞性之目的。 The main purpose of the present invention is that the electronic device can first perform Fourier series transformation on the sound signal emitted by at least one musical instrument to obtain a rhythm diagram of the sound signal, and use the electronic device to analyze the rhythm diagram and intensity waveform in the sound signal. If the intensity of the rhythm graph, the intensity of the waveform graph, and the size of the spectrogram decrease to a preset percentage at the same time and maintain the preset time, the time point will be regarded as the rhythm paragraph point, at this time, the sound signal of the music will disappear, and the electronic device will transmit an action signal to the action device at the rhythm paragraph point, and after the action device receives the action signal, it will execute the phase according to the action signal. The corresponding action can enable the action device to perform the action according to the rhythm played by at least one musical instrument, so that the music can change the action at the transition time, thereby improving the music The overall purpose of performance viewing.
1:節奏段落點 1: Rhythm paragraph point
[第1圖]係為本發明之節奏圖。 [Fig. 1] is a rhythm diagram of the present invention.
[第2圖]係為本發明之流程圖。 [Fig. 2] is a flow chart of the present invention.
為達成上述目的及功效,本發明所採用之技術手段及其構造,茲繪圖就本發明之較佳實施例詳加說明其特徵與功能如下,俾利完全瞭解。 In order to achieve the above objects and effects, the technical means and structures adopted by the present invention are described in detail with reference to the preferred embodiments of the present invention, and the features and functions are as follows, so as to be fully understood.
請參閱第1、2圖,係為本發明之節奏圖及流程圖,由圖中可清楚看出,係包含下列之步驟: Please refer to Figures 1 and 2, which are rhythm diagrams and flow charts of the present invention. It can be clearly seen from the figures that the following steps are included:
(A)該電子裝置為可先對音樂中至少一種樂器(如:吉他、鼓、貝斯、鋼琴、鈸或其它樂器)發出的聲音訊號進行傅立葉級數轉換,以得到聲音訊號的節奏圖,其節奏圖為表示聲音訊號中的至少一種頻率隨著時間所呈現之強度變化。 (A) The electronic device can first perform Fourier series transformation on the sound signal emitted by at least one musical instrument (such as guitar, drum, bass, piano, cymbal or other musical instruments) in music to obtain a rhythm diagram of the sound signal, which is The rhythm diagram represents the intensity change of at least one frequency in the sound signal over time.
(B)該電子裝置再對聲音訊號中之節奏圖、強度波形圖及頻譜圖進行節奏段落點1擷取動作,其節奏圖的強度、波形圖的強度及頻譜圖的大小若同時下降到預設百分比,並維持預設時間時,便會視此時間點為節奏段落點1,此時,該音樂的聲音訊號便會消失,而該電子裝置即會於節奏段落點1傳輸動作訊號至動作裝置。
(B) The electronic device then performs the
(C)該動作裝置接收到動作訊號後,便會依據動作訊號來執行相對應之動作,以完成本發明之使用。 (C) After the action device receives the action signal, it will execute the corresponding action according to the action signal, so as to complete the use of the present invention.
上述之電子裝置可為桌上型電腦(PC)、筆記型電腦(Notebook)、平板電腦(Table PC)、智慧型手機(Smartphone)、個人數位助理(PDA)或其它具運算功能之電子裝置。 The above electronic device can be a desktop computer (PC), a notebook computer (Notebook), a tablet computer (Table PC), a smart phone (Smartphone), a personal digital assistant (PDA) or other electronic devices with computing functions.
且上述步驟(B)中之電子裝置較佳為可透過傳輸線來將動作訊號傳輸至動作裝置,但於實際應用時,亦可利用無線傳輸的方式(如:Wi-Fi、藍芽或紅外線等)來將動作訊號傳輸至動作裝置。 Moreover, the electronic device in the above step (B) is preferably capable of transmitting the motion signal to the motion device through a transmission line, but in practical application, wireless transmission methods (such as Wi-Fi, bluetooth or infrared rays, etc.) can also be used. ) to transmit the motion signal to the motion device.
再者,上述步驟(B)中之動作裝置可為發光裝置(如:LED)、噴水裝置、噴火裝置、噴乾冰裝置、煙火裝置或其它可配合音樂播送來執行動作之動作裝置,即可透過發光裝置來配合節奏、聲音大小及聲音高低進行燈光變化、模擬水舞變化、模擬火炬變化或任意之場景燈光特效變化,亦或者可利用噴水裝置、噴火裝置、噴乾冰裝置、煙火裝置或其它動作裝置來進行噴火、噴水、噴乾冰、放煙火或其它動作,惟,有關動作裝置的種類很多,其可接收動作訊號來配合音樂節奏、聲音大小及聲音高低執行動作即可,故舉凡可達成前述效果之結構皆應受本發明所涵蓋,此種簡易修飾及等效結構變化,均應同理包括於本發明之專利範圍內,合予陳明。 Furthermore, the action device in the above step (B) can be a light-emitting device (such as: LED), a water spray device, a fire spray device, a dry ice spray device, a pyrotechnic device or other action devices that can perform actions in conjunction with music broadcasting. The light-emitting device can be used to match the rhythm, sound volume and sound level to perform lighting changes, simulate water dance changes, simulate torch changes or any scene lighting effects changes, or use water spray devices, fire spray devices, dry ice spray devices, pyrotechnic devices or other actions The device is used to spray fire, spray water, spray dry ice, set off fireworks or other actions. However, there are many types of action devices, which can receive action signals to match the music rhythm, sound volume and sound level. The structure of the effect should be covered by the present invention, and such simple modification and equivalent structural changes should be similarly included within the scope of the patent of the present invention, and are hereby stated.
然而,上述步驟(B)中之預設百分比為小於5%(介於1%~5%),且預設時間為小於3秒(介於0.5秒~3秒)。 However, the predetermined percentage in the above step (B) is less than 5% (between 1% and 5%), and the predetermined time is less than 3 seconds (between 0.5 seconds and 3 seconds).
當本發明實際使用時,該電子裝置為可先對至少一種樂器發出的聲音訊號進行傅立葉級數轉換,以得到聲音訊號的節奏圖,並利用電子裝置來對節奏圖、強度波形圖及頻譜圖進行節奏段落點1擷取動作,
其節奏圖的強度、波形圖的強度及頻譜圖的大小若同時下降到預設百分比,並維持預設時間時,便會視此時間點為節奏段落點1,此時,該音樂的聲音訊號便會消失,而該電子裝置即會於節奏段落點1傳輸動作訊號至動作裝置,而該動作裝置接收到動作訊號後,便會依據動作訊號來執行相對應之動作,即可使動作裝置可依據至少一種樂器所演奏出的節奏、聲音大小及聲音高低來執行動作,以使音樂於轉場時機可進行動作的變換(如:交響樂換章節時,可播送新的影片動畫等),進而可提升音樂整體的演奏觀賞性。
When the present invention is actually used, the electronic device can first perform Fourier series transformation on the sound signal emitted by at least one musical instrument to obtain a rhythm diagram of the sound signal, and use the electronic device to analyze the rhythm diagram, the intensity waveform diagram and the spectrogram. Perform
上所述僅為本發明之較佳實施例而已,非因此即侷限本發明之專利範圍,故舉凡運用本發明說明書及圖式內容所為之簡易修飾及等效結構變化,均應同理包含於本發明之專利範圍內,合予陳明。 The above description is only a preferred embodiment of the present invention, which does not limit the scope of the patent of the present invention. Therefore, any simple modifications and equivalent structural changes made by using the contents of the description and drawings of the present invention should be similarly included in the Within the scope of the patent of the present invention, it is hereby stated.
綜上所述,本發明隨著音樂轉場而改變動作之方法於實際應用、實施時,為確實能達到其功效及目的,故本發明誠為一實用性優異之研發,為符合發明專利之申請要件,爰依法提出申請,盼 審委早日賜准本案,以保障發明人之辛苦研發、創設,倘若 鈞局審委有任何稽疑,請不吝來函指示,發明人定當竭力配合,實感德便。 To sum up, the method of the present invention to change the action with the transition of music is actually used and implemented, in order to achieve its effect and purpose, the present invention is a research and development with excellent practicability, in order to meet the requirements of the invention patent. The application requirements are to be submitted according to the law. I hope that the review committee will approve this case as soon as possible to protect the inventor's hard work in research and development. If the review committee has any doubts, please do not hesitate to send a letter for instructions. The inventor will do his best to cooperate. .
1:節奏段落點 1: Rhythm paragraph point
Claims (4)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW109127968A TWI769498B (en) | 2020-08-17 | 2020-08-17 | How to change the action as the music transitions |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW109127968A TWI769498B (en) | 2020-08-17 | 2020-08-17 | How to change the action as the music transitions |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW202209299A TW202209299A (en) | 2022-03-01 |
| TWI769498B true TWI769498B (en) | 2022-07-01 |
Family
ID=81747106
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW109127968A TWI769498B (en) | 2020-08-17 | 2020-08-17 | How to change the action as the music transitions |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI769498B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101421707A (en) * | 2006-04-13 | 2009-04-29 | 伊默生公司 | System and method for automatically generating haptic events from digital audio signals |
| US20140278229A1 (en) * | 2012-06-22 | 2014-09-18 | Fitbit, Inc. | Use of gyroscopes in personal fitness tracking devices |
| TW201546616A (en) * | 2014-06-04 | 2015-12-16 | Univ Nat Cheng Kung | Emotion regulation system and regulation method thereof |
| CN107317625A (en) * | 2012-05-24 | 2017-11-03 | 松下电器(美国)知识产权公司 | Information communicating method, information-communication device, recording medium |
| EP2811220B1 (en) * | 2012-02-02 | 2017-11-15 | Iborra Badia, Gerardo | Association of lighting effects with discrete frequency signals extracted from audio signals |
-
2020
- 2020-08-17 TW TW109127968A patent/TWI769498B/en active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101421707A (en) * | 2006-04-13 | 2009-04-29 | 伊默生公司 | System and method for automatically generating haptic events from digital audio signals |
| EP2811220B1 (en) * | 2012-02-02 | 2017-11-15 | Iborra Badia, Gerardo | Association of lighting effects with discrete frequency signals extracted from audio signals |
| CN107317625A (en) * | 2012-05-24 | 2017-11-03 | 松下电器(美国)知识产权公司 | Information communicating method, information-communication device, recording medium |
| US20140278229A1 (en) * | 2012-06-22 | 2014-09-18 | Fitbit, Inc. | Use of gyroscopes in personal fitness tracking devices |
| TW201546616A (en) * | 2014-06-04 | 2015-12-16 | Univ Nat Cheng Kung | Emotion regulation system and regulation method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202209299A (en) | 2022-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Smus | Web audio API: advanced sound for games and interactive apps | |
| Turchet et al. | Examples of use cases with smart instruments | |
| CN106383676B (en) | Instant photochromic rendering system for sound and application thereof | |
| TW202244904A (en) | Method of changing light display with music rhythm achieving the purpose of enhancing beauty between the music and the light and improving the effect of simultaneous enjoyment of sound and light when listening to music | |
| CN109254747A (en) | The method and apparatus for controlling mobile terminal screen flashing | |
| CN118633355A (en) | Determine global and local light effect parameter values | |
| CN105810226B (en) | A kind of method and system of control musical effect | |
| TWI769498B (en) | How to change the action as the music transitions | |
| US11558944B2 (en) | Method of producing light animation with rhythm of music | |
| US20220156035A1 (en) | Method of generating actions following the rhythm of music | |
| US20180137770A1 (en) | Musical instrument indicator apparatus, system, and method to aid in learning to play musical instruments | |
| TWI769497B (en) | How to create action with the rhythm of music | |
| CN104768106B (en) | A kind of conversion method and device of terminal audio | |
| US8382589B2 (en) | Musical action response system | |
| US20220156031A1 (en) | Method of generating actions following the rhythm of music | |
| Ilsar | The AirSticks: a new instrument for live electronic percussion within an ensemble | |
| TW202209307A (en) | Method for generating action along with the rhythm of music capable of performing Fourier series transformation and vocal range division on the sound signals in the plurality of vocal ranges | |
| TW202209309A (en) | Method for generating light animation along with music rhythm capable of improving the overall performance and appreciation of the music | |
| US20220156034A1 (en) | Method of generating actions following the rhythm of music | |
| TW202209306A (en) | Method for generating action according to music rhythm in which a sound signal emitted from one single music instrument is subjected to Fourier series transformation to form a rhythm plot from which a rhythm conversion point is retrieved | |
| Pinch | The Art of a New Technology: Early Synthesizer Sounds | |
| Lin et al. | Intuitive, Interactive Training System for the Sense of Sound Using Portable Theremin Device | |
| TW202244903A (en) | Method of varying light combination with intensity of music mood capable of detecting up and down of the music emotional rhythm of the sound signal through the electronic device according to the intensity of the emotional rhythm of the music played | |
| Wang | The role of technology in the field of music | |
| De Lautour | Involution: For Flute, Erbane, Live Electronics: Score in C |