[go: up one dir, main page]

WO2018150647A1 - Système de sortie de données et procédé de sortie de données - Google Patents

Système de sortie de données et procédé de sortie de données Download PDF

Info

Publication number
WO2018150647A1
WO2018150647A1 PCT/JP2017/039958 JP2017039958W WO2018150647A1 WO 2018150647 A1 WO2018150647 A1 WO 2018150647A1 JP 2017039958 W JP2017039958 W JP 2017039958W WO 2018150647 A1 WO2018150647 A1 WO 2018150647A1
Authority
WO
WIPO (PCT)
Prior art keywords
information processing
processing apparatus
score
information
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2017/039958
Other languages
English (en)
Japanese (ja)
Inventor
藤島　琢哉
教裕 植村
暖 篠井
崇 大塚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yamaha Corp
Original Assignee
Yamaha Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yamaha Corp filed Critical Yamaha Corp
Priority to CN201780085802.9A priority Critical patent/CN110678920A/zh
Priority to JP2018567985A priority patent/JP6741085B2/ja
Publication of WO2018150647A1 publication Critical patent/WO2018150647A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10G—REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS
    • G10G1/00—Means for the representation of music

Definitions

  • Patent Literature 1 describes a technique for distributing musical score data stored in a server to a display device.
  • the performer has to perform an operation for turning the page of the score, and this operation sometimes interferes with the performance.
  • the present invention provides a technique for reducing the load of the player who updates the display of the score.
  • the present invention includes a first information processing apparatus and a second information processing apparatus, and the first information processing apparatus includes a position output unit that outputs information indicating a position in music to the second information processing apparatus.
  • the second information processing apparatus includes an information input unit that receives the information from the first information processing apparatus, and a position output unit that outputs position data in a predetermined format indicating the position based on the information. And a score output unit that outputs score display data for displaying the score of the music in accordance with the position data.
  • the second information processing apparatus includes an operation input unit that receives an operation input from a user, and the first information processing apparatus outputs an instruction to invalidate the operation input unit of the second information processing apparatus. You may have a part.
  • the data output system further includes a fourth information processing apparatus, and the fourth information processing apparatus receives the information from the first information processing apparatus and the position based on the information.
  • a position output unit that outputs position data in a predetermined format indicating data, and a data output unit that outputs data for controlling operations other than the display of the score to another device according to the position data Also good.
  • the operation input unit 25 receives an operation input by a user, that is, a player.
  • the information processing apparatus 20 performs processing according to the operation input in the operation input unit 25.
  • the operation input unit 25 invalidates the operation input. That is, the process according to the operation input is not performed.
  • FIG. 4 is a diagram illustrating a hardware configuration of the information processing apparatus 10.
  • the information processing apparatus 10 is a computer device that includes a CPU 101, a memory 102, a storage 103, a communication IF 104, a display 105, and an input device 106. Specifically, for example, a personal computer, a tablet terminal, or a smartphone.
  • the CPU 101 is a control device that executes a program and controls other hardware elements of the information processing apparatus 10.
  • the memory 102 is a main storage device that functions as a work area when the CPU 101 executes a program, and includes, for example, a RAM (Random Access Memory).
  • the storage 103 stores a program (hereinafter referred to as “control program”) for causing the computer device to function as a master (server) in the data output system 1.
  • control program a program for causing the computer device to function as a master (server) in the data output system 1.
  • the CPU 101 executes the control program, the functions shown in FIG.
  • At least one of the memory 102 and the storage 103 is an example of the storage unit 11.
  • the display 105 is an example of the display unit 12.
  • the input device 106 is an example of the operation input unit 13.
  • the communication IF 104 is an example of the output unit 14.
  • FIG. 5 is a diagram illustrating a hardware configuration of the information processing apparatus 20.
  • the information processing device 20 is a computer device having a CPU 201, a memory 202, a storage 203, a communication IF 204, a display 205, and an input device 206, specifically, for example, a smartphone or a tablet terminal.
  • the CPU 201 is a control device that executes a program and controls other hardware elements of the information processing apparatus 20.
  • the memory 202 is a main storage device that functions as a work area when the CPU 201 executes a program, and includes, for example, a RAM.
  • the storage 203 is a nonvolatile auxiliary storage device that stores various programs and data, and includes, for example, an SSD or an HDD.
  • the storage 203 stores score data indicating the score of the music to be played.
  • each performer possesses one information processing device 20 and one display device 30.
  • the storage 203 stores a part score of a part (musical instrument) performed by a corresponding performer.
  • the display device 30 has any hardware configuration as long as it displays an image according to the input data. Also good.
  • the display device 30 is a wearable device called a smart glass or a scouter, for example. Smart glasses or scouters are so-called see-through display devices. That is, the performer can visually recognize the image displayed on the panel (glasses glass) in front of the user's eyes, and can visually recognize the periphery through the panel. Thereby, the performer can see the musical instrument at hand while looking at the score.
  • the display device 30 may be a non-wearable device using a projector or a direct-view display.
  • the information processing apparatus 20 is a smartphone, and each performer possesses the information processing apparatus 20 by putting it in a pocket of clothes.
  • the display device 30 is a wearable device. Two performers, performers A and B, participate in the concert. Player A plays the violin and player B plays the cello.
  • the information processing apparatus 20A stores the violin part music, and the display apparatus 30A displays the violin part music.
  • the information processing device 20B stores the cello part, and the display device 30B stores the cello part.
  • software such as a control program may be described as the subject of processing, but this is because hardware elements such as the CPU 101 executing the software execute processing in cooperation with other hardware elements. It means to do.
  • step S ⁇ b> 101 the operator inputs information for performing initial settings to the control program of the information processing apparatus 10.
  • the information for performing the initial setting includes, for example, information for specifying the music to be played and information for specifying the size of the score displayed on the screen (for example, m bars ⁇ n stages).
  • the information for performing the initial setting is information indicating a correspondence relationship between the information processing device 20 and the musical instrument (for example, information that associates the information processing device 20A with the violin and associates the information processing device 20B with the cello). including.
  • the control program performs initial setting according to the input information.
  • the control program reads the musical score data of the music to be played from the plurality of musical score data stored in the storage 103.
  • the score data is described in a predetermined format (for example, MIDI (Musical Instrument Digital Interface) format).
  • the control program generates score display data for displaying the score on the display 105 using the read score data.
  • the display 105 displays the score according to the score display data.
  • the score displayed on the information processing apparatus 10 is a total score including a score of a plurality of parts.
  • step S102 the control program transmits information for initial setting to the information processing apparatuses 20A to 20C.
  • the identification information for specifying the information processing apparatus 20 constituting the data output system 1 is associated with the corresponding musical instrument identification information and registered in advance in the control program.
  • the control program refers to this information and determines a transmission destination of information for performing the initial setting.
  • the musical score display program performs initial setting according to the received information.
  • the control program reads the musical score data of the part to be played of the musical piece to be played from the plurality of musical score data stored in the storage 203.
  • the musical score data is described in a predetermined format (for example, MIDI format).
  • the control program generates score display data for displaying a score on the display 205 using the read score data.
  • the display 205 displays the score according to the score display data.
  • the score displayed on the display device 30A is a violin part
  • the score displayed on the display device 30B is a cello part.
  • FIG. 10 is a diagram illustrating a score displayed on the display device 30.
  • a score of a total of 6 bars of 3 bars ⁇ 2 levels is displayed on one screen.
  • the reason why only the six-bar score is displayed is that in the case of a wearable device, the screen of the display device 30 is often small, so it may be difficult to see if many bars are displayed on one screen.
  • the score of 3 measures ⁇ 2 steps is displayed for a total of 6 measures.
  • the score displayed on one screen may be appropriately changed according to the screen size and resolution of the display device. .
  • step S ⁇ b> 103 the user determines whether to invalidate the operation input via the input device 206 in the information processing apparatus 20.
  • the control program informs the instruction to invalidate the operation input via the input device 206 in the score display program 293. Output to the processing device 20.
  • the score display program switches the operation mode from the normal mode (an example of the first operation mode) to the remote control mode (an example of the second operation mode) (step S104). ).
  • the score display program 293 In the normal mode, when the user performs an operation input through the input device 206, the score display program 293 updates the display of the score in accordance with the operation input.
  • the display update includes, for example, a process corresponding to turning a musical score page or changing a size (enlargement ratio).
  • the score display program 293 When the score display program 293 is operating in the normal mode, when the user operates, for example, a touch screen (an example of the input device 206), the score display program 293 turns the page according to the user's operation input, Change the magnification of the score.
  • the remote control mode is an operation mode in which the operation input via the input device 206 is invalidated, and the score display program 293 does not update the display of the score even when the user performs an operation input via the input device 206. .
  • FIG. 11 is a diagram illustrating a UI (User Interface) screen in the control program (information processing apparatus 10).
  • This UI screen includes a window 51 and a button 52.
  • the window 51 is an area for displaying a score. The score is displayed in the size specified by the operator. In this example, the window 51 displays a musical score of 8 bars ⁇ 8 lines.
  • the control program holds position information indicating the position on the score. The position information is, for example, information that identifies a measure that is currently being played.
  • the currently played bar is displayed using a display mode (appearance) different from other bars. In this example, the currently playing bar is highlighted (represented by shading in the figure).
  • the button 52 is a UI object for notifying the control program that the performance position has reached a new measure (next measure).
  • control program repeatedly transmits the same position information a plurality of times (for example, 10 to 20 times at 50 msec intervals) with a predetermined time interval. This is because retransmission of lost data (packets) is not supported by the communication protocol (UDP).
  • UDP communication protocol
  • the timing at which the operator presses the button 52 is not limited to measures.
  • the operator may press the button 52 at a timing corresponding to the beat of the performance.
  • the control program manages position information in units of beats.
  • the position information used in the data output system 1 may be a combination of the absolute value of the bar number and the absolute value of the beat number in the bar, or a beat number given as a serial number through the music.
  • the control program may also display information corresponding to the beat number on the UI screen illustrated in FIG.
  • the information corresponding to the beat number is, for example, an image object such as a cursor that moves in the time axis direction of the score (the direction from left to right in the example of FIG. 11). As the performance progresses, the image object moves from left to right at least in beat units.
  • This image object is an image showing a vertical bar, triangle mark, arrow, or the like of a color (for example, red) different from the musical score portion.
  • the image object may be an image of a numerical value or symbol indicating a numerical value of a beat number (a beat number in a measure or a continuous beat number in music). This image object may be displayed at a predetermined position in the score, or may be displayed in a measure currently being played (shaded portion in FIG. 11).
  • the relay program 292 receives (that is, acquires) position information from the information processing apparatus 10.
  • the relay program 292 converts the received position information into position data that describes the position on the score in a predetermined format (or generates position data) (step S107).
  • the format of the position data for example, the MIDI format is used. MIDI is widely used for transmission of musical score information and is a highly versatile data format.
  • the relay program 292 outputs the position data to the score display program 293.
  • the score display program 293 generates score display data for displaying a score on the display device 30 in accordance with the position data input from the relay program 292 (step S109).
  • the score display data is, for example, image data of a score.
  • the score display program 293 transmits score display data to the display device 30 (step S110).
  • the display device 30 displays the score according to the score display data.
  • FIG. 12 is a diagram illustrating an example of a score display screen updated according to position data.
  • the bar specified by the position data is displayed first (upper left), and then the five bars following the bar are displayed in order.
  • What is displayed on the display device 30 is a part score of the part to be played.
  • the measure specified by the position data that is, the measure corresponding to the performance position is highlighted. The performer can play the instrument while watching this part score.
  • the position information includes a beat number
  • an image object indicating the beat number may be displayed in FIG. 12 as in FIG. This image object may be displayed at a predetermined position on the screen, or may be displayed in a measure currently being played (shaded portion in FIG. 12).
  • the operator of the information processing apparatus 10 presses the button 52 when determining that the performance has reached a new measure while listening to the performance on the stage.
  • the processes in steps S106 to S110 are repeatedly executed. Since the operation for updating the display of the score is performed by an operator different from the performer, the load on the performer is reduced, and the performer can concentrate on the performance of the musical instrument.
  • the specific method for the information processing apparatus 10 to acquire the performance position is as described in the embodiment.
  • the human operator listens to the performance and determines whether the performance position has reached a new measure. It is not limited to the example which inputs via the input device 106.
  • the information processing apparatus 10 may acquire the performance position on the score in accordance with the movement of a conductor stick that a performer (for example, a conductor) on the stage swings.
  • the movement of the baton is detected by, for example, a sensor (for example, an acceleration sensor) built in the baton.
  • the baton and the information processing apparatus 10 communicate with each other by, for example, Bluetooth (registered trademark).
  • the baton transmits data indicating the movement detected by the built-in sensor to the information processing apparatus 10.
  • the control program acquires bar or beat information from the movement of the baton indicated by the data received from the baton.
  • the control program converts the bar number into an absolute value (counts up one by one) from the acquired bar or beat information and transmits it to the information processing apparatus 20 as position information.
  • at least a part of the technique described in Japanese Patent No. 4626087 can be applied.
  • the method of detecting the movement of the baton is not limited to using the baton's built-in sensor.
  • the control program may detect the movement of the baton using an external sensor such as a camera. In this case, the information processing apparatus 10 does not need to communicate with the baton, and may communicate with the camera.
  • the object of movement detection is not limited to the conductor, and the performance position on the score may be acquired according to the movement of the musical instrument played by the performer. Furthermore, when information specifying a beat is acquired as in this example, the data output system 1 may use a beat number or a combination of a bar number and a beat number as position information.
  • control program of the information processing apparatus 10 may automatically acquire the performance position on the score based on the sound signal.
  • a technique for acquiring a performance position on a score from a sound signal for example, a technique described in Japanese Patent Application Laid-Open No. 2015-114360 or a score alignment technique described in Japanese Patent Application Laid-Open No. 2015-79183 can be used.
  • the information processing apparatus 20 controls the display device 30, but an apparatus that performs an operation other than the display of the score may be controlled.
  • the information processing device 20 may control a lighting device (not shown).
  • the information processing apparatus 20 in this case is an example of a fourth information processing apparatus.
  • an illumination control program (not shown) is executed instead of the score display program 293.
  • the lighting control program is a program for controlling the lighting device, and is an example of a program for controlling operations other than the display of the score.
  • the sequence for controlling the illumination is controlled by MIDI data, for example.
  • the storage 203 of the information processing apparatus 20 stores MIDI data describing a lighting control sequence according to the music to be played.
  • the lighting control program specifies a performance position using the position data output from the relay program 292, and outputs a command corresponding to the performance position to the lighting device.
  • the lighting device controls lighting according to a command output from the information processing device 20.
  • This command is an example of data for controlling operations other than the display of the score.
  • the brightness, color, position, or size of the illumination can be controlled according to the progress of the actual music.
  • the CPU 201 executing the lighting control program is an example of a data output unit that outputs data for controlling operations other than the display of the score to another apparatus according to the position data. is there.
  • the relay program 292 repeatedly receives position information indicating the same measure number a plurality of times, but the relay program 292 may generate position data each time it receives position information. Alternatively, when the relay program 292 receives the position information, the relay program 292 determines whether the received position information is the same as the previously received position information. If it is determined that the position information is the same, the relay program 292 does not generate position data and is different from the previous time. The position data may be generated only when it is determined that the position information has been received.
  • the functional configuration of the data output system 1 is not limited to that exemplified in the embodiment. For example, some of the functions illustrated in FIGS. 2 and 3 may be omitted. Specifically, the score display program of the information processing apparatus 20 may not be implemented with the remote control mode. In this case, the control program of the information processing apparatus 10 may not have the function of the instruction output unit 142. Good.
  • the processing performed using the position data in the information processing apparatus 20 is not limited to the one exemplified in the embodiment.
  • any processing such as playing an electronic musical instrument or controlling a stage apparatus may be performed.
  • the system may be configured using only the information processing apparatus 20 and the information processing apparatus 10 that perform only processing other than the display of the score.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Auxiliary Devices For Music (AREA)

Abstract

L'invention concerne un système de sortie de données (1) comprenant un dispositif de traitement d'informations (10) et un dispositif de traitement d'informations (20). Le dispositif de traitement d'informations (10) comprend une unité de sortie (141) qui délivre des informations de position indiquant une position dans un morceau de musique au dispositif de traitement d'informations (20). Le dispositif de traitement d'informations (20) comprend une unité d'entrée d'informations sur laquelle des informations de position sont entrées à partir du dispositif de traitement d'informations (10), une unité de sortie de position (23) qui délivre des données de position d'un format prescrit indiquant une position sur la base des informations de position, et une unité de sortie de partition musicale (24) qui délivre des données d'affichage de partition musicale pour afficher une partition musicale du morceau de musique en fonction des données de position.
PCT/JP2017/039958 2017-02-16 2017-11-06 Système de sortie de données et procédé de sortie de données Ceased WO2018150647A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780085802.9A CN110678920A (zh) 2017-02-16 2017-11-06 数据输出系统及数据输出方法
JP2018567985A JP6741085B2 (ja) 2017-02-16 2017-11-06 データ出力システム及びデータ出力方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-026717 2017-02-16
JP2017026717 2017-02-16

Publications (1)

Publication Number Publication Date
WO2018150647A1 true WO2018150647A1 (fr) 2018-08-23

Family

ID=63170190

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/039958 Ceased WO2018150647A1 (fr) 2017-02-16 2017-11-06 Système de sortie de données et procédé de sortie de données

Country Status (3)

Country Link
JP (1) JP6741085B2 (fr)
CN (1) CN110678920A (fr)
WO (1) WO2018150647A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7504446B2 (ja) 2020-09-28 2024-06-24 くるみ 北出 演奏支援装置、演奏支援方法、プログラム

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114067633A (zh) * 2020-08-04 2022-02-18 森兰信息科技（上海）有限公司 钢琴的琴谱标记方法、系统、介质及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012090279A1 (fr) * 2010-12-27 2012-07-05 キャスティングメディア株式会社 Système d'affichage de partition musicale
JP2013068899A (ja) * 2011-09-26 2013-04-18 Yamaha Corp 楽音再生装置及び情報処理装置、並びにプログラム
JP2014170087A (ja) * 2013-03-04 2014-09-18 Jvc Kenwood Corp 楽譜表示装置および楽譜表示システム
WO2016080479A1 (fr) * 2014-11-21 2016-05-26 ヤマハ株式会社 Procédé de fourniture d'informations et dispositif de fourniture d'informations

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007011220A (ja) * 2005-07-04 2007-01-18 Toshiba Plant Systems & Services Corp 電子楽譜表示装置
CN103325362B (zh) * 2012-03-22 2016-01-20 赵汉青 具有协同翻谱功能的音乐演奏辅助系统
JP2013225070A (ja) * 2012-04-23 2013-10-31 Nec Casio Mobile Communications Ltd 楽譜表示システム、楽譜表示方法、指揮棒、楽譜生成装置、楽譜生成装置の制御方法及びプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012090279A1 (fr) * 2010-12-27 2012-07-05 キャスティングメディア株式会社 Système d'affichage de partition musicale
JP2013068899A (ja) * 2011-09-26 2013-04-18 Yamaha Corp 楽音再生装置及び情報処理装置、並びにプログラム
JP2014170087A (ja) * 2013-03-04 2014-09-18 Jvc Kenwood Corp 楽譜表示装置および楽譜表示システム
WO2016080479A1 (fr) * 2014-11-21 2016-05-26 ヤマハ株式会社 Procédé de fourniture d'informations et dispositif de fourniture d'informations

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7504446B2 (ja) 2020-09-28 2024-06-24 くるみ 北出 演奏支援装置、演奏支援方法、プログラム

Also Published As

Publication number Publication date
JPWO2018150647A1 (ja) 2019-11-07
CN110678920A (zh) 2020-01-10
JP6741085B2 (ja) 2020-08-19

Similar Documents

Publication Publication Date Title
US20130038523A1 (en) Character Input Device, Character Input Device Control Method, And Information Storage Medium
KR20120004023A (ko) 휴대용 단말기에서 증강 현실 기법을 이용한 악기 연주를 제공하기 위한 장치 및 방법
JP6690589B2 (ja) 電子楽器制御端末、電子楽器制御システム、電子楽器制御プログラムおよび電子楽器制御方法
CN108353096A (zh) 通信系统和存储介质
JP2018073287A (ja) 情報処理装置及び情報処理方法
JP6741085B2 (ja) データ出力システム及びデータ出力方法
JP4478001B2 (ja) 画像表示装置、画像表示方法及びプログラム
JP5958049B2 (ja) 台紙管理プログラム及び台紙管理装置
JP6705407B2 (ja) 電子楽器制御端末、電子楽器制御システム、電子楽器制御プログラムおよび電子楽器制御方法
JP5770782B2 (ja) オペレータ端末、ユーザ端末、所要時間通知方法、及びオペレータ端末用プログラム
JP2024114794A (ja) コントローラ
JP5786997B2 (ja) リモコン装置、カラオケシステム、及びプログラム
JP2005277490A (ja) 音響信号処理装置
JP5003706B2 (ja) 情報処理装置、情報処理システム及びプログラム
CN101009894B (zh) 显示关于便携式终端的条件的信息的方法
KR101682214B1 (ko) 전자잉크 키보드
JP2016189152A (ja) 電子機器及びその制御方法
JP2014197056A (ja) 情報端末、情報端末用プログラム及びカラオケ装置
WO2019054012A1 (fr) Dispositif et programme de traitement d'informations
JP2010213129A (ja) テレビ会議装置、テレビ会議システム、テレビ会議制御方法、及びテレビ会議装置のプログラム
JP6527764B2 (ja) カラオケシステム
TW201837948A (zh) 動態按鍵顯示方法及其相關電腦系統
JP4162146B2 (ja) 画像表示装置、画像表示方法及びプログラム
JP6308988B2 (ja) カラオケ用入力装置及びプログラム
JP2025158488A (ja) 端末装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17896484

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018567985

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17896484

Country of ref document: EP

Kind code of ref document: A1