US20130276618A1

US20130276618A1 - Keyboard system for multi-student training and visualization

Info

Publication number: US20130276618A1
Application number: US13/794,670
Authority: US
Inventors: Yoshinari Yoshikawa
Original assignee: Miselu Inc
Current assignee: Miselu Inc
Priority date: 2012-03-09
Filing date: 2013-03-11
Publication date: 2013-10-24
Also published as: US9035783B2; US20130234857A1; US20160011251A1

Abstract

Embodiments generally relate to providing a multi-user keyboard system. In one embodiment, a multi-user keyboard system comprises a display screen, a first keyboard apparatus, a second keyboard apparatus, and one or more digital processors, all operably connected together. The display screen is viewable simultaneously by first and second users of the first and second keyboard apparatuses. An image directly related to the use of at least one of the keyboard apparatuses by a corresponding user is displayed on the display screen by at least one of the one or more digital processors.

Description

CROSS REFERENCES TO RELATED APPLICATIONS

This application claims priority from U.S. Provisional Patent Application Ser. No. 61/609,196, entitled “Portable Piano Keyboard Computer”, filed on Mar. 9, 2012, which is hereby incorporated by reference as if set forth in full in this application for all purposes.

BACKGROUND

Currently available compact electronic musical devices including piano-type keyboards may be used educationally and enjoyably by individuals, playing alone. However, the ability to interactively share the experience with other nearby players may reasonably be expected to greatly increase the value of such devices, especially for children and student musicians. This application is related in general to a computer system that uses one or more keyboards and a shared display screen along with additional controls to provide applications, utilities and other functionality to a plurality of users. This application is related more specifically to a computer system that uses one or more piano-type keyboards and a shared display screen along with additional controls to provide music related applications, utilities and other functionality to a plurality of users.

SUMMARY

Embodiments generally relate to providing a multi-user keyboard system. In one embodiment, a multi-user keyboard system comprises a display screen operably connected to a first keyboard apparatus, a second keyboard apparatus, and one or more digital processors. The display screen is viewable simultaneously by a first user of the first keyboard apparatus and a second user of the second keyboard apparatus. An image directly related to the use of at least one of the first and second keyboard apparatuses by a corresponding one of the first and second users is displayed on the display screen by at least one of the one or more digital processors.
In another embodiment, a multi-user keyboard system comprises a display screen operably connected to a first keyboard apparatus and one or more digital processors. The display screen displays a virtual keyboard apparatus. An image, directly related to the use of at least one of the first keyboard apparatus by a first user and the virtual keyboard apparatus by a second user, and simultaneously viewable by the first and second users, is displayed on the display screen by at least one of the one or more digital processors.
In another embodiment, a method for providing a musical experience shared between a first user and a second user comprises the act, performed by one or more digital processors, of displaying, on a display screen operably connected to a first piano-style keyboard apparatus, a second piano-style keyboard apparatus, and the one or more digital processors, an image directly related to the use of the first keyboard apparatus by the first user and the use of the second keyboard apparatus by the second user.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic view of an example keyboard system configured to allow two users, each with one keyboard apparatus, to share a display screen, according to some embodiments

FIG. 2 is a schematic view of an example keyboard system showing the spatial associations of a visual cue with a prompted key and a visualization feature with a pressed key, according to some embodiments.

FIG. 3 is a schematic view of an example keyboard system configured to allow four users, each with one keyboard apparatus, to share a display screen, according to some embodiments

FIG. 4 illustrates two users interacting with an example keyboard system comprising a keyboard apparatus and a display screen, according to some embodiments.

DETAILED DESCRIPTION

Embodiments described herein enable users of separate keyboards to enjoy a shared, interactive playing experience, enhanced by the support of digital processing functionality.
Some embodiments provide a keyboard system that enables two users, each playing a separate keyboard apparatus, to share a display screen, on which an image directly related to the playing of either one or both keyboard apparatuses is displayed. In embodiments in which the system is used in a training or tutorial mode, the image may include visual cues to prompt one or both users to press specific keys on the corresponding keyboards. In embodiments in which the system is used in a visualization or performance mode, the image may include visualization features associated with keys that are determined to have been pressed by either one or both users.
Some embodiments provide a keyboard system that enables one user to play one keyboard apparatus operably connected to a display screen, while another user plays a virtual keyboard apparatus displayed on that same display screen. Images directly related to the playing of either one or both keyboard apparatuses are displayed on the shared display screen.
Various embodiments described below with particular reference to FIG. 1 through FIG. 4 allow such keyboard systems and methods of providing such systems to be realized.
FIG. 1 is a schematic view of an example keyboard system 100 configured to allow user 102 to play with keyboard apparatus 104, user 106 to play with keyboard apparatus 108, and to allow both users to view display screen 110, according to some embodiments. One or more digital processers 112 may be provided in either keyboard apparatus, or in a computing unit 114 as shown, directly or indirectly connected to display screen 110, as indicated schematically in the figure. Alternately, digital processors 112 may be distributed in various ways between some or all of these elements. One or more of the digital processors 112 displays an image 116 on screen 110 that is directly related to the use of either one of the first and second keyboard apparatuses or both by the corresponding user or users. The keyboard apparatuses may be connected to the display screen in a variety of well-known ways, for example using plug in contacts, or wired, or wireless connections, omitted from the figure for simplicity.
In some embodiments, as shown in FIG. 1, the keyboard apparatuses, 104 and 108, and the display screen 110 may lie substantially in the same plane, for example on a table or on a floor. In other embodiments, the first keyboard apparatus may lie in a first plane that is either parallel to or inclined with respect to a second plane in which the second keyboard apparatus lies, and the display screen may be lie in either the first plane, the second plane, or a third plane different from either the first or second planes. Non-coplanar arrangements may be advantageous when the first and second users are of significantly different height, for example, or when one user prefers to stand while the other prefers to sit, but in all cases, the display screen 110 is simultaneously viewable by both users.
In some embodiments, for example when the keyboard system 100 is used in a training or tutorial mode, the displayed image 116 includes a visual cue 118 to prompt the first or second user to press a key on the first keyboard apparatus. Examples of visual cues include simple shapes such as squares or rectangles, as shown in FIG. 1, or musical symbols for notes; in general, a vast range of possible visual cues may be envisaged for this purpose. Cues may be static in space, or may move over the screen following some meaningful path. For example, the cue may move from the top edge of the screen towards the bottom edge as viewed by the user to be prompted, approaching the keyboard corresponding to that user. Cues may be displayed only momentarily, or may persist for some significant duration, possibly even after the key in question has been pressed and released. Cues may flash on and off, or with more or less brightness, or with time varying colors, as desired, to attract the user's attention and/or to convey additional meaning. Such variables may indicate, for example, the force with which the key should be pressed, or the time for which the key should remain pressed. Cues may be coded by color, pattern, or some other visual feature to distinguish between the different users if desired.
FIG. 2 is a top down schematic view of an example keyboard system 200 according to some embodiments. Digital processors 112 and the users of the keyboard apparatuses are omitted from this figure, for simplicity. At the particular state of play indicated, display screen 110 shows displayed image 116 including a visual cue 118A intended to prompt the user of keyboard apparatus 108 to press the third black key from the left of that keyboard apparatus, as viewed by that user.
In some embodiments, there is a spatial association between the position on display screen 110 at which visual cue 118A is displayed and the position of the key being prompted to be pressed. In the particular case shown in FIG. 2, the spatial association is very direct, with cue 118A shown to be in linear alignment with the long axis of the key cued to be pressed. In some embodiments, cue 118A may move along that axial direction, towards or away from the keyboard apparatus 108. To cover the full range of possible keys in embodiments involving linear cue alignment, the width of the display screen required to display the key cues must be at least equal to the width of the keyboard apparatus. In other embodiments, scaled down and/or spatially shifted representations of the keyboard apparatus may be envisaged. In yet other embodiments, instead of or in addition to a spatial association between the cue 118A and the key prompted to be pressed, another feature of the cue such as color, an alphanumeric symbol, or some other coding may be used to convey to the user the identity of the key to be pressed.
In some embodiments, one of the one or more digital processors 112 determines when a key is pressed by either user, and causes the displayed image 116 to include a visualization feature 118B associated with the key determined to have been pressed. Sensors (not shown) may be included in the keyboard apparatuses or be situated externally, and may operate in any way that allows digital processors 112 to make the required determination. Example system 200 of FIG. 2 shows a case where visualization feature 118B indicates that the user of keyboard 104 has pressed the fourth black key from the left of keyboard apparatus 104, as viewed by that user.
The particular case shown in FIG. 2 is typical of some embodiments in which visualization feature 118B is not only displayed in spatial association with the key determined to have been pressed, but additionally that association is a particularly direct one, the feature being in linear alignment with the long axis of that key. The various considerations discussed above regarding the range of possible spatial and other types of visual associations between cues 118A and keys apply equally well to embodiments concerning visualization features 118B.
In some embodiments, it may be helpful to consider two coordinate systems in the plane of display screen 110 as shown in FIG. 2, a first coordinate system defined by axes X1, Y1, oriented with regard to the user of keyboard 104, and a second coordinate system defined by axes X2, Y2, oriented with regard to the user of keyboard 108. While Cartesian coordinate systems are shown for simplicity, non-Cartesian systems may equally well be considered.
In the embodiment of FIG. 2, the position on display screen 110 at which visualization feature 118B is displayed is determined by one of the one or more digital processors I12 with respect to the first coordinate system, to be meaningful to the user of keyboard 104. One or more visual cues, not shown in this figure, may also be positioned with respect to the first coordinate system, to prompt the user of keyboard 104 to press the corresponding key or keys on that keyboard.
The position on display screen 110 at which visual cue 118A is displayed is similarly determined by one of the one or more digital processors I12 with respect to the second coordinate system, to be meaningful to the user of keyboard 108. One or more visualization features, not shown in this figure, may also be positioned with respect to the second coordinate system to indicate to the user of keyboard 108 the corresponding key or keys of keyboard 108 determined to have been pressed.
In some embodiments, one or more of the digital processors may cause a musical composition to be played, audible to the users as an accompaniment or an integral part of the training or performance experience.
While all the embodiments so far discussed have been relevant to two users, using one keyboard apparatus each, other embodiments may be directed to three or four users of a corresponding number of keyboard apparatuses. FIG. 3 shows one possible arrangement, in which an example keyboard system 300 adds a third keyboard apparatus 304 and a fourth keyboard apparatus 308, positioned so that the corresponding third and fourth users will conveniently face two side edges of display screen 310, in between the top and bottom edges faced by the users of keyboard apparatuses 104 and 108, as positioned in other previously described embodiments.
Example system 300 operates in essentially the same way as systems 100 and 200, with the additional option that visual cues and visualization features, relevant to the users of keyboard apparatus 304 and keyboard apparatus 308, may be included in image 316 displayed on display screen 310. Examples of such cues and features are indicated generally by image elements 318. In some embodiments, these image elements may be displayed in spatial association with the keys being cued and/or pressed, as previously discussed. In some embodiments, spatial association may include linear alignment, as previously discussed. In some embodiments, the positions on display screen 310 at which visual cues and/or visualization features relevant to the users playing keyboard apparatuses 104, 304, 108, and 308 are displayed are determined with respect to four differently oriented coordinate systems, each one relevant to one of those users, as discussed with regard to the previously described embodiments.
FIG. 4 illustrates an example keyboard system 400, configured to allow user 402 to play with keyboard apparatus 404, user 406 to play a virtual keyboard 408 displayed on display screen 410, and to allow both users to view display screen 410. One or more digital processers 412 may be provided in keyboard apparatus 404, or in a computing unit 414 as shown, directly or indirectly connected to display screen 410, or may be distributed in various ways between some or all of these elements. One or more of the digital processors 412 displays an image 416 on screen 410 that is directly related to the use of either keyboard apparatus 404, or virtual keyboard 408, or both, by the corresponding user or users.
In some embodiments, one or more of the keyboard apparatuses may include a piano-type keyboard, a qwerty-type keyboard, or both. In some embodiments, the display screen image may include a virtual piano-type keyboard, a virtual qwerty-type keyboard or both.
Embodiments described herein provide various benefits. In particular, embodiments enable multiple keyboard users to enjoy a shared, interactive playing experience that may include training, instruction, and/or real-time feedback on user performance. These benefits may be especially valuable to children and music students.
Although the description has been described with respect to particular embodiments thereof, these particular embodiments are merely illustrative, and not restrictive. Any suitable programming language can be used to implement the routines of particular embodiments including C, C++, Java, assembly language, etc. Different programming techniques can be employed such as procedural or object oriented. The routines can execute on a single processing device or multiple processors.
Particular embodiments may be implemented in a computer-readable storage medium for use by or in connection with the instruction execution system, apparatus, system, or device. Particular embodiments can be implemented in the form of control logic in software or hardware or a combination of both. The control logic, when executed by one or more processors, may be operable to perform that which is described in particular embodiments.
Particular embodiments may be implemented by using a programmed general purpose digital computer, by using application specific integrated circuits, programmable logic devices, field programmable gate arrays, optical, chemical, biological, quantum or nanoengineered systems, components and mechanisms. In general, the functions of particular embodiments can be achieved by any means known in the art. Distributed, networked systems, components, and/or circuits can be used. Communication or transfer of data may be wired, wireless, or by any other means.
It will also be appreciated that one or more of the elements depicted in the drawings/figures can also be implemented in a more separated or integrated manner, or even removed or rendered as inoperable in certain cases, as is useful in accordance with a particular application. It is also within the spirit and scope to implement a program or code that can be stored in a machine-readable medium to permit a computer to perform any of the methods described above.
A “processor” includes any suitable hardware and/or software system, mechanism or component that processes data, signals or other information. A processor can include a system with a general-purpose central processing unit, multiple processing units, dedicated circuitry for achieving functionality, or other systems. Processing need not be limited to a geographic location, or have temporal limitations. For example, a processor can perform its functions in “real time,” “offline,” in a “batch mode,” etc. Portions of processing can be performed at different times and at different locations, by different (or the same) processing systems. A computer may be any processor in communication with a memory. The memory may be any suitable processor-readable storage medium, such as random-access memory (RAM), read-only memory (ROM), magnetic or optical disk, or other tangible media suitable for storing instructions for execution by the processor.
As used in the description herein and throughout the claims that follow, “a”, “an”, and “the” includes plural references unless the context clearly dictates otherwise. Also, as used in the description herein and throughout the claims that follow, the meaning of “in” includes “in”, “on”, and “in close proximity to” unless the context clearly dictates otherwise.
Thus, while particular embodiments have been described herein, latitudes of modification, various changes, and substitutions are intended in the foregoing disclosures, and it will be appreciated that in some instances some features of particular embodiments will be employed without a corresponding use of other features without departing from the scope and spirit as set forth. Therefore, many modifications may be made to adapt a particular situation or material to the essential scope and spirit.

Claims

We claim:

1. A multi-user keyboard system comprising:

a display screen operably connected to a first keyboard apparatus, a second keyboard apparatus, and one or more digital processors;

wherein the display screen is viewable simultaneously by a first user of the first keyboard apparatus and a second user of the second keyboard apparatus; and

wherein an image, directly related to the use of at least one of the first and second keyboard apparatuses by a corresponding one of the first and second users, is displayed on the display screen by at least one of the one or more digital processors.

2. The keyboard system of claim 1, wherein the display screen, the first keyboard apparatus, and the second keyboard apparatus are positioned substantially in the same plane.

3. The keyboard system of claim 1, wherein the displayed image includes a visual cue to prompt either the first user to press a key on the first keyboard apparatus or the second user to press a key on the second keyboard apparatus.

4. The keyboard system of claim 3, wherein the visual cue is displayed in spatial association with the key cued to be pressed.

5. The keyboard system of claim 4, wherein the spatial association includes displaying the visual cue in linear alignment, as viewed by the prompted user, with the key cued to be pressed.

6. The keyboard system of claim 1, wherein one of the one or more digital processors determines when a key is pressed by either one of the first and second users, and causes the displayed image to include a visualization feature associated with the key determined to have been pressed.

7. The keyboard system of claim 6, wherein the visualization feature is displayed in spatial association with the pressed key.

8. The keyboard system of claim 7, wherein the spatial association includes displaying the visualization feature in linear alignment, as viewed by whichever of the first or second users pressed the key, with the key determined to have been pressed.

9. The keyboard system of claim 7, wherein a first coordinate system in the plane of the display screen corresponds to the first user, a second coordinate system in the plane of the display screen corresponds to the second user, and the displayed visualization feature is located at a position, relative to the coordinate system corresponding to whichever of the first and second users pressed the key, determined by the location of the pressed key relative to the keyboard apparatus including the pressed key.

10. A multi-user keyboard system comprising:

a display screen operably connected to a first keyboard apparatus and one or more digital processors;

wherein the display screen displays a virtual keyboard apparatus; and

wherein an image, directly related to the use of at least one of the first keyboard apparatus by a first user and the virtual keyboard apparatus by a second user, and simultaneously viewable by the first and second users, is displayed on the display screen by at least one of the one or more digital processors.

11. The keyboard system of claim 1, wherein the display screen is the display screen of a tablet computer.

12. The keyboard system of claim 1, wherein at least one of the first keyboard apparatus and the second keyboard apparatus includes a piano-type keyboard.

13. The keyboard system of claim 1, wherein at least one of the first keyboard apparatus and the second keyboard apparatus includes a qwerty-type keyboard.

14. A method for providing a musical experience shared by a first user and a second user, the method comprising the following act performed by one or more digital processors:

displaying an image on a display screen operably connected to a first piano-style keyboard apparatus, a second piano-style keyboard apparatus, and the one or more digital processors, the displayed image being directly related to the use of the first piano-style keyboard apparatus by the first user and the use of the second piano-style keyboard apparatus by the second user.

15. The method of claim 14, wherein the display screen, the first keyboard apparatus, and the second keyboard apparatus are positioned substantially in the same plane.

16. The method of claim 14, wherein the displayed image includes a visual cue to prompt at least one of the first and second users to press a key on the corresponding keyboard apparatus, the visual cue being displayed in spatial association with the key to be pressed.

17. The method of claim 14, wherein one of the one or more digital processors determines when a key is pressed by either one of the first and second users, and displays a visualization feature associated with the key determined to have been pressed on the display screen.

18. The method of claim 17, wherein the visualization feature is displayed in spatial association with the pressed key.

19. The method of claim 18, wherein a first coordinate system in the plane of the display screen corresponds to the first user, a second coordinate system in the plane of the display screen corresponds to the second user, and the displayed visualization feature is located at a position, relative to the coordinate system corresponding to whichever of the first and second users pressed the key, determined by the location of the pressed key relative to the keyboard apparatus including the pressed key.

20. The method of claim 14, further comprising the act, performed by one of the one or more digital processors, of playing a musical composition.