HK1194702B - Expanding operating device and operating system - Google Patents

Description

Extended operation device and operation system

The invention is a divisional application of an invention patent application with the application number of 200810175060.1 and the application date of 2008, 10 and 24 and named as 'expansion operation device and operation system'.

Cross reference to related applications

The publications of Japanese patent applications No.2008-181419, No.2008-181420, and No.2008-181421 are incorporated herein by reference.

Background

Technical Field

The invention relates to an extended operation device and an operation system. More particularly, the present invention relates to an extended operation device which is connected to an operation device by means of a connector so that the extended operation device is used as one unit together with the operation device, and to an operation system in which a plurality of operation devices are connected to perform an operation.

Description of the Related Art

An example of this device is disclosed in "http:// www.nintendo.co.jp/wii/controllers/index. In the related art, a "Wii remote controller" (Wii: registered trademark) has a three-axis motion sensor for detecting inclination and motion change of itself. "Nunchaku" also has a three axis motion sensor. The Wii remote controller as the main controller is provided with an extension connector, and "Nunchaku" as the extension controller is connected to the Wii remote controller via the extension connector.

In some games, a player operates by holding a Wii remote controller with one hand and moving the Wii remote controller. In another game, the Wii remote controller is held with one hand and the Nunchaku is held with the other hand, and the player performs an operation by moving each of the Wii remote controller and the Nunchaku.

However, since the Wii remote controller and Nunchaku are provided with only an acceleration sensor as a motion sensor, it is not easy to detect a turning movement especially in the main plane. More specifically, if a spin is played in a tennis game, for example, an angular velocity or a rotation angle around a Wii remote controller must be detected with high accuracy. These variables can be calculated from the accelerations in the three axis directions detected by the acceleration sensors, but each acceleration in the three axis directions also includes an acceleration component due to gravity, and therefore complicated calculation is required to evaluate the angular velocity or the rotation angle with high accuracy.

This requires the introduction of such a calculation routine into each game program, which imposes a great burden on the developer. Further, by repeatedly executing these calculations, a large burden is imposed on the CPU of the game device. Therefore, it is considered that a gyro sensor for detecting an angular velocity is connected to the Wii remote controller via the extension connector.

However, even in the state where the gyro sensor is connected, Nunchaku cannot be used, and thus a game cannot be played using both the Wii remote controller and the Nunchaku.

(II) the motion cannot be detected with high accuracy and convenience only by adding a gyro sensor.

In addition, a strap may be mounted to the Wii remote control, and the wrist of the hand holding the Wii remote control passes through the loop of the strap mounted to the Wii remote control. Further, the connector of Nunchaku is provided with a hook, and a cord of a belt mounted to the Wii remote controller is hung and fixed with the hook of the connector of Nunchaku. Thereby, the connector of Nunchaku and the extension connector of the Wii remote controller are firmly coupled to each other.

On the other hand, as described above, in the case where the gyro sensor for detecting the angular velocity is connected to the Wii remote controller via the extension connector, the gyro sensor is required to be provided with another extension connector so that the game can be played even in a state where the gyro sensor is connected to the extension connector of the Wii remote controller.

(III) however, in the case where the connector of Nunchaku is connected to the extension connector at one side of the gyro sensor, that is, in the case where the gyro sensor exists between the Wii remote controller and the connector of Nunchaku, it is difficult to hang and fix the belt line with the hook of the Nunchaku connector.

Summary of The Invention

It is therefore a primary object of the present invention to provide a new extended operating device and a new operating system.

Another object of the present invention is to provide an extended operation device capable of attaching a sensor to an operation device while allowing another device conventionally connected to the operation device to exert its original function.

It is another object of the present invention to provide an operating system capable of detecting a motion with high accuracy and convenience.

It is a further object of the present invention to provide an operating system in which the connector is difficult to remove.

The present invention adopts the following features to solve the above problems. It is to be noted that the reference numerals and supplementary explanation in parentheses indicate an example of the corresponding relation with the embodiments described later to more easily understand the present invention and do not limit the present invention.

The first invention is an extended operation device which is connected to an operation device via a connector, is used as a unit with the operation device, and includes a housing, a first connector having a first shape which is physically and electrically connected to a connector provided at the operation device, a second connector having a second shape which is connectable to the connector of the first shape, and a sensor.

In a first invention, an expansion operation device (100) has a housing (110), a first connector (106), a second connector (108), and a sensor (104). The first connector has a first shape that can be physically and electrically connected to a connector (42) provided at the operation device. Thus, by connecting the first connector to the connector of the operating device, the extended operating device is physically and electrically connected to the operating device via the two connectors, which allows the extended operating device to be used as a unit with the operating system, and finally attaches the sensor to the operating device.

In another aspect, the second connector has a second shape connectable to the connector having the first shape. Therefore, a connector of another device (e.g., the connector 40 of the second controller 36) that is conventionally connected to the connector of the operation device can also be connected to the second connector. Therefore, if the connector of the other device is connected to the second connector in a state where the first connector is connected to the connector of the operating device, the other device is finally connected to the operating device via the extended operating device.

According to the first invention, the sensor can be attached to the operation device while causing another device conventionally connected to the operation device to exert its original function.

The sensor is thus in the preferred embodiment a gyroscope sensor (angular velocity sensor), but may also be other motion sensors, such as acceleration sensors, velocity sensors, displacement sensors, rotation angle sensors, etc. In addition to the motion sensor, there are an inclination sensor, an image sensor, an optical sensor, a pressure sensor, a magnetic sensor, a temperature sensor, and the like, and in the case of adding any one of the sensors, an operation using an object detected by the sensor becomes possible.

In the present embodiment, the gyro sensor is a three-axis sensor, but may be a two-axis sensor or a single-axis sensor. Among other motion sensors, a three-axis sensor is preferred, but a two-axis sensor or a single-axis sensor may also be employed. In addition, the three-axis gyro sensor is configured by two pieces of the two-axis sensor and the one-axis sensor in the present embodiment, but may be configured by one piece of the three-axis sensor or three pieces of the one-axis sensor.

A second invention is the extended operation device according to the first invention, wherein the sensor is a motion detector for detecting a motion of itself.

In the second invention, the movement of the sensor itself or even of the extended operating device extended and the operating device used as a unit therewith is detected by the motion sensor.

According to the second invention, by separately providing the motion sensor, the operation by the movement of the operation device itself becomes possible.

A third invention is the extended operation device according to the second invention, wherein the motion sensor is a three-axis gyro sensor.

In the third invention, the angular velocities about the three axes are detected by the three-axis gyro sensor. In addition, in the preferred embodiment, the operating device has a three-axis acceleration sensor, and angular velocities about three axes can also be calculated from accelerations in the directions of the three axes in principle, but this requires complicated calculations. However, the addition of a three-axis gyro sensor omits this calculation.

According to the third invention, application development by the operation device becomes easy, and the processing load on the microcomputer for processing operation data from the operation device is reduced.

A fourth invention is an extended operation device according to the second invention, wherein at least one through hole portion is provided on a surface of the connector to which the operation device is provided, and further comprising a projection member capable of being fitted to the through hole portion.

In the fourth invention, at least one through-hole portion (82 a, 82 b) is provided on a surface of the connector to which the operation device is provided, and the expanding operation device further includes a boss member (112 Fa, 112 Fb) capable of being fitted to the through-hole portion. The projection member is fitted into the through-hole portion, whereby a firm fixed state can be maintained between the expansion operation device and the operation device even during operation.

A fifth invention is an expansion operation device according to the fourth invention, wherein the projection member is a claw member capable of opening and closing and further comprises a projection lock mechanism for locking the opened and closed state thereof.

In the invention of the fifth invention, the claw member capable of opening and closing is fitted into the through hole portion. The opening and closing of the claw members are locked by a protrusion locking mechanism (114).

According to the fifth invention, the claw member is locked in the state where the claw member is fitted into the through hole portion, which ensures a firm fixed state.

A sixth invention is the expanding operating device according to the second invention, and further includes a recess from a side of the first connector to a lower surface of the housing.

In a preferred embodiment, the operating device has a housing (78) and a through hole (82 c) from a surface to a lower surface of the connector of the housing, the belt (24) passes through the through hole (82 c), and in the sixth invention, a recess (110 a) extends from a side of the first connector to the lower surface of the housing of the expansion operating device, and therefore, in a state where the expansion operating device is connected to the operating system, the through hole for the belt is exposed from the recess.

According to the sixth invention, the belt can be attached and detached even in a state where the extension operation means remains connected to the operation means.

A seventh invention is the expanding operating device according to the second invention, further comprising a cover capable of covering the second connector and being tethered to the housing when detached.

In the seventh invention, a cover (116) for covering the second connector is tethered to the housing of the expansion operation device when detached from the second connector.

According to the seventh invention, the cover can be prevented from being lost.

An eighth invention is the extended operation device according to the second invention, acquiring data from the external device through the second connector, and outputting the data from the external device and the data from the motion sensor to the operation device through the first connector.

In the eighth invention, data from an external device (36) is acquired through the second connector in the extended operation device, and then the data is output to the operation device through the first connector as with the data from the motion sensor in the extended operation device.

According to the eighth aspect of the present invention, since data from the external device is output to the operation device via the extended operation device, the external device itself can function even if a motion sensor is added.

A ninth invention is an extended operation device according to the eighth invention, further comprising: output data control means for controlling output data including data from the sensor; a bus switch directly connecting the line on one side of the second connector to one side of the first connector; and a bus switch control device that switches connection of the bus switch between on and off, wherein when the bus switch is off, the line on the second connector side is connected to the first connector side via the output data control device.

In the ninth invention, output data including data from the sensor is controlled by the output data control device (102). The line on the side of the second connector may be directly connected to the side of the first connector via a bus Switch (SW), the on and off switching by the bus switch being switched by a bus switch control means (102). When the bus switch is turned off, the line on the second connector side is connected to the first connector side via the output data control device.

According to the ninth invention, when the bus switch is turned on, data from the external device connected to the second connector is output to the operating device connected to the first connector without being controlled by the output data control device. On the other hand, when the bus switch is turned off, data from the external device is under the control of the output data control device together with data from the sensor, and therefore, a collision when outputting both data can be avoided.

In addition, in the preferred embodiment, the output data control means turns on the bus switch when the application does not use the data from the gyro sensor, and turns off the bus switch when the application uses the data from the gyro sensor. The output data control means alternately outputs data from the external device and data from the sensor.

The tenth invention is the extended operation device according to the ninth invention, further comprising sensor power management means for switching power supply to the sensor between on and off, and the bus switch control means turns on the connection with the bus switch when the power supply to the sensor is turned off.

In the tenth invention, the sensor power management device (102) switches the power supply to the sensor between on and off. When the power of the sensor is cut off, the connection with the bus switch is conducted through the bus switch control device. Therefore, when the power of the sensor is cut off and thus the connection to the bus switch is turned on, data from the external device reaches the operating device without passing through the extended operating device.

According to the tenth invention, by cutting off power of the sensor when data from the sensor is not utilized, electric power consumption can be reduced.

An eleventh invention is an extended operation device according to the tenth invention, further comprising connection detection means for detecting whether or not a predetermined device is connected to the second connector, wherein the output data control means alternately outputs the first data output from the predetermined device and the second data based on the output of the sensor from the first connector when the connection with the bus switch is cut and the predetermined device is connected to the second connector.

In the eleventh invention, whether or not a predetermined device (36) is connected to the second connector is detected by the connection detecting means (102). When the connection with the bus switch is cut off and the predetermined device is connected to the second connector, as a result of the control, the first data output from the predetermined device and the second data based on the output from the sensor are alternately output from the first connector (S31).

According to the eleventh invention, a collision between the first data and the second data can be avoided.

A twelfth invention is the expanding operation device according to the third invention, further comprising: angular velocity determination means for determining the magnitude of the angular velocity of each axis detected by the gyro sensor; and angular velocity data output control means for outputting the first angular velocity data with low accuracy in the case where the angular velocity is large, and outputting the second angular velocity data with the same amount of data as the first angular velocity data and with high accuracy in the case where the angular velocity is small.

In the twelfth invention, the magnitude of the angular velocity of each axis detected by the gyro sensor is determined by the angular velocity determination means (102). The angular velocity data output control means (102) outputs first angular velocity data with low accuracy in the case where the angular velocity is large, and outputs second angular velocity data with the same amount of data as the first angular velocity data and with high accuracy in the case where the angular velocity is small.

According to the twelfth invention, when the angular velocity is large, the accuracy of the angular velocity data is made low, and when the angular velocity is small, the accuracy of the angular velocity data is made high, whereby the detection accuracy of the angular velocity is improved and the detection range of the angular velocity is extended without increasing the data amount of the angular velocity data.

The thirteenth invention is an operating system comprising: a first operating device including a first housing elongated in shape and having a thickness capable of being held by one hand, and a first operating portion provided on an upper surface of the first housing, the first operating portion being provided at a position such that the first operating portion is operable by a thumb of the hand; a second operating portion provided on a lower surface of the first casing, the second operating portion being provided at a position where the second operating portion can be operated by an index finger of a hand when a thumb of the hand is placed on the first operating portion; a grip portion formed on the first casing, the grip portion being disposed at a position where the grip portion can be gripped by a palm and other fingers of a hand when a thumb and an index finger of the hand are placed on the first operating portion and the second operating portion of the first casing, respectively; a first acceleration sensor; an image pickup device provided at an end opposite to the grip portion of the first housing and a first connector provided at an end of the first housing on the grip portion side, and a second operation device including at least a second housing, a second connector connectable to the first connector, and a gyro sensor, wherein an operation is performed by connecting the second operation device to the first operation device.

In the thirteenth invention, the operating system (14) includes a first operating device (34) and a second operating device (100). The user performs an operation by connecting the second operation device to the first operation device.

The first operating device (34) includes a first housing (78) having an elongated shape and a thickness capable of being held by one hand. A first operation portion (80 a, 80d, etc.) is provided on an upper surface of the first casing, the first operation portion is provided at a position where the first operation portion can be operated by a thumb of a hand, and a second operation portion (80 h) is provided at a position where an operation can be performed on a lower surface of the first casing with an index finger of one hand when the thumb of one hand is placed on the first operation portion. The first housing is further provided with a grip portion (78 a) at a position where the thumb and the index finger of the hand are respectively placed on the first operating portion and the second operating portion so that the grip portion can be gripped by the palm and the other fingers of the hand. Therefore, the first operating portion and the second operating portion are located at the front end of the first casing, and the grip portion is located at the rear end of the first casing, and when the first casing is held with one hand, the user places the thumb on the upper surface of the first operating portion, places the index finger on the lower surface of the second operating portion, and grips the grip portion with the palm and other fingers.

Further, the first operating device further includes a first acceleration sensor (84), and the first housing is further provided with an image pickup device (81) at an end opposite to the grip portion of the housing, and a first connector (42) at an end of the grip portion of the housing. In another aspect, the second operating device includes a second housing (110), a second connector (106) connectable to the first connector, and a gyro sensor (104). Thus, the second operating device is connected to the first operating device by the user connecting the second connector to the first connector. The second operating device thus connected to the first operating device is located on the rear end side of the first operating device, i.e., in the vicinity of the wrist of the hand holding the first operating device. The acceleration value and the angular velocity value output from the first acceleration sensor and the gyro sensor indicate acceleration and angular velocity from the first and second operating devices, respectively.

According to the thirteenth invention, the gyro sensor as the means for detecting the angular velocity is located near the wrist so that the angular velocity is always detected near the rotation shaft, making it easy to detect the angular velocity, and at the same time, since the acceleration sensor is located in front of the wrist, making it easy to detect the centrifugal force. That is, when the operation device is regarded as a whole, the acceleration sensor is in front and the gyro sensor is in back, and therefore, it is possible to provide an operation system capable of accurately detecting the movement of the hand of the player. Further, by placing the second operating device at the rear end of the first operating device, the position of the center of gravity of the operating device integrated with the second operating device is moved rearward. The method of holding the holding portion by placing the fingers on the first operating portion and the second operating portion is the same as the method of holding the first operating device, and therefore, in the case of rotating around the wrist, operability can be greatly improved.

A fourteenth invention is an operating system according to the thirteenth invention, wherein the second operating device further comprises a third connector, the operating system further comprising a third operating device comprising a fourth connector connectable to the third connector, a third housing, a second acceleration sensor, and a direction-inputtable lever, wherein the operation is performed by connecting the third operating device to the second operating device.

In the fourteenth invention, the operating system further includes a third operating device (36). The second operating device further comprises a third connector (108), and the third operating device comprises a fourth connector (40) connectable to the third connector. Therefore, by the user further connecting the fourth connector to the third connector, the third operating device is connected to the second operating device and to the first operating device via the second operating device.

The third operating device includes a third housing (142), a second acceleration sensor (90), and a stick (88 a) capable of inputting a direction, and data containing an acceleration value of the second acceleration sensor and direction information of the stick is transmitted to the first operating device via the second operating device.

According to the fourteenth invention, the user can perform various operations according to the movement of each device itself and the direction of the stick by holding the first operating device integrated with the second operating device with one hand and holding the third operating device with the other hand.

A fifteenth invention is an operating system according to the thirteenth invention, and further comprising a third operating device including a third casing, a second acceleration sensor, and a stick capable of performing a directional input, wherein the operation is performed by connecting the third operating device to the second operating device via wireless communication.

In the fifteenth invention, the operating system further includes a third operating device (36). The third operating device is connected to the second operating device by wireless communication and is also connected to the first operating device via the second operating device. The third operating device includes a third housing (142), a second acceleration sensor (90), and a stick (88 a) capable of performing directional input, and can transmit an acceleration value of the second acceleration sensor and direction information of the stick to the first operating device through the second operating device.

According to the fifteenth invention, the user can perform various operations according to the movement of each device itself and the direction of the stick by holding the first operating device integrated with the second operating device with one hand and holding the third operating device with the other hand. Furthermore, there is no cable between the second operating device and the third operating device, which makes the operation more convenient.

The sixteenth invention is an operating system according to the fourteenth invention, wherein the third operating device includes a second acceleration sensor and a stick inside a third housing, and the third housing and the fourth connector are connected via a bendable cable (38).

In the sixteenth invention, a cable is provided between the second operating device and the third operating device.

According to the sixteenth invention, the cost can be reduced compared to the case of wireless connection.

A seventeenth invention is an operating system according to the fourteenth invention, and the fourth connector has a shape connectable to the first connector in place of the third connector.

In the seventeenth invention, the third operating device may be connected to the first operating device via the second operating device or directly.

The eighteenth invention is an extended operation device having a second connector, a housing, and a gyro sensor using the second operation device of the invention according to claim 13 or 17.

Also with the eighteenth invention, as with the thirteenth invention, safety and detection accuracy can be improved.

A nineteenth invention is the operating system according to the thirteenth invention, and the second operating device further includes output data control means for controlling data output to the first operating device via the second connector, and the first operating device further includes communication means for transmitting data based on at least outputs from the first operating part, the second operating part, the first acceleration sensor, and the image pickup device, and data output from the second operating device via the second connector.

In the nineteenth invention, the second operating device further includes an output data control device (102), and the data output to the first operating device via the second connector is controlled by the output data control device. The first operating device further includes a communication device (92) through which data based on outputs from the first operating portion, the second operating portion, the first acceleration sensor, and the image pickup device and data output from the second operating device via the second connector are transmitted.

A twentieth invention is the operating system according to the nineteenth invention, and the second operating device further includes a third connector, and the operating system further includes a third operating device including a fourth connector connectable to the third connector, a third housing, a second acceleration sensor, and a stick capable of inputting a direction, and connecting the third operating device to the second operating device to perform an operation, wherein the communication device further transmits data output from the third operating device via the fourth connector.

In the twentieth invention, the operating system further includes a third operating device (36). The second operating device further comprises a third connector (108), and the third operating device comprises a fourth connector (40) connectable to the third connector. Therefore, by the user connecting the fourth connector to the third connector, the third operating device is connected to the second operating device and further connected to the first operating device via the second operating device. The third operating device also includes a third housing (142), an acceleration sensor (90), and a stick (88 a) capable of inputting a direction, and data including an acceleration value of the second acceleration sensor and direction information of the stick is also transmitted via the second operating device by the communication device of the first operating device.

According to the twentieth invention, the user can perform various operations based on the movement of each device itself and the direction of the stick by holding the first operating device integrated with the second operating device with one hand and holding the third operating device with the other hand.

A twenty-first invention is an operating system according to the twentieth invention, and the second operating device further includes: a bus switch for directly connecting the line on the third connector side to the second connector side; and a bus switch control means for switching the bus switch between on and off, wherein when the bus switch is turned off, the line on the third connector side is connected to the second connector side via the output data control means.

In the twenty-first invention, the line on the third connector side may be directly connected to the side of the second connector via a bus Switch (SW), and the connection is switched by the bus switch control means (102). When the bus switch is turned off, the line on the third connector side is connected to the second connector side via the output data control device.

According to the twenty-first invention, when the bus switch is turned on, data from the third operating device connected to the third connector is output to the first operating device connected to the second connector without being controlled by the output data control device. On the other hand, when the bus switch is turned off, the data from the third operating device is under the control of the output data control device together with the data from the gyro sensor, and therefore the occurrence of a collision can be avoided when outputting both data.

In addition, in a preferred embodiment, the output data control means turns on the bus switch when the application does not utilize data from the gyro sensor, and turns off the bus switch when the application utilizes data from the gyro sensor. The output data control means alternately outputs data from the third operating means and data from the gyro sensor.

A twenty-second invention is an operating system according to the twenty-first invention, further comprising gyro sensor power management means for switching power supply to the gyro sensor between on and off, wherein the bus switch control means turns on the connection of the bus switch when the power supply to the gyro sensor is off.

In a twenty-second invention, a sensor power management device (102) switches power supply to a gyro sensor between on and off. When the power supply of the gyro sensor is cut off, the connection of the bus switch is conducted by the bus switch control device. Therefore, when the power supply of the gyro sensor is cut off, the connection of the bus switch is turned on, and the data from the third operating device reaches the first operating device without passing through the second operating device.

According to the twenty-second invention, by cutting off power supply to the gyro sensor when data from the gyro sensor is not utilized, power consumption can be reduced.

A twenty-third invention is the operating system according to the twenty-second invention, the second operating system further comprising connection detecting means for detecting whether or not the third operating means is connected to the third connector, the output data controlling means alternately outputting the first data input from the third operating means and the second data based on the output from the gyro sensor to the first operating means when the connection of the bus switch is cut off and the third operating means is connected to the third connector.

In the twenty-third invention, whether or not the third operating device (36) is connected to the third connector is detected by the connection detecting device (102). When the connection of the bus switch is cut off and the third operating device is connected to the third connector, as a control result of the output data control device, the first data input from the third operating device and the second data based on the output from the gyro sensor are alternately output from the second connector.

According to the twenty-third invention, it is possible to avoid the generation of a collision between the first data and the second data.

A twenty-fourth invention is an operating system which has a first operating device, a second operating device, and a third operating device, and in which an operation is performed by connecting the first operating device, the second operating device, and the third operating device or by connecting the first operating device and the third operating device, the first operating device includes: a motion sensor for detecting a motion of the first operating device itself; a belt mounting portion to which a belt is mountable, and a first connector, and the second operating device includes a second connector connectable to the first connector, a third connector, and a cover capable of covering the third connector and being tethered to the second operating device in a state detached from the third connector, and the third operating device includes a fourth connector selectively connectable to the first and third connectors, and a hook provided in the vicinity of the fourth connector, wherein the hook is capable of hooking the belt when the first operating device and the third operating device are connected by a connecting structure between the first connector and the fourth connector, and hooking the cover when the second operating device and the third operating device are connected by a connecting structure between the third connector and the fourth connector.

In a twenty-fourth invention, an operating system (14) has a first operating device (34), a second operating device (100), and a third operating device (36). The user performs an operation by connecting the first operating device, the second operating device, and the third operating device or by connecting the first operating device and the third operating device. Specifically, the first operating device has a first connector (42), the second operating device has a second connector (106) and a third connector (108), and the third operating device has a fourth connector (40). The second connector is connectable to the first connector and the fourth connector is selectively connectable to the first and third connectors. The first operating device, the second operating device and the third operating device are connected to each other by the user connecting the second connector to the first connector and further connecting the fourth connector to the third connector. The first operating device and the third operating device are connected to each other by connecting the fourth connector to the first connector.

Further, the first operating device further includes a motion sensor (84), and the motion of the first operating device itself is detected by the motion sensor.

The first operating device further includes a belt mounting portion (82 c) to which the belt (24) is mounted. The second operating device further comprises a cover (116) and covers the third connector by the cover. The cover is captive to the second operating means when removed from the third connector. The third operating device further includes a hook (144) disposed near the fourth connector and adapted to hook a belt mounted to the first operating device when the first operating device is coupled to the third operating device and to hook a cover tethered to the second operating device when the third operating device is coupled to the second operating device.

According to the twenty-fourth invention, by hooking and holding the cover in place with the hook, the fourth connector is difficult to detach from the third connector.

A twenty-fifth invention is an operating device (100) serving as a second operating device in the operating system according to the twenty-fourth invention and including a second connector, a third connector, and a cover.

Also with the twenty-fifth invention, the connector is difficult to detach as with the twenty-fourth invention.

A twenty-sixth invention is an operating system according to the twenty-fourth invention, and the motion sensor is an acceleration sensor.

In the twenty-sixth invention, the acceleration may be detected by an acceleration sensor.

In general, the motion of an object can be represented by variables such as acceleration, velocity, angular velocity, etc., but velocity and angular velocity can be calculated from the acceleration. According to the twenty-sixth invention, the acceleration is detected to perform the operation by utilizing the movement of the operation device itself.

A twenty-seventh invention is the operating system according to the twenty-fourth invention, and the second operating device further includes a gyro sensor (104).

According to the twenty-seventh invention, a gyro sensor may be added as necessary. By adding the gyro sensor, in a processing apparatus (application) that processes operation data from the operating system, there is no need to calculate an angular velocity, thereby reducing the processing load.

A twenty-eighth invention is the operating system according to the twenty-fourth invention, and the third operating device further includes an acceleration sensor (90) and a stick (88 a) capable of inputting a direction.

According to the twenty-eighth invention, by providing an acceleration sensor to each of the first operating device and the third operating device, the user can independently move the first operating device and the third operating device. Further, by providing the stick to the third operating device, the user can input the direction with the stick when moving the third operating device itself. Whereby various operations may be performed.

According to the present invention, the operating device can be attached with a sensor while ensuring that other devices conventionally connected to the operating device exert their original functions.

According to the present invention, an operating system that can be easily operated by a player can be provided. Further, an operation system capable of detecting the movement of the operation device with high accuracy can be provided.

According to the present invention, since the connector of the third operating device (Nunchaku) is difficult to be detached from the extension connector of the second operating device (gyro sensor unit), the security of the operating system can be maintained even if the second operating device is added between the first operating device (Wii remote controller) and the third operating device.

The above and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.

Brief Description of Drawings

FIG. 1 is a block diagram showing the configuration of one embodiment of the present invention;

fig. 2 is a diagram showing an external appearance of a first controller applied to the embodiment of fig. 1, fig. 2(a) is a perspective view of the first controller viewed from the rear upper side, and fig. 2(B) is a perspective view of the first controller viewed from the front lower side;

fig. 3 is a diagram showing an external appearance of a second controller applied to the embodiment of fig. 1, fig. 3(a) is a perspective view of the second controller viewed from the rear upper side, and fig. 3(B) is a perspective view of the second controller viewed from the front lower side;

fig. 4 is a diagram showing an outer shape of a connector of the second controller;

fig. 5 is a view showing a manner in which a belt cord mounted to a first controller is hooked and held in place by a hook of a connector in a state in which a connector of a second controller is connected to the first controller;

fig. 6 is a diagram showing an external shape of a gyro sensor unit applied to the embodiment of fig. 1, fig. 6(a) is a perspective view of the gyro sensor unit viewed from the front upper side, and fig. 6(B) is a perspective view of the gyro sensor unit viewed from the rear lower side;

fig. 7 is a diagram showing the structure of a gyro sensor unit;

fig. 8 is a diagram showing a state in which a gyro sensor unit is connected to a first controller;

fig. 9 is a diagram of a state in which the second controller is connected to the first controller via the gyro sensor unit;

FIG. 10 is a block diagram of the electrical configuration of the embodiment of FIG. 1;

FIG. 11 is a block diagram showing the electrical configuration of all controllers suitable for use in the embodiment of FIG. 1;

fig. 12 is a block diagram showing an electrical configuration of a gyro sensor unit provided between a first controller and a second controller in the controllers shown in fig. 11;

fig. 13 is a diagram showing a format of data processed by the gyro sensor unit, and fig. 13(a) is a diagram showing a format of gyro data, and fig. 13(B) is a diagram showing a format of second controller data;

fig. 14 is a diagram showing a table in which the control of the gyro sensor unit by the microcomputer is described for each mode;

fig. 15 is a diagram showing mode switching applied to the gyro sensor unit. Fig. 15(a) is a diagram showing mode switching when the application is in a gyro-compatible form, and fig. 15(B) is a diagram showing mode switching when the application is in a gyro-incompatible form;

fig. 16 is a flowchart showing a part of the operation of the microcomputer of the gyro sensor unit;

fig. 17 is a flowchart showing another part of the operation of the microcomputer of the gyro sensor unit;

FIG. 18 is a diagram showing the manner in which a player operates a controller;

fig. 19 is a block diagram showing an electrical configuration of all controllers applied to another embodiment.

Detailed description of the preferred embodiments

Referring to FIG. 1, a gaming system 10 in one embodiment of the invention includes a gaming device 12 and a controller 14. The gaming device 12 is a game console. The controller 14 is an input device or an operation device for a user or a player. The gaming device 12 and the controller 14 are connected by radio.

The game device 12 includes a substantially rectangular parallelepiped housing 16, and the housing 16 is provided with a disk slot 18 and a memory card slot cover 20 on a front surface. An optical disk 66 (fig. 10), which is one example of an information storage medium storing game programs and data, is inserted from the disk slot 18 into the disk drive 54 (see fig. 10) located in the housing 16. A connector 62 (see fig. 10) for an external memory card is provided in the memory card slot cover 20, and a memory card (not shown) is inserted through the connector 62. The game program or the like read out from the optical disk 66 (fig. 10) is loaded with an external memory card to be temporarily stored, and game data (result data or processing data of the game) or the like of the game played with the game system 10 is stored (saved). It is to be noted that the storage of the above-described game data may be performed on an internal memory such as a flash memory instead of an external memory card.

The game device 12 has an AV cable connector (not shown) on the rear surface of the housing 16, and by means of this connector, the game device 12 is connected to a monitor (display) 30 via an AV cable 28. The monitor 30 is typically a color television receiver, and inputs a video signal from the game device 12 to a video input terminal of the color television and inputs an audio signal to an audio input terminal thereof through the AV cable 28. Accordingly, a game image of, for example, a three-dimensional (3D) video game is displayed on the screen of the color television (monitor) 30, and stereo game sounds such as game music, sound effects are output from the integrated speaker 32.

Further, around the monitor 30 (in the present embodiment, on the upper side of the monitor 30), a marker unit 22 including two infrared LEDs (markers) 22a and 22b is provided. The markers 22a and 22b output infrared rays to the monitor 30.

Further, the power supply of the game device 12 is done by means of a general-purpose AC adapter (not shown). The AC adapter plugs into a standard wall outlet for home use and converts the mains electricity into a low DC voltage signal suitable for driving the gaming device 12. In another embodiment, a battery may be used as the power source. The flag unit 22 is connected to the game device 12 through a power cord, not shown, to obtain power.

The controller 14, which will be described in detail later, includes a first controller 34 and a second controller 36 that can be held by one hand, respectively, and a gyro sensor unit 100 mounted to the first controller 34. A connector 42 (fig. 2a and 11) is provided on the rear end surface of the first controller 34, a connector 40 (fig. 4 and 11) is provided on one end of the cable 38 extending from the rear end of the second controller 36, and connectors 106 and 108 (fig. 6a, 6B, 7 and 11) are provided on the front end surface and the rear end surface of the gyro sensor unit 100, respectively. The connector 106 at the front end face of the gyro sensor unit 100 may be connected to the connector 42 of the first controller 34, and the connector 40 of the second controller 36 may be connected to the connector 42 of the first controller 34 or the connector 108 at the rear end face of the gyro sensor unit 100.

By connecting the connector 106 to the connector 42, the gyro sensor unit 100 is physically and electrically connected to the first controller 34. Angular velocity data indicating the angular velocity of the first controller 34 is output from the gyro sensor unit 100 thus mounted (connected as a unit) to the first controller 34.

With the gyro sensor unit 100 thus mounted to the first controller 34, the connector 40 of the second controller 36 is connected to the connector 108 at the rear end face of the gyro sensor unit 100. That is, the connector 42 has a structure that can be selectively connected to either the connector 106 or the connector 40, and the connector 40 has a structure that can be selectively connected to either the connector 42 or the connector 108. Therefore, the connector 106 and the connector 108 provided to the gyro sensor unit 100 are not actually connected but have a shape that can be connected to each other since they are part of the same housing. Input data from the second controller 36 is applied to the first controller 34 via the cable 38 and the gyro sensor unit 100. The first controller 34 transmits controller data including input data from the first controller 34 itself, angular velocity data from the gyro sensor unit 100, and input data from the second controller 36 to the game device 12.

On the other hand, in the case where the connector 40 is connected to the connector 42, the operation data or the input data from the second controller 36 is applied to the first controller 34 via the cable 38, and the first controller 34 transmits controller data including the input data from the first controller 34 itself and the input data from the second controller 36 to the game device 12.

In the system for transmitting input data from the first controller 34 and input data from the second controller 36 here, the amount of data transmitted at one time is sometimes designed to be unable to be attached, but in the case of attaching the gyro sensor unit 100, angular velocity data from the gyro sensor unit 100 and input data from the second controller 36 are alternately output to the first controller 34, which allows transmission of both data. The data control may be implemented by the gyro sensor unit 100 so that the first controller 34 and the second controller 36 do not need to be changed in design.

Therefore, the gyro sensor unit 100 is an extension unit for attaching a gyro function to the first controller 34 by utilizing the existing first controller 34 and second controller 36 in the original manner.

In the gaming system 10, the user powers on the gaming device 12 to play the game (or other application), then selects the appropriate optical disc 66 for storing the video game (or another application that the player wishes to play), and loads the optical disc 66 into the disc drive 54 through the disc slot 18 of the gaming device 12. In response, gaming device 12 begins executing a video game or another application based on the software stored on optical disc 66. The user operates the controller 14 to apply inputs to the gaming device 12.

Fig. 2 shows an example of the outer shape of the first controller 34. Fig. 2(a) is a perspective view of the first controller 34 viewed from the rear upper side, and fig. 2(B) is a perspective view of the first controller 34 viewed from the front lower side.

The first controller 34 has a housing 78 formed, for example, by plastic molding. The housing 78 is formed in an approximately rectangular parallelepiped shape with the front-rear direction (the illustrated Z-axis direction) as the longitudinal direction, and has a size sufficient for a child or an adult to hold with one hand. For example, the housing 78 has approximately the same length or width as a human palm. The player can perform a game operation by means of the first controller 34, i.e., by pressing a button provided on the first controller 34 and changing the position and orientation of the first controller 34 itself.

The housing 78 is provided with a plurality of operation buttons. That is, a cross key 80a, an X button 80b, a Y button 80c, an a button 80d, a selection switch 80e, a menu switch 80f, and a start key 80g are provided on the upper surface of the housing 78. Meanwhile, a concave portion is formed on the lower surface of the housing 78, and a B button 80h is provided on a surface of the concave portion inclined rearward. Each of the buttons (switches) 80 a-80 h is given an appropriate function according to a game program executed by the game device 12. Further, the housing 78 has a power switch 80i for turning on and off the power supply of the main body of the game device from a remote position on the upper surface. The buttons (switches) provided on the first controller 34 may be collectively referred to by reference numeral 80.

The housing 78 is provided with an acceleration sensor 84 (fig. 11) for detecting accelerations in three axial directions (i.e., the left-right direction, the up-down direction, and the front-rear direction) of X, Y and Z shown in fig. 2. Alternatively, a biaxial acceleration sensor for detecting accelerations in any two directions of the left-right direction, the up-down direction, and the front-rear direction may be used as the acceleration sensor 84 according to constraints such as the shape of the housing 78, the holding method of the first controller 34, and the like. In some cases, a single axis acceleration sensor may also be used.

A light incident port 78b is formed on the front surface of the case 78, and a photographic information arithmetic section 81 is further provided in the case 78. The imaging information arithmetic section 81 is constituted by a camera that images infrared rays and an arithmetic operation section that calculates coordinates of an imaging object in an image, and captures a subject scene (scene) including the above-described markers 22a and 22b by infrared rays to calculate position coordinates of the markers 22a and 22b in the subject scene.

The connector 42 is provided on the rear surface of the housing 78. The connector 42 is used to connect other devices to the first controller 34. In the present embodiment, the connector 42 is connected to the connector 40 of the second controller 36 or the connector 106 of the gyro sensor unit 100.

Further, on the rear surface of the housing 78, a pair of through holes 82a and 82b are formed in positions symmetrical to each other (X-axis direction) with the connector 42. The pair of through holes 82a and 82b are used to insert hooks 112Fa and 112Fb (fig. 6 (a)) to fix the gyro sensor unit 100 to the rear surface of the housing 78. A through hole 82c for mounting the belt 24 (fig. 5) is also provided in the rear surface of the housing 78.

Fig. 3 is a diagram showing one example of the external shape of the second controller 36 itself. Fig. 3(a) is a perspective view of the second controller 36 viewed from the rear upper side, and fig. 3(B) is a perspective view of the second controller 36 viewed from the front lower side. In fig. 3, the cable 38 of the second controller 36 is omitted.

The second control 36 has a housing 86 formed, for example, by plastic molding. The housing 86 is formed in a shape that is approximately thin and oblong in a plan view in the front-rear direction (Z-axis direction) and has a width in the left-right direction (X-axis direction) at the rear end that is narrower than the width in the left-right direction at the front end. Further, the housing 86 has a shape that is curved as a whole in a side view and is curved downward from a horizontal portion at the front end to the rear end. The housing 86, like the first control 34, is of a size small enough to be held in one hand entirely by a child or adult, and has a longitudinal length (in the Z-axis direction) slightly shorter than the housing 78 of the first control 34. Even with the second controller 36, the player can perform game operations by operating buttons and a stick and by changing the position and orientation of the controller itself.

An analog joystick 88a is provided at the front end of the upper surface of the housing 86. A slightly backward inclined front end is provided at an end of the housing 86, and a C button 88b and a Z button 88C arranged vertically (in the Y axis direction in fig. 3) are provided at the front end. The analog joystick 88a and the respective buttons 88b and 88c are given appropriate functions according to the game program executed by the game device 12. The analog joystick 88a and the various buttons 88b, 88c provided on the second controller 36 may be collectively referred to by the reference numeral 88.

An acceleration sensor 90 (fig. 11) is provided in the housing 86 of the second controller 36. An acceleration sensor identical to the acceleration sensor 84 in the first controller 34 may be used as the acceleration sensor 90. More specifically, a three-axis acceleration sensor is employed in the present embodiment, and the three-axis acceleration sensor detects acceleration in each of three axial directions, for example, the up-down direction (the illustrated Y-axis direction), the left-right direction (the illustrated X-axis direction), and the front-rear direction (the illustrated Z-axis direction) of the second controller 36. Therefore, similar to the case of the first controller 34, an appropriate arithmetic process is performed on the detected acceleration, thereby calculating the inclination and the gyration of the second controller and the orientation of the acceleration sensor 90 in the direction of gravity. Further, like the second controller 36, the motion applied to the first controller 34 may be calculated by swinging or the like.

Fig. 4 shows an example of the outer shape of the connector 40 of the second controller 36. Fig. 4 is a perspective view of the connector 40 viewed from the front lower side. Here again, cable 38 is omitted. The connector 40 has a housing 142 formed by plastic molding, for example. A hook 144 is provided on the lower surface of the housing 142. As shown in fig. 5, when the connector 40 is directly connected to the first controller 34 (the connector 42), the hook 144 catches and fixes the cord of the belt 24 attached to the first controller 34 from the inside. The connector is securely held by hooking and securing the cord of the strap 24 to the hook 144.

Fig. 6 shows an example of the outer shape of the gyro sensor unit 100, fig. 6(a) is a perspective view of the gyro sensor unit 100 viewed from the front upper side, and fig. 6(B) is a perspective view of the gyro sensor unit 100 viewed from the rear lower side.

The gyro sensor unit 100 has a housing 110 formed by, for example, plastic molding. The housing 110 has a substantially rectangular parallelepiped shape and a length 1/5 that is the length of the housing 78 of the first controller 34 and a width and thickness that is approximately equal to the housing 78. Even if the first controller 34 is mounted with the gyro sensor unit 100, the player can perform a game operation by changing the position and orientation of the first controller 34 itself.

The aforementioned connectors 106 and 108 are provided on the front and rear surfaces of the housing 110, a pair of release buttons 112a and 112b are provided on the side surfaces of the housing 110, and a lock switch 114 is provided on the lower surface of the housing 110. A nearly spherical recess 110a is provided from an end portion of the front surface to the lower surface of the case 110 so that the through hole 82c of the belt 24 is exposed in a state where the first controller 34 is mounted to the gyro sensor unit 100 (fig. 8).

A pair of hooks 112Fa and 112Fb connected to the release buttons 112a and 112b, respectively, are provided on the front surface of the housing 110 at positions (Y-axis in fig. 6 (a)) symmetrical to each other about the connector 106 in the horizontal direction (X-axis direction). When the connector 106 is connected to the connector 42 to mount the gyro sensor unit 100 to the first controller 34, the pair of hooks 112Fa and 112Fb are inserted into the pair of through holes 82a and 82b (fig. 2 (a)) at the rear surface of the housing 78, and the claws of the hooks 112Fa and 112Fb are engaged with the inner wall of the housing 78. Thereby, the gyro sensor unit 100 is fixed to the rear surface of the first controller 34.

Fig. 8 shows the gyro sensor unit 100 thus fixed to the first controller 34. When the pair of release buttons 112a and 112b is pushed in this state, the engagement of the claws is released to enable the gyro sensor unit 100 to be detached from the first controller 34.

The lock switch 114 is a slide switch for locking the release buttons 112a and 112 b. When the lock switch 114 is in the first position (e.g., toward the rear side), the release buttons 112a and 112b may not be pushed (locked state), and when the lock switch 114 is in the second position (e.g., toward the front), the release buttons 112a and 112b may be pushed (released state). In the housing 110, locking springs 118a and 118b (fig. 7) are provided and configured to generate a resistance when the release buttons 112a and 112b are pushed, thereby maintaining a snap-in state when the release buttons 112a and 112b are not pushed. Thus, in order to detach the gyro sensor unit 100, the user has to push the release buttons 112a and 112b after sliding the lock switch 114 from the first position to the second position.

Since the gyro sensor unit 100 is mounted to the rear surface of the first controller 34, the centrifugal force applied to the gyro sensor 100 in the game is exclusively used to press the gyro sensor unit 100 toward the first controller 34. Further, the gyro sensor unit 100 is fixed to the rear surface of the first controller 34 by the hooks 112Fa and 112Fb, while the release buttons 112a and 112b are provided with the lock switch 114 for releasing the hooks 112Fa and 112Fb, and thus, even in the game operation, a firmly fixed state can be formed between the gyro sensor unit 100 and the first controller 34.

On the rear surface of the housing 110, a recess 110b that can accommodate a connector cover 116 to be mounted to the connector 108 is provided on the peripheral edge of the connector 108. The connector cover 116 has a narrow thin (i.e., bendable) projection 116a extending in the front-rear direction (Z-axis direction) on one end of the main surface. The end of the projection 116a is engaged with the housing 110, and the connector cover 116 is tied to the housing 110 in a state of being detached from the connector 108.

The connector cover 116 has a narrow and thick (i.e., hardly bendable) projection 116b extending in the left-right direction (X-axis direction) on the other end of the main surface. The thickness (height in the Z-axis direction) of the projection 116b is almost the same as the thickness (height in the Y-axis direction) of the hook 144 provided at the connector 40 of the second controller 36. In the case where the second controller 36 is connected to the first controller 34 via the gyro sensor unit 100, as shown in fig. 9, the main surface of the connector cover 116 is horizontal to engage with the side surface of the hook 144 of the connector 40. By thus introducing the connector cover 116 separated from the connector 108 into the connector 40, the connector 40 is firmly fixed to the gyro sensor unit 100 and is improved in both operability and appearance.

Fig. 7 shows an example of the structure of the gyro sensor unit 100. In addition to the above-mentioned housing 110, connectors 106 and 108, release buttons 112a and 112b, hooks 112Fa and 112Fb, lock switch 114, connector cover 116, and lock springs 118a, 118b, the gyro sensor unit 100 has a gyro substrate 120 and a support member 122. The gyro substrate 120 is connected to each of the connectors 106 and 108 through a signal line, and the support member 122 supports the gyro substrate 120 and the connectors 106 and 108.

The gyro substrate 120 is provided with a gyro sensor 104. The gyro sensor 104 is composed of two pieces including a single-axis gyro sensor 104a and a two-axis gyro sensor 104 b. The gyro sensor 104a is used to detect an angular velocity (an angular velocity about the Y axis) associated with a yaw angle, and the gyro sensor 104b is used to detect two angular velocities (an angular velocity about the Z axis and an angular velocity about the X axis) associated with a roll angle and a pitch angle. The gyro sensors 104a and 104b are horizontally arranged and arranged in parallel on the upper surface 120a of the gyro substrate 120.

Here, the configuration of the gyro sensors 104a and 104b is not limited to the configuration shown in fig. 7. In another embodiment, the gyro sensor 104a is horizontally disposed on one of the upper surface 120a and the lower surface 120b of the gyro substrate 120, and the gyro sensor 104b is horizontally disposed on the other of the upper surface 120a and the lower surface 120b of the gyro substrate 120 so as to be opposed to the gyro sensor 104a with the gyro substrate 120 disposed therebetween. In another embodiment, the gyro sensor 104a is vertically disposed on one of the upper surface 120a and the lower surface 120b of the gyro substrate 120, and the gyro sensor 104b is horizontally disposed on the other of the upper surface 120a and the lower surface 120b of the gyro substrate 120.

Further, the gyro sensor 104 is not limited to being constituted by two pieces, and it may be constituted by three single-axis gyro sensors (three pieces), or by one three-axis gyro sensor (one piece). In either case, the position and orientation of each sheet is determined so as to be able to correctly detect the above three angular velocities. In addition, in some cases, the gyro sensor 104 may be constituted by one two-axis gyro sensor, or by one or two one-axis gyro sensors.

It is to be noted that the shapes of the first controller 34 shown in fig. 2, the second controller 36 shown in fig. 3, and the gyro sensor unit 100 shown in fig. 6, and the shapes, the numbers, and the set positions of the buttons (switches, levers, or the like) are merely one example, and may be changed to other shapes, numbers, and set positions as needed.

Here, the sensor is a gyro sensor (angular velocity sensor) in the preferred embodiment, but may be other motion sensors such as an acceleration sensor, a velocity sensor, a displacement sensor, a rotation angle sensor, and the like. In addition to the motion sensor, there are an inclination sensor, an image sensor, an optical sensor, a pressure sensor, a magnetic sensor, a temperature sensor, and the like, and in the case of adding any one of the sensors, an operation of the object to be detected by the sensor becomes possible. In the case of using either sensor, the sensor may be added to the operating device while using another device conventionally connected to the operating device in the original manner.

In addition, the power supply of the controller 14 is applied by a battery (not shown) replaceably housed in the first controller 34. Power is provided to the second controller 36 via the connector 40 and the cable 38. If the gyro sensor unit 100 is connected to the first controller 34, power is supplied to the gyro sensor unit 100 via the connectors 42 and 106. Alternatively, if the second controller 36 is connected to the gyro sensor unit 100, a part of the power supplied from the first controller 34 to the gyro sensor unit 100 is also applied to the second controller 36 via the connector 108, the connector 40, and the cable 38.

Fig. 10 shows an electrical configuration of the game system 10. Although not shown, the components in the housing 16 are in fact mounted on a printed circuit board. As shown in fig. 10, the game device 12 is provided with a CPU44 serving as a game processor. The CPU44 is also connected to the system LSI 64. The system LSI64 is connected to the external main memory 46, ROM/RTC48, disk drive 54, and AV IC 56.

The external main memory 46 can be used as a work area and a cache area for the CPU44 by storing programs such as game programs and various data. The ROM/RTC48, a so-called boot ROM, contains a program for starting the game device 12 and is provided with a time circuit for timing. The disk drive 54 reads a program, texture data, and the like from the optical disk 66, and writes them to the internal main memory 64e or the external main memory 46, which will be described later, under the control of the CPU 44.

The system LSI64 is provided with an input-output processor 64a, a GPU (graphics processor unit) 64b, a DSP (digital signal processor) 64c, a VRAM64d, and an internal main memory 64e, and these devices are connected to each other via an internal bus, although not shown in the figure.

An input-output processor (I/O processor) 64a performs transmission and reception of data and performs downloading of data.

The GPU64b is constituted by a part of a drawing device, and receives a graphic command (composition command) from the CPU44 to generate game image data according to the command. In addition, in addition to the graphics commands, the CPU44 also applies an image generation program required to generate game image data to the GPU64 b.

Although not shown, the GPU64b is connected to the VRAM64d as described above. The GPU64b accesses the VRAM64d to acquire data (image data: data such as polygon data, texture data, and the like) necessary for executing the composition command. Here, the CPU64 writes image data necessary for drawing to the VRAM64d via the GPU64 b. The GPU64b accesses the VRAM64d to create game image data for drawing.

In the present embodiment, a case where the GPU64b generates game image data is explained, however, in the case where any application other than the game application is executed, the GPU64b generates image data for the any application.

Further, the DSP64c functions as an audio processor, and generates audio data corresponding to sound, voice, music, and the like, which are output from the speaker 32 by means of the sound data and sound wave (tone) data stored in the internal main memory 64e and the external main memory 46.

The game image data and audio data generated as described above are read by the AV IC56 and output to the monitor 30 and the speaker 32 via the AV connector 58. Accordingly, a game screen is displayed on the monitor 30, and sounds (music) required for the game are output from the speaker 32.

Further, the input-output processor 64a is connected to the flash memory 43, the wireless communication module 50, and the wireless controller module 52, and is connected to the expansion connector 60 and the connector 62 of the external memory card. Wireless communication module 50 is connected to antenna 50a and wireless controller module 52 is connected to antenna 52 a.

The input-output processor 64a may be connected to other game devices and a plurality of servers connected to a network (not shown) via the wireless communication module 50. It is to be noted that communication with other game apparatuses may be direct without passing through a network. The input-output processor 64a periodically accesses the flash memory 43 to detect the presence or absence of data (also referred to as transmission data) that needs to be transmitted to the network and transmits it to the network via the wireless communication module 50 and the antenna 50a in the presence of the transmission data. Further, the input-output processor 64a receives data transmitted from another game device (also referred to as reception data) via the network, the antenna 50a, and the wireless communication module 50, and stores the received data in the flash memory 43. In case the received data does not satisfy a certain condition, the received data is discarded. In addition, the input-output processor 64a receives data (download data) downloaded from a download server (not shown) via the network, the antenna 50a, and the wireless communication module 50, and stores the downloaded data in the flash memory 43.

Further, the input-output processor 64a receives input data transmitted from the controller 14 via the antenna 52a and the wireless controller module 52, and (temporarily) stores it in a buffer area of the internal main memory 64e or the external main memory 46. After being used in processing (e.g., game processing) via the CPU44, the input data is erased from the buffer.

In one embodiment, the wireless controller module 52 communicates with the controller 14 according to the bluetooth standard, as described above. This enables the game device 12 not only to acquire data from the controller 14, but also to transmit a predetermined command to the controller 14, thereby controlling the operation of the controller 14 from the game device 12.

In addition, the input-output processor 64a is connected to the expansion connector 60 and the connector 62 of the external memory card. The expansion connector 60 is a connector of an interface such as USB, SCSI, or the like, and can be connected to a medium such as an external memory and a peripheral device such as another controller different from the controller 14. Further, the expansion connector 60 is connected to a cable LAN adapter, and replaces the wireless communication module 50 with a cable LAN. The connector of the external memory card 62 is connectable to an external memory like a memory card. Thus, the input-output processor 64a accesses the external memory, for example, via the expansion connector 60 and the connector 62 of the external memory card, to store and read data.

As shown in fig. 10, although not described in detail, the game device 12 (housing 16) is provided with a power button 20a, a reset button 20b, and an eject button 20 c. The power button 20a is connected to the system LSI 64. When the power button 20a is turned on, the system LSI64 sets a mode of a normal power supply state in which the respective devices of the game apparatus 12 are supplied with power through an AC adapter, not shown.

The reset button 20b is also connected to the system LSI 64. When the reset button 20b is pressed, the system LSI64 restarts the startup program of the game device 12. The eject button 20c is connected to the disk drive 54. When the eject button 20c is pressed, the optical disk 66 is ejected from the disk drive 54.

Fig. 11 shows one example of the electrical configuration of the entire controller 14 when the first controller 34 and the second controller 36 are connected via the gyro sensor unit 100.

The first controller 34 includes a communication unit 92, and the communication unit 92 is connected to the operation section 80, the imaged information arithmetic section 81, the acceleration sensor 84, and the connector 42. The operating portion 80 instructs the above-described operating buttons or operating switches 80a to 80 i. When the operation section 80 is operated, data indicating an operation is applied to the communication unit 92. Data indicating the position coordinates of the markers 22a and 22b in the object scene is output from the imaging information arithmetic section 81 to the communication unit 92. Data indicative of the acceleration monitored by the acceleration sensor 84 is also output to the communication unit 92. The acceleration sensor 84 has a sampling period of the order of 200 frames/second at maximum.

The connector 42 may be connected to the connector 106 of the gyro sensor unit. The gyro sensor unit 100 includes a microcomputer 102 and a gyro sensor 104 inside thereof. The gyro sensor 104 represents the above-described gyro sensors 104a and 104b and has, for example, the same sampling period as the acceleration sensor 84. The microcomputer 102 outputs data indicating the angular velocity detected by the gyro sensor 104 to the communication unit 92 via the connector 106 and the connector 42.

The connector 108 of the gyro sensor unit 100 is connected to the connector 40 of the cable 38 extending from the second controller 36. The connector 40 is connected to the operation portion 88 of the second controller 36 and the acceleration sensor 90. The operation portion 88 shows the above-described shift lever 88a and the operation buttons 88b, 88 c. When the operation portion 88 is acted, data indicating an operation is applied to the microcomputer 102 of the gyro sensor unit 100 via the cable 38, the connector 40, and the connector 108. The microcomputer 102 outputs data to the communication unit 92 via the connector 106 and the connector 42. The acceleration sensor 90 also has the same sampling period as the acceleration sensor 84, and data indicating the acceleration thus detected is also output to the communication unit 92 through the microcomputer 102.

Here, each output to the above-described communication unit 92 is performed at a cycle of 1/200 seconds. Therefore, the operation data from the operation section 80, the position coordinate data from the imaging information arithmetic section 81, the acceleration data from the acceleration sensor 84, the angular velocity data from the gyro sensor 104, the operation data from the operation section 88, and the acceleration data from the acceleration sensor 90 are output to the communication unit 92 one at a time in an arbitrary 1/200 seconds.

Fig. 12 shows an important part of the gyro sensor unit 100 of the entire configuration shown in fig. 11. Each of the above-described connector 42, connector 106, connector 108, and connector 40 is, for example, a six-pin connector including a mounting pin for controlling a variable "Attach" indicating a connection state between the two connectors. Attach varies between "Low" indicating that the connectors are unconnected and "High" indicating that the connectors are connected. Hereinafter, the mounting (Attach) between the connector 42 and the connector 106, i.e., the mounting between the first controller 34 and the gyro sensor unit 100, is referred to as "Attach 1", and the mounting (Attach) between the connector 108 and the connector 40, i.e., the mounting between the gyro sensor unit 100 and the second controller 36, is referred to as "Attach 2".

Even if the first controller 34 is attached to the gyro sensor unit 100, if the application is of a gyro-incompatible type and the gyro sensor unit 100 is not connected to the second controller 36, the Attach1 is controlled to "Low" by the microcomputer 10 of the gyro sensor unit 100 so that the gyro sensor unit 100 is as if it cannot be seen for the gyro-incompatible application (standby mode: see fig. 14). In the standby mode, power supply to the gyro sensor 104 is stopped to disable the gyro function, and the microcomputer 102 performs power management based on the Attach2 exclusive execution mode selection and based on an instruction from the gyro-compatible application.

The other two of the aforementioned six pins are given an I2C bus, and the gyro sensor unit 100 further includes a bus switch SW for connecting/isolating the I2C bus on the first controller 34 side and the I2C bus on the second controller 36 side. When the gyro-incompatible application is executed in a state where the second controller 36 is connected to the first controller 34 via the gyro sensor unit 100, the bus switch SW is turned on by the microcomputer 102. Thereafter, the data from the second controller 36 is output to the communication unit 92 through the I2C bus without passing through the microcomputer 102 (bypass mode: see fig. 14). Therefore, like the standby mode, the microcomputer 102 performs only the mode selection and the power management, which reduces the electric power consumption. Further, even if the gyro sensor unit 100 is installed, a gyro-incompatible application can be executed. When the bus switch SW is turned off, the bus is connected to the microcomputer 102, and the data output to the first controller 34 is controlled by the microcomputer 102.

The bus switch SW remains on even in the standby mode. This allows the gyro-compatible application to confirm whether the first controller 34 is mounted to the gyro sensor unit 100 by referring to the specific address of the I2C bus line shaft. Even though the Attach1 is controlled to "Low" as described above.

It is to be understood that the gyro sensor unit 100 is equipped with four modes, including a "gyro" mode and a "gyro & second controller" mode, in addition to the above-described "standby" and "bypass" modes. In the former two modes, the bus switch SW is turned off.

The microcomputer 102 of the gyro sensor unit 100 includes two kinds of a/D conversion circuits 102a and 102b, and angular velocity signals about three axes output from the gyro sensor 104 are applied to each of the a/D conversion circuits 102a and 102 b. In the a/D conversion circuit 102a, a/D conversion processing of a high angular velocity mode is performed with the entire detection range (± 360 °/sec) of the gyro sensor 104 as a target, and in the a/D conversion circuit 102b, a/D conversion processing of a low angular velocity mode is performed with a partial detection range (± 90 °/sec) of the gyro sensor 104 as a target. The microcomputer 102 outputs one of the two results of the a/D conversion as angular velocity data.

More specifically, when two kinds of angular velocity data corresponding to a certain time are output from the a/D conversion circuits 102a and 102b, the microcomputer 102 first determines whether the value a falls between the first threshold value Th1 to the second threshold value Th2 (> Th 1) for the angular velocity data of the angular velocity mode for that time, i.e., the condition "Th 1 ≦ a ≦ Th 2" is satisfied for each axis (i.e., the yaw axis, the roll axis, and the pitch axis). Then, based on the three determination states, one of the low angular velocity mode and the high angular velocity mode is selected. For example, for each of the three determination results, if "YES", the low angular velocity mode is selected for each axis, and if "No", the high angular velocity mode is selected for each axis. Then, the angular velocity data according to the mode selected for each axis is output together with mode information indicating the selected mode. That is, by changing the accuracy of data according to the angular velocity, data can be output at a low speed with high accuracy even if the amount of data is equal.

Fig. 13 shows a data format processed by the gyro sensor unit 100. Fig. 13(a) shows a data format of the gyro sensor unit 100, and fig. 13(B) shows a data format of the second controller 36. The data of the gyro sensor unit 100 includes yaw angular rate data, roll angular rate data and pitch angular rate data and yaw angular rate mode information, roll angular rate mode information and pitch angular rate mode information, second controller connection information and gyro/second controller identification information.

Yaw angular rate data, roll angular rate data, and pitch angular rate data, each including, for example, 14-bit data, are obtained from the yaw angular rate signal, the roll angular rate signal, and the pitch angular rate signal output from the gyro sensor 104 by a/D conversion, respectively. Each of the yaw angular velocity mode information, the roll angular velocity mode information, and the pitch angular velocity mode information is 1-bit information indicating a corresponding mode of each angular velocity data, and varies between "0" corresponding to the high angular velocity mode and "1" corresponding to the low angular velocity mode.

The second controller connection information is one-bit information indicating whether or not the second controller 36 is connected to the connector 108, and changes between "0" indicating no connection and "1" indicating connection. The gyro/second controller identification information is 1-bit information identifying whether the data is data output from the gyro sensor unit 100 or data output from the second controller 36, and changes between "1" indicating that this is from the gyro sensor unit 100 and "0" indicating that this is from the second controller 36.

On the other hand, the data of the second controller 36 includes: x shifter lever operation data and Z shifter lever operation data each indicating a shifter lever operation in the left-right direction (X-axis direction) and a shifter lever operation in the front-rear direction (Z-axis direction); and X acceleration data, Y acceleration data, and Z acceleration data each representing an acceleration in the X-axis direction, an acceleration in the Y-axis direction, and an acceleration in the Z-axis direction; and button operation data; second controller connection information; and gyroscope/second controller identification information.

The gyro sensor unit 100 alternately outputs the gyro data according to the format shown in fig. 13(a) and the second controller data according to the format shown in fig. 13(B) to the communication unit 92 at a cycle of 1/200 seconds, for example. Thus, data in one of the formats is output in a period of 1/100 seconds, but this is much shorter than the 1/60 second period of the general processing period of the game processing, and therefore, even if data is output alternately, both data can be used as one frame at the same time in the game processing.

The communication unit 92 includes a microcomputer (microcomputer) 94, a memory 96, a wireless module 76, and an antenna 98. The microcomputer 94 transmits the acquired data to the game device 12 and receives the data from the game device 12 by controlling the wireless module 76 while processing the memory 96 as a storage area (work area and cache area).

The data output from the gyro sensor unit 100 to the communication unit 92 is temporarily stored in the memory 96 via the microcomputer 94. Data output from the operating section 80, the imaged information arithmetic section 81, and the acceleration sensor 84 in the first controller 34 to the communication unit 92 is also temporarily stored in the memory 96. When the transmission timing of the game device 12 comes, the microcomputer 94 outputs the data stored in the memory 96 to the wireless module 76 as controller data. The controller data includes first controller data in addition to the gyro data and/or the second controller data shown in fig. 13(a) and 13 (B). The first controller data includes: x acceleration data, Y acceleration data, and Z acceleration data based on the output from the acceleration sensor 84; position coordinate data based on an output from the imaging information arithmetic section 81; and button operation data based on an output from the operation section 80.

The wireless module 76 modulates a carrier wave at a predetermined frequency by controller data using a short-range wireless communication technique such as bluetooth (trademark) and transmits its weak radio wave signal from the antenna 98. That is, the controller data is modulated into a weak radio wave signal by the wireless module 76 and transmitted from the first controller 34. The weak radio wave signal is received by the wireless controller module 52 of the game device 12. The weak radio wave thus received is subjected to demodulation and decoding processing to make the game apparatus 12 obtain the controller data. The CPU44 of the game device 12 executes game processing based on the controller data obtained from the controller 14. Here, the wireless communication between the first controller 34 and the game device 12 may be realized according to another standard, such as a wireless LAN or the like.

In such a game system 10, a user can make an input to an application like a game or the like by moving the controller 14 itself, not by button operation. In playing the game, the user holds the first controller 34 (specifically, the holding portion 78a of the housing 78: fig. 2) with the right hand and the second controller 36 with the left hand, as shown in fig. 18, for example. As described above, the acceleration sensor 84 for detecting acceleration in the three-axis direction is included in the first controller 34, and the same acceleration sensor 90 is included in the second controller 36. When the first controller 34 and the second controller 36 are moved by the player, acceleration values indicating the movements of the respective controllers in the three-axis directions are detected by the acceleration sensor 84 and the acceleration sensor 90. In the case where the gyro sensor unit 100 is mounted to the first controller 34, angular velocity values about three axes indicating the motion of the first controller 34 itself are further detected.

These detection values are sent to the game device 12 in the form of the aforementioned controller data. In the game device 12 (fig. 10), the controller data from the controller 14 is received by the input-output processor 64a via the antenna 52a and the wireless controller module 52, and the received controller data is written to the buffer area of the internal main memory 64e or the external main memory 46. The CPU44 reads the controller data stored in the buffer area of the internal main memory 64e or the external main memory 46 and restores the value detected from the controller data, i.e., the acceleration and/or angular velocity value detected by the controller 14.

Here, the angular velocity data has two modes, a high angular velocity mode and a low angular velocity mode, and therefore two angular velocity recovery algorithms corresponding to the two modes are prepared. In recovering the angular velocity value from the angular velocity data, an angular velocity recovery algorithm corresponding to the angular velocity data pattern is selected based on the angular velocity pattern information.

The CPU44 executes the process of calculating the velocity of the controller 14 from the restored acceleration in parallel with this restoration process. In parallel, the travel distance or position of the controller 14 may be estimated from the calculated velocity. On the other hand, the rotation angle of the controller 14 is estimated from the recovered angular velocity. Here, the initial value (integration constant) when integrating the acceleration to calculate the velocity and integrating the angular velocity to calculate the rotation angle may be calculated from the position coordinate data from the imaged information arithmetic section 81. The position coordinate data may also be used to correct for errors accumulated due to integration.

The game processing is executed based on the thus evaluated variables such as acceleration, speed, travel distance, angular velocity, turning angle, and the like. Therefore, all the above-described processes need not be executed, and variables necessary for game processing can be calculated as needed. Note that the angular velocity and the rotation angle may also be calculated from the acceleration in principle, but this requires a more complicated routine for the game program, thereby imposing a heavy processing load on the CPU 44. By using the gyro sensor unit 100, the development of the program becomes easy, and the processing load on the CPU44 is reduced.

Incidentally, some games may be single-controller games using only the first controller 34, while other games may be dual-controller games using the first controller 34 and the second controller 36, and the various games are classified into a gyro-compatible type and a gyro-incompatible type. The first controller 34, which is the master controller, is required to play all games. Further, the second controller 36, which is an expansion controller, is connected to the first controller 34 via the gyro sensor unit 100 or directly when a game of a dual controller is played, and is generally detached when a game of a single controller is played.

On the other hand, when playing a game in which the gyro is not compatible, the gyro sensor unit 100 as an extension sensor or an extension controller is not required, but it does not need to be inconveniently detached. Accordingly, the gyro sensor unit 100 generally remains mounted to the first controller 34 and is used as a unit with the first controller 34. As in the case where the gyro sensor unit 100 is not included, the second controller 36 is detachable except that the connection object of the connector 40 is changed from the connector 42 to the connector 108.

Fig. 14 shows a table describing the control that the microcomputer 102 of the gyro sensor unit 100 implements for each mode. The modes prepared for the gyro sensor unit 100 are the aforementioned "standby", "bypass", "gyro", and "gyro and second controller", and the object controlled by the microcomputer 102 covers the six items of "gyro function", "gyro power supply", "bus switch", "expansion connector", "Attach 1", and "I2C address".

The gyro function is in a stop state (inactive) in each of the standby mode and the bypass mode, but is in a start state (active) in each of the gyro mode and the gyro and second controller mode. The power supply to the gyro power supply (i.e., the gyro sensor 104) is stopped (OFF) in each of the standby mode and the bypass mode, and is performed (ON) in each of the gyro mode and the gyro and second controller mode. The bus switch SW is connected (connected) in each of the standby mode and the bypass mode and is isolated (disconnected) in each of the gyro mode and the gyro and second controller mode.

The extension connector, i.e., the connector 108, is in an on state in each of the bypass mode and the gyro and second controller modes, and is in an off state in each of the standby mode and the gyro mode. The Attach1 is controlled to "LOW" indicating an unconnected state in the standby mode, and to "High" indicating a connected state in each of the bypass mode, the gyro mode, and the gyro and second controller mode. In association with the I2C address, a particular address is only important in each of the standby mode and the bypass mode.

The mode switching is performed in the manner shown in fig. 15. Fig. 15(a) is a diagram showing a switching process in the case where the application is gyro-compatible, and fig. 15(B) is a diagram showing a switching process in the case where the application is gyro-incompatible. As in fig. 15(a) and 15(B), that is, regardless of whether it is a gyro-compatible application or a gyro-incompatible application, the gyro sensor unit 100 starts up in response to itself being connected to the first controller 34, and enters a standby mode as an initial mode. Here, when the second controller 36 is connected to the gyro sensor unit 100, the standby mode is switched to the bypass mode, and when the second controller 36 is subsequently detached therefrom, the bypass mode is restored to the standby mode.

Here, the gyro-compatible application calls and resets the gyro sensor unit 100 to acquire angular velocity data as needed. As described above, in this embodiment, the controller can be controlled from the game machine through communication, and thus the gyro sensor unit 100 can be controlled by the application. Therefore, as shown in fig. 15(a), when a call is received from an application in the standby mode, the gyro sensor unit 100 switches to the gyro mode, and when a reset is received from the application in the gyro mode, the gyro sensor unit 100 returns to the standby mode. When connected to the second controller 36 in the gyro mode, the gyro sensor unit 100 switches to the gyro and second controller mode, and returns to the gyro mode when disconnected from the second controller 36 in the gyro and second controller mode. The gyro sensor unit 100 further switches to the bypass mode when a reset is received from the application in the gyro and second controller mode, and returns to the gyro and second controller mode when a call is received from the application in the bypass mode.

On the other hand, the gyro-incompatible application does not have a function of performing calling and resetting with respect to the gyro sensor unit 100. Therefore, when a gyro-incompatible application is executed, the mode of the gyro sensor unit 100 is switched only between the standby mode and the bypass mode, as shown in fig. 15 (B).

The mode switching by the gyro sensor unit 100 is realized by executing the processing shown in the flowcharts shown in fig. 16 and 17 by the microcomputer 102 with reference to the table shown in fig. 14. Here, the program corresponding to the flowchart and the table shown in fig. 14 are stored in the nonvolatile memory 102c (fig. 12).

When the user mounts the gyro sensor unit 100 to the first controller 34, power is supplied from the first controller 34 to the microcomputer 102 to start and execute the processing shown in the flowcharts in fig. 16 and 17. The processing is executed until the gyro sensor unit 100 is detached from the first controller 34.

Referring to fig. 16, after the completion of the startup, the microcomputer 102 first performs a mode update to the standby mode at step S1. More specifically, the microcomputer 102 stops the gyro function according to the definition of "standby" described in the table (fig. 14) in the memory 102c, stops power supply to the gyro sensor 104, connects the bus switch SW, deactivates the connector 108, controls the Attach1 to "Low", and starts focusing on a specific address of the I2C bus. Therefore, when the gyro sensor unit 100 is switched to the standby mode, the process proceeds to the loop of steps S3 and S5.

That is, the microcomputer 102 determines in step S3 whether the Attach2 is "1", and if it is determined here to be "NO", it further determines in step S5 whether a call is issued from the application. If it is determined here as "NO", the process returns to step S3. In this mode, the gyroscope is not used, whereby no operation data is output to the first controller 34, or only the fact that no operation data exists is output. When the Attach2 changes from "0" to "1" in response to the second controller 36 being connected to the first controller 34 via the gyro sensor unit 100, the determination result in step S3 becomes "YES", and the process proceeds to step S17. On the other hand, when a call is issued from the application to the gyro sensor unit 100, the determination result in step S5 becomes "YES", and the process proceeds to step S7.

In step S7, a mode update to the gyro mode is performed. More specifically, the microcomputer 102 activates the gyro function according to the definition of "gyro" described in the table (fig. 14), starts supplying power to the gyro sensor, turns off the bus switch SW, deactivates the connector 108, and controls the Attach1 to "High". When the gyro sensor unit 100 is thus switched to the gyro mode, the process proceeds to the loop of steps S9-S13.

Whether the Attach2 is "1", whether a reset is issued from the application, and whether the current time corresponds to the data output time are determined in step S9, step S11, and step S13, respectively. When the Attach2 changes from "0" to "1", the determination made in step S9 is "YES", and the process proceeds to step S23. When a reset is issued from the application to the gyro sensor 100, the determination result in step S11 becomes "YES", and the process returns to step S1. When the preset time has elapsed since the previous data output, the determination made in step S13 becomes "YES", and the process proceeds to step S15. In step S15, the microcomputer 102 outputs the gyro data (fig. 13 (a)) to the first controller 34 side. After the output is completed, the process returns to the loop of steps S9-S13.

Referring to fig. 17, in step S17, a mode update to the bypass mode is performed. More specifically, the microcomputer 102 stops supplying power to the gyro sensor 104, deactivates the gyro function, connects the bus switch SW, activates the connector 108, and then makes the Attach1 "High" according to the definition of "bypass" described in the table (fig. 14) in the memory 102 c. The focus on a particular address of the I2C bus ceases. When the gyro sensor unit 100 is thus switched to the bypass mode, the process proceeds to the loop of steps S19 and S21.

It is determined in step S19 and step S21 whether the Attach2 is "0" and whether a call is issued from the application, respectively. When the Attach2 changes from "1" to "0", the determination made in step S19 becomes "YES", and the process returns to step S1. When a call is issued from the application to the gyro sensor unit 100, the determination made in step S21 becomes "YES", and the process proceeds to step S23. In the bypass mode, the data of the second controller (fig. 13 (B)) is directly output from the second controller 36 to the first controller 34, and therefore the microcomputer 102 does not output any data as a result.

In step S23, the mode is updated to the gyro and second controller mode. More specifically, the microcomputer 102 starts supplying power to the gyro sensor 104, activates the gyro function, turns off the bus switch SW, activates the connector 108, and controls the Attach1 to "High" according to the definition of "gyro & second controller" described in the table (fig. 14) in the memory 102 c. The particular address of interest of the IC2 bus is disabled. When the gyro sensor unit 100 is thus switched to the gyro and second controller mode, the process proceeds to the loop of steps S25-S29.

In step S25, it is determined whether the Attach2 is "0", in step S27, it is determined whether a reset is issued from the application, and in step S29, it is determined whether the current time corresponds to the data output time. When the Attach2 changes from "1" to "0", the determination result in step S25 becomes "YES", and the process returns to step S7. When a reset is issued from the application to the gyro sensor unit 100, the determination result in step S27 becomes "YES", and the process returns to step S17. When the preset time has elapsed since the previous data output, the determination result in step S28 becomes "YES", and the process proceeds to step S31. In step S31, the microcomputer 102 alternately outputs the gyro data (fig. 13 (a)) and the second controller data (fig. 13 (B)) to the first controller 34 side. After the output, the process returns to the loop of steps S25-S29.

As understood from the above description, in the present embodiment, the gyro sensor unit 100 is provided with the housing 110, the connectors 106 and 108, and the gyro sensor 104. The connector 106 has a first shape that is physically and electrically connectable to the connector 42, the connector 42 being disposed to the first controller 34. Thus, by connecting the connector 106 to the connector 42 of the first controller 34, the gyro sensor unit 100 is physically and electrically connected to the first controller 34 via the two connectors 42 and 106, so that the gyro sensor unit 100 can be used as one unit with the first controller 34. That is, the gyro sensor 104 is finally attached to the first controller 34.

On the other hand, the connector 108 has a second shape connectable with a connector having the first shape. Thus, a connector of another device, such as connector 40 of second controller 36, that is conventionally connected to connector 42, may also be connected to connector 108. Therefore, if the connector 40 is connected to the connector 108 in a state where the connector 42 is connected to the connector 106, the second controller 36 is finally connected to the first controller 34 via the gyro sensor unit 100.

Accordingly, the gyro sensor 104 may be attached to the first controller 34 while another device (e.g., the second controller 36, etc.) conventionally connected to the first controller 34 exerts its original function. A gyro sensor as a means for detecting an angular velocity is provided near the wrist to detect an angular velocity often near the rotation shaft, which makes it easy to detect an angular velocity. The acceleration sensor is arranged in front of the wrist, which makes it easy to detect the centrifugal force. That is, when the operation device is regarded as a whole, the acceleration sensor is located in the front and the gyro sensor is located in the rear, which enables the operation system to accurately detect the movement of the player's hand. The addition of the gyro sensor 104 for detecting an angular velocity eliminates the need to introduce a routine for calculating an angular velocity or a rotation angle in each game program, which relieves the developer of burden. Further, the processing load on the CPU44 of the game device 12 is also reduced.

Further, in the present embodiment, the first controller 34 has a housing 78 having an elongated shape, the thickness of which can be held by one hand. On the upper surface of the housing 78, a first operation portion (operation buttons 80a, 80d, etc.) is provided at a position operable by the thumb of one hand, and on the lower surface of the housing 78, a second operation portion (operation button 80 h) is provided at a position operable by the index finger of one hand when the thumb of one hand is placed on the first operation portion. In the housing 78, a grip portion 78a is formed at a position which can be gripped by the palm and other fingers of the hand when the thumb and the index finger are placed on the first operating portion and the second operating portion, respectively. Therefore, the first operating portion and the second operating portion are located on the front side of the housing 78, and the grip portion 78a is located on the rear side of the housing 78. Therefore, when holding the housing 78 with one hand, the user places the thumb on the first operating portion of the upper surface, places the index finger on the second operating portion of the lower surface, and holds the grip portion 78a with the palm and other fingers.

In addition, the first controller 34 also has an acceleration sensor 84, and the housing 78 also has a camera information arithmetic section 81 at the opposite end to the grip portion 78a and a connector 42 at the end of the grip portion 78 a. Incidentally, the gyro sensor unit 100 has a housing 110, a connector 106 connectable to the connector 42, and a gyro sensor 104. Accordingly, the user connects the connector 106 to the connector 42 to connect the gyro sensor unit 100 to the first controller 34. The gyro sensor unit 100 thus connected to the first controller 34 is disposed at the rear end of the first controller 34, i.e., in the vicinity of the wrist of the hand holding the first controller 34 (fig. 18). The acceleration value output from the acceleration sensor 84 and the angular velocity value output from the gyro sensor 104 each indicate the acceleration of the first controller 34 and the angular velocity of the gyro sensor unit 100.

By disposing the gyro sensor unit 100 on the rear side of the first controller 34, the center of gravity position of the included controller is moved rearward toward the position of the palm. The centrifugal force caused by the gyro sensor unit 100 connected to the first controller 34 is increased to a smaller extent than in the case where the gyro sensor unit 100 is located at the front end of the first controller 34. Further, since the centrifugal force acting on the gyro sensor unit 100 acts to press the first controller 34, the gyro sensor unit 100 and the first controller 34 are firmly fixed together. In addition, the gyro sensor 104 is located near the wrist so that the angular velocity is always detected near the rotation axis, which makes the detection accuracy of the angular velocity high. On the other hand, the acceleration sensor 84 is located in front of the wrist, which makes it easy to detect acceleration due to rotation.

Further, in the present embodiment, the first controller 34 is also provided with a belt mounting portion (through hole 82 c) to which the belt 24 is mounted. The gyro sensor unit 100 is also provided with a cover 116 covering the connector 108. The cover 116 is tied to the gyro sensor unit 100 even in a state of being detached from the connector 108. The second controller 36 is also provided with a hook 144 near the connector 40, and the belt 24 mounted to the first controller 34 in the state where the second controller 36 is connected to the first controller 34 is hooked and fixed in place while the hook 144 is to be hooked by the cover 116 tied to the gyro sensor unit 100 in the state where the second controller 36 is connected to the gyro sensor unit 100.

Thus, the player may wear the belt 24 on the wrist of the hand holding the first controller 34. Further, in the case where the gyro sensor unit 100 is attached between the first controller 34 and the second controller 36, the cover 116 detached from the connector 108 and tethered to the gyro sensor unit 100 is hung on the hook 144, and the belt 24 is hung on the hook 144 conventionally, which makes it more difficult to detach the connector 40 from the connector 108. Accordingly, the gyro sensor unit 100 may be attached to the first controller 34 while the second controller 36, which is conventionally connected to the first controller 34, exerts its original function.

In addition, in the present embodiment, although the gyro sensor unit 100 and the second controller 36 are connected to the cable 38, they may be connected to each other by wireless communication. Fig. 19 shows an example of such a case. In the embodiment of fig. 19, the gyro sensor unit 100 is provided with a wireless module 108a and an antenna 108b instead of the aforementioned connector 108, and the second controller 36 is provided with a wireless module 40a and an antenna 40b instead of the aforementioned connector 40. The wireless modules 40a and 108a transmit and receive data via the antennas 40b and 108b in a short-range radio communication technology such as bluetooth (registered trademark), wireless LAN, infrared communication, and the like. In the embodiment of fig. 19, by using the original function of the first controller 34 and attaching the gyro sensor unit 100 and the second controller 36 via radio, the second controller 36 and the first controller 34 can be moved completely independently, and an operation with a high degree of freedom can be performed. Further, the gyro sensor unit 100 has not only a function of attaching a gyro but also a function as an adapter capable of connecting each expansion controller by radio.

In the above, the game system 10 is described as an example, but the present invention is applicable to a computer system that executes processing according to a game application or the like based on the movement of the operation device itself.

Although the present invention has been described and illustrated in detail, it is also to be clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, the spirit and scope of the present invention being limited only by the terms of the appended claims.

Claims (16)

1. An operating system, comprising:

a first operating device comprising:

a first housing having an elongated shape and a thickness capable of being held by one hand;

a first operating portion provided on an upper surface of the first housing, the first operating portion being provided at a position such that the first operating portion is operable by a thumb of the hand;

a second operating portion provided on a lower surface of the first casing, the second operating portion being provided at a position where the second operating portion can be operated by an index finger of a hand when a thumb of the hand is placed on the first operating portion;

a grip portion formed on the first housing, the grip portion being provided at a position where the grip portion can be gripped by a palm and other fingers of the hand when a thumb and an index finger of the hand are placed on the first operating portion and the second operating portion, respectively;

a first acceleration sensor;

a camera device provided at an end opposite to the grip portion of the first housing; and

a first connector provided at one end of the grip portion of the first housing, an

A second operation device including at least a second housing, a second connector connectable to the first connector, and a gyro sensor, wherein an operation is performed by connecting the second operation device to the first operation device.

2. The operating system of claim 1,

the second operating device further includes a third connector, and the operating system further includes:

a third operating device including a fourth connector connectable to the third connector, a third housing, a second acceleration sensor, and a stick capable of inputting a direction, wherein the third operating device includes a third housing, a second acceleration sensor, and a stick capable of inputting a direction

The operation is performed by connecting the third operating device to the second operating device.

3. The operating system of claim 1, further comprising:

a third operating device including a third housing, a second acceleration sensor, and a stick capable of performing directional input, wherein

The operation is performed by connecting the third operating device to the second operating device via wireless communication.

4. The operating system of claim 2,

the third operating device includes the second acceleration sensor and the stick in the third housing, and the third housing and the fourth connector are connected via a bendable cable.

5. The operating system of claim 2,

the fourth connector has a shape that can be connected to the first connector in place of the third connector.

6. An extended operation device used in the operating system of claim 1, the extended operation device being the second operation device.

7. The operating system of claim 1,

the second operating device further includes an output data control device for controlling data output to the first operating device via the second connector, and

the first operating device further includes a communication device for transmitting data based on at least outputs from the first operating portion, the second operating portion, the first acceleration sensor, and the image pickup device, and data output from the second operating device via the second connector.

8. The operating system of claim 7,

the second operating device further comprises a third connector, the operating system further comprises a third operating device, the third operating device comprises a fourth connector which can be connected to the third connector, a third shell, a second acceleration sensor and a deflector rod capable of inputting directions, and the third operating device is connected to the second operating device to execute an operation; and

the communication device further transmits data output from the third operation device via the fourth connector.

9. The operating system of claim 8,

the second operating device further includes:

a bus switch for directly connecting the line on the third connector side to the second connector side; and

a bus switch control means for switching the bus switch between on and off, and

when the bus switch is turned off, the line on the third connector side is connected to the second connector side via the output data control device.

10. The operating system of claim 9, further comprising:

gyro sensor power management means for switching the power supply of said gyro sensor between on and off, wherein

The bus switch control device turns on the connection of the bus switch when the power supply of the gyro sensor is cut off.

11. The operating system of claim 10,

the second operating device further comprises a connection detecting device for detecting whether the third operating device is connected to the third connector; and

when the connection with the bus switch is cut off and the third operating device is connected to the third connector, the output data control device alternately outputs first data input from the third operating device and second data based on the output from the gyro sensor to the first operating device.

12. An operating system which has a first operating device, a second operating device, and a third operating device, and performs an operation by connecting the first operating device, the second operating device, and the third operating device or by connecting the first operating device and the third operating device, wherein

The first operating device includes:

a motion sensor for detecting a motion of the first operating device itself;

a belt mounting portion to which a belt is mountable; and

a first connector for connecting a first connector to a second connector,

the second operating device includes:

a second connector connectable to the first connector;

a third connector; and

a cover capable of covering the third connector and being tethered to the second operating device in a state detached from the third connector,

the third operating device includes:

a fourth connector selectively connectable to said first and third connectors; and

a hook disposed near the fourth connector, and

the hook may hook a belt when the first operating device and the third operating device are connected by a connecting structure between the first connector and the fourth connector, and may hook the cover when the second operating device and the third operating device are connected by a connecting structure between the third connector and the fourth connector.

13. An operating device used as the second operating device in the operating system according to claim 12, comprising the second connector, the third connector, and the cover.

14. The operating system of claim 12,

the motion sensor is an acceleration sensor.

15. The operating system of claim 12,

the second operating device further includes a gyro sensor.

16. The operating system of claim 12,

the third operating device further includes an acceleration sensor and a stick capable of inputting a direction.