JP4031504B2 - Information input device with touch of skin - Google Patents

Description

The present invention relates to input means for information equipment.

Japanese Patent Laid-Open No. 11-53153 is a method of reading a fingertip movement by providing a marking on a fingertip and recognizing the marking with a camera.

JP-T-2004-500657 is a method of optically projecting a virtual keyboard on a desk and recognizing a key hit with a finger by a sensor.

Japanese Patent Application Laid-Open No. 2000-112640 is a position detector made of a woven fabric having conductive elements, which is a woven resistive film type touch panel.

Japanese Patent Application Laid-Open No. 2002-203996 is a position detector made of a woven fabric made of a piezoelectric material, which is a woven piezoelectric touch panel.

Further, as a technique for inputting characters and images drawn with a finger or a stylus to an information processing apparatus, a method using a touch panel in a portable information device such as a PDA has been conventionally used.
JP-A-11-53153 Special table 2004-500657 JP2000-112640A JP 2002-203996

However, in the above-described prior art, the special table 2004-500657 needs to be input while visually confirming the optically projected virtual keyboard, and is dependent on vision. Japanese Patent Laid-Open No. 11-53153 uses only the sense on the input side, so the human side discrimination ability for character input is low. Japanese Patent Laid-Open No. 2000-112640 and Japanese Patent Laid-Open No. 2002-203996 have a high development cost because existing parts cannot be used and a new device has to be developed, and a new manufacturing equipment needs to be developed. The wear parts replacement cost is high when the fabric is worn out due to long-term abuse, such as drawing letters on the fabric using a stylus, etc., and wrinkles and wrinkles are likely to occur on the fabric surface (and It is difficult to draw letters on the surface because it is easily affected by the undulations and curved surfaces of the body surface. In view of these points, it is desirable that visually impaired persons can intuitively input characters into the information processing apparatus. In addition, various costs are reduced, or characters, gestures and images are drawn on the skin (with the tactile sensation of the skin) without being affected by the undulations and curved surfaces of the body surface, and these are transferred to the information processing apparatus. I want to be input.

It is assumed that the input device is provided with an input area of a size that fits in a hand and a sensor that detects a pointing position in the input area by a finger or a stylus. The input area is configured such that characters can be drawn on the surface of the hand directly or through a film body with the touch of the skin. When the input device is placed on the hand (on the surface of the hand or in the sky) and a character is drawn in the input area with a finger or a stylus, the character is input to the information processing device through the sensor. It is identified by the sense of touch of the hand directly below.

By drawing letters on the surface of the hand, you can draw patterns accurately through touch. Therefore, ink characters can be input for visually impaired persons. In particular, for kana and alphabet, writing by skin touch is not difficult. By being able to handle ink characters in this way, a barrier-free effect is produced, and communication can be made between blind and healthy persons or between deaf persons by drawing ink on each other's hands. It is also possible to input the conversation as it is to the information processing apparatus. Moreover, since he is proficient in writing, he can write ink on paper using a pen when necessary. It can also be used as an input device for wearable computers.

The present invention produces a barrier-free effect by using ink characters, and is realized in a lightweight and compact form. Therefore, the present invention is provided as an input peripheral device that is used in a state of being integrally connected to the PDA, so that the monitor screen display of the PDA can be used for communication with a sighted person.

FIG. 1 shows an information device for a visually handicapped person provided with a penetrating region. The penetration region is divided into two input regions by a separation band (4 in FIG. 1). This information device is used with at least one of the input areas placed on the hand or other skin. When a finger or stylus indicates an arbitrary position on the skin surface through the input area, there is a sensor (PSD in FIG. 1) that detects the indicated position. The character, gesture or image is input to the information processing apparatus by drawing the character, gesture or image on the other skin surface with the tactile sensation of the skin. Specifically, an instruction position by a finger or a stylus is input to the information processing apparatus, and the input information (characters, gestures, images, etc.) is determined by the information processing apparatus.

The reason why two input areas are provided in FIG. 1 is that the input of the next character is started by alternately using the two input areas when characters are continuously input (that is, the previous character is input). This is because it is easy to determine that it has been completed. Of course, the entire through region may be used as one input region without providing a separation band. When there is one input area, a method of determining that the previous character has been input based on a time interval is conceivable.

In this way, when the input area is divided by the separation band, an indicator (protrusion) indicating that the separation band exists there may be provided on the bottom surface (position facing the hand) or the periphery thereof. For example, the position of the separation band can be determined by tactile sense of the hand on which the device is placed. Further, when the input area is divided by the separation band, not only a method of completely dividing as shown in FIG. 1, but also a method of providing a partial separation band as shown in FIG.

Also, since it is assumed here that the tactile sensation of the hand is used, the size of the input area indicates a size that fits in the hand. In a case where a person on the side uses the back of one person to communicate with characters and inputs the information to an information device, a method with a wide input range may be considered.

Here, the description has been made assuming that when a character, an image, or a gesture is drawn in the input area, it is drawn by a finger or a stylus, but this includes various variations. For example, when the pointing position by a finger or a stylus is detected using an optical sensor, a cap having a reflective material on the surface may be attached to the finger. When using a finger wearing something like this, it should be interpreted as being included in the pattern variation drawn by the finger, or considered as a specially shaped stylus and interpreted as a stylus variation. You can also. Of course, it may be drawn with a pointer other than the stylus, but these various pointers can all be regarded as specially shaped styluses, and they were used in any stylus style. In some cases it can be considered a stylus.

In addition, although described as drawing with touch of the skin on the hand or other skin through the input area, using a pen that can actually draw letters on paper, draw letters on the paper through the input area, It can also be input to information equipment. Continuing to draw letters on the skin with a stylus would be an exercise for actually drawing letters on paper with a pen. When a character is drawn on paper with a pen through the input area, the character is input to the information device, and the input character is displayed on the uneven output device. As a result, it is possible to write characters while confirming the characters that they have written. As described above, when the information device embodying the present invention is installed on paper, it is possible to input characters written on the paper. When the input area is placed on the hand, it is drawn on the surface of the hand with the touch of the skin of the hand directly or through the membrane when the input area is placed on the hand. Can be input to the present invention.

People who have both visual impairment and hearing impairment (hereinafter referred to as “blind people”) communicate by drawing letters on their hands with their fingers. The present invention has been made in view of such a situation, and the character is input to the information processing apparatus when the blind person draws the character with a finger or stylus with the touch of the skin. Is aimed at. As described above, the feature of the present invention is that the input means is accompanied by the sense of touch of the skin.

If the information device is provided with a concavo-convex output device for Braille output, the input operation can be performed while confirming the input characters and commands through the response output by the concavo-convex output device. At that time, if an uneven output device of a type capable of displaying an image is provided, an ink character expressed as a three-dimensional pattern can be displayed. Further, as will be described later, a method using a convex / concave output device of a type that displays characters for visually impaired persons other than Braille, and a method of outputting audio using audio output means are also conceivable. FIG. 18 shows an example of a method involving such input confirmation. In this figure, an input character or command is confirmed by an uneven output device or a response output by voice output, and if the input is wrong, an operation for canceling the input is performed. If the input is correct, the input is automatically confirmed by continuously inputting.

As can be said to the whole of the present invention, the output may be output not only from the uneven output device but also from the audio output means. In the description of the present invention, “speech” refers to synthesized speech (sound synthesized by imitating a human voice by a computer), voice recorded or sampled from a human voice (hereinafter referred to as “sampled voice”), and the like. The term “sound output means” means a sound output from a speaker or the like connected to a computer, and the sound including hardware and software for outputting the synthesized sound and sampling sound from the speaker or the like. Refers to the system for output.

In the description of the present invention, simply speaking “an uneven output device”, an uneven output device for Braille output, an uneven output device for displaying characters for visually impaired persons other than Braille, and ink characters expressed as a three-dimensional pattern It is a broad meaning unevenness output device including various unevenness output devices such as a type of unevenness output device capable of displaying images.

FIG. 2 shows that the penetrating region is within the detection region of the PSD. In FIG. 1, the reason why one through region is divided into two input regions by a separation band is to suppress the number of required sensors. Of course, a sensor may be provided for each input region.

Regarding the implementation of the present invention, a plurality of input regions may be provided in one through region, or one input region may be provided for one through region. For example, an information device having a penetrating area that is much wider than the hand, and when the penetrating area has a plurality of input areas that are smaller than the size of the hand, input work using the sense of touch of the hand When performing the operation, at least one of the input areas is placed on the hand, thereby enabling an input operation. That is, the entire penetrating region does not necessarily have a size that can be accommodated in the hand, but may be any size as long as at least one input region can fit in the hand.

In the description of the present invention, the “size that fits in the hand (width)” means, as shown in FIG. 30, the size of the range including the palm and the entire finger in a state where the fingers are extended to widen the fingers. Refers to that. This applies not only to the palm side of the hand, but also to the back side. This is a measure of the size for an adult male who has no impairment in hand development (ie, excluding developmental disorders such as acromegaly). In the description of the present invention, the term “size that fits in the hand” does not mean a size that covers the entire area, but a size that is less than this size, and is a narrow input. The size may be such that a plurality of regions are arranged and fall within this range. Moreover, as long as most of them are within this range, the size may slightly exceed this range.

The input device according to the present invention is assumed to be installed and used on the hand. However, in the description of the present invention, “on the hand” means the surface and the sky of the hand, The same applies to the back side as well as the palm side. Similarly, “on the skin” refers to the surface and the sky of the skin.

In this embodiment, a frame is provided in the input area. However, as will be described later, a method in which the frame is not provided is also conceivable. Providing a frame in the input area brings various advantages. A visually handicapped person can know the position and range of the input area accurately by tactile sensing, and by providing a sensor in the frame, the sensor can be placed anywhere around the input area. For example, it is possible to use a method in which magnetic sensors are arranged at the four corners of the frame and a magnet is built in the tip of the stylus. In the penetrating region of FIG. 1, an infrared absorbing material (7 in FIG. 1) is affixed to the surface that receives infrared irradiation by PSD. Thus, when using an optical sensor, a material that reflects the light of the sensor is applied to the entire inside of the frame, and a reflective material is provided at the tip of the stylus, thereby effectively removing optical noise from the environment. be able to.

In addition, when the position indicated by the stylus is detected using an optical sensor as in the present embodiment, in order to accurately detect the position indicated by the stylus, a method using a stylus having a small diameter or the radius of the stylus itself A method such as performing an operation in consideration of the above can be considered.

Although FIG. 1 shows an example in which PSD is used as a sensor for detecting the position of a finger or a stylus, FIG. 3 shows an example in which a transmissive photo interrupter is arranged at a position surrounding a penetrating region as another example of the sensor. The position of the finger or stylus can be detected by sequentially scanning the pair of opposing infrared light emitting LEDs and photodiodes.

The weak point of the infrared light emitting LED is that it has a lifetime. Therefore, you may use what used visible light LED as an optical sensor. For example, the amount of light reflected from a finger or stylus by irradiating light from a visible light LED is measured by a light receiving element, the light amount is used as a measure of distance, and the finger measured by two sets of LEDs and light receiving elements or The position of the finger or stylus may be calculated as the intersection of distance circles to the stylus.

In this embodiment, as a means for reducing the influence of disturbance light, if a reflection material is used in the vicinity of the tip of a stylus that is irradiated with LED light, and the amount of reflected light from the detection target is increased, the threshold of sensor input Can be set high, the influence of disturbance light can be reduced. Further, as another method for reducing the influence of disturbance light, a method of providing eaves in front of the light receiving element is also conceivable.

When drawing a character with a finger or stylus, it is necessary to distinguish whether the tip of the finger or stylus is in contact with the skin or is floating. In order to distinguish this optically, it is desirable to make the thickness of the detection region as thin as possible. As a specific means for that purpose, there can be considered a method in which a gap through which light passes for detection is formed into a narrow slit shape by using a light shielding plate or eaves. At this time, if the optical lens is used in combination, the gap can be reduced more effectively. However, care must be taken that the unevenness of the skin does not affect the detection.

As described above, the problem in identifying characters drawn by the stylus is how to identify when the tip of the stylus is sliding on the skin and when it is floating and moving. It is. For example, if a magnetic sensor is placed at the four corners of the frame surrounding the input area and the stylus pointing position with a built-in magnet is to be detected, the sensor will react even when the stylus tip is floating from the skin. Is a problem. In that case, a method of providing a sensor for detecting that the tip of the stylus is approaching the position where the tip of the stylus is in contact with the skin surface can be considered in addition to the sensor for detecting the indicated position by the stylus (here, a magnetic sensor). . For example, an LED and an optical sensor may be provided, and when the tip of the stylus reaches a position where the tip of the stylus is to come into contact with the skin, the optical sensor detects this and turns on the input from the magnetic sensor. Similarly, when drawing through the film body, the position at which the finger or stylus indicates by detecting that the finger or stylus is in contact with the film body is detected by a mechanical sensor provided at the end of the film body. A method of turning on a sensor that detects the occurrence of this is also conceivable. Also, even if the same type of sensor is used, the same effect can be obtained by using a sensor with a different detection range or a different detection range. In the case of a sensor that can be easily selected, the same effect can be obtained by switching the detection region to be checked.

In the information equipment in which the present invention is implemented, characters (in the description of the present invention, when referring simply to “characters”, all known ink letters, Braille, other visually impaired characters, and characters in a broad sense including symbols) Or input of gestures, input of images, input of commands assigned in advance to the divided areas by pointing to the divided areas described later, with the touch of the hand or other skin These methods can also be used for various command inputs and operations, and texts and character strings can be read out through voice output means and uneven output devices according to predetermined operation methods. Is possible.

In the input area, the detection area of the sensor is divided into a plurality of areas in terms of software (hereinafter referred to as “divided area”), and is determined in advance by designating the target divided area with a finger or a stylus. Various operation commands can be selected. It may be configured such that an operation command is input by instructing these areas while pressing a push button switch, or by instructing these areas after performing a mode switching operation. FIG. 4 shows a method in which a character string is read by an uneven output device or voice output means by designating a divided area to which an operation command is assigned with a finger or a stylus. FIG. 19 shows an example of a process of inputting a command associated with these divided areas by designating with a finger or a stylus.

The information device embodying the present invention can read not only characters but also sentences or character strings, and has, for example, a mode switching function such as a “character input” mode and a “character string read” mode. Assumed, the optimum command assignment to each divided area may be set in accordance with the change of these modes.

FIG. 4 shows an example of association of operation commands with respect to each divided area at the time of “character string reading”. In FIG. 4, an operation command for “character advance” is assigned to the divided area arranged near the lower side of the penetrating area, and an operation command for “line feed” is assigned to the divided area arranged near the right side. An operation command for “page feed” is associated with the divided areas arranged in the vicinity. The divided areas near each side are subdivided, and fine operations are assigned.

In FIG. 4, the vicinity of the lower side of the penetrating region is divided into five divided regions. Character feed can be controlled by designating each divided region near the lower side with a finger or a stylus. Characters are sent faster in the right divided area, and characters are sent in the reverse direction faster in the left area. The center area holds the current display (output state). Brailles constituting the sentence or character string are continuously output by the uneven output device or voice output means by this character feeding operation, and the sentence or character string can be read continuously.

In FIG. 4, the vicinity of the right side of the penetrating region is divided into five divided regions. Line feed can be controlled by designating each divided area near the right side with a finger or a stylus. When the subdivision area one level below the center is designated, the line is sent one line at a time, and when the bottom subdivision area is designated, the line is sent ten lines. If the middle area is specified, the current line is retained. When the uppermost divided area is designated from the center, the line returns by one line, and when the uppermost divided area is designated, the line returns by 10 lines. While designating the divided area near the right side, the current line number is displayed on the uneven output device, and the moving line number is displayed in real time (on the uneven output device) in accordance with the line feed operation. .

In FIG. 4, the vicinity of the left side of the penetrating region is divided into five regions. The page feed can be controlled by designating each divided area near the left side with a finger or a stylus. The center divided area holds the current page. The divided area one level above the center is sent page by page. The top divided area is sent 10 pages at a time. The divided area one level below the center returns one page at a time. The lower divided area returns 10 pages at a time. While designating the divided area near the left side, the current page number is displayed on the uneven output device, and the page number that moves as the page feed operation is displayed in real time (on the uneven output device). .

The existence of each divided area and the meaning of the command assigned to them are written in braille around the penetrating area. Further, in order to easily recognize the position of each divided area with a finger or a stylus, a depression is provided inside each frame that is in contact with each divided area.

Here, a method has been described in which the sensor detection area is divided by software and a speed is assigned to the divided area. However, the sensor detection area does not necessarily have to be a divided area, and may be controlled steplessly.

In FIG. 4, the penetrating region is divided into two left and right input regions by a separation band. However, in the case where the penetrating region is divided into a plurality of input regions in this way, the roles may be assigned to the respective input regions. For example, the roles may be shared such that one input area is used for command input (may be a gesture) and the other input area is used for character input.

Here, the method of assigning the operation to each divided area has been described. However, as will be described later in an embodiment in which no frame is provided in the input area, a method of inputting various commands by gestures is also conceivable.

The unevenness output device used in the present invention may output not only a device that displays Braille but also a representation of ink characters as a three-dimensional pattern using an unevenness output device that can display an image. An uneven output device of a type capable of displaying an image is a flat surface (if it is a surface, it is not necessarily limited to a flat surface, and may be a curved surface as long as there is no obstacle to tactile discrimination. Can be expressed as a combination of protrusions and depressions of uneven output actuators arranged in a plane and curved surface, thereby expressing ink characters as a two-dimensional distribution of dots. I can do it. Moreover, you may use the uneven | corrugated output device of the type which outputs the character for visually impaired persons other than Braille so that it may mention later.

When Braille is output continuously at the same part of the uneven output device, the Braille pins in the part are all in a concave state (hereinafter referred to as “non-display state”) every time Braille and Braille are displayed. By inserting, the gap between characters becomes clear and it becomes easy to recognize the continuous transition of braille output. Specifically, the braille may be output after outputting the non-display state for a moment before outputting the next braille. Naturally, the method of inserting the non-display state between the output of individual cells or characters as described above is generally applicable to the case where characters are continuously output from the same part of the uneven output device in the present invention.

Here, the method of continuously reading out one character (or one cell) continuously using the uneven output device for Braille output has been described, but such a method is applied only to the uneven output device for Braille output. In this way, a part of the uneven output device of a type capable of displaying an image may be used to continuously output one character at a time.

By attaching incidental information to each Braille character, it can be used when processing a character string by an information device or notifying a visually impaired person of information. Here, the accompanying information is an attribute of a character string, and is information indicating, for example, when a link is attached to the character string or when the character string is a command. For example, in an information device having an uneven output device for two characters, Braille is displayed in the first cell of the uneven output device, and incidental information belonging to the Braille is displayed in the second cell. Further, when the information device has an audio output means such as a speaker, the incidental information may be output as audio. In the case of reading out by sound output using sound output means such as a speaker, a method of adding some modulation to the sound, a method of outputting another sound such as a beep sound, and the like can be considered. The incidental information can also be used temporarily. For example, when a target character string is selected in order to edit a character string with a word processor or the like, incidental information indicating the selected state is temporarily given to the character string, and the selected state is released. At the same time, the incidental information is deleted.

An information device implementing the present invention can also select commands and modes. Hereinafter, an example of a method for selecting a command or a mode by using the push button switch together will be described. Double-clicking the right push button switch displays a list of currently selectable commands or modes. At this time, when the information device includes the uneven output device for two cells, it is easy to understand if the current display state is displayed in the second cell of the uneven output device. For example, by displaying the initial “ko” of “command list” in the second cell of the uneven output device, it is clearly shown that “command list” is displayed. When the right push button switch is pressed again, the command selection mode is canceled. Commands have a hierarchical structure. The commands are displayed one by one for each line, and each command is read by the unevenness output device or the voice output means while using the “line feed” operation and the “character feed”. When the target command is found, the command is selected by pressing the left push button switch in a state where the line of the command is displayed. Here, you may comprise so that the input confirmation by an uneven | corrugated output apparatus or an audio | voice output means may be accompanied. As a result, switching between the “character input” mode and the “character reading” mode described later, a character string editing command when using a word processor described later, and the like can be used.

In the information device in which the present invention is implemented, since a sentence or a character string can be read and a character can be input, the sentence can be edited by a word processor or the like. In order to use editing commands such as "Copy" and "Delete" when editing text with a word processor, etc., it is necessary to select the target character string, which is the same as the mouse drag operation. Method can be used. That is, with the first character of the character string to be selected displayed, press the left push button switch, and while holding down the left push button switch, move the character or line, and press the left push button switch at the end of the character string. The character string is selected by releasing it. For the selected character string, “se” (acronym for “selection”) is assigned as supplementary information to the braille constituting the character string, and when the selected character string is read, the uneven output device “SE” is displayed in the second cell. When the selection is canceled, the incidental information “se” is deleted. When the left push button switch is pressed again in the selected state, the selected state is released. After selecting the target character string, double-click the right push button switch and select the required character string editing command.

FIG. 5 shows an example in which the input area is not provided with a frame. For example, it is possible to implement a configuration in which no frame is provided in the input area by using a sensor or stylus that is suitable for the sensor or stylus, such as using a PSD for the sensor, using a magnetic sensor for the sensor, and incorporating a magnet at the tip of the stylus.

FIG. 6 shows a state in which a sensor that does not have a frame in the input area is provided at the front end of the keyboard of the notebook computer. In this example, when using a notebook computer on a desk, the notebook computer is placed in a position that protrudes from the front edge of the desk to the front, and the input area is placed on the hand by placing the hand from the bottom to the front edge of the notebook computer. To do. As shown in the figure, an input area may be provided at a position extended to the outside at the end of the information device. In this example, the input area is arranged on the hand. However, the input area is arranged on the desk, and a finger or a stylus is used to input what is drawn on the desk in the input area. Alternatively, the input area may be arranged on a sheet of paper, and a drawing drawn on the sheet of paper may be input.

The PC keyboard is presumed to be used by sighted people and difficult to use for visually impaired people, but with this example, a dedicated input / output device for visually impaired people can be installed, making the notebook computer barrier-free. I can do it.

When the program in the present embodiment is activated, the push button switch provided near the touch panel of the notebook personal computer main body is used for the operation of the program.

In this embodiment, as a method for controlling the reading of a sentence or character string by the unevenness output device or the voice output means, the method for indicating the divided area is difficult (although not impossible). It seems that the operation by is suitable. As an example of controlling the reading of a sentence or a character string by gesture, for example, if the gestures of “character feed”, “line feed”, “page feed” are determined in advance and the “character feed” gesture is performed slowly Characters are sent slowly, and if this gesture is performed quickly, characters are sent quickly. At that time, characters are read out by sound output from the speaker of the personal computer. If this gesture is performed in the opposite direction, a “character return” operation is performed. When the “line feed” gesture is performed slowly, one line is sent, and when this gesture is performed quickly, 10 lines are sent. At that time, the current line is notified in real time by audio output from the speaker of the personal computer. If this gesture is performed in the reverse direction, an operation of “line return” is obtained. When the “page feed” gesture is performed slowly, pages are sent page by page, and when this gesture is performed quickly, pages are sent page by page. At that time, the current page is notified in real time by voice output from the speaker of the personal computer. If this gesture is performed in the opposite direction, a “page return” operation is performed.

In this way, as a method for continuously reading a sentence or a character string, a gesture that moves a finger or a stylus so as to draw a circle is conceivable. As shown in FIG. 17, an area for performing such a reading operation may be provided in the input area, and the reading may be continuously performed by moving the finger or the stylus in a circular pattern in the area. In this figure, the area for drawing a circle is divided by software, and if a circle is drawn by a finger or a stylus in the area, the divided areas 1 to 8 are continuously indicated. From the continuous movement of the indicated position, the direction of drawing a circle (clockwise or counterclockwise) and the speed of drawing a circle can be calculated. At this time, the speed at which the circle is drawn is proportional to the speed at which the braille is continuously output. If the speed at which the circle is drawn is high, the braille character string is sent (output) quickly. If the circle is drawn slowly, the braille character string is sent slowly. When configured to be output (output), the reading speed can be freely controlled. In addition, braille character strings may be sent in the reverse direction when rotated in the reverse direction. These operations may be performed while pressing the push button switch. At this time, a push button switch may be provided for each type of operation such as a “page feed” switch, a “line feed” switch, and a “character feed” switch, and the operation may be performed while these switches are being pressed. Alternatively, these operations may be performed after the mode switching operation. When the mode switching operation is performed, it is helpful to use a switch such as a tumbler switch that can visually recognize a current mode by a visually impaired person.

As another variation of the form in which the frame is not provided in the input area as in this embodiment, a form in which a cutout is provided in a part of the frame or one or more sides are removed from the sides constituting the frame It can also be considered. Moreover, these can also be interpreted as being included in the variation of the frame in description of this invention. Further, in the description of the present invention, even when a frame having such a cutout is provided around the membrane, or when a frame having a form in which one or more sides are removed is provided, the film body Can apply the expression “enclosed” in the frame.

In this embodiment, a frame can be provided in the input area. This is shown in FIG. In the example shown on the left side of FIG. 7, the frame installed in front of the sensor is a folding type, and can be folded and stored toward the bottom surface of the notebook computer. Further, as shown in the middle of FIG. 7, a sliding method may be used. This frame can be made difficult to break by using a flexible material. Further, as shown on the right side of FIG. 7, it may be a method of rotating and storing about an axis. As shown in the figure, a deployment storage mechanism may be provided and deployed and used as necessary.

Here, an example of installing at the front end of the notebook computer or the keyboard of the personal computer has been shown, but it may be installed at the side end instead of the front end. In that case, place the notebook computer or keyboard side edge so that it protrudes from the side edge of the desk, and use your hand from below the side edge of the desk. Moreover, such installation at the end of the information device can also be implemented in a PDA, a mobile phone, and a mouse.

In the description of the present invention, the term “information device” simply includes not only information devices as a main body such as a personal computer, PDA, and mobile phone, but also a keyboard and a mouse as terminals connected to them. Concept.

FIG. 8 shows an example of being built in a glove. A unit including a sensor is installed on the palm side of the glove, and a penetrating region is provided on the palm side of the glove as a region for drawing characters. In addition, a thin film body that is resistant to friction may be provided in the input region, and the film may be drawn through the film body. Information processing devices, batteries, speakers, push button switches, etc. are included in the unit installed on the back side. Since there is no frame in the input area, it is possible to move the finger relatively freely and grab an object. Since it is always worn, it will not fall or be lost. In addition, input work can be done quickly without looking at the screen. Of course, you may provide as a glove provided with the mechanism for hold | maintaining such an input device or information equipment.

In this embodiment, an uneven output device may be provided, but if it is difficult to read the display by the uneven output device, an audio output means can be used as the output device. For example, when a character or a command is input, there is a response as an audio output. This is for input confirmation. If the input is wrong, the input is canceled by pressing the right push button switch. If the input is correct, the input is confirmed by pressing the left push button switch. When the right push button switch is double-clicked, the mode change is accepted, and notification to that effect is given by voice output. When the target mode is input as a character or a gesture, the mode is shifted to, and notification to that effect is given.

The reason why the input area is not provided with a frame in the present embodiment is that the case where an object is grasped is taken into consideration. Therefore, the frame surrounding the input area itself is made of a soft material or an elastic material, or is a multi-joint structure whose shape is restored by a spring, etc., so that it can flexibly handle changes in the shape of the palm when grasping an object. In some cases, it may be practical to use a frame. Further, even when a frame is provided, it seems that there is no problem in practical use as long as the frame has an appropriate size.

Various attachment / detachment mechanisms can be used to hold the information device in the glove. Use a rail as shown in FIG. 9, use a pocket as shown in FIG. 25, use a mechanism for hooking as shown in FIG. 26, or use a cover or belt with a fastener as shown in FIG. The information device may be attachable to and detachable from the glove with a simple attachment / detachment mechanism. Any other known attachment / detachment mechanism may be used. Of course, it may be fixedly held by sewing. When sewing, in the case of an input device that does not have a film body, it may be desirable to provide a thin fabric resistant to friction in the input area. In the case of an input device having a film body, it seems that it is not always necessary to provide the cloth in the input area.

In the case of a glove that covers up to the wrist, it may be stored in the wrist by various deployment storage mechanisms as shown in FIG. 28 and deployed on the hand when necessary. At that time, if a thin and strong cloth is provided at the part where the input area is developed in the palm of the glove, it can be recognized by tactile sensation.

In addition to the wearable method described above, a method of using the tactile sensation of the skin by wearing it on the forearm, upper arm, thigh, abdomen or other skin using a belt or a holder is also conceivable. . When installing on the skin other than the hand, there is no need to consider grasping an object like a hand, so it seems that there is no need to consider restrictions on providing a frame.

Various methods for implementing the present invention in a wearable form are conceivable. FIG. 9 shows a state in which a portable information device using the present invention is detachable from pants. In FIG. 9, the rail is sewn on the pants so that the information device can be attached and detached. The rail is provided with a detent mechanism. When the portable information device is removed, it can be removed by sliding it while pushing down the detent release switch (67 in FIG. 9). Between the two rails, a penetrating region is provided in the trousers, and when the information device is mounted, the penetrating region of the information device is arranged above the penetrating region of the trousers. Thereby, the input work using the skin sensation of the thigh can be performed. A thin cloth (or film) that is resistant to friction may be sewn in the penetrating region of the pants and touched through the cloth. Further, the cloth may be detachable or openable with a Velcro or a chuck.

FIG. 10 shows an information device mounted on the rail. It is assumed that an uneven output device is provided on the side surface, and an input operation is performed with an index finger while a thumb is placed on the uneven output device. As an output device, in addition to the uneven output device, a method using an audio output means or a vibration motor can be considered, and a head-mounted display may be used when a sighted person uses it. In addition, by connecting the information device to an external information device wirelessly and receiving information or sending a command, the character information can be exchanged. Can be provided.

FIG. 31 shows an example of attaching and detaching using a cover having a fastener (71 in FIG. 31). A velcro is provided on the bottom surface (side facing the hand) of the information device and is fixed to the pants with the velcro. A cover is applied from above, and it is held by fixing with a fastener (69 in FIG. 31). As shown in FIG. 32, a pocket (56 in FIG. 32) may be provided inside the cover, and the cover having the fastener may be closed and held after inserting the information device into the pocket. As shown in FIG. 33, a mechanism for fastening a clip or hook or the like is provided near the clothing input area, and the clip or hook or the like provided on the information device is inserted and held there. May be. The left side of FIG. 33 shows a state in which elongated pockets are provided on both sides of the input area in clothing. 33, two clips are provided on the back side of the information device shown on the right side of FIG. 33, and are held by inserting the clips into the pockets. Any known fasteners may be used. For example, a belt may be provided on the cover and a mechanism for tightening the belt may be used as a fastener. Here, an example in which a cover provided with a penetrating region is used has been described, but this is the same even when two belts are used and the belt is regarded as the penetrating region. As described above, the information device may be held using a plurality of belts. Moreover, a groove part and a penetration part may be provided in the information device, and these may be held through a belt or the like. Any other known holding mechanism may be used.

Here, although the example which attaches and detaches to pants using a rail was shown, an attachment mechanism may be provided in clothes other than pants, and various attachment mechanisms other than a rail can be used. FIG. 24 shows an example in which an annular clip is provided on the back surface of the information device. By passing a finger through the annular clip, the penetrating region (input region) can be held on the hand. By providing a pocket as shown in FIG. 25 in the garment, the penetrating region can be held on a thin cloth (26 in FIG. 25) that is resistant to friction by inserting the annular clip into the pocket. At this time, what is drawn with a finger or a stylus can be touched by the skin through the penetrating region of the information device and the annular portion of the clip. Further, by providing a belt as shown in FIG. 26 (57 in FIG. 26) on the garment, the clip can be sandwiched and fixed by the belt. Other known attachment / detachment mechanisms may be used to attach the garment.

Of course, a frame provided with a penetrating area used as an input area is stored by using an expansion storage system as shown in FIG. 28 or any other known expansion storage system, and is expanded and used when necessary. It may be a mechanism.

Here, pants are taken as an example, but such various attachment / detachment methods may be applied to any clothing other than pants. Further, any other known attachment / detachment method or attachment / detachment mechanism may be used.

FIG. 40 shows a penetration region (input region) on the skin by sandwiching the cloth of the clothing between the upper housing (77 in FIG. 40) and the lower housing (78 in FIG. 40) at the sleeve and hem of the clothing. ) Is shown. FIG. 41 shows a structure in which the upper housing (77 in FIG. 41) and the lower housing (78 in FIG. 41) are separated from each other in FIG. The example which enabled it to hold | maintain is shown.

FIG. 20 is an example in which a clip portion (46 in FIG. 20) for holding an information device embodying the present invention on a hand is provided. The clip unit is a gripping mechanism that can hold the information device on the hand even when the finger is opened, and holds the input area on the hand so that the hand is pinched by the clip unit. The clip portion may be retractable. Of course, such a gripping mechanism may be prepared as a detachable component.

Also, a ring-shaped part may be provided, and the input area may be held on the hand by passing a finger therethrough, or may be fixed on the hand or other skin using a device such as a belt or a holder. . Of course, a part for attaching a belt or a holder may be provided, and these devices may be prepared as removable parts. When worn on the skin by a belt or holder, the input area may be held directly on the skin, or when characters, gestures or images are drawn with a finger or stylus on the clothing, In the case of a fabric that is identified in this way, it may be worn with a belt or a holder from above the clothing.

When considering long text input, the problem with using a stylus is the potential for skin hurt by continuing to rub the skin surface with the tip of the stylus. Therefore, when using a stylus at the time of input, from the viewpoint of skin protection, the tip of the stylus is made of soft materials such as brushes, sponges, rubber (including silicon rubber), felt, etc., or resin / balls with a smooth surface. You may make it reduce irritation | stimulation to skin by using what has a friction reduction effect.

However, even when a stylus with a hard tip is used, letters are drawn on the hand through a flexible film body (film) that can be touched from the back side by a finger or stylus. If so, the skin is protected. Although it can be said to the whole of this invention, you may provide such a film body in the penetration area | region (input area) of an input device from the objectives, such as skin protection.

When the film body is provided, the film body does not necessarily need to be provided so as to cover the entire penetration region or the input region, and may be provided so as to cover a part of the penetration region or the input region.

When the film body to which the elastic force is applied to the input region is held in a flat state and a method of drawing characters, gestures or images with a finger or a stylus is used on the surface of the film body, There is an advantage that it is not affected by the undulations and curved surfaces.

In the description of the present invention, the “flat state (shape)” means that when drawing characters, gestures or images on the surface, they are drawn almost without being affected by the undulation or curved surface of the skin surface. This concept indicates that the surface is as flat as possible, and this concept also includes a gently curved surface that does not hinder the drawing of the object. The “flat state (shape)” in the description of the present invention is a concept having such a width.

When such a film body is placed in the input area and a character, gesture or image is drawn on the film body with a stylus, the character, gesture or image is touched by the hand or other skin through the film body. Is recognized. At this time, various known sensors such as an optical sensor and a magnetic sensor can be used as a sensor for detecting the pointing position of the finger or stylus, but the sensor may be installed on the film body itself. A sensor is fixed to the end of the membrane body, and when the membrane body is pointed or reduced with a finger or stylus, the force applied to the membrane body or the degree of deformation of the membrane body caused by this is processed through this sensor. You may use the method of inputting into an apparatus. In this case, the sensor may be a strain gauge or pressure sensitive rubber. FIG. 11 and FIG. 12 detect the deformation of the film body that occurs when the film body is pointed and reduced with a stylus as the distortion of the elastic body fixed to the end of the film body, and each sensor detects it. A state in which the indicated portion is calculated from the difference in distortion is shown.

As can be said for the present invention as a whole, it is desirable to have a mechanism that allows the film body to be replaced when the film body is worn out. Here, the method of installing the sensor at the end of the film body is shown, but a touch panel can also be used as the film body. If it is a touch panel which has a softness | flexibility, all the well-known things can be used as a film body said by this invention by giving elastic force and hold | maintaining on a skin in a flat state. There is a conventional technique (JP 2000-112640, JP 2002-203996) for making a woven fabric into a touch panel, but even if such a touch-coated fabric is used as a film body in the present invention, good.

In order to reliably detect that the stylus tip is in contact with the skin, an actuator linked to the microswitch may be provided at the stylus tip. When the tip of the stylus contacts the film, the microswitch is turned on. While the micro switch is ON, a sensor for detecting the position of the finger or stylus is turned ON. As described above, in the method of detecting the contact pressure with the microswitch, the contact pressure of the stylus is inevitably increased, so that the role of protecting the skin by the film is considered to be large.

The present invention can also be implemented in a wearable form, but in that case, clothing can also be used as a kind of film body referred to herein. When wearable in a form that is worn on the body from the top of clothing using a belt etc., for example, by drawing a character etc. through the fabric by using a thin material that is resistant to friction as part of the fabric of clothing, Input work with touch of skin can be performed. In addition, as described above, the present invention can be implemented in a form in which no frame is provided in the input area. However, in the case of being implemented in a form in which no frame is provided in the input area as described above, the input operation is performed through the film body. Can be done. That is, if an information device implemented in a form in which no frame is provided in the input area is worn on the body from the top of the garment, and the input operation is performed through the cloth of the garment, the input is performed through the film body. Work can be done.

When the input device embodying the present invention is placed on the hand or other skin (the surface of the skin or the sky), and the membrane body surface of the input device is pushed down with a finger or a stylus, the membrane body is deformed to cause the pressing. The part touches the hand or other skin directly underneath. When the pressing pressure is removed, the film body returns to its original flat shape by elastic force. In order to realize this operation, an elastic force is applied to the film body by some method.

As a method of applying an elastic force to the film body, a method of holding the film body on the frame body through the elastic body can be used. The “frame” in the description of the present invention does not mean only a frame as shown in FIG. In FIG. 37, an annular elastic body is held around a pin provided on the inner surface of the housing, and the film body is fixed to the elastic body via a hook. A penetration region is provided on the upper side and the lower side of the case. When a through region (input region) is provided in the housing as shown in the figure, the housing functions as a frame body in the present invention. As described above, all of the objects around the film body and holding the film body function as the “frame body” in the present invention, and the skeleton, the substrate, the housing, etc. All known materials used for holding parts may be used as the “frame”. In the description of the present invention, “holding” means fixing with an adhesive, etc., melting and fixing materials and parts with heat or solvent, fixing with screws and nuts, clips, staples, It includes fixing using pins or any other known fixing method and fixture. In addition, it may include restricting movement of parts using a stopper or the like. In FIG. 37, the pin provided in the housing functions as a stopper that restricts the movement of the film body via the elastic body, and the film body is held by the stopper. Moreover, fixing so that it can rotate centering on this pin by pin fixing etc. is also included. In addition, all known fixing methods and holding methods are included.

As another method of applying an elastic force to the film body, the film body may be held on a frame so as to surround the periphery of the film body, and the frame may have an elastic force. In this case, the frame itself may be made of an elastic material, or the frame may have a structure in which a plurality of parts are connected via an elastic body. In the frame to which the elastic force is applied in this way, a sensor for detecting the indicated position on the film body by a finger or a stylus may be provided. For example, a method may be used in which strain gauges are affixed to the surface of the frame or at several locations inside the frame, and the degree of deformation of each part of the frame body is read by the film body being pressed by a finger or a stylus to calculate the indicated position. Alternatively, in a frame having a configuration in which a plurality of members are connected, a method is provided in which a sensor for detecting mechanical deformation or pressure of pressure-sensitive rubber or the like is provided at each connecting part, and the indicated position is calculated based on input values of these parts. May be used. FIG. 23 shows an example in which a film body is fixed to a frame having elastic force. It is fixed to the sensor unit (1 in FIG. 23) through a flexible material (54 in FIG. 23), and is held on the hand with the gripping part (55 in FIG. 23) sandwiched between fingers. This figure shows an example in which a PSD (3 in FIG. 23) is used as a sensor for detecting a position indicated by a finger or a stylus. The example of FIG. 23 can be regarded as an example in which the film body is fixed to a frame having elastic force, and at the same time, the elastic force is applied when the frame is not provided (assuming that the frame is a part of the film body). It can also be regarded as an example in which a film body is provided.

As another method for applying an elastic force to the film body, the film body itself may be made of an elastic material.

As another method of applying an elastic force to the film body, a crease may be formed around the film body and the elastic force may be applied by being held on a base through the fold.

By devising the film body such that wrinkles and wrinkles are less likely to occur when the film body surface is pushed down with a finger or a stylus, it may be easier to draw characters on the film body surface. As a device to make wrinkles and wrinkles less likely to occur on the surface of the film body, make a cut around the film body, devise a shape around the film body, or make a crease around the film body. A method of suppressing wrinkles and wrinkles by absorbing strain generated in the film body by the structure applied to the film body may be used.

There is a conventional technology in which a camera is provided at the tip of a pen and characters and images are drawn on paper on which a special pattern is printed, and the image is input to an information device. The present embodiment is an example in which the conventional technique is applied.

In an embodiment in which a film body is installed in the penetrating area (input area), the pattern indicating the absolute position according to the above-described conventional technique is printed on the surface of the film body, and the printed pattern is detected at the tip of the stylus. There is a built-in camera. When characters, gestures, and images are drawn on the film body with the stylus, they are touched and recognized by the hand or other skin on the back side of the film body, and simultaneously input from the camera at the tip of the stylus to the information processing apparatus. In the vicinity of the tip of the stylus with a built-in camera, it is preferable to provide a portion that is pointed to the extent that the movement on the film body can be touched and recognized by the skin located on the back side of the film body.

As another method using a camera, as shown in Japanese Patent Application Laid-Open No. 11-53153, a method of detecting a designated position / movement of a finger or a stylus using a camera is also conceivable. When such a method is used, a two-dimensional position on the hand can be grasped by capturing the position of the finger or stylus with the camera from two directions, and at the same time, the direction perpendicular to the surface of the hand. The position of can also be grasped.

The present invention can be applied not only to ink characters but also to braille characters. FIG. 13 shows an example in which the present invention is applied to Braille. A through region (hereinafter referred to as “through hole”) is provided at a portion corresponding to the “point” to be input, and a guide (32 in FIG. 13) for guiding the stylus is disposed around the through region. When the tip of the stylus is guided / inserted along the guide into a target through hole, the tip of the stylus penetrating the hole is palpated by hand. FIG. 14 shows an example of a mechanism for detecting this. In this embodiment, the stylus is an electrode connected to the A / D converter input terminal of the microcomputer, and a soft material is provided at the tip of the stylus so as not to damage the skin when contacting the skin. Each through hole is provided with electrodes (35 in FIG. 14), and these electrodes are voltage-distributed by resistors. Further, if a sensor having a click feeling such as a microswitch is used as a sensor disposed in each through hole, a more reliable input feeling can be obtained. In this embodiment, the slope is used as a guide for guiding the stylus to the hole, but a linear protrusion or groove may be used.

As characters for the visually impaired, those other than Braille have been proposed. FIG. 15 is an example configured to handle visually impaired characters represented by linear protrusions as disclosed in JP-A-2005-70257. The character for the visually impaired shown in Japanese Patent Application Laid-Open No. 2005-70257 is composed of eight linear protrusions arranged radially and eight linear protrusions arranged so as to surround them from four sides. These 16 linear protrusions represent 16-bit characters.

Here, the surrounding linear projection group represents the type of character (a distinction between katakana, hiragana, alphabet, number, common kanji, etc.), and the radial linear projection group is used to specify the character. For example, 8-bit input may be performed after the character type is designated. In FIG. 15, a radial penetrating region extending in eight directions is provided, and a finger or a stylus can input with tactile touch through the penetrating region.

In FIG. 15, a plurality of push button switches capable of designating the type of character with one touch are arranged. Each of these push button switches corresponds to the character type such as “Hiragana”, “Katakana”, “Number”, “Alphabet”, “Common Kanji”, etc., and by pressing these push button switches, After selecting the type, input characters through the radial penetration area. These character type selection push button switches are of the type that is held down and selected exclusively, and visually impaired persons are currently selected by touching the state of these switches. Character type can be determined.

In FIG. 15, linear penetrating areas arranged radially from the center are provided, and an input is made by sliding a finger or a stylus while touching the skin from the center to the end of the radial penetrating area. Is done. A sensor for detecting a finger or a stylus is arranged in each radial penetration region. In FIG. 15, a micro switch is used as the sensor, in order to obtain a click feeling. Other examples of the sensor include a method of installing a transmissive photo interrupter at the end of each penetrating region, and a method of installing a reflective photo interrupter on the side wall of each penetrating region. In addition, for example, a method may be conceived in which electrodes of different voltages that are voltage-divided by resistors are arranged in each through region, and the input voltage is discriminated by an A / D converter.

The uneven output device is provided with two cells suitable for displaying the character for the visually impaired. The first cell displays a 16-bit character, and the second cell is attached when reading a sentence or a character string. It is assumed that information is displayed.

When the radial penetrating region is traced with a finger or a stylus and input is performed bit by bit, a corresponding pin protrudes from the first cell of the uneven output device. This is for input confirmation, and the input operation proceeds while tactile confirmation. When the input bit is wrong, pressing the right push button switch cancels the previous input bit. You may comprise so that an input confirmation may be performed by audio | voice output whenever the input of one character is completed.

Two radial penetrating areas (input areas) are provided, and characters can be continuously input by using them alternately. Of course, one input area may be sufficient.

Here, the right penetrating region controls “character feeding”. When the sensor near the center of the radial penetrating region is turned on with a finger or a stylus, the character is sent at a low speed and is sent to the uneven output device. Characters are output in real time. When the sensor at the end of the penetrating region is turned on, characters are sent at a faster speed, and the characters are output in real time by the uneven output device. When these sensors are not turned on, the uneven output device holds the current character output. Similarly, the left penetrating region is used to perform “character return” control, and the control is in contrast to the right penetrating region.

The upper right penetrating area controls “line feed”. When the sensor near the center of the radial penetrating area is turned on with a finger or a stylus, a line is sent for each line, and the uneven output device The current line number is displayed in real time. When the sensor at the end of the penetrating region is turned ON, a line is sent every 10 lines, and the current line number is displayed in real time by the uneven output device. When these sensors are not turned on, the current line is held. Similarly, the lower left penetrating region is used to perform “line return” control, which is in contrast to the upper right penetrating region.

The lower right penetrating area controls “page feed”. When the sensor near the center of the radial penetrating area is turned on with a finger or a stylus, the page is sent page by page, and the uneven output device The current page number is displayed in real time. When the sensor at the end of the penetrating region is turned on, a page is sent every 10 pages, and the current page number is displayed in real time by the uneven output device. When these sensors are not turned on, the current page is held. Similarly, the upper left penetrating region is used to control “page return”, and the control is in contrast to the lower right penetrating region.

The radial penetrating area on the left side indicates the position of the sensor and its role (“letter feed slow”, “letter feed fast”, etc.) in braille. Can understand the operation.

Alternatively, the left radial penetrating area may be used for “character feed” control, and the right radial penetrating area may be used for “line feed” and “page feed” control.

In the case of an information device that handles characters for the visually impaired represented by linear protrusions shown in Japanese Patent Laid-Open No. 2005-70257, in addition to the above-described method of radially arranging the linear penetrating regions, as shown in FIG. A circular penetrating region can also be used. The operation method for character input is basically the same as that in the case where the linear penetrating areas are arranged radially. First, after selecting a character type with a push button switch, the center of the circular penetrating area is selected. The finger or stylus is moved radially from the periphery to the periphery (with a tactile sense of the hand) to detect the finger or stylus with a sensor arranged around the circular penetrating region, and is input bit by bit.

As a form for handling characters for the visually impaired other than Braille, the form in which the linear penetrating areas are arranged radially or the form in which the circular penetrating areas are provided is a form in which a frame is provided in the input area. Can be regarded as variations of the shape of various frames.

FIG. 21 shows an example in which the film body provided in the penetrating region (input region) can be removed and replaced. It is thought that the film body hurts during use. At that time, the lid (47 in FIG. 21) of the information device can be opened to replace the membrane part.

FIG. 22 shows the film body component. The film body (27 in FIG. 22) is fixed to the frame (51 in FIG. 22) via rubber (52 in FIG. 22). The rubber may have a shape that is fixed to the entire periphery of the film body. The frame is made highly rigid (hereinafter referred to as “film body frame”). Pressure sensitive sensors (50 in FIG. 21) are arranged at the four corners of the membrane component mounting part (48 in FIG. 21) of this information device, and when the membrane component is mounted, the four corners of the membrane frame are at the pressure sensitive. You will get on the sensor. When an arbitrary position on the film body is indicated (pressed down) with a finger or a stylus, the pressure is transmitted to the film body frame via the rubber, and the indicated position is read as a pressure distribution of the pressure-sensitive sensor group.

FIG. 27 shows an example in which the information device of the present invention is stored in a case fixed to the wrist with a belt. The frame (20 in FIG. 27) developed on the hand from the wrist case is pressed against the palm side surface (or back side surface) of the hand by the action of the torsion coil spring (61 in FIG. 27). As a result, the frame body follows the palm side surface (or back side surface) regardless of the wrist angle. Here, an elastic body other than the torsion coil spring may be used. This information device includes a speaker (13 in FIG. 27) and a microphone (63 in FIG. 27), and has the function of a mobile phone. The telephone number is input by drawing a number with a finger or stylus in the input area (27 in FIG. 27). Input confirmation may be performed by sound output from a speaker, or may be displayed on a monitor screen (62 in FIG. 27). The case is provided with a through-hole so that the monitor screen display can be confirmed even when the information device is stored. If you are a sighted person, you can check the other party on the monitor when you receive a call. In this embodiment, various information can be provided not only by telephone but also by sound output from a speaker placed on the ear. For example, when walking is guided by the sound output from a speaker attached to the waist, there is a possibility that it will be drowned out by the surrounding noise. It doesn't matter much.

At this time, it is not always necessary to press against the palm side surface or the back side surface of the hand, and the information device may only be angled toward the side closer to the hand or away from the hand when deployed on the hand. For example, the angle of the information device may be determined by a guide or the like just before the deployment onto the hand is completed. Also, as shown in FIG. 38, in the case where the information device is stored, the information device may be stored in an angled state from the beginning. These apply not only on the palm side but also on the back side. These angles may be set in a direction approaching the hand or in a direction away from the hand. Of course, in all of these, an elastic body as shown in 28 of FIG. 38 may be provided.

Various deployment storage schemes can be used for the present invention in general. FIG. 28 shows examples of various expansion and storage systems. A slide type, a foldable type, a method of expanding and storing by rotation around an axis, and any other known expansion and storage method may be used. Various deployment storage mechanisms may be provided as shown in the figure. Further, in this embodiment, an example of storing in the case when stored on the wrist side is shown, but when storing on the wrist side using such various methods, it is not necessarily stored in the case. . FIG. 39 shows a state in which an input area using a non-contact type sensor (such as an optical sensor or a magnetic sensor) is developed on the hand using a folding deployment storage mechanism. Thus, even when a non-contact type sensor is used, various deployment and storage mechanisms can be used.

As a holding mechanism for holding the information device on the wrist, it may be wrapped around the wrist directly on the wrist by a belt or from above the sleeve of the clothes (wrist part), or the holding mechanism on the sleeve of the clothes (wrist part) In the case of a glove that covers up to the wrist, a holding mechanism may be provided on the wrist of the glove, or the wrist may be held by a clip or the like. FIG. 34 shows an example in which a clip (46 in FIG. 24) for holding on the wrist is provided. The frame is pressed against the hand by an elastic body (61 in FIG. 34) such as a torsion coil spring. By the unfolding and storing mechanism (72 in FIG. 34), it can be folded in the direction opposite to the hand (toward the elbow).

As can be said for the present invention in general, various shapes can be used for the frame and the input area. For example, the frame and the input area do not necessarily have to be a rectangle, and may be a polygon or a circle.

By making the information equipment waterproof, it can be used even in liquids such as water. When the membrane is used in water, water resistance becomes a problem. FIG. 35 shows an example of a method for reducing the resistance of water by using a net as the film body or providing a drain hole in the film body. FIG. 36 shows an example in which a similar effect is obtained by providing drainage grooves and drainage holes in the frame body to which the film body is attached. Further, by such a mechanism, water on the film body can be quickly drained when it is lifted from the water to the air, or drainage on the film body can be improved even when it is raining. Of course, when the net is used as the film body, the entire film body does not necessarily need to be configured by the net, and a part of the film body may be configured by the net. Moreover, these drainage grooves and drainage holes provided in the frame do not necessarily have to be linear. That is, if the film body can reduce the resistance by functioning as a water flow path when it receives water resistance in the water, or when the information device is lifted from the water to the air, rain, shower, etc. As long as the water accumulated on the film body can be drained when it is covered with water, the shape is not necessarily linear, and may be a meandering shape or any other shape. For the drainage grooves and drainage holes provided in the frame body, the drainage holes provided in the membrane body, and the case where a net is used as the membrane body, all the water on the membrane body must be drained. There is no need to drain a part of it. There is not necessarily a plurality of drain holes provided in the film body, and one drain hole is provided so that the information device is drained when the information device is lifted from the water into the air (by tilting the information device). good. When a diver or the like is used in water, it seems that the diver can easily recognize even in dark water if an LED (light emitting diode) is used as an output device.

When such a film body is used, there is a possibility that resistance is generated in the movement of the finger or the stylus. To avoid this, when using a cap on the stylus, gloves, or fingertip, a ball or roller may be provided at the tip of the cap, or a smooth indicator with a surface made of highly self-lubricating resin may be provided. .

In the description of the present invention, “clothing” refers to clothing in a broad sense including trousers, skirts, shirts, outerwear, underwear, socks, gloves, swimwear, and the like, and the present invention may be applied to all of them.

The present invention can be used as a communication tool between blind and healthy persons, or between blind persons, and the characteristics of the present invention can be used for whole-body skin tactile sense other than the hand. Such usage is also conceivable.

In other words, it can be used in the welfare field, such as being able to realize input using the tactile sensation of a normal skin site in a person who has burned the whole body. A person engaged in dangerous work can perform input work without looking away from the object. Adapted to special situations such as using the monitor with sound output through earphones in situations where the monitor screen illumination cannot be used for input work in the dark, such as the work of observing wildlife in the dark. Can be considered. Moreover, divers etc. can also be used underwater by setting it as a waterproof structure.

Example using PSD as sensor The penetration area is within the PSD detection area Example of LED and phototransistor array as sensors Example of associating control commands with divided areas Example implemented as a form without a frame Example implemented with no frame at the front edge of the laptop Example implemented as a form with a frame at the front edge of the notebook computer Example built in a glove Example of removable pants Example of information equipment when detachable from pants Example using a membrane with mechanical sensors at four corners Reading the deformation of the membrane as the difference in the input intensity of the mechanical sensor Example implemented for Braille input Example of input circuit when implemented for Braille input Example using characters for visually impaired persons disclosed in Japanese Patent Laid-Open No. 2005-70257 An example in which a circular through region is provided in order to use JP-A-2005-70257 Touch panel division area for controlling Braille output by rotating a finger or stylus Proceeding with input while confirming the response of the uneven output device or voice output means Command input by specifying the divided area to which the command is associated Example of providing a mechanism to hold on the hand with a clip An example of changing the membrane Diagram explaining membrane parts Example of applying elastic force to a film body using an elastic frame Example with an annular clip Example of a pocket for attaching this input device to clothing Example of providing a belt to attach this input device to clothing Example of storing in the wrist case Various storage methods Example of dividing the input area by partial separation Illustration explaining “size that fits in hand” The figure which shows the attachment mechanism to the clothing using a cover The figure which shows the attachment mechanism to the clothing using the cover which provided the pocket The figure which shows the attachment mechanism to the clothes with the clip and the pin The figure which shows the mechanism which attaches to the wrist etc. with the clip The figure which shows the example which provided the drainage mechanism in the membrane The figure which shows the example which provided the drainage mechanism in the frame Illustration to explain the concept of "frame" and "hold" Attaching to the wrist with an inclination (along the angle of the hand) An information device using a non-contact sensor can be stored on the wrist An example of holding clothing cloth between upper and lower casings that open and close Example of holding clothing cloth between the upper and lower casings

Explanation of symbols

1 Information Device 2 Implementing the Present Invention 2 Penetration Area (Input Area)
3 PSD
4 Separator 5 Push button switch 6 Uneven output device 7 Infrared absorber 8 Individual PSD detection area 9 Area where both detection areas overlap 10 Input area 11 Infrared LED
DESCRIPTION OF SYMBOLS 12 Phototransistor 13 Speaker 14 Division | segmentation area | region 18 Notebook personal computer 19 Sensor 20 Frame body 21 Unit 22 equipped with information processing apparatus, power supply, etc. Sensor unit 23 Gloves 24 Pants 25 Rail 26 Thin and strong cloth 27 Film body 28 Elastic body 29 sensor (detects mechanical deformation)
30 Stylus 31 Through hole 32 Guide slope 33 Guide pin 34 Ring-shaped conductor (connected to the input terminal)
35 Voltage-distributed electrode 36 Micro switch 37 Character type selection switch 38 Magnet 39 Touch panel 40 Divided area 46 for character feed control Clip 47 Cover 48 Membrane component mounting part 49 Presser (spring)
DESCRIPTION OF SYMBOLS 50 Pressure-sensitive sensor 51 Film body frame 52 Rubber | gum 53 Elastic frame 54 Flexible material 55 Gripping part 56 Pocket 57 Belt 58 The axis 59 used as the rotation center at the time of rotating a frame body Slit (for storing an input device) Gap)
60 Hand 61 Elastic body (torsion coil spring, etc.) to press the frame against the hand
62 Liquid crystal display (monitor screen)
63 Microphone 64 Case 65 Through-hole 66 for viewing LCDs “Size that fits in hand”
67 Detent release switch 68 Velcro 69 Fastener 70 Penetrating region 71 Cover 72 Deployment storage mechanism 73 Film body 74 constituted by net Drain hole 75 provided in film body Drain groove 76 provided in frame body Provided in frame body Drainage hole 77 Upper housing 78 Lower housing 79 Pin (boss etc.)
80 hooks

Claims (4)

An input device for inputting an instruction position by a finger or a stylus to an information processing device,
Having a frame that has one or more penetrating areas of a size that fits in the hand, or most of which fits in the hand,
In the penetrating region, the film body is held by the frame body in a state surrounded by the frame body, and is held in a flat state by being given an elastic force,
An information processing apparatus that detects the indicated position from the distribution of the indicated pressure on the film body by a finger or a stylus, or the degree of deformation of each part of the film body or the degree of deformation of each part of the frame body caused by the indicated pressure. Has a sensor to input to
When the frame body is placed on the skin, the input position by the finger or stylus can be touched by the skin through the membrane body, or the input device Information equipment equipped with the device In claim 1,
Having a holding mechanism for holding the frame on the wrist;
The frame body is stored around the wrist, and has a deployment storage mechanism that can be deployed on the hand,
An input device having an elastic body capable of urging the frame body toward the hand side in a state where the frame body is unfolded on the hand by the unfolding and storing mechanism, or the input device is mounted Information equipment An input device for inputting an instruction position by a finger or a stylus to an information processing device,
Having a frame that has one or more penetrating areas of a size that fits in the hand, or most of which fits in the hand,
In the penetrating region, the film body is held by the frame body in a state surrounded by the frame body, and is held in a flat state by being given elastic force, and has a film body having a pattern pattern indicating an absolute position,
A stylus having a camera at the tip that captures the pattern and inputs it to the information processing apparatus;
When the frame body is placed on the skin, the input position by the stylus can be touched by the skin through the membrane body, or the input device Information equipment to be installed In claim 3,
Having a holding mechanism for holding the frame on the wrist;
The frame body is stored around the wrist, and has a deployment storage mechanism that can be deployed on the hand,
An input device having an elastic body capable of urging the frame body toward the hand side in a state where the frame body is unfolded on the hand by the unfolding and storing mechanism, or the input device is mounted Information equipment

Images