JP6147149B2 - Screen input operation device - Google Patents

Description

  The present invention relates to a technique for suppressing erroneous operation of a screen input operation device that performs input by a gesture on a touch panel.

  2. Description of the Related Art Conventionally, as an input operation device capable of intuitive input operation, there is a screen input operation device that performs an input operation by a gesture touching a touch panel. According to such a screen input operation device, while intuitive operation is possible, when the area of the touch panel is small or the touch panel is installed at a location far from the user, the user touches a desired position. However, it is difficult to perform an erroneous operation.

  In particular, in a screen input operation device mounted on a moving body such as a vehicle such as a car navigation device, it is even more difficult for a user to touch a desired position due to a change in vibration or acceleration that occurs as the moving body travels. It is easy to make mistakes.

  With respect to this problem, the screen input operation device disclosed in Patent Document 1 expands the operation button image and its reaction area in the vertical direction when the vibration of the vehicle exceeds a predetermined intensity, thereby reducing the vibration in the vertical direction. However, it is easy to select a desired operation button.

JP 2008-265544 A

  However, there are various factors that cause the user to perform an erroneous operation other than the vibration of the vehicle, and further suppression of the erroneous operation has been demanded. The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a screen input operation device that determines an operation content in consideration of an operation history.

The screen input operation device of the present invention is a screen input operation device mounted on a moving body that performs input by a gesture on a screen, and accepts an operation, and accepts an operation to output a touch position on the screen in the gesture as gesture information. parts and a parameter storage unit for storing a gesture parameter is a parameter for determining the content of the gesture, a parameter correction unit which corrects the gesture parameters based on the operation frequency of the user as correction gesture parameters, corrects the gesture information gesture parameters A gesture determination unit that determines the content of the gesture by comparing with the above, and the gesture parameter includes a type determination parameter for determining the type of gesture .

The screen input operation device of the present invention is a screen input operation device mounted on a moving body that performs input by a gesture on a screen, and accepts an operation, and accepts an operation to output a touch position on the screen in the gesture as gesture information. parts and a parameter storage unit for storing a gesture parameter is a parameter for determining the content of the gesture, a parameter correction unit which corrects the gesture parameters based on the operation frequency of the user as correction gesture parameters, corrects the gesture information gesture parameters A gesture determination unit that determines the content of the gesture by comparing with the above, and the gesture parameter includes a type determination parameter for determining the type of gesture . Therefore, erroneous operation can be suppressed by determining the content of the operation in consideration of the operation frequency .

1 is a configuration diagram of a screen input operation device according to Embodiment 1. FIG. 4 is a flowchart showing an operation of the screen input operation device according to the first embodiment. 6 is a diagram illustrating a screen display example of the screen input operation device according to Embodiment 1. FIG. 6 is a diagram illustrating a screen display example of the screen input operation device according to Embodiment 1. FIG. 6 is a diagram illustrating a screen display example of the screen input operation device according to Embodiment 1. FIG. It is a figure which shows the reaction area | region parameter. It is a figure which shows a button selection log | history. It is a figure which shows the most frequent button reaction area | region correction parameter. It is a figure which shows the parameter number of the reaction area correction parameter according to vehicle information, and a classification determination correction parameter. It is a figure which shows a gesture history. It is a figure which shows a classification determination parameter. It is a figure which shows the most frequent gesture classification determination correction parameter. It is a figure which shows the classification determination parameter after correction | amendment based on an operation history. It is a figure which shows a classification determination correction parameter. It is a figure which shows the classification determination parameter after correction | amendment based on vehicle information. 6 is a configuration diagram of a screen input operation device according to a modification of the first embodiment. FIG. FIG. 11 is a diagram showing a screen display example of a screen input operation device according to a modification of the first embodiment.

<A. Embodiment 1>
<A-1. Configuration>
FIG. 1 shows the configuration of a screen input operation device 100 according to Embodiment 1 of the present invention. Hereinafter, although screen input operation device 100 is explained as what is carried in vehicles, it may be carried in vehicles other than vehicles.

  The screen input operation device 100 includes an operation receiving unit 10, a vehicle information acquisition unit 20, an operation history storage unit 30, a parameter storage unit 40, a parameter correction unit 50, a gesture determination unit 60, a display control unit 70, and a display unit 80. ing.

  The operation reception unit 10 and the display unit 80 are an input interface and an output interface of the screen input operation device 100, respectively. The operation reception unit 10 is realized by a touch pad, and outputs information related to the user's gesture (gesture information) such as a touch position and a touch time to the gesture determination unit 60 described later. The display unit 80 is realized by an image display device such as a liquid crystal panel. Further, the image display device that realizes the display unit 80 constitutes a touch panel together with the touch pad that realizes the operation accepting unit 10.

  The vehicle information acquisition unit 20 is a communication interface connected to various sensors such as an acceleration sensor provided in the vehicle and a map data storage unit (not shown). The vehicle information acquisition unit 20 acquires vehicle information from these connection destinations to obtain a parameter correction unit described later. Output to 50. Here, the vehicle information is information related to the vehicle on which the screen input operation device 100 is mounted. For example, in addition to the vibration direction of the vehicle and the traveling speed of the vehicle, the type of road on which the vehicle travels (highway, general road) Information about. The type of road that is running can be acquired by collating the current position of the vehicle acquired from, for example, a GPS (Global Positioning System) signal with map data.

  The operation history storage unit 30 is realized by a storage medium such as a hard disk drive (HDD), a semiconductor memory, or an SD memory card, and stores an operation history. The operation history includes a button selection history (described later in FIG. 7) indicating the button selection ratio for each screen of the user and a gesture history (described later in FIG. 10) indicating the type ratio of the gesture performed for each button. These are updated as needed whenever a gesture determination unit 60 described later determines a user input operation.

  The parameter storage unit 40 is realized by a storage medium such as an HDD, a semiconductor memory, or an SD memory card, and stores a gesture parameter 41 and a correction parameter 42. The gesture parameter 41 includes a reaction region parameter (described later in FIG. 6) that defines the reaction region of each button displayed on the display unit 80, and a type determination parameter that indicates threshold values of various elements for determining the type of gesture operation. (Described later in FIG. 11). The button reaction area is an area on the touch pad that is determined to be selected when the user touches the touch pad of the display unit 80.

  The correction parameter 42 is a parameter that defines the correction amount of the gesture parameter 41. As the correction parameter 42 based on the vehicle information, a reaction region correction parameter indicating the correction amount of the reaction region parameter (described later in FIG. 9), a type determination correction parameter indicating the correction amount of the type determination parameter (described later in FIGS. 9 and 14), and There is. In addition, as the correction parameters based on the operation history, there are a most frequent button response region correction parameter (described later in FIG. 8) and a most frequent gesture type determination correction parameter (described later in FIG. 12).

  The parameter correction unit 50 acquires vehicle information from the vehicle information acquisition unit 20 and operation history from the operation history storage unit 30, and corrects the gesture parameter 41 using the correction parameter 42 based on these information. The parameter correction unit 50 includes a reaction region parameter correction unit 51 and a type determination parameter correction unit 52. The reaction region parameter correction unit 51 corrects the reaction region parameter by using the reaction region correction parameter and the most frequent button reaction region correction parameter. The type determination parameter correction unit 52 corrects the type determination parameter using the type determination correction parameter and the most frequent gesture type determination correction parameter.

  The gesture determination unit 60 collates the gesture information acquired from the operation reception unit 10 with the corrected reaction region parameter and type determination parameter acquired from the parameter correction unit 50, and determines the user's gesture content. The gesture content is a user selection button and a gesture type for the selection button. The gesture determination unit 60 outputs the determined gesture content to the display control unit 70 and the operation history storage unit 30. Then, the operation history storage unit 30 receives the gesture content and updates the operation history.

  The display control unit 70 controls display on the display unit 80. The display control unit 70 displays buttons based on the reaction region parameters stored in the parameter storage unit 40. Specifically, the buttons are displayed so that the display area matches the reaction area of the button defined by the reaction area parameter. When the operation content determined by the gesture determination unit 60 is acquired, the display on the display unit 80 is controlled based on the operation content.

  The parameter correction unit 50 and the gesture determination unit 60 are realized by a CPU (Central Processing Unit) that executes a program stored in the memory. The display control unit 70 is realized by a CPU or a GPU (Graphics Processing Unit) that executes a program stored in the memory.

<A-2. Operation button judgment>
FIG. 2 shows a flowchart of the operation of the screen input operation device 100 according to Embodiment 1 of the present invention. 3 to 5 are screen display examples of the screen input operation device 100, and the reaction areas of the buttons B and D when a drag operation is performed on the screen of the display unit 80 on which the buttons B and D are displayed. Shows changes. The display positions of the buttons B and D are defined by the reaction region parameters shown in FIG. The reaction area parameter defines the reaction area of the button, but the reaction area coincides with the display area in an initial state before correction described later is performed.
The operation of the screen input operation device 100 that has received the drag operation will be described below with reference to the flowchart of FIG.

  Assume that the user performs a drag operation in the right direction starting from the coordinates (115, 8) as indicated by an arrow in FIG. The operation reception unit 10 detects this gesture (step S1), and sends, for example, gesture information “index 1, touch panel touch time 8 ms, movement distance 30 dots, coordinates (115, 8)” to the gesture determination unit 60.

  Next, the parameter correction unit 50 acquires the vehicle information from the vehicle information acquisition unit 20 and the operation history from the operation history storage unit 30 (step S2).

  The reaction region parameter correction unit 51 selects a button that has been selected by the user with the highest frequency so far among the buttons displayed on the current screen of the display unit 80 (hereinafter, referred to as “most frequent button”). A determination is made based on the operation history (step S3). The operation history used here is the button selection history illustrated in FIG. The button selection history indicates the ratio of buttons (buttons A to D) that the user has selected so far for each screen (screens 1 to 3) displayed by the display unit 80. The current display screen corresponds to the screen 2 in FIG. 7. In the screen 2, the button B is selected most frequently (60%). Therefore, the reaction region parameter correction unit 51 sets the button B as the most frequent button.

  Next, the reaction region parameter correction unit 51 corrects the reaction region of the most frequently appearing button B (step S4). Specifically, the reaction area parameter is acquired from the parameter storage unit 40 as the gesture parameter 41, the most frequent button reaction area correction parameter is acquired as the correction parameter 42, and the reaction area parameter is corrected using the most frequent button reaction area correction parameter. To do.

  FIG. 6 shows the reaction region parameters for buttons A-D. Here, an example in the case where the reaction area is rectangular is shown, and the reaction area parameters include four items, that is, the X coordinate and Y coordinate of the upper left vertex of the reaction area, and the width (W) and height (H) of the reaction area. Consists of. FIG. 8 shows the most frequent button response region correction parameter. The most frequent button reaction region correction parameter indicates a correction amount for the four items of the reaction region parameter.

  According to FIG. 8, the response region correction parameter of the most frequently appearing button B has a width and a height of +5 dots, respectively. Accordingly, 5 dots are added to the width and height of the reaction area parameter of the button B shown in FIG. 6, and the width and height of the reaction area of the button B are 105 dots, respectively. FIG. 4 shows a response region after correction by the most frequently used button response region correction parameter by a dotted frame.

  Next, the reaction area of each button being displayed is corrected based on the vehicle information (step S5). FIG. 9 shows the reaction region correction parameter and the parameter number of the type determination correction parameter corresponding to each item of the vehicle information. The items of vehicle information include longitudinal vibration, lateral vibration, vehicle speed, and road type (highway or general road). For the longitudinal vibration, the lateral vibration, and the vehicle speed, the reaction region parameter and the type determination parameter are corrected (described later) when the threshold value is exceeded. The parameter number of the type determination correction parameter will also be described later.

  Assuming that the vertical vibration 15 is detected by the vehicle information acquisition unit 20, the vertical vibration threshold is exceeded in FIG. The reaction region correction parameter when the vertical vibration exceeds the threshold value is +5 dots in both the upper and lower sides. Therefore, for the button B, the response region parameters (X coordinate: 10, Y coordinate: 10, width: 105 dots, height: 105 dots) after correction by the most frequent button response region correction parameter are shown, and for the button D, FIG. For the reaction region parameters shown in (1), the Y coordinate is -5 and the height is +10 dots. The reaction area after correction by the reaction area correction parameter is shown by a dotted frame in FIG.

  Here, only longitudinal vibration is considered as vehicle information. However, for example, when the condition is satisfied for a plurality of items of vehicle information such as the vehicle speed is 80 km / h in addition to the lateral vibration 15, the reaction region parameter may be corrected by overlapping the plurality of items. The reaction region parameter may be corrected for any one item.

  Returning to FIG. 2, the gesture determination unit 60 determines the operation button (step S6). Here, the gesture determination unit 60 collates the gesture information acquired from the operation reception unit 10 with the corrected reaction region parameter in step S5, and determines an operation button. As shown in FIG. 5, since the coordinates (115, 8) that are the starting point of the gesture operation are included in the corrected response region of the button B based on the operation history and the vehicle information, the button B is determined as an operation button.

<A-3. Determination of gesture type>
Next, the type determination parameter correction unit 52 determines the most frequently used gesture type for the operation button B based on the operation history (step S7). The most frequent gesture type is the most frequently used gesture type among the gestures that have been performed on the operation buttons so far. The operation history used here is the gesture history shown in FIG. The gesture history indicates the operation ratio of the gesture type for each button. Gesture types include tap (touching the touch panel once), press (moving while touching the touch screen), drag (moving fingers while touching the touch panel), pinch-in (two touches on the touch panel) ), Pinch out (increase the distance between the two fingers touching the touch panel), rotate (rotate the two fingers clockwise while keeping the distance between the two fingers touching the touch panel) Or an operation that rotates counterclockwise). According to FIG. 10, the gesture most frequently performed on the operation button B is a drag (90%). Therefore, the type determination parameter correction unit 52 determines that the drag is the most frequent gesture type.

  Next, the type determination parameter correction unit 52 corrects the drag type determination parameter which is the most frequently used gesture type (step S8). Specifically, the type determination parameter is acquired as the gesture parameter 41 and the most frequently used gesture type determination correction parameter is acquired as the correction parameter 42 from the parameter storage unit 40, and the type determination parameter is corrected using the most frequent gesture type determination correction parameter. To do.

  FIG. 11 shows the type determination parameters. Here, six items of index, touch panel contact time, chattering allowable time, movement distance, finger interval, and two-finger fluctuation distance are shown as type determination parameters. The movement distance is the distance that the finger has moved in contact with the touch panel. The finger interval is the interval between two fingers that have touched the touch panel, and pinch-in and pinch-out indicate the interval at the start of operation. In pinch-in (pinch-out), first, the touch panel is touched with two fingers, and the operation of narrowing (expanding) the distance between the fingers is performed. The fluctuation distance of the finger interval at that time is the fluctuation distance of two fingers.

  FIG. 12 shows the most frequently used gesture type determination correction parameter. Here, the most frequently used gesture type determination correction parameter indicates a correction amount for the chattering allowable time, the moving distance, and the two-finger fluctuation distance among the above six items of the type determination parameter. The most frequently used gesture type determination correction parameter related to the drag operation has a chattering allowable time of +2 ms and a movement distance of −2 dots. Therefore, the type determination parameter correcting unit 52 adds the chattering allowable time of the type determination parameter related to the drag operation to 2 ms from 2 ms to 4 ms, and reduces the lower limit of the moving distance from 5 to 2 dots to 3 dots or more. The corrected type determination parameter is shown in FIG. By correcting the type determination parameter in this way, it is easier to determine that the gesture type is a drag operation than before the correction.

  Returning to FIG. 2, the type determination parameter correction unit 52 corrects the type determination parameter of each gesture based on the vehicle information (step S9). As discussed in step S5, since the vertical vibration 15 exceeding the threshold value is detected by the vehicle information acquisition unit 20, the type determination correction parameter of parameter number 1 is used based on FIG. A parameter number type determination correction parameter corresponding to the type of vehicle information is used.

  FIG. 14 shows the type determination correction parameter of parameter number 1. The type determination parameter correction unit 52 adds the type determination correction parameter of parameter number 1 to the type determination parameter after correction based on the operation history (FIG. 13). Here, the type determination parameters are corrected for all gesture types. FIG. 15 shows the type determination parameters after correction.

  Here, only longitudinal vibration is considered as vehicle information. However, for example, when the condition is satisfied for a plurality of items of vehicle information such as the vehicle speed is 80 km / h in addition to the lateral vibration 15, the type determination parameter may be corrected by overlapping the items. The type determination parameter may be corrected for any one item.

  Next, the gesture determination unit 60 determines the gesture type (step S10). Here, the gesture determination unit 60 collates the gesture information acquired from the operation reception unit 10 with the type determination parameter after correction in step S9 (FIG. 15), and determines a gesture type that satisfies the gesture information. Here, since the gesture type that satisfies the gesture information “index 1, touch panel touch time 8 ms, moving distance 30 dots, coordinates (115, 8)” is a drag, the gesture determination unit 60 determines the gesture type as a drag. In addition, although the conditions overlap between press and drag, when the gesture information satisfies both the press and drag conditions, for example, the most frequent gesture type is determined as the gesture type with priority.

  The gesture determination unit outputs the determination result “operation button: B, gesture type: drag” to the operation history storage unit 30 and the display control unit 70. The operation history storage unit 30 receives the determination result, and updates the reaction region parameter (FIG. 6) and the type determination parameter (FIG. 11) (step S11). The display control unit 70 controls display of an image on the display unit 80, and a display that reflects the drag operation on the operation button B is performed on the display unit 80.

<A-4. Modification>
After detecting the user's gesture operation (FIG. 3), screen input operation device 100 according to Embodiment 1 corrects gesture parameter 41 (reaction region parameter and type determination parameter) based on the operation history (FIG. 3). 4, 5). The corrected gesture parameters are discarded after being used for gesture determination. In the next gesture determination, correction is performed again using the gesture parameter 41 before correction.

  However, the screen input operation device 101 according to the modification updates the operation history each time gesture determination is performed, and updates the gesture parameter 41 of the parameter storage unit 40 with a value corrected based on the operation history. If it does so, after detecting gesture operation, gesture determination can be performed only by correcting the gesture parameter 41 based on vehicle information.

  FIG. 16 is a configuration diagram of a screen input operation device 101 according to a modification. The screen input operation device 101 includes a parameter update unit 90 in addition to the configuration of the screen input operation device 100. The parameter update unit 90 stores the reaction region parameter and the type determination parameter corrected by the parameter correction unit 50 based on the operation history in the parameter storage unit 40 again. In other words, the gesture parameter 41 is updated to a value corrected based on the operation history. Since the configuration other than the parameter update unit 90 is the same as that of the screen input operation device 100, description thereof is omitted.

  The display control unit 70 uses the gesture parameter 41 of the parameter storage unit 40 to draw a button so that the display area matches the reaction area. Therefore, when the same screen is displayed again, the most frequently appearing button is displayed large, so that it is possible to suppress the user's erroneous operation. FIG. 17 shows a display screen when the screen input operation device 101 displays the buttons B and D shown in FIG. 3 and then displays the same screen consisting of the buttons B and D again. Based on the reaction area parameter of the button B updated based on the operation history, the display area of the most frequently appearing button B is enlarged and displayed.

  Further, the screen input operation devices 100 and 101 perform the gesture determination by correcting the gesture parameter 41 based on both the operation history and the vehicle information. However, the correction of the gesture parameter 41 based on the vehicle information is essential for the present invention. It is not processing. However, by correcting the gesture parameter 41 based on both the operation history and the vehicle information, it is possible to perform gesture determination in consideration of the situation of the vehicle in addition to the tendency of the user's past operation, and the effect of suppressing erroneous operations Is further improved.

  Although the screen input operation devices 100 and 101 have been described as being mounted on a vehicle, a PND (Portable Navigation Device) that can be mounted on the vehicle, a mobile terminal (for example, a mobile phone, a smartphone, a tablet, and the like), a server, and the like The present invention can also be applied to a screen input operation device constructed as a system by appropriately combining the above. In this case, each function or each component of the screen input operation devices 100 and 101 described above is distributed and arranged in each device constituting the system.

<A-5. Effect>
The screen input operation device 100 according to Embodiment 1 of the present invention is a screen input operation device mounted on a moving body that performs an input by a gesture on the screen. The screen input operation device 100 receives a gesture and outputs an operation reception unit 10 that outputs a touch position on the screen in the gesture as gesture information, and a parameter storage unit 40 that stores a gesture parameter 41 that is a parameter for determining the gesture content. A parameter correction unit 50 that corrects the gesture parameter 41 based on the user's operation history, and a gesture determination unit 60 that checks the gesture information by comparing the gesture information with the corrected gesture parameter 41. By determining the gesture content in consideration of the operation history, erroneous operations can be suppressed. For example, even when the user touches a position slightly deviated from the display area of a desired button, the button is determined as an operation button by enlarging the response area of the button based on the operation history, and erroneous operations are suppressed.

  The gesture parameter 41 includes at least one of a reaction area parameter indicating a reaction area of the button and a type determination parameter for determining the type of gesture. When the gesture parameter 41 includes a reaction region parameter, the operation button can be accurately determined by correcting the reaction region of the button based on the operation history. When the gesture parameter 41 includes a type determination parameter, the gesture type can be accurately determined by correcting the type determination parameter based on the operation history.

  Further, the screen input operation device 100 includes a vehicle information acquisition unit 20 (moving body information acquisition unit) that acquires vehicle information (moving body information) including at least one of a vehicle speed, a change in acceleration, and a type of road on which the vehicle travels. In addition, the parameter correction unit 50 corrects the gesture parameter based on the vehicle information. Thereby, it is possible to suppress an erroneous operation due to a factor caused by traveling of the vehicle.

  The screen input operation device 101 according to the modification includes a display control unit 70 that displays buttons in the same region as the reaction region based on the reaction region parameter stored in the parameter storage unit 40, and the corrected gesture parameter as the gesture parameter 41. The parameter update unit 90 stores the parameter storage unit 40 in the parameter storage unit 40. Therefore, after detecting the gesture operation, the gesture determination can be performed only by correcting the gesture parameter 41 based on the vehicle information. In addition, the display control unit 70 draws a button in the display region that matches the reaction region based on the updated reaction region parameter, so that the most frequently appearing button is displayed large, and it is possible to suppress erroneous operations by the user. .

  In the present invention, each embodiment can be appropriately modified or omitted within the scope of the invention.

DESCRIPTION OF SYMBOLS 10 Operation reception part, 20 Vehicle information acquisition part, 30 Operation history storage part, 40 Parameter storage part, 41 Gesture parameter, 42 Correction parameter, 50 Parameter correction part, 51 Reaction area parameter correction part, 52 Type determination parameter correction part, 60 Gesture determination unit, 70 display control unit, 80 display unit, 90 parameter update unit, 100, 101 screen input operation device.

Claims (3)

A screen input operation device mounted on a moving body that performs input by gestures on the screen,
An operation receiving unit that receives the gesture and outputs a touch position on the screen in the gesture as gesture information;
A parameter storage unit that stores a gesture parameter that is a parameter for determining the content of the gesture;
A parameter correction unit that corrects the gesture parameter as a correction gesture parameter based on the operation frequency of the user;
A gesture determination unit that determines the content of the gesture by comparing the gesture information with the corrected gesture parameter,
The gesture parameter includes a type determination parameter for determining the type of the gesture.
Screen input operation device. The gesture parameter includes a reaction area parameter indicating a reaction area of a button on the screen ,
Based on the reaction region parameter stored in the parameter storage unit, a display control unit that displays the button in the same region as the reaction region;
A parameter updating unit that stores the corrected gesture parameter as the gesture parameter in the parameter storage unit;
The screen input operation device according to claim 1. A moving body information acquisition unit that acquires moving body information including at least one of a speed, a change in acceleration of the moving body, and a type of road on which the moving body travels;
The parameter correction unit corrects the gesture parameter based on the moving body information;
The screen input operation device according to claim 1 or 2.

Images