JP2013232118A - Operation processor - Google Patents

Abstract

To provide an operation processing device capable of reducing the trouble of operation from release of a screen lock state to activation of a desired application.
An operation processing device provided in a terminal having a touch panel overlaid on a display includes an operation determining unit that determines an effective operation on the touch panel for releasing the locked state when the terminal is in the locked state. Based on the operation information of the effective operation for the touch panel determined by the operation determination unit, an operation determination unit for determining whether or not an application corresponding to the operation is registered and an application corresponding to the effective operation for the touch panel are registered. Then, a registered application activation instructing unit that instructs to activate the registered application, and an application activation unit that activates the application instructed by the registered application activation instructing unit.
[Selection] Figure 1

Description

  The present invention relates to an operation processing apparatus that performs processing according to an operation on a touch panel.

  A terminal device such as a mobile phone disclosed in Patent Document 1 can use a plurality of functions properly by operating a touch panel. FIG. 15 is a block diagram showing an electrical configuration of a main part of the mobile phone 1 disclosed in Patent Document 1. As shown in FIG. As shown in FIG. 15, in the mobile phone 1, each operation mode is associated with each password and registered in the storage unit 21, and locus information tc is associated with each password and registered. Then, it is determined whether or not the trajectory information tb generated by the trajectory information generation unit 22 matches each registered trajectory information tc, and when the trajectory information tb matches any one of the trajectory information tc, they match. Thus, the mobile phone 1 is realized in which the operation mode corresponding to the password corresponding to the trajectory information tc is selected and set, and the functions for a plurality of devices can be used properly by one device.

JP 2010-010845 A

  FIG. 16 is a diagram illustrating an example of transition of the screen of the mobile terminal by the user's operation. Note that a touch panel is placed on the display of the portable terminal. When the mobile terminal is in a screen lock state for preventing an erroneous operation or the like, as shown in (Screen A), when the user slides from left to right within a predetermined area 31 on the touch panel, the screen lock state is released. The Next, as shown in (screen B), the user slides the icon page on which each icon corresponding to the application installed on the mobile terminal (hereinafter simply referred to as “app”) is displayed, and Display an icon page containing icons. Next, when the user taps an icon of a desired application as shown in (Screen C), the desired application is activated as shown in (Screen D).

  As described above, in the mobile terminal described above, the user needs to perform at least three operations from the release of the screen lock state to the activation of a desired application. In addition, the user has to search for an icon of an application to be activated from the icons displayed on the icon page. For this reason, there is room for improvement in terms of reducing the labor of operation in the user interface of the portable terminal.

  The objective of this invention is providing the operation processing apparatus which can reduce the effort of operation from cancellation | release of a screen lock state to starting a desired application.

  The present invention is an operation processing device provided in a terminal in which a touch panel is placed on a display, and when the terminal is in a locked state, an effective operation on the touch panel for releasing the locked state is determined. An operation determination unit that determines the presence or absence of registration of an application corresponding to the operation based on operation information of an effective operation for the touch panel determined by the operation determination unit, and an effective operation for the touch panel If a corresponding application is registered, a registered application activation instructing unit that instructs to activate the registered application, and an application activation unit that activates the application instructed from the registered application activation instructing unit, An operation processing apparatus is provided.

  The operation processing device is based on operation information of an effective operation on the touch panel determined by the operation determination unit, and time-series contact information indicating a contact area between the operation body and the touch panel when the operation is performed. And an operation hand determination unit that determines whether an operation performed on the touch panel is performed with a right hand or a left hand.

  In the operation processing device, the application activation unit performs processing so that an input interface of the application displayed on the display is displayed on an operator side indicated by a determination result by the operator determination unit.

  If an application corresponding to an effective operation on the touch panel is not registered, the operation processing device accepts application activation and instructs the application activation unit to activate the received application. Manual operation application activation instruction unit And an application activation management unit that monitors an application activation instruction by the manual operation application activation instruction unit and outputs activation application information that is statistical information obtained from the monitoring to the manual operation application activation instruction unit. The manual operation application activation instructing unit performs a process of displaying on the display a screen that prompts the user to determine whether to activate the application indicated by the activated application information after the locked state of the terminal is released.

  In the operation processing device, the activated application information is information indicating an application activated most frequently during a certain period or the total number of activations, or an application activated during a certain period or within the total number of activations. And information indicating the number of activations.

  In the above-described operation processing apparatus, the apps activated during the predetermined period or within the total number of activations and the number of activations are shown in order of increasing activation frequency, alphabetical order, or alphabetical order.

  According to the operation processing device of the present invention, it is possible to reduce the trouble of operation from the cancellation of the screen lock state to the activation of a desired application.

The block diagram which shows the structure of the operation processing apparatus of 1st Embodiment. The figure which shows an example of the data structure of the internal table in 1st Embodiment The flowchart which shows operation | movement of the operation processing apparatus of 1st Embodiment. The figure which shows an example of the transition of the screen of a portable terminal from the cancellation | release of a screen lock state in 1st Embodiment until starting a desired application. The block diagram which shows the structure of the operation processing apparatus of 2nd Embodiment. The figure which shows the change of a contact area when the slide operation of the X-axis positive direction with respect to a touch panel is performed with the thumb of the right hand when the portable terminal is hold | maintained with the right hand. The figure which shows the change of a contact area when the slide operation of the X-axis positive direction with respect to a touch panel is performed with the thumb of the left hand when the portable terminal is hold | maintained with the left hand. The figure which shows the change of a contact area when the slide operation of the X-axis negative direction with respect to a touch panel is performed with the thumb of the right hand when the portable terminal is hold | maintained with the right hand. The figure which shows the change of a contact area when the slide operation of the X-axis negative direction with respect to a touch panel is performed with the thumb of the left hand when the portable terminal is hold | maintained with the left hand. (A) And (b) is a figure which shows the example in which the input interface of a starting application is displayed The block diagram which shows the structure of the operation processing apparatus of 3rd Embodiment. (A) shows the transition of the screen from the release of the screen lock state to the activation of the application when the activated application information indicates that the most activated application is a browser within a certain period or the total number of activations. (B) is a screen lock state when the activated application information indicates the applications activated for a certain period or within the total activation count and the activation count in descending order of the activation count. Diagram showing an example of screen transition from release to application launch (A)-(c) is a figure which shows the example of operation when canceling the screen lock state of the portable terminal by which the display and the touch panel were each provided in two foldable housing | casings. The figure which shows an example of the data structure of the internal table in the portable terminal shown in FIG. 1 is a block diagram showing an electrical configuration of a main part of a mobile phone 1 disclosed in Patent Document 1 The figure which shows an example of the transition of the screen of the portable terminal by a user's operation

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The operation processing device according to each embodiment described below is provided in a portable terminal (not shown) in which a touch panel is placed on a display. The user of the mobile terminal operates the mobile terminal by sliding, tapping, and long-pressing the touch panel with a finger or a stylus pen. The operation processing device operates when the user performs a predetermined operation on the touch panel when the mobile terminal is in a screen lock state for preventing an erroneous operation or the like.

(First embodiment)
FIG. 1 is a block diagram illustrating the configuration of the operation processing apparatus according to the first embodiment. As illustrated in FIG. 1, the operation processing apparatus 100 according to the first embodiment includes an operation determination unit 101, an unlock processing unit 103, an operation determination unit 105, a memory 107, a registered application activation instruction unit 109, A manual operation application activation instruction unit 111 and an application activation unit 113 are provided.

  Hereinafter, each component of the operation processing apparatus 100 will be described.

  The operation discriminating unit 101 discriminates an effective operation on the touch panel of the mobile terminal, and outputs operation information of the effective operation to the unlock processing unit 103. As described above, the operation on the touch panel includes a slide operation, a tap operation, or a long press operation. When a slide operation is performed on the touch panel, the operation determination unit 101 determines the slide direction or locus, the slide length, and the operation time of the slide operation. Note that the operation determination unit 101 determines that the slide operation is valid only for the slide operation that is determined as the slide length within the predetermined range and the operation time within the predetermined range, and the operation information is obtained. Output to the unlock processing unit 103. The operation information of the slide operation includes a slide direction or locus, a slide length, and an operation time.

  When a tap operation is performed on the touch panel, the operation determination unit 101 determines the tapped position and the number of taps. When the tap operation is performed a plurality of times, the operation determination unit 101 determines that the tap operation is effective only for the tap operation performed within a predetermined range of time, and stores the operation information in the unlock processing unit 103. Output to. The operation information of the tap operation includes the tap position and the number of taps.

  When a long press operation is performed on the touch panel, the operation determination unit 101 determines the position of the long press and the long press time. Note that the operation determination unit 101 determines that the long-pressing operation is valid only for a long-pressing operation within a predetermined range of time, and outputs the operation information to the unlock processing unit 103. The long press operation information includes the long press position and the long press time.

  The unlock processing unit 103 releases the screen lock state of the mobile terminal according to the operation information input from the operation determination unit 101 when the mobile terminal is in the screen lock state. When the unlock processing unit 103 releases the screen lock state of the mobile terminal, the operation determination unit 105 determines the next operation based on the operation information output from the operation determination unit 101. At this time, the operation determination unit 105 refers to an internal table stored in the memory 107.

  FIG. 2 is a diagram illustrating an example of the data configuration of the internal table in the first embodiment. As shown in FIG. 2, the internal table shows operation information and a startup application corresponding to each operation information. The activation application shown in the internal table is an application that is activated following the cancellation of the screen lock state when the operation information corresponding to the application is operated on the touch panel of the mobile terminal in the screen lock state. In addition to the example of the operation information illustrated in FIG. 2, the operation information may be indicated by a coordinate value indicating a slide locus, a tap position, or a long press position when the touch panel is represented by XY coordinates. Further, the slide locus is not limited to a straight line, but may be an arc shape or a wave shape.

  If the activation application corresponding to the operation information output from the operation determination unit 101 is registered in the internal table, the operation determination unit 105 sends an operation instruction to the registered application activation instruction unit 109. The operation instruction includes information indicating a startup application corresponding to the operation information. On the other hand, if the activation application corresponding to the operation information output from the operation determination unit 101 is not registered in the internal table, the operation determination unit 105 sends an operation instruction to the manual operation application activation instruction unit 111.

  In response to the operation instruction from the operation determination unit 105, the registered application activation instruction unit 109 instructs the application activation unit 113 to activate the activation application indicated by the information included in the operation instruction. In response to the operation instruction from the operation determination unit 105, the manual operation application activation instruction unit 111 performs a process of displaying a standby screen or a screen immediately before the screen lock state on the display of the mobile terminal. The manual operation application activation instructing unit 111 accepts activation of an application by the user of the mobile terminal and instructs the application activation unit 113 to activate the received application. The application activation unit 113 activates an application instructed from the registered application activation instruction unit 109 or the manual operation application activation instruction unit 111.

  Next, the operation of the operation processing apparatus 100 according to the first embodiment will be described with reference to FIG. FIG. 3 is a flowchart illustrating the operation of the operation processing apparatus according to the first embodiment.

  As shown in FIG. 3, when the mobile terminal is in the screen lock state, the operation determination unit 101 of the operation processing apparatus 100 determines whether an effective operation has been performed on the touch panel (step S101), and the effective operation is performed. If so, the process proceeds to step S103. In step S103, the lock release processing unit 103 releases the screen lock state of the mobile terminal. Next, the operation determination unit 105 determines whether or not a startup application corresponding to the operation information of the operation determined to be valid in step S101 is registered in the internal table of the memory 107 (step S105). If it is determined in step S105 that the activated application corresponding to the operation information is registered in the internal table, the process proceeds to step S107. If it is determined that the activated application is not registered, the process proceeds to step S111.

  In step S107, the registered application activation instructing unit 109 instructs the application activation unit 113 to activate the activated application registered in the internal table corresponding to the operation information. Next, the application activation unit 113 activates the application instructed from the registered application activation instruction unit 109 in step S107 (step S109).

  On the other hand, when the manual operation application activation instructing unit 111 accepts activation of the application by the user of the mobile terminal in step S111, the process proceeds to step S113. In step S113, the manual operation application activation instruction unit 111 instructs the application activation unit 113 to activate the received application. Next, the application activation unit 113 activates the application instructed from the manual operation application activation instruction unit 111 in step S113 (step S115).

  As described above, in the operation processing apparatus 100 according to the present embodiment, when the mobile terminal is in the image lock state, if the user performs a predetermined operation on the touch panel, not only the image lock state is released, but An application corresponding to a predetermined operation is activated. That is, as shown in FIG. 4, there is only one operation from release of the screen lock state to activation of a desired application. For this reason, the trouble of operation for the user of a portable terminal can be reduced. Further, since only the operation for releasing the screen lock state is performed, the probability of occurrence of an operation error by the user is small. Furthermore, the user does not need to search for an icon of an application to be activated from the icon page.

  The operation information of the internal table stored in the memory 107 can be arbitrarily registered, changed, and deleted by the user. The operation for registering, changing, and deleting operation information may be text input or locus input such as actually operated slide operation.

(Second Embodiment)
FIG. 5 is a block diagram illustrating a configuration of the operation processing apparatus according to the second embodiment. In FIG. 5, the same reference numerals are given to the components common to FIG. 1. As illustrated in FIG. 5, the operation processing device 200 according to the second embodiment includes an operation hand determination unit 251 in addition to the components of the operation processing device 100 according to the first embodiment. In addition, the operation determination unit 201 of the second embodiment outputs contact information described later to the operation hand determination unit 251. Except for these points, the second embodiment is substantially the same as the first embodiment.

  In addition to the functions of the operation determination unit 101 of the first embodiment, the operation determination unit 201 includes time-series contact information and operation information indicating the contact area between the user's finger and the touch panel when an operation on the touch panel is performed. Is output to the operator determination unit 251. Based on the time-series contact information and operation information obtained from the operation determination unit 201, the operation hand determination unit 251 determines whether an operation performed on the touch panel is performed with the right hand or the left hand. However, this determination is effective when the mobile terminal is held with one hand.

  FIG. 6 is a diagram illustrating a change in the contact area when the mobile terminal is held with the right hand and a slide operation in the X-axis positive direction with respect to the touch panel is performed with the thumb of the right hand. FIG. 7 is a diagram illustrating a change in the contact area when the mobile terminal is held with the left hand and a slide operation in the X-axis positive direction with respect to the touch panel is performed with the thumb of the left hand. In FIG. 6 and FIG. 7, the portion where the finger contacts the touch panel is indicated by hatching.

  When the contact point at the start of the slide is on the left side of the contact point at the end of the slide on the X-axis shown in FIGS. 6 and 7, the operator determination unit 251 determines the contact area Ss at the start of the slide and the end of the slide. The difference (Ss−Se) in the contact area Se is calculated. The operator determination unit 251 compares the difference value with the threshold value k, and determines that the operation is performed with the right hand if (Ss−Se)> k, and satisfies (Ss−Se) <− k. If there is, it is determined that the operation was performed with the left hand. Further, the operating hand determination unit 251 determines that the operating hand cannot be identified as either the right hand or the left hand if −k ≦ (Ss−Se) ≦ k. The threshold value k is a positive value set in advance.

  FIG. 8 is a diagram illustrating a change in the contact area when a slide operation in the negative X-axis direction is performed on the touch panel with the thumb of the right hand when the mobile terminal is held by the right hand. FIG. 9 is a diagram illustrating a change in contact area when a sliding operation in the X-axis negative direction is performed on the touch panel with the thumb of the left hand when the mobile terminal is held by the left hand. In FIG. 8 and FIG. 9, portions where the finger contacts the touch panel are indicated by hatching.

  When the contact point at the start of the slide is on the right side of the contact point at the end of the slide on the X axis shown in FIGS. 8 and 9, the operator determination unit 251 determines the contact area Ss at the start of the slide and the end of the slide. The difference (Ss−Se) in the contact area Se is calculated. The operation hand determining unit 251 compares the difference value with the threshold value k, and determines that the operation is performed with the right hand if (Ss−Se) <− k, and (Ss−Se)> k. If there is, it is determined that the operation was performed with the left hand. Further, the operating hand determination unit 251 determines that the operating hand cannot be identified as either the right hand or the left hand if −k ≦ (Ss−Se) ≦ k. The threshold value k is a positive value set in advance.

  Therefore, the operating hand determination unit 251 can determine which hand has performed the slide operation on the touch panel. The operation hand determination unit 251 outputs operation hand information indicating that neither the left hand, the right hand, or the left and right hands can be specified to the operation determination unit 105. Note that the slide operation with which the operator can be determined is not limited to the horizontal operation, and may be an arc-shaped slide operation. That is, the locus of the slide operation on the touch panel only needs to include at least a change on the X axis on the XY axis coordinates shown in FIGS.

  In the present embodiment, the operator information output by the operator determination unit 251 is included in the application activation instruction that the registered application activation instruction unit 109 or the manual operation application activation instruction unit 111 issues to the application activation unit 113. The application activation unit 113 may arrange an input interface to be displayed on the display closer to the operator side when activating the instructed application. For example, when the application activation unit 113 activates mail, if the operating hand information does not indicate left and right, as shown in FIG. 10A, the input interface 25 that is a button for inputting characters is displayed at the lower center of the display. Displayed in the section. On the other hand, when the operating hand information indicates the right hand, as shown in FIG. 10B, the input interface 26 obtained by reducing the input interface 25 is moved to the right side and displayed on the display. The input interfaces 25 and 26 are not limited to buttons, and may be lists or scroll bars.

  As described above, according to the operation processing apparatus 200 of the present embodiment, when a slide operation is performed on the touch panel with a finger of a hand holding the mobile terminal, the slide operation is performed with the right hand or the left hand. It can be determined. At this time, the slide operation with respect to the touch panel is performed with the thumb. However, in the operation with the thumb, it is difficult to contact the operator on the touch panel and the portion on the opposite side on the X axis. However, according to the present embodiment, the input interface of the application that is activated in response to an instruction from the registered application activation instruction unit 109 or the manual operation application activation instruction unit 111 is displayed on the operator side in the display. Therefore, it becomes easy to use the input interface of the application that is activated when the image lock state is released. Further, as compared with the case where the application is activated in response to the application activation instruction that does not include the operator information as in the first embodiment, the user needs to perform menu setting after activation or the operation of moving the input interface. Absent.

  Note that the user can register default operation information in the memory 107. Further, the operation determining unit 105 can use the operator information registered in the memory 107 when no operator is specified.

(Third embodiment)
FIG. 11 is a block diagram illustrating a configuration of the operation processing apparatus according to the third embodiment. In FIG. 11, the same reference numerals are given to the components common to FIG. 1. As illustrated in FIG. 11, the operation processing device 300 according to the third embodiment includes an application activation management unit 351 in addition to the components of the operation processing device 100 according to the first embodiment. Also, the manual operation application activation instruction unit 311 of the third embodiment determines whether to activate a predetermined application immediately after the screen lock state is released based on the information obtained from the application activation management unit 351. Prompt the user for a decision. Except for these points, the second embodiment is substantially the same as the first embodiment.

  The application activation management unit 351 monitors an application activation instruction by the manual operation application activation instruction unit 311. The application activation management unit 351 outputs activation application information that is information based on the information obtained by the monitoring to the manual operation application activation instruction unit 311. The activated application information is information indicating an application activated most frequently during a certain period, or information indicating an application activated most frequently in the total number of activations. In addition, the activated application information is information indicating an application activated during a certain period and its activation count in descending order of activation count, or an application activated within the total activation count and the activation count is large. Information shown in order may be used. The activated application information is information indicating an application activated during a certain period and the number of activations in the order of 50 sounds, or information indicating the application activated within the total activation number and the number of activations in the order of 50 sounds. There may be. Furthermore, the activated application information is information indicating the applications activated during a certain period and the number of activations in alphabetical order, or information indicating the applications activated within the total activation number and the number of activations in alphabetical order. Also good. Note that the user can arbitrarily clear the startup application information, and can change the history setting such as the period.

  Whether the manual operation application activation instruction unit 311 activates the application indicated by the activation application information obtained from the application activation management unit 351 in addition to the function of the manual operation application activation instruction unit 111 of the first embodiment. A process for displaying on the display a screen prompting the user to make the determination is performed. FIG. 12A shows a screen from the release of the screen lock state to the activation of the application when the activated application information indicates that the application activated most frequently within a certain period or the total number of activations is a browser. It is a figure which shows an example of transition of. FIG. 12 (b) shows from the release of the screen lock state to the activation of the application when the activated application information indicates the applications activated for a certain period or within the total activation count and the activation count in descending order of the activation count. It is a figure which shows an example of the transition of a screen. In the example shown in FIGS. 12A and 12B, a screen that prompts the user to determine whether to start the application indicated by the startup application information is shown in the middle.

  Whether or not the manual operation application activation instructing unit 311 performs the screen display process shown in the middle of FIGS. 12A and 12B immediately after the unlock processing unit 103 releases the screen lock state of the mobile terminal. It may be determined based on the setting.

  As described above, according to the operation processing device 300 of the present embodiment, even when the screen lock state of the mobile terminal is released by an operation not registered in the internal table of the memory 107, the user desires it. Applicable application information that can be activated is displayed on the display, and the user can select an application and give an activation instruction. Therefore, the number of operations from the release of the screen lock state to the activation of the desired application can be reduced as compared with the case where the desired application is activated by the operation procedure illustrated in FIG.

  The operation processing device 300 according to the present embodiment has a configuration in which the application activation management unit 351 is added to the operation processing device 100 according to the first embodiment, but the application activation management is performed in the operation processing device 200 according to the second embodiment. A configuration in which the part 351 is added may be used.

  As shown in FIGS. 13A to 13C, the portable terminal described in the first to third embodiments described above has a configuration in which a display and a touch panel are provided in each of two foldable housings. It may be. In this case, as shown in FIG. 14, the internal table of the memory 107 shows the same number of operation information as the number of touch panels, and the startup application corresponding to the operation information. When each touch panel is represented by XY coordinates, the XY coordinates may be independent coordinates for each touch panel or may be a single coordinate representing a plurality of touch panels connected.

  The operation processing device according to the present invention is useful as an operation processing device having a user interface in which the trouble of operation from the release of the screen lock state to the activation of a desired application is reduced.

100, 200, 300 Operation processing device 101, 201 Operation determination unit 103 Unlock processing unit 105 Operation determination unit 107 Memory 109 Registered application activation instruction unit 111, 311 Manual operation application activation instruction unit 113 Application activation unit 251 Operator determination unit 351 Application activation management unit 25, 26 Input interface 31 Predetermined area on touch panel

Claims (6)

An operation processing device provided in a terminal in which a touch panel is arranged on a display,
When the terminal is in a locked state, an operation determining unit that determines an effective operation on the touch panel for releasing the locked state;
An operation determining unit that determines whether or not an application corresponding to the operation is registered based on operation information of an effective operation on the touch panel determined by the operation determining unit;
If an application corresponding to an effective operation on the touch panel is registered, a registered application activation instruction unit that instructs to activate the registered application;
An application launcher that launches an application instructed by the registered app launch instruction unit;
An operation processing apparatus comprising: The operation processing device according to claim 1,
Based on the operation information of the effective operation for the touch panel determined by the operation determination unit, and the time-series contact information indicating the contact area between the operating body and the touch panel when the operation is performed on the touch panel An operation processing apparatus comprising an operation hand determination unit that determines whether the operation performed in the right hand or the left hand is performed. The operation processing device according to claim 2,
The operation processing apparatus, wherein the application activation unit performs processing so that an input interface of the application displayed on the display is displayed on an operator side indicated by a determination result by the operator determination unit. The operation processing apparatus according to any one of claims 1 to 3,
If an application corresponding to an effective operation on the touch panel is not registered, a manual operation application activation instructing unit that accepts application activation and instructs the application activation unit to activate the received application;
An application activation management unit that monitors an application activation instruction by the manual operation application activation instruction unit and outputs activation application information that is statistical information obtained from the monitoring to the manual operation application activation instruction unit;
The manual operation application activation instructing unit performs a process of displaying on the display a screen that prompts the user to determine whether to activate the application indicated by the activation application information after the terminal is unlocked. An operation processing device. The operation processing device according to claim 4,
The activated application information indicates information indicating an application activated most frequently during a certain period or the total number of activations, or indicates an application activated during a certain period or within the total number of activations and the number of activations thereof. An operation processing apparatus characterized by being information. The operation processing device according to claim 5,
The operation processing apparatus according to claim 1, wherein the applications activated during the predetermined period or within the total number of activations and the number of activations are displayed in descending order of activation, alphabetical order or alphabetical order.

Images