CN108984092B - Device control method, device, storage medium and electronic device - Google Patents

Abstract

The application discloses a device control method, a device, a storage medium and an electronic device, wherein the device control method is applied to the electronic device comprising a screen, and comprises the following steps: acquiring a track of at least two fingers sliding on the screen in the same direction and touch duration of each track point in the track; determining a target instruction group from a plurality of candidate instruction groups according to the touch duration; determining a target instruction from the target instruction group according to the track; the electronic equipment is correspondingly controlled according to the target instruction, so that various equipment functions can be started in a multi-finger sliding mode without entering a related operation interface, and the method is simple and high in flexibility.

Description

Device control method, device, storage medium and electronic device

technical field

The present application relates to the field of computer technologies, and in particular, to a device control method, device, storage medium, and electronic device.

Background technique

With the development of terminal technology, the functions of mobile terminals, especially smart terminals, are becoming more and more powerful, and they have gradually become an indispensable part of people's lives.

During the use of smart terminals, users often use various functions, such as screen lock function, split screen function, sound adjustment function, screen rotation function, memory cleaning function, etc. Usually, if a user needs to perform a certain function, It is necessary to enter the relevant interface and execute it through the relevant interface, and for different functions, the user may need to enter different interfaces, which is complicated to operate and has poor flexibility.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a device control method, device, storage medium, and electronic device, which do not require an interface to perform various functions of the device, and the method is simple.

An embodiment of the present application provides a device control method, which is applied to an electronic device, where the electronic device includes a screen, and the device control method includes:

Acquiring the trajectory of at least two fingers sliding in the same direction on the screen, and the touch duration of each trajectory point in the trajectory;

Determine a target instruction group from a plurality of candidate instruction groups according to the touch duration of the starting point and the touch duration of the end point;

Determine a target instruction from the target instruction group according to the trajectory;

The electronic device is controlled accordingly according to the target instruction.

An embodiment of the present application further provides a device control device, which is applied to an electronic device, where the electronic device includes a screen, and the device control device includes:

an acquisition module, configured to acquire the trajectory of at least two fingers sliding in the same direction on the screen and the touch duration of each trajectory point in the trajectory;

a first determining module, configured to determine a target instruction group from a plurality of candidate instruction groups according to the touch duration;

a second determining module, configured to determine a target instruction from the target instruction group according to the trajectory;

The control module is used for correspondingly controlling the electronic device according to the target instruction.

Embodiments of the present application further provide a computer-readable storage medium, where a plurality of instructions are stored in the storage medium, and the instructions are suitable for being loaded by a processor to execute any one of the foregoing device control methods.

An embodiment of the present application further provides an electronic device, including a processor and a memory, the processor is electrically connected to the memory, the memory is used for storing instructions and data, and the processor is used for any of the above The steps in the described device control method.

The device control method, device, storage medium and electronic device provided by the present application are applied to electronic devices including a screen, by acquiring the trajectory of at least two fingers sliding in the same direction on the screen and the touch of each trajectory point in the trajectory and determine the target instruction group from multiple candidate instruction groups according to the touch duration, and then determine the target instruction from the target instruction group according to the trajectory, and control the electronic device accordingly according to the target instruction, so that the electronic device can be controlled through multiple The method is simple, flexible, and user experience is good.

Description of drawings

The technical solutions and other beneficial effects of the present application will be apparent through the detailed description of the specific embodiments of the present application in conjunction with the accompanying drawings.

FIG. 1 is a schematic diagram of an application scenario of a device control system provided by an embodiment of the present application.

FIG. 2 is a schematic flowchart of a device control method provided by an embodiment of the present application.

FIG. 3 is another schematic flowchart of a device control method provided by an embodiment of the present application.

FIG. 4 is a schematic diagram of various sliding directions provided by an embodiment of the present application.

FIG. 5 is a schematic diagram of file transmission and window adjustment provided by an embodiment of the present application.

FIG. 6 is a schematic flowchart of step 209 provided in this embodiment of the present application.

FIG. 7 is another schematic flowchart of step 209 provided in this embodiment of the present application.

FIG. 8 is another schematic flowchart of step 209 provided in this embodiment of the present application.

FIG. 9 is another schematic flowchart of step 209 provided by this embodiment of the present application.

FIG. 10 is a schematic structural diagram of a device control apparatus provided by an embodiment of the present application.

FIG. 11 is another schematic structural diagram of a device control apparatus provided by an embodiment of the present application.

FIG. 12 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

Embodiments of the present application provide a device control method, device, storage medium, and electronic device.

Please refer to FIG. 1. FIG. 1 provides a schematic diagram of an application scenario of a device control system. The device control system may include any device control apparatus provided in the embodiments of the present application. The device control apparatus may be integrated into an electronic device. Electronic devices may include touch-enabled devices such as smart phones, tablet computers, and the like.

The electronic device can obtain the trajectory of at least two fingers sliding in the same direction on the screen, and the touch duration of each trajectory point in the trajectory. The duration determines a target instruction group from a plurality of candidate instruction groups, and then determines a target instruction from the target instruction group according to the trajectory, and controls the electronic device accordingly according to the target instruction.

For example, the candidate instruction group may include at least a first candidate instruction group and a second candidate instruction group, the first candidate instruction group may include instructions for instructing device parameters to be adjusted, and the second candidate instruction group may include Instructions for state switching of device modes. The preset duration can be set manually, such as 3 seconds or 4 seconds, which is slightly longer than the time required to end the action normally, and is used to reflect a pause state. Usually, the touch duration of any track point is shorter than the preset duration. The finger does not pause at the track point, and when the duration is greater than or equal to the preset duration, it means that the finger has a pause state at the track point.

In Figure 1, when the electronic device is in the unlocked state, if it is detected that the user's two fingers are sliding in the same direction on the screen, it can be determined which candidate command group to select according to the pause at the starting point and the ending point. If it stops at the starting point, the first candidate instruction group is selected. If it only stops at the end point, or does not stop at the end point and the starting point, the second candidate instruction group is selected. After that, it can be further determined from the candidate instruction group according to the trajectory. A single command, for example, when the trajectory is sliding, select the command to increase the volume value or the brightness value in the first candidate command group, and in the second candidate command group, if it only slides at the end point, select the cleaning mode. An instruction to perform state switching, such as switching the cleaning mode from the non-cleaning state to the cleaning state, if so. When the track is sliding upwards, select an instruction to decrease the volume value or brightness value in the first candidate instruction group, and select an instruction to switch the notification mode in the second candidate instruction group, for example, change the notification mode to allow notification The state switches to the notification-disabled state.

As shown in FIG. 2, FIG. 2 is a schematic flowchart of a device control method provided by an embodiment of the present application, which is applied to an electronic device, and the electronic device includes a screen, and the specific process may be as follows:

101. Acquire a track of at least two fingers sliding in the same direction on the screen, and a touch duration of each track point in the track.

In this embodiment, when the electronic device is in a normal use state (that is, in an unlocked state), the sliding information of the finger on the screen can be detected in real time. The sliding information includes the position of the sliding point and the corresponding touch moment, and is generated according to the sliding information. Corresponding to the sliding track, the sliding track generally refers to a regular or irregular line segment formed between the starting point and the ending point, such as a straight line segment, a polyline segment, a curved line segment, and the like. The co-directional sliding refers to sliding in the same direction. Generally, the sliding trajectory formed when multiple fingers slide in the same direction is a plurality of line segments with the same shape.

102. Determine a target instruction group from multiple candidate instruction groups according to the touch duration.

For example, the trajectory point may include a start point and an end point, and the candidate instruction group may include a first candidate instruction group and a second candidate instruction group. In this case, the above step 102 may specifically include:

Determine whether the touch duration of the starting point is not less than the preset duration;

If so, when the touch duration of the end point is less than the preset duration, acquire a first candidate instruction group as a target instruction group, and the first candidate instruction group includes an instruction for instructing the electronic device to perform parameter adjustment;

If not, when the touch duration of the end point is less than the preset duration, a second candidate instruction group is obtained as the target instruction group, and the second candidate instruction group includes an instruction for instructing the electronic device to perform state switching.

In this embodiment, the preset time period can be set manually, for example, 3 seconds or 4 seconds, which is slightly longer than the time required to end the action normally, and is used to reflect a pause state. When the touch duration of a track point is greater than or equal to the preset duration, it means that the user's finger pauses here, and different pause methods can correspond to start different types of application functions. When the finger slides, the electronic device can real-time Detect the pause situation of each track point. For example, when the user's finger starts to pause at the starting point, a small range of command groups can be initially determined, such as a series of commands belonging to the parameter adjustment type or state switching type. The parameter Can include brightness or volume, etc.

In another embodiment, the candidate instruction group may further include a third candidate instruction group. In this case, after judging whether the touch duration of the starting point is not less than a preset duration, the device control method may further include:

When the touch duration of the starting point is not less than the preset duration, detect whether there are multiple application windows displayed in the foreground interface;

If so, acquire a third candidate instruction group as the target instruction group, and the third candidate instruction group includes an instruction for instructing the corresponding application window to be processed;

If not, when the touch duration of the end point is less than the preset duration, the first candidate instruction group is acquired as the target instruction group.

In this embodiment, the processing of the corresponding application window may include adjusting the size of the corresponding application window, transferring files to the corresponding application window, and the like. When the finger starts to slide after pausing at the starting point, if the current interface is a split-screen interface (that is, at least two application windows are displayed at the same time), it can be considered that the user wants to process the application windows. If the current interface is not a split-screen interface, you can It is assumed that the user wants to make adjustments to the device parameters.

103. Determine a target instruction from the target instruction group according to the trajectory.

In this embodiment, the two dimensions of touch duration and trajectory can be used to determine which function of the electronic device needs to be activated. For example, different pause situations, sliding directions and sliding distances of trajectory points can correspond to different instructions.

(A) When the target instruction group is the first candidate instruction group

In one embodiment, the above step 103 may specifically include:

When the track indicates sliding along the first preset direction, and the sliding distance is not less than the first preset distance, acquire an instruction to increase the volume value and/or the brightness value from the first candidate instruction group as a target instruction;

When the track indicates sliding in a direction opposite to the first preset direction, and the sliding distance is not less than the first preset distance, obtain the instruction to decrease the volume value and/or the brightness value from the first candidate instruction group command as the target command.

In this embodiment, both the first preset direction and the first preset distance can be set manually, for example, the first preset direction can be up or down, and the first preset distance can be a certain fixed value, Or according to the length or width of the screen, such as two-thirds of the length or width of the screen. When the finger pauses and slides the first preset distance in the first preset direction, an instruction to increase numerical parameters such as volume or brightness can be obtained, and when the finger pauses, slide the first preset distance in the opposite direction of the first preset direction When the distance is set, you can obtain the command to reduce the numerical parameters such as volume or brightness.

(B) When the target instruction group is the second candidate instruction group

In one embodiment, the above step 103 may specifically include:

Judging whether the trajectory satisfies a first preset condition, the first preset condition is sliding along a second preset direction, and the sliding distance is not less than the second preset distance;

If so, when the touch duration of the end point is not less than the preset duration, obtain from the second candidate instruction group an instruction instructing to perform state switching on the cleaning mode, as the target command, and the cleaning mode includes a cleaning state and a non-cleaning state; or,

When the touch duration of the end point is less than the preset duration, obtain an instruction from the second candidate instruction group that instructs the state switching of the lock screen mode, notification mode, sound mode and/or screen rotation mode, as the target instruction, the lock screen mode The screen mode includes a locked state and an unlocked state, the notification mode includes a notification enabled state and a notification prohibited state, the sound mode includes a silent state and a ringing state, and the screen rotation mode includes a rotation prohibited state and a rotation enabled state.

In this embodiment, the second preset direction and the second preset distance can be set manually. When the finger slides along the second preset direction for the second preset distance and pauses, the memory clearing operation can be started, or the memory clearing operation being executed can be stopped. When the finger only slides the second preset distance along the second preset direction, other modes can be switched, such as one or more of the lock screen mode, notification mode, sound mode, screen rotation mode, etc. Switching, and during the switching process, it is necessary to first determine which state the electronic device is currently in, and then switch it to another state.

In another embodiment, the above step 103 may specifically include:

Determine whether the track indicates sliding along the curve, and the foreground display interface does not belong to the preset application;

If so, obtain an instruction from the second candidate instruction group to instruct to switch the state of the screen display mode as a target instruction, and the screen display mode includes a horizontal display state and a vertical display state.

In this embodiment, the preset application may be an application related to image viewing. When the track includes multiple sliding directions, and the changing rules of these sliding directions are constant, it can be considered as sliding along a curve. In the case of rotation, a curved sliding trajectory will be formed. Specifically, in the image viewing interface, the user's finger rotation can activate the image rotation function, and in the non-image viewing interface, the user's finger rotation can activate the screen rotation function.

In another embodiment, when the touch duration of the end point is still less than the preset duration, the above step 103 may specifically include:

Judging whether the trajectory satisfies a second preset condition, the second preset condition is sliding along a third preset direction, and the sliding distance is not less than the third preset distance;

If so, when the foreground display interface is the default interface, the first command, the second command or the third command is obtained from the second candidate command group as the target command, and the first command is used to instruct to close the foreground display interface. The second instruction is used for instructing to perform a split screen operation on the foreground display interface, and the third instruction is used for instructing to switch the foreground display interface to the notification preview interface.

In this embodiment, the third preset direction and the third preset distance can be set manually. The preset interface may be any application interface that does not include the main screen interface, or an interface of a split-screen application. The notification preview interface is mainly used to display various reminder notifications such as missed calls and unseen messages. The split screen operation mainly refers to dividing the screen into at least two display windows, and the different display windows operate independently of each other.

When the finger slides the third preset distance along the third preset direction, if the foreground display interface is any application interface that does not include the main screen interface, the foreground application can be closed (equivalent to switching to the closed state) or the notification preview can be displayed interface, in which the switching method of switching the foreground display interface to the notification preview interface can be slide down (slide down) or left slide (right slide). It is equivalent to switching to the split-screen state), and during the split-screen process, the user can select other single or multiple applications that need to be displayed on the screen at the same time, or can be selected by the system by default.

In another embodiment, when the touch duration of the end point is still less than the preset duration, the above step 103 may specifically include:

Determine whether the track slides along the fourth preset direction, and the foreground display interface is an application interface;

If so, calculate the sliding speed according to the touch duration and the total length of the track;

When the sliding speed is not less than the preset speed, an instruction instructing to switch the foreground application is obtained from the second candidate instruction group as a target instruction.

In this embodiment, the touch duration of each track point can be accumulated to obtain the total duration, and then the ratio between the total track length and the total duration can be calculated to obtain the sliding speed. The preset speed mainly refers to the speed of sweeping on the screen, the fourth preset direction and the preset speed can be set manually, and the fourth preset direction can be left, right, or up and down. Switching the foreground application may include switching the foreground application and the background application, or switching the foreground application and a designated application.

(C) When the target instruction group is the third candidate instruction group

In one embodiment, the above step 103 may specifically include:

When the position of the starting point in the track overlaps with the position of the boundary line in the application window, obtain an instruction instructing to adjust the size of the corresponding application window from the third candidate instruction group as the target instruction; or,

When the position of the starting point in the track overlaps with the position of the file in the application window, and the starting point and the ending point are located in different window applications, the instruction instructing the file transfer to the corresponding application window is obtained from the third candidate instruction group, as target instruction.

In this embodiment, for a foreground interface that displays multiple application windows at the same time, when the finger pauses at the starting point and then slides, if the paused place is where the boundary line of the application window is located, the window adjustment function can be activated. When a file is located in the application window, and the start and end points of the swipe are in different application windows, the file transfer function can be activated.

104. Perform corresponding control on the electronic device according to the target instruction.

For example, when the target instruction is used to instruct to switch the foreground application, the above step 104 may specifically include:

Determine the background application running in the electronic device and the start time of the background application;

Determine the target application from the background application according to the startup time;

Switch the foreground application to the target application.

In this embodiment, the background applications can be sorted from left to right or from top to bottom according to the startup time. When the electronic device slides in a certain direction (such as left or up), the startup time can be placed before the foreground application. When swiping in the opposite direction, the background application whose startup time is after the foreground application can be used as the target application.

For example, when the target instruction is used to instruct file transfer to the corresponding application window, the above step 104 may specifically include:

The file corresponding to the starting point is transferred to the application window corresponding to the ending point.

In this embodiment, data transmission between the two applications may be implemented according to different applications corresponding to the start point and the end point.

For example, when the target instruction is used to instruct the corresponding application window to be resized, the above step 104 may specifically include:

Drag the boundary line corresponding to the start point to the end point.

In this embodiment, when the user's finger is placed on the boundary line of the window, the boundary line can be dragged to move along the track, so as to realize the adjustment operation on the size and position of the application window.

It should be noted that the above-mentioned first preset direction, second preset direction, third preset direction and fourth preset direction may be the same direction or different directions. The set distance and the third preset distance may be the same distance or different distances, which may be determined according to user requirements.

It can be seen from the above that the device control method provided in this embodiment is applied to an electronic device including a screen. By acquiring the trajectory of at least two fingers sliding in the same direction on the screen and the touch duration of each trajectory point in the trajectory, and According to the touch duration, a target instruction group is determined from a plurality of candidate instruction groups, and then a target instruction is determined from the target instruction group according to the trajectory, and the electronic device is controlled accordingly according to the target instruction, so that the multi-finger sliding can be performed. The method starts various device functions without entering the relevant operation interface, the method is simple, the flexibility is high, and there is no need to use physical buttons, and the user experience is good.

In this embodiment, description will be made from the perspective of a device control apparatus, and will be described in detail by taking an example that the device control apparatus is integrated into an electronic device including a screen.

Please refer to Figure 3, a device control method, the specific process can be as follows:

201. The electronic device acquires a trajectory of at least two fingers sliding in the same direction on the screen, and a touch duration of each trajectory point in the trajectory, where the trajectory point includes a start point and an end point.

For example, when the screen of the electronic device is in the sensing state (that is, the screen is in the unlocked state), if the user wants to activate a certain function, he can slide two or more fingers on the screen in the same direction, and the electronic device can obtain the information during the sliding process. The touch duration of the corresponding track and track point.

202. The electronic device determines whether the touch duration of the starting point is not less than the preset duration, and if so, executes the following step 203, and if not, executes the following step 204.

For example, the preset time period may be 3 seconds or 4 seconds, etc. which are manually set. In the process of finger sliding, which type of instruction needs to be selected can be determined according to the sliding situation and the running application situation. The sliding situation involves the touch time of the starting point and the sliding direction, etc. Rotation, etc., see Figure 4 for details.

203. The electronic device detects whether there are multiple application windows displayed in the foreground interface, and if so, obtains the third candidate instruction group as the target instruction group, and the third candidate instruction group includes an instruction for indicating that the corresponding application window is processed, And execute the following steps 205-206, if not, when the touch duration of the end point is less than the preset duration, obtain the first candidate instruction group as the target instruction group, and the first candidate instruction group includes instructions for controlling the electronic device. The device performs parameter adjustment instructions, and executes the following steps 207-208.

For example, when the finger stops at the starting point and then slides, the first candidate command group or the third candidate command group can be selected. For example, when the current interface is a split-screen interface of an application, the third candidate command group can be selected, and the current interface interface can be selected as the third candidate command group. When it is not the split-screen interface of the application, the first candidate instruction group may be selected, and different candidate instruction groups correspond to different types of instructions.

205. When the position of the starting point in the track overlaps with the position of the boundary line in the application window, the electronic device obtains an instruction instructing to adjust the size of the corresponding application window from the third candidate instruction group as a target instruction.

206. When the position of the starting point in the track overlaps with the position of the file in the application window, and the starting point and the ending point are located in different window applications, the electronic device obtains an instruction from the third candidate instruction group to transfer the file to the corresponding application window. command as the target command.

For example, referring to Fig. 5, when the foreground interface is divided into two application windows A and B, if the user's finger stops on the boundary line of application window A at the initial stage of sliding (that is, the finger shown by the solid line in the figure), Then you can drag the boundary line to move to adjust the size of the application window A. If the user's finger stops on a file in the application window A (that is, the PDF file pointed to by the finger indicated by the dotted line in the figure), Then the cross-application transfer of the file can be realized.

207. When the track indicates sliding along the first preset direction, and the distance of the sliding is not less than the first preset distance, the electronic device obtains the instruction to increase the volume value and/or the brightness value from the first candidate instruction group. instruction, as the target instruction.

208. When the trajectory instruction slides in the opposite direction to the first preset direction, and the sliding distance is not less than the first preset distance, the electronic device obtains the instruction to reduce the volume value and the / or the command of the brightness value, as the target command.

For example, the first preset direction may be sliding down or sliding up, and the first preset distance may be determined according to the length of the display screen. Or turn up the brightness. When the user's finger pauses and slides up (or slides down) a specified distance, the volume or brightness can be turned down.

204. When the touch duration of the end point is less than the preset duration, the electronic device obtains a second candidate instruction group as a target instruction group, and the second candidate instruction group includes an instruction for instructing the electronic device to perform state switching, and executes the instruction. Step 209 is described below.

209. The electronic device determines a target instruction from the second candidate instruction group according to the trajectory.

For example, referring to FIG. 6 , the foregoing step 209 may specifically include:

The electronic device determines whether the trajectory satisfies a first preset condition, where the first preset condition is sliding along a second preset direction, and the sliding distance is not less than the second preset distance;

If not, you can return to the above step 201;

If so, when the touch duration of the end point is not less than the preset duration, obtain from the second candidate instruction group an instruction instructing to perform state switching on the cleaning mode, as the target command, and the cleaning mode includes a cleaning state and a non-cleaning state; or,

When the touch duration of the end point is less than the preset duration, obtain an instruction from the second candidate instruction group that instructs the state switching of the lock screen mode, notification mode, sound mode and/or screen rotation mode, as the target instruction, the lock screen mode The screen mode includes a locked state and an unlocked state, the notification mode includes a notification enabled state and a notification prohibited state, the sound mode includes a silent state and a ringing state, and the screen rotation mode includes a rotation prohibited state and a rotation enabled state.

For example, the second preset condition and the second preset distance can be the same as the first preset condition and the first preset distance, or they can be different. For example, when the user's finger slides down a specified distance and pauses, memory cleaning can be performed. , when the user's finger slides down a specified distance, the screen can be locked, or the notification mode can be switched between the notification allowed state and the notification prohibited state (that is, the do not disturb state), or the mute state and the ringing state in the sound mode can be switched. Switch, or switch between the prohibited rotation state and the permitted rotation state in the screen rotation mode.

For example, referring to FIG. 7 , the foregoing step 209 may specifically include:

The electronic device determines whether the track indicates sliding along the curve, and the foreground display interface does not belong to the preset application;

If not, you can return to the above step 201;

If so, obtain an instruction from the second candidate instruction group to instruct to switch the state of the screen display mode as a target instruction, and the screen display mode includes a horizontal display state and a vertical display state.

For example, the preset application may be an image browsing application. When the user's finger rotates, if the foreground display interface is any interface other than the image viewing interface, the screen can be switched from landscape to portrait, or from portrait to landscape.

For example, referring to FIG. 8 , the foregoing step 209 may specifically include:

When the touch duration of the end point is less than the preset duration, the electronic device determines whether the trajectory satisfies the second preset condition, and the second preset condition is to slide along the third preset direction, and the sliding distance is not less than the third preset condition. set distance;

If not, you can return to the above step 201;

If so, when the foreground display interface is the default interface, the first command, the second command or the third command is obtained from the second candidate command group as the target command, and the first command is used to instruct to close the foreground display interface. The second instruction is used for instructing to perform a split screen operation on the foreground display interface, and the third instruction is used for instructing to switch the foreground display interface to the notification preview interface.

For example, the third preset condition and the third preset distance may be the same as or different from the first preset condition and the first preset distance. For example, when the user's finger slides down a specified distance, if the preset interface is For the application interface, the application can be closed, or the application interface can be switched to the notification center. If the preset interface is an application interface that supports split-screen, the application can be split-screen.

For example, referring to FIG. 9 , the foregoing step 209 may specifically include:

When the touch duration of the end point is less than the preset duration, determine whether the track slides in the fourth preset direction, and the foreground display interface is the application interface;

If so, calculate the sliding speed according to the touch duration and the total length of the track;

When the sliding speed is not less than the preset speed, an instruction instructing to switch the foreground application is obtained from the second candidate instruction group as a target instruction.

For example, the fourth preset direction may be left swipe or right swipe, and when the finger swipes left or right at a certain speed, the foreground application can be switched to another application.

210. The electronic device performs corresponding control on the electronic device according to the target instruction.

For example, when the foreground application needs to be switched, it can be switched to the previous startup application, the latter startup application, or a specified application according to the startup time. When the window file needs to be transferred, the file can be transferred in the two application windows according to different application windows corresponding to the start point and the end point. When the application window needs to be resized, the boundary line can be dragged from the start point to the end point.

According to the methods described in the foregoing embodiments, this embodiment will be further described from the perspective of a device control device. The device control device may be specifically implemented as an independent entity or integrated in an electronic device, such as a terminal. The terminal may include a mobile phone, a tablet computer, and the like.

Please refer to FIG. 10 . FIG. 10 specifically describes the device control apparatus provided by the embodiment of the present application, which is applied to electronic equipment. The device control apparatus may include: an acquisition module 10 , a first determination module 20 , a second determination module 30 , and a control module 40, of which:

(1) Acquisition module 10

The acquiring module 10 is configured to acquire the trajectory of at least two fingers sliding in the same direction on the screen, and the touch duration of each trajectory point in the trajectory.

In this embodiment, when the electronic device is in a normal use state (that is, in an unlocked state), the sliding information of the finger on the screen can be detected in real time. The sliding information includes the position of the sliding point and the corresponding touch moment, and is generated according to the sliding information. Corresponding to the sliding track, the sliding track generally refers to a regular or irregular line segment formed between the starting point and the ending point, such as a straight line segment, a polyline segment, a curved line segment, and the like. The co-directional sliding refers to sliding in the same direction. Generally, the sliding trajectory formed when multiple fingers slide in the same direction is a plurality of line segments with the same shape.

(2) The first determination module 20

The first determination module 20 is configured to determine a target instruction group from a plurality of candidate instruction groups according to the touch duration.

For example, the trajectory point includes a start point and an end point, and the candidate instruction group may include a first candidate instruction group and a second candidate instruction group, see FIG. 11 , the first determination module 20 includes:

Judging sub-module 21, for judging whether the touch duration of the starting point is not less than the preset duration;

The first acquisition sub-module 22 is used for, if yes, when the touch duration of the end point is less than the preset duration, acquire a first candidate instruction group as a target instruction group, and the first candidate instruction group includes instructions for controlling the electronic device Instructions for parameter adjustment;

The second acquisition sub-module 23 is configured to acquire a second candidate instruction group as a target instruction group when the touch duration of the end point is less than the preset duration, if not, the second candidate instruction group includes instructions for controlling the electronic A command for the device to switch states.

In this embodiment, the preset time period can be set manually, for example, 3 seconds or 4 seconds, which is slightly longer than the time required to end the action normally, and is used to reflect a pause state. When the touch duration of a track point is greater than or equal to the preset duration, it means that the user's finger pauses here, and different pause methods can correspond to start different types of application functions. When the finger slides, the electronic device can real-time Detect the pause situation of each track point. For example, when the user's finger starts to pause at the starting point, a small range of command groups can be initially determined, such as a series of commands belonging to the parameter adjustment type or state switching type. The parameter Can include brightness or volume, etc.

In another embodiment, the candidate instruction group may further include a third candidate instruction group, and the first determining module further includes a third obtaining sub-module 24 for:

After the judging submodule judges whether the touch duration of the starting point is not less than the preset duration, when the touch duration of the starting point is not less than the preset duration, it is detected whether there are multiple application windows displayed in the foreground interface;

If so, acquire a third candidate instruction group as the target instruction group, and the third candidate instruction group includes an instruction for instructing the corresponding application window to be processed;

If not, when the touch duration of the end point is less than the preset duration, trigger the second acquisition sub-module to perform the operation of acquiring the first candidate instruction group as the target instruction group.

In this embodiment, the processing of the corresponding application window may include adjusting the size of the corresponding application window, transferring files to the corresponding application window, and the like. When the finger starts to slide after pausing at the starting point, if the current interface is a split-screen interface (that is, at least two application windows are displayed at the same time), it can be considered that the user wants to process the application windows. If the current interface is not a split-screen interface, you can It is assumed that the user wants to make adjustments to the device parameters.

(3) The second determination module 30

The second determination module 30 is configured to determine a target instruction from the target instruction group according to the trajectory.

In this embodiment, the second determination module 30 can determine which function of the electronic device needs to be activated by means of the two dimensions of the touch duration and the trajectory. For example, different pause situations, different sliding directions and sliding distances of the trajectory points can be corresponding to different commands.

(A) When the target instruction group is the first candidate instruction group

In one embodiment, the above-mentioned second determining module 30 may be specifically used for:

When the track indicates sliding along the first preset direction, and the sliding distance is not less than the first preset distance, acquire an instruction to increase the volume value and/or the brightness value from the first candidate instruction group as a target instruction;

When the track indicates sliding in a direction opposite to the first preset direction, and the sliding distance is not less than the first preset distance, obtain the instruction to decrease the volume value and/or the brightness value from the first candidate instruction group command as the target command.

In this embodiment, both the first preset direction and the first preset distance can be set manually, for example, the first preset direction can be up or down, and the first preset distance can be a certain fixed value, Or according to the length or width of the screen, such as two-thirds of the length or width of the screen. When the finger pauses and slides the first preset distance in the first preset direction, an instruction to increase numerical parameters such as volume or brightness can be obtained, and when the finger pauses, slide the first preset distance in the opposite direction of the first preset direction When the distance is set, you can obtain the command to reduce the numerical parameters such as volume or brightness.

(B) When the target instruction group is the second candidate instruction group

In one embodiment, the above-mentioned second determining module 30 may be specifically used for:

Judging whether the trajectory satisfies a first preset condition, the first preset condition is sliding along a second preset direction, and the sliding distance is not less than the second preset distance;

If so, when the touch duration of the end point is not less than the preset duration, obtain from the second candidate instruction group an instruction instructing to perform state switching on the cleaning mode, as the target command, and the cleaning mode includes a cleaning state and a non-cleaning state; or,

When the touch duration of the end point is less than the preset duration, obtain an instruction from the second candidate instruction group that instructs the state switching of the lock screen mode, notification mode, sound mode and/or screen rotation mode, as the target instruction, the lock screen mode The screen mode includes a locked state and an unlocked state, the notification mode includes a notification enabled state and a notification prohibited state, the sound mode includes a silent state and a ringing state, and the screen rotation mode includes a rotation prohibited state and a rotation enabled state.

In this embodiment, the second preset direction and the second preset distance can be set manually. When the finger slides along the second preset direction for the second preset distance and pauses, the second determination module 30 may start the memory clearing operation, or stop the memory clearing operation being performed. When the finger only slides the second preset distance along the second preset direction, the second determination module 30 can switch the state of other modes, such as one of the lock screen mode, notification mode, sound mode, screen rotation mode, etc. It is necessary to first determine which state the electronic device is currently in and switch it to another state during the switching process.

In another embodiment, the above-mentioned second determining module 30 may be specifically used for:

Determine whether the track indicates sliding along the curve, and the foreground display interface does not belong to the preset application;

If so, obtain an instruction from the second candidate instruction group to instruct to switch the state of the screen display mode as a target instruction, and the screen display mode includes a horizontal display state and a vertical display state.

In this embodiment, the preset application may be an application related to image viewing. When the track includes multiple sliding directions, and the changing rules of these sliding directions are constant, it can be considered as sliding along a curve. In the case of rotation, a curved sliding trajectory will be formed. Specifically, in the image viewing interface, the user's finger rotation can activate the image rotation function, and in the non-image viewing interface, the user's finger rotation can activate the screen rotation function.

In another embodiment, when the touch duration of the end point is still less than the preset duration, the above-mentioned second determination module 30 can be specifically used to:

Judging whether the trajectory satisfies a second preset condition, the second preset condition is sliding along a third preset direction, and the sliding distance is not less than the third preset distance;

If so, when the foreground display interface is the default interface, the first command, the second command or the third command is obtained from the second candidate command group as the target command, and the first command is used to instruct to close the foreground display interface. The second instruction is used for instructing to perform a split screen operation on the foreground display interface, and the third instruction is used for instructing to switch the foreground display interface to the notification preview interface.

In this embodiment, the third preset direction and the third preset distance can be set manually. The preset interface may be any application interface that does not include the main screen interface, or an interface of a split-screen application. The notification preview interface is mainly used to display various reminder notifications such as missed calls and unseen messages. The split screen operation mainly refers to dividing the screen into at least two display windows, and the different display windows operate independently of each other.

When the finger slides the third preset distance along the third preset direction, if the foreground display interface is any application interface that does not include the main screen interface, the foreground application can be closed (equivalent to switching to the closed state) or the notification preview can be displayed interface, in which the switching method of switching the foreground display interface to the notification preview interface can be slide down (slide down) or left slide (right slide). It is equivalent to switching to the split-screen state), and during the split-screen process, the user can select other single or multiple applications that need to be displayed on the screen at the same time, or can be selected by the system by default.

In another embodiment, when the touch duration of the end point is still less than the preset duration, the above-mentioned second determination module 30 can be specifically used to:

Determine whether the track slides along the fourth preset direction, and the foreground display interface is an application interface;

If so, calculate the sliding speed according to the touch duration and the total length of the track;

When the sliding speed is not less than the preset speed, an instruction instructing to switch the foreground application is obtained from the second candidate instruction group as a target instruction.

In this embodiment, the determination module 30 may accumulate the touch duration of each track point to obtain the total duration, and then calculate the ratio between the total track length and the total duration to obtain the sliding speed. The preset speed mainly refers to the speed of sweeping on the screen, the fourth preset direction and the preset speed can be set manually, and the fourth preset direction can be left, right, or up and down. Switching the foreground application may include switching the foreground application and the background application, or switching the foreground application and a designated application.

(C) When the target instruction group is the third candidate instruction group

In one embodiment, the above-mentioned second determining module 30 may be specifically used for:

When the position of the starting point in the track overlaps with the position of the boundary line in the application window, obtain an instruction instructing to adjust the size of the corresponding application window from the third candidate instruction group as the target instruction; or,

When the position of the starting point in the track overlaps with the position of the file in the application window, and the starting point and the ending point are located in different window applications, the instruction instructing the file transfer to the corresponding application window is obtained from the third candidate instruction group, as target instruction.

In this embodiment, for a foreground interface that displays multiple application windows at the same time, when the finger pauses at the starting point and then slides, if the paused place is where the boundary line of the application window is located, the second determining module 30 can activate the window adjustment function , if the pause point is the position of a certain file in the application window, and the sliding start and end points are located in different application windows, the second determining module 30 can start the file transfer function.

(4) Control module 40

The control module 40 is used for correspondingly controlling the electronic device according to the target instruction.

For example, when the target instruction is used to instruct to switch the foreground application, the above-mentioned control module 40 can be specifically used for:

Determine the background application running in the electronic device and the start time of the background application;

Determine the target application from the background application according to the startup time;

Switch the foreground application to the target application.

In this embodiment, the control module 40 can sort the background applications from left to right or from top to bottom according to the start time. When the electronic device slides in a certain direction (such as left or up), the start time can be The background application before the foreground application is used as the target application. When sliding in the opposite direction, the background application whose startup time is after the foreground application can be used as the target application.

For example, when the target instruction is used to instruct file transfer to the corresponding application window, the above-mentioned control module 40 can be specifically used for:

The file corresponding to the starting point is transferred to the application window corresponding to the ending point.

In this embodiment, the control module 40 may implement data transmission between the two applications according to different applications corresponding to the start point and the end point.

For example, when the target instruction is used to instruct to adjust the size of the corresponding application window, the above-mentioned control module 40 can be specifically used for:

Drag the boundary line corresponding to the start point to the end point.

In this embodiment, when the user's finger is placed on the boundary line of the window, the control module 40 can drag the boundary line to move along the track, so as to adjust the size and position of the application window.

It should be noted that the above-mentioned first preset direction, second preset direction, third preset direction and fourth preset direction may be the same direction or different directions. The set distance and the third preset distance may be the same distance or different distances, which may be determined according to user requirements.

During specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units can refer to the previous method embodiments, which will not be repeated here.

It can be seen from the above that the device control device provided in this embodiment is applied to electronic devices, and the acquisition module 10 acquires the trajectory of at least two fingers sliding in the same direction on the screen, and the touch duration of each trajectory point in the trajectory. A determination module 20 determines a target instruction group from a plurality of candidate instruction groups according to the touch duration, then the second determination module 30 determines a target instruction from the target instruction group according to the trajectory, and the control module 40 determines the target instruction for the electronic device according to the target instruction Corresponding control is performed, so that various device functions can be activated by means of multi-finger sliding, without entering the relevant operation interface, the method is simple, the flexibility is high, and there is no need to use physical buttons, and the user experience is good.

In addition, an embodiment of the present application further provides an electronic device, where the electronic device may be a device such as a smart phone, a tablet computer, or the like. As shown in FIG. 12 , electronic device 100 may include control circuitry, which may include storage and processing circuitry 110 . The storage and processing circuit 110 may be memory, such as hard disk drive memory, non-volatile memory (such as flash memory or other electronically programmable read only memory used to form solid state drives, etc.), volatile memory (such as static or dynamic random access memory, etc.) access memory, etc.), etc., which are not limited in the embodiments of the present application. Processing circuitry in storage and processing circuitry 110 may be used to control the operation of electronic device 100 . The processing circuit may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, and the like.

Storage and processing circuitry 110 may be used to run software in electronic device 100, such as Internet browsing applications, Voice over Internet Protocol (VOIP) phone calling applications, email applications, media playback applications, operating system functions Wait. These software can be used to perform some control operations, for example, camera-based image acquisition, ambient light measurement based on ambient light sensor, proximity sensor measurement based on proximity sensor, information based on status indicator implementation such as status indicators of light emitting diodes Display functions, touch sensor-based detection of touch events, functions associated with displaying information on multiple (eg, layered) displays, operations associated with performing wireless communication functions, operations associated with collecting and generating audio signals , control operations associated with collecting and processing button press event data, and other functions in the electronic device 100, etc., are not limited in this embodiment of the present application.

Electronic device 100 may also include input-output circuitry 120 . The input-output circuit 120 may be used to enable the electronic device 100 to input and output data, ie, allowing the electronic device 100 to receive data from an external device and also allow the electronic device 100 to output data from the electronic device 100 to an external device. The input-output circuit 120 may further include a sensor 121 . Sensors 121 may include ambient light sensors, light and capacitance-based proximity sensors, touch sensors (eg, light-based touch sensors and/or capacitive touch sensors, where the touch sensor may be part of a touch-sensitive display, or may be used as a The touch sensor structure is used independently), acceleration sensor, and other sensors.

Input-output circuitry 120 may also include one or more displays 122 . The display 122 may include one or a combination of a liquid crystal display, an organic light emitting diode display, an electronic ink display, a plasma display, and displays using other display technologies. Display 122 may include an array of touch sensors (ie, display 122 may be a touch display). The touch sensor can be a capacitive touch sensor formed from an array of transparent touch sensor electrodes, such as indium tin oxide (ITO) electrodes, or can be a touch sensor formed using other touch technologies, such as sonic touch, pressure sensitive touch, resistive touch Touch, optical touch, etc., are not limited in the embodiments of the present application.

The electronic device 100 may also include an audio component 123 . Audio component 123 may be used to provide audio input and output functionality for electronic device 100 . Audio components 123 in electronic device 100 may include speakers, microphones, buzzers, tone generators, and other components for generating and detecting sounds.

Communication circuitry 124 may be used to provide electronic device 100 with the ability to communicate with external devices. Communication circuitry 124 may include analog and digital input-output interface circuitry, and wireless communication circuitry based on radio frequency signals and/or optical signals. Wireless communication circuitry in communication circuitry 124 may include radio frequency transceiver circuitry, power amplifier circuitry, low noise amplifiers, switches, filters, and antennas. For example, wireless communication circuitry in communication circuitry 124 may include circuitry for supporting Near Field Communication (NFC) by transmitting and receiving near-field coupled electromagnetic signals. For example, the communication circuit 124 may include a near field communication antenna and a near field communication transceiver. Communication circuitry 124 may also include cellular telephone transceivers and antennas, wireless local area network transceiver circuits and antennas, and the like.

The electronic device 100 may further include a battery, power management circuitry, and other input-output units 125 . Input-output unit 125 may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, and the like.

A user may input commands through the input-output circuit 120 to control the operation of the electronic device 100 , and may use the output data of the input-output circuit 120 to enable receiving status information and other outputs from the electronic device 100 .

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or completed by instructions that control relevant hardware, and the instructions can be stored in a computer-readable storage medium, and loaded and executed by the processor. To this end, the embodiments of the present invention provide a storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute steps in any device control method provided by the embodiments of the present invention.

Wherein, the storage medium may include: a read only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and the like.

Because the instructions stored in the storage medium can execute the steps in any device control method provided by the embodiment of the present invention, it is possible to implement any device control method provided by the embodiment of the present invention. For the beneficial effects, refer to the foregoing embodiments for details, which will not be repeated here.

For the specific implementation of the above operations, reference may be made to the foregoing embodiments, and details are not described herein again.

To sum up, although the present application has been disclosed above with preferred embodiments, the above preferred embodiments are not intended to limit the present application. Those of ordinary skill in the art can make various Therefore, the scope of protection of the present application is subject to the scope defined by the claims.

Claims (11)

1. A device control method, applied to an electronic device, wherein the electronic device comprises a screen, and the device control method comprises: Acquiring the trajectory of at least two fingers sliding in the same direction on the screen, and the touch duration of the starting point and the touch duration of the end point in the trajectory; Determine whether the touch duration of the starting point is not less than a preset duration; If so, when it is detected that multiple application windows are displayed in the foreground interface, a third candidate instruction group is obtained as the target instruction group, and the third candidate instruction group includes an instruction for instructing the corresponding application window to be processed; If so, when it is detected that there are no multiple application windows displayed in the foreground interface and the touch duration of the end point is less than the preset duration, acquire a first candidate instruction group as the target instruction group, and the first candidate instruction The group includes instructions for instructing to control the electronic device to adjust parameters; If not, when the touch duration of the end point is less than the preset duration, acquire a second candidate instruction group as the target instruction group, where the second candidate instruction group includes instructions for controlling the electronic device to perform Instructions for state switching; Determine a target instruction from the target instruction group according to the trajectory; The electronic device is controlled accordingly according to the target instruction. 2. The device control method according to claim 1, wherein when the target instruction group is the first candidate instruction group, the target instruction is determined from the target instruction group according to the trajectory, include: When the track indicates sliding along the first preset direction, and the sliding distance is not less than the first preset distance, acquire an instruction for increasing the volume value and/or the brightness value from the first candidate instruction group as the target instruction; When the track indicates sliding in a direction opposite to the first preset direction, and the sliding distance is not less than the first preset distance, acquiring an instruction to decrease the volume from the first candidate instruction group A command of value and/or luminance value is used as the target command. 3. The device control method according to claim 1, wherein, when the target instruction group is the second candidate instruction group, the target instruction is determined from the target instruction group according to the trajectory, include: Judging whether the trajectory satisfies a first preset condition, the first preset condition is sliding along a second preset direction, and the sliding distance is not less than the second preset distance; If so, when the touch duration of the end point is less than the preset duration, obtain an instruction from the second candidate instruction group indicating state switching of the lock screen mode, notification mode, sound mode and/or screen rotation mode As the target instruction, the lock screen mode includes a locked state and an unlocked state, the notification mode includes a notification allowed state and a notification prohibited state, the sound mode includes a ringing state and a mute state, and the screen rotation mode includes an allowed state Rotation state and rotation prohibited state. 4. The device control method according to claim 1, wherein when the target instruction group is the second candidate instruction group, the target instruction is determined from the target instruction group according to the trajectory, include: Determine whether the track indicates sliding along the curve, and the foreground display interface does not belong to the preset application; If so, acquire an instruction instructing to switch the state of the screen display mode from the second candidate instruction group as the target instruction, and the screen display mode includes horizontal display and vertical display. 5 . The device control method according to claim 1 , wherein when the target instruction group is the second candidate instruction group and the touch duration of the end point is less than the preset duration, the The trajectory determines target commands from the target command group, including: Judging whether the trajectory satisfies a second preset condition, the second preset condition is sliding along a third preset direction, and the sliding distance is not less than the third preset distance; If so, when the foreground display interface is the default interface, the first command, the second command or the third command is obtained from the second candidate command group as the target command, and the first command is used to instruct to close all the foreground display interface, the second instruction is used for instructing to perform a split screen operation on the foreground display interface, and the third instruction is used for instructing to switch the foreground display interface to the notification preview interface. 6 . The device control method according to claim 1 , wherein when the target instruction group is the second candidate instruction group and the touch duration of the end point is less than the preset duration, the The trajectory determines target commands from the target command group, including: Judging whether the track indicates sliding in a fourth preset direction, and the foreground display interface is an application interface; If so, calculate the sliding speed according to the touch duration and the total length of the track; When the sliding speed is not less than the preset speed, an instruction instructing to switch the foreground application is acquired from the second candidate instruction group as the target instruction. 7. The device control method according to claim 1, wherein when the target instruction group is the third candidate instruction group, the target instruction is determined from the target instruction group according to the trajectory, include: When the position of the starting point in the trajectory overlaps with the position of the upper boundary line of the application window, acquiring an instruction instructing to adjust the size of the corresponding application window from the third candidate instruction group as the target instruction; The corresponding control of the electronic device according to the target instruction includes: dragging the boundary line at the starting point to the ending point. 8. The device control method according to claim 1, wherein when the target instruction group is the third candidate instruction group, the target instruction is determined from the target instruction group according to the trajectory, include: When the position of the starting point in the track overlaps with the position of the file in the application window, and the starting point and the ending point are located in different application windows, an instruction is obtained from the third candidate instruction group to execute the corresponding application window. The instruction of file transfer is used as the target instruction; The corresponding control of the electronic device according to the target instruction includes: transferring the file in the application window corresponding to the start point to the application window corresponding to the end point. 9. A device control device, applied to an electronic device, wherein the electronic device comprises a screen, and the device control device comprises: an acquisition module, configured to acquire the trajectory of at least two fingers sliding in the same direction on the screen, and the touch duration of the starting point and the touch duration of the end point in the trajectory; a judgment module for judging whether the touch duration of the starting point is not less than a preset duration; The first obtaining module is used to obtain a third candidate instruction group as a target instruction group when it is detected that there are multiple application windows displayed in the foreground interface, wherein the third candidate instruction group includes instructions for instructing the corresponding application Instructions for processing the window; The second acquiring module is configured to acquire the first candidate instruction group as the target instruction group when it is detected that there are no multiple application windows displayed in the foreground interface and the touch duration of the end point is less than the preset duration , the first candidate instruction group includes an instruction for instructing the electronic device to perform parameter adjustment; a third acquiring module, configured to acquire a second candidate instruction group as the target instruction group when the touch duration of the end point is less than the preset duration, if not, the second candidate instruction group includes an instruction group for an instruction instructing to control the electronic device to perform state switching; a determining module for determining a target instruction from the target instruction group according to the trajectory; The control module is used for correspondingly controlling the electronic device according to the target instruction. 10. A computer-readable storage medium, wherein the storage medium stores a plurality of instructions, the instructions are adapted to be loaded by a processor to execute the device control method according to any one of claims 1 to 8 . 11. An electronic device, characterized in that it comprises a processor and a memory, the processor is electrically connected to the memory, the memory is used to store instructions and data, and the processor is used to execute claims 1 to 8 any one of the steps in the device control method.

Images