CN111324248A - Terminal control method, terminal control device, terminal, computer equipment and storage medium - Google Patents

Abstract

The present application relates to a terminal control method, device, terminal, computer equipment and storage medium. The method includes: acquiring interactive interfaces of at least two controlled terminals, performing split-screen display processing on each interactive interface, and responding to the split-screen display processing by a user. After the touch operation of the interface, the touch operation data is obtained, the corresponding controlled terminal is determined according to the touch operation data, and the touch operation data is sent to the corresponding controlled terminal to obtain the touch control of the corresponding controlled terminal. The response interface displays the touch response interface in the corresponding split screen area. The present application also provides a terminal control method, device, terminal, computer equipment and storage medium. The method establishes a connection with multiple controlled terminals through a control center, thereby realizing split-screen control of multiple controlled terminals. In the above solution, the user does not need to carry the controlled terminal, and the user only needs to operate on the interactive interface of the control terminal, so as to realize remote split-screen control of multiple controlled terminals, thereby improving the convenience.

Description

Terminal control method, device, terminal, computer equipment and storage medium

technical field

The present application relates to the field of communication technologies, and in particular, to a terminal control method, apparatus, terminal, computer equipment and storage medium.

Background technique

With the rapid development of computer technology, the portability of mobile terminals in communication systems has become an inevitable trend. Mobile terminals such as mobile phones and notebook computers need to reduce the weight and volume of each functional module as much as possible while realizing complex and diverse functions, so as to meet people's demand for portability of mobile terminals.

At present, in order to improve the portability of mobile terminals, some mobile terminals use highly integrated processor chips to replace complex circuit structures, and there are methods to reduce the thickness of mobile terminals such as smart phones and pursue ultra-thin bodies.

The above method has limited improvement effect on the complexity of the terminal. At present, people still need to carry the main body when they are actually operating on the human-machine interface in pursuit of the use effect of human-computer interaction. The problem of low convenience brought about by inconvenience.

SUMMARY OF THE INVENTION

Based on this, it is necessary to provide a terminal control method, device, terminal, computer device and storage medium that can improve convenience in view of the above technical problems.

A terminal control method, comprising:

Obtain the interactive interfaces of at least two controlled terminals, and perform split-screen display processing on each interactive interface;

Obtaining touch operation data in response to a user's touch operation on the interface processed by the split-screen display;

Determine the corresponding controlled terminal according to the touch operation data, and send the touch operation data to the corresponding controlled terminal;

The touch response interface of the corresponding controlled terminal is acquired, the touch response interface is displayed in the corresponding split screen area, and the touch response interface is obtained based on the controlled terminal performing the touch response according to the touch operation data.

In one embodiment, performing split-screen display processing on each interactive interface includes:

Obtain the number of connected controlled terminals and the identity information of each controlled terminal;

Determine the number of split-screen areas according to the number of connected controlled terminals;

Divide the screen into split-screen areas corresponding to the number of split-screen areas;

According to the identification information of each controlled terminal, each interactive interface is displayed in each split screen area.

In one of the embodiments, before acquiring the interactive interfaces of the at least two controlled terminals, the method further includes:

Send a connection request to at least two controlled terminals, and the connection request carries identity authentication information;

Receive a connection permission message fed back by each controlled terminal according to the identity authentication information, and establish a connection with each controlled terminal.

In one embodiment, the touch operation data includes touch coordinates;

According to the touch operation data, determining the corresponding controlled terminal includes:

Determine the split-screen area touched by the user according to the touch coordinates;

Determine the corresponding controlled terminal according to the split screen area.

In one of the embodiments, acquiring the interactive interfaces of at least two controlled terminals includes:

Obtain the program running window data of at least two controlled terminals;

Process the running window data of each program to obtain multiple interactive interface configuration data;

Configure the corresponding interactive interface according to the configuration data of each interactive interface.

In one embodiment, acquiring the touch response interface of the corresponding controlled terminal includes:

Obtain the target program running window data displayed after the corresponding controlled terminal responds to the touch operation data;

Process the target program running window data to obtain touch response interface configuration data;

Configure the touch response interface according to the touch response interface configuration data.

In one of the embodiments, the displayed interactive interface and the displayed touch response interface match the size of the corresponding split screen area.

A terminal control device, the device includes:

a first split-screen display module, used for acquiring the interactive interfaces of at least two controlled terminals, and performing split-screen display processing on each interactive interface;

a touch operation data receiving module, used for obtaining touch operation data in response to a user's touch operation on the interface processed by the split-screen display;

a control module, configured to determine the corresponding controlled terminal according to the touch operation data, and send the touch operation data to the corresponding controlled terminal;

The second split-screen display module is used to acquire the touch response interface of the corresponding controlled terminal, display the touch response interface in the corresponding split screen area, and the touch response interface performs touch response based on the controlled terminal according to the touch operation data obtained later.

A terminal, comprising: a communication module, a touch display module and a processor;

The communication module establishes a connection with at least two controlled terminals, and the processor obtains the interactive interface of each controlled terminal, performs display split-screen processing on each interactive interface, obtains the split-screen display interface configuration data, and sends the split-screen display interface configuration data To the touch display module, the touch display module receives the configuration data of the split-screen display interface, displays the interactive interface in the corresponding split-screen area, receives the user's touch operation on the interactive interface after the split-screen display, obtains the touch operation data, and obtains the touch operation data. Send the touch operation data to the processor, and the processor determines the corresponding controlled terminal according to the touch operation data, sends the touch operation data to the corresponding controlled terminal, and obtains the operation of the touch control program of the corresponding controlled terminal Window data: Process the touch program running window data to obtain touch response interface configuration data, and send the touch response interface configuration data to the touch display module. The touch display module displays the touch response interface configuration data according to the touch response interface configuration data. The response interface is in the corresponding split screen area, wherein the touch response interface is obtained after the controlled terminal performs a touch response according to the touch operation data.

The above terminal control method, device, terminal, computer equipment and storage medium, by establishing a connection between the control terminal and a plurality of controlled terminals, the control terminal obtains the interactive interface of each controlled terminal, and splits each interactive interface. Display processing makes it possible to comprehensively display the screen data of multiple controlled terminals on one control terminal, and then send the touch operation data to the corresponding touch operation data by responding to the user's touch operation data on the interactive interface after split-screen display. The controlled terminal is to obtain the touch response interface after the controlled terminal performs a touch response according to the touch operation, so that the user can operate on the interactive interface of the control terminal to remotely realize split-screen control of multiple controlled terminals. . In the above solution, there is no need to carry the controlled terminal, and the interaction between the controlling terminal and multiple controlled terminals replaces the direct operation of the controlling terminal, which also reduces the storage space of the controlling terminal and improves the convenience.

A terminal control method, comprising:

Obtain the interactive interfaces of at least two controlled terminals through the control center, perform split-screen display processing on each interactive interface, and the control center has the access and operation authority of each controlled terminal;

In response to the user's touch operation on the interface after the split-screen display, the touch operation data is obtained, and the touch operation data carries the identity information of each controlled terminal;

Send the touch operation data to the control center, and the control center is used to control the corresponding controlled terminal to respond to the touch according to the touch operation data;

Obtain the touch response interface of the corresponding controlled terminal through the control center, display the touch response interface in the corresponding split screen area, and obtain the touch response interface based on the touch response of the controlled terminal according to the touch operation data.

In one embodiment, performing split-screen display processing on each interactive interface includes:

Obtain the number of connected controlled terminals and the identity information of each controlled terminal through the control center;

Determine the number of split-screen areas according to the number of connected controlled terminals;

Divide the screen into split-screen areas corresponding to the number of split-screen areas;

Each interactive interface is displayed in the corresponding split screen area according to the identity information of each controlled terminal.

In one embodiment, before acquiring the interactive interfaces of at least two controlled terminals through the control center, the method further includes:

Send a connection request to the control center, and the connection request carries the identity authentication information;

The connection permission message forwarded by the control center is received, and the connection permission message is sent by the controlled terminal after completing the identity authentication or pairing authentication according to the identity authentication information.

In one of the embodiments, acquiring the interactive interfaces of at least two controlled terminals through the control center includes:

Obtain the program running window data of at least two controlled terminals through the control center;

Process the running window data of each program to obtain multiple interactive interface configuration data;

Configure the interactive interface of the controlled terminal according to the configuration data of each interactive interface.

In one embodiment, acquiring the touch response interface of each controlled terminal through the control center includes:

Obtain the touch program running window data displayed after the corresponding controlled terminal responds to the touch operation data through the control center;

Process the touch program running window data to obtain touch response interface configuration data;

Configure the touch response interface according to the touch response interface configuration data.

In one of the embodiments, the displayed interactive interface and the displayed touch response interface match the size of the corresponding split screen area.

A terminal control device, the device includes:

The first processing module is used to obtain the interactive interfaces of at least two controlled terminals through the control center, and perform split-screen display processing on each interactive interface, and the control center has the access operation authority of each controlled terminal;

The touch operation response module is used to respond to the user's touch operation on the interface after the split-screen display, and obtain touch operation data, and the touch operation data carries the identity information of each controlled terminal;

The data control module is used to send the touch operation data to the control center, and the control center is used to control the corresponding controlled terminal to respond to the touch according to the touch operation data;

The second processing module is configured to obtain the touch response interface of the corresponding controlled terminal through the control center, display the touch response interface in the corresponding split screen area, and the touch response interface performs touch based on the controlled terminal according to the touch operation data. get after the response.

A computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the steps in the above terminal control method when the computer program is executed.

A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps in the above terminal control method.

The above-mentioned terminal control method, device, computer equipment and storage medium establish a connection between the control terminal and a plurality of controlled terminals through the control center, obtain the interactive interface of each controlled terminal through the control center, and display each interactive interface on a split screen processing, so that the screen data of multiple controlled terminals can be comprehensively displayed on one control terminal, and then the touch operation data is sent to the control center by responding to the user's touch operation data on the interactive interface after the split-screen display. The corresponding controlled terminal is controlled by the control center, and the touch response interface of the controlled terminal is obtained through the control center, so that there is no need to establish a direct connection with the controlled terminal, so that the user can remotely realize the control of multiple controlled terminals through the control terminal. Split screen control. The above solution does not need to carry the controlled terminal, nor does it need to establish a connection with the controlled terminal, replaces the direct operation of the control terminal with the interaction between the control terminal and the control center, and avoids the execution of complex data processing in the control terminal. The storage space of the control terminal is reduced and the convenience is improved.

Description of drawings

1 is an application environment diagram of a terminal control method in one embodiment;

2 is a schematic flowchart of a terminal control method in one embodiment;

3 is a schematic diagram of a control terminal performing split-screen display in one embodiment;

4 is a detailed schematic flowchart of a terminal control method in another embodiment;

FIG. 5 is a schematic flowchart of split-screen display processing steps in one embodiment;

6 is an application environment diagram of a terminal control method in another embodiment;

7 is a schematic flowchart of a terminal control method in another embodiment;

8 is a software architecture diagram of a terminal control method in one embodiment;

9 is a detailed schematic flowchart of a terminal control method in another embodiment;

10 is a structural block diagram of a terminal in one embodiment;

11 is a detailed structural block diagram of a terminal in another embodiment;

12 is a structural block diagram of a terminal control apparatus in one embodiment;

13 is a structural block diagram of a terminal control apparatus in another embodiment;

14 is a structural block diagram of a terminal control apparatus in another embodiment;

15 is a structural block diagram of a terminal control apparatus in another embodiment;

Figure 16 is a diagram of the internal structure of a computer device in one embodiment.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

The terminal control method provided by the present application can be applied to the application environment shown in FIG. 1 . In this application environment, a control terminal 202 and a controlled terminal 204 are included. The control terminal 202 has touch and display functions. The touch function is that the user controls the operation interface by touching or writing with a writing pen on the touch screen. The display function includes displaying the operation interface and the touch response interface. The touch response interface is to display the corresponding touch response after the touch operation. interface. The controlled terminal 204 is a terminal controlled by the control terminal 202, the number of controlled terminals 204 is multiple, the controlled terminal 204 communicates wirelessly with the control terminal 202, and the controlled terminal 204 transmits the operation interface to the control terminal through a wireless link The terminal 202 makes a touch response to the touch operation of the control terminal 202, and transmits the touch response interface to the control terminal 202 through a wireless link. Wherein, the control terminal 202 and the controlled terminal 204 may be, but are not limited to, various personal computers, notebook computers, smart phones, tablet computers and portable wearable devices.

In one embodiment, as shown in FIG. 2, a terminal control method is provided, and the method is applied to the control terminal 202 in FIG. 1 as an example for description, including the following steps:

Step S200, acquiring the interactive interfaces of at least two controlled terminals, and performing split-screen display processing on each interactive interface.

In practical applications, both the control terminal 202 and the controlled terminal 204 are preset with a remote control system or a remote operation application program, and the controlled terminal can be controlled through the operating system/application program. The control terminal 202 and the controlled terminal 204 may establish a connection through wireless communication such as 3G, 4G, 2.4G, 5G, Wi-Fi (Wireless Fidelity, wireless fidelity) communication or Bluetooth communication.

Wherein, the interactive interface is the operation interface displayed on the controlled terminal 204, or the controlled terminal 204, after authorizing the control terminal 202 to operate remotely, enters a “safe mode” similar to a computer by running the corresponding remote operation process A background interface, further, the background interface is not displayed on the current interface of the controlled terminal 204, so that when the controlled terminal 204 is remotely controlled by the controlled terminal 202, the user of the controlled terminal 204 may not be affected. operate autonomously. In specific implementation, the operation interface image of the controlled terminal 204 may be intercepted, and the operation interface image may be used as the interactive interface, or the screen UI (User Interface, user interface) data, screen size, resolution and other data of the controlled terminal 204 may be intercepted, An interactive interface is obtained based on these data. For example, for the controlled terminal 204, a screenshot operation may be performed on the entire operation interface thereof, and the screenshot result may be used as the interactive interface. It can also read the operation interface parameters of the controlled terminal 204 to obtain a resolution of 2048×1536 pixels. When the upper left corner of the operation interface is the coordinate origin, the software icon (for example, the WeChat icon) is located at the coordinates (1600, 600) pixels. Resolution, icon type and icon position, you can get the interactive interface.

Split-screen display processing refers to the use of split-screen technology to divide the screen of the control terminal into multiple split-screen areas, and then display the acquired interactive interface of the controlled terminal in the corresponding split-screen area, so as to realize the control terminal screen through the control terminal. A comprehensive view of the screen of the controlled terminal. In specific implementation, the split-screen display processing may be to obtain a screenshot of the operation interface of each controlled terminal and use it as the interactive interface (referred to as the first interactive interface), and then obtain the screen UI data and screen size of the interactive interface captured by the controlled terminal. , resolution and other data, and then based on the above data and its own screen resolution, the interactive interface is proportionally scaled or rendered to obtain a second interactive interface, and then the second interactive interface is displayed in the corresponding split screen area. Specifically, for a schematic diagram of split-screen display, please refer to FIG. 3 . More specifically, when the interface of the control terminal 202 is not proportional to the resolution of the first interactive interface, the first interactive interface may be scaled in equal proportions, and then operations such as interception or filling may be performed according to the scaling result to obtain the second interactive interface. interactive interface, and then display the second interactive interface; if the resolution is proportional, the first interactive interface can be directly scaled to an interface that matches the size of the split-screen area to obtain the second interactive interface; if the resolution is just right If they match, the first interactive interface can be directly used as the second interactive interface, and then the second interactive interface is displayed in the corresponding split screen area. For example, if the resolution of the first interactive interface is 2048×1536 pixels, if the interface resolution of the control terminal 202 is 1024×768 pixels, the first interactive interface can be proportionally reduced to 50% of the original to obtain the second interactive interface; The interface resolution of the terminal 202 is 1024×800 pixels. The first interactive interface can be scaled down to 50% of the original, and displayed in the center of the interface of the control terminal 202, and then the blank part is filled with black to obtain the second interactive interface. Further, in order to facilitate the user to visually check which controlled terminal the second interactive interface displayed on which split-screen area corresponds to, the identity of the controlled terminal may be displayed on the split-screen area, for example, "You are talking to XXX( identification information) terminal for remote operation” and other words. In another embodiment, in addition to the split-screen display, the display of the interactive interface may also be a sliding switching method, whereby each interactive interface is switched through a sliding operation.

Step S400, in response to a user's touch operation on the interface after the split-screen display processing, to obtain touch operation data.

The touch operation is an operation in which the user controls the operation interface by touching or writing with a writing pen on the second interactive interface after the split-screen display. During specific implementation, the user can click the software icon on the second interactive interface with a finger or a writing pen to open the software, click various controls in the software after the software is opened, or perform touch operations by writing in the operation interface after the software is opened, Touch operations can include operations such as tap, long press, swipe, zoom, and multi-touch. For example, there is a WeChat icon at the position where the coordinates of the second interactive interface are (1600, 600) pixels. The user can click the WeChat icon, click various controls in the opened WeChat, or enter text in the WeChat dialog box. After performing the above-mentioned touch operation, the control terminal 202 receives the above-mentioned touch operation, and records the coordinates of the user's touch point, the touch duration, and the touch pressure information, etc., to obtain touch operation data.

In addition, during the touch operation, the user may touch multiple split-screen areas in one touch operation, such as a large sliding operation, whose action position will involve multiple split-screens, which can be divided into the following two methods Processing: The first one is that the control terminal 202 can be pre-set that a touch operation can only control one split screen at the same time, then when there is a multi-screen operation, the split screen that the touch action acts on the earliest can be selected, and the split screen can be selected. As the operated split screen, and other split screens are not processed; the second control terminal 202 is not limited, and all the involved split screens can be used as the objects of the touch operation, according to the touch time sequence to be processed.

Step S600: Determine the corresponding controlled terminal according to the touch operation data, and send the touch operation data to the corresponding controlled terminal.

In a specific implementation, after obtaining the touch operation data, the control terminal 202 can detect the specific split screen area acted by the user according to the touch coordinates in the touch operation data, and determine the controlled terminal controlled by the user according to the split screen area 204. Then, the touch operation data can be processed according to the ratio of the first interactive interface to the second interactive interface, and the processed touch operation data can be sent to the corresponding controlled terminal 204, so that the controlled terminal 204 can touch the touch operation data according to the processed touch operation data. Control data for touch response, and the touch response includes information such as screen UI data and sound after the response. For example, if the smart hand board is the control terminal, and the tablet computer is the controlled terminal. The resolution of the first interactive interface of the tablet computer is 2048×1536 pixels, and the resolution of the second interactive interface of the smart tablet 302 is 1024×768 pixels. When the user needs to open WeChat, click on the coordinates of (500, 200) on the second interactive interface WeChat icon, according to the ratio of the first interactive interface to the second interactive interface, transform the touch operation data into a click operation at the coordinates (1000, 400) of the first interactive interface, and then send the touch operation data to the Tablet computer, the tablet computer performs touch response at the first interactive interface (1000, 400).

Step S800: Obtain a touch response interface of the corresponding controlled terminal, display the touch response interface in the corresponding split screen area, and obtain the touch response interface based on the controlled terminal performing touch response according to touch operation data.

The touch response interface may be an interface displayed after the controlled terminal 204 performs a touch response according to the received touch operation data. In specific implementation, the acquisition method of the touch response interface may be to intercept the touch response interface image of the controlled terminal 204 and use the touch response interface image as the first touch response interface, or read the touch response interface of the controlled terminal 204 Information such as resolution, color, and text of the response interface is obtained, and a first touch response interface is obtained according to the information. For example, for the controlled terminal 204, a screenshot operation may be performed on the entire touch response interface, and the screenshot result may be used as the first touch response interface. Or, read the touch response interface information of the controlled terminal 204, including the resolution of 2048×1536 pixels, the text content and position displayed by the touch response, the color and position of the image displayed by the touch response, etc. A first touch response interface is obtained by responding to the interface information. After the first touch response interface is obtained, the first touch response interface may be proportionally scaled according to the resolution of the interface of the control terminal 202 to obtain the second touch response interface. For example, when the resolution of the interface of the control terminal 202 is not proportional to the resolution of the first touch response interface, the first touch response interface may be scaled in equal proportions, and then operations such as interception or filling may be performed according to the scaling result to obtain the first touch response interface. Second touch response interface, and then display the second touch response interface; if the resolution is proportional, the first touch response interface can be directly scaled to an interface that matches the size of the split screen area to obtain the second touch response interface. touch response interface, and then display the second touch response interface in the corresponding split screen area. If the resolutions are exactly matched, the first touch response interface can be directly used as the second touch response interface, and then display the second touch response interface in the corresponding split screen area. The area displays the second touch response interface. Further, the user can adjust the size of each split screen area. If the user wants to continue the operation on the controlled terminal 204, he can perform a touch operation on the touch response interface again, and then the control terminal 202 sends the touch operation data to the controlled terminal 204 again, and receives the controlled terminal 204 again. The sent touch response interface (different from the previous touch response interface) is basically the same as the way that the user normally performs touch operations on a mobile terminal such as a mobile phone.

In the above terminal control method, by establishing a connection between a control terminal and a plurality of controlled terminals, the control terminal acquires the interactive interface of each controlled terminal, and performs split-screen display processing on each interactive interface, so that the control terminal can be controlled in one terminal. The terminal comprehensively displays the screen data of multiple controlled terminals, and then responds to the user's touch operation data on the interactive interface after split-screen display, and then sends the touch operation data to the corresponding controlled terminal to obtain the controlled terminal. The touch response interface after the touch response is performed according to the touch operation enables the user to operate on the interactive interface of the control terminal to remotely realize split-screen control of multiple controlled terminals. In the above solution, there is no need to carry the controlled terminal, and the interaction between the controlling terminal and multiple controlled terminals replaces the direct operation of the controlling terminal, which also reduces the storage space of the controlling terminal and improves the convenience.

In one of the embodiments, as shown in FIG. 4 , before acquiring the interactive interfaces of the at least two controlled terminals, the method further includes: Step S100, sending a connection request to the at least two controlled terminals, the connection request carrying identity authentication information, receiving Each controlled terminal establishes a connection with each controlled terminal according to the connection permission message fed back by the identity authentication information.

In specific implementation, the process of establishing a connection between the control terminal 202 and the controlled terminal 204 may be as follows: the control terminal 202 can select a specific controlled terminal to be connected, such as connecting to smart devices such as mobile phones, computers, and smart bracelets. The smart device may be a smart device in the history record that the control terminal 202 has previously connected to or performed remote control, or may be a new terminal device.

In practical applications, the control terminal 202 can be powered on to enter the display interface, the user opens the historical connection device record, and selects a specific controlled terminal to be connected to connect, or it can search for a currently connectable controlled terminal, and then touch The operation selects a specific controlled terminal to be connected for connection. At this time, the control terminal 202 responds to the user's touch operation and sends a connection request carrying its identity authentication information to the controlled terminal 204. The controlled terminal 204 receives the request and reads identity authentication information in the request, and perform identity authentication or pairing authentication based on the identity authentication information. Specifically, the verification methods include, but are not limited to, string password verification, fingerprint verification, face verification, or iris verification and other verification methods. After receiving the correct authentication information, the controlled terminal 204 can automatically send the interactive interface to the controlling terminal 202 without the user clicking to confirm.

Further, the controlled terminal 204 can also set the control authority of the control terminal 202. For some privacy-sensitive or important operations, the control terminal 202 needs to be re-authenticated, or can be accessed only with different access authority. Specifically, a connection with the controlled terminal can be established through 3G, 4G, 5G, 2.4G, Wi-Fi, Bluetooth or a custom wireless protocol. In specific implementation, the communication distance between the control terminal 202 and the controlled terminal 204 is within the Wi-Fi or Bluetooth communication range, and the two realize data transmission through Wi-Fi, Bluetooth or a custom wireless protocol. Since a common platform such as Wi-Fi or Bluetooth is used, or a custom wireless protocol is used, a completely open operating environment can be maintained, allowing any controlled terminal to develop application software at any time, which can meet the increasingly complex and diverse functional requirements of communication products. In this embodiment, the connection is allowed to be established only after passing the verification of the controlled terminal, which can ensure the standardization and security of the remote operation.

In one of the embodiments, acquiring the interactive interfaces of the at least two controlled terminals includes: acquiring program running window data of the at least two controlled terminals, processing each program running window data, and obtaining a plurality of interactive interface configuration data, according to Each interactive interface configures data, and configures the corresponding interactive interface.

In a specific implementation, the acquisition of the interactive interface may be to acquire the screenshot data of the touch response interface sent by the controlled terminal 204, or the control terminal 202 may acquire the program running window data of the controlled terminal 204, that is, the controlled terminal 204 currently displays or Page information of the operation interface (window) of the application program running in the background, including various attribute information and configuration data of the page, screen UI data, screen size and resolution, etc. Then, according to the size of the split screen area, the data of the program running window is scaled, intercepted or filled to obtain the interactive interface configuration data. According to the interactive interface configuration data, a corresponding interactive interface is configured, and then the corresponding interactive interface is displayed in the corresponding split screen area. user-interface. In this embodiment, the interactive interface of the controlled terminal 204 may be page configuration data other than the screenshot data, which can accurately configure and display the corresponding interactive interface of the controlled terminal 204 .

In one embodiment, as shown in FIG. 5 , performing split-screen display processing on each interactive interface includes:

Step S120, obtaining the number of connected controlled terminals and the identity information of each controlled terminal;

Step S140, determining the number of split-screen areas according to the number of connected controlled terminals;

Step S160: Divide the screen into split-screen areas corresponding to the number of split-screen areas, and display each interactive interface in each split-screen area according to the identity information of each controlled terminal.

In practical applications, in order to ensure the accuracy of the split-screen display, the split-screen display process for the interactive interface may be: after establishing connections with multiple controlled terminals 204, or in other words, after the user selects the controlled terminal 204 that needs to be connected , obtain the number and identity information (including device number, MAC (Media Access Control Address, media access control address) address and other information that can uniquely identify the controlled terminal) of the controlled terminal 204 that establishes a connection with itself), and then Determine the number of split-screen areas according to the number of connected controlled terminals, and then divide the screen into split-screen areas corresponding to the number of split-screen areas. For example, when 2, 3 or 4 controlled terminals are connected, the The screen is correspondingly divided into 1×2, 1×3, and 2×2. After the screen splitting is completed, each interactive interface is displayed in the corresponding split screen area according to the identification information of each controlled terminal 204 . Specifically, it can be the corresponding relationship between the preset identity identifier and the split screen area, for example, split screen area 1 (for example, the coordinates (0,0) to (512,384) are split screen area 1) corresponds to the controlled terminal A, and the split screen area 2. Corresponding to the controlled terminal B, according to this relationship and the identification information carried by each interactive interface, the allocation and display of each interactive interface is completed, and it can also be in the order in which the interactive interfaces carrying the controlled terminal identification information are received. Perform split-screen display to obtain the corresponding relationship between the split-screen area and the controlled terminal (ie, the corresponding relationship between each controlled terminal and the coordinate range). After the corresponding relationship between the split screen area and the controlled terminal is obtained, the corresponding relationship between the split screen area and the controlled terminal can also be sent to each controlled terminal, so that the controlled terminal can specify which coordinate range interval it corresponds to. In this embodiment, the number of controlled terminals and identification information are used to complete the split-screen display of the interactive interface, and the split-screen display can be performed flexibly and accurately for different situations.

In one embodiment, acquiring the touch response interface of the corresponding controlled terminal includes: acquiring target program running window data displayed after the corresponding controlled terminal responds to the touch operation data, and processing the target program running window data to obtain The touch response interface configuration data is configured to configure the touch response interface according to the touch response interface configuration data.

After the controlled terminal 204 receives the touch operation data and performs a touch response, it can correspondingly generate and send a touch response interface to the control terminal 202. Specifically, it can send the screenshot data of the touch response interface, or it can send the touch response interface. The program running window data of the response interface is the page information of the operation interface currently displayed by the controlled terminal 204, including various attribute information and configuration data of the page, screen UI data, screen size, and resolution. Then, according to the size of the split screen area, the data of the program running window is scaled, intercepted or filled to obtain touch response interface configuration data, and according to the touch response interface configuration data, a corresponding touch response interface is configured, and then further The touch response interface is displayed in the corresponding split screen area. In this embodiment, the touch response interface of the controlled terminal 204 may be page configuration data other than the screenshot data, which can accurately configure and display the corresponding touch response interface of the controlled terminal 204 .

In one of the embodiments, the displayed interactive interface and the displayed touch response interface match the size of the corresponding split screen area.

During specific implementation, each split screen area (split screen interface) correspondingly displays an interactive interface and a touch response interface of the controlled terminal 204 . For example, there are three controlled terminals connected to the control terminal 202, namely controlled terminal A, controlled terminal B, and controlled terminal C, then the control terminal also has three split-screen interfaces, namely split-screen a, split-screen b and Split screen b, the interactive interface a displayed on split screen a is the obtained interface after rendering the initial interactive interface of controlled terminal A, the interface matches the size of the split screen area, and the interactive interface displayed on split screen b b is the obtained interface after rendering the initial interactive interface of the controlled terminal B, which matches the size of the split screen area, and the interactive interface c displayed on the split screen c is the acquired interface of the controlled terminal C. The rendered interface of the initial interactive interface, which matches the size of the split screen area. Specifically, the rendering action may be performed by the controlled terminal or by the control terminal. In this embodiment, the interface is rendered into an interface that matches the size of the split-screen area, so that interface data can be displayed more reasonably, and the user's sense of use can be improved at the same time.

The present application provides another terminal control method, and the terminal control method can be applied in the application environment as shown in FIG. 6 . In this application environment, a control terminal 602 , a control center 604 and a controlled terminal 606 are included. Among them, there are multiple controlled terminals 606, and the control center 604 is used for data forwarding 606 between the control terminal 602 and the controlled terminal. The control center 604 can be a server, a cloud (cloud computing server), a computer host, etc. The control center There can also be multiple 604, each control center 604 operates independently, and the control center and the control center can be independent of each other or connected to each other, in addition, each control center can also use an independent server or a server cluster composed of multiple servers. realization etc.

In one of the embodiments, as shown in FIG. 7 , another terminal control method provided by the present application is described by taking the method applied to the control terminal 602 in the application environment in FIG. 6 as an example, including the following steps:

Step S300, obtaining the interactive interfaces of at least two controlled terminals through the control center, and performing split-screen display processing on each interactive interface;

Step S500, in response to a user's touch operation on the interface after the split-screen display, obtain touch operation data, where the touch operation data carries the identity information of each controlled terminal;

Step S700, sending the touch operation data to the control center, and the control center is used to control the corresponding controlled terminal to perform a touch response according to the touch operation data;

Step S900 , obtaining the touch response interface of the corresponding controlled terminal through the control center, displaying the touch response interface in the corresponding split screen area, and obtaining the touch response interface based on the controlled terminal performing the touch response according to the touch operation data.

As can be seen from the above embodiments, the terminal control method provided in this embodiment is different in that the connection between the control terminal 602 and the controlled terminal 606 is not directly established, but the control terminal 602 establishes a connection with the controlled terminal 606 through the control center 604 . In the specific implementation, the control center has the access operation authority of each controlled terminal, and at least two or more controlled terminals 606 may establish connections with the control center 604 in advance, and the controlled terminals 606 may backup data in the control center 604 in advance, and It is set to an accessible state, or the controlled terminal 606 is brought into a controllable state through a pre-installed remote operation application/operating system. The control terminal 602 may send its own identity code to the control center 604, and the control center 604 establishes a connection with the control terminal 602 after receiving the identity code. The control terminal 602 obtains the interactive interfaces of at least two controlled terminals 606 through the control center 604, and each interactive interface carries the identity information of the controlled terminals 606, and then performs split-screen display processing on the interactive interfaces according to the above-mentioned identity information, and displays each interface. The interactive interface is displayed in each split screen area.

In specific implementation, the split-screen display processing may be to obtain a screenshot of the operation interface of each controlled terminal through the control center and use it as the interactive interface (referred to as the first interactive interface), and then obtain the screen UI data of the interactive interface captured by the controlled terminal. , screen size, resolution and other data, and then based on the above data combined with its own screen resolution, the interactive interface is proportionally scaled or rendered to obtain a second interactive interface, and then the second interactive interface is displayed in the corresponding split screen area. Specifically, when the interface of the control terminal 602 is not proportional to the resolution of the first interactive interface, the first interactive interface may be scaled in equal proportions, and then operations such as interception or filling may be performed according to the scaling result to obtain the second interactive interface. interface, and then display the second interactive interface; if the resolutions are in equal proportions, the first interactive interface can be directly scaled to an interface that matches the size of the split-screen area to obtain the second interactive interface, and then the corresponding split-screen The area displays the second interactive interface. Further, in order to facilitate the user to visually check which controlled terminal the second interactive interface displayed on which split-screen area corresponds to, the identity of the controlled terminal may be displayed on the split-screen area, for example, "You are talking to XXX( identification information) terminal for remote operation” and other words.

The user performs a touch operation on the interactive interface after the split-screen display, and the control terminal 602 is preset with software such as a browser portal for receiving the user's touch operation, and the control terminal 602 receives the user's touch operation on a specific split screen, records The split-screen area touched by the user and the identification information, touch coordinates, touch duration, and touch pressure of the controlled terminal 606 corresponding to the split-screen area are obtained to obtain touch operation data, and process the touch operation data Then, it is forwarded to the controlled terminal 606 through the control center 604 . The touch response interface may be an interface displayed after the controlled terminal 606 performs a touch response according to the received touch operation data. In specific implementation, the touch response interface image of the controlled terminal 606 may be intercepted, and the touch response interface image may be used as the first touch response interface, or the resolution, Information such as color and text, and a first touch response interface is obtained according to the information. For example, for the controlled terminal 606, a screenshot operation can be performed on the entire touch response interface, and the screenshot result can be used as the first touch response interface. Or, read the touch response interface information of the controlled terminal 204, including the resolution of 2048×1536 pixels, the text content and position displayed by the touch response, the color and position of the image displayed by the touch response, etc. A first touch response interface is obtained by responding to the interface information.

After the first touch response interface is obtained, the first touch response interface may be proportionally scaled according to the resolution of the interface of the control terminal 202 to obtain the second touch response interface. For example, when the resolution of the interface of the control terminal 202 is not proportional to the resolution of the first touch response interface, the first touch response interface may be scaled in equal proportions, and then operations such as interception or filling may be performed according to the scaling result to obtain the first touch response interface. Second touch response interface, and then display the second touch response interface; if the resolution is proportional, the first touch response interface can be directly scaled to an interface that matches the size of the split screen area to obtain the second touch response interface. touch response interface, and then display the second touch response interface in the corresponding split screen area. If the resolutions are exactly matched, the first touch response interface can be directly used as the second touch response interface, and then display the second touch response interface in the corresponding split screen area. The area displays the second touch response interface. Further, the user can adjust the size of each split screen area.

8 is a schematic diagram of the software architecture of a terminal control method according to an embodiment, the figure includes a smart hand board 702, a cloud computing server 704 and a tablet computer 706, wherein the smart hand board 702 is a control terminal, and the cloud computing server 704 is a control center. The tablet computer 706 is a controlled terminal. The cloud computing server 704 includes a message middleware 708 , a front-end service 710 , a back-end service 712 and a database 714 .

Referring to FIG. 8 , the tablet computer 706 runs the block screen UI and touch (touch) events and other data software, via the 4G/5G network, through TCP (Transmission Control Protocol, Transmission Control Protocol)/IP (Internet Protocol Address, Internet Internet Protocol) It carries private protocol data and establishes a connection with the cloud computing server 704 . In the cloud computing server 704, the message middleware 708 distributes data efficiently, and the back-end service 712 and the front-end service 710 conduct bidirectional communication through the Websocket protocol. Specifically, when the cloud computing server 704 transmits information with the smart hand board 702 and the tablet computer 706, it communicates with the tablet computer 706 through the TCP/IP protocol by using the message middleware 708, and receives the operation interface of the tablet computer 706 (including interactive interface and touch response interface), the message middleware 708 transmits the operation interface to the back-end service 712 through the TCP/IP protocol, and the back-end service 712 transmits the operation interface to the front-end service 710 through the Websocket protocol. The resolution of the hand board 702, the size of the control interface, etc. are used to render the operation interface, so that the rendered image is adapted to the smart hand board 702. The smart hand board 702 actively obtains the rendered image from the front-end service 710 through the HTTP protocol, and the cloud computing server 704 It is to receive the touch operation data such as the touch coordinates, touch pressure and touch duration detected by the smart hand board 702 on the hand board interface detected by the smart hand board 702 through the HTTP or Restful interface. The data is encapsulated by the TCP/IP protocol carrying the private protocol, and forwarded to the tablet computer 706 . Then, the backend service 712 sends the received touch response interface sent by the tablet computer 706 to the smart panel 702 through the message middleware 708 .

Referring to FIG. 8 , the following describes the display of the touch response interface of the control terminal. Through the cloud computing server 704 , the tablet computer 706 performs a touch response after receiving the WeChat opening operation, and obtains the WeChat opening interface, that is, the first interface of the controlled terminal. A touch-responsive interface. Through the cloud computing server 704 , the tablet computer 706 sends the first touch corresponding interface to the smart hand panel 702 . The resolution of the first touch response interface is 2048×1536 pixels. If the resolution of the smart panel 702 interface is 1024×768 pixels, the first touch response interface can be proportionally reduced to 50% of the original to obtain the second touch response interface; if the resolution of the interface of the smart hand board 702 is 700×384 pixels, the first touch response interface can be scaled down to 50% of the original, and displayed in the center of the interface of the smart hand board 702, and then fill the undisplayed part with black to obtain the second touch response interface. Afterwards, the smart panel 702 displays the second touch response interface.

In the above terminal control method, a connection is established between the control terminal and a plurality of controlled terminals through the control center, the interactive interface of each controlled terminal is obtained through the control center, and each interactive interface is displayed in a split screen, so that the interface can be displayed in one screen. The control terminal comprehensively displays the screen data of multiple controlled terminals, and then sends the touch operation data to the control center by responding to the user's touch operation data on the interactive interface after the split-screen display, and the control center controls the corresponding receivers. control terminal, and then obtain the touch response interface of the controlled terminal through the control center, so that the user can remotely realize split-screen control of multiple controlled terminals through the control terminal without establishing a direct connection with the controlled terminal. The above solution does not need to carry the controlled terminal, nor does it need to establish a connection with the controlled terminal, replaces the direct operation of the control terminal with the interaction between the control terminal and the control center, and avoids the execution of complex data processing in the control terminal. The storage space of the control terminal is reduced and the convenience is improved.

In one of the embodiments, as shown in FIG. 9 , before obtaining the interactive interfaces of at least two controlled terminals through the control center, the method further includes: Step S250 , sending a connection request to the control center, the connection request carrying identity authentication information, and receiving control The connection permission message forwarded by the center is sent by the controlled terminal after completing the identity authentication or pairing authentication according to the identity authentication information.

In specific implementation, the process of establishing a connection between the control terminal 602 and the controlled terminal 606 through the control center 602 may be: the control terminal 602 can select a specific controlled terminal to be connected, such as connecting a mobile phone, a computer, a smart bracelet and other smart devices. The smart device may be a smart device in the history record that the control terminal 602 has been indirectly connected to or performed remote control before, or may be a new terminal device.

In practical applications, similarly, the control terminal 602 can be powered on to enter the display interface, the user opens the historical connection device record, selects a specific controlled terminal to be connected to connect, or searches for a currently connectable controlled terminal, and then The specific controlled terminal to be connected is selected through the touch operation for connection. At this time, the control terminal 602 responds to the user's touch operation and sends a connection request carrying its identity authentication information to the control center 604. The control center 604 receives the request and sends The request is forwarded to the controlled terminal 606, and the controlled terminal 606 reads the identity authentication information in the request, and performs identity authentication or pairing authentication based on the identity authentication information. The center 604 establishes a connection with the control terminal 602 according to the connection permission message, and forwards the connection permission message to the control terminal 602 . Specifically, the verification methods include, but are not limited to, string password verification, fingerprint verification, face verification, or iris verification and other verification methods. After receiving the correct authentication information, the controlled terminal 606 can automatically send the interactive interface to the control center 604 without the user clicking to confirm.

Further, the controlled terminal 606 may also set the control authority of the control terminal 602. For some privacy-sensitive or important operations, the control terminal 602 needs to be re-authenticated, or different access authority is required for access. Specifically, a connection with the controlled terminal can be established through 3G, 4G, 5G, 2.4G, Wi-Fi, Bluetooth or a custom wireless protocol. In specific implementation, the communication distance between the control terminal 602 and the control center 606 and between the control center 604 and the controlled terminal 606 is within the Wi-Fi or Bluetooth communication range, and the two realize data through Wi-Fi, Bluetooth or a custom wireless protocol. transmission. Since a common platform such as Wi-Fi or Bluetooth is used, or a custom wireless protocol is used, a completely open operating environment can be maintained, allowing any controlled terminal to develop application software at any time, which can meet the increasingly complex and diverse functional requirements of communication products. In this embodiment, the connection is allowed to be established only after passing the verification of the controlled terminal, which can ensure the standardization and security of the remote operation.

In one embodiment, performing split-screen display processing on each interactive interface includes: obtaining the number of connected controlled terminals and the identity information of each controlled terminal through the control center, and according to the number of connected controlled terminals, Determine the number of split-screen areas, divide the screen into split-screen areas corresponding to the number of split-screen areas, and display each interactive interface in the corresponding split-screen area according to the identity information of each controlled terminal.

In this embodiment, the process of performing split-screen display processing on each interactive interface is different from the process of performing split-screen display processing on each interactive interface in the aforementioned terminal control method. The difference lies in the different communication methods. The number of connected controlled terminals 606 and the identity information of each controlled terminal, based on the number of controlled terminals and the identity information, the process of performing split-screen processing and display on each interactive interface has been described in detail in the foregoing embodiments. , and will not be repeated here. In this embodiment, the number of controlled terminals and identification information are used to complete the split-screen display of the interactive interface, and the split-screen display can be performed flexibly and accurately for different situations.

In one of the embodiments, acquiring the interactive interfaces of the at least two controlled terminals through the control center includes: acquiring the program running window data of the at least two controlled terminals through the control center, and processing each program running window data to obtain multiple The interactive interface configuration data, according to each interactive interface configuration data, configure the interactive interface of the controlled terminal.

In this embodiment, the way in which the control terminal 602 obtains the interactive interface of the controlled terminal 606 is different from the obtaining way in the aforementioned terminal control method in that: the control center 604 obtains the program running window data of at least two controlled terminals, which is specifically based on obtaining The obtained program running window data and the interactive interface for configuring the controlled terminal have been described in detail in the foregoing embodiments. For details, please refer to the description on configuring the interactive interface of the controlled terminal in the foregoing embodiment, which will not be repeated here. In this embodiment, the interactive interface of the controlled terminal 204 may be page configuration data other than the screenshot data, which can accurately configure and display the corresponding interactive interface of the controlled terminal 204 .

In one embodiment, obtaining the touch response interface of each controlled terminal through the control center includes: obtaining, through the control center, touch program running window data displayed after the corresponding controlled terminal responds to the touch operation data, and responding to the touch program The operation window data is processed to obtain touch response interface configuration data, and the touch response interface is configured according to the touch response interface configuration data.

Similarly, in this embodiment, the difference between the manner in which the control terminal 602 acquires the touch response interface of the controlled terminal 606 and the acquisition manner in the aforementioned terminal control method is that the control center 604 acquires at least two controlled terminals in response to the received The program running window data after the touch operation data is specifically based on the obtained program running window data. The touch response interface for configuring the controlled terminal has been described in detail in the foregoing embodiments. The description of the touch response interface of the control terminal will not be repeated here. In this embodiment, the touch response interface of the controlled terminal 606 may be page configuration data other than the screenshot data, which can accurately configure and display the touch response interface of the corresponding controlled terminal.

In one of the embodiments, the displayed interactive interface and the displayed touch response interface match the size of the corresponding split screen area.

Similarly, during specific implementation, each split screen area (split screen interface) of the control terminal 602 corresponds to displaying an interactive interface and a touch response interface of the controlled terminal 606 . For example, there are two controlled terminals connected to the control terminal 602, namely controlled terminal A and controlled terminal B, then the control terminal also has two split-screen interfaces, namely split-screen a and split-screen b, which are displayed on split-screen a. The interactive interface a is the obtained interface after rendering the initial interactive interface of the controlled terminal A, which matches the size of the split screen area, and the interactive interface b displayed on the split screen b is the acquired controlled terminal A. The rendered interface of the initial interactive interface of terminal B, which matches the size of the split-screen area. Specifically, the rendering action may be performed by the control center 604 or by the control terminal 602 . In this embodiment, the interface is rendered into an interface that matches the size of the split-screen area, so that interface data can be displayed more reasonably, and the user's sense of use can be improved at the same time.

It should be understood that although the steps in the flowcharts of FIGS. 2 , 4 , 5 , 7 and 9 are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in FIG. 2, FIG. 4, FIG. 5, FIG. 7 and FIG. 9 may include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but may be performed at different times. The execution sequence of these steps or stages is not necessarily carried out sequentially, but may be executed in turn or alternately with other steps or at least a part of the steps or stages in the other steps.

In one of the embodiments, as shown in FIG. 10, a terminal is provided, which includes: a communication module 510, a touch display module 520, and a processor 530, wherein:

The communication module 510 establishes a connection with at least two controlled terminals, and the processor 530 obtains the interactive interface of each controlled terminal, performs display split-screen processing on each interactive interface, obtains split-screen display interface configuration data, and configures the split-screen display interface The data is sent to the touch display module 520, and the touch display module 520 receives the split screen display interface configuration data, displays the interactive interface in the corresponding split screen area, receives the user's touch operation on the split screen displayed interactive interface, and obtains the touch operation data, and send the touch operation data to the processor 530. The processor 530 determines the corresponding controlled terminal according to the touch operation data, and sends the touch operation data to the corresponding controlled terminal to obtain the corresponding controlled terminal. The touch program running window data of the terminal processes the touch program running window data to obtain the touch response interface configuration data, and sends the touch response interface configuration data to the touch display module 520, and the touch display module 520 according to the touch display module 520 The control response interface configuration data displays the touch response interface in the corresponding split screen area, wherein the touch response interface is obtained based on the controlled terminal performing the touch response according to the touch operation data.

In another embodiment, as shown in FIG. 11 , the communication module 510 includes a wireless communication interface 1616 , and the touch display module 520 may be a touch display screen 1602 . Specifically, referring to FIG. 11 , the wireless communication interface 1616 can be a 3G/4G/5G network or a Wi-Fi antenna interface, and the touch display 1602 can be an OLED (Organic Light-Emitting Diode, organic light-emitting diode) and glass (or sapphire) ) cover plate, the processor can be equipped with Qualcomm APQ8053 on PCBA (Printed Circuit Board+Assembly, printed circuit board assembly). In addition, the terminal also includes a separator 1604, a battery 1608 (capacity 1000mAh, 1.0mm), a USB interface 1610 (Type C), a stainless steel middle frame 1612 and a back cover 1614, which can be OLED and glass (or sapphire). ) cover. Since components such as microphones and cameras are not designed, the dialogue function can be realized by a Bluetooth headset, and photography can be realized by a watch.

More specifically, the thickness of the terminal can be 4mm, and the communication interface of Wi-Fi and BT (Bit Torrent) can be used for interaction in the early stage, and the independent protocol can be used for interaction in the later stage. For prototype terminals such as network mobile phones, network video terminals, game terminals and various extensions (such as biological detection) of smart watches, 5-6 inch screens can be used; for home management boards, reading boards, game boards, WeChat boards, social boards 7-14 inch screen can be used for smart home terminals such as homework boards and work boards; for teaching boards, textbook boards, exam boards, conference boards, aviation boards, high-speed rail boards and one-way confidential information boards and other intelligent teaching, conference, aviation and high-speed rail The terminal can also use a 7-14 inch screen; for desk boards, projection display boards, ordering boards, bus stop boards, household appliances boards, smart furniture boards, bar interactive boards, outdoor natural scene film and television interactive boards and concerts Smart surface terminals such as competitive sports focus boards can use 5-105 inch screens.

The above-mentioned terminal can ensure good realization of touch and display functions, and realize functions such as data processing and storage through the controlled terminal and/or control center, and functionally separate touch and display from other functions. Since there is no need to implement functions such as data processing and storage, compared with traditional terminals, the above-mentioned terminals can implement various complex functions with lighter weight, smaller volume and thinner thickness, which solves the problem of the weight of terminals in traditional communication systems. And the problem of large size and poor portability.

Further, because the terminal uses an open communication platform, it can communicate directly through an open platform such as a wireless communication network or cloud without relying on any mobile phone brand and without the operator's license, avoiding the need for existing terminal brands and operations. complex problems caused by the threshold of commercial configuration.

In one of the embodiments, as shown in FIG. 12 , a terminal control apparatus is provided, including: a first split-screen display module 610 , a touch operation data receiving module 620 , a control module 630 and a second split-screen display module 640 ,in:

The first split-screen display module 610 is configured to acquire interactive interfaces of at least two controlled terminals, and perform split-screen display processing on each interactive interface.

The touch operation data receiving module 620 is used for obtaining touch operation data in response to a user's touch operation on the interface processed by the split screen display.

The control module 630 is configured to determine the corresponding controlled terminal according to the touch operation data, and send the touch operation data to the corresponding controlled terminal.

The second split-screen display module 640 is configured to acquire the touch response interface of the corresponding controlled terminal, display the touch response interface in the corresponding split-screen area, and the touch response interface performs touch based on the controlled terminal according to the touch operation data. get after the response.

In one embodiment, as shown in FIG. 13 , the apparatus further includes a data connection module 650, configured to send connection requests to at least two controlled terminals, the connection requests carry identity authentication information, and receive each controlled terminal according to the identity authentication information. The connection permission message is fed back, and the connection with each controlled terminal is established.

In one embodiment, the first split-screen display module 610 is further configured to acquire the number of connected controlled terminals and the identity information of each controlled terminal, and determine the split-screen area according to the number of connected controlled terminals The screen is divided into split screen areas corresponding to the number of split screen areas, and each interactive interface is displayed in each split screen area according to the identity information of each controlled terminal.

In one embodiment, the touch operation data includes touch coordinates; the control module 630 is further configured to determine the split screen area touched by the user according to the touch coordinates, and determine the corresponding controlled terminal according to the split screen area.

In one embodiment, the apparatus further includes an interface configuration module 660, configured to acquire program running window data of at least two controlled terminals, process each program running window data, and obtain a plurality of interactive interface configuration data. Interface configuration data, configure the corresponding interactive interface.

In one embodiment, the configuration module 660 is further configured to obtain the target program running window data displayed after the corresponding controlled terminal responds to the touch operation data, process the target program running window data, and obtain the touch response interface configuration data, Configure the touch response interface according to the touch response interface configuration data.

For the specific limitation of the terminal control apparatus, reference may be made to the limitation on the terminal control method above, which will not be repeated here. Each module in the above-mentioned terminal control device may be implemented in whole or in part by software, hardware and combinations thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

In one of the embodiments, as shown in FIG. 14, a terminal control apparatus is also provided, including: a first processing module 710, a touch operation data receiving module 720, a control module 730 and a second processing module 740, wherein:

The first processing module 710 is configured to obtain interactive interfaces of at least two controlled terminals through the control center, and perform split-screen display processing on each interactive interface.

The touch operation response module 720 is configured to respond to the user's touch operation on the interface after the split-screen display, and obtain touch operation data, where the touch operation data carries the identity information of each controlled terminal.

The data control module 730 is used for sending the touch operation data to the control center, and the control center is used for controlling the corresponding controlled terminal to perform touch response according to the touch operation data.

The second processing module 740 is configured to obtain the touch response interface of the corresponding controlled terminal through the control center, display the touch response interface in the corresponding split screen area, and the touch response interface is based on the controlled terminal according to the touch operation data. obtained after the control response.

In one embodiment, as shown in FIG. 15 , the apparatus further includes a data connection module 750 for sending a connection request to the control center, the connection request carrying the identity authentication information, and receiving a connection permission message forwarded by the control center, the connection permission message being sent by The controlled terminal is sent after completing identity authentication or pairing authentication according to the identity authentication information.

In one embodiment, the first processing module 710 is further configured to obtain the number of connected controlled terminals and the identity information of each controlled terminal through the control center, and determine the split screen according to the number of connected controlled terminals The number of areas, the screen is divided into split-screen areas corresponding to the number of split-screen areas, and each interactive interface is displayed in each split-screen area according to the identity information of each controlled terminal.

In one embodiment, the touch operation data includes touch coordinates; the data control module 730 is further configured to determine the split screen area touched by the user according to the touch coordinates, determine the corresponding controlled terminal according to the split screen area, and record the The identity information of the corresponding controlled terminal is contained in the touch operation data.

In one of the embodiments, as shown in FIG. 15 , the apparatus further includes a page configuration module 760, which is used for obtaining the program running window data of at least two controlled terminals through the control center, and processing each program running window data to obtain multiple configuration data of each interactive interface, and configure the corresponding interactive interface according to the configuration data of each interactive interface.

In one embodiment, the page configuration module 760 is further configured to obtain the target program running window data displayed after the corresponding controlled terminal responds to the touch operation data through the control center, and process the target program running window data to obtain the touch response. Interface configuration data, configure the touch response interface according to the touch response interface configuration data.

For the specific limitation of the terminal control apparatus, reference may be made to the limitation on the terminal control method above, which will not be repeated here. Each module in the above-mentioned terminal control device may be implemented in whole or in part by software, hardware and combinations thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

In one embodiment, a computer device is provided, and the computer device may be a terminal, and its internal structure diagram may be as shown in FIG. 16 . The computer equipment includes a processor, memory, a communication interface, a display screen, and an input device connected by a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium, an internal memory. The nonvolatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the execution of the operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for wired or wireless communication with an external terminal, and the wireless communication can be realized by WIFI, operator network, NFC (Near Field Communication) or other technologies. The computer program implements a terminal control method when executed by the processor. The display screen of the computer equipment may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment may be a touch layer covered on the display screen, or a button, a trackball or a touchpad set on the shell of the computer equipment , or an external keyboard, trackpad, or mouse.

Those skilled in the art can understand that the structure shown in FIG. 16 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer equipment to which the solution of the present application is applied. Include more or fewer components than shown in the figures, or combine certain components, or have a different arrangement of components.

In one embodiment, a computer device is provided, including a memory and a processor, where a computer program is stored in the memory, and the processor implements the steps in the above terminal control method when the processor executes the computer program.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above terminal control method are implemented.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other media used in the various embodiments provided in this application may include at least one of non-volatile and volatile memory. The non-volatile memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, and the like. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, the RAM may be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM).

The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features It is considered to be the range described in this specification.

The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are specific and detailed, but should not be construed as a limitation on the scope of the invention patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (18)

1. A terminal control method, the method comprising:

acquiring interactive interfaces of at least two controlled terminals, and performing split-screen display processing on each interactive interface;

responding to the touch operation of the user on the interface after the split-screen display processing to obtain touch operation data;

determining a corresponding controlled terminal according to the touch operation data, and sending the touch operation data to the corresponding controlled terminal;

and acquiring a touch response interface of the corresponding controlled terminal, and displaying the touch response interface corresponding to the corresponding split screen area, wherein the touch response interface is obtained after touch response is carried out on the basis of the controlled terminal according to the touch operation data.

2. The method according to claim 1, wherein before acquiring the interactive interfaces of the at least two controlled terminals, the method further comprises:

sending a connection request to at least two controlled terminals, wherein the connection request carries identity authentication information;

and receiving a connection permission message fed back by each controlled terminal according to the identity authentication information, and establishing connection with each controlled terminal.

3. The method of claim 2, wherein performing a split-screen display process on each interactive interface comprises:

acquiring the number of connected controlled terminals and the identity identification information of each controlled terminal;

determining the number of split screen areas according to the number of the connected controlled terminals;

dividing the screen into screen division areas corresponding to the screen division areas in number;

and displaying each interactive interface in each split screen area according to the identity identification information of each controlled terminal.

4. The method according to any one of claims 1 to 3, wherein the touch operation data comprises touch coordinates;

the determining the corresponding controlled terminal according to the touch operation data includes:

determining a split screen area touched by the user according to the touch coordinate;

and determining a corresponding controlled terminal according to the split screen area.

5. The method according to any one of claims 1 to 3, wherein the acquiring the interactive interfaces of the at least two controlled terminals comprises:

acquiring program operation window data of at least two controlled terminals;

processing the program operation window data to obtain a plurality of interactive interface configuration data;

and configuring the corresponding interactive interface according to the configuration data of each interactive interface.

6. The method according to any one of claims 1 to 3, wherein the acquiring the touch response interface of the corresponding controlled terminal comprises:

acquiring target program running window data displayed after the corresponding controlled terminal responds to the touch operation data;

processing the target program operation window data to obtain touch response interface configuration data;

and configuring the touch response interface according to the touch response interface configuration data.

7. The method of any one of claims 1 to 3, wherein the displayed interactive interface and the displayed touch response interface match the size of the corresponding split screen area.

8. A terminal control method comprises the following steps:

acquiring interactive interfaces of at least two controlled terminals through a control center, and performing split-screen display processing on each interactive interface, wherein the control center has access operation authority of each controlled terminal;

responding to touch operation of a user on an interface displayed in a split screen mode to obtain touch operation data, wherein the touch operation data carries identity identification information of each controlled terminal;

sending the touch operation data to the control center, wherein the control center is used for controlling a corresponding controlled terminal to perform touch response according to the touch operation data;

and acquiring a touch response interface of a corresponding controlled terminal through the control center, and displaying the touch response interface corresponding to the split screen area, wherein the touch response interface is obtained after touch response is performed on the basis of the controlled terminal according to the touch operation data.

9. The method according to claim 8, wherein before the obtaining of the interactive interfaces of the at least two controlled terminals through the control center, the method further comprises:

sending a connection request to the control center, wherein the connection request carries identity authentication information;

and receiving a connection permission message forwarded by the control center, wherein the connection permission message is sent by the controlled terminal after finishing identity authentication or pairing authentication according to the identity authentication information.

10. The method of claim 9, wherein performing a split-screen display process on each interactive interface comprises:

acquiring the number of the connected controlled terminals and the identity information of each controlled terminal through the control center;

the split-screen display processing of each interactive interface comprises the following steps:

determining the number of split screen areas according to the number of the connected controlled terminals;

dividing the screen into screen division areas corresponding to the screen division areas in number;

and displaying each interactive interface in the corresponding split screen area according to the identity identification information of each controlled terminal.

11. The method according to any one of claims 8 to 10, wherein the obtaining, by the control center, the interactive interfaces of the at least two controlled terminals comprises:

acquiring program operation window data of at least two controlled terminals through the control center;

processing the program operation window data to obtain a plurality of interactive interface configuration data;

and configuring the interactive interface of the controlled terminal according to the configuration data of each interactive interface.

12. The method according to any one of claims 8 to 10, wherein the obtaining, by the control center, the touch response interface of each controlled terminal includes:

acquiring touch program operation window data displayed after the corresponding controlled terminal responds to the touch operation data through the control center;

processing the touch program operation window data to obtain touch response interface configuration data;

and configuring the touch response interface according to the touch response interface configuration data.

13. The method of any one of claims 8 to 10, wherein the displayed interactive interface and the displayed touch responsive interface match the size of the corresponding split screen area.

14. A terminal control apparatus, characterized in that the apparatus comprises:

the first split screen display module is used for acquiring interactive interfaces of at least two controlled terminals and performing split screen display processing on each interactive interface;

the touch operation data receiving module is used for responding to the touch operation of the user on the interface after the split-screen display processing to obtain touch operation data; (ii) a

The control module is used for determining a corresponding controlled terminal according to the touch operation data and sending the touch operation data to the corresponding controlled terminal;

and the second split screen display module is used for acquiring a touch response interface of the corresponding controlled terminal and displaying the touch response interface in the corresponding split screen area, wherein the touch response interface is obtained after touch response is carried out on the basis of the controlled terminal according to the touch operation data.

15. A terminal control apparatus, characterized in that the apparatus comprises:

the first split screen display module is used for acquiring interactive interfaces of at least two controlled terminals through the control center and performing split screen display processing on each interactive interface, and the control center has access operation permission of each controlled terminal;

the touch operation data receiving module is used for responding to the touch operation of a user on the interface after split screen display to obtain touch operation data, and the touch operation data carries the identity identification information of each controlled terminal;

the control module is used for sending the touch operation data to the control center, and the control center is used for controlling a corresponding controlled terminal to perform touch response according to the touch operation data;

and the second screen splitting display module is used for acquiring a touch response interface of the corresponding controlled terminal through the control center and displaying the touch response interface corresponding to the screen splitting area, wherein the touch response interface is obtained after touch response is carried out on the basis of the controlled terminal according to the touch operation data.

16. A terminal, comprising: the touch display device comprises a communication module, a touch display module and a processor;

the communication module is connected with at least two controlled terminals, the processor acquires an interactive interface of each controlled terminal and performs display split-screen processing on each interactive interface to obtain split-screen display interface configuration data, the split-screen display interface configuration data are sent to the touch display module, the touch display module receives the split-screen display interface configuration data, displays an interactive interface in a corresponding split-screen area, receives touch operation of a user on the interactive interface displayed in a split-screen mode to obtain touch operation data, and sends the touch operation data to the processor, the processor determines the corresponding controlled terminal according to the touch operation data, sends the touch operation data to the corresponding controlled terminal, acquires touch program operation window data of the corresponding controlled terminal, and processes the touch program operation window data, and obtaining touch response interface configuration data and sending the touch response interface configuration data to the touch display module, wherein the touch display module displays a touch response interface corresponding to a split screen area according to the touch response interface configuration data, and the touch response interface is obtained after touch response is carried out on the basis of the controlled terminal according to the touch operation data.

17. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 13 are implemented when the computer program is executed by the processor.

18. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 13.

Images