CN113835609B - Display method, system, electronic device and storage medium - Google Patents
Display method, system, electronic device and storage medium Download PDFInfo
- Publication number
- CN113835609B CN113835609B CN202111136473.0A CN202111136473A CN113835609B CN 113835609 B CN113835609 B CN 113835609B CN 202111136473 A CN202111136473 A CN 202111136473A CN 113835609 B CN113835609 B CN 113835609B
- Authority
- CN
- China
- Prior art keywords
- display area
- track content
- track
- processor
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses a display method, a system, electronic equipment and a storage medium, wherein a first processor responds first track data of an operation body detected based on a first display area to be first track content, and the first track content is displayed through the first display area; at least part of the first track content is positioned in a track content display area in the interactive window displayed in the first display area; the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by using the second track content; the second track content is positioned in the track content display area; the first processor also obtains a display position of the track content display area. Based on the scheme of the application, the problem that the pen following performance is poor when the display content is updated only through the second processor can be avoided, and the problem that the display content determined by the first processor is not in the content display area can be avoided.
Description
Technical Field
The present application relates to the field of electronic devices, and more particularly, to a display method, a display system, an electronic device, and a storage medium.
Background
Currently, more and more electronic devices use an electronic ink screen (e.g., an E ink screen), where the E ink screen is displayed by receiving a video stream signal output, and when handwriting application software (e.g., drawing, handwriting notes, oneNote, whiteboard, etc.) is used on the E ink screen, there is a problem that pen following performance of a screen display pen is poor.
In order to overcome the above problem, one solution is to draw lines in combination with hardware, i.e. directly receive the track data from the touch pad by using the driving chip (TCON) of the E ink screen, directly display lines on the E ink screen by using the track data, and then cover the area by the real lines in the received video stream signal output. But this scenario may occur where the input trajectory is displayed in a non-drawing area (e.g., button, title bar, non-handwriting software area, etc.), followed by a message.
Disclosure of Invention
The application aims to provide a display method, a display system, electronic equipment and a storage medium, which comprise the following technical scheme:
a display method, the method comprising:
The first processor responds to first track data of the operation body detected based on a first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is positioned in a track content display area in the interactive window displayed in the first display area;
The second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by using the second track content; the second track content is positioned in the track content display area;
The method further comprises the steps of:
The first processor obtains a display position of the track content display area.
In the above method, preferably, the first processor acquires a display position of the track content display area, including:
The first processor receives the display position of the track content display area sent by the second processor; or alternatively
The first processor analyzes the interactive window to obtain the display position of the track content display area;
The first processor responds to first trajectory data of the operation body detected based on the first display area as first trajectory content, including:
the first processor responds track data located in the display position in the first track data as the first track content.
In the above method, preferably, the second processor acquires a display position of the track content display area, including:
The second processor reads the display position of the track content display area through an interface provided by an application program to which the interactive window belongs; or alternatively
And the second processor analyzes the interactive window and determines the display position of the track content display area.
The method, preferably, the process of analyzing the interactive window, includes:
Enumerating all sub-windows of the interactive window to screen out at least one target sub-window; the target sub-window is a sub-window with the area larger than a threshold value;
detecting a track content display area of a first target sub-window to judge whether the track content display area exists in the first target sub-window; the first target sub-window is any target sub-window;
and if the judgment result is yes, determining the display position of the track content display area.
In the above method, preferably, the detecting the track content display area of the first target sub-window includes:
Searching the same-color rectangular area at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area;
If N rectangular areas in the same-color rectangular areas at the four positions are positioned at N vertex angle positions of the same target rectangle, searching the same-color right triangle area at the four positions of the leftmost upper part, the rightmost upper part, the leftmost lower part and the rightmost lower part in the first target sub-window area; the N is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangle area is larger than the sum of two adjacent right-angle sides in the rectangular area;
And if N right triangle areas in the same color right triangle areas at the four positions are positioned at N vertex angle positions of the target rectangle, determining the area where the target rectangle is positioned as a track content display area.
In the above method, preferably, the detecting the track content display area of the first target sub-window includes:
Searching for the same-color rectangular areas at the four positions of the upper left, the upper right, the lower left and the lower right in the first target sub-window area;
If N rectangular areas in the same-color rectangular areas at the four positions are positioned at N vertex angle positions of the same target rectangle, judging whether right triangle areas at four vertex angles of the target rectangular areas are same-color right triangle areas or not; the N is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangle area is larger than the sum of two adjacent right-angle sides in the rectangular area;
and if the judgment result is yes, determining the area where the target rectangle is located as a track content display area.
In the above method, preferably, the first processor acquires a display position of the track content display area, including:
The first processor judges whether the first track content is different from the second track content;
And if the judgment result is yes, determining the display position of the track content display area according to the second track content and the part of the second track content which is lack of the first track content.
The above method, preferably, further comprises:
The second processor determines distances of the track content display area to respective edges of the interactive window;
if the position of the interactive window is determined to change, updating the display position of the track content display area according to the distance and the changed display position of the interactive window;
And sending the updated display position of the track content display area to the first processor.
In the above method, preferably, the first processor is a processor for refreshing the first display area, and the second processor is a processor for determining display content.
A display system, comprising:
A first processor for responding first track data of an operation body detected based on a first display area to be first track content, and displaying the first track content through the first display area; at least part of the first track content is positioned in a track content display area in the interactive window displayed in the first display area;
The second processor is used for responding to the first track data to obtain second track content, and updating the first track content displayed in the first display area by using the second track content; the second track content is positioned in the track content display area;
the first processor is further configured to obtain a display position of the track content display area.
An electronic device, comprising:
a memory for storing a program;
a processor for calling and executing the program in the memory, and implementing the respective steps of the display method according to any one of the above by executing the program.
A readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the display method as claimed in any one of the preceding claims.
According to the display method, the system, the electronic equipment and the storage medium, the first processor responds first track data of the operation body detected based on the first display area to be first track content, and the first track content is displayed through the first display area; at least part of the first track content is positioned in a track content display area in the interactive window displayed in the first display area; the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by using the second track content; the second track content is positioned in the track content display area; the first processor also obtains a display position of the track content display area. According to the scheme, the first processor responds the first track data of the operation body detected based on the first display area to be first track content and displays the first track content, and then the second processor responds the first track data to obtain second track content and then updates the first track content by the second track content, wherein the first processor also obtains the display position of the track content display area, so that the first processor can respond the track data of the operation body detected based on the first display area according to the display position of the track content display area to obtain track content only displayed in the track content display area, the problem that the pen following performance is poor when the display content is updated only through the second processor can be avoided, and the problem that the display content determined by the first processor is not in the content display area can be avoided.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of an implementation of a display method according to an embodiment of the present application;
FIG. 2 is an exemplary diagram of a user operating an interactive window displayed in a first display area according to an embodiment of the present application;
FIG. 3 is a flowchart of an implementation of analyzing an interactive window according to an embodiment of the present application;
FIG. 4 is a flowchart of an implementation of track content display area detection for a first target sub-window according to an embodiment of the present application;
FIG. 5 is a flowchart of an implementation of track content display area detection for a first target sub-window according to an embodiment of the present application;
FIG. 6 is a flowchart of one implementation of a first processor obtaining a display position of a track content display area according to an embodiment of the present application;
FIG. 7 is a diagram illustrating an example of a first processor acquiring a display position of a track content display area according to an embodiment of the present application;
FIG. 8 is a diagram illustrating an example of a first processor acquiring a display position of a track content display area according to an embodiment of the present application;
FIG. 9 is a schematic diagram of a display system according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented in other sequences than those illustrated herein.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without any inventive effort, are intended to be within the scope of the application.
The display method provided by the embodiment of the application can be used in electronic equipment, and the electronic equipment is provided with a touch display device, such as a liquid crystal touch screen or an electronic ink screen, and the display area (marked as a first display area) of the touch display device can display content and detect the operation track of an operation body. The electronic device has a first processor and a second processor, wherein,
When the operation body performs touch operation in the first display area, the first display area can detect track data (marked as first track data) of the operation body, and the first display area sends the first track data to the first processor, so that the first processor responds to the first track data to obtain first track content, and the first track content is displayed through the first display area.
The first display area or the first processor can send the first track data to the second processor, so that the second processor responds to the first track data to obtain second track content, and updates the first track content displayed in the first display area with the second track content (for example, the second processor sends the second track content to the first processor to instruct the first processor to update the first track content displayed in the first display area to the second track content).
Optionally, the second processor may collect an image of the operation body through the image collecting device, and obtain the first track data of the operation body by processing the collected image, based on which the second processor may project the second track content to the first display area through the projection device.
In the prior art, when the first track content is displayed, there may be a case that part of the track content in the first track content is not in the track content display area of the interactive window, and when the first track content is updated by the second track content, the part of the track content not in the track content display area of the interactive window may disappear, so that the intelligence is poor, and the input experience of the user is poor. To overcome this problem, the present application has been proposed:
the first processor responds to the first track data of the operation body detected based on the first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is positioned in a track content display area in the interactive window displayed in the first display area;
The second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by using the second track content; the second track content is positioned in the track content display area;
The first processor also obtains the display position of the track content display area, so that the first processor can respond to the track data of the operation body detected by the first display area according to the display position of the track content display area to obtain the track content only displayed in the track content display area.
The first processor may obtain a display position of the track content display area prior to responding to the first track data; or alternatively
The first processor may determine the display position of the track content display area after the second processor responds to the first track data, for example, according to a track change condition after the second track content updates the first track content, determining the display position of the track content display area.
Specific implementations may refer to the following.
Optionally, as shown in fig. 1, a flowchart for implementing the display method provided in the embodiment of the present application may include:
step S101: the first processor obtains the display position of the track content display area in the interactive window displayed in the first display area.
Optionally, the first processor may receive the display position of the track content display area sent by the second processor; or alternatively
The first processor may analyze the interactive window to obtain a display position of the track content display area.
Step S102: the first processor responds track data positioned in the display position in the first track data to be first track content, and the first track content is displayed through a first display area;
The first track content is located entirely in the track content display area in the interactive window displayed in the first display area.
Fig. 2 is an exemplary diagram of a user operating an interactive window displayed in a first display area according to an embodiment of the present application. In this example, the first display area displays an interactive window of drawing software, the track content display area in the interactive window is a rectangular area with four points P1, P2, P3 and P4 as vertexes in the drawing, and the operation body (i.e. the finger of the user) moves from point a to point B of the first display area to execute linear motion, so according to the embodiment of the application, the first track content is a straight line segment from a to C as shown in fig. 2. In the prior art, the first track content is a straight line segment from a to B as shown in fig. 2.
Step S103: the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by using the second track content; the second track content is located in the track content display area of the interactive window.
In the embodiment of the application, the application software to which the interactive window belongs runs on the second processor, so that the second processor can know the display position of the track content display area of the interactive window, and can respond to the track data positioned in the display position only to obtain the second track content positioned in the track content display area of the interactive window.
The second track content is identical to the first track content. Also taking the scenario shown in fig. 2 as an example, the second track content is also a straight line segment from a to C.
And after obtaining the second track content, the second processor displays the second track content through the first display area, namely, updates the first track content into the second track content.
According to the display method provided by the embodiment of the application, the first processor can obtain the display position of the track content display area in the interactive window displayed in the first display area, so that the first processor can only respond to the track data in the track content display area when responding to the first track data detected by the first display area, obtain the first track content only in the track content display area, and the track content outside the track content display area can not appear, and further, when the second processor updates the first track content by using the second track content, the condition that the track content outside the track content display area disappears can not appear, thereby improving the intelligence of the display method and improving the user experience.
In an alternative embodiment, in a case where the first processor may receive the display position of the track content display area sent by the second processor, the second processor may acquire the display position of the track content display area by:
The second processor reads the display position of the track content display area through an interface provided by an application program to which the interactive window belongs. The application to which the interactive window belongs is aware of the display position of the track content display area in the first display area, and thus, if the application to which the interactive window belongs provides an access interface, the second process can read the display position of the track content display area through the access interface.
Or alternatively
The second processor analyzes the interactive window and determines a display position of the track content display area.
In an alternative embodiment, the first processor analyzes the interactive window, and the process of determining the display position of the track content display area is the same as the process of analyzing the interactive window by the second processor, and the process of determining the display position of the track content display area is the same, where the second processor may send the interactive window to the first processor, so that the first processor may analyze the interactive window. The following describes a specific implementation process of analyzing an interactive window, and a flowchart of an implementation of analyzing an interactive window provided in an embodiment of the present application is shown in fig. 3, and may include:
Step S301: enumerating all sub-windows of the interactive window to screen out at least one target sub-window; the target sub-window is a sub-window having an area greater than a threshold.
Alternatively, to reduce data throughput for example, only all visible sub-windows of the interactive window may be enumerated.
As an example, the target sub-window may be a visible sub-window having an area at least greater than half the area of the interactive window.
Alternatively, if a child window is not enumerated, the interactive window may be directly taken as the target child window.
Step S302: detecting a track content display area of the first target sub-window to judge whether the track content display area exists in the first target sub-window; the first target sub-window is any one target sub-window.
Alternatively, the track content display area is generally a rectangular area, so it may be detected whether a rectangular area satisfying the condition exists in the first target sub-window, and if the rectangular area exists, the display position of the rectangular area is the display position of the track content display area if the rectangular area is determined to be the track content display area.
Step S302: if the judgment result is yes, the display position of the track content display area is determined.
In an alternative embodiment, a flowchart of an implementation of the track content display area detection on the first target sub-window as shown in fig. 4 may include:
Step S401: and searching the same-color rectangular areas at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area.
Alternatively, four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area may be used as initial positions, each initial position is provided with a rectangular frame, and in each initial position, one vertex angle of the rectangular frame coincides with one vertex angle of the first target sub-window area. As an example, the size of the rectangular frame may be a square frame with a size of 1cm×1cm, and it is determined whether the four rectangular areas at the initial position in the first target sub-window area are of the same color, if so, step S402 is performed, otherwise, the positions of the four rectangular frames are adjusted, it is determined whether the four rectangular areas after the adjustment of the positions are of the same color, if so, step S402 is performed, otherwise, the step of adjusting the positions of the four rectangular frames is performed again until the four rectangular areas of the same color are found, or the first target sub-window area is traversed.
Optionally, the adjusting the positions of the four rectangular frames may include:
Moving at least one rectangular frame of the four rectangular frames to a direction approaching to the center of the first target sub-window area by a preset step length; wherein moving in a direction near the center of the first target sub-window area may include, but is not limited to, the following: moving a first preset step length parallel to a first edge of a first target sub-window area; moving a second preset step length parallel to a second edge of the first target sub-window area; moving a third preset step along the diagonal of the first target sub-window area; wherein the first side and the second side are perpendicular to each other.
The first preset step size, the second preset step size and the third preset step size can be the same or different.
Step S402: if N rectangular areas in the same-color rectangular areas at the four positions are positioned at N vertex angle positions of the same target rectangle (marked as a first target rectangle), searching the same-color right-angle triangle areas at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area; n is a positive integer greater than 2, i.e., N is equal to 3 or 4; the sum of the two right angle sides of each right angle triangle area is larger than the sum of the adjacent two right angle sides in the rectangular area.
The N vertex angle positions of the N rectangular areas in the same target rectangle means that each rectangular area in the N rectangular areas has a vertex angle coincident with the vertex angle of the same rectangle (the rectangle is referred to as the target rectangle).
When searching the same-color right triangle areas at the leftmost upper, upper right, lower left and lower right positions in the first target sub-window area, the leftmost upper, upper right, lower left and lower right positions in the first target sub-window area can be used as initial positions, a right triangle frame is placed at each initial position, and the right angle vertex angle of the right triangle frame coincides with one vertex angle of the first target sub-window area at each initial position. Judging whether the four right triangle areas at the initial position in the first target sub-window area are of the same color, if so, executing step S403, otherwise, adjusting the positions of the four right triangle frames, judging whether the four right triangle areas after the adjustment are of the same color, if so, executing step S403, otherwise, returning to execute the step of adjusting the positions of the four right triangle frames until the four right triangle areas of the same color are found, or completing the traversal of the first target sub-window area.
As an example, the two right angle sides of a right triangle frame may be 1cm and 2cm, respectively.
As an example, the two right angle sides of a right triangle frame may be 1.5cm and 1.5cm, respectively.
Optionally, the adjusting the positions of the four right triangle frames may include:
Moving at least one right triangle frame of the four right triangle frames to a direction approaching to the center of the first target sub-window area by a preset step length; wherein moving in a direction near the center of the first target sub-window area may include, but is not limited to, the following: moving a first preset step length parallel to a first edge of a first target sub-window area; moving a second preset step length parallel to a second edge of the first target sub-window area; moving a third preset step along the diagonal of the first target sub-window area; wherein the first side and the second side are perpendicular to each other.
The first preset step size, the second preset step size and the third preset step size can be the same or different.
Step S403: if N right triangle areas in the same color right triangle areas at the four positions are positioned at N vertex angle positions of the target rectangle, determining the area where the target rectangle is positioned as a track content display area.
That is, if N right triangle areas in the same color right triangle areas of the four positions are located in the same target rectangle and the target rectangle is the first target rectangle, it may be determined that the area where the first target rectangle is located is the track content display area.
In an alternative embodiment, a flowchart of an implementation of the track content display area detection on the first target sub-window as shown in fig. 5 may include:
step S501: and searching the same-color rectangular areas at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area.
The specific implementation process may refer to step S401, and will not be described herein.
Step S502: if N rectangular areas in the same-color rectangular areas at the four positions are positioned at N vertex angle positions of the same target rectangle, judging whether right triangle areas at the four vertex angles of the target rectangular areas are the same-color right triangle areas or not; n is a positive integer greater than 2; the sum of the two right angle sides of each right angle triangle area is larger than the sum of the adjacent two right angle sides in the rectangular area.
And placing a right triangle at each of four vertex angles of the target rectangular area, wherein the right vertex angle of each right triangle coincides with one vertex angle of the target rectangular area.
Step S503: if the determination result is yes, determining the area where the target rectangle is located as the track content display area.
If at least three right triangle areas in the four right triangle areas are the same-color right triangle areas, the area where the target rectangle is located can be determined to be the track content display area.
Compared with the embodiment shown in fig. 4, in the embodiment of the application, the 4 same-color right triangle areas are not searched any more, and whether the four right triangle areas at the four vertex angles of the target rectangle are the same-color right triangle areas is directly judged, so that the data processing workload is reduced, and the display efficiency is further improved.
In an optional embodiment, the first processor may obtain the second track content in response to the first track data by the second processor, and obtain the display position of the track content display area in the interactive window displayed in the first display area after updating the first track content displayed in the first display area with the second track content.
Optionally, a flowchart of an implementation of the first processor to obtain the display position of the track content display area according to the embodiment of the present application is shown in fig. 6, and may include:
step S601: the first processor determines whether the first track content is different from the second track content.
The first processor may record the position of the first track content, and after updating the first track content with the second track content, determine whether the position of the first track content still has the first track content, and if not, indicate that the first track content is different from the second track content.
Step S602: and if the judgment result is yes, determining the display position of the track content display area according to the second track content and the part of the second track content which is lack of the first track content.
If the first track content is different from the second track content, the missing part of the second track content relative to the first track content and the second track content can be spliced to obtain the first track content, and the splicing point is a point on the boundary of the track content display area, and the boundary of the track content display area is perpendicular or parallel to the boundary of the interactive window, based on the splicing point, and at least part of the boundary of the track content display area and the boundary of the interactive window can be determined.
As shown in fig. 7, an exemplary diagram of a display position of a track content display area is obtained by a first processor according to an embodiment of the present application, in this example, a user may first draw a straight line in a direction shown by D '-E' in a first display area through an operation body, two ends of the straight line are located outside the track content display area, then the first processor responds to track data on D '-E' detected in the first display area to obtain track content shown by D '-E', and the second processor responds to track data on D '-E' to obtain track content shown by D-E, so that the first processor compares the track content shown by D '-E' with the track content shown by D-E to obtain splice points D and E, the user can also draw a straight line in the direction shown by F '-G' in the first display area through the operation body, wherein the two ends of the straight line are positioned outside the track content display area, then the first processor responds to the track data on F '-G' detected by the first display area to obtain the track content shown by F '-G', the second processor responds to the track data on F '-G' to obtain the track content shown by F-G, therefore, the first processor compares the track content shown by F '-G' with the track content shown by F-G to obtain splice points F and G, then the first processor can make a straight line parallel to F-G at the point D, make a straight line parallel to F-G at the point E, make a straight line parallel to D-E at the point F, make a straight line parallel to D-E at the point G, so that at D, E, F, the rectangular area formed by the four straight lines of G is the track content display area.
As shown in fig. 8, in an example of obtaining a display position of a track content display area by using the first processor provided in the embodiment of the present application, a user may draw four straight lines in a "well" shape in the first display area through an operation body, where each set includes two sets of straight lines that are perpendicular to each other, based on the foregoing method, two intersecting points of each straight line and a boundary of the track content display area may be determined, as shown in fig. 8, four straight lines obtain 8 intersecting points, which are H, D, J, F, E, I, G, K, and two intersecting points that have the same coordinates of one dimension but do not belong to one straight line are determined as two points located at the same boundary of the track content display area, for example, H, D is two points at the same boundary of the track content display area, J, F is two points at the same boundary of the track content display area, E, I is two points at the same boundary of the track content display area, G, K is two points at the same boundary of the track content display area, H, D is a straight line, 5224 is a straight line, and 6283 is a straight line of the track content display area.
In the embodiments shown in fig. 7 and fig. 8, the application program where the interactive window is located may be opened by the user, so that after the application program presents the interactive window, the line drawing operation shown in fig. 7 or fig. 8 is performed in the first display area, so that the first processor may determine the track content display area according to the track data of the operation.
In another embodiment, the user may directly perform handwriting input in the first display area according to the user's own needs without performing the line drawing operation, where the handwriting input track data may be located in the track content display area, or located in a position outside the track content display area. And responding the track data to the first track content and displaying the first track content after the track data of the operation body is detected by the first processor every time, and after responding the track data by the second processor to obtain the second track content and updating the track content obtained by the first processor, recording the determined splicing point after each updating, and carrying out statistical analysis on the splicing points obtained by multiple operations to obtain a track content display area.
In an optional embodiment, the display method provided by the embodiment of the application may further include:
The second processor determines the distance of the track content display area to the respective edges of the interactive window.
If the position of the interactive window is determined to change, updating the display position of the track content display area according to the distance and the changed display position of the interactive window.
After the position of the interactive window is changed, the display position of the track content display area is correspondingly changed.
And sending the display position of the updated track content display area to the second processor.
Alternatively, the first processor may be a processor for refreshing the first display area, for example, a driver chip of the touch display device. The second processor may be a processor for determining display content, for example, may be a central processing unit CPU.
Alternatively, the first processor and the second processor may communicate via a serial bus interface, or may communicate via a Windows management tool (Windows Management Instrumentation, WMI).
Corresponding to the method embodiment, the embodiment of the application also provides a display system, and a schematic structural diagram of the display system provided by the embodiment of the application is shown in fig. 9, which may include:
a first processor 901 and a second processor 902; wherein,
The first processor 901 is configured to respond to first trajectory data of an operation body detected based on a first display area as first trajectory content, and display the first trajectory content through the first display area; at least part of the first track content is positioned in a track content display area in the interactive window displayed in the first display area;
The second processor 902 is configured to respond to the first track data, obtain a second track content, and update the first track content displayed in the first display area with the second track content; the second track content is positioned in the track content display area;
The first processor 901 is further configured to obtain a display position of the track content display area.
According to the display system provided by the embodiment of the application, the first processor can obtain the display position of the track content display area in the interactive window displayed in the first display area, so that the first processor can only respond to the track data in the track content display area when responding to the first track data detected by the first display area, obtain the first track content only in the track content display area, and the track content outside the track content display area can not appear, and further, when the second processor updates the first track content by using the second track content, the condition that the track content outside the track content display area disappears can not appear, the intelligence of the display method is improved, and the user experience is improved.
In an alternative embodiment, the first processor is configured to, when acquiring the display position of the track content display area:
Receiving a display position of the track content display area sent by the second processor; or alternatively
Analyzing the interactive window to obtain the display position of the track content display area;
The first processor is configured to, when responding to first trajectory data of the operation body detected based on the first display area as first trajectory content:
and responding the track data positioned in the display position in the first track data to be the first track content.
In an alternative embodiment, the second processor is configured to, when acquiring the display position of the track content display area:
reading the display position of the track content display area through an interface provided by an application program to which the interactive window belongs; or alternatively
And analyzing the interactive window to determine the display position of the track content display area.
In an alternative embodiment, when the first processor or the second processor analyzes the interactive window, the method is used for:
Enumerating all sub-windows of the interactive window to screen out at least one target sub-window; the target sub-window is a sub-window with the area larger than a threshold value;
detecting a track content display area of a first target sub-window to judge whether the track content display area exists in the first target sub-window; the first target sub-window is any target sub-window;
and if the judgment result is yes, determining the display position of the track content display area.
In an optional embodiment, when the first processor or the second processor detects the track content display area of the first target sub-window, the first processor is configured to:
Searching the same-color rectangular area at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area;
If N rectangular areas in the same-color rectangular areas at the four positions are positioned at N vertex angle positions of the same target rectangle, searching the same-color right triangle area at the four positions of the leftmost upper part, the rightmost upper part, the leftmost lower part and the rightmost lower part in the first target sub-window area; the N is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangle area is larger than the sum of two adjacent right-angle sides in the rectangular area;
And if N right triangle areas in the same color right triangle areas at the four positions are positioned at N vertex angle positions of the target rectangle, determining the area where the target rectangle is positioned as a track content display area.
In an optional embodiment, when the first processor or the second processor detects the track content display area of the first target sub-window, the first processor is configured to:
Searching for the same-color rectangular areas at the four positions of the upper left, the upper right, the lower left and the lower right in the first target sub-window area;
If N rectangular areas in the same-color rectangular areas at the four positions are positioned at N vertex angle positions of the same target rectangle, judging whether right triangle areas at four vertex angles of the target rectangular areas are same-color right triangle areas or not; the N is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangle area is larger than the sum of two adjacent right-angle sides in the rectangular area;
and if the judgment result is yes, determining the area where the target rectangle is located as a track content display area.
In an alternative embodiment, the first processor is configured to, when acquiring the display position of the track content display area:
Judging whether the first track content is different from the second track content;
And if the judgment result is yes, determining the display position of the track content display area according to the second track content and the part of the second track content which is lack of the first track content.
In an alternative embodiment, the second processor is further configured to:
Determining the distance from the track content display area to each edge of the interactive window;
if the position of the interactive window is determined to change, updating the display position of the track content display area according to the distance and the changed display position of the interactive window;
And sending the updated display position of the track content display area to the first processor.
In an alternative embodiment, the first processor is a processor for refreshing the first display area, and the second processor is a processor for determining display content.
Corresponding to the method embodiment, the application further provides an electronic device, and a schematic structural diagram of the electronic device is shown in fig. 10, which may include: at least two processors (processor 11, processor 12), at least one communication interface 2, at least one memory 3, at least one communication bus 4 and at least one touch-sensitive display device 5;
the processor 11, the processor 12, the communication interface 2, the memory 3 and the touch display device 5 can complete communication with each other through the communication bus 4;
The processor 11 may be a driving chip of the touch display device; the processor 12 may be a central processing unit CPU, or an Application-specific integrated Circuit ASIC (Application SPECIFIC INTEGRATED Circuit), or one or more integrated circuits configured to implement embodiments of the present application, etc.;
the memory 3 may comprise a high-speed RAM memory, and may further comprise a non-volatile memory (non-volatile memory) or the like, such as at least one magnetic disk memory;
wherein the memory 3 stores a program, and the processor 11 and the processor 12 can call the program stored in the memory 3, the program being for:
The first processor responds to first track data of the operation body detected based on a first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is positioned in a track content display area in the interactive window displayed in the first display area;
The second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by using the second track content; the second track content is positioned in the track content display area;
The method further comprises the steps of:
The first processor obtains a display position of the track content display area.
Alternatively, the refinement function and the extension function of the program may be described with reference to the above.
The embodiment of the present application also provides a storage medium storing a program adapted to be executed by a processor, the program being configured to:
The first processor responds to first track data of the operation body detected based on a first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is positioned in a track content display area in the interactive window displayed in the first display area;
The second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by using the second track content; the second track content is positioned in the track content display area;
The method further comprises the steps of:
The first processor obtains a display position of the track content display area.
Alternatively, the refinement function and the extension function of the program may be described with reference to the above.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the several embodiments provided by the present application, it should be understood that the disclosed systems and methods may be implemented in other ways. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
It should be understood that in the embodiments of the present application, the claims, the various embodiments, and the features may be combined with each other, so as to solve the foregoing technical problems.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A display method, the method comprising:
the method comprises the steps that a first processor obtains the display position of a track content display area in an interactive window displayed in a first display area, responds track data in the display position in the first track data to be first track content based on first track data of an operation body detected by the first display area, and displays the first track content through the first display area; the first track content is positioned in the track content display area;
and the second processor responds to the first track data to obtain second track content, and sends the second track content to the first processor so as to instruct the first processor to update the first track content displayed in the first display area into the second track content.
2. The method of claim 1, the first processor obtaining a display position of a track content display area in an interactive window displayed in a first display area, comprising:
The first processor receives the display position of the track content display area sent by the second processor; or alternatively
And the first processor analyzes the interactive window to obtain the display position of the track content display area.
3. The method of claim 2, the second processor obtaining a display position of the track content display area, comprising:
The second processor reads the display position of the track content display area through an interface provided by an application program to which the interactive window belongs; or alternatively
And the second processor analyzes the interactive window and determines the display position of the track content display area.
4. A method according to claim 2 or 3, the process of analysing the interactive window comprising:
Enumerating all sub-windows of the interactive window to screen out at least one target sub-window; the target sub-window is a sub-window with the area larger than a threshold value;
detecting a track content display area of a first target sub-window to judge whether the track content display area exists in the first target sub-window; the first target sub-window is any target sub-window;
and if the judgment result is yes, determining the display position of the track content display area.
5. The method of claim 4, wherein the detecting the track content display area for the first target sub-window comprises:
Searching the same-color rectangular area at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area;
If N rectangular areas in the same-color rectangular areas at the four positions are positioned at N vertex angle positions of the same target rectangle, searching the same-color right triangle area at the four positions of the leftmost upper part, the rightmost upper part, the leftmost lower part and the rightmost lower part in the first target sub-window area; the N is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangle area is larger than the sum of two adjacent right-angle sides in the rectangular area;
And if N right triangle areas in the same color right triangle areas at the four positions are positioned at N vertex angle positions of the target rectangle, determining the area where the target rectangle is positioned as a track content display area.
6. The method of claim 4, wherein the detecting the track content display area for the first target sub-window comprises:
Searching for the same-color rectangular areas at the four positions of the upper left, the upper right, the lower left and the lower right in the first target sub-window area;
If N rectangular areas in the same-color rectangular areas at the four positions are positioned at N vertex angle positions of the same target rectangle, judging whether right triangle areas at four vertex angles of the target rectangular areas are same-color right triangle areas or not; the N is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangle area is larger than the sum of two adjacent right-angle sides in the rectangular area;
and if the judgment result is yes, determining the area where the target rectangle is located as a track content display area.
7. The method of claim 1, the first processor obtaining a display position of a track content display area in an interactive window displayed in a first display area, comprising:
The first processor judges whether the first track content is different from the second track content;
And if the judgment result is yes, determining the display position of the track content display area according to the second track content and the part of the second track content which is lack of the first track content.
8. The method of claim 1, further comprising:
The second processor determines distances of the track content display area to respective edges of the interactive window;
if the position of the interactive window is determined to change, updating the display position of the track content display area according to the distance and the changed display position of the interactive window;
And sending the updated display position of the track content display area to the first processor.
9. The method of any of claims 1-3, 5-8, the first processor being a processor for refreshing the first display area, the second processor being a processor for determining display content.
10. A display system, comprising:
The first processor is used for acquiring the display position of a track content display area in the interactive window displayed in the first display area, responding track data in the display position in the first track data to be first track content based on the first track data of the operation body detected in the first display area, and displaying the first track content through the first display area; the first track content is positioned in the track content display area;
and the second processor is used for responding to the first track data to obtain second track content, and sending the second track content to the first processor so as to instruct the first processor to update the first track content displayed in the first display area into the second track content.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111136473.0A CN113835609B (en) | 2021-09-27 | 2021-09-27 | Display method, system, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111136473.0A CN113835609B (en) | 2021-09-27 | 2021-09-27 | Display method, system, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113835609A CN113835609A (en) | 2021-12-24 |
| CN113835609B true CN113835609B (en) | 2024-07-26 |
Family
ID=78970846
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111136473.0A Active CN113835609B (en) | 2021-09-27 | 2021-09-27 | Display method, system, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113835609B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108475178A (en) * | 2017-04-21 | 2018-08-31 | 深圳市柔宇科技有限公司 | Head-mounted display apparatus and its content input method |
| CN110134261A (en) * | 2019-05-22 | 2019-08-16 | 贵州大学 | An electronic pen that restores real writing |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6136967B2 (en) * | 2014-02-06 | 2017-05-31 | ソニー株式会社 | Information processing system, information processing method, and program |
| CN112783408A (en) * | 2021-01-28 | 2021-05-11 | 维沃移动通信有限公司 | Gesture navigation method and device of electronic equipment, equipment and readable storage medium |
-
2021
- 2021-09-27 CN CN202111136473.0A patent/CN113835609B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108475178A (en) * | 2017-04-21 | 2018-08-31 | 深圳市柔宇科技有限公司 | Head-mounted display apparatus and its content input method |
| CN110134261A (en) * | 2019-05-22 | 2019-08-16 | 贵州大学 | An electronic pen that restores real writing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113835609A (en) | 2021-12-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7248177B2 (en) | Information processing system, information processing method, and program | |
| JP7279738B2 (en) | OBJECT DETECTION DEVICE, OBJECT DETECTION METHOD AND PROGRAM | |
| US8098879B2 (en) | Information processing device, image movement instructing method, and information storage medium | |
| CN103365599B (en) | Mobile terminal operation optimization method and device based on screen sliding track | |
| CN112885130B (en) | Method and device for presenting road information | |
| CN102163108B (en) | Method and device for identifying multiple touch points | |
| CN101685497B (en) | Method and device for processing hand-written information | |
| CN103488356A (en) | Infrared camera three-dimensional imaging-based touch recognition method | |
| CN103885685A (en) | Method and device for processing pages | |
| US20160378336A1 (en) | Terminal device, display control method, and non-transitory computer-readable recording medium | |
| JP2015158900A (en) | Information processing device, information processing method and information processing program | |
| CN110740315B (en) | Camera correction method and device, electronic equipment and storage medium | |
| CN112306235A (en) | Gesture operation method, device, equipment and storage medium | |
| CN114663902B (en) | Document image processing method, device, equipment and medium | |
| US20100215287A1 (en) | Methods and devices for detecting changes in background of images using multiple binary images thereof and hough transformation | |
| CN113835609B (en) | Display method, system, electronic device and storage medium | |
| EP3125089B1 (en) | Terminal device, display control method, and program | |
| CN113673214B (en) | Information list alignment method and device, storage medium and electronic equipment | |
| JP2018067298A (en) | Handwritten content editing apparatus and handwritten content editing method | |
| EP3125088B1 (en) | Terminal device, display control method, and program | |
| EP3051401B1 (en) | Image display apparatus, image enlargement method, and image enlargement program | |
| CN110737417B (en) | Demonstration equipment and display control method and device of marking line of demonstration equipment | |
| KR101401720B1 (en) | Application execution device and method for Multi-monitor system | |
| CN104281381B (en) | The device and method for controlling the user interface equipped with touch screen | |
| CN103279219A (en) | Method and system for moving cursor of touch screen device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |