CN118057333A - Acceptance method, device, equipment and storage medium for user interface design - Google Patents

Abstract

The embodiment of the application provides a user interface design acceptance method, device, equipment and storage medium, which are used for arranging a view detection function in an application program, so that a layer to be detected is obtained at terminal equipment, and UI acceptance flexibility is improved. Comprising the following steps: constructing CALayer a rendering pipeline, and drawing a user interface image to be detected by using the rendering pipeline; controlling the moving cursor to move to a first position of the user interface image to be detected, and determining a first action range of the detection floating layer according to the first position; acquiring a first layer set from the layer set to be detected according to a first action range by utilizing the detection floating layer; searching from the first layer set to obtain a first layer to be detected; and comparing the layer to be detected with the standard layer to obtain an acceptance result. The technical scheme provided by the application can be applied to the scenes of cloud technology, artificial intelligence, intelligent traffic, internet of vehicles and the like.

Description

User interface design acceptance method, device, equipment and storage medium

Technical Field

The present application relates to the computer field, and in particular to a user interface design acceptance method, device, equipment and storage medium.

Background technique

With the development of science and technology, more and more platforms have launched self-developed applications. In order to ensure that the developed user interface (UI) restores the UI design scheme given in the design draft as much as possible, UI design acceptance has become a key link in the application development process.

Under related technologies, when conducting UI design acceptance, it is usually necessary to take a screenshot of the image to be tested, then send it to the acceptance platform, and then rely on the UI designer to complete the human eye identification. This makes the UI acceptance method inflexible and often cannot keep up with the rapid iteration and update of Internet products.

Therefore, there is an urgent need for a UI acceptance method that can improve the flexibility of UI acceptance.

Summary of the invention

The embodiments of the present application provide a user interface design acceptance method, apparatus, device and storage medium for building a view detection function into an application program, so as to obtain a layer to be detected on a terminal device, thereby improving the flexibility of UI acceptance.

In view of this, on the one hand, the present application provides an acceptance method for user interface design, including: constructing a CALayer rendering pipeline, and using the rendering pipeline to draw a user interface image to be detected, the user interface image to be detected includes a layer set to be detected, and the layer set to be detected constitutes multiple layer tree structures; controlling a moving cursor to move to a first position of the user interface image to be detected, and determining a first range of action of a detection floating layer according to the first position, the moving cursor is used to be moved on the interface where the user interface image to be detected is located, the detection floating layer is used to determine the range of obtaining the layer to be detected in the user interface image to be detected based on the position of the moving cursor, the detection floating layer and the moving cursor are constructed based on the rendering pipeline; using the detection floating layer to obtain a first layer set from the layer set to be detected according to the first range of action; searching for a first layer to be detected from the first layer set; comparing the layer to be detected with the standard layer to obtain an acceptance result.

Another aspect of the present application provides a user interface acceptance device, comprising:

A generation module is used to construct a CALayer rendering pipeline and use the rendering pipeline to draw a user interface image to be detected, wherein the user interface image to be detected includes a layer set to be detected, and the layer set to be detected constitutes a plurality of layer tree structures;

A determination module, used for controlling a moving cursor to move to a first position of the user interface image to be detected, and determining a first action range of a detection floating layer according to the first position, wherein the moving cursor is used to be moved on the interface where the user interface image to be detected is located, and the detection floating layer is used to determine a range of obtaining a layer to be detected in the user interface image to be detected based on the position of the moving cursor, and the detection floating layer and the moving cursor are constructed based on the rendering pipeline;

An acquisition module, used for acquiring a first layer set from the to-be-detected layer set according to the first action range by using the detection floating layer;

A search module, used for searching for a first layer to be detected from the first layer set;

The acceptance module is used to compare the layer to be tested with the standard layer to obtain an acceptance result.

In a possible design, in another implementation of another aspect of the embodiment of the present application, the generating module is specifically used to obtain context information of the user interface image to be detected by using the rendering pipeline, where the context information includes view data of the user interface image to be detected, a view life cycle, position information of each view in the user interface image to be detected relative to the user interface image to be detected, and state information of the user interface image to be detected;

Generate a set of layers to be detected according to the context information using the rendering pipeline;

The rendering pipeline is used to generate a corresponding layer tree structure for the layer set to be detected, and the user interface image to be detected is obtained according to the layer tree structure.

In one possible design, in another implementation of another aspect of the embodiment of the present application, the search module is specifically used to search for the first layer to be detected from the first layer set using a breadth-first search algorithm.

In a possible design, in another implementation of another aspect of the embodiment of the present application, the search module is specifically used to perform pixel point scanning on each layer in the first layer set based on the root node layer in the first layer set to generate multiple layer tree structures corresponding to the first layer set, and generate multiple task queues according to the multiple layer tree structures, wherein each layer tree structure corresponds to a task queue;

According to the queue processing rules, the class information of the layer nodes in each task queue is identified in turn. The class information is used to describe the properties and methods of the layer nodes.

When it is determined that the information of this type exists in the common class matching template, the layer node corresponding to the information of this type is determined to be a layer node that does not need to be accepted, and the state of the layer node corresponding to the information of this type and its corresponding layer subnode is set to a marked state;

When it is determined that the information of this type does not exist in the common class matching template, the layer nodes corresponding to the information of this type are classified into a second layer node set, and the state of each layer node in the second layer node set is set to an accessed state;

Acquire a third layer node set from the second layer node set according to the first position of the moving cursor;

The first layer to be detected is obtained from the third layer node set.

In a possible design, in another implementation of another aspect of the embodiment of the present application, the acquisition module is further used to acquire a first data information set of each layer node in the second layer node set;

The generating module is further used to create a first pop-up window with the detection floating layer as the root view;

The device also includes a display module, which is used to select data information corresponding to the third layer node set from the first data information set and display it in the first pop-up window.

In one possible design, in another implementation of another aspect of the embodiment of the present application, the device also includes a storage module for caching the first data information set to a storage medium corresponding to the detection floating layer.

In a possible design, in another implementation of another aspect of the embodiment of the present application, the determination module is further used to control the moving cursor to move to a second position, and obtain a fourth layer node set corresponding to the second position;

The device also includes a reading module, which is used to read data information corresponding to the fourth layer set from the first data information set of the detection floating layer cache when there is a layer node included in the second layer node set in the fourth layer node set;

The generating module is further used to create a second pop-up window with the detection floating layer as the root view;

The device also includes a display module, which is used to display the data information corresponding to the fourth layer node set in the second pop-up window.

Another aspect of the present application provides a computer device, including: a memory, a processor, and a bus system;

Wherein, the memory is used to store programs;

The processor is used to execute the program in the memory, and the processor is used to execute the above-mentioned methods according to the instructions in the program code;

The bus system is used to connect the memory and the processor so that the memory and the processor can communicate with each other.

Another aspect of the present application provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer is enabled to execute the above-mentioned methods.

Another aspect of the present application provides a computer program product or a computer program, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided by the above aspects.

It can be seen from the above technical scheme that the embodiments of the present application have the following advantages: a CALayer rendering pipeline is constructed within the application, and then the user interface image to be detected is drawn according to the CALayer rendering pipeline, and the layer to be detected is obtained through the moving cursor constructed by the CALayer rendering pipeline and the detection floating layer, so that the terminal running the application can obtain the layer to be detected, and implement the acceptance process according to the layer to be detected, without having to interact with a third-party acceptance platform for data, thereby improving the flexibility of user interface acceptance.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of an application scenario of the acceptance method for user interface design in an embodiment of the present application;

FIG2 is a schematic diagram of an embodiment of a method for accepting user interface design in an embodiment of the present application;

FIG3 is a schematic diagram of a process of drawing a user interface image to be detected based on a CALayer rendering pipeline in an embodiment of the present application;

FIG4 is a schematic diagram of an interface of a user interface image to be detected drawn based on a CALayer rendering pipeline in an embodiment of the present application;

FIG5 is another interface schematic diagram of a user interface image to be detected drawn based on a CALayer rendering pipeline in an embodiment of the present application;

FIG6 is another interface schematic diagram of a user interface image to be detected drawn based on a CALayer rendering pipeline in an embodiment of the present application;

FIG7 is another interface schematic diagram of a user interface image to be detected drawn based on a CALayer rendering pipeline in an embodiment of the present application;

FIG8 is another interface schematic diagram of a user interface image to be detected drawn based on a CALayer rendering pipeline in an embodiment of the present application;

FIG9 is a schematic diagram of a layer search process based on a breadth-first search algorithm in an embodiment of the present application;

FIG9a is a schematic diagram of an interface showing data information of a layer to be detected in an embodiment of the present application;

FIG10 is a schematic diagram of an embodiment of a user interface acceptance device in an embodiment of the present application;

FIG10a is a schematic diagram of another embodiment of the user interface acceptance device in the embodiment of the present application;

FIG10b is a schematic diagram of another embodiment of the user interface acceptance device in the embodiment of the present application;

FIG10c is a schematic diagram of another embodiment of the user interface acceptance device in the embodiment of the present application;

FIG11 is a schematic diagram of another embodiment of the user interface acceptance device in the embodiment of the present application;

FIG. 12 is a schematic diagram of another embodiment of the user interface acceptance device in the embodiment of the present application.

Detailed ways

The embodiments of the present application provide a user interface design acceptance method, apparatus, device and storage medium for building a view detection function into an application program, so as to obtain a layer to be detected on a terminal device, thereby improving the flexibility of UI acceptance.

The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "corresponding to" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

With the development of science and technology, more and more platforms have launched self-developed applications. In order to ensure that the developed UI restores the UI design scheme given in the design draft as much as possible, UI design acceptance has become a key link in the application development process. Under related technologies, when conducting UI design acceptance, it is usually necessary to take a screenshot of the image to be detected, then send it to the acceptance platform, and then rely on the UI designer to complete the human eye recognition. This makes the UI acceptance method not flexible enough and often cannot keep up with the pace of rapid iteration and update of Internet products. Therefore, there is an urgent need for a UI acceptance method that can improve the flexibility of UI acceptance.

In order to solve the above technical problems, the present application provides the following technical solutions: constructing a CALayer rendering pipeline, and using the rendering pipeline to draw a user interface image to be detected, the user interface image to be detected includes a layer set to be detected, and the layer set to be detected constitutes multiple layer tree structures; controlling a moving cursor to move to a first position of the user interface image to be detected, and determining a first range of action of a detection floating layer according to the first position, the moving cursor is used to be moved on the interface where the user interface image to be detected is located, the detection floating layer is used to determine the range of obtaining the layer to be detected in the user interface image to be detected based on the position of the moving cursor, the detection floating layer and the moving cursor are constructed based on the rendering pipeline; using the detection floating layer to obtain a first layer set from the layer set to be detected according to the first range of action; searching for a first layer to be detected from the first layer set; comparing the layer to be detected with the standard layer to obtain an acceptance result. In this way, a CALayer rendering pipeline is constructed within the application, and then the user interface image to be detected is drawn according to the CALayer rendering pipeline, and the layer to be detected is obtained through the moving cursor constructed by the CALayer rendering pipeline and the detection floating layer, so that the terminal running the application can obtain the layer to be detected and implement the acceptance process based on the layer to be detected, without having to interact with the third-party acceptance platform for data, thereby improving the flexibility of user interface acceptance.

For ease of understanding, some of the terms involved in this application are explained below:

Cloud computing: In a narrow sense, cloud computing refers to the delivery and use model of Internet technology (IT) infrastructure, which is to obtain the required resources through the network in an on-demand and easily scalable manner; while in a broad sense, cloud computing refers to the delivery and use model of services, which is to obtain the required services through the network in an on-demand and easily scalable manner. Among them, it can be IT and software, Internet-related services, or other services. Cloud computing is the product of the development and integration of traditional computer and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage technologies, virtualization, and load balancing. With the development of the Internet, real-time data streams, and the diversification of connected devices, as well as the promotion of search services, social networks, mobile commerce, and open collaboration, cloud computing has developed rapidly. Different from traditional parallel distributed computing, cloud computing will promote revolutionary changes in the entire Internet model and enterprise management model from the perspective of concept.

Tree data structure: In computer science, a tree is an abstract data type or a data structure of this abstract data type. A tree data structure is a hierarchical set of n (n>0) finite nodes, used to represent a one-to-many relationship between data elements. Trees and binary trees are the two most common tree data structures. This data structure is called a "tree" because it looks like an upside-down tree, that is, a tree with its roots facing upward and its leaves facing downward. Therefore, a tree data structure has the following characteristics: (1) Each node has zero or more child nodes; (2) A node without a parent node is called a root node; (3) Each non-root node has one and only one parent node; (4) Except for the root node, each child node can be divided into multiple non-intersecting subtrees. Tree data structure is an important type of nonlinear data structure, which is widely used in the computer field. For example, in compilers, trees are used to represent the syntax structure of source programs; for example, in database systems, tree data structures are also one of the important forms of information organization; for example, tree data structures are used to build multi-level directory structures for file management. In the present application, the layer nodes are laid out according to a tree structure, thereby obtaining a layer tree structure, wherein each node in the tree structure is a layer.

Core Animation Layer (CALayer): An object that can be used to manage image-based content and allow animation to be performed on the content. In this embodiment, when drawing the user interface image to be detected, each view in the user interface image to be detected is drawn in the form of a layer based on CALayer, and the layers are laid out as a tree structure, so that the user interface image to be detected is displayed on the display interface of the APP running on the terminal. Among them, each layer can have its specific size, rotation, angle, coordinate change or content information, and these changes can also be expressed through animation.

Class information: A class is used to describe a certain type of thing, which is equivalent to a template. For example, in an application (APP) page, the views displayed at the bottom of the APP page can be classified into one category, such as "tabbar", also known as bottom tab; or the views displayed at the top of the APP page can be classified into one category, such as "navigation bar", also known as nativationBar.

Standard layers: Reference layers designed for user interface designers.

Referring to FIG. 1 , FIG. 1 is an optional architecture diagram of an application scenario of the acceptance scheme of the user interface provided in an embodiment of the present application. To implement the application of the acceptance scheme supporting the user interface, the terminal device 100 is connected to the server 300 through the network 200, and the server 300 is connected to the database 400. The network 200 can be a wide area network or a local area network, or a combination of the two. The client for implementing the acceptance scheme of the user interface is deployed on the terminal device 100, wherein the client can be run on the terminal device 100 in the form of a browser, or can be run on the terminal device 100 in the form of an independent application (application, APP), etc. The specific presentation form of the client is not limited here. The server 300 involved in the present application can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms. The terminal device 100 can be a smart phone, a tablet computer, a laptop, a PDA, a personal computer, a smart TV, a smart watch, a vehicle-mounted device, a wearable device, etc., but is not limited thereto. The terminal device 100 and the server 300 can be directly or indirectly connected through the network 200 by wired or wireless communication, and this application does not limit this. The number of servers 300 and terminal devices 100 is also not limited. The solution provided in this application can be completed independently by the terminal device 100, or by the server 300, or by the terminal device 100 and the server 300 in cooperation, and this application does not make specific limitations. Among them, the database 400, in short, can be regarded as an electronic file cabinet-a place for storing electronic files, and users can add, query, update, delete, and other operations on the data in the file. The so-called "database" is a collection of data that is stored together in a certain way, can be shared with multiple users, has as little redundancy as possible, and is independent of the application program. A database management system (DBMS) is a computer software system designed for managing databases, generally with basic functions such as storage, interception, security, and backup. Database management systems can be classified according to the database models they support, such as relational, Extensible Markup Language (XML); or according to the types of computers they support, such as server clusters, mobile phones; or according to the query language used, such as Structured Query Language (SQL), XQuery; or according to performance impulse focus, such as maximum scale, maximum operating speed; or other classification methods. Regardless of the classification method used, some DBMSs can cross categories, for example, supporting multiple query languages at the same time. In the present application, the database 400 can be used to store the view data of the application or the code file of the application to be detected, for example, it can also be stored in the distributed file system of the terminal device 100, the blockchain or the server 300, etc.

In some embodiments, the server 300 can jointly execute the user interface acceptance scheme provided by the embodiment of the present application with the terminal device 100. In this embodiment, the specific process can be as follows: the terminal device 100 obtains the context information of the user interface image to be detected from the database 400 through the server 300; the terminal device 100 runs the application corresponding to the user interface image to be detected, and constructs a CALayer rendering pipeline, and uses the rendering pipeline to draw the user interface image to be detected, the user interface image to be detected includes a layer set to be detected, and the layer set to be detected constitutes a plurality of layer tree structures; the moving cursor is controlled to move to the first position of the user interface image to be detected, and the first action range of the detection floating layer is determined according to the first position, the moving cursor is used to be moved on the interface where the user interface image to be detected is located, the detection floating layer is used to determine the range of obtaining the layer to be detected in the user interface image to be detected based on the position of the moving cursor, and the detection floating layer and the moving cursor are constructed based on the rendering pipeline; the first layer set is obtained from the layer set to be detected according to the first action range using the detection floating layer; the first layer to be detected is searched from the first layer set; the layer to be detected is compared with the standard layer to obtain the acceptance result.

In another embodiment, the terminal device 100 independently executes the information recommendation method provided by the embodiment of the present application. In this embodiment, the specific process can be as follows: the terminal device 100 obtains the context information of the user interface image to be detected from the database 400; then runs the application corresponding to the user interface image to be detected, and constructs a CALayer rendering pipeline, and uses the rendering pipeline to draw the user interface image to be detected, the user interface image to be detected includes a layer set to be detected, and the layer set to be detected constitutes a plurality of layer tree structures; controls the moving cursor to move to the first position of the user interface image to be detected, and determines the first action range of the detection floating layer according to the first position, the moving cursor is used to be moved on the interface where the user interface image to be detected is located, the detection floating layer is used to determine the range of obtaining the layer to be detected in the user interface image to be detected based on the position of the moving cursor, and the detection floating layer and the moving cursor are constructed based on the rendering pipeline; uses the detection floating layer to obtain a first layer set from the layer set to be detected according to the first action range; searches for a first layer to be detected from the first layer set; compares the layer to be detected with the standard layer to obtain an acceptance result.

It is understandable that in the specific implementation of the present application, related data such as view data is involved. When the above embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

In combination with the above introduction, the following introduces the user interface acceptance method in the present application with the terminal device as the execution subject. Please refer to FIG. 2. An embodiment of the user interface acceptance method in the embodiment of the present application includes:

201. Construct a CALayer rendering pipeline, and use the rendering pipeline to draw a user interface image to be detected, where the user interface image to be detected includes a layer set to be detected, and the layer set to be detected constitutes a plurality of layer tree structures.

Generally, during the development process of an app, the developer will first develop a test version of the app. The test version of the app includes most of the functions of the app to be released, and in order to test the functions of the app, it is usually necessary to accept the UI controls of the app. Therefore, in this embodiment, an acceptance function for user interface design can be introduced in the test version of the app. That is to say, in this embodiment, the acceptance function for user interface design provided can be a functional mode in the test version. In this functional mode, it is convenient to accept each UI control in the test version of the app. And after the release version of the app is officially launched, the acceptance function for user interface scheduling does not need to be packaged.

In this embodiment, the app corresponding to the user interface to be detected can be run on the terminal device. When the app to be detected is run on the terminal device and the acceptance function mode of the user interface design is turned on, the terminal device can call CALayer and generate a rendering pipeline, and draw the user interface image to be detected based on the rendering pipeline. The specific process can be shown in Figure 3:

After generating the rendering pipeline, the terminal device obtains the context information of the user interface image to be detected from the server or its own storage medium through the rendering pipeline, the context information including the view data of the user interface image to be detected, the view life cycle, the position information of each view in the user interface image to be detected relative to the user interface image to be detected, and the status information of the user interface image to be detected; uses the rendering pipeline to generate a layer set to be detected according to the context information; uses the rendering pipeline to generate a corresponding layer tree structure for the layer set to be detected, and obtains the user interface image to be detected according to the layer tree structure.

In this embodiment, the view data of the user interface image to be detected is used to indicate the specific layer data information of a view, such as the picture, text, background color, control size, shadow, font, font size and other information corresponding to each layer in the view. The view life cycle is used to indicate the length of time a view exists in the user interface image to be detected. For example, after a control in the user interface image to be detected is triggered, a pop-up window will pop up. The pop-up window exists as a view in the user interface image to be detected for 1 minute, and the view life cycle is 1 minute. The status information of the user interface image to be detected is used to indicate the different stages of the user interface image to be detected in the overall drawing process, such as the user interface image to be detected is in the view data loading stage or in the view data parsing stage or in the view data parsing completion stage.

The position information is used to indicate the relative position of each view in the user interface image to be detected, which can be specifically stored in the form of x, y, width, and height. Among them, the x is used to indicate the starting point of the view on the X-axis of the user interface image to be detected; y is used to indicate the starting point of the view on the Y-axis of the user interface image to be detected; width is used to indicate the length of the view; height is used to indicate the height of the view. In an exemplary scheme, as shown in Figure 4, assuming that the control 1 corresponds to one view and the control 2 corresponds to another view, the position of the control 1 in the user interface image to be detected is (100, 100, 510, 475), and the position of the control 2 in the user interface image to be detected is (0, 0, 80, 75). When drawing the user interface image to be detected, if the display screen of the terminal device cannot display the entire user interface image to be detected, the specific display position of each view when the user interface image to be detected is scrolled can be determined by obtaining the position information of each view in the user interface image to be detected. For example, as shown in Figure 5, assuming that the position of the control 1 in the user interface image to be detected is (100, 100, 510, 475), the position of the control 2 in the user interface image to be detected is (0, 0, 80, 75), the position of the control 3 in the user interface image to be detected is (0, 600, 80, 75), and the position of the control 4 in the user interface image to be detected is (90, 600, 80, 75). If the bottom of the user interface image to be detected is determined as the zero point of the X-axis and the Y-axis, during the initial drawing, drawing starts from the top of the user interface image to be detected, and control 3 and control 4 are displayed at this time; as the user interface image to be detected scrolls, the control 1 will be displayed first, and then the control 2 will be displayed at last.

202. Control the mobile cursor to move to the first position of the user interface image to be detected, and determine the first effective range of the detection floating layer according to the first position. The mobile cursor is used to be moved on the interface where the user interface image to be detected is located. The detection floating layer is used to determine the range of obtaining the layer to be detected in the user interface image to be detected based on the position of the mobile cursor. The detection floating layer and the mobile cursor are constructed based on the rendering pipeline.

In this embodiment, when the terminal device draws the user interface image to be detected based on the CALayer rendering pipeline, the detection floating layer and the moving cursor can also be constructed, and when the moving cursor stops moving, the terminal device can obtain the position information of the moving cursor on the display screen of the terminal device, and determine the action range corresponding to the detection floating layer according to the position information. When the detection floating layer is constructed, it has the function of triggering the acquisition of all layers within its action range.

In this embodiment, the moving cursor can be a circular ring as shown in FIG. 6 or a triangle as shown in FIG. 7. It is understandable that the moving cursor can also be any visible shape, such as a circle, a hand sign, etc. It should be noted that in this embodiment, the layer display level corresponding to the moving cursor needs to be set to the first level (that is, the highest level), so that the moving cursor is always at the top of any user interface in the app. When jumping between interfaces (such as switching to another user interface image to be detected), it will not be affected (that is, jumping between interfaces will not cause the moving cursor to be invisible or hidden), so that any UI control in the interface can be easily detected. Among them, when constructing the moving cursor, it is necessary to define the properties of the moving cursor (such as shape, size, color, layer priority, etc.) and methods (execution actions triggered when pressed, execution actions triggered when released, execution actions triggered when dragged, etc.). In this embodiment, the size and position of the detection floating layer are determined according to the position of the moving cursor, and when the moving cursor has no action or there is no UI control at the position, the detection floating layer can be set to be hidden. As shown in Figure 6, when the moving cursor is located at the position of control 1 for more than a preset time, the detection floating layer will be hidden. Or, as shown in a in Figure 7, when the moving cursor is located between control 1 and control 2, the detection floating layer will be hidden. When the moving cursor moves to the position of control 2, as shown in b in Figure 7, the detection floating layer will be displayed and its scope of action will be displayed. That is, the detection floating layer will display an area, as shown in b in Figure 7, at which time the area will be able to completely surround control 2. It can be understood that the detection floating layer can overlap with the control 2, or the boundary of the detection floating layer and the boundary of the control 2 can be spaced at a preset distance, and the control 2 is guaranteed to be covered. The detection floating layer can also be covered on the control 2 with a transparent layer, or it can be covered on the control 2 with an opaque layer, which is not specifically limited here.

It can be understood that in this embodiment, the operation instruction for controlling the movement of the moving cursor can be to press and hold the moving cursor and drag the moving cursor at will. Among them, the pressing and dragging can be realized by the user operating the touch display screen of the terminal device through fingers or stylus, etc.; it can also be realized by the user operating the display screen of the terminal device through a mouse. In another possible implementation, the operation instruction for controlling the movement of the moving cursor can also be to sense the moving cursor, and the terminal device should have a floating touch screen at this time. When the distance between the user's finger (or other suitable object) and the moving cursor displayed on the floating touch screen falls into the sensing range of the floating touch screen, the moving cursor can sense the user's operation. Among them, the floating touch screen can adopt the Floating Touch floating touch screen technology, and the floating touch screen allows the user to complete the relevant operations without touching the screen when using the terminal device. For example, the finger and the floating touch screen are kept at a distance of about 15 mm to obtain a mouse-like operation on the terminal device, that is, the terminal device can be controlled by simply hovering the finger above the floating touch screen. In another possible implementation, the operation instruction for controlling the movement of the moving cursor can also be to sense the moving cursor and drag it at the same time. Similarly, the terminal device should have a floating touch screen at this time. When the distance between the user's finger (or other suitable object) and the moving cursor displayed on the floating touch screen falls within the sensing range of the floating touch screen, the moving cursor can sense the user's operation. Within the sensing range, while sensing, if the user's finger (or other suitable object) moves horizontally at the same time, the moving cursor will move accordingly on the floating touch screen.

203. Obtain a first layer set from the set of layers to be detected according to the first action range by using the detection floating layer.

In the embodiment of the present application, if the layer to be detected is to be obtained, the UI control information corresponding to the layer to be detected (i.e., the first layer set) needs to be obtained first, and then the trajectory of the moving cursor needs to be mapped to the UI control. In general, for an app, there are usually multiple UI controls in each user interface image to be detected, and there is a parent-child relationship between some of the UI controls (i.e., the position of any child UI control is set relative to the coordinate system of his parent UI control). Taking the three UI controls 1, 2, and 3 shown in Figure 8 as an example, 1 is the parent UI control of 2, and the corresponding 2 is the child UI control of 1; and 2 is the parent UI control of 3, and the corresponding 3 is the child UI control of 2. In terms of spatial position relationship, since 2 is the child UI control of 1, the layer of 2 is above the layer of 1. Similarly, 3 is the child UI control of 2, so the layer of 3 is above the layer of 2. Because in general, for an app, there are usually multiple UI controls in each interface. In some cases, if multiple UI controls in an interface are all siblings at the same layer level and are not subordinate to each other, it is easy to detect the UI controls within the first scope of action after scanning all UI elements in the current interface. However, in more cases, when there are multiple UI controls in an interface, at least some of the UI components have a parent-child relationship. In this case, the UI controls at the first scope of action can be determined in the following way. In an exemplary scheme, first, each root UI control among all UI controls in the current interface is determined. Among them, the root UI control refers to the UI control that does not have a parent UI control, or the parent UI control of the root UI control is UIView. Among them, UIView represents a rectangular area on the screen, which occupies an absolutely important position in the app because almost all visual controls are subclasses of UIView. Secondly, from the root UI controls, the root UI controls located in the first scope of action are detected. Of course, after detecting the root UI controls located at the first scope of action, those root UI controls that are not at the detection point position can be eliminated or ignored, and correspondingly, the UI controls belonging to those root UI controls that are not in the first scope of action will also be eliminated or ignored accordingly. Again, determine each first sub-UI control of the root UI control located in the first scope of action. Again, from each first sub-UI control, detect the first sub-UI control located in the first scope of action. Similarly, after detecting the first sub-UI control located in the first scope of action, the first sub-UI control that is not in the first scope of action can be eliminated or ignored. Then, determine each second sub-UI control of the first sub-UI control located in the first scope of action. In this way, recursively, until a UI control located in the first scope of action and whose layer display level is the second level (that is, the display level of its layer is second only to the moving cursor) is found from all UI controls in the current interface. It can be seen that this exemplary embodiment detects one by one from the bottom layer to the upper layer of the layer based on a recursive traversal method, and finally finds the UI control located in the first scope of action and whose layer display level is the second level, and then uses the layers corresponding to all the detected UI controls located in the first scope of action as the first layer set. Of course, in other exemplary embodiments of the present application, the detection can also be implemented in other ways, such as detecting one by one from the upper layer of the layer to the bottom layer.

204. Search and obtain a first layer to be detected from the first layer set.

In this embodiment, the terminal device may use a breadth-first search algorithm to search for the first layer to be detected from the first layer set, and the specific process may be shown in FIG. 9 :

First, the terminal device creates a global queue based on the first layer set. The terminal device scans the pixels of each layer in the first layer set based on the root node layer in the first layer set to generate multiple layer tree structures corresponding to the first layer set, and generates multiple task queues based on the multiple layer tree structures, wherein each layer tree structure corresponds to a task queue. In this embodiment, three states can be set for each layer node in the layer tree structure: unvisited state, visited state, and marked state. Among them, the unvisited state can be set as the initial state of each layer node. The visited state is used to indicate that the layer node has been traversed and accessed and the class information of the layer node is not in the public class matching template. The marked state is used to indicate that when the layer node is traversed and accessed, the class information of the layer node is a public class matching template (i.e., a UI control that does not need to be accepted). In this process, assuming that the layer root node in the first layer set is a click control, and the layer to be detected is button 1, after moving the cursor to the UI control corresponding to button 1, the pixel points of the click control are scanned, thereby obtaining layers of each level and forming a task queue.

Then, the terminal device identifies the class information and status information of the layer nodes in each task queue in turn according to the first-in-first-out processing rule of the task queue, and the class information is used to describe the properties and methods of the layer nodes.

Secondly, the terminal device determines the state information of the layer node. When the state information is in the unaccessed state, the terminal device determines whether the class information of the layer node exists in the public class matching template. If it is determined that the class information exists in the public class matching template, the layer node is determined to be a layer node that does not require acceptance, and the state of the layer node and its corresponding layer subnode is set to a marked state. If it is determined that the class information does not exist in the public class matching template, the layer node corresponding to the class information is classified as a second layer node set, the state of each layer node in the second layer node set is set to an accessed state, and the data information of each layer node in the second layer node set is obtained and cached. Among them, the public class matching module is the class information of the user interface element that does not require acceptance, such as the system-level views such as tabbar and nativationBar in the actual page detection process. The size, color, coordinates and text of these views are fixed, so there is no need for detection and acceptance. If the state information of the state of the layer node is an accessed state, the terminal can directly read the cached data information of the layer node. If the state information of the layer node is marked, the layer node and its sub-layer nodes are directly skipped.

Next, the terminal device obtains a third layer node set from the second layer node set according to the first position of the moving cursor.

Finally, the terminal device obtains the first layer to be detected from the third layer node set.

In this embodiment, after determining the second layer node set, the terminal device can also obtain the first data information set of each layer node in the second layer node set; create a first pop-up window with the detection floating layer as the root view, and select the data information corresponding to the third layer node set from the first data information set to display in the first pop-up window. In this embodiment, the data information may include information such as shadow direction, shadow offset pixels, rounded border, inner margin, etc. When the terminal device displays the data information, the terminal device can display the data information in the pop-up window in the form of a field, and its content may include the class name, frame coordinates, background color, text color, font, font size, etc. of the specified view. In an exemplary solution, the display result can be shown in Figure 9a, and its display content may include a class name of "UILabel", a frame coordinate of "{{32, 54}, {272, 22.5}}", a background color of "clear color", a text color of "#999999", a font size of "16", and so on. It can be understood that the pop-up window can only display the data information of one layer, and when it is necessary to obtain the data information of the sub-layer node and the parent layer node corresponding to the layer, it can be viewed by clicking the node selection control (such as the "parent node" and "child node" controls) as shown in Figure 9a.

205. Compare the layer to be tested with the standard layer to obtain an acceptance result.

In this embodiment, the terminal device can compare the layer to be detected with the standard layer designed by the designer through a script or manually to obtain similarity or coordinates to obtain an acceptance result.

The user interface acceptance device in the present application is described in detail below. Please refer to FIG. 10 . FIG. 10 is a schematic diagram of an embodiment of the user interface acceptance device in the present application. The user interface acceptance device 20 includes:

A generation module 201 is used to construct a CALayer rendering pipeline and use the rendering pipeline to draw a user interface image to be detected, where the user interface image to be detected includes a layer set to be detected, and the layer set to be detected constitutes a plurality of layer tree structures;

A determination module 202 is used to control a moving cursor to move to a first position of the user interface image to be detected, and determine a first action range of a detection floating layer according to the first position, wherein the moving cursor is used to be moved on the interface where the user interface image to be detected is located, and the detection floating layer is used to determine a range of obtaining a layer to be detected in the user interface image to be detected based on the position of the moving cursor, and the detection floating layer and the moving cursor are constructed based on the rendering pipeline;

An acquisition module 203 is used to acquire a first layer set from the to-be-detected layer set according to the first action range by using the detection floating layer;

A search module 204, configured to search for a first layer to be detected from the first layer set;

The acceptance module 205 is used to compare the layer to be inspected with the standard layer to obtain an acceptance result.

In an embodiment of the present application, a user interface acceptance device is provided. The above device is used to construct a CALayer rendering pipeline in the application, and then the user interface image to be detected is drawn according to the CALayer rendering pipeline, and the layer to be detected is obtained through the moving cursor constructed by the CALayer rendering pipeline and the detection floating layer, so that the terminal running the application can obtain the layer to be detected, and implement the acceptance process according to the layer to be detected, without having to interact with the third-party acceptance platform for data, thereby improving the flexibility of user interface acceptance.

Optionally, based on the embodiment corresponding to FIG. 10 , in another embodiment of the user interface acceptance device 20 provided in the embodiment of the present application,

The generating module 201 is specifically used to obtain context information of the user interface image to be detected by using the rendering pipeline, where the context information includes view data of the user interface image to be detected, view life cycle, position information of each view in the user interface image to be detected relative to the user interface image to be detected, and state information of the user interface image to be detected;

Generate a set of layers to be detected according to the context information using the rendering pipeline;

The rendering pipeline is used to generate a corresponding layer tree structure for the layer set to be detected, and the user interface image to be detected is obtained according to the layer tree structure.

In an embodiment of the present application, a user interface acceptance device is provided. Using the above device, all view information of the user interface image to be detected is obtained based on the CALayer rendering pipeline, and then the user interface to be detected, the floating layer is detected, and the cursor is moved based on the view information. In this way, all layer information of the user interface to be detected can be obtained by the CALayer rendering pipeline, so that the terminal running the application can obtain the layer to be detected without having to interact with the third-party acceptance platform for data, thereby improving the flexibility of user interface acceptance.

Optionally, based on the embodiment corresponding to the above-mentioned Figure 10, in another embodiment of the user interface acceptance device 20 provided in the embodiment of the present application, the search module 204 is specifically used to search for the first layer to be detected from the first layer set using a breadth-first search algorithm.

In an embodiment of the present application, a user interface acceptance device is provided. With the above device, each UI element on the user interface to be detected can be parsed into a tree and graph data structure using a breadth-first search algorithm, so that specific UI elements can be detected, and the function of obtaining the layer to be detected in the terminal is realized, without the need to interact with the third-party acceptance platform for data, thereby improving the flexibility of user interface acceptance.

Optionally, based on the embodiment corresponding to FIG. 10 , in another embodiment of the user interface acceptance device 20 provided in the embodiment of the present application,

The search module 204 is specifically used to perform pixel point scanning on each layer in the first layer set based on the root node layer in the first layer set to generate multiple layer tree structures corresponding to the first layer set, and generate multiple task queues according to the multiple layer tree structures, wherein each layer tree structure corresponds to a task queue;

According to the queue processing rules, the class information of the layer nodes in each task queue is identified in turn. The class information is used to describe the properties and methods of the layer nodes.

When it is determined that the information of this type exists in the common class matching template, the layer node corresponding to the information of this type is determined to be a layer node that does not need to be accepted, and the state of the layer node corresponding to the information of this type and its corresponding layer subnode is set to a marked state;

When it is determined that the information of this type does not exist in the common class matching template, the layer nodes corresponding to the information of this type are classified into a second layer node set, and the state of each layer node in the second layer node set is set to an accessed state;

Acquire a third layer node set from the second layer node set according to the first position of the moving cursor;

The first layer to be detected is obtained from the third layer node set.

In an embodiment of the present application, a user interface acceptance device is provided. With the above device, each UI element on the user interface to be detected can be parsed into a tree and graph data structure using a breadth-first search algorithm, so that specific UI elements can be detected. At the same time, the general template sets the status information of each layer, thereby reducing the number of matches in the breadth-first search process and improving the search efficiency.

Optionally, based on the embodiment corresponding to FIG. 10 above, as shown in FIG. 10a, in another embodiment of the user interface acceptance device 20 provided in the embodiment of the present application,

The acquisition module 203 is further used to acquire a first data information set of each layer node in the second layer node set;

The generating module 201 is further used to create a first pop-up window with the detection floating layer as the root view;

The device also includes a display module 206, which is used to select data information corresponding to the third layer node set from the first data information set and display it in the first pop-up window.

In an embodiment of the present application, a user interface acceptance device is provided. With the above device, data information of each layer can be obtained through the CALayer rendering pipeline, and then the information of each layer can be displayed through a visual interface, so that the user can intuitively obtain the information of the layer, so that the user can perform a preliminary screening of the information of each layer, thereby improving the acceptance efficiency of the user interface.

Optionally, based on the embodiment corresponding to the above-mentioned Figure 10a, as shown in Figure 10b, in another embodiment of the user interface acceptance device 20 provided in the embodiment of the present application, the device also includes a storage module 207 for caching the first data information set to the storage medium corresponding to the detection floating layer.

In an embodiment of the present application, a user interface acceptance device is provided. By using the above device, the layers required for acceptance obtained during a detection process are stored, which can reduce the process of obtaining data information during the search process, thereby improving the efficiency of obtaining layer data information.

Optionally, based on the embodiment corresponding to FIG. 10b above, as shown in FIG. 10c, in another embodiment of the user interface acceptance device 20 provided in the embodiment of the present application, the determination module 202 is further used to control the moving cursor to move to a second position, and obtain a fourth layer node set corresponding to the second position;

The device further includes a reading module 208, which is used to read data information corresponding to the fourth layer set from the first data information set of the detection floating layer cache when there is a layer node included in the second layer node set in the fourth layer node set;

The generating module 201 is further used to create a second pop-up window with the detection floating layer as the root view;

The device also includes a display module 206, which is used to display the data information corresponding to the fourth layer node set in the second pop-up window.

In an embodiment of the present application, a user interface acceptance device is provided. By using the above device, the layers required for acceptance obtained during a detection process are stored, which can reduce the process of obtaining data information during the search process, thereby improving the efficiency of obtaining layer data information.

The user interface acceptance device provided in the present application can be used for a server. Please refer to Figure 11. Figure 11 is a schematic diagram of a server structure provided in an embodiment of the present application. The server 300 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 322 (for example, one or more processors) and memory 332, and one or more storage media 330 (for example, one or more mass storage devices) storing application programs 342 or data 344. Among them, the memory 332 and the storage medium 330 can be short-term storage or permanent storage. The program stored in the storage medium 330 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processor 322 can be configured to communicate with the storage medium 330 and execute a series of instruction operations in the storage medium 330 on the server 300.

The server 300 may also include one or more power supplies 326, one or more wired or wireless network interfaces 350, one or more input and output interfaces 358, and/or one or more operating systems 341, such as Windows Server ^™ , Mac OS X ^™ , Unix ^™ , Linux ^™ , FreeBSD ^™ , etc.

The steps performed in the above embodiment may be based on the server structure shown in FIG. 11 .

The user interface acceptance device provided in this application can be a terminal device. Please refer to Figure 12. For the convenience of explanation, only the part related to the embodiment of this application is shown. For specific technical details not disclosed, please refer to the method part of the embodiment of this application. In the embodiment of this application, the terminal device is a smart phone as an example for explanation:

FIG12 is a block diagram showing a partial structure of a smartphone related to a terminal device provided in an embodiment of the present application. Referring to FIG12 , the smartphone includes components such as a radio frequency (RF) circuit 410, a memory 420, an input unit 430, a display unit 440, a sensor 450, an audio circuit 460, a wireless fidelity (WiFi) module 470, a processor 480, and a power supply 490. Those skilled in the art will appreciate that the smartphone structure shown in FIG12 does not constitute a limitation on the smartphone, and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

The following is a detailed introduction to the various components of the smartphone in conjunction with FIG12:

The RF circuit 410 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is sent to the processor 480 for processing; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit 410 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc. In addition, the RF circuit 410 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to the global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), email, short messaging service (SMS), etc.

The memory 420 can be used to store software programs and modules. The processor 480 executes various functional applications and data processing of the smartphone by running the software programs and modules stored in the memory 420. The memory 420 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the smartphone (such as audio data, a phone book, etc.), etc. In addition, the memory 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

The input unit 430 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the smart phone. Specifically, the input unit 430 may include a touch panel 431 and other input devices 432. The touch panel 431, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 431 or near the touch panel 431 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 431 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the contact coordinates, and then sends it to the processor 480, and can receive and execute the command sent by the processor 480. In addition, the touch panel 431 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 431, the input unit 430 may also include other input devices 432. Specifically, other input devices 432 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 440 can be used to display information input by the user or information provided to the user and various menus of the smart phone. The display unit 440 may include a display panel 441, and optionally, the display panel 441 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel 431 may cover the display panel 441, and when the touch panel 431 detects a touch operation on or near it, it is transmitted to the processor 480 to determine the type of the touch event, and then the processor 480 provides a corresponding visual output on the display panel 441 according to the type of the touch event. Although in Figure 12, the touch panel 431 and the display panel 441 are used as two independent components to realize the input and output functions of the smart phone, in some embodiments, the touch panel 431 and the display panel 441 can be integrated to realize the input and output functions of the smart phone.

The smartphone may also include at least one sensor 450, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 441 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 441 and/or the backlight when the smartphone is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of smartphones (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometers, tapping), etc.; as for other sensors that can be configured in smartphones, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

The audio circuit 460, the speaker 461, and the microphone 462 can provide an audio interface between the user and the smartphone. The audio circuit 460 can transmit the received audio data to the speaker 461 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 462 converts the collected sound signal into an electrical signal, which is received by the audio circuit 460 and converted into audio data, and then the audio data is output to the processor 480 for processing, and then sent to another smartphone through the RF circuit 410, or the audio data is output to the memory 420 for further processing.

WiFi is a short-range wireless transmission technology. Smartphones can help users send and receive emails, browse web pages, and access streaming media through WiFi module 470, which provides users with wireless broadband Internet access. Although FIG. 12 shows WiFi module 470, it is understandable that it is not a necessary component of the smartphone and can be omitted as needed without changing the essence of the invention.

Processor 480 is the control center of the smartphone, which uses various interfaces and lines to connect various parts of the entire smartphone, and executes various functions of the smartphone and processes data by running or executing software programs and/or modules stored in memory 420, and calling data stored in memory 420, so as to monitor the smartphone as a whole. Optionally, processor 480 may include one or more processing units; optionally, processor 480 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into processor 480.

The smart phone also includes a power source 490 (such as a battery) for supplying power to various components. Optionally, the power source can be logically connected to the processor 480 through a power management system, thereby managing functions such as charging, discharging, and power consumption management through the power management system.

Although not shown, the smartphone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

The steps performed in the above embodiment may be based on the terminal device structure shown in FIG. 12 .

A computer-readable storage medium is also provided in an embodiment of the present application. The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the methods described in the aforementioned embodiments.

A computer program product including a program is also provided in an embodiment of the present application. When the program is run on a computer, the computer is enabled to execute the methods described in the aforementioned embodiments.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the unit is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, a person of ordinary skill in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A method of acceptance of a user interface design, comprising:

Constructing CALayer a rendering pipeline, and drawing a user interface image to be detected by utilizing the rendering pipeline, wherein the user interface image to be detected comprises a layer set to be detected, and the layer set to be detected forms a plurality of layer tree structures;

Controlling a moving cursor to move to a first position of the user interface image to be detected, determining a first action range of a detection floating layer according to the first position, wherein the moving cursor is used for being moved on an interface where the user interface image to be detected is located, the detection floating layer is used for determining a range of the image to be detected obtained on the user interface image to be detected based on the position where the moving cursor is located, and the detection floating layer and the moving cursor are constructed based on the rendering pipeline;

Acquiring a first layer set from the layer set to be detected according to the first action range by utilizing the detection floating layer;

Searching from the first layer set to obtain a first layer to be detected;

And comparing the layer to be detected with the standard layer to obtain an acceptance result.

2. The method of claim 1, wherein the drawing the user interface image to be detected with the rendering pipeline comprises:

Acquiring context information of a user interface image to be detected by using the rendering pipeline, wherein the context information comprises view data of the user interface image to be detected, a view life cycle, position information of each view in the user interface image to be detected relative to the user interface image to be detected and state information of the user interface image to be detected;

Generating a layer set to be detected according to the context information by utilizing the rendering pipeline;

And generating a corresponding layer tree structure by utilizing the rendering pipeline to the layer set to be detected, and obtaining the user interface image to be detected according to the layer tree structure.

3. The method of claim 1, wherein searching for a first layer to be detected from the first layer set comprises:

and searching the first layer to be detected from the first layer set by using a breadth-first search algorithm.

4. The method of claim 3, wherein searching for the first layer to be detected from the first set of layers using a breadth-first search algorithm comprises:

Performing pixel point scanning on each layer in the first layer set based on a root node layer in the first layer set to generate a plurality of layer tree structures corresponding to the first layer set, and generating a plurality of task queues according to the plurality of layer tree structures, wherein each layer tree structure corresponds to one task queue;

sequentially identifying class information of the layer nodes in each task queue according to a queue processing rule, wherein the class information is used for describing attributes and methods of the layer nodes;

When the class information is determined to exist in a public class matching template, determining that a layer node corresponding to the class information is a layer node which does not need to be checked and accepted, and setting the states of the layer node corresponding to the class information and the layer child node corresponding to the layer node as marked states;

When the class information is determined not to exist in the public class matching template, classifying the layer nodes corresponding to the class information into a second layer node set, wherein the state of each layer node in the second layer node set is set to be an accessed state, and the public class matching module is class information of user interface elements which do not need to be checked;

Acquiring a third layer node set from the second layer node set according to the first position of the moving cursor;

and acquiring the first layer to be detected from the third layer node set.

5. The method of claim 4, wherein after classifying the layer nodes corresponding to the class information into the second layer node set, the method further comprises:

Acquiring a first data information set of each layer node in the second layer node set;

And creating a first popup window by taking the detection floating layer as a root view, and selecting data information corresponding to the third layer node set from the first data information set to display in the first popup window.

6. The method of claim 5, wherein after obtaining the first set of data information for each layer node in the second set of layer nodes, the method further comprises:

And caching the first data information set to a storage medium corresponding to the detection floating layer.

7. The method of claim 6, wherein the method further comprises:

Controlling the moving cursor to move to a second position, and acquiring a fourth layer node set corresponding to the second position;

When the layer nodes contained in the second layer node set exist in the fourth layer node set, reading data information corresponding to the fourth layer set from the first data information set cached by the detection floating layer;

And creating a second popup window by taking the detection floating layer as a root view, and displaying data information corresponding to the fourth layer node set in the second popup window.

8. A user interface acceptance device, comprising:

The generation module is used for constructing CALayer rendering pipelines and drawing user interface images to be detected by utilizing the rendering pipelines, wherein the user interface images to be detected comprise layer sets to be detected, and the layer sets to be detected form a plurality of layer tree structures;

The device comprises a determining module, a detecting module and a rendering pipeline, wherein the determining module is used for controlling a moving cursor to move to a first position of the user interface image to be detected, determining a first action range of a detecting floating layer according to the first position, wherein the moving cursor is used for being moved on an interface where the user interface image to be detected is located, the detecting floating layer is used for determining a range of acquiring a layer to be detected on the user interface image to be detected based on the position where the moving cursor is located, and the detecting floating layer and the moving cursor are constructed based on the rendering pipeline;

the acquisition module is used for acquiring a first layer set from the layer set to be detected according to the first action range by utilizing the detection floating layer;

the searching module is used for searching from the first layer set to obtain a first layer to be detected;

and the acceptance module is used for comparing the layer to be detected with the standard layer to obtain an acceptance result.

9. A computer device, comprising: a memory, a processor, and a bus system;

Wherein the memory is used for storing programs;

The processor being for executing a program in the memory, the processor being for executing the method of any one of claims 1 to 7 according to instructions in program code;

the bus system is used for connecting the memory and the processor so as to enable the memory and the processor to communicate.

10. A computer readable storage medium comprising instructions which, when run on a computer, cause the computer to perform the method of any one of claims 1 to 7.