CN111292302B - Screen detection method and device - Google Patents

Abstract

The purpose of the present invention is to provide a screen detection method and device. The present invention displays the bright screen as a white background image, and can simply and accurately locate the screen position of the device based on the boundary of the white background image. In addition, the present invention respectively takes the first photo containing the screen area displayed as a full-screen yellow screen, and the second photo containing the screen area displayed as a full-screen white screen, so as to facilitate subsequent reliable identification in the first photo or the second photo Different kinds of screen cracks or scratches within the range enclosed by the outline of the screen.

Description

Screen detection method and device

technical field

The invention relates to the field of computers, in particular to a screen detection method and device.

Background technique

The detection of cracks and scratches on the screens of existing smart terminals such as mobile phones is done manually, which is time-consuming and labor-intensive.

Contents of the invention

An object of the present invention is to provide a screen detection method and device.

According to one aspect of the present invention, a screen detection method is provided, the method comprising:

Display the bright screen as a white background screen;

taking a photo of the mobile phone screen including said white background picture;

Recognizing the boundary of the white background picture from the photo, using the boundary as the outline of the screen;

Display the bright screen as a full-screen yellow screen, and control the light source to illuminate the screen area that is displayed as a full-screen yellow screen;

Take the first photo of the area of the screen that includes the area of the screen shown as a full-screen yellow screen;

Display the bright screen as a full-screen white screen, and control the light source to illuminate the screen area displayed as a full-screen white screen;

Take a second photo that includes the area of the screen that appears as a full-screen white image;

Detecting whether there are cracks or scratches in the area enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches in the screen.

Further, in the above method, identifying the boundary of the white background picture from the photo, using the boundary as the outline of the screen, includes:

converting said photo into a grayscale image;

Designate a preset pixel threshold T1 to segment the grayscale picture, wherein the pixel values of the pixels in the photo that exceed the preset pixel threshold T1 are set to 255, and the pixel values in the photos that do not exceed the preset pixel threshold T1 are set to 255. Set the pixel value of the pixel point of the pixel threshold T1 to be 0;

Obtain the continuous area of each pixel point in the grayscale image with a pixel value of 255;

Calculate the number of pixels in the area where each pixel is continuous, and filter the area where each pixel is continuous, wherein the area where the number of pixels is less than the preset number threshold T2 is discarded is continuous, and Retaining a region where the number of pixels is greater than or equal to the preset number threshold T2 and the pixels are continuous;

Calculate the area of the minimum circumscribed rotating rectangle of each retained pixel continuous region, and calculate the fullness s of the smallest circumscribed rotated rectangle of each retained pixel continuous region, where fullness s=a certain reserved pixel The number of pixels in the continuous area/the area of the smallest circumscribed rotating rectangle of the reserved pixel continuous area;

The area where the reserved pixels are continuous with the fullness s greater than the preset fullness threshold T3 is taken as the boundary of the white background picture, and the boundary is taken as the outline of the screen.

Further, in the above method, it is detected whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, and if there are cracks or scratches in the screen, it is determined that there are cracks or scratches in the screen,

Detect whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, and if so, calculate the length of each crack or scratch, if a certain crack or scratch is If the length exceeds the preset length threshold, it is determined that there is a crack or scratch on the screen.

Further, in the above method, it is detected whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, and if there are cracks or scratches in the screen, it is determined that there are cracks or scratches in the screen,

Detect whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, if there are, calculate the number of cracks or scratches, if the number of cracks or scratches exceeds If the number threshold is preset, it is determined that there are cracks or scratches on the screen.

Further, in the above method, it is detected whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, and if there are cracks or scratches in the screen, it is determined that there are cracks or scratches in the screen,

Detecting whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, if there is, calculating the length of each crack or scratch, if the length exceeds the preset length threshold If the number of cracks or scratches exceeds the preset number threshold, it is determined that there are cracks or scratches on the screen.

According to another aspect of the present invention, a screen detection device is also provided, wherein the device includes:

The display module is used to display the bright screen as a white background image;

The first photographing module is used to photograph the photograph of the mobile phone screen that comprises described white background picture;

An identification module, configured to identify the boundary of the white background picture from the photo, and use the boundary as the outline of the screen;

The second shooting module is used to display the bright screen of the screen as a full-screen yellow picture, and control the light source to illuminate the screen area displayed as a full-screen yellow picture, and shoot the first photo containing the screen area displayed as a full-screen yellow picture;

The third shooting module is used to display the bright screen of the screen as a full-screen white picture, and control the light source to illuminate the screen area displayed as a full-screen white picture, and take a second photo containing the screen area displayed as a full-screen white picture;

The detection module is configured to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, and if so, determine that there are cracks or scratches on the screen.

Further, in the above-mentioned device, the recognition module is used to convert the photo into a grayscale picture; specify a preset pixel threshold T1 to segment the grayscale picture, wherein, the pixels in the photo that exceed the preset Set the pixel value of the pixel point of the pixel threshold T1 to 255, and set the pixel value of the pixel point not exceeding the preset pixel threshold T1 in the photo to 0; obtain the pixel value of 255 in the gray scale image A region where each pixel point is continuous; calculate the number of pixels in each pixel point continuous region, and filter each pixel point continuous region, wherein the number of discarded pixel points is less than the preset number threshold T2 A region with continuous pixels, and retain a region with continuous pixels whose number of pixels is greater than or equal to the preset number threshold T2; calculate the area of the smallest circumscribed rotating rectangle for each retained region of continuous pixels, and calculate each reserved The fullness s of the minimum circumscribed rotating rectangle of the continuous pixel point area, wherein, the fullness s=the number of pixels in a certain reserved pixel point continuous area/the minimum value of the reserved pixel point continuous area The area of the circumscribed rotating rectangle; use the continuous area of the reserved pixels whose fullness s is greater than the preset fullness threshold T3 as the boundary of the white background picture, and use the boundary as the outline of the screen.

Further, in the above device, the detection module is used to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, and if so, calculate the or the length of the scratch, if the length of a certain crack or scratch exceeds the preset length threshold, it is determined that there is a crack or scratch on the screen.

Further, in the above device, the detection module is used to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, and if so, calculate the crack or scratch If the number of cracks or scratches exceeds the preset number threshold, it is determined that there are cracks or scratches on the screen.

Further, in the above device, the detection module is used to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, and if so, calculate the or the length of the scratches, if the number of cracks or scratches whose length exceeds the preset length threshold exceeds the preset number threshold, it is determined that there are cracks or scratches on the screen.

According to another aspect of the present invention, there is also provided a computing-based device, comprising:

processor; and

A memory arranged to store computer-executable instructions that, when executed, cause the processor to:

Display the bright screen as a white background screen;

taking a photo of the mobile phone screen including said white background picture;

Recognizing the boundary of the white background picture from the photo, using the boundary as the outline of the screen;

Display the bright screen as a full-screen yellow screen, and control the light source to illuminate the screen area that is displayed as a full-screen yellow screen;

Take the first photo of the area of the screen that includes the area of the screen shown as a full-screen yellow screen;

Display the bright screen as a full-screen white screen, and control the light source to illuminate the screen area displayed as a full-screen white screen;

Take a second photo that includes the area of the screen that appears as a full-screen white image;

Detecting whether there are cracks or scratches in the area enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches in the screen.

According to another aspect of the present invention, there is also provided a computer-readable storage medium on which computer-executable instructions are stored, wherein, when the computer-executable instructions are executed by a processor, the processor:

Display the bright screen as a white background screen;

taking a photo of the mobile phone screen including said white background picture;

Recognizing the boundary of the white background picture from the photo, using the boundary as the outline of the screen;

Display the bright screen as a full-screen yellow screen, and control the light source to illuminate the screen area that is displayed as a full-screen yellow screen;

Take the first photo of the area of the screen that includes the area of the screen shown as a full-screen yellow screen;

Display the bright screen as a full-screen white screen, and control the light source to illuminate the screen area displayed as a full-screen white screen;

Take a second photo that includes the area of the screen that appears as a full-screen white image;

Detecting whether there are cracks or scratches in the area enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches in the screen.

Compared with the prior art, the present invention displays the bright screen as a white background picture, and the screen position of the device can be positioned simply and accurately based on the boundary of the white background picture. In addition, the present invention respectively takes the first photo containing the screen area displayed as a full-screen yellow screen, and the second photo containing the screen area displayed as a full-screen white screen, so as to facilitate subsequent reliable identification in the first photo or the second photo Different kinds of screen cracks or scratches within the range enclosed by the outline of the screen.

Description of drawings

Other characteristics, objects and advantages of the present invention will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

Fig. 1 shows a flowchart of a screen detection method according to an embodiment of the present invention.

The same or similar reference numerals in the drawings represent the same or similar components.

detailed description

The present invention will be described in further detail below in conjunction with the accompanying drawings.

In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input/output interfaces, network interfaces and memory.

Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and/or nonvolatile memory such as read only memory (ROM) or flash RAM. Memory is an example of computer readable media.

Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridge, tape disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media excludes non-transitory computer-readable media, such as modulated data signals and carrier waves.

As shown in Figure 1, the present invention provides a screen detection method, the method comprising:

Step S1, displaying the bright screen as a white background image;

Here, the screen may be a terminal device with a display screen such as a mobile phone or a PAD;

Step S2, taking a photo of the screen including the white background picture;

Here, when shooting the screen of the mobile phone, the irrelevant area outside the screen area will also be captured, and the screen area needs to be identified from it later;

Step S3, identifying the boundary of the white background picture from the photo, and using the boundary as the outline of the screen;

Step S4, displaying the bright screen as a full-screen yellow picture, and controlling the light source to illuminate the screen area displayed as a full-screen yellow picture;

Here, in order to ensure the clarity of subsequent photos taken, the screen area displayed as a full-screen yellow screen can be illuminated by controlling the light source to fill in the screen area displayed as a full-screen yellow screen;

Step S5, taking a first photo including a screen area displayed as a full-screen yellow screen;

Step S6, displaying the bright screen as a full-screen white picture, and controlling the light source to illuminate the screen area displayed as a full-screen white picture;

Here, in order to ensure the clarity of subsequent photos taken, the screen area displayed as a full-screen white screen can be illuminated by controlling the light source to fill in the screen area displayed as a full-screen white screen;

Step S7, taking a second photo including a screen area displayed as a full-screen white screen;

Step S8 , detecting whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches on the screen.

Here, the display clarity of different types of cracks or scratches will be different in the screen area full of white screens or the screen area of full screen yellow screens. The first photo, and the second photo including the screen area displayed as a full-screen white screen, to ensure the clarity of different types of screen cracks or scratches taken later.

If cracks or scratches are detected in one of the first photos or the second photos, it can be determined that there are cracks or scratches on the screen.

In the present invention, the bright screen is displayed as a picture with a white background, and the screen position of the device can be positioned simply and accurately based on the boundary of the picture with a white background. In addition, the present invention respectively takes the first photo containing the screen area displayed as a full-screen yellow screen, and the second photo containing the screen area displayed as a full-screen white screen, so as to facilitate subsequent reliable identification in the first photo or the second photo Different kinds of screen cracks or scratches within the range enclosed by the outline of the screen.

In an embodiment of the screen detection method of the present invention, step S3, identifying the boundary of the white background picture from the photo, using the boundary as the outline of the screen, includes:

Step S31, converting the photo src into a grayscale image gray;

Step S32, specifying a preset pixel threshold T1 to segment the grayscale image gray, wherein the pixel values of the pixels exceeding the preset pixel threshold T1 in the photo src are set to 255, and the photo src is set to The pixel values of the pixel points that do not exceed the preset pixel threshold T1 are set to 0;

Step S33, obtaining a region where each pixel in the grayscale image gray has a pixel value of 255 and is continuous;

Here, if a certain pixel is in the 8-neighborhood of another pixel, the two can be considered to be continuous, and two or more consecutive pixels can form a continuous pixel area;

A pixel with a pixel value of 0 is a black pixel, a pixel with a value of 255 is a white pixel, and the connection area of a pixel with a pixel value of 0 does not need to be considered, and it is regarded as the background outside the screen area;

Step S34, calculating the number of pixels in the area where each pixel is continuous, and filtering each area where each pixel is continuous, wherein the number of discarded pixels is less than the preset number threshold T2. region, and retain a region where the number of pixels is greater than or equal to the preset number threshold T2 and the pixels are continuous;

Step S35, calculate the area of the smallest circumscribed rotating rectangle in each area of continuous pixel points retained, and calculate the fullness s of the smallest circumscribed rotated rectangle in the area of continuous pixel points retained, wherein, fullness s=a reserved The number of pixels in the area with continuous pixels/the area of the smallest circumscribed rotating rectangle of the area with continuous pixels;

Step S36 , taking the area with continuous pixels whose fullness s is greater than the preset fullness threshold T3 as the boundary of the white background picture, and using the boundary as the outline of the screen.

Here, it is possible to traverse each area where each reserved pixel is continuous, and divide the number of pixels in each area where each reserved pixel is continuous by the area of the smallest circumscribed rotating rectangle to obtain the fullness s of the area. If the fullness s value of the area with consecutive retained pixels is greater than the preset fullness threshold T3, it is a screen area, and if it is smaller, it is a non-screen area.

In this implementation, the gray-scale image gray is segmented by specifying a preset pixel threshold T1; the number of pixels in the area where each pixel is continuous is calculated, and each area where each pixel is continuous is screened; The area of the minimum circumscribed rotating rectangle of the continuous pixel point area, calculate the fullness s of the minimum circumscribed rotated rectangle in the continuous pixel point area of each reserved; set the fullness s greater than the preset fullness threshold T3 of the reserved pixels The continuous area is used as the boundary of the white background image, and the boundary is used as the outline of the screen, so that the screen positions of various terminals can be accurately and reliably identified.

In an embodiment of the screen detection method of the present invention, step S9 is to detect whether there are cracks or scratches in the area surrounded by the outline of the screen in the first photo or the second photo, and if so, determine whether the screen There are cracks or scratches,

Detect whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, and if so, calculate the length of each crack or scratch, if a certain crack or scratch is If the length exceeds the preset length threshold, it is determined that there is a crack or scratch on the screen.

Here, by calculating the length of each crack or scratch, the cracks or scratches that meet the requirements can be reliably screened, so as to accurately determine whether the screen has cracks or scratches.

In an embodiment of the screen detection method of the present invention, step S9 is to detect whether there are cracks or scratches in the area surrounded by the outline of the screen in the first photo or the second photo, and if so, determine whether the screen There are cracks or scratches,

Detect whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, if there are, calculate the number of cracks or scratches, if the number of cracks or scratches exceeds If the number threshold is preset, it is determined that there are cracks or scratches on the screen.

Here, by counting the number of each crack or scratch, the cracks or scratches that meet the requirements can be reliably screened, so as to accurately determine whether the screen has cracks or scratches.

In step S9 in an embodiment of the screen detection method of the present invention, it is detected whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, and if there is, it is determined that the screen exists cracks or scratches,

Detecting whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, if there is, calculating the length of each crack or scratch, if the length exceeds the preset length threshold If the number of cracks or scratches exceeds the preset number threshold, it is determined that there are cracks or scratches on the screen.

Here, by calculating the length of each crack or scratch, and calculating whether the number of cracks or scratches whose length exceeds the preset length threshold exceeds the preset number threshold, cracks or scratches that meet the requirements can be reliably screened to facilitate It is more accurate to determine whether the screen has cracks or scratches.

The present invention provides a screen detection device, which includes:

The display module is used to display the bright screen as a white background image;

Here, the screen may be a terminal device with a display screen such as a mobile phone or a PAD;

The first photographing module is used to photograph the photograph of the mobile phone screen that comprises described white background picture;

An identification module, configured to identify the boundary of the white background picture from the photo, and use the boundary as the outline of the screen;

The second shooting module is used to display the bright screen of the screen as a full-screen yellow picture, and control the light source to illuminate the screen area displayed as a full-screen yellow picture, and shoot the first photo containing the screen area displayed as a full-screen yellow picture;

Here, in order to ensure the clarity of subsequent photos taken, the screen area displayed as a full-screen yellow screen can be illuminated by controlling the light source to fill in the screen area displayed as a full-screen yellow screen;

The third shooting module is used to display the bright screen of the screen as a full-screen white picture, and control the light source to illuminate the screen area displayed as a full-screen white picture, and take a second photo containing the screen area displayed as a full-screen white picture;

Here, in order to ensure the clarity of subsequent photos taken, the screen area displayed as a full-screen white screen can be illuminated by controlling the light source to fill in the screen area displayed as a full-screen white screen;

The detection module is configured to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, and if so, determine that there are cracks or scratches on the screen.

Here, the display clarity of different types of cracks or scratches will be different in the screen area full of white screens or the screen area of full screen yellow screens. The first photo, and the second photo including the screen area displayed as a full-screen white screen, to ensure the clarity of different types of screen cracks or scratches taken later.

If cracks or scratches are detected in one of the first photos or the second photos, it can be determined that there are cracks or scratches on the screen.

In the present invention, the bright screen is displayed as a picture with a white background, and the screen position of the device can be positioned simply and accurately based on the boundary of the picture with a white background. In addition, the present invention respectively takes the first photo containing the screen area displayed as a full-screen yellow screen, and the second photo containing the screen area displayed as a full-screen white screen, so as to facilitate subsequent reliable identification in the first photo or the second photo Different kinds of screen cracks or scratches within the range enclosed by the outline of the screen.

In an embodiment of the screen detection device of the present invention, the identification module is used to convert the photo src into a grayscale image gray; specify a preset pixel threshold T1 to segment the grayscale image gray, wherein the Set the pixel value of the pixel points exceeding the preset pixel threshold T1 in the photo src to 255, and set the pixel value of the pixel points in the photo src not exceeding the preset pixel threshold T1 to 0; obtain the In the grayscale image gray, the pixel value is 255 in the continuous area of each pixel point; calculate the number of pixels in the continuous area of each pixel point, and filter the continuous area of each pixel point, and discard the pixel point A region in which the number of pixels is less than the preset number threshold T2 is continuous, and a region in which the number of pixels is greater than or equal to the preset number threshold T2 is continuous; calculate the minimum value of each retained pixel point in the region The area of the circumscribed rotating rectangle is calculated by calculating the fullness s of the smallest circumscribed rotated rectangle in the continuous area of each reserved pixel point, where the fullness s=the number of pixels in a certain reserved pixel point continuous area/the The area of the smallest circumscribed rotating rectangle in the area of continuous pixels retained; the area of continuous pixels retained with the fullness s greater than the preset fullness threshold T3 is used as the boundary of the white background picture, and the boundary is used as the boundary of the white background picture to describe the outline of the screen.

Here, if a certain pixel is in the 8-neighborhood of another pixel, the two can be considered to be continuous, and two or more consecutive pixels can form a continuous pixel area;

A pixel with a pixel value of 0 is a black pixel, a pixel with a value of 255 is a white pixel, and the connection area of a pixel with a pixel value of 0 does not need to be considered, and it is regarded as the background outside the screen area;

It is possible to traverse each area where each reserved pixel is continuous, and divide the number of pixels in each area where each reserved pixel is continuous by the area of the smallest circumscribed rotating rectangle to obtain the fullness s of the area. If a reserved If the fullness s value of the area with continuous pixels is greater than the preset fullness threshold T3, it is a screen area, and if it is smaller, it is a non-screen area.

In this implementation, the gray-scale image gray is segmented by specifying a preset pixel threshold T; the number of pixels in the area where each pixel is continuous is calculated, and each area where each pixel is continuous is screened; The area of the minimum circumscribed rotating rectangle of the continuous pixel point area, calculate the fullness s of the minimum circumscribed rotated rectangle in the continuous pixel point area of each reserved; set the fullness s greater than the preset fullness threshold T3 of the reserved pixels The continuous area is used as the boundary of the white background image, and the boundary is used as the outline of the screen, so that the screen positions of various terminals can be accurately and reliably identified.

In an embodiment of the screen detection device of the present invention, the detection module is used to detect whether there are cracks or scratches in the area surrounded by the outline of the screen in the first photo or the second photo, and if so, The length of each crack or scratch is calculated, and if the length of a certain crack or scratch exceeds a preset length threshold, it is determined that there is a crack or scratch on the screen.

Here, by calculating the length of each crack or scratch, the cracks or scratches that meet the requirements can be reliably screened, so as to accurately determine whether the screen has cracks or scratches.

In an embodiment of the screen detection device of the present invention, the detection module is used to detect whether there are cracks or scratches in the area surrounded by the outline of the screen in the first photo or the second photo, and if so, The number of cracks or scratches is calculated, and if the number of cracks or scratches exceeds a preset number threshold, it is determined that there are cracks or scratches on the screen.

Here, by counting the number of each crack or scratch, the cracks or scratches that meet the requirements can be reliably screened, so as to accurately determine whether the screen has cracks or scratches.

In an embodiment of the screen detection device of the present invention, the detection module is used to detect whether there are cracks or scratches in the area surrounded by the outline of the screen in the first photo or the second photo, and if so, The length of each crack or scratch is calculated, and if the number of cracks or scratches whose length exceeds the preset length threshold exceeds the preset number threshold, it is determined that there is a crack or scratch on the screen.

Here, by calculating the length of each crack or scratch, and calculating whether the number of cracks or scratches whose length exceeds the preset length threshold exceeds the preset number threshold, cracks or scratches that meet the requirements can be reliably screened to facilitate It is more accurate to determine whether the screen has cracks or scratches.

According to another aspect of the present invention, there is also provided a computing-based device, comprising:

processor; and

A memory arranged to store computer-executable instructions that, when executed, cause the processor to:

Display the bright screen as a white background image;

taking a photo of the mobile phone screen including said white background picture;

Recognizing the boundary of the white background picture from the photo, using the boundary as the outline of the screen;

Display the bright screen as a full-screen yellow screen, and control the light source to illuminate the screen area that is displayed as a full-screen yellow screen;

Take the first photo of the area of the screen that includes the area of the screen shown as a full-screen yellow screen;

Display the bright screen as a full-screen white screen, and control the light source to illuminate the screen area displayed as a full-screen white screen;

Take a second photo that includes the area of the screen that appears as a full-screen white image;

Detecting whether there are cracks or scratches in the area enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches in the screen.

According to another aspect of the present invention, there is also provided a computer-readable storage medium on which computer-executable instructions are stored, wherein, when the computer-executable instructions are executed by a processor, the processor:

Display the bright screen as a white background image;

taking a photo of the mobile phone screen including said white background picture;

Recognizing the boundary of the white background picture from the photo, using the boundary as the outline of the screen;

Display the bright screen as a full-screen yellow screen, and control the light source to illuminate the screen area that is displayed as a full-screen yellow screen;

Take the first photo of the area of the screen that includes the area of the screen shown as a full-screen yellow screen;

Display the bright screen as a full-screen white screen, and control the light source to illuminate the screen area displayed as a full-screen white screen;

Take a second photo that includes the area of the screen that appears as a full-screen white image;

Detecting whether there are cracks or scratches in the area enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches in the screen.

For detailed content of each device and storage medium embodiment of the present invention, refer to corresponding parts of each method embodiment specifically, and details are not repeated here.

Compared with the prior art, the present invention displays the bright screen as a white background picture, and the screen position of the device can be positioned simply and accurately based on the boundary of the white background picture. In addition, the grayscale image gray is segmented by specifying a preset pixel threshold T1; calculating the number of pixels in the continuous area of each pixel, and filtering the continuous area of each pixel; calculating each reserved The area of the minimum circumscribed rotating rectangle of the continuous pixel point area, calculate the fullness s of the minimum circumscribed rotated rectangle in the continuous pixel point area of each reserved; set the fullness s greater than the preset fullness threshold T3 of the reserved pixels The continuous area is used as the boundary of the white background image, and the boundary is used as the outline of the screen, so that the screen positions of various terminals can be accurately and reliably identified.

Obviously, those skilled in the art can make various changes and modifications to the application without departing from the spirit and scope of the application. In this way, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

It should be noted that the present invention can be implemented in software and/or a combination of software and hardware, for example, it can be implemented by an application specific integrated circuit (ASIC), a general purpose computer or any other similar hardware devices. In one embodiment, the software program of the present invention can be executed by a processor to realize the steps or functions described above. Likewise, the software program (including associated data structures) of the present invention can be stored in a computer-readable recording medium such as RAM memory, magnetic or optical drive or floppy disk and the like. In addition, some steps or functions of the present invention may be implemented by hardware, for example, as a circuit that cooperates with a processor to execute each step or function.

In addition, a part of the present invention can be applied as a computer program product, such as a computer program instruction. When it is executed by a computer, the method and/or technical solution according to the present invention can be invoked or provided through the operation of the computer. The program instructions for invoking the method of the present invention may be stored in a fixed or removable recording medium, and/or transmitted through broadcasting or data streams in other signal-carrying media, and/or stored in the in the working memory of the computer device on which the program instructions described above are executed. Here, an embodiment according to the present invention comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, a trigger The operation of the device is based on the foregoing methods and/or technical solutions according to multiple embodiments of the present invention.

It will be apparent to those skilled in the art that the invention is not limited to the details of the above-described exemplary embodiments, but that the invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Accordingly, the embodiments should be regarded in all points of view as exemplary and not restrictive, the scope of the invention being defined by the appended claims rather than the foregoing description, and it is therefore intended that the scope of the invention be defined by the appended claims rather than by the foregoing description. All changes within the meaning and range of equivalents of the elements are embraced in the present invention. Any reference sign in a claim should not be construed as limiting the claim concerned. In addition, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means stated in the device claims may also be realized by one unit or device through software or hardware. The words first, second, etc. are used to denote names and do not imply any particular order.

Claims (10)

1. A screen detection method, wherein the method comprises: Display the bright screen as a white background image; taking a photo of the mobile phone screen including said white background picture; Recognizing the boundary of the white background picture from the photo, using the boundary as the outline of the screen; Display the bright screen as a full-screen yellow screen, and control the light source to illuminate the screen area that is displayed as a full-screen yellow screen; Take the first photo of the area of the screen that includes the area of the screen shown as a full-screen yellow screen; Display the bright screen as a full-screen white screen, and control the light source to illuminate the screen area displayed as a full-screen white screen; Take a second photo that includes the area of the screen that appears as a full-screen white image; Detecting whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches on the screen; Identifying the boundary of the white background picture from the photo, using the boundary as the outline of the screen, including: converting said photo to a grayscale image; Designate a preset pixel threshold T1 to segment the grayscale picture, wherein the pixel values of the pixels in the photo that exceed the preset pixel threshold T1 are set to 255, and the pixel values in the photos that do not exceed the preset pixel threshold T1 are set to 255. Set the pixel value of the pixel point of the pixel threshold T1 to be 0; Obtain the continuous area of each pixel point in the grayscale image with a pixel value of 255; Calculate the number of pixels in the area where each pixel is continuous, and filter the area where each pixel is continuous, wherein the area where the number of pixels is less than the preset number threshold T2 is discarded is continuous, and Retaining a region where the number of pixels is greater than or equal to the preset number threshold T2 and the pixels are continuous; Calculate the area of the minimum circumscribed rotating rectangle of each retained pixel continuous region, and calculate the fullness s of the smallest circumscribed rotated rectangle of each retained pixel continuous region, where fullness s=a certain reserved pixel The number of pixels in the continuous area/the area of the smallest circumscribed rotating rectangle of the reserved pixel continuous area; The area where the reserved pixels are continuous with the fullness s greater than the preset fullness threshold T3 is taken as the boundary of the white background picture, and the boundary is taken as the outline of the screen. 2. The method according to claim 1, wherein it is detected whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, and if there is, it is determined that the screen exists Cracks or scratches, including: Detect whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, and if so, calculate the length of each crack or scratch, if a certain crack or scratch is If the length exceeds the preset length threshold, it is determined that there is a crack or scratch on the screen. 3. The method according to claim 1, wherein it is detected whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, and if there is, it is determined that the screen exists Cracks or scratches, including: Detect whether there are cracks or scratches in the range surrounded by the outline of the screen in the first photo or the second photo, if there are, calculate the number of cracks or scratches, if the number of cracks or scratches exceeds If the number threshold is preset, it is determined that there are cracks or scratches on the screen. 4. The method according to claim 1, wherein it is detected whether there are cracks or scratches in the range enclosed by the outline of the screen in the first photo or the second photo, and if there is, it is determined that the screen exists Cracks or scratches, including: Detecting whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, if there is, calculating the length of each crack or scratch, if the length exceeds the preset length threshold If the number of cracks or scratches exceeds the preset number threshold, it is determined that there are cracks or scratches on the screen. 5. A screen detection device, wherein the device comprises: The display module is used to display the bright screen as a white background image; The first photographing module is used to photograph the photograph of the mobile phone screen that comprises described white background picture; An identification module, configured to convert the photo into a grayscale image; specify a preset pixel threshold T1 to segment the grayscale image, wherein pixels in the photo that exceed the preset pixel threshold T1 are The value is set to 255, and the pixel value of the pixel that does not exceed the preset pixel threshold T1 in the photo is set to 0; obtain the continuous area of each pixel with a pixel value of 255 in the grayscale picture; calculate each The number of pixels in the area where the pixels are continuous, and each area where the pixels are continuous is screened, wherein the area where the number of pixels is less than the preset number threshold T2 is discarded is continuous, and the pixels are retained The area where the number of points is greater than or equal to the preset number threshold T2 is a continuous pixel point; calculate the area of the smallest circumscribed rotating rectangle of each retained pixel point continuous area, and calculate the minimum circumscribed area of each retained pixel point continuous area The fullness s of the rotating rectangle, wherein, the fullness s=the number of pixels in a certain reserved pixel point continuous area/the area of the minimum circumscribed rotating rectangle of the reserved pixel point continuous area; the fullness s is greater than the preset fullness threshold value T3, the area where the reserved pixels are continuous is used as the boundary of the white background picture, and the boundary is used as the outline of the screen; The second shooting module is used to display the bright screen of the screen as a full-screen yellow picture, and control the light source to illuminate the screen area displayed as a full-screen yellow picture, and shoot the first photo containing the screen area displayed as a full-screen yellow picture; The third shooting module is used to display the bright screen of the screen as a full-screen white picture, and control the light source to illuminate the screen area displayed as a full-screen white picture, and take a second photo containing the screen area displayed as a full-screen white picture; The detection module is configured to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, and if so, determine that there are cracks or scratches on the screen. 6. The device according to claim 5, wherein the detection module is configured to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, if If there is, the length of each crack or scratch is calculated, and if the length of a certain crack or scratch exceeds a preset length threshold, it is determined that there is a crack or scratch on the screen. 7. The device according to claim 5, wherein the detection module is configured to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, if If there is, the number of cracks or scratches is calculated, and if the number of cracks or scratches exceeds a preset number threshold, it is determined that there are cracks or scratches on the screen. 8. The device according to claim 5, wherein the detection module is configured to detect whether there are cracks or scratches within the range surrounded by the outline of the screen in the first photo or the second photo, if If there is, the length of each crack or scratch is calculated, and if the number of cracks or scratches whose length exceeds the preset length threshold exceeds the preset number threshold, it is determined that there is a crack or scratch on the screen. 9. A computing-based device, comprising: processor; and A memory arranged to store computer-executable instructions that, when executed, cause the processor to: Display the bright screen as a white background image; taking a photo of the mobile phone screen including said white background picture; Recognizing the boundary of the white background picture from the photo, using the boundary as the outline of the screen; Display the bright screen as a full-screen yellow screen, and control the light source to illuminate the screen area that is displayed as a full-screen yellow screen; Take the first photo of the area of the screen that includes the area of the screen shown as a full-screen yellow screen; Display the bright screen as a full-screen white screen, and control the light source to illuminate the screen area displayed as a full-screen white screen; Take a second photo that includes the area of the screen that appears as a full-screen white image; Detecting whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches on the screen; converting said photo to a grayscale image; Designate a preset pixel threshold T1 to segment the grayscale picture, wherein the pixel values of the pixels in the photo that exceed the preset pixel threshold T1 are set to 255, and the pixel values in the photos that do not exceed the preset pixel threshold T1 are set to 255. Set the pixel value of the pixel point of the pixel threshold T1 to be 0; Obtain the continuous area of each pixel point in the grayscale image with a pixel value of 255; Calculate the number of pixels in the area where each pixel is continuous, and filter the area where each pixel is continuous, wherein the area where the number of pixels is less than the preset number threshold T2 is discarded is continuous, and Retaining a region where the number of pixels is greater than or equal to the preset number threshold T2 and the pixels are continuous; Calculate the area of the minimum circumscribed rotating rectangle of each retained pixel continuous region, and calculate the fullness s of the smallest circumscribed rotated rectangle of each retained pixel continuous region, where fullness s=a certain reserved pixel The number of pixels in the continuous area/the area of the smallest circumscribed rotating rectangle of the reserved pixel continuous area; The area where the reserved pixels are continuous with the fullness s greater than the preset fullness threshold T3 is taken as the boundary of the white background picture, and the boundary is taken as the outline of the screen. 10. A computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions, when executed by a processor, cause the processor to: Display the bright screen as a white background image; taking a photo of the mobile phone screen including said white background picture; Recognizing the boundary of the white background picture from the photo, using the boundary as the outline of the screen; Display the bright screen as a full-screen yellow screen, and control the light source to illuminate the screen area that is displayed as a full-screen yellow screen; Take the first photo of the area of the screen that includes the area of the screen shown as a full-screen yellow screen; Display the bright screen as a full-screen white screen, and control the light source to illuminate the screen area displayed as a full-screen white screen; Take a second photo that includes the area of the screen that appears as a full-screen white image; Detecting whether there are cracks or scratches within the range enclosed by the outline of the screen in the first photo or the second photo, and if so, determining that there are cracks or scratches on the screen; converting said photo to a grayscale image; Designate a preset pixel threshold T1 to segment the grayscale picture, wherein the pixel values of the pixels in the photo that exceed the preset pixel threshold T1 are set to 255, and the pixel values in the photos that do not exceed the preset pixel threshold T1 are set to 255. Set the pixel value of the pixel point of the pixel threshold T1 to be 0; Obtain the continuous area of each pixel point in the grayscale image with a pixel value of 255; Calculate the number of pixels in the area where each pixel is continuous, and filter the area where each pixel is continuous, wherein the area where the number of pixels is less than the preset number threshold T2 is discarded is continuous, and Retaining a region where the number of pixels is greater than or equal to the preset number threshold T2 and the pixels are continuous; Calculate the area of the minimum circumscribed rotating rectangle of each retained pixel continuous region, and calculate the fullness s of the smallest circumscribed rotated rectangle of each retained pixel continuous region, where fullness s=a certain reserved pixel The number of pixels in the continuous area/the area of the smallest circumscribed rotating rectangle of the reserved pixel continuous area; The area where the reserved pixels are continuous with the fullness s greater than the preset fullness threshold T3 is taken as the boundary of the white background picture, and the boundary is taken as the outline of the screen.

Images