Disclosure of Invention
In order to solve or improve the problems existing in the prior art, embodiments of the present application provide an automatic detection method, apparatus, and system for a display device.
In one embodiment of the present application, an automatic detection method of a display device is provided. The method is applied to a server device and comprises the steps of sending a first image to at least one display device in a first space to control the at least one display device to display the first image, obtaining a second image acquired in the first space, wherein the second image contains a display screen of the at least one display device, detecting the number of the first image in the second image by using a target detection model, obtaining a second number of the at least one display device in the first space, and determining a detection result for the display device in the first space according to the first number and the second number.
Preferably, acquiring the second image acquired in the first space comprises acquiring video information acquired in the first space and extracting at least one frame of image from the video information as the second image.
The method comprises the steps of acquiring video information acquired in a first space, generating a second control instruction according to a preset automatic detection task, wherein the second control instruction is used for controlling an image acquisition device to acquire the video information of at least one display device, sending the second control instruction to the image acquisition device, and receiving the video information fed back by the image acquisition device.
Preferably, determining the detection result for at least one display device in the first space according to the first number and the second number comprises determining that at least part of display devices in the first space are normal when the first number is the same as the second number, determining the number of abnormal display devices in the first space according to the difference between the first number and the second number when the first number is different from the second number, and taking the number of abnormal display devices as the detection result.
Preferably, when the first number is different from the second number, the method further comprises the steps of obtaining reference pictures of the specified images displayed by the display devices in the first space, determining the positions of blocks in the second image, where the first images are not displayed, by comparing the reference pictures with the second images, determining the identifications of the abnormal display devices according to the identifications of all the display devices in the first space and the association relation of the positions of the blocks of the display devices in the reference pictures, and adding the identifications of the abnormal display devices in the detection result.
The method comprises the steps of sending a first image to at least one display device in a first space, and generating a first control instruction according to a preset automatic detection task, wherein the first control instruction carries the first image, and sending the first control instruction to a control middle end of the display device so that the control middle end controls the at least one display device to display the first image.
Preferably, the method further comprises the steps of sending detection notification information to the client device according to the detection result of the display device in the first space, or obtaining the detection result of the display device in the at least one second space, and sending the detection notification information to the client device according to the detection result of the display device in the first space and the detection result of the display device in the at least one second space.
In another embodiment of the present application, an automatic detection apparatus of a display device is provided. The device comprises a sending module, an acquisition module, a detection module and a determination module, wherein the sending module is used for sending a first image to at least one display device in a first space to control the at least one display device to display the first image, the acquisition module is used for acquiring a second image acquired in the first space, the second image comprises a display screen of the at least one display device, the detection module is used for detecting the first quantity of the first image in the second image by utilizing a target detection model, the acquisition module is also used for acquiring the second quantity of the at least one display device in the first space, and the determination module is used for determining the detection result of the display device in the first space according to the first quantity and the second quantity.
In yet another embodiment of the present application, an automatic detection system for a display device is provided. The system is used for executing the automatic detection method of the display equipment, and comprises a server side equipment, at least one display equipment, a server side equipment, a target detection model and a detection result determining unit, wherein the server side equipment is used for sending a first image to at least one display equipment in a first space, the at least one display equipment is used for displaying the first image, the server side equipment is also used for acquiring a second image acquired in the first space, the number of the first image in the second image is detected by the target detection model, the second number of the display equipment in the first space is acquired, and the detection result for the display equipment in the first space is determined according to the first number and the second number.
Preferably, the system further comprises an image acquisition device, wherein the image acquisition device is used for acquiring video information in the first space. Correspondingly, the server device is also used for acquiring video information acquired in the first space, and extracting at least one frame of image from the video information as a second image.
The server device generates a second control instruction according to a preset automatic detection task, wherein the second control instruction is used for controlling the image acquisition device to acquire video information of at least one display device, sending the second control instruction to the image acquisition device, and receiving the video information fed back by the image acquisition device.
Preferably, the system further comprises a control middle end, a server device and at least one display device, wherein the server device is further used for generating a first control instruction according to a preset automatic detection task, the first control instruction carries a first image, the first control instruction is sent to the control middle end of the display device, and the control middle end is used for controlling the at least one display device to display the first image according to the received first control instruction.
Preferably, the server device is specifically configured to determine that at least part of the display devices in the first space are normal when the first number is the same as the second number when the detection result for the display devices in the first space is determined according to the first number and the second number, and determine the number of abnormal display devices in the first space according to the difference between the first number and the second number when the first number is different from the second number, and take the number of abnormal display devices as the detection result.
Preferably, the system further comprises a client device, a server device, a client device and a client device, wherein the server device is further used for sending detection notification information to the client device according to the detection result of the display device in the first space, or obtaining the detection result of the display device in the at least one second space, sending detection notification information to the client device according to the detection result of the display device in the first space and the detection result of the display device in the at least one second space, and the client device is used for receiving and displaying the detection notification information.
According to the technical scheme provided by the embodiment of the application, firstly, the server side equipment controls the display equipment of each area to play the designated picture, the image acquisition equipment acquires the video stream of the designated image displayed by the display equipment of each area, whether the designated picture appears in the picture is detected through the target detection model, so that the detection efficiency is improved, secondly, the robustness of the scheme is better, the scheme can adapt to various environments and is not influenced by ambient light completely, in addition, whether the whole picture is normal or not is detected, the situation that the picture of a certain area in a screen is detected only by a photosensitive device in the traditional scheme, the error detection in a partial or complete way appears can be avoided, the detection accuracy is improved, and thirdly, whether the display equipment is abnormal or not can be rapidly judged by comparing whether the number of the display pictures obtained through analysis is consistent with the number of actual equipment or not, and only the image acquisition equipment is needed, so that the detection efficiency is improved, and the detection cost is saved.
Detailed Description
The present application provides the following embodiments to solve or partially solve the problems with the above-described solutions. In order to enable those skilled in the art to better understand the present application, the following description will make clear and complete descriptions of the technical solutions according to the embodiments of the present application with reference to the accompanying drawings.
In some of the flows described in the description of the application, the claims, and the figures described above, a number of operations occurring in a particular order are included, and the operations may be performed out of order or concurrently with respect to the order in which they occur. The sequence numbers of operations such as 101, 102, etc. are merely used to distinguish between the various operations, and the sequence numbers themselves do not represent any order of execution. In addition, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first" and "second" herein are used to distinguish different messages, devices, modules, etc., and do not represent a sequence, and are not limited to the "first" and the "second" being different types. Furthermore, the embodiments described below are only some, but not all, embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Fig. 1 is a schematic flow chart of a method for automatically detecting a display device according to an embodiment of the present application, where an execution subject of the method may be a server device. As shown in fig. 1, the method includes:
101. Transmitting the first image to at least one display device in the first space to control the at least one display device to display the first image;
102. Acquiring a second image acquired in the first space, wherein the second image contains at least one display screen of display equipment;
103. Detecting, using the object detection model, a first number of occurrences of the first image in the second image;
104. acquiring a second number of at least one display device in the first space;
105. And determining a detection result for the display device in the first space according to the first quantity and the second quantity.
According to the technical scheme provided by the embodiment of the application, firstly, the server side equipment controls the display equipment of each area to play the designated picture, the image acquisition equipment acquires the video stream of the designated image displayed by the display equipment of each area, whether the designated picture appears in the picture is detected through the target detection model, so that the detection efficiency is improved, secondly, the robustness of the scheme is better, the scheme can adapt to various environments and is not influenced by ambient light completely, in addition, whether the whole picture is normal or not is detected, the situation that the picture of a certain area in a screen is detected only by a photosensitive device in the traditional scheme, the error detection in a partial or complete way appears can be avoided, the detection accuracy is improved, and thirdly, whether the display equipment is abnormal or not can be rapidly judged by comparing whether the number of the display pictures obtained through analysis is consistent with the number of actual equipment or not, and only the image acquisition equipment is needed, so that the detection efficiency is improved, and the detection cost is saved.
In step 101, at least one display device may be one display device or a plurality of display devices. When a plurality of display devices are contained in the first space, the contents of the images of the first images transmitted to the plurality of display devices may be different, or the contents of the first images transmitted to the plurality of display devices may be the same. In this embodiment, the first space may be a classroom of a school, the display device may be a computer, a projector, a smart blackboard, etc., and the first image may be a special graphic, logo, letter, text, etc. When a plurality of display devices are included in the same space, the display devices in the same space may be the same display device or may be different display devices, and the plurality of display devices may all display the same picture, or the plurality of display devices may display different pictures, or may display the same picture by a part of display devices, which is not limited in this embodiment.
The step 102, the "acquiring the second image acquired in the first space" may be implemented by:
1021. acquiring video information acquired in a first space;
1022. at least one frame of image is extracted from the video information as a second image.
In the step 1021, the acquired video information is a video stream acquired by the camera, the video stream can be understood as a video after the camera rotates 360 degrees to shoot the first space, and 360 degrees of dead angle-free shooting enables the information in the video to be more complete, so that the condition that the display equipment in the first space is missed can be avoided. In addition, the embodiment does not need to use a photosensitive device or other professional analysis cameras, and only needs to collect by using the existing image acquisition equipment in the classroom, so that the cost is saved.
In step 1022, the second image includes at least part of the display screen of the display device in the first space, that is, the display function of at least part of the display device in the first space is normal. Wherein at least part of the display devices may be one display device in the first space, or a plurality of display devices in the first space, or all display devices in the first space. The number of display devices is based at least in part on the actual detection requirements and is not particularly limited herein.
In step 103, the target detection model may be a specific target detection algorithm, or may be other image recognition algorithms, such as a CDN (Content Delivery Network ) image algorithm, which is not limited in this embodiment. According to the embodiment, the automatic inspection of the classroom display equipment can be completed by using the target detection model, the target detection model is not limited to application scenes and light rays, and the robustness is high.
In the step 104, the second number is the number of at least part of the display devices in the first space to be detected.
The specific determining process of the step 105 "determining the detection result for at least one display device in the first space according to the first number and the second number" is:
When all display devices in the first space are detected (namely, the second quantity is the quantity of all display devices in the first space), if the first quantity is the same as the second quantity, the detection result can be determined that all display devices in the first space are normal, and if the first quantity is different from the second quantity, the quantity of abnormal display devices in the first space can be determined according to the difference between the first quantity and the second quantity, and the quantity of abnormal display devices is taken as the detection result. For example, the second number is a, the first number is B, and then the number of abnormal display devices in the first space is a-B (a > B).
When detecting part of the display devices in the first space (namely, the second number is the number of part of the display devices in the first space), if the first number is the same as the second number, the detection result can be determined that the currently detected display devices in the first space are normal, and if the first number is different from the second number, the number of abnormal display devices in the currently detected display devices in the first space can be determined according to the difference between the first number and the second number, and the number of the abnormal display devices is taken as the detection result. As above, for example, the second number is a, the first number is B, and then the number of abnormal display devices in the first space is a-B (a > B).
Further, when the first number is different from the second number, in the embodiment of the application, reference pictures of the specified images can be obtained, which are normally displayed by the display devices in the first space, the block positions of the second image, which are not displayed by the first image, can be determined by comparing the reference pictures with the second image, the identification of the abnormal display devices is determined according to the identifications of all the display devices in the first space and the association relation of the block positions of the display devices in the reference pictures, and the identification of the abnormal display devices is added in the detection result.
Specifically, the server side device stores reference pictures for normally displaying the specified pictures by the display devices in the first space, and the block where the relative positions of the display devices in the first space are located in the reference pictures and the device identifiers of the display devices of the block are stored in a correlated mode, so that the display conditions of the display devices in a certain area can be counted conveniently, and maintenance staff can acquire the specific information of the display devices conveniently. The device identification of the display device at least comprises an ID, a model and a device name of the display device.
In this embodiment, the server device controls the display device to work through the control middle end of the display device, so that the server device sends the first image to at least one display device in the first space, and specifically includes the steps of generating a first control instruction according to a preset automatic detection task, wherein the first control instruction carries the first image, and then sending the first control instruction to the control middle end of the display device, so that the control middle end controls the at least one display device to display the first image.
In this embodiment, the server device directly controls the image acquisition device to acquire video information, so that the video information acquired in the first space is acquired, and specifically includes the steps of generating a second control instruction according to a preset automatic detection task, where the second control instruction is used to control the image acquisition device to acquire video information of at least one display device, then sending the second control instruction to the image acquisition device, and receiving the video information fed back by the image acquisition device.
Further, the method further comprises the steps of:
The method comprises the steps of receiving detection notification information from a client device, sending the detection notification information to the client device according to the detection result of the display device in the first space, or obtaining the detection result of at least one display device in the second space, and sending the detection notification information to the client device according to the detection result of the display device in the first space and the detection result of the display device in the at least one second space, so that a worker can timely grasp the detection result of the display device in each space and maintain the display device according to the detection result.
In an embodiment of the present application, the at least one second space may be other space of a certain area than the first space. Taking a school as an example, the first space is one of classrooms of the school with display devices, and the at least one second space is the other classrooms of the school with display devices except the one classroom.
The automatic detection of the display device will be described below by taking the first space and at least one second space as school classrooms as an example.
As shown in fig. 2, after receiving the detection task of the classroom display device, the server device controls the control middle end of all classrooms to turn on the classroom computer and other display devices, and then each classroom computer and other display devices displays a designated picture sent by the server. When the display equipment displays the appointed pictures, the image acquisition equipment in the classroom, such as a camera, starts to rotate and acquire videos of the appointed pictures displayed by the display equipment in the classroom, then the server equipment acquires video streams acquired by the image acquisition equipment, and the acquired video streams are analyzed by utilizing the target detection model to determine the quantity of the appointed pictures displayed by the display equipment in each classroom. Judging whether the number of the designated pictures displayed by each classroom display device is consistent with the number of the display devices which are required to be detected at least partially in the corresponding classrooms, if so, determining that the display devices and computers which are required to be detected at least partially in the classrooms are all operating normally, then outputting detection results of all classrooms, sending the detection results to the client device, and ending the detection, and if not, determining the identification of the abnormal display device according to the identification of the display devices which are required to be detected at least partially in the classrooms and the association relation of the positions of the classroom blocks where the display devices are located in the reference pictures, adding the identification of the abnormal display device in the detection results, and sending the results to the client device, and ending the detection.
Fig. 3 is a schematic structural diagram of an automatic detection device of a display apparatus according to an embodiment of the present application. As shown in fig. 3, the apparatus includes:
a transmitting module 31 for transmitting the first image to at least one display device in the first space to control the at least one display device to display the first image;
an acquisition module 32, configured to acquire a second image acquired in the first space, where the second image contains at least one display screen of the display device;
a detection module 33 for detecting the number of first images present in the second image using the object detection model;
An acquisition module 32, configured to acquire a second number of at least one display device in the first space;
the determining module 34 is configured to determine a detection result for the display device in the first space according to the first number and the second number.
Further, when a plurality of display devices are contained in the first space, the contents of the images of the first images transmitted to the plurality of display devices are different, or the contents of the first images transmitted to the plurality of display devices are the same.
Further, the acquiring module 32 is mainly used for acquiring video information acquired in the first space when acquiring the second image acquired in the first space, and extracting at least one frame of image from the video information as the second image.
Further, the determining module 34 is configured to determine, when the detection result for at least one display device in the first space is determined according to the first number and the second number, specifically, determine that at least part of the display devices in the first space are normal when the first number is the same as the second number, and determine, when the first number is different from the second number, the number of abnormal display devices in the first space according to a difference between the first number and the second number, and take the number of abnormal display devices as the detection result.
Further, when the first number is different from the second number, the obtaining module 32 is further configured to obtain a reference picture in which the display devices in the first space all normally display the specified image, determine a block position in the second image where the first image is not displayed by comparing the reference picture with the second image, determine an identifier of the abnormal display device according to an association relationship between an identifier of at least part of the display devices in the first space and a position of the block where each display device is located in the reference picture, and add the identifier of the abnormal display device to the detection result.
Further, the sending module 31 is specifically configured to generate a first control instruction according to a preset automatic detection task when being configured to send the first image to at least one display device in the first space, where the first control instruction carries the first image. Correspondingly, the sending module 31 is further configured to send a first control instruction to the control middle end of the display device, so that the control middle end controls at least one display device to display the first image.
Further, the acquiring module 32 is specifically configured to generate a second control instruction according to a preset automatic detection task when acquiring the video information acquired in the first space, where the second control instruction is used to control the image acquisition device to acquire the video information of the at least one display device, and the corresponding transmitting module 31 is further configured to transmit the second control instruction to the image acquisition device, so that the image acquisition device acquires the video information of the at least one display device.
Further, the sending module 31 is further configured to send detection notification information to the client device according to a detection result of the display device in the first space, or the obtaining module 32 is further configured to obtain a detection result for at least one display device in the at least one second space. Correspondingly, the sending module 31 is further configured to send detection notification information to the client device according to the detection result of the display device in the first space and the detection result of the display device in the at least one second space.
Preferably, the identification of the display device includes at least an IP address of the display device, a device model number, and a device name.
It should be noted that, the automatic detection device for a display device provided in the foregoing embodiments may implement the technical solutions described in the foregoing method embodiments, and the specific implementation principles of the foregoing modules or units may refer to corresponding contents in the foregoing method embodiments, which are not repeated herein.
Fig. 4 is a schematic structural diagram of an automatic detection system of a display device according to an embodiment of the present application. As shown in fig. 4, the system includes:
A server device 41, configured to send a first image to at least one display device in the first space;
at least one display device 42 for displaying the first image;
The server device 41 is further configured to acquire a second image acquired in the first space, detect, using the target detection model, a number of first images appearing in the second image, acquire a second number of display devices in the first space, and determine a detection result for the display devices in the first space according to the first number and the second number.
Preferably, the system further comprises:
The image acquisition device 43 is configured to acquire video information in the first space, and correspondingly, the server device 41 is further configured to acquire the video information acquired in the first space, and extract at least one frame of image from the video information as the second image.
Preferably, the server device 41 is further configured to generate a second control instruction according to a preset automatic detection task, where the second control instruction is used to control the image capturing device 43 to capture video information of at least one display device 42, send the second control instruction to the image capturing device 43, and receive the video information fed back by the image capturing device 43.
Preferably, the system further comprises a control middle end 44, a server device 41 further configured to generate a first control instruction according to a preset automatic detection task, wherein the first control instruction carries a first image, the first control instruction is sent to the control middle end 44 of the display device 42, and the control middle end 44 is configured to control at least one display device 42 to display the first image according to the received first control instruction.
Preferably, the server device 41 is further configured to determine that at least part of the display devices in the first space are normal when the first number is the same as the second number, and determine the number of abnormal display devices in the first space according to the difference between the first number and the second number when the first number is different from the second number, and take the number of abnormal display devices as the detection result.
Preferably, the system further comprises a client device 45, a server device 41, which is further used for sending detection notification information to the client device 45 according to the detection result of the first in-space display device 42, or obtaining the detection result of the at least one second in-space display device 42, and sending detection notification information to the client device 45 according to the detection result of the first in-space display device and the detection result of the at least one second in-space display device. Correspondingly, the client device 45 is further configured to receive and display the detection notification information.
The automatic detection system of the display device will be described below taking a classroom as an example.
Fig. 5 is a schematic structural diagram of display devices, control center devices and server devices in classrooms of a school. The control module of the server equipment sends control instructions to the control middle end of each classroom, and the control end sends control information to each classroom after receiving the control instructions so as to control the opening of the corresponding classroom computers and other display equipment associated with the computers. Wherein, the classrooms are related through a school local area network. Because the appointed picture is displayed by controlling the classroom computer through the server equipment, the method not only can be used for judging the normal display equipment of the classroom, but also can further confirm that the computer connected with the display equipment in the classroom is normal. After receiving the designated picture sent by the server device, computers and other display devices in classrooms display the designated picture. The control module of the server equipment controls the image acquisition device to acquire video streams of the appointed pictures displayed by the classroom display equipment, the video acquisition module of the server equipment acquires the video streams, the target detection module of the server equipment detects the video streams, and the output module of the server equipment outputs detection results after the detection is completed.
It should be noted that, the automatic detection system of the display device provided in the foregoing embodiments may implement the technical solutions described in the foregoing method embodiments, and the specific implementation principles of the foregoing modules or units may be referred to the corresponding content in the foregoing method embodiments, which is not repeated herein.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by adding necessary general purpose hardware platforms, or may be implemented by a combination of hardware and software. Based on such understanding, the foregoing aspects, in essence and portions contributing to the art, may be embodied in the form of a computer program product, which may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable coordinate determination device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable coordinate determination device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable coordinate determination device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable coordinate determination device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer implemented process such that the instructions which execute on the computer or other programmable device provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory, random Access Memory (RAM), and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (f.ash RAM), among other forms in computer readable media. Memory is an example of computer-readable media.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (trans i tory med i a), such as modulated data signals and carrier waves.
It should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present application, and not for limiting the same, and although the present application has been described in detail with reference to the above-mentioned embodiments, it should be understood by those skilled in the art that the technical solution described in the above-mentioned embodiments may be modified or some technical features may be equivalently replaced, and these modifications or substitutions do not make the essence of the corresponding technical solution deviate from the spirit and scope of the technical solution of the embodiments of the present application.