CN107257449B - A remote monitoring system based on cloud computing - Google Patents

Abstract

The invention relates to a remote monitoring system based on cloud computing, which comprises wireless communication equipment, CCD image sensing equipment, theater content acquisition equipment, content analysis equipment and illumination control equipment, wherein the CCD image sensing equipment is used for acquiring audience screen images, the theater content acquisition equipment is used for acquiring theater stage images, and the content analysis equipment is respectively connected with the CCD image sensing equipment and the theater content acquisition equipment and is used for determining a driving control signal based on the audience screen images and the theater stage images and sending the driving control signal to the illumination control equipment so as to facilitate the illumination control equipment to realize the control of the illumination equipment. By the invention, the intelligent control of the lighting equipment can be realized.

Description

A remote monitoring system based on cloud computing

technical field

The invention relates to the field of cloud computing, in particular to a remote monitoring system based on cloud computing.

Background technique

In order to identify and track pirated movies, some industry leaders have proposed anti-piracy through coding (CAP), which is to add watermarks to movies. The first coded anti-piracy was designed by Kodak and then improved by Deluxe Laboratories. Philips also proposed an identification system called CineFence in 2006. However, the watermarking technology is only a passive measure, and it cannot eliminate and prevent camera sneak shots. Camera jamming techniques, on the other hand, aim to eliminate camera candids by wreaking havoc on the visual quality of movies, while keeping these jamming signals from affecting theater audiences.

A large number of early camera jamming methods mainly used the principle that imaging sensors respond to infrared rays. In order to interfere with moving cameras and to create bright lights in the captured footage, infrared emitters are installed in movie theaters. Apart from the extra cost and overhead of those transmitters etc., this solution can be achieved by attaching appropriate filters to the lens. But this method is easy to be circumvented because of the choice of sneak photographers.

It can be seen that there is a need for a new anti-surveillance program for performance venues, which can electronically analyze the images of the auditorium and the live performance environment, and judge the candid photographer based on the two analysis results. The location information to remind the sneak shot.

Contents of the invention

In order to solve the above problems, the present invention provides a remote monitoring system based on cloud computing. The auditorium image acquisition equipment is installed on site to complete the extraction of auditorium images, and various image processing equipment and image analysis equipment are introduced to judge whether the auditorium images are Whether there is a suspicious candid photographer, if there is a suspicious candid photographer, extract the number of the seat where the suspicious candid photographer is located, and then perform real-time detection on the environmental parameters or current performance content on the spot, so as to Information and on-site detection results to determine the real sneak shot.

According to one aspect of the present invention, a remote monitoring system based on cloud computing is provided, the system includes wireless communication equipment, CCD image sensing equipment, theater content acquisition equipment, content analysis equipment and lighting control equipment, CCD image sensing equipment The device is used to collect the audience screen image, the theater content collection device is used to collect the theater stage image, the content analysis device is respectively connected with the CCD image sensing device and the theater content collection device, and is used to determine the driving control signal based on the audience screen image and the theater stage image , and send the drive control signal to the lighting control device so that the lighting control device can control the lighting device.

More specifically, in the remote monitoring system based on cloud computing, it includes: a wireless communication device connected to a content analysis device for wirelessly sending each screen sub-image and its corresponding seat number; a theater content collection device , set opposite to the theater stage, for real-time acquisition of scene images on the theater stage as real-time scene image output; content analysis equipment, set in the backstage control room of the theater, respectively connected with sub-screen splitting equipment and theater content acquisition equipment, used For receiving real-time scene images, it is also used to receive each screen sub-image and its corresponding seat number, and match each screen sub-image with the real-time scene image to determine the content matching percentage. When the content matching percentage is greater than or equal to the preset percentage When the threshold is reached, the seat number corresponding to the sub-image on the screen is output as the target seat number; Sunplus SPCE061A chip is installed in the backstage control room of the theater and is connected with the content analysis equipment to send out the driving control including the target seat number based on the target seat number Signal; motor drive equipment, installed in the backstage control room of the theater, connected with Sunplus SPCE061A chip and DC motor respectively, used to receive the drive control signal sent by Sunplus SPCE061A chip, and analyze the drive control signal to determine the target seat Numbering, based on the target seat number to determine the motor drive signal; Pan Tilt, set on the roof position directly above the theater stage, including equipment fixing brackets and DC motors, equipment fixing brackets are used to fix lighting equipment and DC motors, DC motors and motor drives Equipment connection, used to adjust the lighting direction of the lighting equipment driven by the motor drive signal, and send out a lighting start signal after the adjustment; the lighting equipment is fixed on the equipment fixing bracket and connected to the DC motor, including the lighting switch and lighting The light source and the lighting switch are respectively connected with the DC motor and the lighting source, and are used to automatically open to start the lighting of the lighting source after receiving the lighting start signal; the CCD image sensing device is arranged in the center of the theater roof, and is used to monitor the theater stage. The opposite auditorium performs image acquisition to output the target image; the data segmentation device, located in the cloud, is connected to the CCD image sensing device, and is used to divide the target image into N image blocks, where N is a natural number greater than 1; N cloud The storage device is located in the cloud and is connected to the data segmentation device for storing N image segments respectively; the cloud command channel management device is located in the cloud and is used for channel management of cloud commands; the cloud service center device is located in the cloud and communicates with N A cloud storage device connection is used to concentrate N image blocks and distribute N image blocks to M cloud application devices, where M is a natural number greater than 1 and M is less than or equal to N; M cloud application devices are located in the cloud , connected with the cloud service center equipment, used to receive the assigned image blocks, each cloud application equipment includes: grayscale processing sub-equipment, including channel parameter extraction unit, weighted value storage unit and grayscale value The calculation unit, the channel parameter extraction unit is used to receive each image block and extract each pixel in the image block The R channel pixel value, the G channel pixel value and the B channel pixel value of the point, the weighted value storage unit is used to pre-store the R channel weighted value, the G channel weighted value and the B channel weighted value, and the gray value calculation unit is connected with the channel parameters respectively The extraction unit is connected to the weighted value storage unit, and for each pixel in the image block, the product of the pixel value of the R channel and the weighted value of the R channel, the product of the pixel value of the G channel and the weighted value of the G channel, and the pixel value of the B channel and the B channel Add the products of channel weighted values to obtain the grayscale value of the targeted pixel, and obtain the grayscale image corresponding to the image block based on the grayscale value of each pixel in the image block; wherein, the R channel weighted value is 0.298839, the weighted value of the G channel is 0.586811, and the weighted value of the B channel is 0.114350; the histogram distribution detection sub-equipment is connected with the grayscale processing sub-equipment for receiving the grayscale image and processing the grayscale image Perform grayscale histogram processing to obtain the corresponding histogram image. When the histogram image presents a bimodal distribution, a global threshold selection signal is sent, otherwise, a non-global threshold selection signal is sent; the threshold selection sub-equipment, and the histogram distribution detector The device connection is used to output the global threshold 128 as threshold data when receiving the global threshold selection signal, and output the gray difference threshold of adjacent pixels 40 as the threshold data when receiving the non-global threshold selection signal; binary The processing sub-device is connected with the threshold selection sub-device and the histogram distribution detection sub-device respectively, and is used for when the global threshold selection signal is received, for each pixel in the grayscale image, when the gray value is greater than or equal to the threshold data, set the targeted pixel as a white level pixel, and when the grayscale value is less than the threshold data, set the targeted pixel as a black level pixel, and output the binarized image corresponding to the grayscaled image ; The binarization processing sub-equipment is also used to calculate the grayscale value of the pixel point that is 3 pixels away from it in the vertical direction for each pixel point in the grayscale image when receiving the non-global threshold selection signal as For the gray value of the upper pixel, calculate the gray value of the pixel that is 3 pixels away from it in the vertical direction as the gray value of the lower pixel, and calculate the gray value of the pixel that is 3 pixels away from it in the horizontal direction as The gray value of the left pixel, calculate the gray value of the pixel that is 3 pixels away from it in the horizontal direction as the gray value of the right pixel, when the absolute value of the difference between the gray value of the upper pixel and the gray value of the lower pixel is less than or equal to Threshold data and when the absolute value of the difference between the gray value of the left pixel and the gray value of the right pixel is less than or equal to the threshold data, set the targeted pixel as a white level pixel, when the gray value of the upper pixel and the gray value of the lower pixel When the absolute value of the difference is greater than the threshold data or the absolute value of the difference between the grayscale value of the left pixel and the grayscale value of the right pixel is greater than the threshold data, set the targeted pixel as a black level pixel and output the corresponding grayscale image The binarized image; the image smoothing processing sub-equipment is connected with the binarization processing sub-equipment for receiving the binarized image, for each pixel in the binarized image, when there is more than half of the trip point, the Then the gray value of the targeted pixel is retained, otherwise, the gray value of the targeted pixel is set as a white level pixel, and a smooth image corresponding to the binarized image is output; the data merging device is located in the cloud, and M cloud application device connections are used to stitch the smooth images output by the image smoothing sub-device of each cloud application device to obtain a smooth integrated image; the wavelet filtering device is set in the background control room of the theater and connected to the data merging device , for receiving a smooth integrated image, performing two-dimensional wavelet filtering processing on the smooth integrated image to obtain a filtered image; the sub-screen splitting device is set in the background control room of the theater, connected with the wavelet filtering sub-equipment to obtain a filtered image, and the filtered image Matching with pre-stored screen patterns of various mobile terminals to detect and segment each screen sub-image in the filtered image, and for each screen sub-image, determine the target screen sub-image corresponding to its position in the filtered image Seat number; wherein, the seat number corresponding to the screen sub-image is the theater seat number of the audience holding the mobile terminal corresponding to the screen sub-image; wherein, the content analysis device compares each screen sub-image with the real-time scene image Content matching to determine the content matching percentage specifically includes: identifying each object in the real-time scene image, and for each object, detecting whether it exists in the screen sub-image, the more objects exist in the screen sub-image, the content matches The higher the percentage; where the relationship between the number of objects present in the screen sprite and the content match percentage is non-linear.

More specifically, in the remote monitoring system based on cloud computing: the gray value of the black level pixel is 0.

More specifically, in the remote monitoring system based on cloud computing: the gray value of the white level pixel is 255.

More specifically, in the remote monitoring system based on cloud computing, it further includes: a FLASH storage device for pre-storing the R channel weighted value, the G channel weighted value and the B channel weighted value.

More specifically, in the remote monitoring system based on cloud computing: the FLASH storage device is set in the backstage control room of the theater.

More specifically, in the remote monitoring system based on cloud computing: the FLASH storage device is also used to pre-store the screen patterns of various mobile terminals.

More specifically, in the remote monitoring system based on cloud computing: FLASH storage device and Sunplus SPCE061A chip are integrated on an integrated circuit board.

Description of drawings

Embodiments of the present invention will be described below in conjunction with the accompanying drawings, wherein:

Fig. 1 is a structural block diagram of a remote monitoring system based on cloud computing according to an embodiment of the present invention.

Reference signs: 1CCD image sensing device; 2theatre content collection device; 3content analysis device; 4lighting control device

detailed description

The implementation of a remote monitoring system based on cloud computing of the present invention will be described in detail below with reference to the accompanying drawings.

The artificial anti-sneak shooting method has inherent shortcomings. In order to reduce the operating cost of anti-sneak shooting and improve the work efficiency of anti-sneak shooting, the operator has been looking for an electronic anti-sneak shooting method for on-site monitoring. There are two development directions for electronic anti-sneak shooting, one It is to make a fuss on the mobile terminal held by the audience, and automatically detect the candid shooting behavior when the mobile terminal is shooting, but this method may be circumvented because the candid photographer chooses the mobile terminal. The other is to install electronic interference equipment at the candid scene, This way can avoid the circumvention of the sneak shot.

The existing anti-candid electronic interference equipment is to install an infrared device on the back of the curtain or the stage. The infrared device emits infrared rays invisible to the human eye. The images obtained by the camera of the sneak shooter, resulting in low-quality images or images obtained by the sneak shooter, cannot be sold in the market or spread on the Internet, thereby effectively safeguarding copyright interests.

However, this method needs to emit infrared rays all the time, and the emission of infrared rays is in a wide range, and infrared rays need to be emitted from various positions, which is costly and poor in feasibility. Therefore, the on-site electronic anti-sneak shooting equipment also needs to find other breakthrough directions.

In order to overcome the above-mentioned deficiencies, the present invention builds a remote monitoring system based on cloud computing, which can determine whether there is a sneak shot in the auditorium by detecting the behavior of the audience in the auditorium and extracting the parameters of the on-site environment, and The location of the sneak shot can be located in time, so that corresponding directional warning measures can be taken to remind the sneak shot to give up the sneak shot.

Fig. 1 is a structural block diagram of a remote monitoring system based on cloud computing according to an embodiment of the present invention, the system includes wireless communication equipment, CCD image sensing equipment, theater content acquisition equipment, content analysis equipment and lighting control equipment , the CCD image sensing device is used to collect the audience screen image, the theater content collection device is used to collect the theater stage image, the content analysis device is respectively connected with the CCD image sensing device and the theater content collection device, and is used to collect images based on the audience screen image and the theater stage The image determines the driving control signal, and sends the driving control signal to the lighting control device so that the lighting control device can control the lighting device.

Next, continue to further describe the specific structure of a remote monitoring system based on cloud computing of the present invention.

The system includes: a wireless communication device, connected with a content analysis device, for wirelessly sending each screen sub-image and its corresponding seat number; a theater content collection device, set opposite to the theater stage, for real-time collection of seats on the theater stage The scene image is output as a real-time scene image; the content analysis equipment is set in the backstage control room of the theater, and is respectively connected with the sub-screen splitting device and the theater content acquisition device to receive the real-time scene image and each screen sub-image And its corresponding seat number, match the content of each screen sub-image with the real-time scene image to determine the content matching percentage, when the content matching percentage is greater than or equal to the preset percentage threshold, use the seat number corresponding to the screen sub-image as the target seat number Output: Sunplus SPCE061A chip, installed in the backstage control room of the theater, connected with the content analysis equipment, is used to send out the driving control signal including the target seat number based on the target seat number.

The system includes: motor drive equipment, installed in the backstage control room of the theater, respectively connected to the Sunplus SPCE061A chip and the DC motor, used to receive the drive control signal sent by the Sunplus SPCE061A chip, and analyze the drive control signal to Determine the target seat number, determine the motor drive signal based on the target seat number; the pan/tilt, set on the roof position directly above the theater stage, including equipment fixing brackets and DC motors, equipment fixing brackets are used to fix lighting equipment and DC motors, DC motors It is connected with the motor driving device, and is used to adjust the lighting direction of the lighting device under the drive of the motor driving signal, and send out a lighting start signal after the adjustment is completed.

The system includes: lighting equipment, fixed on the equipment fixing bracket, connected with the DC motor, including a lighting switch and a lighting source, the lighting switch is respectively connected with the DC motor and the lighting source, and is used to automatically turn on after receiving a lighting start signal to start the lighting of the lighting source; the CCD image sensing device is set in the center of the theater roof, and is used to collect images of the auditorium opposite the theater stage to output the target image.

The system includes: a data segmentation device, located in the cloud, connected to a CCD image sensing device, used to divide the target image into N image blocks, where N is a natural number greater than 1; N cloud storage devices, located in the cloud, and The data segmentation device is connected to store N image segments respectively; the cloud command channel management device is located in the cloud and is used for channel management of cloud commands; the cloud service center device is located in the cloud and is connected to N cloud storage devices for Concentrate N image blocks and distribute N image blocks to M cloud application devices, M is a natural number greater than 1 and M is less than or equal to N; M cloud application devices are located in the cloud and connected to the cloud service center equipment , used to receive the assigned, more than one image tile.

Each cloud application device includes: a grayscale processing sub-equipment, including a channel parameter extraction unit, a weighted value storage unit, and a grayscale value calculation unit. The channel parameter extraction unit is used to receive each image block and extract the image in the block The R channel pixel value, the G channel pixel value and the B channel pixel value of each pixel, the weighted value storage unit is used to pre-store the R channel weighted value, the G channel weighted value and the B channel weighted value, and the gray value calculation unit respectively Connected with the channel parameter extraction unit and the weighted value storage unit, for each pixel in the image block, the product of the R channel pixel value and the R channel weighted value, the product of the G channel pixel value and the G channel weighted value, and the B channel pixel value and the weighted value of the B channel to obtain the grayscale value of the targeted pixel, and based on the grayscale value of each pixel in the image block to obtain the grayscale image corresponding to the image block; wherein, the R channel weighted value The value is 0.298839, the weighted value of the G channel is 0.586811, and the weighted value of the B channel is 0.114350.

Each cloud application device includes: a histogram distribution detection sub-device, which is connected to the grayscale processing sub-device for receiving the grayscale image, and performing grayscale histogram processing on the grayscale image to obtain a corresponding histogram image , when the histogram image presents a bimodal distribution, a global threshold selection signal is sent, otherwise, a non-global threshold selection signal is sent.

Each cloud application device includes: a threshold selection sub-device connected to the histogram distribution detection sub-device for outputting the global threshold 128 as threshold data when receiving a global threshold selection signal, and outputting a non-global threshold selection signal when receiving a non-global threshold selection signal , output the adjacent pixel gray level difference threshold 40 as threshold data.

Each cloud application device includes: a binarization processing sub-device, which is respectively connected to the threshold selection sub-device and the histogram distribution detection sub-device, and is used to target each pixel in the grayscale image when receiving the global threshold selection signal point, when the grayscale value is greater than or equal to the threshold data, set the targeted pixel point as a white level pixel point, and when the grayscale value is smaller than the threshold value data, set the targeted pixel point as a black level pixel point, and output gray The binarized image corresponding to the binarized image; the binarized processing sub-equipment is also used to calculate the vertical upward distance of 3 pixels for each pixel in the grayscaled image when receiving the non-global threshold selection signal The gray value of the pixel of the point is used as the gray value of the upper pixel, and the gray value of the pixel point that is 3 pixels away from it in the vertical direction is used as the gray value of the lower pixel, and the gray value of the pixel point that is 3 pixels away from it in the horizontal direction is calculated The gray value of the pixel of the point is used as the gray value of the left pixel, and the gray value of the pixel point that is 3 pixels away from it in the horizontal direction is used as the gray value of the right pixel. When the gray value of the upper pixel and the gray value of the lower pixel When the absolute value of the difference between the intensity values is less than or equal to the threshold data and the absolute value of the difference between the gray value of the left pixel and the gray value of the right pixel is less than or equal to the threshold data, set the targeted pixel as a white level pixel, when the upper pixel When the absolute value of the difference between the grayscale value and the grayscale value of the next pixel is greater than the threshold data or the absolute value of the difference between the grayscale value of the left pixel and the grayscale value of the right pixel is greater than the threshold data, set the targeted pixel as a black level pixel point, and output the binarized image corresponding to the grayscale image.

Each cloud application device includes: image smoothing processing sub-device, connected with binarization processing sub-device, used to receive binarized image, for each pixel in the binarized image, when all adjacent pixels When there are more than half of the jump points, the gray value of the targeted pixel is retained, otherwise, the gray value of the targeted pixel is set as a white level pixel, and a smooth image corresponding to the binarized image is output .

The system includes: a data merging device, located in the cloud, connected to M cloud application devices, and used to splice the smooth images output by the image smoothing processing sub-equipment of each cloud application device to obtain a smooth integrated image; wavelet filtering device, It is installed in the backstage control room of the theater, connected with the data merging device, and used to receive smooth integrated images, and perform two-dimensional wavelet filtering processing on the smooth integrated images to obtain filtered images.

The system includes: a sub-screen splitting device, set in the backstage control room of the theater, connected with the wavelet filtering sub-device to obtain a filtered image, and matching the filtered image with pre-stored screen patterns of various mobile terminals to detect and segment out For each screen sub-image in the filtered image, for each screen sub-image, determine the seat number corresponding to the targeted screen sub-image based on its position in the filtered image.

Wherein, the seat number corresponding to the screen sub-image is the theater seat number of the audience holding the mobile terminal corresponding to the screen sub-image; the content analysis device matches each screen sub-image with the real-time scene image to determine the content The matching percentage specifically includes: identifying each object in the real-time scene image, and for each object, detecting whether it exists in the screen sub-image, the more objects exist in the screen sub-image, the higher the content matching percentage; and The relationship between the number of objects present in a screen sub-image and the content match percentage is non-linear.

Optionally, in the system: the grayscale value of the black level pixel point is 0; the grayscale value of the white level pixel point is 255; it also includes: a FLASH storage device for pre-storing the R channel weighted value, G-channel weighted value and B-channel weighted value; the FLASH storage device is set in the background control room of the theater; the FLASH storage device is also used to pre-store the screen patterns of various mobile terminals; the FLASH storage device and Sunplus SPCE061A chip are integrated into one circuit board.

In addition, cloud computing, or cloud computing, is the growth, usage, and delivery model of Internet-based related services, usually involving the provision of dynamically scalable and often virtualized resources over the Internet. Cloud is a metaphor for network, internet. In the past, the cloud was often used to represent the telecommunications network in the figure, and later it was also used to represent the abstraction of the Internet and the underlying infrastructure. Therefore, cloud computing can even allow you to experience the computing power of 10 trillion times per second. With such powerful computing power, you can simulate nuclear explosions, predict climate change and market development trends. Users access the data center through computers, notebooks, mobile phones, etc., and perform calculations according to their own needs.

There are many definitions of cloud computing. There are at least 100 explanations for what exactly cloud computing is. The widely accepted definition at this stage is the National Institute of Standards and Technology (NIST): cloud computing is a pay-per-use model that provides available, convenient, and on-demand network access, and enters configurable Shared pool of computing resources (resources include network, server, storage, application software, service), these resources can be provided quickly, with little management work or little interaction with service providers.

Adopting a remote monitoring system based on cloud computing of the present invention, aiming at the technical problem that the existing technology cannot provide effective electronic detection for sneak shots of performances, by adopting a series of targeted and high-precision image processing equipment and image analysis The device analyzes the status of the audience in the auditorium, and also analyzes the environment of the performance site. On the basis of the above analysis, it accurately detects and identifies the behavior of the pirates in the auditorium, and finally adopts a warning mechanism to punish the sneak photographers. Electronic reminders are used to effectively reduce the occurrence of sneak shots while avoiding interference with other viewers.

It can be understood that although the present invention has been disclosed above with preferred embodiments, the above embodiments are not intended to limit the present invention. For any person skilled in the art, without departing from the scope of the technical solution of the present invention, the technical content disclosed above can be used to make many possible changes and modifications to the technical solution of the present invention, or be modified into equivalent changes, etc. effective example. Therefore, any simple modifications, equivalent changes and modifications made to the above embodiments according to the technical essence of the present invention, which do not deviate from the technical solution of the present invention, still fall within the protection scope of the technical solution of the present invention.

Claims (1)

1. A remote monitoring system based on cloud computing, said system comprising wireless communication equipment, CCD image sensing equipment, theater content acquisition equipment, content analysis equipment and lighting control equipment, CCD image sensing equipment is used to collect audience screen images , the theater content collection device is used to collect theater stage images, and the content analysis device is connected with the CCD image sensing device and the theater content collection device respectively, and is used to determine the driving control signal based on the audience screen image and the theater stage image, and send the driving control signal To the lighting control equipment so that the lighting control equipment can realize the control of the lighting equipment; It is characterized in that the system includes: A wireless communication device, connected with a content analysis device, for wirelessly sending each screen sub-image and its corresponding seat number; The theater content collection equipment is set opposite to the theater stage, and is used for real-time collection of scene images on the theater stage to be output as real-time scene images; The content analysis equipment is installed in the background control room of the theater, and is respectively connected with the sub-screen splitting equipment and the theater content acquisition equipment, and is used to receive real-time scene images, and is also used to receive each screen sub-image and its corresponding seat number. A screen sub-image is content-matched with a real-time scene image to determine a content matching percentage, and when the content matching percentage is greater than or equal to a preset percentage threshold, the seat number corresponding to the screen sub-image is output as the target seat number; Sunplus SPCE061A chip is installed in the backstage control room of the theater, connected with the content analysis equipment, and used to send out the driving control signal including the target seat number based on the target seat number; The motor drive equipment is installed in the backstage control room of the theater, and is respectively connected with the Sunplus SPCE061A chip and the DC motor, used to receive the drive control signal sent by the Sunplus SPCE061A chip, and analyze the drive control signal to determine the target seat number. determining a motor drive signal based on the target seat number; The cloud platform is set on the roof directly above the theater stage, including equipment fixing brackets and DC motors. The equipment fixing brackets are used to fix lighting equipment and DC motors. Adjust the lighting direction of the lighting equipment, and send a lighting start signal after the adjustment; The lighting equipment is fixed on the equipment fixing bracket and connected to the DC motor, including a lighting switch and a lighting source. The lighting switch is respectively connected to the DC motor and the lighting source, and is used to automatically turn on after receiving the lighting start signal to start the lighting source. illumination; CCD image sensing equipment, set in the center of the theater roof, is used to collect images of the auditorium opposite the theater stage to output target images; The data segmentation device is located in the cloud and is connected with the CCD image sensing device for dividing the target image into N image segments, where N is a natural number greater than 1; N cloud storage devices, located in the cloud, connected to the data segmentation device, are used to store N image segments respectively; The cloud command channel management device, located in the cloud, is used for channel management of cloud commands; Cloud service center equipment, located in the cloud, connected to N cloud storage devices, used to concentrate N image blocks and distribute N image blocks to M cloud application devices, where M is a natural number greater than 1 and M is less than or equal to N; M cloud application devices, located in the cloud, connected to the cloud service center device, are used to receive the allocated image blocks, and each cloud application device includes: The grayscale processing sub-equipment includes a channel parameter extraction unit, a weighted value storage unit, and a grayscale value calculation unit. The channel parameter extraction unit is used to receive each image block and extract the R channel of each pixel in the image block Pixel value, G channel pixel value and B channel pixel value, the weighted value storage unit is used to pre-store the R channel weighted value, G channel weighted value and B channel weighted value, the gray value calculation unit is respectively connected with the channel parameter extraction unit and the weighted value The value storage unit is connected, and for each pixel in the image block, the product of the pixel value of the R channel and the weighted value of the R channel, the product of the pixel value of the G channel and the weighted value of the G channel, and the product of the pixel value of the B channel and the weighted value of the B channel Multiply and add to obtain the grayscale value of the targeted pixel, and obtain the grayscale image corresponding to the image block based on the grayscale value of each pixel in the image block; where the weighted value of the R channel is 0.298839, and the G channel The weighted value is 0.586811, and the weighted value of the B channel is 0.114350; The histogram distribution detection sub-equipment is connected with the gray-scale processing sub-equipment for receiving the gray-scale image, and performing gray-scale histogram processing on the gray-scale image to obtain a corresponding histogram image, and the histogram image presents a double When the peak is distributed, a global threshold selection signal is sent, otherwise, a non-global threshold selection signal is sent; The threshold selection sub-equipment is connected with the histogram distribution detection sub-equipment, and is used to output the global threshold 128 as threshold data when receiving the global threshold selection signal, and gray out the adjacent pixels when receiving the non-global threshold selection signal. Degree difference threshold 40 is output as threshold value data; The binarization processing sub-equipment is connected with the threshold selection sub-equipment and the histogram distribution detection sub-equipment respectively, and is used for when the global threshold selection signal is received, for each pixel in the grayscale image, when the gray value is greater than When it is equal to the threshold data, set the targeted pixel as a white level pixel, and when the grayscale value is less than the threshold data, set the targeted pixel as a black level pixel, and output the binary value corresponding to the grayscale image image; the binarization processing sub-equipment is also used to calculate the grayscale of the pixel point that is 3 pixels away from it in the vertical direction for each pixel point in the grayscale image when receiving the non-global threshold selection signal Value as the gray value of the upper pixel, calculate the gray value of the pixel point that is 3 pixels away from it in the vertical direction as the gray value of the lower pixel, and calculate the gray value of the pixel point that is 3 pixels away from it in the horizontal direction The value is used as the gray value of the left pixel, and the gray value of the pixel point that is 3 pixels away from it in the horizontal direction is used as the gray value of the right pixel, when the absolute value of the difference between the gray value of the upper pixel and the gray value of the lower pixel When it is less than or equal to the threshold data and the absolute value of the difference between the gray value of the left pixel and the gray value of the right pixel is less than or equal to the threshold data, set the targeted pixel as a white level pixel, when the gray value of the upper pixel and the gray value of the lower pixel When the absolute value of the difference between the grayscale values is greater than the threshold data or the absolute value of the difference between the grayscale value of the left pixel and the grayscale value of the right pixel is greater than the threshold data, set the targeted pixel as a black level pixel and output grayscale The binary image corresponding to the image; The image smoothing processing sub-device is connected with the binarization processing sub-device for receiving the binarized image, for each pixel in the binarized image, when there are more than half of the jump points in all adjacent pixels , the gray value of the targeted pixel is retained, otherwise, the gray value of the targeted pixel is set as a white level pixel, and a smooth image corresponding to the binarized image is output; The data merging device, located in the cloud, is connected to M cloud application devices, and is used to splice the smooth images output by the image smoothing processing sub-device of each cloud application device to obtain a smooth integrated image; The wavelet filtering device is installed in the backstage control room of the theater, connected with the data merging device, used to receive the smooth integrated image, and perform two-dimensional wavelet filter processing on the smooth integrated image to obtain the filtered image; The sub-screen splitting device is set in the backstage control room of the theater, connected with the wavelet filtering sub-device to obtain the filtered image, and matches the filtered image with the pre-stored screen patterns of various mobile terminals to detect and segment each of the filtered images Screen sub-images, for each screen sub-image, determine the seat number corresponding to the screen sub-image for its position in the filtered image; wherein, the seat number corresponding to the screen sub-image is the corresponding The theater seat number where the audience of the mobile terminal is located; Wherein, the content analysis device matches the content of each screen sub-image with the real-time scene image to determine the content matching percentage specifically includes: identifying each object in the real-time scene image, and for each object, detecting whether it exists in the screen sub-image , the greater the number of objects present in the screen sub-image, the higher the content matching percentage; wherein the relationship between the number of objects present in the screen sub-image and the content matching percentage is a non-linear relationship; The gray value of the black level pixel is 0; The gray value of the white level pixel is 255.