CN109782706B

CN109782706B - Exhibition hall control system and method, cloud server and terminal control device

Info

Publication number: CN109782706B
Application number: CN201811551688.7A
Authority: CN
Inventors: 陈天佳; 徐葳; 尹伟; 刘昕; 吕厦敏; 王芸芸; 王春梅; 吴丹; 徐薇
Original assignee: Tuling Artificial Intelligence Institute Nanjing Co ltd; Tsinghua University
Current assignee: Tuling Artificial Intelligence Institute Nanjing Co ltd; Tsinghua University
Priority date: 2018-12-18
Filing date: 2018-12-18
Publication date: 2021-10-01
Anticipated expiration: 2038-12-18
Also published as: CN109782706A

Abstract

The application provides an exhibition hall control system based on cloud computing, a cloud server, a terminal control device, an exhibition hall control method based on cloud computing and a computer readable storage medium, wherein the method comprises the following steps: when a control instruction submitted by at least one client is received, converting the control instruction into a command code; the command code is distributed to at least one terminal control device to instruct the at least one content display device to play and display a file to be played according to the command code; the file to be played is obtained by the at least one terminal control device from being stored in the cloud server synchronously in advance or is read from the cloud server instantly according to the command code. The method and the device are used for solving the problems that the controllability is poor, the control efficiency is low, the price is high and the like in the prior art.

Description

Exhibition hall control system and method, cloud server and terminal control equipment

Technical Field

The present application relates to the field of exhibition hall control technologies, and in particular, to an exhibition hall control system based on cloud computing, a cloud server, a terminal control device, an exhibition hall control method based on cloud computing, and a computer-readable storage medium.

Background

The exhibition hall is a system for exhibiting and demonstrating activities by using elements such as a complex, a person, a scene and the like to transmit specific information. The existing exhibition hall demonstration intelligent equipment is expensive, each piece of equipment is relatively independent and cannot be communicated with each other, and no main equipment is used for management and analysis. For newly added equipment or new demonstration content, hardware equipment needs to be adjusted on site, and a newly added equipment control system cannot be installed remotely by one key. Because of the lack of an intelligent control system for remotely controlling all objects (lights, multiple screens, exhibition instruments) of an exhibition hall by using a client, an explicator must perform complicated operations on the exhibition hall to explain to visitors. Moreover, during the display, the explanation can be carried out only according to the steps designed in advance, and the display content cannot be increased, decreased and traced back at any time according to the number of visitors and the different levels of visitors. For newly added display content, long-time field adjustment is usually required.

In the existing equipment for controlling the exhibition hall, a slide show (PPT) is played from the beginning each time, the content to be displayed cannot be directly displayed, the flexibility is poor, and poor experience is brought to audiences; when uploading files, a USB flash disk needs to be inserted into a USB socket on the back of each display screen for copying and pasting the files. Taking an exhibition hall with a plurality of display screens as an example, a worker is usually required to repeat operations for many times, if the playing file of the PPT needs to be added by one page or modified once, the PPT needs to be operated again for many times, so that unified control cannot be realized, and the operations of controlling the operation and uploading the file are very complicated. The repeated workload is large, and for newly added display contents, long-time field adjustment is needed, which undoubtedly reduces the working efficiency, increases the operation and maintenance cost of hardware/software, and brings inconvenience to visitors. In addition to this, such control products are expensive.

Disclosure of Invention

In view of the above-mentioned shortcomings of the related art, an object of the present application is to provide a cloud computing-based exhibition hall control system, a cloud server, a terminal control device, a cloud computing-based exhibition hall control method, and a computer-readable storage medium, which are used to solve the problems of poor controllability, low manipulation efficiency, and the like in the prior art.

To achieve the above and other related objects, a first aspect of the present application provides a cloud computing-based exhibition hall control system, comprising: at least one client used for uploading the file to be played or submitting the control instruction; at least one content display device configured to perform display playing when receiving a playing instruction; the cloud server is connected with at least one client through a network, and is configured to receive and store a file to be played uploaded by the at least one client, monitor a control instruction of the at least one client and convert the control instruction into a command code; the terminal control equipment is configured corresponding to each content display equipment, connected with the cloud server through a network, and configured to synchronize data with the cloud server and instruct the at least one content display equipment to play and display the file to be played according to the received command code; the file to be played is obtained by the at least one terminal control device from being stored in the cloud server synchronously in advance or is read from the cloud server instantly according to the command code.

A second aspect of the present application further provides a cloud server, which is connected to at least one client and at least one terminal control device through a network, and includes: the interface module is connected with at least one client through a network and used for receiving a file to be played or a submitted control instruction uploaded by the at least one client; the storage module is used for storing the file to be played and the equipment list; the conversion module is used for converting the control instruction into a command code; and the cloud control module is connected with the at least one terminal control device and used for distributing the command code to the at least one terminal control device so as to enable the at least one terminal control device to indicate at least one content display device to play and display the file to be played.

The third aspect of the present application also provides a terminal control device, including: the network module is connected with the cloud server through a network and used for receiving the command codes distributed by the cloud server; the command code is obtained by monitoring a control instruction from at least one client side by the cloud server side and converting the control instruction; the synchronization module synchronizes data with the cloud server through the network module; and the control module is locally connected with a content display device and used for indicating the content display device to play and display the file to be played according to the received command code.

The fourth aspect of the present application further provides a cloud computing-based exhibition hall control method, including the following steps: when a control instruction submitted by at least one client is received, converting the control instruction into a command code; the command code is distributed to at least one terminal control device to instruct the at least one content display device to play and display a file to be played according to the command code; the file to be played is obtained by the at least one terminal control device from being stored in the cloud server synchronously in advance or is read from the cloud server instantly according to the command code.

A fifth aspect of the present application further provides a computer-readable storage medium storing a cloud computing-based exhibition hall control computer program, wherein the exhibition hall control computer program is executed to implement the exhibition hall control method according to the fourth aspect.

As described above, the cloud server and the terminal control device configured in the cloud-computing-based exhibition hall control system have the characteristics of high efficiency, low price, elastic expansion and the like, the analysis control nodes are placed on the cloud system, the bottom layer device is controlled in an intranet mode, and the cloud system is convenient to implement. When the number of the exhibition hall content display devices is increased, the cloud server can expand the computing capacity and the storage capacity, and the inconvenience that hardware needs to be upgraded and redeveloped due to the increase of the devices is avoided. In addition, for newly added equipment, a user only needs to be connected with a power supply and a network, and the rest parts of the background are all automatically deployed, so that the whole system is easy to maintain, the cost of manually arranging the equipment is reduced, and the working efficiency is improved.

Drawings

Fig. 1 is a block diagram of a cloud computing-based exhibition hall control system according to an embodiment of the present application.

Fig. 2a and fig. 2b are schematic diagrams illustrating a graphical user interface provided by a cloud server to a client according to an embodiment of the present disclosure.

Fig. 3 is a block diagram of a cloud computing-based exhibition hall control system according to another embodiment of the present application.

Fig. 4 is a schematic diagram illustrating the access of a new device to the control system of the exhibition hall according to an embodiment of the present application.

Fig. 5 is a system block diagram of a cloud server according to an embodiment of the present disclosure.

Fig. 6 is a system block diagram of a cloud server according to another embodiment of the present disclosure.

Fig. 7 is a block diagram illustrating an application of the terminal control device according to an embodiment of the present application.

Fig. 8 is a flowchart illustrating an exemplary embodiment of an exhibition hall control method according to the present application.

Detailed Description

The following description of the embodiments of the present application is provided for illustrative purposes, and other advantages and capabilities of the present application will become apparent to those skilled in the art from the present disclosure. In the following description, reference is made to the accompanying drawings that describe several embodiments of the application. It is to be understood that other embodiments may be utilized and that compositional and operational changes may be made without departing from the spirit and scope of the present application. The following detailed description is not to be taken in a limiting sense, and the scope of embodiments of the present application is defined only by the claims of the patent of the present application. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.

Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. For example, in the present application, the "at least one client" includes one client and a plurality of clients, or the "at least one content presentation device" includes one content presentation device and a plurality of content presentation devices. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination.

The exhibition hall control system is realized based on cloud computing. In an embodiment, the cloud computing is a cloud computing system or a cloud computing platform, and a user can flexibly deploy and maintain a service through the cloud computing system, for example, the user can submit a requirement of a display file to the cloud computing system in a form required by the cloud computing system, and the cloud computing system can apply for a corresponding resource for the user according to requirements of applications, services, components and the like in the requirement of the display file to create an executable service instance.

In practical applications, the Cloud computing system includes a Public Cloud (Public Cloud) computing system and a Private Cloud (Private Cloud) computing system, and the Cloud computing system or Platform can be generally divided into three Service modes, namely, Software as a Service (SaaS), Platform as a Service (Platform as a Service, PaaS) and infrastructure as a Service (infrastructure as a Service, IaaS), according to different Service levels, where PaaS and IaaS can directly provide services to Platform users through a Service-Oriented Architecture (SOA) or a web server, and can also serve as a support Platform of the SaaS mode to indirectly provide services to end users. Such as an ari cloud computing service platform, Amazon cloud computing service platform, a hundredth cloud computing platform, a Tencent cloud computing platform, and so on.

In the prior art, the computing resources in the cloud computing platform are likely to fail. This requires that the running application system in cloud computing HAs High Availability (HA), which means that a system is highly reliable, i.e. rarely fails, or can be quickly recovered after failure. That is to say, when the computing resource of the application system in the cloud computing platform is invalid or other faults occur, a corresponding HA mechanism must be provided to ensure that the application system is recovered as soon as possible, and the downtime caused by planned daily maintenance operation or unplanned system crash is shortened, so that the interruption of service is avoided, and the availability of the application system is improved. The HA scheme is generally provided for a cloud computing platform by using a cloud management platform, and at present, the most popular cloud management platform is OpenStack, which is an open source project aiming at providing software for construction and management of public and private clouds. Both organizations and individuals in the OpenStack community use OpenStack as a common front-end for infrastructure as a service (IaaS) resources. OpenStack has become the de facto deployment standard of IaaS cloud platform in the industry and academia nowadays, and OpenStack is widely applied to various industries. From the viewpoint of OpenStack, in a cloud computing platform, IaaS serves as a support infrastructure of cloud computing, IaaS provides an elastic and extensible infrastructure service, and can provide large-scale on-demand computing service, storage service and network service for upper-layer applications, and the network service of the IaaS cloud platform is the most core service of the IaaS cloud platform, and is a key for influencing the quality of various cloud application services. Therefore, OpenStack is deployed on the physical computing, storage and network resources at the bottom of the cloud platform to realize the unified management of the computing, storage and network resources and provide the cloud infrastructure unified service of the IaaS layer.

The exhibition hall control system based on cloud computing integrates NLP semantic analysis technology to provide a solution for an intelligent exhibition hall control platform, analyzes and distributes to specific exhibition hall equipment for management control on the basis of OpenStack cloud platform, Ceph (highly reliable, automatic adjustment and automatic recovery distributed storage system), OpenvSwitch (virtual switch, OVS for short), Flask Web (Werkzeug and Jinja 2-based Python micro-framework, and the scheme provided by the application is used for building a client platform and generating commands), Febic (distributed distributor based on modular support and distributes the commands to at least one terminal control equipment) and Tunnel (network communication protocol).

Referring to fig. 1, a block diagram of an exhibition hall control system based on cloud computing according to an embodiment of the present application is shown, and as shown in the drawing, the exhibition hall control system includes: the system comprises at least one client 10, a cloud server 11, a plurality of content display devices 13 and a plurality of terminal control devices 12.

In this embodiment, the exhibition hall control system is built in a Virtual Private Network (VPN), that is, by establishing a VPN tunnel, the cloud server 11 and the terminal control device 12 communicate based on a Linux public key ssh-keygen to ensure the security of the system. The ssh-keygen is a tool of the unix-like system for generating and managing ssh public keys and private keys. In one example, the virtual private network is, for example, a VPN and SSL/TLS secure network.

In an example, an SSH key may be created on the active virtual machine using an SSH-keygen command, the SSH key may be activated, and the key may be stored in the terminal control device. According to the exhibition hall control system, the client 10 uploads information to the cloud server 11 based on the virtual special safety network through the HTTP protocol, the information is issued to the specific terminal control device 12 through the cloud server 11, the virtual special network is set up, all data transmission in the platform is safe and reliable, and the personal information of the user at the client is protected. According to the method and the system, the whole platform is built in the virtual network, and the security authentication is carried out through the secret key, so that the security of system data is guaranteed.

In the embodiment, the Client 10 is, for example, a local program loaded in a computer device including but not limited to a desktop computer, a notebook computer, a tablet computer, a smart phone, a media player, a Personal Digital Assistant (PDA), and the like, that is, the Client (Client) refers to a local program installed on a common user machine and needs to operate in cooperation with a service end, but for convenience of the following description, a physical form presented by the Client, such as a tablet computer, is taken as an example for explanation. For client-side voice control, a hardware device with recording capability is required, and it should be understood that the computer device described in the embodiments of the present application is only one example of an application, and that the components of the device may have more or fewer components than those shown, or have a different configuration of components. The various components described may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

In the embodiment of the present application, the client 10 is a tablet computer, for example, a tablet computer of iPad series with an iOS operating system loaded by apple inc; for example, the Android tablet pc is an Android tablet pc loaded with an Android operating system developed by Google corporation, and is a tablet pc of companies such as samsung, huashi, and millet.

The client 10, which is a tablet computer, supports various applications such as one or more of the following: a mapping application, a rendering application, a word processing application, a website creation application, a disc editing application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and/or a digital video player application.

The client 10, which is a tablet computer, includes memory, a memory controller, one or more processors (CPUs), peripheral interfaces, RF circuitry, audio circuitry, speakers, microphones, input/output (I/O) systems, touch screens, other output or control devices, and external ports, which communicate via one or more communication buses or signal lines.

In embodiments, the memory may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state storage devices. In certain embodiments, the memory may also include memory that is remote from the one or more processors, such as network-attached memory accessed via RF circuitry or external ports and a communication network (not shown), which may be the internet, one or more intranets, Local Area Networks (LANs), wide area networks (WLANs), Storage Area Networks (SANs), etc., or a suitable combination thereof. The memory controller may control access to the memory by other components of the device, such as the CPU and peripheral interfaces.

In one exemplary embodiment, the display screen of the tablet computer is a touch screen that may use LCD (liquid crystal display) technology or LPD (light emitting polymer display) technology, although in other embodiments other display technologies may be used. Touch screens and touch screen controllers may detect contact and movement or breaking thereof using any of a number of touch sensitive technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays, or other technologies for determining one or more points of contact with a touch screen. The touch screen displays visual output from the portable device, while the touch sensitive panel does not provide visual output. The touch screen may have a resolution of greater than 100 dpi. In one exemplary embodiment, the touch screen may have a resolution of approximately 168 dpi. The user may contact the touch screen using any suitable object or accessory, such as a stylus, finger, or the like. In particular, the touch screen receives a gesture or touch screen trace of a user's input based on a tactile and/or tactile contact. The touch screen forms a touch sensitive surface that accepts user input. The touch screen and touch screen controller (along with any associated modules and/or instruction sets in memory) detect contact on the touch screen (and any movement or breaking of the touch) and transform the detected contact into an interaction with a multimedia file (such as a picture or video) or multimedia sample file (such as a screenshot of a picture or video) object displayed on the touch screen, thereby capturing control instructions for user-entered keystrokes, gestures, or touch screen trace operations

In an exemplary embodiment, the client 10, which is a tablet computer, may also obtain language information input by a user through an audio signal acquisition device, such as a microphone.

In an embodiment, the number of the clients 10 configured according to the number of administrators or operating users may be one or more, and for convenience of describing the embodiment of the present application, the example shown in fig. 1 is described by taking the client 10 as an example.

The client 10 is configured to upload a file to be played or submit a control instruction, and in an embodiment, the client 10 uploads the file to be played or submits the control instruction to the cloud server 11 by using a communication network.

In an embodiment, the file to be played may be a picture, a video, an Office file, a PDF file, or the like.

In an embodiment, the picture format is a format for storing pictures in a computer, such as a format for storing jpeg, jpg, png, svg, xcf, otf and the like.

In an embodiment, the video format is a format of a computer storage multimedia file, such as AVI, MOV, MP4, MKV, M4A, 3GP, 3G2, MJ2, and the like.

In an embodiment, the Office file has a format including doc (Word file),. xls (Excel file),. PPT (PowerPoint or PPT file), or. docx (Word file),. xlsx (Excel file),. pptx (PowerPoint or PPT file), and so on.

The control instruction comprises one or more of a file type playing instruction, a specified playing device instruction or a file playing mode instruction.

In an embodiment, the playing file type instruction includes a designation playing file type instruction, for example, a designation playing picture, a video, a PPT file, a PDF file, or the like.

In an exemplary embodiment, the instructions for specifying the playback device include instructions for specifying the content presentation device 13, such as which content presentation device or devices 13 to play back for presentation.

In an exemplary embodiment, the file playing mode instruction includes an instruction for setting a playing mode, for example, setting a playing mode of a playing file, such as modes of automatic loop playing, random playing, sequential playing, backtracking playing, inter-cut content, etc., or setting an automatic playing dwell time, or setting a control instruction for controlling video and audio playing, pausing, closing, and adjusting sound size, etc.

In an exemplary embodiment, the client 10 uploads the file to be played or submits the control command based on a user interaction interface (GUI interface) displayed on a display screen, where the user interaction interface includes a plurality of keys or input fields or keys for activating a microphone for user input or selection.

In an embodiment, the control instruction is, for example, a page information instruction, a voice information instruction, or terminal command control information, and in an embodiment, the page information instruction is implemented by controlling a page, a user may set detailed parameters of playing content on the client 10, and the user selects content to be played and a specified content display device 13 by operating a plurality of keys or input fields displayed in the user interaction interface to send the control instruction to the cloud server 11. In an embodiment, the voice information instruction is implemented by performing voice control, and the client 10 sends the voice information to the cloud service end 11 for analysis feature extraction, such as "number of devices", "play content", "play/pause/switch back to upper content", "previous page/next page", and integrates and sends the feature information to the cloud service end 11. In an embodiment, the terminal command control information is information controlled by a user in a manner of directly ssh logging in a terminal control device through a local client and in a manner of a terminal command, in an application example, the exhibition hall control system is a programmable system, and the user can directly cross a cloud service end to feed back a user interaction interface to the control terminal, in other words, the user does not need to obtain client information through a page command and voice information, and can directly log in, for example, a raspberry serving terminal control device to control a raspberry serving file in a manner of tapping a command at the terminal.

The at least one content display device 13 is configured to display the file to be played in a playing manner when receiving the playing instruction; in different embodiments, the content presentation device 13 may be one or more based on the arrangement of the exhibition hall. The content presentation apparatus 13 will be described as an example of a plurality of the content presentation apparatuses.

In an embodiment, the content display device 13 is an electronic device including a display screen, such as a smart television, or a touch-control all-in-one machine, an interactive smart tablet device, and the like. In an embodiment, the content presentation device 13 is an output device with an HDMI interface, and its display screen is, for example, a 4: 3 display screen, a 14: 9 display screen, a 16: 10 display screen, or a 15: 9 display screen. The content display device 13 carries a bluetooth audio output or 3.5mm audio output interface.

The cloud server 11 is connected to at least one client 10 through a network, is connected to at least one terminal control device 12 through a network, and is configured to receive and store a file to be played uploaded by the at least one client 10. The cloud service end 11 is further configured to monitor a control instruction of the at least one client 10 at regular time or in real time and convert the control instruction into a command code; in an embodiment, the cloud server 11 is actually, for example, a server or a cluster of multiple servers. In an embodiment, the server includes a communication interface, a processor and a memory, the communication interface establishes a communication connection with the processor and the memory, respectively, and the processor and the memory establish a communication connection.

The cloud server receives a file to be played uploaded by the at least one client 10 and stores the file to be played into a Memory, where in an embodiment, the Memory includes a non-volatile Memory (non-volatile Memory), such as a read-only Memory (ROM), a flash Memory (flash Memory), a SD Card (Secure Digital Memory Card/SD Card), a hard disk (HDD) or a Solid State Drive (SSD); the memory may also comprise a combination of memories of the kind described above. The memory may include a plurality of instructions, modules or applications to perform various functions, including routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. When the technical solution provided by the present application is implemented by software, program codes for implementing the exhibition hall control system provided by the present application are stored in a memory and executed by a processor. The processor may be a Central Processing Unit (CPU).

The cloud server 11 is further configured to verify the operation authority of the at least one client 10 when receiving the request of the at least one client 10, and feed back a verification result to the at least one client 10. In an embodiment, when a user logs in, the cloud service end 11 obtains user data sent from the client 10, such as user data such as a user login ID, a login password, and an authentication code, the cloud service end 11 responds to a login request of the user, sends the data to the database to authenticate the operation authority of the at least one client 10, and after the authentication is successful, feeds back an authentication result to the client 10, the user enters a control interface of the client 10, and at this time, the user can select voice control or page control, that is, the user can select a control instruction sent as a page information instruction, or a control instruction sent as a voice information instruction.

In an embodiment, after the client 10 of the user successfully logs in, the cloud server 11 provides a corresponding graphical user interface to the at least one client 10, so that the client 10 uploads a file to be played or submits a control instruction. In an embodiment, the graphical user interface comprises at least one or more of a graphical interface, a textual interface, and a voice interface.

Referring to fig. 2a and fig. 2b, schematic diagrams of a graphical user interface provided by the cloud server 11 to the client 10 according to an embodiment of the present application are shown, as shown in the figures, the graphical user interface includes a plurality of buttons, including a button for selecting a playing file, such as the buttons "play video", "play PPT", "play picture", and "play PDF" shown in fig. 2 a; keys designating the content presentation apparatus 13, such as keys of "apparatus No. 1", "apparatus No. 2", "apparatus No. 3", and "control all", etc., are illustrated; the system further comprises a key for uploading files, and a key for designating or setting a playing mode, such as the illustrated "loop playing", or icon keys representing "previous page", "playing", "next page", and "returning". The illustration also shows exemplary icon keys comprising "input language" and "control volume", corresponding to the difference in control commands. Fig. 2b is a schematic diagram of a graphical user interface provided by the cloud server 11 to the client 10 in an embodiment of the present application, and a user performs voice input through the graphical user interface, it should be specifically noted that the display in fig. 2a or fig. 2b is only exemplary, and in different embodiments or different UI designs, it may also be considered that corresponding keys and different forms of page designs, such as keys corresponding to control instructions, such as file editing or file modification, are added, modified or deleted according to requirements of uploading a file to be played and control instructions. For example, when new devices are added, for example, new terminal devices are added, the terminal devices may automatically submit content information to the cloud server, and the cloud server is responsible for adding new keys to control the new terminal devices.

The playing content/interface displayed by the content display device 13 is synchronized to the cloud server 11, so that the user can view the playing content/interface being displayed by the content display device 13 on the client 10 through the communication between the client 10 and the cloud server 11. As shown in fig. 2a, when the user selects the content to be played, and the user clicks the content to be played, the client uploads the new content, and the pull-down menu adds a new key in real time and names the key with the uploaded file name. The content displayed by the content display equipment in the actual exhibition hall can be synchronized in real time under the graphical user interface, so that a user can pay attention to the flow of the exhibition hall in real time when not in the exhibition hall.

The cloud server 11 further includes a voice recognition module, where the voice recognition module is configured to recognize a voice information instruction sent by the client 10, perform NLP semantic analysis on the recognized voice information instruction, convert the recognized voice information instruction into a command code, and output the command code. The neural network system may process speech input received through the I/O to generate recognition results. Examples of speech recognition models in the trained neural network system may include hidden markov models, gaussian mixture models, deep neural network models, n-grams, and other statistical models. Examples of speech recognition engines may include dynamic time warping based engines and Weighted Finite State Transducer (WFST) based engines. One or more speech recognition models and one or more speech recognition engines may be used to process the proposed replacement representative features of the front-end speech preprocessor to generate intermediate recognition results (e.g., phonemes, phoneme sequences, and sub-words) and ultimately text recognition results (e.g., words, word sequences, or symbol sequences). Once the speech recognition module generates recognition results containing text (e.g., words, or sequences of symbols), the recognition results may be passed to a natural language processing module for NLP semantic analysis for intent inference.

The cloud service end 11 is further configured to monitor a control instruction of the at least one client 10 at regular time or in real time and convert the control instruction into a command code; in an embodiment, a preferable mode is that the cloud server 11 monitors the control instruction of the at least one client 10 in real time, and when receiving the control instruction submitted by the client 10, converts the control instruction into a command code by analyzing the control instruction; the command code may be readable by the terminal control device 12, for example, so that the terminal control device 12 may read a play file type instruction, for example, "file format or type of file to be played" from the command code; a specify playback device instruction, such as "specify one or more content presentation devices 13"; and file playing mode instructions, such as "playing software or application corresponding to the file to be played", playing/pausing/switching back to the upper content, "previous/next page", and the like. In an embodiment, the command code includes, for example, a conversion code from a key of the corresponding graphical user interface of the client 10 or a code obtained by performing voice analysis on the acquired user voice information.

Referring to fig. 3, which is a block diagram of an exhibition hall control system based on cloud computing according to another embodiment of the present disclosure, as shown in the figure, the cloud server 11 is configured with a cloud server 110 and a cloud controller 111, the cloud controller 111 is correspondingly connected to each terminal control device 12, and the cloud controller 111 is configured to distribute the command code to the at least one terminal control device 12. In embodiments, the cloud controller 111 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

In an embodiment, when a user uploads a new file to be played through the client 10, the cloud server 110 receives the file to be played and stores the file in a memory of the file, and at this time, each terminal control device 12 performs data synchronization on the file to be played stored in the cloud server 110.

In an embodiment, each terminal control device 12 is configured to synchronize data with the cloud server 110 further includes synchronizing the playing content/interface presented by the content presentation device 13 to the cloud server 110, so that the user can view the playing content/interface being presented by the content presentation device 13 on the client 10 through communication between the client 10 and the cloud server 110. Referring to fig. 2a, content displayed on the client 10 when the terminal control device 12 synchronizes data with the cloud server 110 according to an embodiment of the present invention is shown, as shown in fig. 2a, a user selects a playing content (PPT in the drawing), a pull-down menu specifically selects the playing content after clicking, and when the client uploads a new content by itself, a new key is added in the pull-down menu in real time and named as the uploaded file name. The content displayed by the content display equipment in the actual exhibition hall can be synchronized in real time under the graphical user interface, so that a user can pay attention to the flow of the exhibition hall in real time when not in the exhibition hall.

In an embodiment, when the cloud server receives a new device access request of the at least one terminal control device 12, the cloud server records configuration information of the at least one terminal control device 12 to add the configuration information into a device list, builds a related underlying environment for the at least one terminal control device 12 according to the configuration information, and provides a graphical user interface corresponding to the new device to the at least one client according to the configuration information, where the graphical user interface includes information such as an automatically generated new button, a command, and a control mode of the new device. In an embodiment, the graphical user interface comprises at least one or more of a graphical interface, a textual interface, and a voice interface. Referring to fig. 4, which is a schematic diagram illustrating a new device accessing to the exhibition hall control system according to an embodiment of the present application, as shown in the figure, when a new content display device 13 configured with a terminal control device 12 arrives at the exhibition hall, the exhibition hall control system identifies and controls the new device. When a new content display device 13 (the content display device 13 shown by the dotted line in the figure) provided with the terminal control device 12 (the terminal control device 12 shown by the dotted line in the figure) is connected to a power supply in an exhibition hall and is networked through WIFI, the terminal control device 12 writes an IP address obtained by DHCP into the configuration, changes the IP address into a fixed IP, and then sends configuration information to the cloud controller 111 side and the cloud server side for recording. The cloud control end will add the new content presentation device 13 configured with the terminal control device 12 into the device list, and control the content presentation device 13 configured with the terminal control device 12 when the command "specify new device operation" and "operate all devices" appears next time (step (r) in the figure). After receiving the configuration information (step two in the figure), the cloud server 110 uploads all files stored in the cloud hard disk to the content display device 13 newly configured with the terminal control device 12 (step three in the figure), and adds an option of the new device to the client 10 (step four in the figure).

For the newly added content display device 13 configured with the terminal control device 12, the user only needs to connect the power supply and the network, and the rest systems are all automatically deployed in the background, so that the whole system is easy to maintain, the cost of manually arranging the devices is reduced, and the working efficiency is improved. For the newly added display content, the user only needs to upload a file in the browser of the client 10, the system will be automatically deployed to the content display device 13 to be displayed, and a backup is left in the cloud, and the system will automatically identify the program or tool required for playing the file.

Each terminal control device 12 is further configured to instruct the at least one content presentation device 13 to present the file to be presented in a playback manner according to the received command code; the file to be played is obtained by the at least one terminal control device 12 from being stored in the cloud server 11 in advance synchronously or is read from the cloud server 11 immediately according to the command code. In an embodiment, the pre-synchronization acquisition is that when a user uploads a new file to be played through the client 10, the cloud server 11 receives the file to be played and stores the file in a memory thereof, and at this time, each terminal control device 12 performs data synchronization on the file to be played stored in the cloud server 11; the instant reading from the cloud service end 11 according to the command code is that, when receiving the command code submitted by the user through the client 10, the cloud service end 11 distributes the command code to the terminal control device 12 through the cloud controller 111, and the terminal control device 12 interprets or identifies the file information contained in the name code, that is, the file to be played stored can be read in real time from the memory of the cloud service end 11 to match the corresponding playing program to the at least one content display device 13 for playing and displaying.

In an embodiment, the cloud controller may also be configured in each of the terminal control devices 12, and the cloud controller is connected to the cloud server via a network, and is configured to receive the command codes converted by the cloud server, and control the content display device via the cloud controller by the at least one client (e.g., a locally configured client) when the network connected to the cloud server is poor. In an embodiment, the network suboptimal condition is a condition that the exhibition hall device cannot normally play due to too low network transmission rate or network disconnection.

In an embodiment, the at least one client 10 is further connected to the cloud controller, and is configured to upload a file to be played or submit a control instruction to the cloud controller, so that the local terminal control device 12 synchronizes cloud control related information and codes, and if the network is interrupted and the cloud server cannot communicate with the exhibition hall device, the local terminal control device 12 may also control the exhibition hall device. The field personnel can realize the control function by connecting the local terminal control equipment 12 with own electronic equipment (mobile phone, computer, etc.).

In an embodiment, the terminal control device 12 is a terminal control device 12 loaded with a linux system. In the preferred embodiment, the terminal control device 12 is a Raspberry Pi (Raspberry Pi), and in other alternative examples, may be other terminals or devices capable of running linux systems.

The cloud server and the terminal control equipment which are configured in the cloud computing-based exhibition hall control system have the advantages of being efficient, low in price, flexible and the like, analysis control nodes are placed on the cloud system, bottom equipment is controlled in an intranet mode, and the cloud system is convenient to achieve. When the number of the exhibition hall content display devices is increased, the cloud server can expand the computing capacity and the storage capacity, and the inconvenience that hardware needs to be upgraded and redeveloped due to the increase of the devices is avoided. In addition, for newly added equipment, a user only needs to be connected with a power supply and a network, and the rest parts of the background are all automatically deployed, so that the whole system is easy to maintain, the cost of manually arranging the equipment is reduced, and the working efficiency is improved. For newly added display contents, a user only needs to upload files in a browser, the system can be automatically deployed to equipment needing displaying, backup is reserved at the cloud end, and tools needed by playing of the files can be automatically identified by the system. On-site explicator can remotely control all devices by voice or a mobile phone browser without learning complex device knowledge. The whole system realizes the remote, quick and intelligent functions, has low learning cost, is convenient to operate and is easy to enhance the user experience. If the user has customized requirements, the code can be added/modified on the cloud server layer to meet individual requirements, the whole exhibition hall system is controlled, and the system data security is guaranteed by building the whole platform in the virtual network and carrying out security authentication through the secret key.

In an embodiment, the cloud computing is a cloud computing system or a cloud computing platform, and a user can flexibly deploy and maintain a service through the cloud computing system, for example, the user can submit a display file requirement to the cloud computing system in a form required by the cloud computing system, and the cloud computing system can apply for a corresponding resource for the user according to application, service, component requirements and the like in the display file requirement to create an executable service instance.

In practical application, the cloud computing system includes a public cloud computing system and a private cloud computing system, and the cloud computing system or the platform can be generally divided into three service modes, namely software as a service, platform as a service and basic equipment as a service, according to different service levels, wherein PaaS and IaaS can directly provide services for platform users through a service-oriented architecture or a network server, and can also serve as a support platform in a SaaS mode to indirectly provide services for end users. The private cloud system is used for example for an Ali cloud computing service platform, an Amazon cloud computing service platform, a Baidu cloud computing platform, an Tencent cloud computing platform and the like.

In the prior art, the computing resources in the cloud computing platform are likely to fail. This requires that the cloud computing system be guaranteed to have High Availability (HA) for running applications, which means that a system is highly reliable, i.e. rarely fails, or can be quickly recovered after failure. That is to say, when the computing resource of the application system in the cloud computing platform is invalid or other faults occur, a corresponding HA mechanism must be provided to ensure that the application system is recovered as soon as possible, and the downtime caused by planned daily maintenance operation or unplanned system crash is shortened, so that the interruption of service is avoided, and the availability of the application system is improved. The HA scheme is generally provided for a cloud computing platform by using a cloud management platform, and at present, the most popular cloud management platform is OpenStack, which is an open source project aiming at providing software for construction and management of public and private clouds. Both organizations and individuals in the OpenStack community use OpenStack as a common front-end for infrastructure as a service (IaaS) resources. OpenStack has become the de facto deployment standard of IaaS cloud platform in the industry and academia nowadays, and OpenStack is widely applied to various industries. From the viewpoint of OpenStack, in a cloud computing platform, IaaS serves as a support infrastructure of cloud computing, IaaS provides an elastic and extensible infrastructure service, and can provide large-scale on-demand computing service, storage service and network service for upper-layer applications, and the network service of the IaaS cloud platform is the most core service of the IaaS cloud platform, and is a key for influencing the quality of various cloud application services. Therefore, OpenStack is deployed on the physical computing, storage and network resources at the bottom of the cloud platform to realize the unified management of the computing, storage and network resources and provide the cloud infrastructure unified service of the IaaS layer.

The exhibition hall control system based on cloud computing is based on an OpenStack cloud platform, a Ceph (highly reliable, automatic adjustment and automatic recovery distributed storage system), an OpenvSwitch (virtual switch, OVS for short), a Flask Web (Pyrthon micro-framework based on Werkzeug and Jinja2, a client platform is built according to the scheme provided by the application and commands are generated), a Febric (distributed distributor based on modular support and distributes the commands to at least one terminal control device) and a Tunnel (network communication protocol), a semantic analysis technology is integrated to provide a solution for an intelligent exhibition hall control platform, and the solution is analyzed and distributed to specific exhibition hall devices for management control.

Referring to fig. 5, which is a system block diagram of a cloud server according to an embodiment of the present disclosure, as shown in the figure, the cloud server 30 is connected to at least one client 10 and at least one terminal control device 12 through a network, and each terminal control device 12 is configured corresponding to each content display device 13, including: an interface module 300, a storage module 301, a conversion module 302, and a cloud control module 303.

In the embodiment, the cloud server 30 is configured in a virtual private network, and the cloud server 30 and the terminal control device communicate with each other based on the Linux public key ssh-keygen. The virtual private network establishes a virtual private network VPN tunnel, so that the cloud server 30 and the terminal control device 12 communicate with each other based on the Linux public key ssh-keygen, thereby ensuring the security of the system. The ssh-keygen is a tool of the unix-like system for generating and managing ssh public keys and private keys. In one example, the virtual private network is, for example, a VPN and SSL/TLS secure network.

In an example, an SSH key may be created on the active virtual machine using an SSH-keygen command, the SSH key may be activated, and the key may be stored in the terminal control device. According to the exhibition hall control system, the client 10 uploads information to the cloud server 30 based on the virtual special safety network through the HTTP protocol, the information is issued to the specific terminal control device 12 through the cloud server 30, the virtual special network is set up, all data transmission in the platform is safe and reliable, and the personal information of the user at the client is protected. According to the method and the system, the whole platform is built in the virtual network, and the security authentication is carried out through the secret key, so that the security of system data is guaranteed.

The Client 10 is used for uploading a file to be played or submitting a control instruction, and in an embodiment, the Client is, for example, a local program loaded in a computer device including but not limited to a desktop computer, a notebook computer, a tablet computer, a smart phone, a media player, a Personal Digital Assistant (PDA), and the like, that is, the Client (Client) refers to a local program installed on a general user machine and needs to operate in cooperation with a service end, but for convenience of subsequent description, a physical form presented by the Client, such as a tablet computer, is taken as an example for illustration. For client-side voice control, a hardware device with recording capability is required, and it should be understood that the computer device described in the embodiments of the present application is only one example of an application, and that the components of the device may have more or fewer components than those shown, or have a different configuration of components. The various components described may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

In an embodiment, the number of the clients 10 configured according to the number of administrators or operating users may be one or more, and for convenience of describing the embodiment of the present application, the example shown in fig. 5 is described by taking the client 10 as an example.

The client 10 is configured to upload a file to be played or submit a control instruction, and in an embodiment, the client 10 uploads the file to be played or submits the control instruction to the cloud server 30 by using a communication network. In an embodiment, the file to be played may be a picture, a video, an Office file, a PDF file, or the like.

In an exemplary embodiment, the control instruction further includes an instruction for controlling the content presentation device 13, for example, a control instruction for controlling power on, power off, volume of playing, brightness of a display screen, and the like of the content presentation device 13.

In an embodiment, the control instruction is, for example, a page information instruction or a voice information instruction, and in an embodiment, the page information instruction is implemented by controlling a page, a user may set detailed parameters of playing content on the client 10, and the user selects content to be played and the formulated content presentation device 13 by operating a plurality of keys or input fields displayed in the user interaction interface to send the control instruction to the cloud server 30. In an embodiment, the voice information command is implemented by voice control, and the client 10 sends the voice information to the cloud server 30 for analysis feature extraction, such as "number of devices", "play content", "play/pause/switch back to previous content", "previous/next page", and sends these feature information to the cloud server 30 in an integrated manner. In an embodiment, the terminal command control information is information controlled by a user in a manner of directly ssh logging in a terminal control device through a local client and in a manner of a terminal command, in an application example, the exhibition hall control system is a programmable system, and the user can directly cross a cloud service end to feed back a user interaction interface to the control terminal, in other words, the user does not need to obtain client information through a page command and voice information, and can directly log in, for example, a raspberry serving terminal control device to control a raspberry serving file in a manner of tapping a command at the terminal.

Referring to fig. 6, which is a system block diagram of a cloud server according to another embodiment of the present disclosure, as shown in the figure, the cloud server 30 further includes a speech recognition module 304, where the speech recognition module 304 is configured to recognize a speech information instruction issued by the client 10, perform NLP semantic analysis on the recognized speech information instruction, convert the recognized speech information instruction into a command code, and output the command code, and in an embodiment, the speech recognition module 304 includes a trained neural network system. The neural network system may process speech input received through the I/O to generate recognition results. Examples of speech recognition models in the trained neural network system may include hidden markov models, gaussian mixture models, deep neural network models, n-grams, and other statistical models. Examples of speech recognition engines may include dynamic time warping based engines and Weighted Finite State Transducer (WFST) based engines. One or more speech recognition models and one or more speech recognition engines may be used to process the proposed replacement representative features of the front-end speech preprocessor to generate intermediate recognition results (e.g., phonemes, phoneme sequences, and sub-words) and ultimately text recognition results (e.g., words, word sequences, or symbol sequences). Once the speech recognition module 304 generates recognition results containing text (e.g., words, or sequences of symbols), the recognition results may be passed to a natural language processing module for NLP semantic analysis for intent inference.

In an embodiment, when a user uploads a new file to be played through the client 10, the cloud server 30 receives the file to be played and stores the file in a memory of the file to be played, and at this time, each terminal control device 12 performs data synchronization on the file to be played stored in the cloud server 30.

The at least one content display device 13 is configured to display the file to be played in a playing manner when receiving the playing instruction; in different embodiments, the content presentation device 13 may be one or more based on the arrangement of the exhibition hall. The content presentation apparatus 13 will be described as an example of a plurality of the content presentation apparatuses. In an embodiment, the content display device 13 is an electronic device including a display screen, such as a smart television, or a touch-control all-in-one machine, an interactive smart tablet device, and the like. In an embodiment, the content presentation device 13 is an output device with an HDMI interface, and its display screen is, for example, a 4: 3 display screen, a 14: 9 display screen, a 16: 10 display screen, or a 15: 9 display screen. The content display device 13 carries a bluetooth audio output or 3.5mm audio output interface.

The interface module 300 is connected to at least one client via a network, and is configured to receive a file to be played or a control instruction submitted by the at least one client; in an embodiment, the interface module 300 comprises a network communication device. The interface module 300 is further configured to verify the operation permission of the at least one client 10 when receiving the request of the at least one client 10, and feed back a verification result to the at least one client 10. In an embodiment, when a user logs in, the interface module 300 obtains user data sent from the client 10, such as user data such as a user login ID, a login password, and an authentication code, the cloud server 11 responds to a login request of the user, sends the data to the database to authenticate the operation authority of the at least one client 10, and after the authentication is successful, feeds back an authentication result to the client 10, the user enters a control interface of the client 10, and at this time, the user may select voice control or page control, that is, the user may select a control instruction sent as a page information instruction, or a control instruction sent as a voice information instruction.

In an embodiment, after the client 10 of the user successfully logs in, the interface module 300 is further configured to provide a corresponding graphical user interface to the at least one client for the client to upload a file to be played or submit a control instruction. Referring to fig. 2a and fig. 2b, schematic diagrams of a graphical user interface provided by the cloud server 30 to the client 10 according to an embodiment of the present application are shown, where the graphical user interface includes a plurality of buttons, including a button for selecting a file to be played, for example, buttons of "play video", "play PPT", "play picture", and "play PDF" shown in fig. 2 a; keys designating the content presentation apparatus 13, such as keys of "apparatus No. 1", "apparatus No. 2", "apparatus No. 3", and "control all", etc., are illustrated; the system further comprises a key for uploading files, and a key for designating or setting a playing mode, such as the illustrated "loop playing", or icon keys representing "previous page", "playing", "next page", and "returning". The illustration also shows exemplary icon keys comprising "input language" and "control volume", corresponding to the difference in control commands. Fig. 2b is a schematic diagram of a graphical user interface provided by the cloud server 11 to the client 10 in an embodiment of the present application, and a user performs voice input through the graphical user interface, it should be specifically noted that the display in fig. 2a or fig. 2b is only exemplary, and in different embodiments or different UI designs, it may also be considered that corresponding keys and different forms of page designs, such as keys corresponding to control instructions, such as file editing or file modification, are added, modified or deleted according to requirements of uploading a file to be played and control instructions. When new equipment is added, for example, terminal control equipment is added newly, the terminal equipment can automatically submit content information to the cloud service end, and the cloud service end is responsible for controlling the new terminal control equipment by adding a key newly.

The playing content/interface displayed by the content display device 13 is synchronized to the cloud server 30, so that the user can view the playing content/interface being displayed by the content display device 13 on the client 10 through the communication between the client 10 and the cloud server 30. As shown in fig. 2a, when the user selects the content to be played, and the user clicks the content to be played, the client uploads the new content, and the pull-down menu adds a new key in real time and names the key with the uploaded file name. The content displayed by the content display equipment in the actual exhibition hall can be synchronized in real time under the graphical user interface, so that a user can pay attention to the flow of the exhibition hall in real time when not in the exhibition hall.

The interface module 300 is further configured to record configuration information of the at least one terminal control device based on a new device access request of the at least one terminal control device, add the configuration information into the device list, build a relevant bottom environment for the at least one terminal control device according to the configuration information, and provide a graphical user interface corresponding to the new device to the at least one client according to the configuration information, where the graphical user interface includes information such as an automatically generated new button, a command, and a control mode of the new device.

When a new content presentation device 13 equipped with the terminal control device 12 arrives at the exhibition hall, the cloud server 30 recognizes and controls the flow of the new device. When the new content display device 13 configured with the terminal control device 12 is connected to a power supply in the exhibition hall and is networked through WIFI, the terminal control device 12 writes the IP address obtained by DHCP into the configuration, changes the IP address into a fixed IP, and then sends the configuration information to the cloud server 30 for recording. The cloud server 30 adds the new content presentation device 13 configured with the terminal control device 12 to the device list, and controls the content presentation device 13 configured with the terminal control device 12 when the command "designate new device to operate" or "operate all devices" appears next time. After receiving the configuration information, the cloud server 30 uploads all files stored in the cloud hard disk to the content display device 13 newly configured with the terminal control device 12, and adds an option of a new device to the client 10. For the newly added content display device 13 configured with the terminal control device 12, the user only needs to connect the power supply and the network, and the rest systems are all automatically deployed in the background, so that the whole system is easy to maintain, the cost of manually arranging the devices is reduced, and the working efficiency is improved. For the newly added display content, the user only needs to upload a file in the browser of the client 10, the system is automatically deployed to the content display device 13 to be displayed, a backup is left in the cloud server 30, and the cloud server 30 automatically identifies a program or a tool required for playing the file.

The storage module 301 is configured to store the file to be played and the device list; the interface module 300 receives a file to be played uploaded by the at least one client 10, and the cloud server 30 stores the file to be played in a memory, in an embodiment, the memory may include a non-volatile memory, such as a read-only memory, a flash memory, an SD card, a hard disk or a solid state disk; the memory may also comprise a combination of memories of the kind described above. The memory may include a plurality of instructions, modules or applications to perform various functions, including routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. In an embodiment, the storage module 301 further stores a speech analysis NLP code, and stores information such as a web page/speech client code.

The conversion module 302 is configured to convert the control instruction into a command code; in an embodiment, the cloud server 30 monitors the control instruction of the at least one client 10 periodically or in real time, and causes the conversion module 302 to convert the control instruction obtained by monitoring into a command code; in an embodiment, it is preferable that the cloud server 30 monitors the control instruction of the at least one client 10 in real time, and when receiving the control instruction submitted by the client 10, converts the control instruction into a command code by analyzing the control instruction; the command code may be readable by the terminal control device 12, for example, so that the terminal control device 12 may read a play file type instruction, for example, "file format or type of file to be played" from the command code; a specify playback device instruction, such as "specify one or more content presentation devices 13"; and file playing mode instructions, such as "playing software or application corresponding to the file to be played", playing/pausing/switching back to the upper content, "previous/next page", and the like. In an embodiment, the command code includes, for example, a conversion code from a key of the corresponding graphical user interface of the client 10 or a code obtained by performing voice analysis on the acquired user voice information.

The cloud control module 303 is connected to the at least one terminal control device, and configured to distribute the command code to the at least one terminal control device so as to instruct at least one content display device to display the file to be played. The cloud control module 303 is a cloud controller, and is correspondingly connected to each terminal control device 12, and the cloud controller is configured to distribute the command code to the at least one terminal control device 12. In embodiments, the cloud controller may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The cloud server is used for managing each terminal control device, has the advantages of being efficient, low in price, flexible and the like, and is convenient to achieve by placing the analysis control nodes on the cloud system and controlling the bottom device in an intranet mode. When the number of the exhibition hall content display devices is increased, the cloud server can expand the computing capacity and the storage capacity, and the inconvenience that hardware needs to be upgraded and redeveloped due to the increase of the devices is avoided. In addition, for newly added equipment, a user only needs to be connected with a power supply and a network, and the rest parts of the background are all automatically deployed, so that the whole system is easy to maintain, the cost of manually arranging the equipment is reduced, and the working efficiency is improved. For newly added display contents, a user only needs to upload a file in a browser, the cloud server can be automatically deployed in equipment needing to be displayed, a backup is reserved in the cloud server, and a system can automatically recognize tools needed by playing the file. On-site explicator can remotely control all devices by voice or a mobile phone browser without learning complex device knowledge. The whole system realizes the remote, quick and intelligent functions, has low learning cost, is convenient to operate and is easy to enhance the user experience. If the user has customized requirements, the code can be added/modified on the cloud server layer to meet individual requirements, the whole exhibition hall system is controlled, and the system data security is guaranteed by building the whole platform in the virtual network and carrying out security authentication through the secret key.

The application also provides a terminal control device, which is used for controlling the content display device to display the file to be played. Referring to fig. 7, an application block diagram of the terminal control device of the present application in an embodiment is shown, in an application example, the terminal control device 50 is connected to a cloud server 11 through a network and is locally connected to a content display device 13. In an embodiment, the cloud server 11 is connected to at least one client 10 through a network, so as to construct an exhibition hall control system based on cloud computing, and the cloud computing is a cloud computing system or a cloud computing platform, so that a user can flexibly deploy and maintain services through the cloud computing system.

The exhibition hall control system based on cloud computing integrates NLP semantic analysis technology to provide a solution for an intelligent exhibition hall control platform, analyzes and distributes to specific exhibition hall equipment for management control on the basis of OpenStack cloud platform, Ceph (highly reliable, automatic adjustment and automatic recovery distributed storage system), OpenvSwitch (virtual switch, OVS for short), and Python micro-framework based on Werkzeug and Jinja2, wherein the scheme provided by the application is used for building a client platform and generating commands), Febric (distributed distributor based on modular support and distributing the commands to at least one terminal control equipment) and Tunnel (network communication protocol).

In the embodiment, in this embodiment, the terminal control device 50 and the cloud server 11 are set up in a Virtual Private Network (VPN), that is, a VPN tunnel is set up, so that the cloud server 11 and the terminal control device 50 communicate with each other based on the Linux public key ssh-keygen, thereby ensuring the security of the system. The ssh-keygen is a tool of the unix-like system for generating and managing ssh public keys and private keys. In one example, the virtual private network is, for example, a VPN and SSL/TLS secure network.

In an example, an SSH key may be created on the active virtual machine using an SSH-keygen command, the SSH key may be activated, and the key may be stored in the terminal control device. According to the exhibition hall control system, the client 10 uploads information to the cloud server 11 based on the virtual private security network through the HTTP protocol, the information is issued to the specific terminal control device 50 through the cloud server 11, and the virtual private network is set up, so that all data transmission in the platform is safe and reliable, and personal information of a user of the client 10 is protected. According to the method and the system, the whole platform is built in the virtual network, and the security authentication is carried out through the secret key, so that the security of system data is guaranteed.

As shown in fig. 7, the terminal control device 50 of the present application includes: a network module 500, a synchronization module 501, and a control module 502.

The network module 500 is connected to the cloud server 11 through a network, and is configured to receive a command code distributed by the cloud server 11; the command code is obtained by monitoring a control instruction from at least one client 10 by the cloud server 11 and converting the control instruction; in an embodiment, the cloud server 11 monitors the control instruction of the at least one client 10 in real time, and when receiving the control instruction submitted by the client 10, converts the control instruction into a command code by analyzing the control instruction; the command code may be readable by the terminal control device 50, for example, so that the terminal control device 50 may read a play file type instruction from the command code, for example, "file format or type of file to be played"; a specify playback device instruction, such as "specify one or more content presentation devices 13"; and file playing mode instructions, such as "playing software or application corresponding to the file to be played", playing/pausing/switching back to the upper content, "previous/next page", and the like. In an embodiment, the command code includes, for example, a conversion code from a key of the corresponding graphical user interface of the client 10 or a code obtained by performing voice analysis on the acquired user voice information.

In an embodiment, the client 10 uploads a file to be played or submits a control instruction to the cloud server 11 by using a communication network.

In an embodiment, the control instruction is, for example, a page information instruction or a voice information instruction, and in an embodiment, the page information instruction is implemented by controlling a page, a user may set detailed parameters of playing content on the client 10, and the user selects content to be played and the formulated content presentation device 13 by operating a plurality of keys or input fields displayed in the user interaction interface to send the control instruction to the cloud server 11. In an embodiment, the voice information instruction is implemented by performing voice control, and the client 10 sends the voice information to the cloud service end 11 for analysis feature extraction, such as "number of devices", "play content", "play/pause/switch back to upper content", "previous page/next page", and integrates and sends the feature information to the cloud service end 11. In an embodiment, the terminal command control information is information controlled by a user in a manner of directly ssh logging in a terminal control device through a local client and in a manner of a terminal command, in an application example, the exhibition hall control system is a programmable system, and the user can directly cross a cloud service end to feed back a user interaction interface to the control terminal, in other words, the user does not need to obtain client information through a page command and voice information, and can directly log in, for example, a raspberry serving terminal control device to control a raspberry serving file in a manner of tapping a command at the terminal.

In an embodiment, the network module 500 is further configured to send a new device access request to the cloud server 11, so that the cloud server 11 constructs a relevant underlying environment for the cloud server, and provide a graphical user interface corresponding to the new device to the at least one client according to the configuration information, where the graphical user interface includes information such as an automatically generated new button, a command, and a control mode of the new device. In an embodiment, when receiving a new device access request of the at least one terminal control device 50, the cloud server 11 records configuration information of the at least one terminal control device 50 to add the configuration information into a device list, and builds a related underlying environment for the at least one terminal control device 50 according to the configuration information. When a new content presentation device 13 provided with the terminal control device 50 arrives at the exhibition hall, the exhibition hall control system recognizes and controls the flow of the new device. When the new content display device 13 configured with the terminal control device 50 is connected to a power supply in the exhibition hall and is networked through WIFI, the terminal control device 50 writes the IP address obtained by DHCP into the configuration, changes the IP address into a fixed IP, and then sends the configuration information to the cloud controller 111 side and the cloud server side for recording. The cloud control end will add the new content presentation device 13 configured with the terminal control device 50 into the device list, and control the content presentation device 13 configured with the terminal control device 50 when the command "designate new device to operate" or "operate all devices" appears next time. After receiving the configuration information, the cloud server 11 uploads all files stored in the cloud hard disk to the content display device 13 newly configured with the terminal control device 50, and adds an option of a new device to the client 10.

For the newly added content display device 13 configured with the terminal control device 50, the user only needs to connect the power supply and the network, and the rest systems are all automatically deployed in the background, so that the whole system is easy to maintain, the cost of manually arranging the devices is reduced, and the working efficiency is improved. For newly added display content, a user only needs to upload a file in a browser of the client 10, the system is automatically deployed into the content display device 13 to be displayed, a backup is left at the cloud server 11, and the system automatically identifies a program or a tool required for playing the file.

The synchronization module 501 synchronizes data with the cloud server 11 through the network module 500; in an embodiment, the synchronizing data between the synchronization module 501 and the cloud server 11 includes synchronizing the command codes converted by the cloud server 11 and the stored file to be played.

In an exemplary embodiment, the terminal control device 50 is configured corresponding to each content display device 13, in the embodiment, each content display device 13 is configured with one terminal control device 50, each terminal control device 50 is connected to the cloud server 11 through a network, each terminal control device 5012 is configured to synchronize data with the cloud server 11, in the embodiment, when a user uploads a new file to be played through the client 10, the cloud server 11 receives the file to be played and stores the file in a memory thereof, and at this time, each terminal control device 5012 performs data synchronization on the file to be played stored in the cloud server 11.

In an embodiment, each terminal control device 50 is configured to synchronize data with the cloud server 11 further includes synchronizing the playing content/interface displayed by the content display device 13 to the cloud server 11, so that a user can view the playing content/interface being displayed by the content display device 13 on the client 10 through communication between the client 10 and the cloud server 11. Referring to fig. 2a and 2b, contents displayed on the client 10 when the terminal control device 50 and the cloud server 11 synchronize data according to an embodiment of the present application are shown, as shown in fig. 2a, a user selects a play content (PPT in the drawing), and after clicking, a pull-down menu specifically selects the play content, and when the client uploads a new content by itself, the pull-down menu adds a new key in real time and names the key with an uploaded file name. The content displayed by the content display device 13 in the actual exhibition hall is synchronized in real time under the graphical user interface, so that the user can pay attention to the flow of the exhibition hall in real time when not in the exhibition hall.

The control module 502 is locally connected to a content display device 13, and is configured to instruct the content display device 13 to display the file to be played according to the received command code. The control module 502 is configured to, when receiving the command code, identify file information included in the name code to match a corresponding playback program to the content display device 13.

The file to be played is obtained by the at least one terminal control device 50 from being stored in the cloud server 11 in advance synchronously or being read from the cloud server 11 immediately according to the command code. In an embodiment, the pre-synchronization acquisition is that when a user uploads a new file to be played through the client 10, the cloud server 11 receives the file to be played and stores the file in a memory thereof, and at this time, each terminal control device 50 performs data synchronization on the file to be played stored in the cloud server 11; the instant reading from the cloud service end 11 according to the command code is that, when receiving the command code submitted by the user through the client 10, the cloud service end 11 distributes the command code to the terminal control device 50 through the cloud controller 111, and the terminal control device 50 reads or identifies the file information contained in the name code, that is, the file to be played stored can be read in real time from the memory of the cloud service end 11 to match the corresponding playing program to the at least one content display device 13 for playing and displaying.

In an embodiment, the cloud controller may also be configured in each of the terminal control devices 50, and the cloud controller is connected to the cloud server via a network, and is configured to receive the command codes converted by the cloud server, and control the content display device via the cloud controller by the at least one client (a locally configured client) when the network connected to the cloud server is poor. In an embodiment, the network suboptimal condition is a condition that the exhibition hall device cannot normally play due to too low network transmission rate or network disconnection.

In an embodiment, the at least one client 10 is further connected to the cloud controller, and is configured to upload a file to be played or submit a control instruction to the cloud controller, so that the local terminal control device 50 synchronizes cloud control related information and codes, and if the network is interrupted and the cloud server cannot communicate with the exhibition hall device, the local terminal control device 50 may also control the exhibition hall device. The field personnel can realize the control function by connecting the local terminal control equipment 50 with own electronic equipment (mobile phone, computer, etc.).

In an embodiment, the terminal control device 50 is a terminal control device 50 loaded with a linux system. In the preferred embodiment, the terminal control device 50 is a Raspberry Pi (Raspberry Pi), and in other alternative examples, may be other terminals or devices capable of running linux system.

The application provides an exhibition hall control method based on cloud computing, which is applied to an exhibition hall control system based on cloud computing, in an embodiment, the cloud computing is a cloud computing system or a cloud computing platform, a user can flexibly deploy and maintain business through the cloud computing system, for example, the user can submit a display file requirement to the cloud computing system in a form required by the cloud computing system, and the cloud computing system can apply for corresponding resources for the user according to application, service, component requirements and the like in the display file requirement so as to create an executable business instance.

In the prior art, the computing resources in the cloud computing platform are likely to fail. This requires that the cloud computing system be guaranteed to have High Availability (HA) for running applications, which means that a system is highly reliable, i.e. rarely fails, or can be recovered quickly after failure. That is to say, when the computing resource of the application system in the cloud computing platform is invalid or other faults occur, a corresponding HA mechanism must be provided to ensure that the application system is recovered as soon as possible, and the downtime caused by planned daily maintenance operation or unplanned system crash is shortened, so that the interruption of service is avoided, and the availability of the application system is improved. The HA scheme is generally provided for a cloud computing platform by using a cloud management platform, and at present, the most popular cloud management platform is OpenStack, which is an open source project aiming at providing software for construction and management of public and private clouds. Both organizations and individuals in the OpenStack community use OpenStack as a common front-end for infrastructure as a service (IaaS) resources. OpenStack has become the de facto deployment standard of IaaS cloud platform in the industry and academia nowadays, and OpenStack is widely applied to various industries. From the viewpoint of OpenStack, in a cloud computing platform, IaaS serves as a support infrastructure of cloud computing, IaaS provides an elastic and extensible infrastructure service, and can provide large-scale on-demand computing service, storage service and network service for upper-layer applications, and the network service of the IaaS cloud platform is the most core service of the IaaS cloud platform, and is a key for influencing the quality of various cloud application services. Therefore, OpenStack is deployed on the physical computing, storage and network resources at the bottom of the cloud platform to realize the unified management of the computing, storage and network resources and provide the cloud infrastructure unified service of the IaaS layer.

In this embodiment, the exhibition hall control system is built in a Virtual Private Network (VPN), that is, by establishing a VPN tunnel, the cloud server and the terminal control device communicate with each other based on a Linux public key ssh-keygen, thereby ensuring the security of the system. The ssh-keygen is a tool of the unix-like system for generating and managing ssh public keys and private keys. In one example, the virtual private network is, for example, a VPN and SSL/TLS secure network.

In an example, an SSH key may be created on the active virtual machine using an SSH-keygen command, the SSH key may be activated, and the key may be stored in the terminal control device. According to the exhibition room control system, the client uploads the information to the cloud server based on the virtual special safety network through the HTTP protocol, the information is issued to the specific terminal control equipment through the cloud server, the virtual special network is set up, all data transmission in the platform is safe and reliable, and the personal information of the user at the client is protected. According to the method and the system, the whole platform is built in the virtual network, and the security authentication is carried out through the secret key, so that the security of system data is guaranteed.

Referring to fig. 8, which is a flowchart illustrating an embodiment of an exhibition hall control method according to the present application, as shown in the figure, the cloud computing-based exhibition hall control method includes the following steps:

step S70, when the cloud service end receives a control instruction submitted by at least one client, the control instruction is converted into a command code; in embodiments where the client is a computer device such as, but not limited to, a desktop computer, a laptop computer, a tablet computer, a smart phone, a media player, a Personal Digital Assistant (PDA), etc., a hardware device with recording capability is required for the client to perform voice control, it should be understood that the computer device described in the embodiments of the present application is only an example of an application and that the components of the device may have more or less components than those shown or a different configuration of components. The various components described may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

In the embodiments of the present application, the client is a tablet computer, for example, a tablet computer of iPad series loaded with iOS operating system by apple is common; for example, the Android tablet pc is an Android tablet pc loaded with an Android operating system developed by Google corporation, and is a tablet pc of companies such as samsung, huashi, and millet.

In an exemplary embodiment, the client, which is a tablet computer, may further obtain language information input by a user through an audio signal acquisition device, such as a microphone.

In an embodiment, the number of the clients configured according to the number of administrators or operating users may be one or multiple, and for convenience of describing the embodiments of the present application, the present embodiment is described by taking the client as an example.

In an embodiment, the client uploads the file to be played or submits the control instruction to the cloud server by using a communication network.

In an exemplary embodiment, the instructions for specifying a playback device include instructions for specifying a content presentation device, such as which content presentation device or devices to play back for presentation.

In an exemplary embodiment, the control instruction further includes an instruction for controlling the content presentation device, for example, a control instruction for controlling power on, power off, volume of playing, brightness of a display screen, and the like of the content presentation device.

In an exemplary embodiment, the client uploads the file to be played or submits the control command based on a user interaction interface (GUI interface) displayed on a display screen, where the user interaction interface includes a plurality of keys or input fields or keys activating a microphone for user input or selection.

In an embodiment, the control instruction is, for example, a page information instruction or a voice information instruction, and in an embodiment, the page information instruction is implemented by controlling a page, a user may set detailed parameters of playing content on a client, and the user selects content to be played and a formulated content presentation device by operating a plurality of keys or input fields displayed in a user interaction interface to send the control instruction to a cloud server. In an embodiment, the voice information instruction is implemented by voice control, and the client sends the voice information to the cloud service end for analysis feature extraction, such as "number of devices", "play content", "play/pause/switch back to upper content", "previous/next page", and integrates and sends the feature information to the cloud service end. In an embodiment, the terminal command control information is information controlled by a user in a manner of directly ssh logging in a terminal control device through a local client and in a manner of a terminal command, in an application example, the exhibition hall control system is a programmable system, and the user can directly cross a cloud service end to feed back a user interaction interface to the control terminal, in other words, the user does not need to obtain client information through a page command and voice information, and can directly log in, for example, a raspberry serving terminal control device to control a raspberry serving file in a manner of tapping a command at the terminal.

The cloud server is connected with at least one client through a network, is connected with at least one terminal control device through the network, and is configured to receive and store a file to be played uploaded by the at least one client. The cloud server is also used for monitoring the control instruction of the at least one client regularly or in real time and converting the control instruction into a command code; in an embodiment, the cloud server 11 is actually, for example, a server or a cluster of multiple servers. In an embodiment, the server includes a communication interface, a processor and a memory, the communication interface establishes a communication connection with the processor and the memory, respectively, and the processor and the memory establish a communication connection.

The cloud server also comprises a voice recognition module, wherein the voice recognition module is used for recognizing a voice information instruction sent by the client, performing NLP semantic analysis on the recognized voice information instruction, converting the language information instruction into a command code and outputting the command code, and in the embodiment, the voice recognition module comprises a trained neural network system. The neural network system may process speech input received through the I/O to generate recognition results. Examples of speech recognition models in the trained neural network system may include hidden markov models, gaussian mixture models, deep neural network models, n-grams, and other statistical models. Examples of speech recognition engines may include dynamic time warping based engines and Weighted Finite State Transducer (WFST) based engines. One or more speech recognition models and one or more speech recognition engines may be used to process the proposed replacement representative features of the front-end speech preprocessor to generate intermediate recognition results (e.g., phonemes, phoneme sequences, and sub-words) and ultimately text recognition results (e.g., words, word sequences, or symbol sequences). Once the speech recognition module generates recognition results containing text (e.g., words, or sequences of symbols), the recognition results may be passed to a natural language processing module for NLP semantic analysis for intent inference.

The cloud server monitors a control instruction of the at least one client regularly or in real time and converts the control instruction into a command code; in an embodiment, a preferable mode is that the cloud service end monitors the control instruction of the at least one client in real time, and when receiving the control instruction submitted by the client, the control instruction is analyzed and converted into a command code; the command code may be readable by the terminal control device, for example, so that the terminal control device may read a play file type instruction, for example, "file format or type of file to be played" from the command code; a specify playback device instruction, such as "specify one or more content presentation devices"; and file playing mode instructions, such as "playing software or application corresponding to the file to be played", playing/pausing/switching back to the upper content, "previous/next page", and the like. In an embodiment, the command code includes, for example, a conversion code from a key of the corresponding graphical user interface of the client 10 or a code obtained by performing voice analysis on the acquired user voice information.

Step S71, the cloud server distributes the command code to at least one terminal control device, so that the terminal control device instructs the at least one content display device to display a file to be played according to the command code; the file to be played is obtained by the at least one terminal control device from being stored in the cloud server synchronously in advance or is read from the cloud server instantly according to the command code.

The at least one content display device is configured to display the file to be played when receiving the playing instruction; in different embodiments, the content display device may be one or more based on the arrangement of the exhibition hall. The content presentation apparatus will be described below as an example of a plurality of the content presentation apparatuses.

In an embodiment, the content display device is an electronic device including a display screen, such as a smart television, or a touch-control all-in-one machine, an interactive smart tablet device, and the like. In an embodiment, the content presentation device 13 is an output device with an HDMI interface, and its display screen is, for example, a 4: 3 display screen, a 14: 9 display screen, a 16: 10 display screen, or a 15: 9 display screen. The content display device 13 carries a bluetooth audio output or 3.5mm audio output interface.

The step S71 further includes: when the command code is received, identifying file information contained in the naming code; and matching the corresponding playing program to the at least one content display device to display a file to be played. In an embodiment, each of the terminal control devices is further configured to instruct the at least one content presentation device to present the file to be presented in a presentation manner according to the received command code; the file to be played is obtained by the at least one terminal control device from the cloud server synchronously in advance or is read from the cloud server instantly according to the command code. In an embodiment, the pre-synchronization acquisition is that when a user uploads a new file to be played through a client, a cloud server receives the file to be played and stores the file in a memory of the cloud server, and at this time, each terminal control device performs data synchronization on the file to be played stored in the cloud server; the instant reading from the cloud service end according to the command code is that when the command code submitted by the user through the client is received, the cloud service end distributes the command code to the terminal control equipment through the cloud controller, and the terminal control equipment reads or identifies the file information contained in the name code, namely, the stored file to be played can be read in real time from the memory of the cloud service end so as to match the corresponding playing program to the at least one content display equipment for playing and displaying.

In an embodiment, the terminal control device is a terminal control device loaded with a linux system. In a preferred embodiment, the terminal control device is a Raspberry Pi (Raspberry Pi), and in other alternative examples, the terminal control device may be other terminals or devices capable of operating linux system.

In an embodiment, the cloud computing-based exhibition hall control method further includes the following steps:

the cloud server side stores the file to be played uploaded by the at least one client side when receiving the file to be played; in an embodiment, the cloud server receives a file to be played uploaded by the at least one client and stores the file to be played in a memory, where the memory may include a non-volatile memory, such as a read-only memory, a flash memory, an SD card, a hard disk, or a solid state disk; the memory may also comprise a combination of memories of the kind described above. The memory may include a plurality of instructions, modules or applications to perform various functions, including routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. When the technical solution provided by the present application is implemented by software, program codes for implementing the exhibition hall control system provided by the present application are stored in a memory and executed by a processor. The processor may be a central processor.

And the file to be played is synchronously stored by at least one terminal control device, so that the at least one content display device is instructed to play and display the file to be played when the command code is received. In an embodiment, when a user uploads a new file to be played through a client, the file to be played is received and stored in a memory of the cloud server, and at this time, each terminal control device performs data synchronization on the file to be played stored in the cloud server.

verifying the operation authority of the at least one client when the request of the at least one client is received; feeding back a verification result to the at least one client; in an embodiment, the cloud server is further configured to verify the operation authority of the at least one client when receiving the request of the at least one client, and feed back a verification result to the at least one client. In an embodiment, when a user logs in, a cloud service side obtains user data sent from a client, such as user data of a user login ID, a login password, a verification code and the like, the cloud service side responds to a login request of the user, sends the data to a database to verify the operation authority of at least one client, after the verification is successful, a verification result is fed back to the client, the user can enter a control interface of the client, and at the moment, the user can select voice control or page control, that is, the user can select a control instruction sent as a page information instruction, or a control instruction sent as a voice information instruction.

In an embodiment, the cloud-computing-based exhibition hall control method further includes a step of providing a corresponding graphical user interface to the at least one client for the client to upload a file to be played or submit a control instruction. In an embodiment, after the client of the user successfully logs in, the cloud server provides a corresponding graphical user interface to the at least one client, so that the client can upload a file to be played or submit a control instruction, wherein in the embodiment, the graphical user interface includes at least one or more of a graphical interface, a text interface and a voice interface. Referring to fig. 2a and fig. 2b, schematic diagrams of a graphical user interface provided by the cloud server to the client according to an embodiment of the present application are shown, as shown in the drawings, the graphical user interface includes a plurality of buttons, including a button for selecting a file to be played, for example, buttons of "play video", "play PPT", "play picture", and "play PDF" shown in fig. 2 a; keys designating the content presentation device 13, such as the illustrated keys "device No. 1", "device No. 2", "device No. 3", and "control all"; the system further comprises a key for uploading files, and a key for designating or setting a playing mode, such as the illustrated "loop playing", or icon keys representing "previous page", "playing", "next page", and "returning". The illustration also shows exemplary icon keys comprising "input language" and "control volume", corresponding to the difference in control commands. Fig. 2b is a schematic diagram of a graphical user interface provided by the cloud server 11 to the client 10 in an embodiment of the present application, and a user performs voice input through the graphical user interface, it should be specifically noted that the display in fig. 2a or fig. 2b is only exemplary, and in different embodiments or different UI designs, it may also be considered that corresponding keys and different forms of page designs, such as keys corresponding to control instructions, such as file editing or file modification, are added, modified or deleted according to requirements of uploading a file to be played and control instructions. When new equipment is added, for example, the terminal equipment is added newly, the terminal equipment can automatically submit content information to the cloud server, and the cloud server is responsible for adding a key newly to control the new terminal equipment.

The playing content/interface displayed by the content display equipment is synchronized to the cloud server, so that a user can view the playing content/interface displayed by the content display equipment on the client through the communication between the client and the cloud server. As shown in fig. 2a, when the user selects the content to be played, and the user clicks the content to be played, the client uploads the new content, and the pull-down menu adds a new key in real time and names the key with the uploaded file name. The content displayed by the content display equipment in the actual exhibition hall can be synchronized in real time under the graphical user interface, so that a user can pay attention to the flow of the exhibition hall in real time when not in the exhibition hall.

when a new device access request of the at least one terminal control device is received, recording the configuration information of the at least one terminal control device so as to add the configuration information into a device list; and building a related bottom environment for the at least one terminal control device according to the configuration information, and providing a graphical user interface corresponding to the new device for the at least one client according to the configuration information, wherein the graphical user interface comprises information such as automatically generating a new button, a command and providing a control mode of the new device. In an embodiment, when receiving a new device access request of the at least one terminal control device, the cloud server records configuration information of the at least one terminal control device to add the configuration information into a device list, builds a related underlying environment for the at least one terminal control device according to the configuration information, and provides a graphical user interface corresponding to the new device for the at least one client according to the configuration information, wherein the graphical user interface includes information such as an automatic generation new button, a command, and a control mode of the new device. In an embodiment, the graphical user interface comprises at least one or more of a graphical interface, a textual interface, and a voice interface. When the new content display device provided with the terminal control device arrives at the exhibition hall, the exhibition hall control system identifies and controls the flow of the new device. When the new content display equipment provided with the terminal control equipment is connected with a power supply in an exhibition hall and is networked through WIFI, the terminal control equipment writes the IP address obtained by DHCP into the configuration, changes the IP address into a fixed IP, and then sends configuration information to the cloud controller end and the cloud server end for recording. The cloud control end adds the new content display equipment configured with the terminal control equipment into the equipment list, and controls the content display equipment configured with the terminal control equipment when the command of 'appointing new equipment to operate' and 'operating all equipment' appears next time. And after receiving the configuration information, the cloud server uploads all files stored in the cloud hard disk to the content display equipment newly configured with the terminal control equipment, and the option of the new equipment is added at the client.

For the newly added content display equipment configured with the terminal control equipment, a user only needs to be connected with a power supply and a network, and the rest parts of the system are all automatically deployed in the background, so that the whole system is easy to maintain, the cost of manually arranging the equipment is reduced, and the working efficiency is improved. For newly added display content, a user only needs to upload a file in a browser of a client, the system can be automatically deployed into content display equipment needing to be displayed, a backup is reserved at the cloud end, and the system can automatically identify a program or a tool needed by playing the file.

According to the cloud computing-based exhibition hall control method, the cloud server and the terminal control device which are configured have the characteristics of high efficiency, low price, elastic expansion and the like, the analysis control nodes are placed on the cloud system, the bottom layer device is controlled in an intranet mode, and the method is convenient to achieve. When the number of the exhibition hall content display devices is increased, the cloud server can expand the computing capacity and the storage capacity, and the inconvenience that hardware needs to be upgraded and redeveloped due to the increase of the devices is avoided. In addition, for newly added equipment, a user only needs to be connected with a power supply and a network, and the rest parts of the background are all automatically deployed, so that the whole system is easy to maintain, the cost of manually arranging the equipment is reduced, and the working efficiency is improved. For newly added display contents, a user only needs to upload files in a browser, the system can be automatically deployed to equipment needing displaying, backup is reserved at the cloud end, and tools needed by playing of the files can be automatically identified by the system. On-site explicator can remotely control all devices by voice or a mobile phone browser without learning complex device knowledge. The whole system realizes the remote, quick and intelligent functions, has low learning cost, is convenient to operate and is easy to enhance the user experience. If the user has customized requirements, the code can be added/modified on the cloud server layer to meet individual requirements, the whole exhibition hall system is controlled, and the system data security is guaranteed by building the whole platform in the virtual network and carrying out security authentication through the secret key.

The present application further provides a computer-readable and writable storage medium on which an exhibition hall control computer program is stored, which when executed implements the exhibition hall control method described above.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application.

In the embodiments provided herein, the computer-readable and writable storage medium may include read-only memory, random-access memory, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, flash memory, a USB flash drive, a removable hard disk, or any other medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection is properly termed a computer-readable medium. For example, if the instructions are transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. It should be understood, however, that computer-readable-writable storage media and data storage media do not include connections, carrier waves, signals, or other transitory media, but are intended to be non-transitory, tangible storage media. Disk and disc, as used in this application, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers.

In one or more exemplary aspects, the functionality described in the cloud computing-based showroom control computer program described herein may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. The steps of a method or algorithm disclosed herein may be embodied in a processor-executable software module, which may be located on a tangible, non-transitory computer-readable and/or writable storage medium. Tangible, non-transitory computer readable and writable storage media may be any available media that can be accessed by a computer.

The flowcharts and block diagrams in the figures discussed above illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical concepts disclosed in the present application shall be covered by the claims of the present application.

Claims

1. An exhibition hall control system based on cloud computing, wherein the exhibition hall control system is installed in a virtual private network, and the exhibition hall control system comprises:

at least one client used for uploading the file to be played or submitting the control instruction; the control instruction comprises a page information instruction or a voice information instruction;

at least one content display device configured to perform display playing when receiving a playing instruction;

the cloud server is connected with at least one client through a network, and is configured to receive and store a file to be played uploaded by the at least one client, monitor a control instruction of the at least one client and convert the control instruction into a command code; the command codes comprise conversion codes of keys in a graphical user interface corresponding to the at least one client, or codes obtained after voice analysis is carried out on the acquired user language information;

the terminal control equipment is configured corresponding to each content display equipment, connected with the cloud server through a network, configured to synchronize data with the cloud server so as to synchronize the playing content or the interface displayed by the content display equipment to the cloud server, and instruct the at least one content display equipment to play and display the file to be played according to the received command code; the synchronous data comprises a command code converted by the cloud server and a stored file to be played;

the cloud controller is correspondingly connected with each terminal control device and used for distributing the command codes to the at least one terminal control device;

the file to be played is obtained by the at least one terminal control device synchronously from the file stored in the cloud server side in advance;

the cloud service side is further used for providing a corresponding graphical user interface for the at least one client side so that the client side can upload files to be played or submit control instructions; and

the cloud server is further configured to record configuration information of the at least one terminal control device to add the configuration information into a device list when receiving a new device access request of the at least one terminal control device, build a relevant bottom environment for the at least one terminal control device according to the configuration information, and provide a graphical user interface corresponding to the new device for the at least one client according to the configuration information.

2. The cloud-computing-based exhibition hall control system according to claim 1, wherein the cloud controller is configured at the cloud server, and the cloud controller is correspondingly connected with each terminal control device.

3. The cloud-computing-based showroom control system according to claim 1, wherein the cloud controller is configured in each of the terminal control devices, the cloud controller is connected to the cloud server and the at least one client via a network, and is configured to receive the command codes converted by the cloud server, and control the content display device via the cloud controller by the at least one client when the network connected to the cloud server is poor.

4. The cloud-computing-based exhibition hall control system according to claim 3, wherein the at least one client is further connected to the cloud controller, and is configured to upload a file to be played or submit a control instruction to the cloud controller.

5. The cloud-computing-based exhibition hall control system according to claim 1, wherein the cloud server is further configured to verify the operation authority of the at least one client when receiving the request of the at least one client, and feed back a verification result to the at least one client.

6. The cloud-computing-based showroom control system according to claim 1, wherein the terminal control device is configured to, when receiving the command code, identify file information included in the command code to match a corresponding playback program to the at least one content presentation device.

7. The cloud-computing-based exhibition hall control system according to claim 1, wherein the control instructions comprise one or more of a play file type instruction, a designated play device instruction, or a file play mode instruction.

8. The cloud-computing-based exhibition hall control system according to claim 1, wherein the control instruction is a page information instruction, or voice information or terminal command control information.

9. The cloud-computing-based showroom control system of claim 8, wherein the cloud server further comprises a voice recognition module for recognizing voice information instructions for conversion into command codes.

10. The cloud-computing-based showroom control system according to claim 1, wherein the cloud server and the terminal control device communicate based on a Linux public key ssh-keygen.

11. The cloud-computing-based showroom control system according to claim 1, wherein the terminal control device is a terminal control device loaded with a linux system.

12. The cloud-computing-based showroom control system according to claim 1 or 11, wherein the terminal control device is a raspberry pi device.

13. A cloud server networked with at least one client and at least one terminal control device, the cloud server being configured in a virtual private network, the cloud server comprising:

the interface module is connected with at least one client through a network and used for receiving a file to be played or a submitted control instruction uploaded by the at least one client; receiving synchronous data, wherein the synchronous data comprises a command code converted by a synchronous cloud server and a stored file to be played; the interface module is also used for providing a corresponding graphical user interface for the at least one client so that the client can upload files to be played or submit control instructions; recording configuration information of the at least one terminal control device to add the configuration information into a device list based on a new device access request of the at least one terminal control device, and building a related bottom environment for the at least one terminal control device according to the configuration information; the control instruction comprises a page information instruction or a voice information instruction; the command codes comprise conversion codes of keys in a graphical user interface corresponding to the at least one client, or codes obtained after voice analysis is carried out on the acquired user language information;

the storage module is used for storing the file to be played and the equipment list;

the conversion module is used for converting the control instruction into a command code;

and the cloud control module is connected with the at least one terminal control device and used for distributing the command code to the at least one terminal control device so as to enable the at least one terminal control device to indicate at least one content display device to play and display the file to be played and synchronize the playing content or interface displayed by the content display device to the cloud server.

14. The cloud server of claim 13, wherein the control instructions comprise one or more of a play file type instruction, a specify play device instruction, or a file play mode instruction.

15. The cloud server of claim 13, wherein the control instruction is a page information instruction, a voice information instruction, or a terminal command control information.

16. The cloud server of claim 15, wherein the cloud server further comprises a voice recognition module configured to recognize voice information instructions for conversion into command codes.

17. The cloud server according to claim 13, wherein the cloud server and the terminal control device communicate based on a Linux public key ssh-keygen.

18. A terminal control device, characterized by comprising:

the network module is connected with the cloud server through a network and used for receiving the command codes distributed by the cloud server; the command code is obtained by monitoring a control instruction from at least one client side by the cloud server side and converting the control instruction; the cloud server is configured in a virtual private network; the network module is further used for enabling the cloud server to build a relevant bottom layer environment for the cloud server and providing a graphical user interface corresponding to the new equipment for the at least one client by sending a new equipment access request to the cloud server; the control instruction comprises a page information instruction or a voice information instruction; the command codes comprise conversion codes of keys in a graphical user interface corresponding to the at least one client, or codes obtained after voice analysis is carried out on the acquired user language information;

the synchronization module synchronizes data with the cloud server through the network module; the synchronous data comprises a command code converted by the cloud server and a stored file to be played;

and the control module is locally connected with a content display device and used for indicating the content display device to play and display the file to be played according to the received command code and synchronizing the playing content or the interface displayed by the content display device to the cloud server.

19. The terminal control device according to claim 18, wherein the control module is configured to, upon receiving the command code, identify file information included in the command code to match a corresponding playback program to the content presentation device.

20. The terminal control device according to claim 18, wherein the control command comprises one or more of a play file type command, a play device designation command, or a file play mode command.

21. The terminal control device according to claim 18, wherein the terminal control device communicates with a cloud service base on a Linux public key ssh-keygen.

22. The terminal control device according to claim 21, wherein the terminal control device is a raspberry pi device.

23. A cloud computing-based exhibition hall control method is applied to a built virtual private network system, and comprises the following steps:

when a control instruction submitted by at least one client is received, converting the control instruction into a command code; the control instruction comprises a page information instruction or a voice information instruction; the command codes comprise conversion codes of keys in a graphical user interface corresponding to the at least one client, or codes obtained after voice analysis is carried out on the acquired user language information;

the command code is distributed to at least one terminal control device to instruct the at least one content display device to play and display a file to be played according to the command code;

the file to be played is obtained by the at least one terminal control device from being stored in a cloud server side in advance in a synchronous mode, each terminal control device is configured to synchronize data with the cloud server so as to synchronize the playing content or the interface displayed by the content display device to the cloud server, and the synchronization data comprise command codes converted by the cloud server side and the stored file to be played; and

providing a corresponding graphical user interface to the at least one client to allow the client to upload a file to be played or submit a control instruction;

when a new device access request of the at least one terminal control device is received, recording the configuration information of the at least one terminal control device so as to add the configuration information into a device list;

building a related bottom environment for the at least one terminal control device according to the configuration information;

and providing a graphical user interface corresponding to the new equipment to the at least one client according to the configuration information.

24. The cloud computing-based showroom control method of claim 23, further comprising the steps of:

storing the file to be played uploaded by the at least one client when the file to be played is received;

and the file to be played is synchronously stored by at least one terminal control device, so that the at least one content display device is instructed to play and display the file to be played when the command code is received.

25. The cloud computing-based showroom control method of claim 23, further comprising the steps of:

verifying the operation authority of the at least one client when the request of the at least one client is received;

and feeding back a verification result to the at least one client.

26. The cloud-computing-based exhibition hall control method of claim 23, wherein the step of distributing the command code to at least one terminal control device to instruct the at least one content presentation device to present a file to be played according to the command code comprises:

when the command code is received, identifying file information contained in the command code;

and matching the corresponding playing program to the at least one content display device to display a file to be played.

27. The cloud-computing-based exhibition hall control method according to claim 23, wherein the control instruction comprises one or more of a play file type instruction, a play device designation instruction, or a file play mode instruction.

28. The cloud-computing-based exhibition hall control method according to claim 23, wherein the control instruction is a page information instruction, a voice information instruction or a terminal command control information.

29. The cloud computing-based showroom control method of claim 28, further comprising the step of recognizing a voice message instruction to convert to a command code.

30. The cloud-computing-based exhibition hall control method according to claim 23, wherein the terminal control device is a terminal control device loaded with a linux system.

31. The cloud-computing-based showroom control method according to claim 23, wherein the terminal control device is a raspberry pi device.

32. A computer-readable storage medium storing a cloud-computing-based exhibition hall control computer program, wherein the exhibition hall control computer program, when executed, implements the exhibition hall control method according to any one of claims 23 to 31.