JP3248017U - Relay device and surveillance camera system - Google Patents

Abstract

The present invention provides a relay device and a surveillance camera system that enable live video images from 16, 32, or 64 cameras to be viewed simultaneously using a commonly used Internet browser.
[Solution] The relay device 13 has a video receiving unit 31 that receives ONVIF standard video data from multiple surveillance cameras 12, a still image generation unit 33 that generates multiple still image data from the video data received by the video receiving unit and stores it in memory, a protocol conversion unit 35 that converts the video data received by the video receiving unit into RTMPS standard video data and stores it in memory, and a transmission control unit 37 that reads the video data and still image data from the memory and transmits them to a cloud server via the Internet.
[Selected figure] Figure 2

Description

This invention relates to a relay device and cloud system for a surveillance camera system that can be used in a cloud-based format.

Cloud-based surveillance camera systems, which have become increasingly popular in recent years, allow users to view live footage from multiple cameras in remote locations using a commonly available internet browser (software).

FIG. 6 shows an example of a conventional general cloud-based surveillance camera system. Conventionally, it is necessary to use a dedicated cloud-compatible surveillance camera.
The video footage from the camera is sent to the cloud server via the internet using a communication method that complies with the RTSP and TCP/IP standards. The communication method is also called a protocol. Sending and receiving video footage in real time is called video streaming, or simply streaming.
The cloud server receives the streaming image from the camera, generates a screen to be displayed on the computer's Internet browser, and sends it to the computer.
The computer sequentially receives and displays the screens generated by the cloud server.
On the PC, use an Internet browser to check the display screen.
When streaming from a cloud server to a PC, it is common to use a communication method that complies with the HLS and HTTP standards.

Commonly used internet browsers include Microsoft Edge (trademark) products from Microsoft, Google Chrome (trademark) products from Google, and Apple Safari (trademark) products from Apple. However, all of these have a technical limit of up to eight cameras that can be displayed simultaneously when viewing live footage from remote cameras.
However, small and medium-sized facilities have an average of 16 cameras installed, and there is a problem in that it is necessary to simultaneously check images from 16, 32, or 64 cameras.

In addition, cloud-based surveillance camera systems have the ability to record camera footage on the cloud server and play it back as needed, but the speed of the Internet is often unstable, and when the communication speed is not sufficient, streaming is interrupted and data does not reach the cloud server, resulting in periods when camera footage cannot be recorded.

The objective of this invention is to provide a surveillance camera system that allows users to simultaneously view footage from 16, 32, or 64 cameras using a commonly used Internet browser, and that can stably transmit surveillance camera footage to a cloud server even if the Internet communication speed becomes unstable.

The present invention is a relay device having a video receiving unit that receives video data output in the ONVIF standard from multiple surveillance cameras, a protocol conversion unit that converts the video received by the video receiving unit into a communication method compatible with the RTMPS standard in order to stream the video to a cloud server via the Internet, a video recording unit that records the video received by the video receiving unit, a still image generation unit that generates multiple still image data at regular time intervals from the video data received by the video receiving unit, a transmission control unit that transmits the output data from the protocol conversion unit, the output data from the still image generation unit, and the output data from the video recording unit to a cloud server via the Internet as appropriate in response to instructions from the cloud server, and a transmission control information receiving unit that controls transmission in response to instructions from the video receiving unit, the still image generation unit, the protocol conversion unit, and the cloud server.

Preferably, the video data is transmitted by RTMPS communication, and the still image data is transmitted by TCP communication. When streaming transmission by RTMPS communication or transmission of still image data by TCP communication is not required in response to a command from the cloud server, the transmission control unit stops the transmission of each data, thereby reducing the amount of Internet traffic used.

Preferably, the device further includes a video recording unit that records the video data, and transmits data from the video recording unit to a cloud server via FTP communication. When a command from the cloud server indicates that it is not necessary to transmit the video recording data via FTP communication, the transmission control unit stops transmitting the video recording data via FTP, thereby reducing the amount of Internet traffic used.

The present invention includes a relay device and a cloud server, the relay device includes a video receiving unit that receives ONVIF video data from multiple surveillance cameras, a protocol conversion unit that converts the video received by the video receiving unit into a communication format compatible with the RTMPS standard for streaming to a cloud server, a video recording unit that records the video received by the video receiving unit, a still image generating unit that generates multiple still image data at regular time intervals from the video data received by the video receiving unit, and a transmission control unit that transmits data from the protocol conversion unit, data from the still image generating unit, and data from the video recording unit to the cloud server via the Internet as appropriate in response to an instruction from the cloud server, and the cloud server receives the streaming data and multiple still image data corresponding to the video data via the Internet. A display screen is generated based on the still image data corresponding to the multiple surveillance cameras. The display screen is appropriately displayed using a browser on a personal computer.
When one or more still images from multiple security cameras are selected by operating the mouse device of the PC, the screen selection information and mouse pointer (mouse position) information are sent to the cloud server, and the transmission control information receiving unit 38 (screen display generating unit) of the cloud server switches from still images to streaming display. After a certain period of time has passed, the part that has been switched to streaming display is automatically reverted to a still image and displayed.

By generating a display screen like this, users can usually check live video in real time by switching between still images at appropriate intervals. Although the number of cameras that can be displayed simultaneously via streaming on a typical Internet browser is limited to eight, there is no limit to the number of cameras that can be displayed simultaneously when still images are displayed, making it possible to simultaneously display video from 16, 32, or 64 security cameras.
Of course, the number of still images that can be displayed simultaneously is not limited to 64, since it depends on the size of the monitor screen on which they are displayed.
If a user wants to view faster changing footage from a specific camera, they can use the mouse to select the display area of the relevant surveillance camera, and the screen will instantly switch to streaming, allowing them to view the content.

According to the inventor's analysis, a time between one and fifteen minutes is usually an appropriate interval for switching still images, and in an environment with little change, a user can easily recognize a live image even if the still images are switched at one-hour intervals.
As a method of displaying live footage, normally still images are displayed, but by combining this with a function that allows for a more detailed view of movements by temporarily switching to streaming for only specified cameras, it is possible to simultaneously display footage from 16, 32, or 64 surveillance cameras.

Preferably, the relay device further includes a video recording unit that records the video data, and transmits data from the video recording unit to a cloud server by FTP communication.
The cloud server displays the video recording data in a playback screen generator based on screen selection information and mouse pointer information from the personal computer, and displays the data on the personal computer's browser.

This invention provides a relay device and a surveillance camera system that allows users to simultaneously view live footage from 16, 32, or 64 cameras using a commonly used Internet browser.

FIG. 1 is a configuration diagram of a surveillance camera system 1 according to a first embodiment of the present invention. FIG. 2 is a diagram showing the configuration of the relay device 13 shown in FIG. FIG. 3 is a configuration diagram of the cloud server 15 shown in FIG. FIG. 4 is a system configuration diagram of the relay device 13 shown in FIG. FIG. 5 is a system configuration diagram of the cloud server 15 shown in FIG. FIG. 6 is a diagram for explaining the prior art.

Hereinafter, a surveillance camera system according to an embodiment of the present invention will be described.
FIG. 1 is a configuration diagram of a surveillance camera system 1 according to a first embodiment of the present invention.
As shown in FIG. 1, the surveillance camera system 1 includes, for example, a router 11, a relay device 13, and a cloud server 15.
FIG. 2 is a diagram showing the configuration of the relay device 13 shown in FIG.
As shown in FIG. 2, the relay device 13 includes, for example, a video receiving unit 31, a still image generating unit 33, a protocol converting unit 35, a transmission control unit 37, a transmission control information receiving unit 38, and a video recording unit 39.

As shown in Figures 1 and 2, the video receiving unit 31 of the relay device 13 receives ONVIF standard video data from multiple surveillance cameras 21. Surveillance cameras that are commercially available can be used as the surveillance cameras 21.

The still image generating unit 33 generates a plurality of still image data at a predetermined time interval from the video data received by the video receiving unit 31. The predetermined time interval may be every minute, every 15 minutes, every hour, etc., and is determined according to the usage environment of the surveillance camera 21.
In addition, by making the generation of still images short enough, it is possible to view the images as if they were being streamed live, so this type of streaming is sometimes called pseudo-streaming. It is also sometimes called a slideshow format.
By using the pseudo-streaming method, the limitation on the number of cameras that can be used for display on the personal computer 51 is eliminated.
Generally, when streaming from a surveillance camera, 5 to 30 frames of video are transmitted per second, but in the case of still images, one frame is sent every minute or every 15 minutes, so the amount of data transmitted is overwhelmingly smaller, resulting in reduced communication costs and the convenience of not needing a high-performance computer to receive and display the images.

The protocol conversion unit 35 converts the video data received by the video receiving unit 31 according to the Open Network Video Interface Forum (ONVIF) standard (first communication standard) into video data according to the Real-Time Messaging Protocol Streaming (RTMPS) standard (second communication standard).
The transmission control unit 37 transmits the RTMPS standard video data (streaming) generated by the protocol conversion unit 35 to the cloud server 15 .

The video recording unit 39 records the video data received by the video receiving unit 31 , and outputs the recorded file to the transmission control unit 37 .
The transmission control unit 37 transmits the still image data of the TCP standard generated by the still image generating unit 33 to the cloud server 15 .
In addition, the transmission control unit 37 transmits the video data file generated and stored by the video recording unit 39 to the cloud server 15 as an FTP file.
In FTP communication, data is converted into files (blocks of data), and if the other party is unable to receive the file properly, it is automatically resent, allowing communication without any data loss.
The relay device 13 appropriately records the above-mentioned moving images, still images, and recorded data in a memory, which will be described later.

FIG. 3 is a configuration diagram of the cloud server 15 shown in FIG.
As shown in FIG. 3 , the cloud server 15 includes, for example, a communication control unit 61 and a display screen generation unit 63 .
The communication control unit 61 includes, for example, a streaming receiving unit 71 , a still image receiving unit 73 , and a recorded data receiving unit 74 .

The display screen generating unit 63 displays a multiple camera display screen, a single camera display screen, and a recorded data playback screen on the screen of the personal computer 51 based on the streaming data, still image data, and recorded video data from the streaming receiving unit 71. The personal computer 51 displays these screens using a general browser.
The display screen generating unit 63 switches between a multiple camera display screen, a single camera display screen, and a recorded data playback screen displayed on the PC 51 based on designated operation information (using a mouse, etc.) from the PC 51 .

In addition, all or part of the multiple camera display screen, single camera display screen, and recorded data playback screen may be displayed simultaneously on the personal computer 51 .
In response to a specified operation, the display screen generating unit 63 may switch the surveillance camera 12 at the relevant location to streaming, and automatically return to still image display after a predetermined time.
The display screen generating unit 63 can be set to switch the surveillance camera 12 at the relevant location to streaming by a specified operation, and to display it as an independent screen, or to automatically display it as a still image screen after a predetermined time.

As mentioned above, the video recording data recorded at a specific time is sent as a file. In this case, FTP communication, which is suitable for file transmission, is used. In other words, by using FTP communication, even if communication via the Internet becomes unstable and transmission is delayed, retransmission processing is automatically performed and data is not lost. In addition, if the retransmission processing is also delayed, a log (communication history) is recorded, so that it is possible to know that data transmission has been delayed and to perform retransmission processing.
With this configuration, even if Internet communication becomes unstable, recorded data will not be lost, and images from surveillance cameras can be recorded and stored on the cloud server 15.

FIG. 4 is a system configuration diagram of the relay device 13 shown in FIG.
As shown in FIG. 4 , the relay device 13 includes, for example, a communication unit 81 , a memory 83 , and a processing unit 85 .
The communication unit 81 communicates with multiple surveillance cameras 21 and the cloud server 15 .
The memory 83 stores programs and data executed by the processing unit 85 .
The processing unit 85 executes the program PRG1 stored in the memory 83 to perform the processes of the relay device 13 defined in this embodiment.

The function of the relay device 13 shown in FIG. 2 is executed using the configuration shown in FIG.
The relay device 13 stores the above-mentioned moving images, still images, and recorded data in the memory 83 as appropriate.
In addition, the communication unit 81 receives video data from the surveillance camera 12 and transmits the data to the cloud server 15 via the router 11.
Moreover, the processing unit 85 controls the processing of the relay device 13 described above.

FIG. 5 is a system configuration diagram of the cloud server 15 shown in FIG.
As shown in FIG. 5 , the cloud server 15 includes, for example, a communication unit 91 , a memory 93 , and a processing unit 95 .
The communication unit 91 communicates with the relay device 13 and the personal computer 51 .
The memory 93 appropriately stores the programs and data executed by the processing unit 95 .
The processing unit 95 executes the program PRG2 stored in the memory 93 to perform the processing of the cloud server 15 defined in this embodiment.

The functions of the cloud server 15 shown in FIG. 3 are executed using the configuration shown in FIG.
The cloud server 15 stores the above-mentioned videos, still images, and files in the memory 93.
Moreover, the communication unit 91 receives data from the relay device 13 and transmits and receives data to and from the personal computer 51 .
Furthermore, the processing unit 95 controls the processing of the cloud server 15 described above.

As described above, unlike a general cloud-based surveillance camera system, the surveillance camera system 1 is not limited to use only dedicated cameras as surveillance cameras, and can use commercially available surveillance cameras 12. When a general surveillance camera 12 outputs captured video to a network, it outputs data using a communication method that complies with an international standard called ONVIF.
On the other hand, in the case of communication over the Internet, communication based on the ONVIF standard cannot be used, so in the surveillance camera system 1, as described above, communication is performed via the relay device 13 that converts the communication method.
There are several types of communication methods permitted for communication via the Internet, but the online sales and delivery system 1 uses the RTMPS and TCP/IP communication methods for video images and various controls.
In this way, the surveillance camera system 1 can use surveillance cameras that are commercially available, and eliminates the restriction on simultaneously displaying images from eight surveillance cameras on the personal computer 51.
That is, live images from 16, 32, or 64 cameras can be viewed simultaneously using a commonly available Internet browser.

Furthermore, even if the camera images change every minute, when a "human" such as a security guard checks the normal camera images, they can still be used as live footage.
On the other hand, if a state that requires confirmation is captured by a surveillance camera, by moving the mouse pointer to a specific camera location on the screen of the personal computer 51 and clicking the location, the information is sent to the cloud server 15, and the cloud server 15 switches the image of the corresponding surveillance camera 12 from a still image to a video image for display, or switches the corresponding surveillance camera 12 to an independent, single display screen for display.
During this operation, the cloud server 15 sends an instruction to the relay device 13 to switch the output of still images to the output of moving images.

The present invention is not limited to the above-described embodiments.
In other words, those skilled in the art may make various modifications, combinations, sub-combinations, and substitutions of the components of the above-described embodiment within the technical scope of the present invention or an equivalent scope.

Applicable to surveillance camera systems.

REFERENCE SIGNS LIST 11 Router 12 Surveillance camera 13 Relay device 15 Cloud server 31 Video receiving unit 33 Still image generating unit 35 Protocol conversion unit 37 Transmission control unit 38 Transmission control information receiving unit 39 Video recording unit 51 Personal computer

Claims (5)

A video receiving unit that receives ONVIF standard video data from a plurality of surveillance cameras;
a protocol conversion unit that converts the video received by the video receiving unit into video data of a communication method compatible with the RTMPS standard in order to stream the video to a cloud server;
a video recording unit that records the video received by the video receiving unit;
a still image generating unit that generates a plurality of still image data at regular time intervals from the video data received by the video receiving unit;
a transmission control unit that transmits data from the protocol conversion unit, the still image generation unit, and the video recording unit to the cloud server via the Internet in response to an instruction from the cloud server;
A relay device comprising the video receiving unit, the still image generating unit, the protocol conversion unit, and a transmission control information receiving unit that controls transmission in response to commands from the cloud server. The video data is transmitted by RTMPS communication.
The still image data is transmitted by TCP communication;
The relay device according to claim 1, wherein when streaming transmission via RTMPS communication or transmission of still image data via TCP communication is not required upon command from the cloud server, the transmission control unit stops each data transmission, thereby reducing the amount of Internet traffic used. The video data is transmitted by RTMPS communication, and the still image data is transmitted by TCP communication;
The relay device of claim 2, wherein when streaming transmission via RTMPS communication or transmission of still image data via TCP communication is not required upon command from the cloud server, the transmission control unit stops transmission of each data, thereby reducing the amount of Internet traffic used. A relay device;
A cloud server and
The relay device is
A video receiving unit that receives ONVIF standard video data from a plurality of surveillance cameras;
a protocol conversion unit that converts the video received by the video receiving unit into video data of a communication method compatible with the RTMPS standard in order to stream the video to the cloud server;
a video recording unit that records the video received by the video receiving unit;
a still image generating unit that generates a plurality of still image data at regular time intervals from the video data received by the video receiving unit;
a transmission control unit that transmits data from the protocol conversion unit, the still image generation unit, and the video recording unit to the cloud server via the Internet in response to an instruction from the cloud server;
a transmission control information receiving unit that controls transmission in response to commands from the video receiving unit, the still image generating unit, the protocol converting unit, and the cloud server;
The cloud server includes:
receiving the video data and a plurality of still image data corresponding to the video data via the Internet;
generating a plurality of screens including the still image data corresponding to the plurality of surveillance cameras;
When a still image being displayed is designated, the video data corresponding to the designated still image is played back, and the video data is automatically switched back to the still image after a certain period of time has elapsed.
Surveillance camera system. The relay device transmits the video data to the cloud server via the Internet by FTP communication;
The surveillance camera system according to claim 4, wherein the cloud server records or films the video data received from the relay device in the cloud server, and when a user operates a personal computer to receive an instruction to play back the recorded date and time, displays a playback screen of the corresponding period on the personal computer.