Towards the Embedded Mobile intelligent monitor system of public safety service
Technical field:
The present invention relates to public safety monitoring technique field, particularly relate to the Embedded Mobile intelligent monitor system towards public safety service.
Background technology:
Public safety service stablizing for society, harmonious and development has important effect, safeguard that social public safety is social stability, healthy, the basic necessary requirement of harmonious development, in current social, public safety comprises Public Traveling rule safety, public place safety, personal safety, urban lifeline safety, building safety, information security, food security etc., wherein public social safety especially public place be safely of paramount importance one of them, such as large-scale square, railway station, subway station, bullet train, middle and primary schools' school bus, coach, residential quarter, elderly person of no family etc.
Utilize audio frequency and video can recognize the situation of target to be monitored in real time to the monitoring that vehicle, residential block and child old man carry out real time remote, be convenient to carry out corresponding security work, the distinct disadvantage of traditional watch-dog generally can only monitor in the fixed location such as PC or video wall, great inconvenience is brought to user, monitoring business is greatly limited, along with the development of Embedded Mobile intelligent monitoring technology, the Embedded Mobile intelligent monitoring towards public safety service becomes possibility.
Embedded Mobile intelligent monitoring has become monitoring field one main trend, the Embedded Mobile intelligent monitoring device of current existing number of different types occurs, such as: application number be 201010180724.0 Chinese invention patent disclose a kind of home wireless intelligent monitor and method for supervising thereof, mainly wireless communication unit is connected with main control unit by USB interface, thus realizes the real-time monitoring of unattended duty; Application number be 201010159743.5 Chinese invention patent disclose a kind of active-mode intelligent safety monitoring instrument for car and method for supervising thereof, wherein mainly comprise embedded system, GPS module, gsm module, SIM card reader, siren, CCD camera, electric power system etc., this instrument utilizes that GPS realizes location, displacement is antitheft, tests the speed, utilize GSM to realize assist location, SMS automatic alarm, utilize the identification of CCD binding pattern to monitor fatigue driving, steal, rob and traffic accident state; Application number be 200810039228.6 Chinese invention patent disclose a kind of wireless data monitoring and intelligent alarm system, this system has can flexible networking reduce the removable data collecting device of radiation hazradial bundle, there is the portable display control apparatus in WLAN (wireless local area network), the data that can send multiple removable data collecting device are carried out reception display and are controlled, based on WLAN (wireless local area network) and common wireless communication net, there is the function such as remote monitoring data collecting device, proactive notification display control terminal.
The common feature of above-mentioned three patents all adopts Embedded Mobile intelligent control method to carry out different supervisory control systems to build, its defect part is mainly the following aspects: 1. just monitor family and surrounding enviroment thereof in above-mentioned first patent, but when unusual circumstance, carry out folk prescription video calling and call out the contacts list preset, there is very large uncertainty in success call contact, when therefore occurring abnormal, the successful of notification call cannot judge; 2. in above-mentioned second patent, although be described in detail vehicle active-type intelligent safety monitoring system, but this system does not have generality, be only applied in vehicle, the location for cell monitoring or child old man cannot realize, and cannot judge for phenomenons such as overload of vehicle, meanwhile, if the traffic accident such as to get into an accident, can only detect,, not there is deficiency functionally in the interlock such as corresponding emergency measures or emergency preplan behavior; 3. in above-mentioned 3rd patent, network configuration just for composition data monitoring and intelligent alarm system carries out analyzing and contrasting, how this network configuration that is described through emphasis reduces the radiation hazradial bundle to human body, but not concrete description for the method realizing monitoring and alarm behavior.
Summary of the invention:
The object of this invention is to provide the Embedded Mobile intelligent monitor system towards public safety service, it is applicable to multiple common monitoring field, the specific groups such as such as residential quarter, large-scale square, bullet train, students in middle and primary schools' dolly, child old man, also there is the features such as anomalous event finds in time, alarm linkage response is fast simultaneously, greatly can improve the fail safe of public place and the stability of society.
In order to solve the problem existing for background technology, the present invention is by the following technical solutions: it is made up of central server 1, Embedded Mobile intelligent terminal 2, user's access terminal 3, database 4, cloud platform data server 5, the network storage 6, center management server 7, control centre's server 8, board information terminal 9, video analysis track terminal 10, track and localization alarm terminal 11, access mobile phone terminal 12, access notebook computer terminal 13; Central server 1 is interconnected by cable network and user's access terminal 3, database 4, cloud platform data server 5, the network storage 6, center management server 7 and control centre's server 8 is provided with in central server 1, Embedded Mobile intelligent terminal 2 is connected with central server 1 by 3G network, be provided with board information terminal 9, video analysis track terminal 10 and track and localization alarm terminal 11 in Embedded Mobile intelligent terminal 2, in user's access terminal 3, be provided with access mobile phone terminal 12 and access notebook computer terminal 13.
Be provided with 3G module in described board information terminal 9, video analysis track terminal 10 and track and localization alarm terminal 11, all can register from trend center after terminal starts, terminal management is carried out in unification.
Described board information terminal 9 is made up of multinuclear flush bonding processor, and its inside is provided with GPS module, and timing can send its position to center, and board information terminal 9, mainly for detection of the anomalous event in car, does not need to use The Cloud Terrace to carry out camera control.
Described video analysis track terminal 10 is made up of multinuclear flush bonding processor, interface is provided with two-way camera, its course of work is: embedded multi-core processor carries out the alarm detection of the every one-frame video data of fixing camera in two cameras in real time, when warning being detected, advanced warning message sends, then video recording of reporting to the police is started, start following function simultaneously, drive cradle head control another one camera, the object setting out and report to the police can be followed the tracks of to make it, within this period, carry out the startup of Video coding simultaneously, after to be tracked, use The Cloud Terrace that camera is recovered initial bit, and warning video record is sent to central server 1, after center management server 7 in central server 1 receives warning message and alert data, warning video data is stored in cloud platform data server 5 or the network storage 6.
Emergency alarm button, voice communication button, GPS module and local display LCD is provided with in described track and localization alarm terminal 11, when anomalous event sends, emergency alarm button can be used to carry out event transmission, voice communication can also be started engage in the dialogue, other alert events that the center that simultaneously can accept sends over carry out LCD display, and GPS module timing can send its position to center.
Described board information terminal 9 and video analysis track terminal 10 can carry out people unusual checking, enter region detection, crowd massing detects, the unusual checking function of demographics and car, track and localization alarm terminal 11 can carry out personnel missing detection.
Described Embedded Mobile intelligent terminal 2 can detect actuation of an alarm and the interlock prediction scheme of anomalous event; difference configuration can be carried out according to the difference of event; action time different mobile terminals detects anomalous event and prediction scheme different, current action and prediction scheme typically protect local warning reminding (buzzer, warning lamp, loudspeaker), short message sending, video data send, 122,119,120 center alert datas forward.
In three kinds of Embedded Mobile intelligent terminals involved in the present invention, video analysis track terminal 10 not only can carry out the detection of reporting to the police, and can part tracking be carried out, adopt linkage technique simultaneously, single video analysis track terminal, single board information terminal each other can be interconnected, form a complete terminal Internet of Things towards public safety service, and then promote the intelligent processing capacity of each terminal, by carrying track and localization alarm terminal in specific group crowd, its position and periphery situation can be understood in time, be conducive to improving processing speed when anomalous event occurs.
The present invention is applicable to multiple common monitoring field, the specific groups such as such as residential quarter, large-scale square, bullet train, students in middle and primary schools' dolly, child old man, also there is the features such as anomalous event finds in time, alarm linkage response is fast simultaneously, greatly can improve the fail safe of public place and the stability of society.
Accompanying drawing illustrates:
Fig. 1 is structural representation of the present invention;
Fig. 2 is Embedded Mobile intelligent terminal of the present invention and center to center communications process schematic;
Fig. 3 is video analysis track terminal block schematic illustration of the present invention;
Fig. 4 is board information terminal block schematic illustration of the present invention;
Fig. 5 is track and localization alarm terminal block schematic illustration of the present invention;
Fig. 6 is video analysis track terminal of the present invention and board information terminal alert process process schematic;
Fig. 7 is track and localization alarm terminal alert process process schematic of the present invention.
Embodiment:
With reference to Fig. 1, this embodiment by the following technical solutions: it is made up of central server 1, Embedded Mobile intelligent terminal 2, user's access terminal 3, database 4, cloud platform data server 5, the network storage 6, center management server 7, control centre's server 8, board information terminal 9, video analysis track terminal 10, track and localization alarm terminal 11, access mobile phone terminal 12, access notebook computer terminal 13; Central server 1 is interconnected by cable network and user's access terminal 3, database 4, cloud platform data server 5, the network storage 6, center management server 7 and control centre's server 8 is provided with in central server 1, Embedded Mobile intelligent terminal 2 is connected with central server 1 by 3G network, be provided with board information terminal 9, video analysis track terminal 10 and track and localization alarm terminal 11 in Embedded Mobile intelligent terminal 2, in user's access terminal 3, be provided with access mobile phone terminal 12 and access notebook computer terminal 13.
Be provided with 3G module in described board information terminal 9, video analysis track terminal 10 and track and localization alarm terminal 11, all can register from trend center after terminal starts, terminal management is carried out in unification.
Described board information terminal 9 is made up of multinuclear flush bonding processor, and its inside is provided with GPS module, and timing can send its position to center, and board information terminal 9, mainly for detection of the anomalous event in car, does not need to use The Cloud Terrace to carry out camera control.
Described video analysis track terminal 10 is made up of multinuclear flush bonding processor, interface is provided with two-way camera, its course of work is: embedded multi-core processor carries out the alarm detection of the every one-frame video data of fixing camera in two cameras in real time, when warning being detected, advanced warning message sends, then video recording of reporting to the police is started, start following function simultaneously, drive cradle head control another one camera, the object setting out and report to the police can be followed the tracks of to make it, within this period, carry out the startup of Video coding simultaneously, after to be tracked, use The Cloud Terrace that camera is recovered initial bit, and warning video record is sent to central server 1, after center management server 7 in central server 1 receives warning message and alert data, warning video data is stored in cloud platform data server 5 or the network storage 6.
Emergency alarm button, voice communication button, GPS module and local display LCD is provided with in described track and localization alarm terminal 11, when anomalous event sends, emergency alarm button can be used to carry out event transmission, voice communication can also be started engage in the dialogue, other alert events that the center that simultaneously can accept sends over carry out LCD display, and GPS module timing can send its position to center.
Described board information terminal 9 and video analysis track terminal 10 can carry out people unusual checking, enter region detection, crowd massing detects, the unusual checking function of demographics and car, track and localization alarm terminal 11 can carry out personnel missing detection.
Described Embedded Mobile intelligent terminal 2 can detect actuation of an alarm and the interlock prediction scheme of anomalous event; difference configuration can be carried out according to the difference of event; action time different mobile terminals detects anomalous event and prediction scheme different, current action and prediction scheme typically protect local warning reminding (buzzer, warning lamp, loudspeaker), short message sending, video data send, 122,119,120 center alert datas forward.
In three kinds of Embedded Mobile intelligent terminals involved by this embodiment, video analysis track terminal 10 not only can carry out the detection of reporting to the police, and can part tracking be carried out, adopt linkage technique simultaneously, single video analysis track terminal, single board information terminal each other can be interconnected, form a complete terminal Internet of Things towards public safety service, and then promote the intelligent processing capacity of each terminal, by carrying track and localization alarm terminal in specific group crowd, its position and periphery situation can be understood in time, be conducive to improving processing speed when anomalous event occurs.
With reference to Fig. 2, this embodiment is different to the processing mode of alert event to each embedded mobile terminal, for each embedded mobile terminal, its workflow is: after powering on, each mobile intelligent terminal carries out initial work, and completion system is correlated with initialization; Then carry out algoritic module initialization, start different algoritic modules according to configuration; Video intelligent analysis is carried out to the data that each frame collects, when anomalous event being detected, report alert event to center and carry out warning simultaneously in this locality and export, in the process also can according to type of alarm not in the same way center upload different warning satellite informations again, such as photo, video, sound etc.After central server 1 receives the warning message of terminal, central server 1 receives the alert event of each Embedded Mobile intelligent terminal by center management server 7, control centre's server 8 is used to trigger different alert process actions according to uploading the difference receiving type of alarm, simultaneously control centre's server 8 and according to type of alarm and position not in the same way other contiguous embedded mobile terminals send identical warning message, in this course of work, the state of all right active inquiry Embedded Mobile intelligent terminal of central server 1, for board information terminal 9 and video analysis track terminal 10, can by the real-time video of control centre's server 8 Real-time Obtaining Embedded Mobile intelligent terminal, audio frequency, positional information, for track and localization terminal 11, can only the position of its correspondence of Real-time Obtaining, and real-time voice call can be carried out with it.
With reference to Fig. 3, this embodiment embedded video is analyzed the main core processor of track terminal 10 and is comprised embedded FPGA, embedded processors ARM and embedded signal processor DSP, periphery comprises typical equipment, such as video encoder, decoder, storage device interface Flash, SD card and USB interface, internal memory ddr interface, audio interface, power supply and clock interface, network interface comprises 3G wireless network and cable network, equally also comprise the networks such as the WIFI using USB, serial communication interface, be used for external various trigger, GPS module etc., video decoder portion in video analysis track terminal 10, comprise two class external camera, one class is the Still camera being used for carrying out video analysis process specially, the visual angle of its correspondence is fixed at erection stage, in use no longer change, its objective is to make intelligent video analysis algorithm continually can carry out work, another kind of is be used for carrying out The Cloud Terrace specially to drive the dynamic camera followed the tracks of, its objective is when Still camera detects that warning occurs, dynamic camera is relied on to carry out tracking and the amplification of target, again its video data is recorded a video, captured, to make to capture useful, alert data clearly in alarm procedure.
With reference to Fig. 4, this embodiment embedded onboard information terminal 9 and the structure basic simlarity both embedded video intellectual analysis track terminal 10, difference is that board information terminal inside only comprises a Still camera, its external interface adds various bus interface simultaneously, as CAN, object is to carry out interactive data communication with vehicle-mounted other sensor terminal all kinds of.
With reference to Fig. 5, this embodiment track and localization alarm terminal 11 Embedded Mobile intelligent terminal core is the two-in-one chip of 3G/GPS, and its outside contains audio input output interface, warning load button interface, LCD display translation interface, 3G and GPS communication interface and antennal interface.
With reference to Fig. 6, the testing process of this embodiment embedded onboard information terminal 9 and video analysis track terminal 10 pairs of alert events is: carry out system initialization after video analysis track terminal 10, board information terminal 9 power on, work comprises the connection of central server, the configuration of self running parameter (such as stores, local warning, cradle head control etc.); The initialization of image enhaucament pretreatment module FPGA, refers to that embedded processors ARM is by being configured FPGA Program module with the corresponding interface of FPGA, makes FPGA can be operated in the image enhaucament pattern of needs; Algoritic module DSP initialization, refer to that embedded processors ARM passes through the communication corresponding interface (generally referring to shared buffer) between DSP and loads the program of DSP, data, inform that it carries out the process of which class intelligent behavior, DSP carries out inside the initialization of corresponding controller, DMA simultaneously; System carries out video data acquiring, no matter be to board information terminal or video analysis track terminal, all need to carry out image enhaucament, if do not have a complete frame video acquisition to arrive after the complete frame data of collection, then wait for, until there is a complete video requency frame data collected; After collecting complete frame of video, carry out image enhancement processing by FPGA module, the output data of image enhancement processing are input to the video acquisition module of embedded processors ARM; The algoritic module that embedded processors ARM uses the original video data frame collected to call DSP carries out intelligent behavior detection, if anomalous event do not detected, then returns to and re-starts video data acquiring, if had, carries out alert process; For board information terminal, its alert process process is: carry out alert data transmission to central server, comprises corresponding warning video data simultaneously; For video analysis track terminal, due to the dynamic camera of its external cradle head control, when therefore producing when reporting to the police, except carrying out video capture, also need to drive dynamic camera to carry out target following, constantly judge in tracing process, if target is left follow the tracks of market scope, return and show that this alert process terminates.It should be noted that video analysis track terminal, in video capture process, the image data that what it carried out coding transmission is corresponding to dynamic camera, instead of the data of Still camera, that is, Still camera is just as the trigger source of alarm sensor, instead of the collection source of video in warning last handling process.
With reference to Fig. 7, this embodiment track and localization alert operation process is: track and localization warning system carries out system initialization after starting, and includes the initialization such as 3G module, voice, display, danger button; Whether track and localization warning system poll inquiry receives danger button alert event, the voice request event at center and the notification event of center warning; After receiving local danger button alert event, track and localization alarm terminal sends warning message to center, and starts the voice call request to center simultaneously, if be allowed to, starts to carry out voice conversation until terminate call; After receiving center voice request event, startup and center session are until stop; When receiving center alert notice, local LCD carrying out warning message display, to make terminal understand warning details, then determining how to carry out unifying associated treatment.
This embodiment is applicable to multiple common monitoring field, the specific groups such as such as residential quarter, large-scale square, bullet train, students in middle and primary schools' dolly, child old man, also there is the features such as anomalous event finds in time, alarm linkage response is fast simultaneously, greatly can improve the fail safe of public place and the stability of society.