CN118494497A - Driver fatigue early warning system and early warning method - Google Patents

Abstract

The invention belongs to the field of automobile safety control, and discloses a driver fatigue early warning system and an early warning method, wherein the system comprises a domain controller CEM, a communication module, an image acquisition module, an execution unit and a whole automobile control unit; the communication module, the image acquisition module and the whole vehicle control unit are all connected to the domain controller CEM, and the execution unit is connected with the whole vehicle control unit; the image acquisition module is used for acquiring head image information of a driver and sending the acquired head image information to the domain controller CEM, and the domain controller CEM is used for sending a mode switching signal to the execution unit through the communication module when the image information of the fatigue state is monitored. The battery management system BMS outputs the output power of the automobile to the whole automobile control unit, and sends the output power to the vehicle-mounted MCU through the whole automobile control unit, and the vehicle-mounted MCU receives the output power of the automobile and outputs corresponding engine torque to reduce the speed of the automobile. The two-way early warning for the driver is realized by performing intervention in two aspects of reminding and executing deceleration operation.

Description

Driver fatigue early warning system and early warning method

Technical Field

The invention relates to the field of automobile safety control, in particular to a fatigue early warning system and method for drivers.

Background

With the continuous improvement of living standard, automobiles gradually become indispensable transportation means for people, and the number of automobiles on roads is increasing. The driver is dozed off due to insufficient sleep or overlong driving time, so that the driving safety is affected, traffic accidents frequently occur, and life and property of people are seriously threatened.

The existing physiological image reaction monitoring is realized by an ECU (electronic control unit) and a camera based on the physiological image reaction of a driver. The camera captures facial features, eye signals, head movements, etc. of the driver, and the ECU deduces the fatigue state of the driver from these information. Upon detection of driver fatigue, the system will issue an alarm prompt

But eventually requires the driver to react even if the system sounds an alarm. If the driver fails to respond in time, for fatigue or other reasons, the system's function is compromised.

Disclosure of Invention

The invention aims to provide a fatigue early warning system and method for drivers, which are used for solving the problem that the early warning fails due to the fact that the system gives a prompt and the driver ignores the prompt.

In order to achieve the above purpose, the present invention adopts the following technical scheme:

In a first aspect, the invention provides a driver fatigue early warning system, which comprises a domain controller CEM, a communication module, an image acquisition module, an execution unit and a whole vehicle control unit; the communication module, the image acquisition module and the whole vehicle control unit are all connected to the domain controller CEM, and the execution unit is connected with the whole vehicle control unit; the image acquisition module is used for acquiring head image information of a driver and sending the acquired head image information to the domain controller CEM, and the domain controller CEM is used for sending a mode switching signal to the execution unit through the communication module when the image information of the fatigue state is monitored.

Further, the domain controller CEM is also connected with a vehicle-mounted entertainment module IHU, and the vehicle-mounted entertainment module IHU is used for turning on or off the fatigue early warning function through man-machine interaction.

Further, the execution unit comprises a battery management system BMS and a vehicle-mounted MCU; and the battery management system BMS and the vehicle-mounted MCU are both connected to the vehicle control unit, and the battery management system BMS outputs the output power of the vehicle to the vehicle control unit and sends the output power to the vehicle-mounted MCU through the vehicle control unit, and the vehicle-mounted MCU receives the output power of the vehicle and outputs corresponding engine torque.

Further, the image acquisition module is an infrared camera.

Further, the communication module is a vehicle-mounted TBOX.

Further, the whole vehicle control unit is a whole vehicle controller VCU.

Further, the input and output ends of the whole vehicle controller VCU are connected with the domain controller CEM, the whole vehicle controller VCU sends the output vehicle speed information to the domain controller CEM and receives the mode switching signal sent by the domain controller, and the whole vehicle controller VCU sends the mode switching signal to the battery management system BMS.

In a second aspect, the invention provides an early warning method of a fatigue early warning system for a driver, comprising the following steps:

transmitting a function starting signal to a domain controller CEM through a vehicle-mounted entertainment module IHU, and starting an early warning function;

The image acquisition module acquires head image information of a driver, converts the detected fatigue state image information into an image signal, and then converts the image signal into an electric signal to be sent to the domain controller CEM;

the whole vehicle control unit transmits the vehicle speed information to the domain controller CEM and receives the mode switching signal transmitted from the domain controller CEM, the whole vehicle control unit transmits the mode switching signal to the battery management system BMS,

The battery management system BMS outputs the output power of the automobile to the whole automobile control unit, and sends the output power to the vehicle-mounted MCU through the whole automobile control unit, and the vehicle-mounted MCU receives the output power of the automobile and outputs corresponding engine torque to reduce the speed of the automobile.

Compared with the prior art, the invention has the following technical effects:

The invention introduces an innovative intelligent early warning driver dozing system of an automobile, which not only realizes accurate monitoring of the state of the driver through an advanced camera technology and a TBOX transmission mechanism, but also realizes timely regulation and control of the speed of the automobile through the voice prompt function of an IHU (in-vehicle entertainment unit) and the linkage of a BMS (battery management system) and a whole automobile control unit, thereby providing double guarantee for driving safety.

First, the core of the system is a unique camera information acquisition mechanism. The camera can capture the image information in the cab in real time, and the image information comprises key characteristics such as facial expression, eye actions and the like of a driver. By analyzing and processing the image information, the system can accurately judge whether the driver is in a dozing state. Once the system detects that the driver has had signs of dozing, it will immediately initiate the early warning procedure.

Next, another important component of the system, the TBOX transfer information module, will play a key role. The TBOX module is responsible for transmitting the driver state information and the vehicle speed information acquired by the camera to the vehicle-mounted entertainment module IHU in real time. The IHU module immediately processes the information after receiving the information and gives a warning to the driver through a voice prompt function to remind the driver of traffic safety. The voice prompt mode is visual and easy to accept by a driver, and can quickly draw attention of the driver, so that potential safety hazards are avoided.

However, it is far from sufficient to rely on voice prompts alone. In order to more effectively ensure driving safety, the system also introduces a linkage mechanism of the battery management system BMS and the whole vehicle control unit. When the IHU module gives out a warning, the BMS system receives the signal at the same time and calculates the vehicle speed range needing to be reduced according to the current vehicle speed information and the state information of the driver. Then, the BMS outputs the corresponding output power of the vehicle to the vehicle control unit, and after the processing of the vehicle control unit, the command is sent to the vehicle-mounted MCU (micro control unit).

After receiving the command of the output power of the automobile, the vehicle-mounted MCU can immediately adjust the output torque of the engine, so that the speed of the automobile is reduced. The mode of reducing the vehicle speed by adjusting the engine torque not only responds rapidly, but also can ensure the stable reduction of the vehicle speed, and avoids potential safety hazards caused by sudden braking.

In general, the intelligent early-warning system for the dozing state of the automobile driver realizes the accurate monitoring and the timely early warning of the dozing state of the driver through multiple technical means such as information acquisition by a camera, TBOX transmission information, IHU voice prompt by a vehicle-mounted entertainment module, linkage of a battery management system BMS and a whole automobile control unit and the like. Meanwhile, the system also has a vehicle speed control function, so that the vehicle speed can be automatically reduced while the driver is reminded, and the driving safety is ensured. The bidirectional early warning mechanism provides omnibearing protection for drivers, and greatly improves the safety and comfort of driving.

Drawings

FIG. 1 shows the early warning of the present invention an overall system block diagram.

Fig. 2 is a logic block diagram of the present invention.

FIG. 3 is a detailed block diagram of the early warning system of the present invention.

Fig. 4 is a flow chart of the system of the present invention.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

In the description of the present invention, it will be understood that the terms "comprises" and "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It is also to be understood that the terminology used in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It should be further understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In the present invention, the character "/" generally indicates that the front and rear related objects are an or relationship.

It should be understood that although the terms first, second, third, etc. may be used to describe the preset ranges, etc. in the embodiments of the present invention, these preset ranges should not be limited to these terms. These terms are only used to distinguish one preset range from another. For example, a first preset range may also be referred to as a second preset range, and similarly, a second preset range may also be referred to as a first preset range without departing from the scope of embodiments of the present invention.

Depending on the context, the word "if" as used herein may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection". Similarly, the phrase "if determined" or "if detected (stated condition or event)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event)" or "in response to detection (stated condition or event), depending on the context.

Various structural schematic diagrams according to the disclosed embodiments of the present invention are shown in the accompanying drawings. The figures are not drawn to scale, wherein certain details are exaggerated for clarity of presentation and may have been omitted. The shapes of the various regions, layers and their relative sizes, positional relationships shown in the drawings are merely exemplary, may in practice deviate due to manufacturing tolerances or technical limitations, and one skilled in the art may additionally design regions/layers having different shapes, sizes, relative positions as actually required.

Example 1:

referring to fig. 1, the present invention aims to overcome the shortcomings of the prior art, and provides a driver fatigue early warning system, comprising:

The system comprises a domain controller CEM, a communication module, an image acquisition module, an execution unit and a whole vehicle control unit; the communication module, the image acquisition module and the whole vehicle control unit are all connected to the domain controller CEM, and the execution unit is connected with the whole vehicle control unit; the image acquisition module is used for acquiring head image information of a driver and sending the acquired head image information to the domain controller CEM, and the domain controller CEM is used for sending a mode switching signal to the execution unit through the communication module when the image information of the fatigue state is monitored.

Information is acquired through the camera and is transmitted through the vehicle-mounted TBOX, and the vehicle-mounted entertainment module IHU prompts in a voice mode to remind a driver and control the vehicle speed.

Information is acquired through the camera and is transmitted through the TBOX, and the vehicle-mounted entertainment module IHU is used for prompting a driver and controlling the speed of the vehicle. Through carrying out analysis processing to image information, speed of a motor vehicle information, when on-vehicle amusement module IHU sent out the alarm, battery management system BMS will output car output power to whole car control unit to send on-vehicle MCU through whole car control unit, on-vehicle MCU receives car output power to output corresponding engine torque reduces the speed of a motor vehicle.

The division of the modules in the embodiments of the present invention is schematically only one logic function division, and there may be another division manner in actual implementation, and in addition, each functional module in each embodiment of the present invention may be integrated in one processor, or may exist separately and physically, or two or more modules may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules.

Example 2:

Specifically, referring to fig. 3, a driver fatigue early warning system includes a vehicle-mounted entertainment module IHU, a camera (infrared camera), a domain controller CEM, a vehicle-mounted TBOX, a vehicle-mounted controller VCU, a battery management system BMS, and a vehicle-mounted microcontroller MCU.

The vehicle-mounted entertainment module IHU is used for enabling or disabling the intelligent early warning dozing function through the large screen soft switch by a user, sending a function enabling signal to the domain controller CEM for processing, and the output end of the vehicle-mounted entertainment module IHU is connected with the domain controller CEM.

The camera (infrared camera) module is used for collecting head image information of a driver, converting the detected image information into image signals, converting the image signals into electric signals, sending the electric signals to the domain controller CEM for processing, and the input end and the output end of the camera are connected with the domain controller CEM.

The intelligent early warning system converts an image signal detected by the camera into an electric signal and sends the electric signal to the TBOX for processing, the input and output ends of the intelligent early warning system are connected with the vehicle-mounted entertainment module IHU, and the output ends of the intelligent early warning system are connected with the whole vehicle controller VCU.

The whole vehicle controller VCU module sends the output vehicle speed information to the domain controller CEM for processing, receives the mode switching signal sent by the domain controller CEM, and sends the mode switching signal to the battery management system BMS module, and the input end and the output end of the whole vehicle controller VCU module are connected with the domain controller CEM.

The TBOX module analyzes and processes the image information and the vehicle speed information sent by the domain controller CEM, and the output end of the TBOX module is connected with the whole vehicle controller VCU and the vehicle entertainment module IHU.

The battery management system BMS module outputs the output power of the automobile to the whole automobile controller VCU and sends the output power to the vehicle-mounted microcontroller MCU through the whole automobile controller VCU module.

The vehicle-mounted microcontroller MCU receives the output power of the automobile and outputs corresponding engine torque, so that the purpose of reducing the speed of the automobile is achieved, and traffic accidents are avoided.

Example 3:

as shown in fig. 2, the description is made with reference to a logic block diagram of dozing off of the intelligent early warning driver:

The camera (infrared camera) collects information, a signal is transmitted to the domain controller CEM through a hard wire, the domain controller CEM processes the received information, a state signal of dozing a driver is sent to the vehicle-mounted entertainment module IHU and the whole vehicle controller VCU through the vehicle-mounted TBOX, an intelligent early warning system is triggered, a voice prompt is given out, an alarm sound is given out, and a signal is output to control the speed of the vehicle, so that the vehicle is decelerated or stopped.

When the driving environment requires high alertness and safety, the infrared camera plays a vital role. The special type camera can still capture clear images under the condition of insufficient light or night, and the information of the interior and the surrounding environment of the vehicle is collected in real time through the advanced infrared sensing technology.

Once the camera captures an image, the information is immediately parsed and encoded to generate a series of digital signals. These signals are then transmitted accurately to the vehicle's domain controller CEM (Centralized Electronic Module) over hard wires, a reliable and efficient transmission medium. The domain controller CEM acts as the "brain" of the vehicle and is responsible for processing information from the various sensors and actuators.

Upon receiving the signal from the camera, the domain controller CEM will immediately activate its powerful processing capabilities to perform depth analysis and determination of this information. Through complex algorithm and logic judgment, the CEM can accurately identify whether the driver is in a dozing state.

Upon confirming that the driver is at risk of driving fatigue, the domain controller CEM will take action rapidly. The vehicle-mounted controller sends a dozing state signal of a driver to the vehicle-mounted entertainment module IHU (Infotainment Head Unit) and the vehicle controller VCU (Vehicle Control Unit) through the advanced communication module of the vehicle-mounted TBOX (Telematics Box). These two modules are responsible for the infotainment system and the overall control functions of the vehicle, respectively.

The vehicle-mounted entertainment module IHU can trigger the intelligent early warning system immediately after receiving the signal. The system can give a warning to drivers by means of voice prompt to remind the drivers of the driving state of the drivers. Meanwhile, in order to remind the driver more intuitively, the system can also give out obvious alarm sound, so that the driver can be ensured to perceive and respond quickly.

In addition to sending out an alarm, the vehicle control unit VCU also outputs a control signal to adjust the vehicle speed according to the received signal. By adjusting the output power of the engine and the intervention degree of the brake system, the VCU can effectively reduce the vehicle speed and even realize the deceleration or stopping of the vehicle. The process is completely and automatically completed by the system, and no additional operation is required for a driver, so that the driving safety and convenience are greatly improved.

As shown in fig. 4, the description is made with reference to a flow chart of the intelligent early warning driver dozing system: the vehicle is powered on and the vehicle is powered up,

The camera collects image information and analyzes and processes the image information to judge whether a driver is in a doze state, and if so, the intelligent early warning system is triggered, and voice prompts are given: the driver is required to pay attention to avoid safety accidents, and the alarm is given for 3 seconds. If not, the camera will continue to collect information. The method specifically comprises the following steps:

Initializing a system: the starting point of the flow chart is "system initialization". This step is a necessary preparation before any system or program is run, including loading the necessary programs, checking hardware connections, etc., to ensure that the entire system is functioning properly.

Image information collection is started: once the system initialization is complete, the system will begin to collect image information. This is typically accomplished by a camera mounted inside the vehicle that captures real-time images of the driver.

Analyzing and processing image information: the collected image information is further analyzed and processed by the system. The system may use image recognition techniques to determine the state of the driver, particularly whether the vehicle is powered up and dozing.

Judging the state of a driver: the system determines whether the driver is in a state in which the vehicle is powered on and dozing off by analyzing the image information. This is an important step, since the status of the driver is directly related to driving safety.

Triggering an intelligent early warning system: if the system determines that the driver is in a state where the vehicle is powered on or dozing off, it will trigger the intelligent warning system. This system may alert the driver in a number of ways, such as by displaying a warning message through the dashboard of the vehicle or activating an audible and visual alarm device within the vehicle.

Voice prompt: after triggering the intelligent early warning system, the system can tell the driver in a voice prompt mode: the driver is required to pay attention to avoid safety accidents. Such voice prompts can be directed to the driver's attention quickly.

Buzzing and alarming for 3 seconds: in addition to the voice prompt, the system would beep within 3 seconds as an additional warning. Such an audible warning can further emphasize the urgency of the problem, causing the driver to take immediate action.

The whole flow ensures that a driver keeps alert in the driving process through a series of logic judgment and automatic operation, thereby reducing the risk of traffic accidents caused by fatigue or distraction of the driver.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the invention.

Claims (10)

1. The driver fatigue early warning system is characterized by comprising a domain controller CEM, a communication module, an image acquisition module, an execution unit and a whole vehicle control unit; the communication module, the image acquisition module and the whole vehicle control unit are all connected to the domain controller CEM, and the execution unit is connected with the whole vehicle control unit; the image acquisition module is used for acquiring head image information of a driver and sending the acquired head image information to the domain controller CEM, and the domain controller CEM is used for sending a mode switching signal to the execution unit through the communication module when the image information of the fatigue state is monitored.

2. The driver fatigue early warning system according to claim 1, wherein the domain controller CEM is further connected with a vehicle-mounted entertainment module IHU, and the vehicle-mounted entertainment module IHU is used for turning on or off the fatigue early warning function through man-machine interaction.

3. The driver fatigue early warning system according to claim 1, wherein the execution unit includes a battery management system BMS and an on-board MCU; and the battery management system BMS and the vehicle-mounted MCU are both connected to the vehicle control unit, and the battery management system BMS outputs the output power of the vehicle to the vehicle control unit and sends the output power to the vehicle-mounted MCU through the vehicle control unit, and the vehicle-mounted MCU receives the output power of the vehicle and outputs corresponding engine torque.

4. The fatigue early warning system for drivers according to claim 3, wherein the input/output end of the vehicle control unit VCU is connected to the domain controller CEM, the vehicle control unit VCU transmits the output vehicle speed information to the domain controller CEM, and receives a mode switching signal transmitted from the domain controller, and the vehicle control unit transmits the mode switching signal to the battery management system BMS.

5. The driver fatigue warning system of claim 1, wherein the image acquisition module is an infrared camera.

6. The driver fatigue warning system of claim 5, wherein the infrared camera is mounted in front of the driver's seat.

7. The driver fatigue warning system of claim 1, wherein the communication module is a vehicle communication box TBOX.

8. The driver fatigue warning system of claim 1, wherein the vehicle control unit is a vehicle control unit VCU.

9. A driver fatigue early warning method, characterized by being based on the driver fatigue early warning system according to any one of claims 1 to 8, comprising the steps of:

The image acquisition module acquires head image information of a driver, converts the detected fatigue state image information into an image signal, and then converts the image signal into an electric signal to be sent to the domain controller CEM;

The whole vehicle control unit sends the vehicle speed information to the domain controller CEM, receives a mode switching signal sent by the domain controller CEM, and sends the mode switching signal to the battery management system BMS;

The battery management system BMS outputs the output power of the automobile to the whole automobile control unit, and sends the output power to the vehicle-mounted MCU through the whole automobile control unit, and the vehicle-mounted MCU receives the output power of the automobile and outputs corresponding engine torque to reduce the speed of the automobile.

10. The driver fatigue warning method according to claim 9, wherein the warning function is started by transmitting a function start signal to the domain controller CEM via the in-vehicle entertainment module IHU.