[go: up one dir, main page]

CN115871678A - Method, device, equipment and storage medium for reminding driver of focusing on driving - Google Patents

Method, device, equipment and storage medium for reminding driver of focusing on driving Download PDF

Info

Publication number
CN115871678A
CN115871678A CN202211543535.4A CN202211543535A CN115871678A CN 115871678 A CN115871678 A CN 115871678A CN 202211543535 A CN202211543535 A CN 202211543535A CN 115871678 A CN115871678 A CN 115871678A
Authority
CN
China
Prior art keywords
driver
driving
mind
wandering
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211543535.4A
Other languages
Chinese (zh)
Inventor
熊迅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Changan Automobile Co Ltd
Original Assignee
Chongqing Changan Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Changan Automobile Co Ltd filed Critical Chongqing Changan Automobile Co Ltd
Priority to CN202211543535.4A priority Critical patent/CN115871678A/en
Publication of CN115871678A publication Critical patent/CN115871678A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Traffic Control Systems (AREA)

Abstract

本发明提供一种提醒司机专注驾驶的方法、装置、设备及存储介质,所述方法包括获取司机驾驶状态图像信息;对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;将所述驾驶姿态持续时间与实时的走神判断时间进行比较;当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶。本发明所提供的提醒司机专注驾驶的方法,确定的走神判断时间是综合驾驶过程中各种因素制定的,能实现更及时地对没有专注驾驶的司机进行提醒,有效避免了由于司机不专注驾驶导致的交通事故的发生。

Figure 202211543535

The present invention provides a method, device, device and storage medium for reminding the driver to focus on driving. The method includes acquiring the image information of the driver's driving state; processing the image information of the driving state to obtain the duration of the driver's driving posture; The driving posture duration is compared with the real-time distraction judgment time; when the driving posture duration is greater than or equal to the real-time distraction judgment time, it is determined that the driver is in a distracted state and a warning is immediately issued to the driver to remind the driver to focus on driving . In the method for reminding drivers to concentrate on driving provided by the present invention, the determined distraction judgment time is formulated based on various factors in the driving process. resulting in traffic accidents.

Figure 202211543535

Description

一种提醒司机专注驾驶的方法、装置、设备及存储介质A method, device, equipment and storage medium for reminding drivers to focus on driving

技术领域technical field

本发明涉及汽车安全驾驶技术领域,特别是涉及一种提醒司机专注驾驶的方法、装置、设备及存储介质。The invention relates to the technical field of safe driving of automobiles, in particular to a method, device, equipment and storage medium for reminding drivers to concentrate on driving.

背景技术Background technique

随着我国经济的不断发展,人民生活水平的提高,汽车逐渐普及开来,成为出行必不可少的工具。汽车的普及推动了汽车行业的变革,近年来,软件定义汽车成为行业的主流,车身上添加了各种控制器和处理器,为多种设计思路提供了实现的可能。传感器在汽车上的应用技术已经相当成熟,现在汽车设计之初就已经留有冗余资源,我们大可利用这些冗余资源去做一些辅助功能,合理利用资源的同时也完善了汽车功能。车云的普及为我们设计方案提供了多种选泽,利用车云可以让车主体验到智能化出行带来的便利。With the continuous development of my country's economy and the improvement of people's living standards, cars have gradually become popular and become an indispensable tool for travel. The popularity of automobiles has promoted the transformation of the automobile industry. In recent years, software-defined automobiles have become the mainstream of the industry. Various controllers and processors are added to the body, which provides the possibility of realizing various design ideas. The application technology of sensors in automobiles is quite mature, and now there are redundant resources at the beginning of automobile design, we can use these redundant resources to do some auxiliary functions, and improve the functions of automobiles while using resources reasonably. The popularity of Cheyun provides us with a variety of options for design solutions. Using Cheyun allows car owners to experience the convenience brought by intelligent travel.

车辆的增多也带来很多交通安全上的问题。在车辆行驶过程中,司机可能因为各种原因导致当时的注意力不在车辆驾驶上,这种情况是很危险的,专注驾驶能规避很多事故的发生。本专利旨在设计一款基于车云大数据处理、图像处理综合数据处理系统以在司机驾驶途中分神的时候提醒司机专注驾驶,避免由于司机不专注驾驶导致的交通事故发生。为司机安全出行提供一层保障。The increase of vehicles also brings many traffic safety problems. During the driving process of the vehicle, the driver may not pay attention to the driving of the vehicle due to various reasons. This situation is very dangerous. Concentrated driving can avoid many accidents. This patent aims to design a comprehensive data processing system based on car cloud big data processing and image processing to remind the driver to focus on driving when the driver is distracted while driving, so as to avoid traffic accidents caused by the driver's inattentive driving. Provide a layer of protection for drivers to travel safely.

现有技术中,有利用单个近红外视觉传感器,基于深度学习和数字图像处理技术,在车辆行驶过程中,检测车道线,并计算车道线到主车两侧边沿直线的距离,当距离小于阈值时,发出警报,实现车道偏离预警。该发明能够有效地在车辆行驶过程中,对车道线偏离发出警报,防止因司机分神产生的危险。但是这种提醒司机走神的方法只能在偏离车道线的情况下提醒司机分神,可应用场景少,而且原理复杂,实现起来较为困难。此外,现有技术大多利用传感器等物理装置判断车主驾车状态,对于判断时间的把握并不智能,导致对司机走神的提醒不够及时。In the existing technology, a single near-infrared vision sensor is used, based on deep learning and digital image processing technology, to detect lane lines during vehicle driving, and calculate the distance from the lane line to the straight lines on both sides of the main vehicle. When the distance is less than the threshold , an alarm is issued to realize lane departure warning. The invention can effectively send out an alarm to the departure of the lane line during the running of the vehicle, so as to prevent the danger caused by the distraction of the driver. However, this method of reminding the driver to be distracted can only remind the driver to be distracted when he deviates from the lane line. There are few applicable scenarios, and the principle is complicated, so it is relatively difficult to implement. In addition, most of the existing technologies use physical devices such as sensors to judge the driving status of the car owner, which is not smart enough to grasp the judgment time, resulting in insufficient timely reminders to the driver's mind-wandering.

发明内容Contents of the invention

鉴于以上所述现有技术的缺点,本发明的目的在于提供一种提醒司机专注驾驶的方法、装置、设备及存储介质,以解决上述技术问题。In view of the shortcomings of the prior art described above, the object of the present invention is to provide a method, device, device and storage medium for reminding the driver to concentrate on driving, so as to solve the above technical problems.

为实现上述目的及其他相关目的,本发明提供一种提醒司机专注驾驶的方法,包括:In order to achieve the above purpose and other related purposes, the present invention provides a method for reminding the driver to focus on driving, including:

获取司机驾驶状态图像信息;Obtain the image information of the driver's driving state;

对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;Processing the driving state image information to obtain the duration of the driver's driving posture;

将所述驾驶姿态持续时间与实时的走神判断时间进行比较;The duration of the driving posture is compared with the real-time mind-wandering judgment time;

当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶。When the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and a warning is immediately issued to the driver to remind the driver to focus on driving.

在本发明的一可选实施例中,所述走神判断时间通过如下方式获得:In an optional embodiment of the present invention, the mind-wandering judgment time is obtained in the following manner:

获取车身周围环境图像信息和车速信息,并将所述车身周围环境图像信息给云端;Obtain the image information of the surrounding environment of the vehicle body and the vehicle speed information, and send the image information of the surrounding environment of the vehicle body to the cloud;

接收所述云端根据所述车身周围环境图像信息解析出的车外因素信息;receiving the external factor information analyzed by the cloud according to the image information of the surrounding environment of the vehicle body;

根据所述车速信息和所述车外因素信息,计算出所述走神判断时间。The mind-wandering judgment time is calculated according to the vehicle speed information and the external factor information.

在本发明的一可选实施例中,根据所述车速信息和所述车外因素信息,计算出所述走神判断时间,具体包括:In an optional embodiment of the present invention, the time for judging mind-wandering is calculated according to the vehicle speed information and the external factor information, which specifically includes:

利用所述车速和车外因素进行综合计算,获得综合系数;Using the speed of the vehicle and factors outside the vehicle to perform comprehensive calculations to obtain a comprehensive coefficient;

将所述综合系数与预设好的综合系数表比对,获得所述走神判断时间。The comprehensive coefficient is compared with the preset comprehensive coefficient table to obtain the mind-wandering judgment time.

在本发明的一可选实施例中,所述走神判断时间通过如下方式获得:In an optional embodiment of the present invention, the mind-wandering judgment time is obtained in the following manner:

获取车身周围环境图像信息和车速信息,并将所述车身周围环境图像信息和所述车速信息给云端;Obtaining the image information of the surrounding environment of the vehicle body and the vehicle speed information, and sending the image information of the surrounding environment of the vehicle body and the vehicle speed information to the cloud;

接收所述云端根据所述车身周围环境图像信息和车速信息处理后得到的所述走神判断时间。receiving the mind-wandering judging time obtained by the cloud according to the image information of the surrounding environment of the vehicle body and the vehicle speed information;

在本发明的一可选实施例中,所述云端根据所述车身周围环境图像信息和车速信息处理后得到的所述走神判断时间,具体包括:In an optional embodiment of the present invention, the mind-wandering judgment time obtained by the cloud according to the image information of the surrounding environment of the vehicle body and the vehicle speed information after processing, specifically includes:

根据所述车身周围环境图像信息,解析出车外因素信息;According to the image information of the surrounding environment of the vehicle body, the information of factors outside the vehicle is analyzed;

根据所述车外因素信息和车速信息,计算出所述走神判断时间。The mind-wandering judgment time is calculated according to the external factor information and the vehicle speed information.

在本发明的一可选实施例中,所述车外因素信息包括天气、道路状况以及车流量。In an optional embodiment of the present invention, the external factor information includes weather, road conditions and traffic flow.

在本发明的一可选实施例中,所述提醒司机专注驾驶的方法还包括:In an optional embodiment of the present invention, the method for reminding the driver to concentrate on driving also includes:

根据所述驾驶状态图像信息来判定所述司机的眼睛处于闭合的时间是否超过预设时间;determining whether the driver's eyes are closed for more than a preset time according to the driving state image information;

当所述司机的眼睛处于闭合的时间超过预设时间时,立即触发警报。When the driver's eyes are closed for more than a preset time, an alarm is triggered immediately.

在本发明的一可选实施例中,当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶,具体包括:In an optional embodiment of the present invention, when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and a warning is issued to the driver immediately to remind the driver to focus on driving, specifically include:

向震动器输出第一震动信号使所述震动器产生一级震动,以提醒司机专注驾驶。Outputting the first vibration signal to the vibrator causes the vibrator to generate a first-level vibration to remind the driver to concentrate on driving.

在本发明的一可选实施例中,当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶,还包括:In an optional embodiment of the present invention, when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and a warning is issued to the driver immediately to remind the driver to concentrate on driving, and include:

继续获取司机驾驶状态图像信息,并进行司机走神状态判定;Continue to obtain the image information of the driver's driving state, and judge the state of the driver's distraction;

如果判定司机仍处于走神状态,则向所述震动器输出第二震动信号一使震动器产生比所述一级震动强度更大的震动。If it is determined that the driver is still distracted, then output a second vibration signal to the vibrator to make the vibrator produce a vibration with a greater intensity than the first level of vibration.

在本发明的一可选实施例中,获取司机驾驶状态图像信息,具体包括:In an optional embodiment of the present invention, obtaining image information of the driver's driving state specifically includes:

通过设置在车身的摄像头和/或红外装置来获得所述司机驾驶状态图像信息。The image information of the driver's driving state is obtained through a camera and/or an infrared device arranged on the vehicle body.

在本发明的一可选实施例中,获取所述车身周围图像信息,具体包括:In an optional embodiment of the present invention, acquiring image information around the vehicle body specifically includes:

利用设置在车身的全息影像来获得所述车身周围图像信息。The image information around the vehicle body is obtained by using the holographic image set on the vehicle body.

为实现上述目的及其它相关目的,本发明还提供一种提醒司机专注驾驶的装置,包括:In order to achieve the above purpose and other related purposes, the present invention also provides a device for reminding the driver to focus on driving, including:

图像获取模块,用以获取司机驾驶状态图像信息;The image acquisition module is used to acquire the image information of the driver's driving state;

图像处理模块,用以对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;An image processing module, configured to process the driving state image information to obtain the duration of the driver's driving posture;

时间比较模块,用以将所述驾驶姿态持续时间与实时的走神判断时间进行比较;Time comparison module, in order to compare described driving posture duration with real-time mind-wandering judgment time;

走神提醒模块,用以当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶。A mind-wandering reminder module is used to determine that the driver is in a state of mind-wandering when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time and to immediately issue a warning to the driver to remind the driver to focus on driving.

为实现上述目的及其它相关目的,本发明还提供一种电子设备,其特征在于,包括:In order to achieve the above purpose and other related purposes, the present invention also provides an electronic device, which is characterized in that it includes:

一个或多个处理器;one or more processors;

存储装置,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述电子设备实现如权利如上述项所述的方法。The storage device is used to store one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device implements the method described in the above item.

为实现上述目的及其它相关目的,本发明还提供一种计算机可读存储介质,其特征在于,其上存储有计算机可读指令,当所述计算机可读指令被计算机的处理器执行时,使计算机执行如上述所述的方法。To achieve the above object and other related objects, the present invention also provides a computer-readable storage medium, which is characterized in that computer-readable instructions are stored thereon, and when the computer-readable instructions are executed by the processor of the computer, the A computer executes the method as described above.

有益效果:Beneficial effect:

本发明提供的提醒司机专注驾驶的方法,通过获取司机驾驶状态图像信息;对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;将所述驾驶姿态持续时间与实时的走神判断时间进行比较;当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶。本发明所提供的提醒司机专注驾驶的方法,确定的走神判断时间是综合驾驶过程中各种因素制定的,对走神司机的提醒更具有可靠性,有效避免了由于司机不专注驾驶导致的交通事故的发生。同时本发明提供的方法还具有应用场景多,原理简单,实现容易等特点。The method for reminding the driver to concentrate on driving provided by the present invention obtains the image information of the driver's driving state; processes the image information of the driving state to obtain the duration of the driver's driving posture; compares the duration of the driving posture with the real-time mind-wandering judgment time Comparison; when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and a warning is immediately issued to the driver to remind the driver to concentrate on driving. The method for reminding the driver to concentrate on driving provided by the present invention, the determined time for judging mind-wandering is determined based on various factors in the driving process, and the reminder to distracted drivers is more reliable, effectively avoiding traffic accidents caused by drivers not focusing on driving happened. At the same time, the method provided by the present invention also has the characteristics of many application scenarios, simple principle, and easy implementation.

附图说明Description of drawings

此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本申请的实施例,并与说明书一起用于解释本申请的原理。显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术者来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。在附图中:The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. Apparently, the drawings in the following description are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without creative efforts. In the attached picture:

图1为本申请的一示例性实施例示出的驾驶员状态监控系统框图。Fig. 1 is a block diagram of a driver state monitoring system according to an exemplary embodiment of the present application.

图2为本申请的一示例性实施例的提醒司机专注驾驶的方法的流程示意图。Fig. 2 is a schematic flowchart of a method for reminding a driver to concentrate on driving according to an exemplary embodiment of the present application.

图3为图2中步骤S203中在一具体实施例中确定走神判断时间的流程示意图。FIG. 3 is a schematic flowchart of determining the mind-wandering judgment time in a specific embodiment in step S203 in FIG. 2 .

图4是本申请的一示例性实施例示出的提醒司机专注驾驶装置的框图。Fig. 4 is a block diagram of an apparatus for reminding a driver to concentrate on driving according to an exemplary embodiment of the present application.

图5示出了适于用来实现本申请实施例的电子设备的计算机系统的结构示意图。Fig. 5 shows a schematic structural diagram of a computer system suitable for implementing the electronic device of the embodiment of the present application.

具体实施方式Detailed ways

以下通过特定的具体实例说明本发明的实施方式,本领域技术人员可由本说明书所揭露的内容轻易地了解本发明的其他优点与功效。本发明还可以通过另外不同的具体实施方式加以实施或应用,本说明书中的各项细节也可以基于不同观点与应用,在没有背离本发明的精神下进行各种修饰或改变。需说明的是,在不冲突的情况下,以下实施例及实施例中的特征可以相互组合。Embodiments of the present invention are described below through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific implementation modes, and various modifications or changes can be made to the details in this specification based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that, in the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.

需要说明的是,以下实施例中所提供的图示仅以示意方式说明本发明的基本构想,遂图示中仅显示与本发明中有关的组件而非按照实际实施时的组件数目、形状及尺寸绘制,其实际实施时各组件的型态、数量及比例可为一种随意的改变,且其组件布局型态也可能更为复杂。It should be noted that the diagrams provided in the following embodiments are only schematically illustrating the basic ideas of the present invention, and only the components related to the present invention are shown in the diagrams rather than the number, shape and number of components in actual implementation. Dimensional drawing, the type, quantity and proportion of each component can be changed arbitrarily during actual implementation, and the component layout type may also be more complicated.

在下文描述中,探讨了大量细节,以提供对本发明实施例的更透彻的解释,然而,对本领域技术人员来说,可以在没有这些具体细节的情况下实施本发明的实施例是显而易见的,在其他实施例中,以方框图的形式而不是以细节的形式来示出公知的结构和设备,以避免使本发明的实施例难以理解。In the following description, numerous details are discussed in order to provide a more thorough explanation of embodiments of the invention, however, it will be apparent to those skilled in the art that embodiments of the invention can be practiced without these specific details, In other embodiments, well-known structures and devices are shown in block diagram form rather than in detail in order to avoid obscuring the embodiments of the invention.

本公开实施例的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本公开实施例的实施例。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含。The terms "first", "second" and the like in the description and claims of the embodiments of the present disclosure and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It should be understood that the data so used may be interchanged under appropriate circumstances so as to facilitate the embodiments of the disclosed embodiments described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion.

除非另有说明,术语“多个”表示两个或两个以上。Unless stated otherwise, the term "plurality" means two or more.

本公开实施例中,字符“/”表示前后对象是一种“或”的关系。例如,A/B表示:A或B。In the embodiments of the present disclosure, the character "/" indicates that the preceding and following objects are an "or" relationship. For example, A/B means: A or B.

术语“和/或”是一种描述对象的关联关系,表示可以存在三种关系。例如,A和/或B,表示:A或B,或,A和B这三种关系。The term "and/or" is an associative relationship describing objects, indicating that there can be three relationships. For example, A and/or B means: A or B, or, A and B, these three relationships.

请参阅图1所示,为本发明所提供的一种驾驶员状态监控系统,包括传感器101、驾驶行为分析模块102以及报警模块103。所述传感器101用于采集驾驶员把握方向盘的状态信息;所述驾驶分析模块与所述传感器电连接,用于根据驾驶员把握方向盘的状态信息判断驾驶员的驾驶行为信号;所述报警模块103与所述驾驶行为分析模块102电连接,用于根据驾驶行为信号执行报警动作。利用上述系统可以实现对驾驶员危险驾驶行为的提醒。Please refer to FIG. 1 , which is a driver state monitoring system provided by the present invention, including a sensor 101 , a driving behavior analysis module 102 and an alarm module 103 . The sensor 101 is used to collect the state information of the driver's grasp of the steering wheel; the driving analysis module is electrically connected to the sensor, and is used to judge the driver's driving behavior signal according to the state information of the driver's grasp of the steering wheel; the alarm module 103 It is electrically connected with the driving behavior analysis module 102, and is used for performing an alarm action according to the driving behavior signal. The above system can be used to remind the driver of dangerous driving behavior.

但是上述控制系统,采用的是传感器来判断车主驾车状态,而传感器采集信息有限,这就使得判断时间的把握并不智能。However, the above-mentioned control system uses sensors to judge the driving state of the car owner, and the information collected by the sensors is limited, which makes the judgment time not intelligent.

有鉴于此,本发明公开了一种提醒司机专注驾驶的方法,所述提醒司机专注驾驶的方法包括:In view of this, the present invention discloses a method for reminding the driver to concentrate on driving, and the method for reminding the driver to concentrate on driving includes:

步骤S201,获取司机驾驶状态图像信息;Step S201, obtaining image information of the driver's driving state;

步骤S202,对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;Step S202, processing the driving state image information to obtain the duration of the driver's driving posture;

步骤S203,将所述驾驶姿态持续时间与实时的走神判断时间进行比较;Step S203, comparing the duration of the driving posture with the real-time mind-wandering judgment time;

步骤S204,当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶。Step S204, when the duration of the driving posture is greater than or equal to the real-time distracted judgment time, it is determined that the driver is distracted and a warning is issued to the driver immediately to remind the driver to concentrate on driving.

采用本公开实施例所提供的提醒司机专注驾驶的方法,通过根据车速信息和车外因素信息进行计算,获得走神判断时间,接着获取司机驾驶状态图像,并对驾驶状态图像进行处理,获得司机姿态,判断在获得的所述走神判断时间内,司机驾驶姿态是否改变,以确定司机是否处于走神状态,如果司机处于走神状态,则向司机发送警示信息以提醒司机专注驾驶。由于本发明所提供的走神判断数据是通过对多种影响因素综合分析得到,因而能更及时有效的提醒司机专注驾驶,避免由于司机不专注驾驶导致的交通事故的发生。Using the method of reminding the driver to focus on driving provided by the embodiment of the present disclosure, by calculating according to the vehicle speed information and the information of factors outside the vehicle, the judgment time of distraction is obtained, and then the driving state image of the driver is obtained, and the driving state image is processed to obtain the driver's posture , judging whether the driver’s driving posture changes within the obtained mind-wandering judgment time, so as to determine whether the driver is in a mind-wandering state, and if the driver is in a mind-wandering state, send a warning message to the driver to remind the driver to concentrate on driving. Since the mind-wandering judgment data provided by the present invention is obtained through comprehensive analysis of various influencing factors, it can more timely and effectively remind the driver to concentrate on driving and avoid the occurrence of traffic accidents caused by the driver's inattentive driving.

下面结合附图2来详细介绍各步骤的实现过程:The implementation process of each step is introduced in detail below in conjunction with accompanying drawing 2:

首先,执行步骤S201,获取司机驾驶状态图像信息;First, step S201 is executed to acquire the image information of the driver's driving state;

在本实施例中,司机驾驶位的位置处设置有前置摄像头和红外装置,前置摄像头和红外装置用于对司机的驾驶状态信息进行实时采集。其中,所述红外装置主要用于夜间或者阴雨天等光线阴暗的时候,采集司机的驾驶状态信息。红外装置的原理是通过线性排列的红外光发射和接收来实现对车辆的同步扫描,并将光信号转换为电信号,从而实现对车辆数据的综合检测,与其它检测技术相比,红外线车辆检测器产品技术成熟,安装简便,高速响应,抗干扰性强,可输出丰富的车辆数据信息,能可靠检测各种特殊车辆。In this embodiment, a front camera and an infrared device are installed at the driver's seat, and the front camera and infrared device are used for real-time collection of the driver's driving state information. Wherein, the infrared device is mainly used for collecting the driving status information of the driver at night or when the light is dark such as rainy days. The principle of the infrared device is to realize the synchronous scanning of the vehicle through the emission and reception of infrared light arranged linearly, and convert the optical signal into an electrical signal, so as to realize the comprehensive detection of vehicle data. Compared with other detection technologies, infrared vehicle detection The product technology is mature, easy to install, high-speed response, strong anti-interference, can output rich vehicle data information, and can reliably detect various special vehicles.

接着,执行步骤S202,对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;Next, step S202 is executed to process the driving state image information to obtain the duration of the driver's driving posture;

首先说明的是,首先说明的是,本文所述驾驶姿态包括司机未操作方向盘、未注视前方、未做出避让车辆动作、未踩踏刹车等。车端的中央处理器通过对获取到的驾驶状态图像信息进行处理,来获得这些司机非专抓驾驶状态的持续时间。Firstly, it should be explained that the driving posture mentioned in this article includes the driver not operating the steering wheel, not looking ahead, not making actions to avoid vehicles, not stepping on the brakes, etc. The central processing unit at the car end processes the acquired driving state image information to obtain the duration of the non-focused driving state of these drivers.

再接着执行步骤S203,将所述驾驶姿态持续时间与实时的走神判断时间进行比较;Then step S203 is executed, and the duration of the driving posture is compared with the real-time mind-wandering judgment time;

需要说明的是,所述走神判断时间的获取方式,请参阅图3所示,在一实施例中,所述走神判断时间通过如下方式获得:It should be noted that the acquisition method of the mind-wandering judgment time is shown in FIG. 3 . In one embodiment, the mind-wandering judgment time is obtained in the following manner:

步骤S310,获取车身周围环境图像信息和车速信息,并将所述车身周围环境图像信息给云端;Step S310, acquiring the image information of the surrounding environment of the vehicle body and the vehicle speed information, and sending the image information of the surrounding environment of the vehicle body to the cloud;

在本实施例中,所述车速信息可通过车身上的速度传感器获得。In this embodiment, the vehicle speed information can be obtained through a speed sensor on the vehicle body.

在本实施例中,所述车身周围环境图像信息可通过车端的全息影像获得,其中全息影像可以是360全息影像、540全息影像。相对于现有技术中通过传感器获得车身周围图像信息,利用全息影像获得的车身周围图像信息,不仅清晰度更高而且更全面。In this embodiment, the image information of the surrounding environment of the vehicle body can be obtained through a holographic image at the vehicle end, where the holographic image can be a 360 holographic image or a 540 holographic image. Compared with the image information around the vehicle body obtained by sensors in the prior art, the image information around the vehicle body obtained by using the holographic image not only has higher definition but also is more comprehensive.

所述360全息影像也被称之为全息三维成像,它是由透明材料制成的四面锥体,观众的视线能从任何一面穿透它,观众能从锥形空间里看到自由飘浮的影像和图形。四面视频成像将光信号反射到这个锥体中的特殊棱镜上,汇集到一起后形成具有真实维度空间的立体影像。The 360 holographic image is also called holographic three-dimensional imaging. It is a four-sided cone made of transparent materials. The viewer's line of sight can penetrate it from any side, and the audience can see free-floating images from the cone-shaped space. and graphics. Four-sided video imaging reflects light signals to special prisms in this cone, and when they are brought together, they form a three-dimensional image with a real-dimensional space.

360全息成像是近年来在国际上兴起的一种新型展示技术,该技术可以使立体影像不借助任何屏幕或介质而直接悬浮在设备外的自由空间,并且360°任意角度看都是三维影像展现,这种展示手段打破常规的实物展示手段立体影像的清晰度及色彩还真度高,立体感强,因此非常逼真,可以给观众以新奇、玄妙的视觉冲击,激发观众探究欲,并可以起到聚集现场人气、加深参观者印象、提高被展示物知名度的作用。360 holographic imaging is a new type of display technology that has emerged internationally in recent years. This technology can make the stereoscopic image directly suspended in the free space outside the device without any screen or medium, and it can be viewed from any angle of 360° as a three-dimensional image display. , This kind of display method breaks the conventional physical display method. The clarity and color of the three-dimensional image are high, and the three-dimensional effect is strong, so it is very realistic. It can give the audience a novel and mysterious visual impact, stimulate the audience's desire to explore, and can play a role To gather the popularity of the scene, deepen the impression of visitors, and improve the popularity of the displayed objects.

所述560全息影像是基于360全景影像的基础上,又增加了180度的底盘透视功能,实现540度的全景影像功能,全景影像功能开启后,不但能够观察到车辆4周的情况,还可以通过摄像头观察到车辆底盘下面的情况。The 560-degree holographic image is based on the 360-degree panoramic image, and a 180-degree chassis perspective function is added to achieve a 540-degree panoramic image function. The camera observes the situation under the chassis of the vehicle.

步骤S320,接收所述云端根据所述车身周围环境图像信息解析出的车外因素信息;Step S320, receiving the external factor information analyzed by the cloud according to the image information of the surrounding environment of the vehicle body;

首先说明的是,所述车外因素包括天气、道路状况以及车流量,云端通过图像处理技术和算法对车端发来的车身周围环境图像信息进行解析,以获得当前车身周围天气、路况以及车流量信息。具体的解析过程如下:First of all, the factors outside the vehicle include weather, road conditions, and traffic flow. The cloud analyzes the image information of the surrounding environment of the vehicle body sent by the vehicle through image processing technology and algorithms to obtain the current weather, road conditions, and traffic conditions around the vehicle body. traffic information. The specific analysis process is as follows:

在本实施例中,云端从获取到车端发送的环境图像中识别出天气图像并与云端预先存储的标准的天气图像进行对比,判断所采集的天气图像属于大雨、浓雾、大风、小雨、雾天、正常中的哪一类。In this embodiment, the cloud recognizes the weather image from the environmental image acquired and sent by the vehicle end and compares it with the standard weather image stored in the cloud in advance, and judges that the collected weather image belongs to heavy rain, dense fog, strong wind, light rain, Foggy, normal which category.

云端从获取到车端发送的环境图像中识别出道路状况图像并与云端预先存储的标准的道路状况图像进行对比,判断所采集的天气图像属于涉水、无护栏、泥泞、凹凸、弯折、略微不平、积水以及正常中的哪一类。The cloud recognizes the road condition image from the environmental image acquired and sent by the vehicle and compares it with the standard road condition image stored in the cloud, and judges that the collected weather image belongs to wading, no guardrail, muddy, bumpy, curved, Slightly uneven, waterlogged, and normal.

云端通过计算一段时间内通过的车辆数量,可以计算出车流量。The cloud can calculate the traffic flow by calculating the number of vehicles passing by in a period of time.

需要说明的是,本步骤中,云端用到的算法主要指图像特征提取和对比算法,具体使用的算法,本文在此不做限定。It should be noted that in this step, the algorithm used in the cloud mainly refers to the image feature extraction and comparison algorithm, and the specific algorithm used is not limited here.

步骤S330,根据所述车速信息和所述车外因素信息,计算出所述走神判断时间。Step S330, calculating the mind-wandering judgment time according to the vehicle speed information and the external factor information.

在一实施例中,根据所述车速信息和所述车外因素信息,计算出所述走神判断时间,具体包括:In one embodiment, the time for judging mind-wandering is calculated according to the vehicle speed information and the external factor information, which specifically includes:

利用所述车速和车外因素进行综合计算,获得综合系数;Using the speed of the vehicle and factors outside the vehicle to perform comprehensive calculations to obtain a comprehensive coefficient;

其中综合系数x的计算公式为把各因素对应的等级*权重,再相加,其中各因素指的是车速、车流量、天气以及道路状况,在一具体实施例中可将车速、天气、道路状况以及车流量按照表1所示进行划分等级。Wherein, the calculation formula of the comprehensive coefficient x is to add the corresponding grade*weight of each factor, wherein each factor refers to vehicle speed, traffic volume, weather and road conditions, and in a specific embodiment, the vehicle speed, weather, road Conditions and traffic flow are classified according to Table 1.

Figure BDA0003973856140000061
Figure BDA0003973856140000061

Figure BDA0003973856140000071
Figure BDA0003973856140000071

表1为因素等级对照表Table 1 is the comparison table of factor levels

作为示例,比如预设的车速、天气、道路状况以及车流量的权重比为3:2:3:2,车速等级为3,天气等级为3,道路状况等级为3,车流量等级为3,那么此时综合系数x的计算公式为3*0.3+3*0.2+3*0.3+3*0.2,即综合系数x=6。As an example, for example, the preset weight ratio of vehicle speed, weather, road condition and traffic flow is 3:2:3:2, the vehicle speed level is 3, the weather level is 3, the road condition level is 3, and the traffic flow level is 3, Then, the calculation formula of the comprehensive coefficient x at this time is 3*0.3+3*0.2+3*0.3+3*0.2, that is, the comprehensive coefficient x=6.

将所述综合系数与预设好的综合系数表比对,获得所述走神判断时间。The comprehensive coefficient is compared with the preset comprehensive coefficient table to obtain the mind-wandering judgment time.

在本实施例中,车端通过将求得的综合系数与车端存储器中预先存储的综合系数对照表进行比对,确定出在此种周围环境下合适的走神判断时间。In this embodiment, the car end compares the calculated comprehensive coefficient with the comprehensive coefficient comparison table stored in the memory of the car end to determine the appropriate mind-wandering judgment time in this surrounding environment.

作为示例,所述综合系数对照表可按照表2的方式设置。As an example, the comprehensive coefficient comparison table may be set in the manner shown in Table 2.

综合系数Comprehensive coefficient 等级grade 走神判断时间Mind wandering to judge time 1-1.41-1.4 11 10s10s 1.4-2.21.4-2.2 22 6s6s 2.2-32.2-3 33 3s3s

表2为综合系数对照表Table 2 is the comprehensive coefficient comparison table

需要说明的是,上述综合系数对照表仅是一个示例性介绍,在其实施例中可根据具体的情况来设定综合系数对照表,本申请对此不做限制。It should be noted that the above comprehensive coefficient comparison table is only an exemplary introduction, and the comprehensive coefficient comparison table can be set according to specific situations in the embodiment, which is not limited in this application.

在另一实施例中,所述走神判断时间还可通过如下方式获得:In another embodiment, the mind-wandering judgment time can also be obtained in the following manner:

获取车身周围环境图像信息和车速信息,并将所述车身周围环境图像信息和所述车速信息给云端;Obtaining the image information of the surrounding environment of the vehicle body and the vehicle speed information, and sending the image information of the surrounding environment of the vehicle body and the vehicle speed information to the cloud;

接收所述云端根据所述车身周围环境图像信息和车速信息处理后得到的所述走神判断时间。receiving the mind-wandering judging time obtained by the cloud according to the image information of the surrounding environment of the vehicle body and the vehicle speed information;

在一具体实施例,所述接收所述云端根据所述车身周围环境图像信息和车速信息处理后得到的所述走神判断时间,具体包括:In a specific embodiment, the receiving the mind-wandering judgment time obtained by the cloud according to the image information of the surrounding environment of the vehicle body and the vehicle speed information after processing, specifically includes:

根据所述车身周围环境图像信息,解析出车外因素信息;According to the image information of the surrounding environment of the vehicle body, the information of factors outside the vehicle is analyzed;

具体的,云端利用预设好的算法对所述车身周围环境图像信息进行解析,获得车外因素信息。Specifically, the cloud uses a preset algorithm to analyze the image information of the surrounding environment of the vehicle body to obtain information on factors outside the vehicle.

根据所述车外因素信息和车速信息,计算出所述走神判断时间。The mind-wandering judgment time is calculated according to the external factor information and the vehicle speed information.

云端利用所述车外因素信息和车速信息计算出综合系数,然后通过查综合系数对照表,可计算出走神判断时间。The cloud calculates the comprehensive coefficient by using the information of factors outside the vehicle and the vehicle speed information, and then by checking the comprehensive coefficient comparison table, the judgment time of mind-wandering can be calculated.

最后执行步骤S204,当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶;Finally, step S204 is executed, when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and a warning is issued to the driver immediately to remind the driver to focus on driving;

在一具体实施例,当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶,具体包括:In a specific embodiment, when the duration of the driving posture is greater than or equal to the real-time distraction judgment time, it is determined that the driver is in a distracted state and an alert is immediately issued to the driver to remind the driver to focus on driving, specifically including:

车端的震动控制器向震动器输出第一震动信号使所述震动器产生一级震动,以提醒司机专注驾驶。The vibration controller at the car end outputs a first vibration signal to the vibrator to make the vibrator generate a first-level vibration to remind the driver to concentrate on driving.

为了确定在震动器产生一级震动后,司机是否回到专注驾驶状态,可以继续获取司机驾驶状态图像信息,并进行司机走神状态判定,如果判定司机仍处于走神状态,则向所述震动器输出第二震动信号一使震动器产生比所述一级震动强度更大的震动。In order to determine whether the driver returns to the focused driving state after the vibrator generates a first-level vibration, the image information of the driver's driving state can be continuously obtained, and the driver's distracted state can be judged. If it is determined that the driver is still in the distracted state, then output to the vibrator The second vibration signal one causes the vibrator to generate a vibration with a stronger intensity than the first-level vibration.

在一实施例中,本发明所提供的提醒司机专注驾驶的方法,还包括:In one embodiment, the method for reminding the driver to focus on driving provided by the present invention further includes:

根据所述驾驶状态图像信息来判定所述司机的眼睛处于闭合的时间是否超过预设时间;当所述司机的眼睛处于闭合的时间超过预设时间时,立即触发警报。Determine whether the driver's eyes are closed for more than a preset time according to the driving state image information; when the driver's eyes are closed for more than a preset time, an alarm is triggered immediately.

综上,本发明提供的提醒司机专注驾驶的方法,通过获取司机驾驶状态图像信息;对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;将所述驾驶姿态持续时间与实时的走神判断时间进行比较;当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶。本发明所提供的提醒司机专注驾驶的方法,确定的走神判断时间是综合驾驶过程中各种因素制定的,对走神司机的提醒更具有可靠性,有效避免了由于司机不专注驾驶导致的交通事故的发生。同时本发明提供的方法还具有应用场景多,原理简单,实现容易等特点。To sum up, the method for reminding the driver to focus on driving provided by the present invention obtains the image information of the driver's driving state; processes the image information of the driving state to obtain the duration of the driver's driving posture; compares the duration of the driving posture with the real-time distraction The judgment time is compared; when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and a warning is sent to the driver immediately to remind the driver to concentrate on driving. The method for reminding the driver to concentrate on driving provided by the present invention, the determined time for judging mind-wandering is determined based on various factors in the driving process, and the reminder to distracted drivers is more reliable, effectively avoiding traffic accidents caused by drivers not focusing on driving happened. At the same time, the method provided by the present invention also has the characteristics of many application scenarios, simple principle, and easy implementation.

图4示出了本申请的一示例性实施例示出的提醒司机专注驾驶装置400的框图。所述提醒司机专注驾驶装置400包括图像获取模块401、图像处理模块402、时间比较模块403以及走神提醒模块404。所述图像获取模块401用以获取司机驾驶状态图像信息;所述图像处理模块402用以对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;所述时间比较模块403用以将所述驾驶姿态持续时间与实时的走神判断时间进行比较;所述走神提醒模块404用以当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶.Fig. 4 shows a block diagram of an apparatus 400 for reminding a driver to concentrate on driving according to an exemplary embodiment of the present application. The device 400 for reminding the driver to concentrate on driving includes an image acquisition module 401 , an image processing module 402 , a time comparison module 403 and a distraction reminder module 404 . The image acquisition module 401 is used to obtain the image information of the driver's driving state; the image processing module 402 is used to process the image information of the driving state to obtain the duration of the driver's driving posture; the time comparison module 403 is used to convert the The driving posture duration is compared with the real-time mind-wandering judgment time; the mind-wandering reminder module 404 is used to determine that the driver is in a mind-wandering state and immediately report to The driver sends out a warning to remind the driver to focus on driving.

需要说明的是,上述实施例所提供的提醒司机专注驾驶装置400与上述实施例所提供的提醒司机专注驾驶的方法属于同一构思,其中各个模块和单元执行操作的具体方式已经在方法实施例中进行了详细描述,此处不再赘述。上述实施例所提供的提醒司机专注驾驶装置400在实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将系统的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能,本处也不对此进行限制。It should be noted that the device 400 for reminding the driver to concentrate on driving provided in the above-mentioned embodiment and the method for reminding the driver to concentrate on driving provided in the above-mentioned embodiment belong to the same concept. has been described in detail, and will not be repeated here. In the actual application of the device 400 for reminding the driver to focus on driving provided by the above embodiment, the above function allocation can be completed by different functional modules according to the needs, that is, the internal structure of the system is divided into different functional modules to complete all the above descriptions. Or some functions, which are not limited here.

本申请的实施例还提供了一种电子设备,包括:一个或多个处理器;存储装置,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述电子设备实现上述各个实施例中提供的提醒司机专注驾驶的方法。The embodiment of the present application also provides an electronic device, including: one or more processors; a storage device for storing one or more programs, when the one or more programs are processed by the one or more When the device is executed, the electronic device is made to implement the method for reminding the driver to focus on driving provided in the above-mentioned embodiments.

图5示出了适于用来实现本申请实施例的电子设备的计算机系统的结构示意图。需要说明的是,图5示出的电子设备的计算机系统500仅是一个示例,不应对本申请实施例的功能和使用范围带来任何限制。Fig. 5 shows a schematic structural diagram of a computer system suitable for implementing the electronic device of the embodiment of the present application. It should be noted that the computer system 500 of the electronic device shown in FIG. 5 is only an example, and should not limit the functions and scope of use of this embodiment of the present application.

如图5所示,计算机系统500包括中央处理单元(Central Processing Unit,CPU)501,其可以根据存储在只读存储器(Read-Only Memory,ROM)502中的程序或者从储存部分708加载到随机访问存储器(Random Access Memory,RAM)503中的程序而执行各种适当的动作和处理,例如执行上述实施例中所述的方法。在RAM 503中,还存储有系统操作所需的各种程序和数据。CPU 501、ROM 502以及RAM 503通过总线504彼此相连。输入/输出(Input/Output,I/O)接口505也连接至总线504。As shown in FIG. 5, a computer system 500 includes a central processing unit (Central Processing Unit, CPU) 501, which can be stored in a program in a read-only memory (Read-Only Memory, ROM) 502 or loaded from a storage part 708 to a random Various appropriate actions and processes are performed by accessing programs in the memory (Random Access Memory, RAM) 503, for example, performing the methods described in the above-mentioned embodiments. In RAM 503, various programs and data necessary for system operation are also stored. The CPU 501 , ROM 502 , and RAM 503 are connected to each other through a bus 504 . An input/output (Input/Output, I/O) interface 505 is also connected to the bus 504 .

以下部件连接至I/O接口505;括键盘、鼠标等的输入部分506;括诸如阴极射线管(Cathode Ray Tube,CRT)、液晶显示器(Liquid Crystal Display,LCD)等以及扬声器等的输出部分507;括硬盘等的储存部分508以及包括诸如LAN(Local Area Network,局域网)卡、调制解调器等的网络接口卡的通信部分509。通信部分509经由诸如因特网的网络执行通信处理。驱动器510也根据需要连接至I/O接口505。可拆卸介质511,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器510上,以便于从其上读出的计算机程序根据需要被安装入储存部分508。The following components are connected to the I/O interface 505; an input section 506 including a keyboard, a mouse, etc.; an output section 507 including a cathode ray tube (Cathode Ray Tube, CRT), a liquid crystal display (Liquid Crystal Display, LCD) etc., and a speaker a storage section 508 including a hard disk or the like, and a communication section 509 including a network interface card such as a LAN (Local Area Network) card, a modem, or the like. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I/O interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is mounted on the drive 510 as necessary so that a computer program read therefrom is installed into the storage section 508 as necessary.

特别地,根据本申请的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本申请的实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的计算机程序。在这样的实施例中该计算机程序可以通过通信部分509从网络上被下载和安装,和/或从可拆卸介质511被安装。在该计算机程序被中央处理单元(CPU)501执行时,执行本申请的系统中限定的各种功能。In particular, according to the embodiments of the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments of the present application include a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment the computer program may be downloaded and installed from a network via communication portion 509 and/or installed from removable media 511 . When this computer program is executed by a central processing unit (CPU) 501, various functions defined in the system of the present application are performed.

需要说明的是,本申请实施例所示的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是电、磁、光电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(ErasableProgrammable Read Only Memory,EPROM)、闪存、光纤、便携式紧凑磁盘只读存储器(Compact Disc Read-Only Memory,CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本申请中,计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的计算机程序。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的计算机程序可以用任何适当的介质传输,包括但不限于:无线、有线等等,或者上述的任意合适的组合。It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, an electrical, magnetic, opto-electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable Read-Only Memory (Erasable Programmable Read Only Memory, EPROM), flash memory, optical fiber, portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical storage device, magnetic storage device, or any of the above-mentioned suitable combination. In this application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying a computer-readable computer program thereon. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. . A computer program embodied on a computer readable medium can be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

附图中的流程图和框图,图示了按照本申请各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。其中,流程图或框图中的每个方框可以代表一个模块程序段、或代码的一部分,上述模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图或流程图中的每个方框、以及框图或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Wherein, each block in the flowchart or block diagram may represent a module program segment, or a part of code, and the above-mentioned module, program segment, or part of code contains one or more executable instructions for realizing the specified logic function . It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block in the block diagrams or flowchart illustrations, and combinations of blocks in the block diagrams or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a A combination of dedicated hardware and computer instructions.

描述于本申请实施例中所涉及到的单元可以通过软件的方式实现,也可以通过硬件的方式来实现,所描述的单元也可以设置在处理器中。其中,这些单元的名称在某种情况下并不构成对该单元本身的限定。The units described in the embodiments of the present application may be implemented by software or by hardware, and the described units may also be set in a processor. Wherein, the names of these units do not constitute a limitation of the unit itself under certain circumstances.

本申请的另一方面还提供了一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如前所述的触摸屏分屏方法。该计算机可读存储介质可以是上述实施例中描述的电子设备中所包含的,也可以是单独存在,而未装配入该电子设备中。Another aspect of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the touch screen splitting method as described above is implemented. The computer-readable storage medium may be included in the electronic device described in the above embodiments, or may exist independently without being assembled into the electronic device.

Claims (14)

1.一种提醒司机专注驾驶的方法,其特征在于,包括:1. A method for reminding drivers to focus on driving, comprising: 获取司机驾驶状态图像信息;Obtain the image information of the driver's driving state; 对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;Processing the driving state image information to obtain the duration of the driver's driving posture; 将所述驾驶姿态持续时间与实时的走神判断时间进行比较;The duration of the driving posture is compared with the real-time mind-wandering judgment time; 当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶。When the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and a warning is immediately issued to the driver to remind the driver to focus on driving. 2.根据权利要求1所述的提醒司机专注驾驶的方法,其特征在于,所述走神判断时间通过如下方式获得:2. The method for reminding the driver to concentrate on driving according to claim 1, wherein the time for judging mind-wandering is obtained in the following manner: 获取车身周围环境图像信息和车速信息,并将所述车身周围环境图像信息给云端;Obtain the image information of the surrounding environment of the vehicle body and the vehicle speed information, and send the image information of the surrounding environment of the vehicle body to the cloud; 接收所述云端根据所述车身周围环境图像信息解析出的车外因素信息;receiving the external factor information analyzed by the cloud according to the image information of the surrounding environment of the vehicle body; 根据所述车速信息和所述车外因素信息,计算出所述走神判断时间。The mind-wandering judgment time is calculated according to the vehicle speed information and the external factor information. 3.根据权利要求2所述的提醒司机专注驾驶的方法,其特征在于,根据所述车速信息和所述车外因素信息,计算出所述走神判断时间,具体包括:3. The method for reminding the driver to concentrate on driving according to claim 2, characterized in that, according to the vehicle speed information and the external factor information, the time for determining distraction is calculated, specifically comprising: 利用所述车速和车外因素进行综合计算,获得综合系数;Using the speed of the vehicle and factors outside the vehicle to perform comprehensive calculations to obtain a comprehensive coefficient; 将所述综合系数与预设好的综合系数表比对,获得所述走神判断时间。The comprehensive coefficient is compared with the preset comprehensive coefficient table to obtain the mind-wandering judgment time. 4.根据权利要求1所述的提醒司机专注驾驶的方法,其特征在于,所述走神判断时间通过如下方式获得:4. The method for reminding the driver to concentrate on driving according to claim 1, wherein the time for judging mind-wandering is obtained in the following manner: 获取车身周围环境图像信息和车速信息,并将所述车身周围环境图像信息和所述车速信息给云端;Obtaining the image information of the surrounding environment of the vehicle body and the vehicle speed information, and sending the image information of the surrounding environment of the vehicle body and the vehicle speed information to the cloud; 接收所述云端根据所述车身周围环境图像信息和车速信息处理后得到的所述走神判断时间。receiving the mind-wandering judging time obtained by the cloud according to the image information of the surrounding environment of the vehicle body and the vehicle speed information; 5.根据权利要求4所述的提醒司机专注驾驶的方法,其特征在于,所述云端根据所述车身周围环境图像信息和车速信息处理后得到的所述走神判断时间,具体包括:5. The method for reminding the driver to concentrate on driving according to claim 4, wherein the time for judging distraction obtained by the cloud according to the image information of the surrounding environment of the vehicle body and the vehicle speed information after processing, specifically includes: 根据所述车身周围环境图像信息,解析出车外因素信息;According to the image information of the surrounding environment of the vehicle body, the information of factors outside the vehicle is analyzed; 根据所述车外因素信息和车速信息,计算出所述走神判断时间。The mind-wandering judgment time is calculated according to the external factor information and the vehicle speed information. 6.根据权利要求2或5所述的提醒司机专注驾驶的方法,其特征在于,所述车外因素信息包括天气、道路状况以及车流量。6. The method for reminding the driver to concentrate on driving according to claim 2 or 5, wherein the information on factors outside the vehicle includes weather, road conditions and traffic flow. 7.根据权利要求1所述的提醒司机专注驾驶的方法,其特征在于,所述提醒司机专注驾驶的方法还包括:7. The method for reminding the driver to concentrate on driving according to claim 1, wherein the method for reminding the driver to concentrate on driving further comprises: 根据所述驾驶状态图像信息来判定所述司机的眼睛处于闭合的时间是否超过预设时间;determining whether the driver's eyes are closed for more than a preset time according to the driving state image information; 当所述司机的眼睛处于闭合的时间超过预设时间时,立即触发警报。When the driver's eyes are closed for more than a preset time, an alarm is triggered immediately. 8.根据权利要求1所述的提醒司机专注驾驶的方法,其特征在于,当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶,具体包括:8. The method for reminding the driver to focus on driving according to claim 1, wherein, when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and an alarm is issued to the driver immediately. Alerts to remind drivers to focus on driving, including: 向震动器输出第一震动信号使所述震动器产生一级震动,以提醒司机专注驾驶。Outputting the first vibration signal to the vibrator causes the vibrator to generate a first-level vibration to remind the driver to concentrate on driving. 9.根据权利要求8所述的提醒司机专注驾驶的方法,其特征在于,当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶,还包括:9. The method for reminding the driver to concentrate on driving according to claim 8, wherein, when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time, it is determined that the driver is in a mind-wandering state and an alarm is issued to the driver immediately. Alerts, to remind drivers to focus on driving, also include: 继续获取司机驾驶状态图像信息,并进行司机走神状态判定;Continue to obtain the image information of the driver's driving state, and judge the state of the driver's distraction; 如果判定司机仍处于走神状态,则向所述震动器输出第二震动信号一使震动器产生比所述一级震动强度更大的震动。If it is determined that the driver is still distracted, then output a second vibration signal to the vibrator to make the vibrator produce a vibration with a greater intensity than the first level of vibration. 10.根据权利要求1所述的提醒司机专注驾驶的方法,其特征在于,获取司机驾驶状态图像信息,具体包括:10. The method for reminding a driver to concentrate on driving according to claim 1, wherein obtaining image information of the driver's driving state specifically includes: 通过设置在车身的摄像头和/或红外装置来获得所述司机驾驶状态图像信息。The image information of the driver's driving state is obtained through a camera and/or an infrared device arranged on the vehicle body. 11.根据权利要求2或4所述的提醒司机专注驾驶的方法,其特征在于,获取所述车身周围图像信息,具体包括:11. The method for reminding the driver to focus on driving according to claim 2 or 4, wherein acquiring image information around the vehicle body specifically includes: 利用设置在车身的全息影像来获得所述车身周围图像信息。The image information around the vehicle body is obtained by using the holographic image set on the vehicle body. 12.一种提醒司机专注驾驶的装置,其特征在于,包括:12. A device for reminding drivers to focus on driving, characterized in that it comprises: 图像获取模块,用以获取司机驾驶状态图像信息;The image acquisition module is used to acquire the image information of the driver's driving state; 图像处理模块,用以对所述驾驶状态图像信息进行处理,获得司机驾驶姿态持续时间;An image processing module, configured to process the driving state image information to obtain the duration of the driver's driving posture; 时间比较模块,用以将所述驾驶姿态持续时间与实时的走神判断时间进行比较;Time comparison module, in order to compare described driving posture duration with real-time mind-wandering judgment time; 走神提醒模块,用以当所述驾驶姿态持续时间大于或等于所述实时的走神判断时间时,则判定司机处于走神状态并立即向司机发出警示,以提醒司机专注驾驶。A mind-wandering reminder module is used to determine that the driver is in a state of mind-wandering when the duration of the driving posture is greater than or equal to the real-time mind-wandering judgment time and to immediately issue a warning to the driver to remind the driver to focus on driving. 13.一种电子设备,其特征在于,包括:13. An electronic device, characterized in that it comprises: 一个或多个处理器;one or more processors; 存储装置,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述电子设备实现如权利要求1至11中任一项所述的方法。A storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the electronic device realizes any one of claims 1 to 11 Methods. 14.一种计算机可读存储介质,其特征在于,其上存储有计算机可读指令,当所述计算机可读指令被计算机的处理器执行时,使计算机执行权利要求1至11中任一项所述的方法。14. A computer-readable storage medium, characterized in that computer-readable instructions are stored thereon, and when the computer-readable instructions are executed by a processor of a computer, the computer is made to perform any one of claims 1 to 11 the method described.
CN202211543535.4A 2022-11-30 2022-11-30 Method, device, equipment and storage medium for reminding driver of focusing on driving Pending CN115871678A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211543535.4A CN115871678A (en) 2022-11-30 2022-11-30 Method, device, equipment and storage medium for reminding driver of focusing on driving

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211543535.4A CN115871678A (en) 2022-11-30 2022-11-30 Method, device, equipment and storage medium for reminding driver of focusing on driving

Publications (1)

Publication Number Publication Date
CN115871678A true CN115871678A (en) 2023-03-31

Family

ID=85765740

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211543535.4A Pending CN115871678A (en) 2022-11-30 2022-11-30 Method, device, equipment and storage medium for reminding driver of focusing on driving

Country Status (1)

Country Link
CN (1) CN115871678A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160055764A1 (en) * 2013-05-03 2016-02-25 Jyväskyän Yliopisto Method, device and computer program product for managing driver safety, method for managing user safety and method for defining a route
CN110390285A (en) * 2019-07-16 2019-10-29 广州小鹏汽车科技有限公司 System for distraction of driver detection method, system and vehicle
CN112863146A (en) * 2021-01-05 2021-05-28 重庆长安汽车股份有限公司 Method for reminding driver of distraction during navigation of high-speed exit
CN114132330A (en) * 2021-12-17 2022-03-04 奇瑞新能源汽车股份有限公司 Method and device for reminding driver of abnormal driving state
CN114821968A (en) * 2022-05-09 2022-07-29 西南交通大学 Intervention method, device, device and readable storage medium for motor vehicle driver fatigue driving

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160055764A1 (en) * 2013-05-03 2016-02-25 Jyväskyän Yliopisto Method, device and computer program product for managing driver safety, method for managing user safety and method for defining a route
CN110390285A (en) * 2019-07-16 2019-10-29 广州小鹏汽车科技有限公司 System for distraction of driver detection method, system and vehicle
CN112863146A (en) * 2021-01-05 2021-05-28 重庆长安汽车股份有限公司 Method for reminding driver of distraction during navigation of high-speed exit
CN114132330A (en) * 2021-12-17 2022-03-04 奇瑞新能源汽车股份有限公司 Method and device for reminding driver of abnormal driving state
CN114821968A (en) * 2022-05-09 2022-07-29 西南交通大学 Intervention method, device, device and readable storage medium for motor vehicle driver fatigue driving

Similar Documents

Publication Publication Date Title
CN111652060B (en) A height limit warning method, device, electronic device and storage medium based on laser radar
US8976040B2 (en) Intelligent driver assist system based on multimodal sensor fusion
CN103723096B (en) With the drive assist system of radio communication function
CN102541061A (en) Micro intelligent vehicle based on visual and auditory information
CN111186379B (en) Automobile blind area dangerous object alarm method based on deep learning
WO2021227520A1 (en) Visual interface display method and apparatus, electronic device, and storage medium
CN106373218A (en) Cell phone automobile data recorder with line pressing alarm function
CN112896159A (en) Driving safety early warning method and system
CN103692974B (en) A kind of vehicle driving safety method for early warning based on environmental monitoring and system
CN112485784B (en) Method, device, electronic device and storage medium for determining the risk factor of a target in an inner wheel difference area
CN114387821A (en) Vehicle collision early warning method and device, electronic equipment and storage medium
CN115187963A (en) Vehicle obstacle detection method, system, equipment, medium and program
CN115402322B (en) A method, system, electronic device and storage medium for assisting driving at an intersection
CN204667643U (en) A kind of early warning system for bend vehicle meeting early warning
CN107370985A (en) Pedestrian's dynamic display method and system
CN116778748A (en) Intelligent early warning method for vehicle turning blind spots based on deep learning
CN115643550A (en) AR-based vehicle driving assistance method, device, device and readable storage medium
CN113962107A (en) Method and device for simulating driving road section, electronic equipment and storage medium
CN117274941A (en) Occupancy grid prediction method and device, intelligent equipment and storage medium
Li et al. Driving behavior of L3 autonomous vehicle drivers in fog zones under different traffic flow conditions
CN120003522A (en) A vehicle driving assistance method
CN115871678A (en) Method, device, equipment and storage medium for reminding driver of focusing on driving
CN117576531A (en) Heavy vehicle blind spot risk early warning methods, devices, electronic equipment and storage media
CN107170245A (en) Load-carrying motor vehicle superelevation siren
CN117261841A (en) Intelligent auxiliary braking method for road driving skill examination based on environment awareness

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination