CN110723145A - Vehicle control method and device, computer-readable storage medium and wearable device - Google Patents

Abstract

The application belongs to the technical field of vehicle control, and particularly relates to a vehicle control method and device, a computer-readable storage medium and wearable equipment. The method can be applied to wearable equipment, the wearable equipment is in communication connection with a vehicle-mounted computer system of a specified vehicle, the wearable equipment firstly acquires physiological parameters of a target user, then determines the physiological state of the target user according to the physiological parameters, and issues a control instruction corresponding to the physiological state to the vehicle-mounted computer system. According to the invention, the sensor integration and fusion processing work is transferred to the wearable equipment, and the wearable equipment can correspondingly control the vehicle, so that the burden of a vehicle-machine computer system is effectively reduced. Moreover, the wearable device can be updated relatively conveniently, the existing hardware defects of the automobile can be made up by means of upgrading and updating of the wearable device, and function updating is achieved under the condition that automobile hardware does not need to be changed.

Description

Vehicle control method, device, computer-readable storage medium, and wearable device

technical field

The present application belongs to the technical field of vehicle control, and in particular, relates to a vehicle control method, a device, a computer-readable storage medium, and a wearable device.

Background technique

In the prior art, the vehicle-mounted computer system is generally solely relied on to control the vehicle. Such a solidified vehicle-mounted computer system is difficult to meet the needs of more and more sensor integration and fusion processing. When new functions are required, the processor and other accessories of the car often need to be replaced, and this hardware upgrade brings great inconvenience to car users.

SUMMARY OF THE INVENTION

In view of this, embodiments of the present application provide a vehicle control method, device, computer-readable storage medium, and wearable device, so as to solve the problem that the existing vehicle-machine computer system is difficult to adapt to more and more sensor integration and fusion processing. demand, and hardware upgrades bring great inconvenience to car users.

A first aspect of the embodiments of the present application provides a vehicle control method, which is applied to a wearable device, where the wearable device establishes a communication connection with an on-board computer system of a designated vehicle, and the vehicle control method includes:

collecting physiological parameters of a target user, where the target user is a user wearing the wearable device;

Determine the physiological state of the target user according to the physiological parameter;

A control instruction corresponding to the physiological state is issued to the on-board computer system.

Further, the physiological parameters include a first physiological parameter and a second physiological parameter, and the collection of the physiological parameters of the target user includes:

Collect the first physiological parameter of the target user through the sensor in the wearable device;

The second physiological parameter of the target user is collected by on-board sensors of the designated vehicle.

Further, before determining the physiological state of the target user according to the physiological parameter, the method further includes:

obtaining the historical physiological parameters of the target user;

The physiological parameters are calibrated and calculated according to the historical physiological parameters to obtain calibrated physiological parameters.

Further, the determining the physiological state of the target user according to the physiological parameter includes:

using a preset deep neural network model to process the physiological parameters to obtain output values corresponding to the physiological parameters;

The physiological state of the target user is determined according to the output value.

Further, the sending of control instructions corresponding to the physiological state to the vehicle computer system includes:

If the physiological state is the fatigue state, selecting a control instruction with the highest priority from the preset control instruction set as the preferred control instruction;

The preferred control instruction is issued to the vehicle computer system.

Further, after the preferred control instruction is issued to the vehicle computer system, it also includes:

Obtain the changes in the physiological state of the target user;

The priority of the preferred control instruction is adjusted according to the change.

Further, the control command includes a first control command, a second control command, a third control command and/or a fourth control command, and the first control command is used to control the on-board audio and video system of the designated vehicle to react, The second control instruction is used to control the steering wheel of the designated vehicle to vibrate, the third control instruction is used to control the on-board air conditioner of the designated vehicle to perform temperature adjustment, and the fourth control instruction is used to control the designated vehicle. The vehicle decelerates or brakes.

A second aspect of the embodiments of the present application provides a vehicle control device, which is applied to a wearable device. The wearable device establishes a communication connection with an on-board computer system of a designated vehicle. The vehicle control device may include:

a physiological parameter collection module, configured to collect physiological parameters of a target user, where the target user is a user wearing the wearable device;

a physiological state determination module, configured to determine the physiological state of the target user according to the physiological parameter;

A control instruction issuing module is used to issue a control instruction corresponding to the physiological state to the on-board computer system.

Further, the physiological parameters include a first physiological parameter and a second physiological parameter, and the physiological parameter acquisition module may include:

a first collection unit, configured to collect the first physiological parameter of the target user through a sensor in the wearable device;

The second collection unit is configured to collect the second physiological parameter of the target user through the vehicle-mounted sensor of the designated vehicle.

Further, the vehicle control device may also include:

a historical physiological parameter acquisition module for acquiring the historical physiological parameters of the target user;

A physiological parameter calibration module, configured to perform calibration calculation on the physiological parameters according to the historical physiological parameters to obtain calibrated physiological parameters.

Further, the physiological state determination module may include:

a model processing unit, configured to process the physiological parameters by using a preset deep neural network model to obtain output values corresponding to the physiological parameters;

A physiological state determination unit, configured to determine the physiological state of the target user according to the output value.

Further, the control instruction issuing module may include:

A preferred control instruction selection unit, configured to select a control instruction with the highest priority from a preset control instruction set as the preferred control instruction if the physiological state is a fatigue state;

The preferred control instruction issuing unit is configured to issue the preferred control instruction to the vehicle computer system.

Further, the vehicle control device may also include:

a state change acquisition module, used for acquiring the changes in the physiological state of the target user;

A priority adjustment module, configured to adjust the priority of the preferred control instruction according to the change.

Further, the control command includes a first control command, a second control command, a third control command and/or a fourth control command, and the first control command is used to control the on-board audio and video system of the designated vehicle to react, The second control instruction is used to control the steering wheel of the designated vehicle to vibrate, the third control instruction is used to control the on-board air conditioner of the designated vehicle to perform temperature adjustment, and the fourth control instruction is used to control the designated vehicle. The vehicle decelerates or brakes.

A third aspect of the embodiments of the present application provides a computer-readable storage medium, where computer-readable instructions are stored in the computer-readable storage medium, and when the computer-readable instructions are executed by a processor, any one of the preceding vehicle controls is implemented steps of the method.

A fourth aspect of the embodiments of the present application provides a wearable device, including a memory, a processor, and computer-readable instructions stored in the memory and executable on the processor, the processor executing the Computer readable instructions implement the steps of any of the above vehicle control methods.

A fifth aspect of the embodiments of the present application provides a computer program product, which, when the computer program product runs on the wearable device, causes the wearable device to execute the steps of any of the foregoing vehicle control methods.

The beneficial effects of the embodiments of the present application compared with the prior art are: the vehicle control method provided by the embodiments of the present application can be applied to a wearable device, and the wearable device establishes a communication connection with the on-board computer system of a designated vehicle, The wearable device first collects the physiological parameters of the target user, then determines the physiological state of the target user according to the physiological parameters, and issues a control instruction corresponding to the physiological state to the vehicle computer system. Through the embodiments of the present invention, the work of sensor integration and fusion processing is transferred to the wearable device, and the wearable device can automatically control the vehicle according to the collected physiological parameters, effectively reducing the burden of the vehicle computer system. Moreover, since the wearable device can be updated relatively easily, the existing hardware defects of the car can be compensated for by the upgrade of the wearable device, and the function of the car can be updated without changing the hardware system of the car.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only for the present application. In some embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

FIG. 1 is a flowchart of an embodiment of a vehicle control method in an embodiment of the application;

2 is a schematic diagram of a deep neural network used in an embodiment of the application;

3 is a structural diagram of an embodiment of a vehicle control device in an embodiment of the application;

FIG. 4 is a schematic block diagram of a wearable device in an embodiment of the present application.

FIG. 5 is a schematic diagram of vehicle control through a wearable device.

FIG. 6 is a schematic block diagram of another wearable device in an embodiment of the present application.

Detailed ways

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are set forth in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It is to be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described feature, integer, step, operation, element and/or component, but does not exclude one or more other The presence or addition of features, integers, steps, operations, elements, components and/or sets thereof.

It will also be understood that, as used in this specification and the appended claims, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items.

As used in the specification of this application and the appended claims, the term "if" may be contextually interpreted as "when" or "once" or "in response to determining" or "in response to detecting ". Similarly, the phrases "if it is determined" or "if the [described condition or event] is detected" may be interpreted, depending on the context, to mean "once it is determined" or "in response to the determination" or "once the [described condition or event] is detected. ]" or "in response to detection of the [described condition or event]".

In addition, in the description of the specification of the present application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and should not be construed as indicating or implying relative importance.

References in this specification to "one embodiment" or "some embodiments" and the like mean that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically emphasized otherwise. The terms "including", "including", "having" and their variants mean "including but not limited to" unless specifically emphasized otherwise.

The vehicle control method provided in the embodiment of the present application can be applied to a wearable device, where the wearable device is a portable device that is directly worn on the user's body or integrated into the user's clothes or accessories. Wearable device is not only a hardware device, but also can achieve powerful functions through software support and data interaction. The wearable devices may include, but are not limited to, smart glasses, smart watches, smart wristbands, smart clothing, and other devices capable of collecting physiological parameters of the user.

The wearable device establishes a communication connection with the on-board computer system of the designated vehicle. In view of the complexity of the on-board computer system and the long-term periodicity of upgrading, the curing of the existing on-board computer system is difficult to adapt to the needs of more and more sensor integration and fusion processing. In this embodiment, some on-board computer systems are used. The data processing part, especially the sensor fusion processing system part, is transferred to an external wearable device, which can greatly reduce the pressure on the computer system of the vehicle, and make the smart technology accessible by breaking through the Internet of Things obstacles at the hardware, software and transmission protocol levels. Unobstructed interconnection and two-way control between the wearable device and the computer system and screen of the car machine, so as to realize the full Internet of Things mode of in-vehicle application scenarios, and improve driving comfort and safety. In terms of the comfort of the driving experience, the temperature of the smart cabin air conditioner, seat position and temperature, sunroof settings (such as light transmittance, etc.), car navigation and audio-visual entertainment systems can be individually adjusted in real time by detecting the physiological parameters of the driver and passengers. ;In terms of safety, through the interconnection between the computer system of the vehicle and the wearable device, the unlocking function of the wearable device to the vehicle, that is, the function of the car key, is realized through the real-time perception and prediction of the fatigue state of the wearable device. Control functions of the computer system, such as steering wheel vibration reminders and emergency deceleration/braking of the vehicle in dangerous driving conditions. While reducing the processing pressure of the on-board computer system, it improves the functional scalability and continuous upgrade capability of the on-board computer system, so as to improve the needs of the Internet of Everything and the ultimate user experience in the 5G era and even the era of autonomous driving through the continuous optimization and upgrading of wearable devices.

Referring to FIG. 1, an embodiment of a vehicle control method in the embodiment of the present application may include:

Step S101, collecting the physiological parameters of the target user.

The target user is a user wearing the wearable device, and in general, the target user is a driver and passenger of the designated vehicle.

The physiological parameters can be divided into two categories according to the different collection sources, wherein the first category is to collect the physiological parameters of the target user through the sensors in the wearable device, which are called first physiological parameters, and the second category is to collect the physiological parameters of the target user through sensors in the wearable device. The class is to collect the physiological parameters of the target user through the on-board sensors of the designated vehicle, which are referred to as second physiological parameters.

Due to its miniaturization and diversification, various sensors can easily integrate various sensor functions in wearable devices, including but not limited to pressure sensors, heart rate sensors, blood pressure sensors, blood oxygen sensors, respiration sensors, heartbeat sensors, electrocardiogram (ECG) sensors. ) sensor, three-way acceleration sensor, temperature sensor, etc. Through these sensors, physiological parameters such as the user's heart rate, respiration (such as respiration rate, breathing depth), blood pressure, body temperature, epidermal conductivity, and glucose amount can be collected to provide users with real-time physiological parameter reference to achieve the purpose of health monitoring. In the era of intelligent driving, various on-board sensors will also be set in the application scenarios of the car. For example, the on-board image sensor can be set in the car to collect the images in the car in real time, and obtain the user's facial expressions, blinking frequency, yawning, etc. Physiological parameters such as frequency.

It should be noted that the physiological parameters in step S101 are all physiological parameters collected in real time at the current moment. However, the physiological parameters collected in real time are easily affected by various sudden reasons, resulting in large fluctuations. Therefore, in another specific implementation of this embodiment, the historical physiological parameters of the target user are preferably obtained, and the physiological parameters are calibrated and calculated according to the historical physiological parameters to obtain calibrated physiological parameters.

The historical physiological parameters refer to the physiological parameters collected by the wearable device within a preset historical monitoring time period, that is, this is a long-term information record. The historical monitoring time period may include both the period of driving the car and the period of not driving the car, and the historical monitoring time period can be set according to the actual situation, for example, it can be set to be within one day, two days from the current moment. A time period within a day, within a week, within two weeks, or within a month. Generally, a periodic physiological parameter combination may be formed according to the historical physiological parameters, and the periodic physiological parameter combination may include historical physiological parameters at different time points. When the physiological parameters collected in step S101 need to be calibrated, historical physiological parameters at corresponding time points may be selected from the periodic physiological parameter combination according to the collection time point of the physiological parameters, and a weighted average of the two may be performed. , so as to obtain the calibrated physiological parameters.

In this way, not only the real-time physiological parameters are considered, but the user's physiological parameters are directly obtained for real-time analysis, and the user's historical physiological parameters can also be considered, because the historical physiological parameters cover a long time, the number of samples is more, and the consideration Different time periods, or the impact on physiological parameters under different physical activities, can understand the physiological state of the user at different times, such as the user may be habitually tired at a certain time, etc. Combined with real-time physiological parameters, more accurate and objective results can be made. analyze. This approach facilitates monitoring personalization, which can eliminate numerical errors due to individual user physique differences and physiological cycle changes.

It should be noted that the physiological parameters mentioned in the following content may be either directly collected physiological parameters or calibrated physiological parameters.

Step S102: Determine the physiological state of the target user according to the physiological parameter.

In this embodiment, a preset deep neural network (Deep Neural Network, DNN) model may be used to process the physiological parameters to obtain output values corresponding to the physiological parameters.

As shown in FIG. 2, the deep neural network may include an input layer, multiple hidden layers and an output layer. The input layer is used to receive input data from the outside, including several input layer nodes, the hidden layer is used to process the data, including several hidden layer nodes, and the output layer is used to output processing results, including Several output layer nodes.

The input layer nodes are in one-to-one correspondence with the physiological parameters. For example, if a total of 3 physiological parameters are collected, namely physiological parameter 1, physiological parameter 2 and physiological parameter 3, then the number of corresponding input layer nodes should also be 3, namely input layer node 1, input layer node 2 and the input layer node 3, wherein the input layer node 1 corresponds to the physiological parameter 1, the input layer node 2 corresponds to the physiological parameter 2, and the input layer node 3 corresponds to the physiological parameter 3.

The hidden layer nodes respectively use the fuzzy Gaussian membership function to process the input layer node data to obtain the hidden layer node data.

In this embodiment, the hidden layer node data can be obtained by the following calculation formula:

in:

i is the label of the input layer node, its value range is [1, n], n is the number of input layer nodes;

j is the label of the hidden layer node, its value range is [1, h], h is the number of hidden layer nodes;

Φ _j (x) is the hidden layer node data of the jth hidden layer node;

G _ij (x _i ) is the ith fuzzy Gaussian membership function of the jth hidden layer node;

x is the input layer node data, and x _i is the input layer node data of the i-th input layer node;

μ _ij is the mathematical expectation of the ith fuzzy Gaussian membership function of the jth hidden layer node;

σ _ij is the standard deviation of the ith fuzzy Gaussian membership function of the jth hidden layer node.

Preferably, the data of the hidden layer nodes can also be normalized to reduce the difference of the data of the hidden layer nodes. Specifically, the maximum value and the minimum value in the data of the hidden layer nodes can be obtained. , and then normalize the hidden layer node data according to the maximum value and the minimum value to obtain normalized hidden layer node data.

For example, the hidden layer node data can be normalized by the following formula:

in:

Ψ _j (x) is the normalized hidden layer node data of the jth hidden layer node;

Φ _max (x) is the maximum value in Φ _j (x);

Φ _min (x) is the minimum value in Φ _j (x).

Finally, the output value can be obtained by performing weighted summation on the data of the hidden layer nodes respectively by using the preset weights.

For the unnormalized hidden layer node data, the calculation formula of the output value can be:

For the normalized hidden layer node data, the calculation formula of the output value can be:

in:

ω _j is the weight corresponding to the hidden layer node data of the jth hidden layer node;

R(x) is the node data of the output layer, that is, the output value.

After the output value is obtained, the physiological state of the target user can be determined according to the output value. In this embodiment, output value intervals corresponding to various physiological states may be preset, and after the output value is obtained, it is determined to which output value interval the output value belongs to which physiological state corresponds, and the output value to which the output value belongs is determined. The physiological state corresponding to the output value interval is determined as the physiological state of the target user. For example, the range of the output value can be calibrated to be 1 to 100, and the output value can be a fatigue degree value. The higher the output value, the more fatigued the target user is. If the output value is greater than the preset threshold, Then, it can be determined that the physiological state of the target user is a fatigued state. On the contrary, if the output value is less than or equal to the threshold value, it can be determined that the physiological state of the target user is an awake state. The threshold can be set according to actual conditions, for example, it can be set to 60, 70, 80 or other values, which are not specifically limited here.

Step S103, sending a control instruction corresponding to the physiological state to the vehicle computer system.

Specifically, if the physiological state is a fatigue state, a control command with the highest priority may be selected from a preset control command set as a preferred control command, and the preferred control command is issued to the vehicle computer system .

The control instructions may include but are not limited to the first control instructions, the second control instructions, the third control instructions and/or the fourth control instructions, and the first control instructions are used to control the in-vehicle audio and video system of the designated vehicle to respond. , the second control instruction is used to control the steering wheel of the designated vehicle to vibrate, the third control instruction is used to control the on-board air conditioner of the designated vehicle to perform temperature adjustment, and the fourth control instruction is used to control the Designate the vehicle to decelerate or brake, and the priority of each control command can be preset according to the actual situation. That is, for different passengers and drivers, it can be turned on or off based on the reminder music/voice of the in-vehicle audio and video system, the steering wheel vibrates periodically/aperiodically, and the cockpit air conditioner temperature is adjusted to the lowest/highest to achieve the reminder function, and even for the driver's health prediction Provides emergency deceleration/braking to improve driving safety on medium and long-distance journeys.

Further, the physiological state can be divided into: awake state, fatigue state, and dangerous driving state. In this case, the output value is still in the range of 1 to 100, but two thresholds can be set, one higher and one lower, the two thresholds are between 1 and 100, and the output value below the lower threshold is awake If the output value is between the two thresholds, it is a fatigue state, and if the output value is between the two thresholds, it is a dangerous driving state. Commands in dangerous driving situations include automatic deceleration/braking. The commands in the fatigue state include the first control command, the second control command, and the third control command, and the control commands appearing in the fatigue state may also appear/maintain in the dangerous driving state.

Further, after the preferred control instruction is issued to the vehicle computer system, the change of the target user's physiological state can also be acquired, and the priority of the preferred control instruction can be adjusted according to the change. Adjustment.

After the on-board computer system responds, the wearable device collects new physiological parameters within a predetermined period of time, and learns from the newly collected physiological parameters the change of the physiological state after the execution of the control instruction, and the change can be expressed in the form of physiological parameters. Changes in status values represent. For example, if the fatigue value decreases after the control command is executed, it means that the relevant reaction has a certain degree of effectiveness in improving the fatigue state. Then, the weight of the control instruction can be adjusted according to the effectiveness of the execution of the relevant control instruction. The weight affects the priority and frequency of selecting control instructions. In this way, control commands that are too ineffective may not be used for the next operation. The user can turn the feature on or off through the wearable device for this reactive action orchestrated by the system's artificial intelligence.

Further, in addition to the weight affecting the priority, the selection of the priority of the control command may also consider the use record of the control command, and the use record includes the last use time and frequency of use of the individual control command. The longer the control command has been used last, or the lower the frequency of use, the higher the priority of the control command. At the same time, the effect weight and time factors are considered to effectively improve the overall effect, maintain the diversification of control instructions, and conform to the law of the driver's response to external stimuli.

Further, a control instruction itself also has further classification and grading. The control command is in a certain category or level setting after the preset/or feedback adjustment, and after output, the category or level setting at the next output is changed according to the degree of effectiveness. One control command is steering wheel vibration, and the intensity of steering wheel vibration can be divided into different intensity levels. The intensity of the next vibration can be changed according to the effectiveness of the currently set intensity. For example, when the effectiveness of the strength is lower than a certain degree of effectiveness, the strength of the next shock will be increased. Other kinds of control commands can also be graded, such as air conditioning temperature and audio and video volume. There are other types of control commands that are classified into categories, such as the music played by the audio-visual system, which has different tracks/sound effects. Therefore, according to the effectiveness of the currently set track/sound effect, it can be decided whether to replace the next-played track/sound effect. Specifically, the next output after the level/category of the control command is changed may be the output that is not changed immediately after the same control command. This allows for instant level/category adjustments to the driver's response. In some cases, the change of the control command level/category made by the on-board computer system for the same type may be temporary, and the original level setting will be restored immediately after the output of the changed level/category is completed, or the level setting of the control command may be changed. After a certain period of time, return to the original level setting.

To sum up, the wearable device first collects the physiological parameters of the target user, then determines the physiological state of the target user according to the physiological parameters, and sends the information corresponding to the physiological state to the vehicle computer system. Control instruction. Through the embodiments of the present invention, the work of sensor integration and fusion processing is transferred to the wearable device, and the wearable device can automatically control the vehicle according to the collected physiological parameters, effectively reducing the burden of the vehicle computer system. Moreover, since the wearable device can be updated relatively conveniently, the existing hardware defects of the car can be compensated for by the upgrade of the wearable device, and the function update can be realized without changing the car hardware.

It should be understood that the size of the sequence numbers of the steps in the above embodiments does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Corresponding to a vehicle control method described in the above embodiment, FIG. 3 shows an embodiment structure diagram of a vehicle control apparatus provided by an embodiment of the present application.

In this embodiment, the vehicle control apparatus is applied to the wearable device, and the vehicle control apparatus may include:

A physiological parameter collection module 301, configured to collect physiological parameters of a target user, where the target user is a user wearing the wearable device;

a physiological state determination module 302, configured to determine the physiological state of the target user according to the physiological parameter;

A control instruction issuing module 303 is configured to issue a control instruction corresponding to the physiological state to the vehicle computer system.

Further, the physiological parameters include a first physiological parameter and a second physiological parameter, and the physiological parameter acquisition module may include:

a first collection unit, configured to collect the first physiological parameter of the target user through a sensor in the wearable device;

The second collection unit is configured to collect the second physiological parameter of the target user through the vehicle-mounted sensor of the designated vehicle.

Further, the vehicle control device may also include:

a historical physiological parameter acquisition module for acquiring the historical physiological parameters of the target user;

A physiological parameter calibration module, configured to perform calibration calculation on the physiological parameters according to the historical physiological parameters to obtain calibrated physiological parameters.

Further, the physiological state determination module may include:

a model processing unit, configured to process the physiological parameters by using a preset deep neural network model to obtain output values corresponding to the physiological parameters;

A physiological state determination unit, configured to determine the physiological state of the target user according to the output value.

Further, the control instruction issuing module may include:

A preferred control instruction selection unit, configured to select a control instruction with the highest priority from a preset control instruction set as the preferred control instruction if the physiological state is a fatigue state;

The preferred control instruction issuing unit is configured to issue the preferred control instruction to the vehicle computer system.

Further, the vehicle control device may also include:

a state change acquisition module, used for acquiring the changes in the physiological state of the target user;

A priority adjustment module, configured to adjust the priority of the preferred control instruction according to the change.

Further, the control command includes a first control command, a second control command, a third control command and/or a fourth control command, and the first control command is used to control the on-board audio and video system of the designated vehicle to react, The second control instruction is used to control the steering wheel of the designated vehicle to vibrate, the third control instruction is used to control the on-board air conditioner of the designated vehicle to perform temperature adjustment, and the fourth control instruction is used to control the designated vehicle. The vehicle decelerates or brakes.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described devices, modules and units can be referred to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

FIG. 4 shows a schematic block diagram of a wearable device provided by an embodiment of the present application. For convenience of description, only parts related to the embodiment of the present application are shown.

As shown in FIG. 4 , the wearable device 4 may include a sensing module 41 , a storage module 42 , a communication module 43 , a control module 44 , an input interface 45 and an output interface 46 .

The sensing module 41 is used for receiving data collected by various sensors, and storing the data in the storage module 42 .

The storage module 42 is used to store the fusion signals from sensors and on-board computer systems, including real-time signals and historical data, including but not limited to sensor data, personal physiological index information, various personalized seat position settings, and user fingerprints. Identification-type safety information is used for driver and passenger identification, personal preference settings for audio and/or navigation, etc.

The communication module 43 is used for the real-time connection between the control module inside the wearable device and the vehicle computer system to send and receive sensing signals and execution signals in both directions. The communication module may include a wireless communication interface, for example, through Bluetooth. ), Ultra Wide Band (UWB), Zigbee (Zigbee) and Wi-Fi to communicate with the vehicle computer system. The wearable device uses the vehicle information obtained from the communication module to generate vehicle control signals. In order to achieve this purpose, low-latency, high-reliability, high-bandwidth, and more secure communication network transmission technologies are required. In this embodiment, the 5G network communication technology based on the third-generation semiconductor radio frequency and power device technology is preferred to achieve this. .

The control module 44 collects the fusion signals from the sensors of the wearable device and the vehicle computer system, performs signal calculation and processing together, performs real-time correction in combination with the instructions of the vehicle computer system, and issues control signals in a timely manner.

The input interface 45 represents the human-computer interaction interface between the wearable device and the user, and provides a remote control interface of the vehicle computer system, which can be a screen plus a control hard button/soft button or a touch input device. Perform routine operations on wearable electronic devices. The user can also set the monitoring system through the input interface, including the image interface, such as the operation interface of the wearable device, and can also display various physiological state values and related warnings. The input interface 45 mainly includes real-time information of various sensors connected to the vehicle computer system and real-time information of vehicle status. The output interface 46 represents the machine-machine interaction interface between the wearable device and the vehicle computer system, including selecting the response operation of the vehicle computer system, the intensity of the operation and other settings, and providing real-time communication between the vehicle computer system and the vehicle computer system through the communication module. After the algorithm is integrated and calculated, it provides a remote control interface for controlling vehicle reminders in response to the real-time fatigue state of the driver or passenger, mainly including real-time updated information on the fatigue state of the driver and passengers and vehicle reminder control suggestions. The interface design of the input interface 45 and the output interface 46 can be developed based on the Microsoft Azure Sphere platform using Visual Studio series development tools, thereby ensuring that the electronic control units (Electronic Control Unit, ECU) of multiple sensor terminals and vehicle computer systems are guaranteed. ) to form a closed artificial intelligence and Internet of Things (Artificial Intelligence & Internet of Things, AIoT) system security and effectiveness.

The wearable electronic device may also include a vibration module. When the control module sends an instruction to the vehicle computer system, the control module controls the vibration module to generate vibration, which is also used as another warning/prompt to the user. .

The wearable electronic device is combined with the on-board computer system to jointly play the role of sensing and feedback. For example, sending a control command to the vehicle computer system by the control module according to the processing result will cause the steering wheel to vibrate, allowing the user holding the steering wheel to perceive the relevant feedback. At the same time, issuing an instruction to the vibration module also causes the wearable electronic device to vibrate, so that the user wearing the wearable electronic device can perceive relevant feedback. The vibration feedback on both sides occurs at the same time, enhancing the strength and comprehensiveness of the feedback. In this scenario, the on-board computer system and the wearable electronic device both have sensory data input, and also have feedback in response to the processing results, realizing the function of two-way interaction.

In addition to the above feedback, control commands can trigger other types of feedback at the same time, even other commands that include forced control of the vehicle. However, in any case, the relevant processing and control are carried out in the external electronic control unit, so that the relevant functions can be modified at the end of the wearable device, and there is no need to modify the vehicle computer system itself.

FIG. 5 is a schematic diagram of vehicle control performed by the wearable device of this embodiment. The wearable device of this embodiment utilizes vehicle information received from the communication module, and the control module generates vehicle control signals to perform vehicle control functions. The vehicle control functions performed may include at least one of lateral control, longitudinal control, gear control, and signal feedback. The lateral control device may be a mechanical device that performs steering control, or may be an electronic control unit for controlling this. The longitudinal control device can be either a mechanical device that performs braking control, or an electronic control unit for controlling this. The gear control device may be a mechanical device that performs gear control, or may be an electronic control unit for controlling this. The signal feedback device may include vehicle status, light status, vehicle speed, wheel speed, yaw rate, etc., and may also be an electronic control unit for providing these signal feedbacks.

FIG. 6 shows a schematic block diagram of another wearable device provided by an embodiment of the present application. The wearable device 6 includes: a processor 60, a memory 61, and a processor 60 stored in the memory 61 and available in the processor Computer program 62 running on 60 . When the processor 60 executes the computer program 62 , the steps in each of the vehicle control method embodiments described above are implemented, for example, steps S101 to S103 shown in FIG. 1 . Alternatively, when the processor 60 executes the computer program 62, the functions of the modules/units in each of the foregoing apparatus embodiments, such as the functions of the modules 301 to 303 shown in FIG. 3, are implemented.

Exemplarily, the computer program 62 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 61 and executed by the processor 60 to complete the this application. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program 62 in the wearable device 6 .

Those skilled in the art can understand that FIG. 6 is only an example of the wearable device 6, and does not constitute a limitation to the wearable device 6, and may include more or less components than the one shown, or combine some components, or different For example, the wearable device 6 may also include input and output devices, network access devices, buses, and the like.

The processor 60 may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 61 may be an internal storage unit of the wearable device 6 , such as a hard disk or a memory of the wearable device 6 . The memory 61 may also be an external storage device of the wearable device 6, such as a plug-in hard disk equipped on the wearable device 6, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, flash memory card (Flash Card), etc. Further, the memory 61 may also include both an internal storage unit of the wearable device 6 and an external storage device. The memory 61 is used to store the computer program and other programs and data required by the wearable device 6 . The memory 61 can also be used to temporarily store data that has been output or will be output.

Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. Module completion, that is, dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated in one processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit, and the above-mentioned integrated units may adopt hardware. It can also be realized in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the above-mentioned system, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed apparatus/wearable device and method may be implemented in other manners. For example, the apparatus/wearable device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple divisions. Units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated modules/units, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the present application can implement all or part of the processes in the methods of the above embodiments, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer When the program is executed by the processor, the steps of the foregoing method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form, and the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable media may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer-readable media Electric carrier signals and telecommunication signals are not included.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the above-mentioned embodiments, those of ordinary skill in the art should understand that: it can still be used for the above-mentioned implementations. The technical solutions described in the examples are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions in the embodiments of the application, and should be included in the within the scope of protection of this application.

Claims (10)

1. A vehicle control method is applied to wearable equipment, the wearable equipment is in communication connection with a vehicle-mounted computer system of a specified vehicle, and the vehicle control method comprises the following steps:

acquiring physiological parameters of a target user, wherein the target user is a user wearing the wearable equipment;

determining the physiological state of the target user according to the physiological parameters;

and issuing a control instruction corresponding to the physiological state to the vehicle-mounted computer system.

2. The vehicle control method according to claim 1, wherein the physiological parameter includes a first physiological parameter and a second physiological parameter, and the acquiring the physiological parameter of the target user includes:

acquiring a first physiological parameter of the target user through a sensor in the wearable device;

and acquiring a second physiological parameter of the target user through a vehicle-mounted sensor of the specified vehicle.

3. The vehicle control method according to claim 1, further comprising, before determining the physiological state of the target user from the physiological parameter:

acquiring historical physiological parameters of the target user;

and calibrating and calculating the physiological parameters according to the historical physiological parameters to obtain the calibrated physiological parameters.

4. The vehicle control method of claim 1, wherein said determining a physiological state of the target user as a function of the physiological parameter comprises:

processing the physiological parameters by using a preset deep neural network model to obtain output values corresponding to the physiological parameters;

and determining the physiological state of the target user according to the output value.

5. The vehicle control method according to claim 1, wherein the issuing of the control instruction corresponding to the physiological state to the in-vehicle computer system includes:

if the physiological state is a fatigue state, selecting a control instruction with the highest priority from a preset control instruction set as a preferred control instruction;

and issuing the optimal control instruction to the vehicle computer system.

6. The vehicle control method according to claim 5, further comprising, after issuing the preferred control instruction to the in-vehicle computer system:

acquiring the change condition of the physiological state of the target user;

and adjusting the priority of the preferred control instruction according to the change situation.

7. The vehicle control method according to any one of claims 1 to 6, wherein the control instruction includes a first control instruction, a second control instruction, a third control instruction and/or a fourth control instruction, the first control instruction is used for controlling a vehicle audio and video system of the specified vehicle to react, the second control instruction is used for controlling a steering wheel of the specified vehicle to vibrate, the third control instruction is used for controlling a vehicle air conditioner of the specified vehicle to adjust temperature, and the fourth control instruction is used for controlling the specified vehicle to decelerate or brake.

8. A vehicle control device is applied to a wearable device, wherein the wearable device is in communication connection with a vehicle computer system of a specific vehicle, and the vehicle control device may include:

the physiological parameter acquisition module is used for acquiring physiological parameters of a target user, and the target user is a user wearing the wearable equipment;

the physiological state determining module is used for determining the physiological state of the target user according to the physiological parameters;

and the control instruction issuing module is used for issuing a control instruction corresponding to the physiological state to the vehicle computer system.

9. A computer readable storage medium storing computer readable instructions, characterized in that the computer readable instructions, when executed by a processor, implement the steps of the vehicle control method according to any one of claims 1 to 7.

10. A wearable device comprising a memory, a processor, and computer readable instructions stored in the memory and executable on the processor, wherein the processor when executing the computer readable instructions implements the steps of the vehicle control method of any of claims 1-7.

Images