A kind of the driving display methods and device of augmented reality
Technical field
The present invention relates to intelligent driving field, in particular to the driving display methods and device of a kind of augmented reality.
Background technique
Existing head-up display device (HUD) or AR glasses, can by various information of vehicles by computer processing conversion after, with
The forms such as figure or number, text are exported.
HUD image is shown, is the information projection that will be received by projection element of the device in front of console
On glass.Have control panel simultaneously, the image for either changing output can be adjusted.
Have the position that can change display image by control projection original part in such HUD, driver can be made
Think that the virtual image of display picture is not imaged on windshield, in position more more forwardly of than windshield.
Existing AR glasses are by single or multiple sensors sense environmental depth informations, and overlapped information is to display picture
In face.
The pictures such as the navigation information warning of driving display system on the market are based not on actual environment, do not reach
The target that actual situation combines, cannot provide true user environment causes user that can not handle in time, and ease for use is also bad.
Summary of the invention
In view of this, the application provides a kind of driving display methods of augmented reality, effective driving can be really shown
Information improves the safety of driving experience and traveling.
In order to solve the above technical problems, the technical solution of the application is achieved in that
A kind of driving display methods of augmented reality, applied in the driving display device on vehicle, this method comprises:
The image data for the vehicle-periphery that receiving sensor component is sent and corresponding spatial information;
If there is the characteristic area of configuration in described image data, the corresponding image data of existing characteristic area is extracted
And spatial information;
Current information of vehicles is obtained, determining in the characteristic area extracted according to the information of vehicles of acquisition needs spy to be shown
Levy the image data in region;
The image data of characteristic area to be shown is generated into virtual screen;And according to virtual screen correspondence image data
Spatial information, by the virtual screen Overlapping display.
A kind of driving display device of augmented reality, the device include: receiving unit, determination unit, acquiring unit, generation
Unit and display unit;
The receiving unit, for the image data for the vehicle-periphery that receiving sensor component is sent, and
Corresponding spatial information;
The determination unit, for determining in the received image data of the receiving unit with the presence or absence of the characteristic area of configuration
Domain;The information of vehicles obtained according to the acquiring unit determines the image that characteristic area to be shown is needed in the characteristic area extracted
Data;
The acquiring unit exists for working as in the image data that the determination unit determines that the receiving unit receives
When the characteristic area of configuration, the existing corresponding image data of characteristic area and spatial information are extracted;Obtain current vehicle letter
Breath,
The generation unit, the image data of the characteristic area to be shown for determining the determination unit generate empty
Quasi- picture;
The display unit, the space letter of the virtual screen correspondence image data for being generated according to the generation unit
Breath, by the virtual screen Overlapping display.
As can be seen from the above technical solution, vehicle-periphery is carried out by using sensor module in the application to examine
It surveys, and returns to image data and spatial information;The corresponding image of characteristic area to be shown is determined according to current information of vehicles
Data, and virtual screen is generated, according to virtual screen described in corresponding spatial information Overlapping display.The program can really be shown
Effective driving information improves the safety of driving experience and traveling.
Detailed description of the invention
Fig. 1 is the driving flow for displaying schematic diagram that augmented reality is realized in the embodiment of the present application one;
Fig. 2 is that there is the display schematic diagram that pedestrian passes through in blind area in the embodiment of the present application;
Fig. 3 is that speed per hour transfinites the display schematic diagram of guideboard in the embodiment of the present application;
Fig. 4 is that there are the guideboard display schematic diagrams of three-way intersection in the embodiment of the present application;
Fig. 5 is the driving flow for displaying schematic diagram that augmented reality is realized in the embodiment of the present application two;
Fig. 6 is the schematic diagram for showing guideboard in the embodiment of the present application under heavy rain weather;
Fig. 7 is the apparatus structure schematic diagram for being applied to above-mentioned technology in the embodiment of the present application.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and examples,
Technical solution of the present invention is described in detail.
A kind of driving display methods of augmented reality is provided in the embodiment of the present application, shows dress applied to the driving on vehicle
It sets, vehicle-periphery is carried out by using sensor module and is detected, and returns to image data and spatial information;According to
Current information of vehicles determines the corresponding image data of characteristic area to be shown, and generates virtual screen, according to corresponding sky
Between information superposition show the virtual screen.The program can really show effective driving information, improve driving experience and row
The safety sailed.
Driving display device in the embodiment of the present application can be but be not limited to HUD or AR glasses.
Sensor module is used to obtain the image data and spatial information and GPS information of vehicle-periphery.
Here sensor module includes at least GPS positioning device, device of taking pictures, spatial information acquisition device, if clapped
Spatial information can be obtained simultaneously according to device, can will take pictures device and spatial information acquisition device is combined into a device.
GPS positioning device is for obtaining GPS information;
Here device of taking pictures is not limited, and such as can be monocular camera, binocular camera, structure light depth camera, TOF
Depth camera etc..Device user of taking pictures obtains image data;
Here spatial information acquisition device is not limited, such as laser radar, millimetre-wave radar, rangefinder;For
Obtain spatial information.
The origin of spatial information is defined as the optical center position of device of taking pictures when vehicle starts for the first time.In vehicle travel process
The corresponding space coordinate of the ambient enviroment got refers to the three-dimensional coordinate relative to origin.
Embodiment one
With reference to the accompanying drawing, the application is described in detail and is realized in the good situation of ambient environmental conditions for driving vehicle and increase
The driving of strong reality shows process.
It is the driving flow for displaying schematic diagram that augmented reality is realized in the embodiment of the present application one referring to Fig. 1, Fig. 1.Specific step
Suddenly are as follows:
Step 101, the image data for the vehicle-periphery that display device receiving sensor component is sent is driven, with
And corresponding spatial information.
Step 102, however, it is determined that there is the characteristic area of configuration in described image data, then extract existing characteristic area pair
The image data and spatial information answered.
Characteristic area is and drives related region, can configure according to actual needs, as road edge, zebra stripes,
Guideboard etc..
It is described after extracting the existing corresponding image data of characteristic area and spatial information when the application implements
Method further comprises:
Obtain cartographic information;Wherein, the cartographic information is made of the information of characteristic area;
By the determining corresponding image data of characteristic area and spatial information update into the cartographic information.
The image data for the vehicle-periphery that the receiving sensor component is sent and corresponding spatial information
When, the method further includes:
Receive the GPS information for the correspondence image data that the sensor module is sent;
The information of the characteristic area includes: spatial information, image data and the GPS information of characteristic area.
Step 103, which obtains current information of vehicles, determines extraction according to the information of vehicles of acquisition
The image data of characteristic area to be shown is needed in characteristic area.
Information of vehicles in the embodiment of the present application includes: data in vehicle interior CAN bus and passes through navigation map
The road conditions information got.
Data in CAN bus include but is not limited to speed, oil consumption, Fuel Oil Remaining, mileage number, blind area testing number
According to etc.;
Road conditions information includes but is not limited to initial position, final position, has travelled milimeter number, apart from destination kilometer
Number, front alert condition (construction, traffic accident, blocking, speed limit etc.), route ahead situation are (currently in what road, the several troubles in front
Road respectively leads to any road) etc..
Step 104, which generates virtual screen for the image data of characteristic area to be shown;And according to
The spatial information of virtual screen correspondence image data, by the virtual screen Overlapping display.
The application gives the corresponding virtual screen of image data of Overlapping display characteristic area, as being in information of vehicles
The content of no display in need can be specifically arranged according to concrete application, can also be handled according to existing realization.
With reference to the accompanying drawing, it provides in the application concrete application scene and realizes process.
Drive the image data of the vehicle-periphery that display device receiving sensor component is sent and corresponding
Spatial information.
If it is determined that there is the characteristic area of configuration in described image data, then the corresponding image of existing characteristic area is extracted
Data and spatial information;Otherwise, end is currently processed, i.e., does not need the information of Overlapping display.
Here characteristic area such as road edge, zebra stripes, guideboard etc..
The driving display device obtains current information of vehicles, and the characteristic area extracted is determined according to the information of vehicles of acquisition
The image data of middle need characteristic area to be shown.
Assuming that the information of vehicles obtained are as follows: right side blind area has pedestrian to pass through or current road segment speed limit 80KM/H, or without road
Board, and there is three-way intersection in front, it is determined that corresponding characteristic area: road edge, the corresponding image data in guideboard region need
Corresponding image data is then generated virtual image, according to the virtual display position of corresponding spatial information Overlapping display by display
Place.
Referring to fig. 2, Fig. 2 is that there is the display schematic diagram that pedestrian passes through in blind area in the embodiment of the present application.The image in left side in Fig. 2
For the scene figure in actual environment, there is pedestrian to pass through in the right side blind area of vehicle;The image on right side is using the embodiment of the present application
The technical solution of offer, the image of Overlapping display make driver it can be seen that improving the peace of driving in the pedestrian that blind area passes through
Quan Xing.
Referring to Fig. 3, Fig. 3 is that speed per hour transfinites the display schematic diagram of guideboard in the embodiment of the present application.In Fig. 3 vehicle forward right side by
It is damaged or direct there is no not shown in guideboard, it can determine that current road segment has speed limit, then gives birth to according to information of vehicles
The speed limit 80KM/H shown on the right side of road is virtually shown at virtual guideboard, such as Fig. 3, and the visual sense feeling to people is that roadside has speed limit road
Board.
Referring to fig. 4, Fig. 4 is that there are the guideboard display schematic diagrams of three-way intersection in the embodiment of the present application.Fig. 4 left-side images are
The road ahead of vehicle driving is three-way intersection, and top is shown without guideboard;Indication guide board (road is virtually shown on the right side of Fig. 4
Title and direction), the visual sense feeling to people is the road instruction for having three-way intersection.
Embodiment two
With reference to the accompanying drawing, in the case where for harsh environmental conditions, such as rain and snow weather, how to carry out realizing that enhancing is existing
Real driving shows process.
It is the driving flow for displaying schematic diagram that augmented reality is realized in the embodiment of the present application two referring to Fig. 5, Fig. 5.Specific step
Suddenly are as follows:
Step 501, when drive display device do not receive the vehicle-periphery image data and corresponding sky
Between information, or when the image data that receives fails to reach preset requirement, the GPS number that uses the sensor module received to send
According to searching corresponding image data and spatial information in the cartographic information.
Cartographic information is the cartographic information for obtaining and storing in the case that environmental condition is good.
Step 502, which obtains current information of vehicles, is determined according to the information of vehicles to be shown
The image data and spatial information found.
Information of vehicles in the embodiment of the present application includes: data in vehicle interior CAN bus and passes through navigation map
The road conditions information got.
Data in CAN bus include but is not limited to speed, oil consumption, Fuel Oil Remaining, mileage number, blind area testing number
According to etc.;
Road conditions information includes but is not limited to initial position, final position, has travelled milimeter number, apart from destination kilometer
Number, front alert condition (construction, traffic accident, blocking, speed limit etc.), route ahead situation are (currently in what road, the several troubles in front
Road respectively leads to any road) etc..
Step 503, which generates virtual screen for image data to be shown;And according to virtual screen pair
The spatial information for answering image data, by the virtual screen Overlapping display.
Below with reference to specific example, it is described in detail:
It is currently the environment of heavy rain in driver's startup procedure, sensor module function limitation is serious, the image letter of acquisition
It ceases unclear, or does not get at all, then corresponding image is obtained in the cartographic information of storage according to the GPS data received
Data and spatial information.
If determining that there is road indicator on right side but does not see according to information of vehicles, needs virtually to show, then will acquire
The image data of the corresponding indication guide board generates virtual screen, and according to the control information of correspondence image data, will be described virtual
Picture Overlapping display.
Referring to Fig. 6, Fig. 6 is the schematic diagram for showing guideboard in the embodiment of the present application under heavy rain weather.Left side is practical in Fig. 6
The traffic information observed, without 40 kilometers of direction board of current road segment speed limit;Right side is to use technical side provided by the present application
After case, 40 kilometers of speed limit of direction board is shown in front of vehicle right side.The peace of driving can be improved in the presence of a harsh environment in this way
Quan Xing.
Based on same inventive concept, the application also proposes a kind of driving display device of augmented reality.Referring to Fig. 7, Fig. 7
For the apparatus structure schematic diagram for being applied to above-mentioned technology in the embodiment of the present application.The device includes: receiving unit 701, determines list
Member 702, acquiring unit 703, generation unit 704 and display unit 705;
Receiving unit 701, the image data of the vehicle-periphery sent for receiving sensor component and right
The spatial information answered;
Determination unit 702, for determining in the received image data of receiving unit 701 with the presence or absence of the characteristic area of configuration
Domain;The information of vehicles obtained according to acquiring unit 703 determines the image that characteristic area to be shown is needed in the characteristic area extracted
Data;
Acquiring unit 703 is matched for working as to exist in the image data that determination unit 702 determines that receiving unit 701 receives
When the characteristic area set, the existing corresponding image data of characteristic area and spatial information are extracted;Current information of vehicles is obtained,
Generation unit 704, the image data of the characteristic area to be shown for determining determination unit 702 generate virtual
Picture;
Display unit 705, the spatial information of the virtual screen correspondence image data for being generated according to generation unit 704,
By the virtual screen Overlapping display.
Preferably,
Acquiring unit 703, be further used for determination unit 702 determine the existing corresponding image data of characteristic area and
When spatial information, cartographic information is obtained;Wherein, the cartographic information is made of the information of characteristic area;And by determining feature
The corresponding image data in region and spatial information update are into the cartographic information.
Preferably,
Receiving unit, when being further used for the image data of the vehicle-periphery of receiving sensor component transmission,
Further receive the GPS information for the correspondence image data that the sensor module is sent;Wherein, the packet of the characteristic area
It includes: spatial information, image data and the GPS information of characteristic area.
Preferably,
Acquiring unit 703 is further used for not receiving the image data of the vehicle-periphery and corresponding
Spatial information, the or when image data that receives fails to reach preset requirement, the GPS for using the sensor module received to send
Data search corresponding image data and spatial information in the cartographic information;Obtain current information of vehicles;
Determination unit 702, be further used for being determined according to the information of vehicles image data to be shown found and
Spatial information;
Generation unit 704, the image data to be shown for determining determination unit 702 generate virtual screen;
Display unit 705, the spatial information of the virtual screen correspondence image data for being generated according to generation unit 704,
By the virtual screen Overlapping display.
Preferably,
The information of vehicles includes: data in vehicle interior CAN bus and the road got by navigation map
Traffic information.
The unit of above-described embodiment can integrate in one, can also be deployed separately;It can be merged into a unit, it can also
To be further split into multiple subelements.
In conclusion the application believes to allow drive display system and can be driven according to the physical location Overlapping display of road
Breath, in order to allow driver in the environment of bad weather still it can be observed that effective driving information, present invention use can be with
The spatial information that the characteristic area in detection environment is carried out using sensor combinations, according to real-time information of vehicles in real space
Position generates on virtual hint image and Overlapping display to HUD AR glasses.
The application constructs roadway characteristic region detection module by the sensor combinations for environment sensing, it is established that drives
The 3d space relationship of the person of sailing, automobile and road, the coordinate information of characteristic area, root are calculated by saving and searching local map
Virtual screen is set according to the real time information of information of vehicles module, vision-control module adjusts each throwing according to the parameter of HUD
The virtual world of the graphics engine of shadow array or adjustment AR glasses simultaneously finally shows picture.It can more really show effective weight
The driving information wanted can be good at the driving for adapting to driver, promote the driving experience and driving safety of driver.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.