[go: up one dir, main page]

CN109050401A - A kind of the driving display methods and device of augmented reality - Google Patents

A kind of the driving display methods and device of augmented reality Download PDF

Info

Publication number
CN109050401A
CN109050401A CN201810742667.7A CN201810742667A CN109050401A CN 109050401 A CN109050401 A CN 109050401A CN 201810742667 A CN201810742667 A CN 201810742667A CN 109050401 A CN109050401 A CN 109050401A
Authority
CN
China
Prior art keywords
information
image data
characteristic area
spatial information
virtual screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810742667.7A
Other languages
Chinese (zh)
Other versions
CN109050401B (en
Inventor
凌霄
谢启宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics China R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Electronics China R&D Center
Priority to CN201810742667.7A priority Critical patent/CN109050401B/en
Publication of CN109050401A publication Critical patent/CN109050401A/en
Application granted granted Critical
Publication of CN109050401B publication Critical patent/CN109050401B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

本申请提供了一种增强现实的驾驶显示方法和装置,该方法包括:接收传感器组件发送的所述车辆周围环境的图像数据,以及对应的空间信息;若所述图像数据中存在配置的特征区域,则提取存在的特征区域对应的图像数据和空间信息;获取当前的车辆信息,根据获取的车辆信息确定提取的特征区域中需要显示的特征区域的图像数据;将要显示的特征区域的图像数据生成虚拟画面;并根据虚拟画面对应图像数据的空间信息,将所述虚拟画面叠加显示。该方法能够真实显示有效的驾驶信息,提高驾驶体验和行驶的安全性。

The present application provides an augmented reality driving display method and device, the method comprising: receiving image data of the surrounding environment of the vehicle and corresponding spatial information sent by sensor components; if there is a configured feature area in the image data , then extract the image data and spatial information corresponding to the existing feature area; obtain the current vehicle information, determine the image data of the feature area to be displayed in the extracted feature area according to the acquired vehicle information; generate the image data of the feature area to be displayed a virtual picture; and superimposing and displaying the virtual picture according to the spatial information of the image data corresponding to the virtual picture. The method can truly display effective driving information, and improve driving experience and driving safety.

Description

A kind of the driving display methods and device of augmented reality
Technical field
The present invention relates to intelligent driving field, in particular to the driving display methods and device of a kind of augmented reality.
Background technique
Existing head-up display device (HUD) or AR glasses, can by various information of vehicles by computer processing conversion after, with The forms such as figure or number, text are exported.
HUD image is shown, is the information projection that will be received by projection element of the device in front of console On glass.Have control panel simultaneously, the image for either changing output can be adjusted.
Have the position that can change display image by control projection original part in such HUD, driver can be made Think that the virtual image of display picture is not imaged on windshield, in position more more forwardly of than windshield.
Existing AR glasses are by single or multiple sensors sense environmental depth informations, and overlapped information is to display picture In face.
The pictures such as the navigation information warning of driving display system on the market are based not on actual environment, do not reach The target that actual situation combines, cannot provide true user environment causes user that can not handle in time, and ease for use is also bad.
Summary of the invention
In view of this, the application provides a kind of driving display methods of augmented reality, effective driving can be really shown Information improves the safety of driving experience and traveling.
In order to solve the above technical problems, the technical solution of the application is achieved in that
A kind of driving display methods of augmented reality, applied in the driving display device on vehicle, this method comprises:
The image data for the vehicle-periphery that receiving sensor component is sent and corresponding spatial information;
If there is the characteristic area of configuration in described image data, the corresponding image data of existing characteristic area is extracted And spatial information;
Current information of vehicles is obtained, determining in the characteristic area extracted according to the information of vehicles of acquisition needs spy to be shown Levy the image data in region;
The image data of characteristic area to be shown is generated into virtual screen;And according to virtual screen correspondence image data Spatial information, by the virtual screen Overlapping display.
A kind of driving display device of augmented reality, the device include: receiving unit, determination unit, acquiring unit, generation Unit and display unit;
The receiving unit, for the image data for the vehicle-periphery that receiving sensor component is sent, and Corresponding spatial information;
The determination unit, for determining in the received image data of the receiving unit with the presence or absence of the characteristic area of configuration Domain;The information of vehicles obtained according to the acquiring unit determines the image that characteristic area to be shown is needed in the characteristic area extracted Data;
The acquiring unit exists for working as in the image data that the determination unit determines that the receiving unit receives When the characteristic area of configuration, the existing corresponding image data of characteristic area and spatial information are extracted;Obtain current vehicle letter Breath,
The generation unit, the image data of the characteristic area to be shown for determining the determination unit generate empty Quasi- picture;
The display unit, the space letter of the virtual screen correspondence image data for being generated according to the generation unit Breath, by the virtual screen Overlapping display.
As can be seen from the above technical solution, vehicle-periphery is carried out by using sensor module in the application to examine It surveys, and returns to image data and spatial information;The corresponding image of characteristic area to be shown is determined according to current information of vehicles Data, and virtual screen is generated, according to virtual screen described in corresponding spatial information Overlapping display.The program can really be shown Effective driving information improves the safety of driving experience and traveling.
Detailed description of the invention
Fig. 1 is the driving flow for displaying schematic diagram that augmented reality is realized in the embodiment of the present application one;
Fig. 2 is that there is the display schematic diagram that pedestrian passes through in blind area in the embodiment of the present application;
Fig. 3 is that speed per hour transfinites the display schematic diagram of guideboard in the embodiment of the present application;
Fig. 4 is that there are the guideboard display schematic diagrams of three-way intersection in the embodiment of the present application;
Fig. 5 is the driving flow for displaying schematic diagram that augmented reality is realized in the embodiment of the present application two;
Fig. 6 is the schematic diagram for showing guideboard in the embodiment of the present application under heavy rain weather;
Fig. 7 is the apparatus structure schematic diagram for being applied to above-mentioned technology in the embodiment of the present application.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and examples, Technical solution of the present invention is described in detail.
A kind of driving display methods of augmented reality is provided in the embodiment of the present application, shows dress applied to the driving on vehicle It sets, vehicle-periphery is carried out by using sensor module and is detected, and returns to image data and spatial information;According to Current information of vehicles determines the corresponding image data of characteristic area to be shown, and generates virtual screen, according to corresponding sky Between information superposition show the virtual screen.The program can really show effective driving information, improve driving experience and row The safety sailed.
Driving display device in the embodiment of the present application can be but be not limited to HUD or AR glasses.
Sensor module is used to obtain the image data and spatial information and GPS information of vehicle-periphery.
Here sensor module includes at least GPS positioning device, device of taking pictures, spatial information acquisition device, if clapped Spatial information can be obtained simultaneously according to device, can will take pictures device and spatial information acquisition device is combined into a device.
GPS positioning device is for obtaining GPS information;
Here device of taking pictures is not limited, and such as can be monocular camera, binocular camera, structure light depth camera, TOF Depth camera etc..Device user of taking pictures obtains image data;
Here spatial information acquisition device is not limited, such as laser radar, millimetre-wave radar, rangefinder;For Obtain spatial information.
The origin of spatial information is defined as the optical center position of device of taking pictures when vehicle starts for the first time.In vehicle travel process The corresponding space coordinate of the ambient enviroment got refers to the three-dimensional coordinate relative to origin.
Embodiment one
With reference to the accompanying drawing, the application is described in detail and is realized in the good situation of ambient environmental conditions for driving vehicle and increase The driving of strong reality shows process.
It is the driving flow for displaying schematic diagram that augmented reality is realized in the embodiment of the present application one referring to Fig. 1, Fig. 1.Specific step Suddenly are as follows:
Step 101, the image data for the vehicle-periphery that display device receiving sensor component is sent is driven, with And corresponding spatial information.
Step 102, however, it is determined that there is the characteristic area of configuration in described image data, then extract existing characteristic area pair The image data and spatial information answered.
Characteristic area is and drives related region, can configure according to actual needs, as road edge, zebra stripes, Guideboard etc..
It is described after extracting the existing corresponding image data of characteristic area and spatial information when the application implements Method further comprises:
Obtain cartographic information;Wherein, the cartographic information is made of the information of characteristic area;
By the determining corresponding image data of characteristic area and spatial information update into the cartographic information.
The image data for the vehicle-periphery that the receiving sensor component is sent and corresponding spatial information When, the method further includes:
Receive the GPS information for the correspondence image data that the sensor module is sent;
The information of the characteristic area includes: spatial information, image data and the GPS information of characteristic area.
Step 103, which obtains current information of vehicles, determines extraction according to the information of vehicles of acquisition The image data of characteristic area to be shown is needed in characteristic area.
Information of vehicles in the embodiment of the present application includes: data in vehicle interior CAN bus and passes through navigation map The road conditions information got.
Data in CAN bus include but is not limited to speed, oil consumption, Fuel Oil Remaining, mileage number, blind area testing number According to etc.;
Road conditions information includes but is not limited to initial position, final position, has travelled milimeter number, apart from destination kilometer Number, front alert condition (construction, traffic accident, blocking, speed limit etc.), route ahead situation are (currently in what road, the several troubles in front Road respectively leads to any road) etc..
Step 104, which generates virtual screen for the image data of characteristic area to be shown;And according to The spatial information of virtual screen correspondence image data, by the virtual screen Overlapping display.
The application gives the corresponding virtual screen of image data of Overlapping display characteristic area, as being in information of vehicles The content of no display in need can be specifically arranged according to concrete application, can also be handled according to existing realization.
With reference to the accompanying drawing, it provides in the application concrete application scene and realizes process.
Drive the image data of the vehicle-periphery that display device receiving sensor component is sent and corresponding Spatial information.
If it is determined that there is the characteristic area of configuration in described image data, then the corresponding image of existing characteristic area is extracted Data and spatial information;Otherwise, end is currently processed, i.e., does not need the information of Overlapping display.
Here characteristic area such as road edge, zebra stripes, guideboard etc..
The driving display device obtains current information of vehicles, and the characteristic area extracted is determined according to the information of vehicles of acquisition The image data of middle need characteristic area to be shown.
Assuming that the information of vehicles obtained are as follows: right side blind area has pedestrian to pass through or current road segment speed limit 80KM/H, or without road Board, and there is three-way intersection in front, it is determined that corresponding characteristic area: road edge, the corresponding image data in guideboard region need Corresponding image data is then generated virtual image, according to the virtual display position of corresponding spatial information Overlapping display by display Place.
Referring to fig. 2, Fig. 2 is that there is the display schematic diagram that pedestrian passes through in blind area in the embodiment of the present application.The image in left side in Fig. 2 For the scene figure in actual environment, there is pedestrian to pass through in the right side blind area of vehicle;The image on right side is using the embodiment of the present application The technical solution of offer, the image of Overlapping display make driver it can be seen that improving the peace of driving in the pedestrian that blind area passes through Quan Xing.
Referring to Fig. 3, Fig. 3 is that speed per hour transfinites the display schematic diagram of guideboard in the embodiment of the present application.In Fig. 3 vehicle forward right side by It is damaged or direct there is no not shown in guideboard, it can determine that current road segment has speed limit, then gives birth to according to information of vehicles The speed limit 80KM/H shown on the right side of road is virtually shown at virtual guideboard, such as Fig. 3, and the visual sense feeling to people is that roadside has speed limit road Board.
Referring to fig. 4, Fig. 4 is that there are the guideboard display schematic diagrams of three-way intersection in the embodiment of the present application.Fig. 4 left-side images are The road ahead of vehicle driving is three-way intersection, and top is shown without guideboard;Indication guide board (road is virtually shown on the right side of Fig. 4 Title and direction), the visual sense feeling to people is the road instruction for having three-way intersection.
Embodiment two
With reference to the accompanying drawing, in the case where for harsh environmental conditions, such as rain and snow weather, how to carry out realizing that enhancing is existing Real driving shows process.
It is the driving flow for displaying schematic diagram that augmented reality is realized in the embodiment of the present application two referring to Fig. 5, Fig. 5.Specific step Suddenly are as follows:
Step 501, when drive display device do not receive the vehicle-periphery image data and corresponding sky Between information, or when the image data that receives fails to reach preset requirement, the GPS number that uses the sensor module received to send According to searching corresponding image data and spatial information in the cartographic information.
Cartographic information is the cartographic information for obtaining and storing in the case that environmental condition is good.
Step 502, which obtains current information of vehicles, is determined according to the information of vehicles to be shown The image data and spatial information found.
Information of vehicles in the embodiment of the present application includes: data in vehicle interior CAN bus and passes through navigation map The road conditions information got.
Data in CAN bus include but is not limited to speed, oil consumption, Fuel Oil Remaining, mileage number, blind area testing number According to etc.;
Road conditions information includes but is not limited to initial position, final position, has travelled milimeter number, apart from destination kilometer Number, front alert condition (construction, traffic accident, blocking, speed limit etc.), route ahead situation are (currently in what road, the several troubles in front Road respectively leads to any road) etc..
Step 503, which generates virtual screen for image data to be shown;And according to virtual screen pair The spatial information for answering image data, by the virtual screen Overlapping display.
Below with reference to specific example, it is described in detail:
It is currently the environment of heavy rain in driver's startup procedure, sensor module function limitation is serious, the image letter of acquisition It ceases unclear, or does not get at all, then corresponding image is obtained in the cartographic information of storage according to the GPS data received Data and spatial information.
If determining that there is road indicator on right side but does not see according to information of vehicles, needs virtually to show, then will acquire The image data of the corresponding indication guide board generates virtual screen, and according to the control information of correspondence image data, will be described virtual Picture Overlapping display.
Referring to Fig. 6, Fig. 6 is the schematic diagram for showing guideboard in the embodiment of the present application under heavy rain weather.Left side is practical in Fig. 6 The traffic information observed, without 40 kilometers of direction board of current road segment speed limit;Right side is to use technical side provided by the present application After case, 40 kilometers of speed limit of direction board is shown in front of vehicle right side.The peace of driving can be improved in the presence of a harsh environment in this way Quan Xing.
Based on same inventive concept, the application also proposes a kind of driving display device of augmented reality.Referring to Fig. 7, Fig. 7 For the apparatus structure schematic diagram for being applied to above-mentioned technology in the embodiment of the present application.The device includes: receiving unit 701, determines list Member 702, acquiring unit 703, generation unit 704 and display unit 705;
Receiving unit 701, the image data of the vehicle-periphery sent for receiving sensor component and right The spatial information answered;
Determination unit 702, for determining in the received image data of receiving unit 701 with the presence or absence of the characteristic area of configuration Domain;The information of vehicles obtained according to acquiring unit 703 determines the image that characteristic area to be shown is needed in the characteristic area extracted Data;
Acquiring unit 703 is matched for working as to exist in the image data that determination unit 702 determines that receiving unit 701 receives When the characteristic area set, the existing corresponding image data of characteristic area and spatial information are extracted;Current information of vehicles is obtained,
Generation unit 704, the image data of the characteristic area to be shown for determining determination unit 702 generate virtual Picture;
Display unit 705, the spatial information of the virtual screen correspondence image data for being generated according to generation unit 704, By the virtual screen Overlapping display.
Preferably,
Acquiring unit 703, be further used for determination unit 702 determine the existing corresponding image data of characteristic area and When spatial information, cartographic information is obtained;Wherein, the cartographic information is made of the information of characteristic area;And by determining feature The corresponding image data in region and spatial information update are into the cartographic information.
Preferably,
Receiving unit, when being further used for the image data of the vehicle-periphery of receiving sensor component transmission, Further receive the GPS information for the correspondence image data that the sensor module is sent;Wherein, the packet of the characteristic area It includes: spatial information, image data and the GPS information of characteristic area.
Preferably,
Acquiring unit 703 is further used for not receiving the image data of the vehicle-periphery and corresponding Spatial information, the or when image data that receives fails to reach preset requirement, the GPS for using the sensor module received to send Data search corresponding image data and spatial information in the cartographic information;Obtain current information of vehicles;
Determination unit 702, be further used for being determined according to the information of vehicles image data to be shown found and Spatial information;
Generation unit 704, the image data to be shown for determining determination unit 702 generate virtual screen;
Display unit 705, the spatial information of the virtual screen correspondence image data for being generated according to generation unit 704, By the virtual screen Overlapping display.
Preferably,
The information of vehicles includes: data in vehicle interior CAN bus and the road got by navigation map Traffic information.
The unit of above-described embodiment can integrate in one, can also be deployed separately;It can be merged into a unit, it can also To be further split into multiple subelements.
In conclusion the application believes to allow drive display system and can be driven according to the physical location Overlapping display of road Breath, in order to allow driver in the environment of bad weather still it can be observed that effective driving information, present invention use can be with The spatial information that the characteristic area in detection environment is carried out using sensor combinations, according to real-time information of vehicles in real space Position generates on virtual hint image and Overlapping display to HUD AR glasses.
The application constructs roadway characteristic region detection module by the sensor combinations for environment sensing, it is established that drives The 3d space relationship of the person of sailing, automobile and road, the coordinate information of characteristic area, root are calculated by saving and searching local map Virtual screen is set according to the real time information of information of vehicles module, vision-control module adjusts each throwing according to the parameter of HUD The virtual world of the graphics engine of shadow array or adjustment AR glasses simultaneously finally shows picture.It can more really show effective weight The driving information wanted can be good at the driving for adapting to driver, promote the driving experience and driving safety of driver.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.

Claims (11)

1. the driving display methods of a kind of augmented reality, applied in the driving display device on vehicle, which is characterized in that the party Method includes:
The image data for the vehicle-periphery that receiving sensor component is sent and corresponding spatial information;
If there is the characteristic area of configuration in described image data, the existing corresponding image data of characteristic area and sky are extracted Between information;
Current information of vehicles is obtained, determining in the characteristic area extracted according to the information of vehicles of acquisition needs characteristic area to be shown The image data in domain;
The image data of characteristic area to be shown is generated into virtual screen;And according to the space of virtual screen correspondence image data Information, by the virtual screen Overlapping display.
2. the method according to claim 1, wherein the corresponding image data of characteristic area existing for the determination When with spatial information, the method further includes:
Obtain cartographic information;Wherein, the cartographic information is made of the information of characteristic area;
By the determining corresponding image data of characteristic area and spatial information update into the cartographic information.
3. according to the method described in claim 2, it is characterized in that, the vehicle periphery that the receiving sensor component is sent When the image data of environment and corresponding spatial information, the method further includes:
Receive the GPS information for the correspondence image data that the sensor module is sent;
The information of the characteristic area includes: spatial information, image data and the GPS information of characteristic area.
4. according to the method described in claim 3, it is characterized in that, the method further includes:
When the image data and corresponding spatial information for not receiving the vehicle-periphery, or the picture number received When according to failing to reach preset requirement, the GPS data sent using the sensor module received is searched in the cartographic information Corresponding image data and spatial information;
Current information of vehicles is obtained, determines that the image data to be shown found and space are believed according to the information of vehicles Breath;
Image data to be shown is generated into virtual screen;And according to the spatial information of virtual screen correspondence image data, by institute State virtual screen Overlapping display.
5. method according to claim 1-4, which is characterized in that
The information of vehicles includes: data in vehicle interior CAN bus and the road conditions got by navigation map Information.
6. method according to claim 1-4, which is characterized in that
The driving display device is HUD or AR glasses;
When the display device is HUD, virtual screen is shown in projected array;
When the display device is AR glasses, virtual screen is shown in the virtual world of the graphics engine of AR glasses.
7. a kind of driving display device of augmented reality, which is characterized in that the device includes: receiving unit, determination unit, acquisition Unit, generation unit and display unit;
The receiving unit for the image data for the vehicle-periphery that receiving sensor component is sent, and corresponds to Spatial information;
The determination unit, for determining in the received image data of the receiving unit with the presence or absence of the characteristic area of configuration; The information of vehicles obtained according to the acquiring unit determines the picture number that characteristic area to be shown is needed in the characteristic area extracted According to;
There is configuration in the image data that the determination unit determines that the receiving unit receives for working as in the acquiring unit Characteristic area when, extract the existing corresponding image data of characteristic area and spatial information;Current information of vehicles is obtained,
The generation unit, the image data of the characteristic area to be shown for determining the determination unit generate virtual draw Face;
The display unit, the spatial information of the virtual screen correspondence image data for being generated according to the generation unit will The virtual screen Overlapping display.
8. device according to claim 7, which is characterized in that
The acquiring unit is further used for determining the existing corresponding image data of characteristic area and sky in the determination unit Between information when, obtain cartographic information;Wherein, the cartographic information is made of the information of characteristic area;And by determining characteristic area The corresponding image data in domain and spatial information update are into the cartographic information.
9. device according to claim 8, which is characterized in that
Receiving unit, when being further used for the image data of the vehicle-periphery of receiving sensor component transmission, into one Step receives the GPS information for the correspondence image data that the sensor module is sent;Wherein, the information of the characteristic area includes: Spatial information, image data and the GPS information of characteristic area.
10. device according to claim 9, which is characterized in that
The acquiring unit is further used for that the image data of the vehicle-periphery and corresponding sky ought not be received Between information, or when the image data that receives fails to reach preset requirement, the GPS number that uses the sensor module received to send According to searching corresponding image data and spatial information in the cartographic information;Obtain current information of vehicles;
The determination unit is further used for determining the image data to be shown found and space according to the information of vehicles Information;
The generation unit, the image data to be shown for determining the determination unit generate virtual screen;
The display unit, the spatial information of the virtual screen correspondence image data for generating according to the generation unit will The virtual screen Overlapping display.
11. according to the described in any item devices of claim 7-10, which is characterized in that
The information of vehicles includes: data in vehicle interior CAN bus and the road conditions got by navigation map Information.
CN201810742667.7A 2018-07-09 2018-07-09 Augmented reality driving display method and device Active CN109050401B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810742667.7A CN109050401B (en) 2018-07-09 2018-07-09 Augmented reality driving display method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810742667.7A CN109050401B (en) 2018-07-09 2018-07-09 Augmented reality driving display method and device

Publications (2)

Publication Number Publication Date
CN109050401A true CN109050401A (en) 2018-12-21
CN109050401B CN109050401B (en) 2020-08-21

Family

ID=64819575

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810742667.7A Active CN109050401B (en) 2018-07-09 2018-07-09 Augmented reality driving display method and device

Country Status (1)

Country Link
CN (1) CN109050401B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109819160A (en) * 2019-01-04 2019-05-28 惠州市凯越电子股份有限公司 Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving and device
CN109883414A (en) * 2019-03-20 2019-06-14 百度在线网络技术(北京)有限公司 A kind of automobile navigation method, device, electronic equipment and storage medium
CN111076742A (en) * 2019-12-17 2020-04-28 百度国际科技(深圳)有限公司 Display method and device of AR navigation, electronic equipment and storage medium
CN113589924A (en) * 2021-07-05 2021-11-02 浙江商汤科技开发有限公司 Augmented reality display method and related device, vehicle and storage medium
CN113671695A (en) * 2020-05-15 2021-11-19 华为技术有限公司 Head-up display device and head-up display method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103105174A (en) * 2013-01-29 2013-05-15 四川长虹佳华信息产品有限责任公司 AR (augmented reality)-based vehicle-mounted live-action safe navigation method
CN103150759A (en) * 2013-03-05 2013-06-12 腾讯科技(深圳)有限公司 Method and device for dynamically enhancing street view image
CN105513389A (en) * 2015-11-30 2016-04-20 小米科技有限责任公司 Method and device for augmented reality
CN105593641A (en) * 2013-10-01 2016-05-18 戴姆勒股份公司 Method and device for augmented display
CN106355153A (en) * 2016-08-31 2017-01-25 上海新镜科技有限公司 Virtual object display method, device and system based on augmented reality
US20180061129A1 (en) * 2016-08-29 2018-03-01 Toyota Jidosha Kabushiki Kaisha Method of Ground Adjustment for In-Vehicle Augmented Reality Systems
CN108151759A (en) * 2017-10-31 2018-06-12 捷开通讯(深圳)有限公司 A kind of air navigation aid, intelligent terminal and navigation server

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103105174A (en) * 2013-01-29 2013-05-15 四川长虹佳华信息产品有限责任公司 AR (augmented reality)-based vehicle-mounted live-action safe navigation method
CN103150759A (en) * 2013-03-05 2013-06-12 腾讯科技(深圳)有限公司 Method and device for dynamically enhancing street view image
CN105593641A (en) * 2013-10-01 2016-05-18 戴姆勒股份公司 Method and device for augmented display
CN105513389A (en) * 2015-11-30 2016-04-20 小米科技有限责任公司 Method and device for augmented reality
US20180061129A1 (en) * 2016-08-29 2018-03-01 Toyota Jidosha Kabushiki Kaisha Method of Ground Adjustment for In-Vehicle Augmented Reality Systems
CN106355153A (en) * 2016-08-31 2017-01-25 上海新镜科技有限公司 Virtual object display method, device and system based on augmented reality
CN108151759A (en) * 2017-10-31 2018-06-12 捷开通讯(深圳)有限公司 A kind of air navigation aid, intelligent terminal and navigation server

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109819160A (en) * 2019-01-04 2019-05-28 惠州市凯越电子股份有限公司 Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving and device
CN109883414A (en) * 2019-03-20 2019-06-14 百度在线网络技术(北京)有限公司 A kind of automobile navigation method, device, electronic equipment and storage medium
CN109883414B (en) * 2019-03-20 2021-08-27 百度在线网络技术(北京)有限公司 Vehicle navigation method and device, electronic equipment and storage medium
CN111076742A (en) * 2019-12-17 2020-04-28 百度国际科技(深圳)有限公司 Display method and device of AR navigation, electronic equipment and storage medium
US11566913B2 (en) 2019-12-17 2023-01-31 Apollo Intelligent Connectivity (Beijing) Technology Co., Ltd. Method, apparatus, electronic device and storage medium for displaying AR navigation
CN113671695A (en) * 2020-05-15 2021-11-19 华为技术有限公司 Head-up display device and head-up display method
US12360382B2 (en) 2020-05-15 2025-07-15 Shenzhen Yinwang Intelligent Technologies Co., Ltd. Head-up display apparatus and head-up display method
CN113589924A (en) * 2021-07-05 2021-11-02 浙江商汤科技开发有限公司 Augmented reality display method and related device, vehicle and storage medium

Also Published As

Publication number Publication date
CN109050401B (en) 2020-08-21

Similar Documents

Publication Publication Date Title
US20240242509A1 (en) Enhanced Navigation Instructions with Landmarks Under Difficult Driving Conditions
US9135754B2 (en) Method to generate virtual display surfaces from video imagery of road based scenery
CN109050401A (en) A kind of the driving display methods and device of augmented reality
US8970451B2 (en) Visual guidance system
US9171214B2 (en) Projecting location based elements over a heads up display
KR102625688B1 (en) Display devices and route guidance systems based on mixed reality
US9267808B2 (en) Visual guidance system
US12394313B1 (en) Displaying sensor data and supplemental data as a mask for autonomous vehicles
JP4909451B1 (en) Information display apparatus and control method
US20160039285A1 (en) Scene awareness system for a vehicle
CN110786004B (en) Display control device, display control method, and storage medium
US10488658B2 (en) Dynamic information system capable of providing reference information according to driving scenarios in real time
US20200249044A1 (en) Superimposed-image display device and computer program
JP2019095213A (en) Superimposed image display device and computer program
JP2001344597A (en) Fusion vision device
CN110888430A (en) Display device, display control method, and storage medium
US20240042857A1 (en) Vehicle display system, vehicle display method, and computer-readable non-transitory storage medium storing vehicle display program
CN111667687B (en) Display device, display control method, and storage medium
JP2012208111A (en) Image display device and control method
JP6186905B2 (en) In-vehicle display device and program
US12202510B2 (en) Display system
JP2017040773A (en) Head-mounted display device
US20250303965A1 (en) Visual assistance display apparatus, visual assistance display system, and visual assistance display method
EP4081421A1 (en) Display apparatus, moving body, display method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant