CN100487380C - Displaying method and apparatus for changing display position according to external environment - Google Patents
Displaying method and apparatus for changing display position according to external environment Download PDFInfo
- Publication number
- CN100487380C CN100487380C CNB200410048467XA CN200410048467A CN100487380C CN 100487380 C CN100487380 C CN 100487380C CN B200410048467X A CNB200410048467X A CN B200410048467XA CN 200410048467 A CN200410048467 A CN 200410048467A CN 100487380 C CN100487380 C CN 100487380C
- Authority
- CN
- China
- Prior art keywords
- display
- information transmission
- information
- driver
- transmission device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims description 44
- 230000005540 biological transmission Effects 0.000 claims abstract description 95
- 230000000007 visual effect Effects 0.000 claims description 45
- 238000012546 transfer Methods 0.000 claims description 9
- 230000000449 premovement Effects 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 235000019646 color tone Nutrition 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000035807 sensation Effects 0.000 description 3
- 235000019615 sensations Nutrition 0.000 description 3
- 239000006185 dispersion Substances 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000000739 chaotic effect Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
Images
Landscapes
- Traffic Control Systems (AREA)
- Navigation (AREA)
Abstract
在平视显示装置(100)中,当在移动前信息传送装置(901)与车辆之间存在前方车辆(902)时,将移动前信息传送装置(901)移动到另一个位置,在该位置处显示移动前信息传送装置(901)作为可识别的移动后信息传送装置(903)。由此,从移动前信息传送装置(901)隐藏在前方车辆(902)之后因此而变得不可见的状态消除移动前信息传送装置(901)。结果是,能够降低车辆驾驶者所感受到的不协调感觉,并且将更少忽视信息传送装置。
In the head-up display device (100), when there is a front vehicle (902) between the before-moving information transmitting device (901) and the vehicle, the before-moving information transmitting device (901) is moved to another position at which The pre-move messaging device (901) is displayed as the identifiable post-move messaging device (903). Thereby, the pre-movement information transmission device ( 901 ) is eliminated from a state where the pre-movement information transmission device ( 901 ) hides behind the preceding vehicle ( 902 ) and thus becomes invisible. As a result, the sense of incongruity felt by the driver of the vehicle can be reduced, and the information transmission device will be less overlooked.
Description
技术领域 technical field
本发明涉及一种向车辆驾驶者呈现信息的显示方法,以及还涉及一种采用该方法的显示装置。The invention relates to a display method for presenting information to a driver of a vehicle, and also to a display device employing the method.
背景技术 Background technique
作为一种用于向车辆驾驶者呈现信息的显示方法,提出了各种方法。常规方法之一是平视显示器(HUD)。这种HUD装置的特征在于HUD能够降低用户视点的移动量,因此,对于安全性的提高是很有用的。As a display method for presenting information to a vehicle driver, various methods have been proposed. One of the conventional methods is a heads-up display (HUD). Such a HUD device is characterized in that the HUD can reduce the amount of movement of the user's point of view, and thus is useful for improving safety.
为了提高HUD装置的显示视觉可识别性,日本专利2,913,901中公开的显示装置已经提出了利用驾驶者眼睛之间的视觉差的显示装置。依据这种显示装置,视觉差、显示数据的数量和位置根据车辆行驶位置的改变而变化,从而提高了驾驶者的感知能力并且提高了安全性。In order to improve display visual recognizability of the HUD device, a display device disclosed in Japanese Patent No. 2,913,901 has been proposed that utilizes a visual difference between eyes of a driver. According to this display device, the visual difference, the amount and the position of the displayed data are changed according to the change of the traveling position of the vehicle, thereby improving driver's perception and improving safety.
然而,这种显示装置没有根据车辆外部的环境情况而示出图形显示(display)。结果是,在某些情况下,显示装置呈现视觉上可识别的图形显示的能力可能会由于外部环境情况而降低。当通过利用驾驶者眼睛之间的视觉差显示车辆前100米距离处的导向箭头作为三维图形显示时,很可能是驾驶者几乎无法识别出车辆前100米距离处的导向箭头,这是因为驾驶者将注意力集中在了该车辆前20米距离处的另一车辆上。However, such display devices do not show graphic displays according to environmental conditions outside the vehicle. As a result, in some cases, the ability of the display device to present a visually recognizable graphic display may be reduced due to external environmental conditions. When the guidance arrow at the distance of 100 meters in front of the vehicle is displayed as a three-dimensional graphic by utilizing the visual difference between the eyes of the driver, it is likely that the driver can hardly recognize the guidance arrow at the distance of 100 meters in front of the vehicle because the driving The victim focused his attention on another vehicle at a distance of 20 meters in front of the vehicle.
发明内容 Contents of the invention
因此,针对上述问题,本发明的目的是提供一种被安装在车辆上的显示装置采用的显示方法作为一种根据车辆外部的环境来呈现图形显示的方法,以便提高图形显示的视觉可识别性,并且提供一种显示装置。Therefore, in view of the above-mentioned problems, an object of the present invention is to provide a display method adopted by a display device mounted on a vehicle as a method of presenting a graphic display according to the environment outside the vehicle in order to improve the visual recognizability of the graphic display , and a display device is provided.
根据本发明,允许车辆驾驶者三维地识别一信息传送装置(information conveyer)的位置,所述信息传送装置用于通过利用驾驶者眼睛之间的视觉差来向驾驶者传送变化。特别地,当在驾驶者识别的信息传送装置的存在位置与车辆之间存在物体时,事先将存在位置转变至该物体的位置,然后再显示信息传送装置。According to the present invention, a driver of a vehicle is allowed to three-dimensionally recognize the position of an information conveyor for conveying changes to the driver by utilizing the visual difference between the driver's eyes. In particular, when there is an object between the presence position of the information delivery device recognized by the driver and the vehicle, the presence position is shifted to the position of the object in advance, and then the information delivery device is displayed.
这样,使隐藏在该物体后面的并且因此应该不可见的信息传送装置进入到可见的状态。结果是,驾驶者能够感受到与正常视觉相同的感觉,并且提高了信息传送装置的视觉可识别性。In this way, the information transmission means which are hidden behind the object and should therefore not be visible are brought into a visible state. As a result, the driver can experience the same sensation as normal vision, and the visual recognizability of the information delivery device is improved.
替换地,当驾驶者识别出的信息传送装置的存在位置与车辆之间存在物体时,事先将存在位置转变至除该物体后面的位置之外的位置,然后显示该信息传送装置。Alternatively, when the driver recognizes that there is an object between the presence position of the information delivery device and the vehicle, the presence position is shifted to a position other than the position behind the object in advance, and then the information delivery device is displayed.
另外,替换地,当驾驶者识别出的信息传送装置的存在位置与位于该存在位置更前面的预定前向距离位置之间不存在物体时,,优选地,在显示该信息传送装置之前,预先将信息传送装置移动至一范围内的物体位置,该范围由以驾驶者作为参考点、预定的前向距离位置与驾驶者之间的距离来确定。通过将信息传送装置移动到此范围内的位置上,驾驶者识别出的信息传送装置的存在位置与其背景之间的距离变得合适,从而使得驾驶者变得能够容易识别信息传送装置。In addition, alternatively, when there is no object between the presence position of the information transmission device recognized by the driver and a predetermined forward distance position ahead of the presence position, preferably, before displaying the information transmission device, a The telematics device is moved to an object position within a range determined by the distance between the predetermined forward distance position and the driver with the driver as a reference point. By moving the information transmission device to a position within this range, the distance between the existence position of the information transmission device recognized by the driver and its background becomes appropriate, so that the driver becomes able to easily recognize the information transmission device.
进一步,替换地,当在驾驶者识别出的信息传送装置的存在位置与位于该存在位置更前面的预定的前方距离位置之间不存在物体时,优选地,在显示该信息传送装置之前先将信息传送装置移动至存在于一距离内的物体的存在位置,该距离通常等于以驾驶者作为参考点、信息传送装置的存在位置与驾驶者之间的距离。通过将信息传送装置移动到此位置,使得驾驶者识别出的信息传送装置的存在位置与其背景之间的距离变得合适。另外,信息传送装置的存在位置与驾驶者之间的距离与初始状态相比没有大变化,从而使得驾驶者能够容易地识别信息传送装置。Further, alternatively, when there is no object between the existence position of the information transmission device recognized by the driver and a predetermined distance ahead of the existence position, it is preferable to display the information transmission device before displaying the information transmission device. The telematics device moves to an existing position of an object present within a distance generally equal to the distance between the telescopic device's existing position and the driver with the driver as a reference point. By moving the information transmission device to this position, the distance between the presence position of the information transmission device recognized by the driver and its background becomes appropriate. In addition, the distance between the existing position of the information transmission device and the driver does not change greatly from the initial state, thereby enabling the driver to easily recognize the information transmission device.
另外,在信息传送装置的存在位置处背景的色调分布度(colortone distribution degree)(或组成色分散度component color dispersiondegree)是如此之高以至于在一些情况下驾驶者会忽视信息传送装置。例如,可以想象地,此背景是带有引人注意的颜色的布告牌、交通信号等等。In addition, the colortone distribution degree (or component color dispersion degree) of the background at the position where the information transmission device exists is so high that the driver ignores the information transmission device in some cases. For example, this background could conceivably be a bulletin board, traffic signal, etc. with an eye-catching color.
在这些情况下,当在信息传送装置的存在位置处的背景的色调分布度高于一预定参考值时,优选地,在显示信息传送装置之前,事先将该信息传送装置移动至色调分布度低于预定参考值的位置上。另外,还可以根据诸如背景亮度及色度之类的条件来移动信息传送装置。此外,优选地,将该预定参考值设定在色调分布度的预定点处。在色调分布度的预定点处,车辆驾驶者难以识别信息传送装置的信息的比率开始增高。然而,此色调分布度的预定点随驾驶者的变化而有所不同。因此,优选地,允许将该预定参考值设定为一可调值。In these cases, when the degree of tone distribution of the background at the position where the information delivery device exists is higher than a predetermined reference value, it is preferable to move the information delivery device to a location where the degree of tone distribution is low before displaying the information delivery device. at the position of the predetermined reference value. In addition, it is also possible to move the information transfer device according to conditions such as background brightness and chromaticity. Furthermore, preferably, the predetermined reference value is set at a predetermined point of the degree of tone distribution. At a predetermined point of the degree of tone distribution, the rate at which it is difficult for the driver of the vehicle to recognize the information of the information transmission device starts to increase. However, the predetermined point of this degree of tone distribution differs depending on the driver. Therefore, preferably, it is allowed to set the predetermined reference value as an adjustable value.
通过用此种方式将信息传送装置移动到此位置,即使在计划的显示位置处背景的色调分布度如此之高以至于使驾驶者几乎无法识别出信息传送装置时,驾驶者也能够容易地识别信息传送装置。这是因为,事先将信息传送装置移动至具有低色调分布度的背景的位置上,并在该位置显示。By moving the telematics device to this position in this way, the driver can easily recognize the information transmission device even when the degree of color tone distribution of the background is so high at the planned display position that the driver can hardly recognize the telematics device. Information transmission device. This is because the information delivery device is moved to a position with a background having a low degree of tone distribution in advance, and is displayed at that position.
另外,在将信息传送装置的存在位置转变至其它位置并在所述其它位置显示信息传送装置之前,还可以在改变存在位置以前一度在该存在位置处显示信息传送装置,然后在于其它位置处显示信息传送装置以前先将信息传送装置的存在位置转变至所述其它位置。应当注意,作为另一个可选方案,可以在移动信息传送装置的同时显示信息传送装置。In addition, before changing the presence position of the information transmission device to another position and displaying the information transmission device at the other position, it is also possible to display the information transmission device at the presence position once before changing the presence position, and then display the information transmission device at the other position. The information delivery device has previously changed the existence location of the information delivery device to the other location. It should be noted that, as another alternative, the information delivery device may be displayed while the information delivery device is being moved.
通过一度在初始计划的视觉识别位置显示信息传送装置,在具有某些特定的信息传送装置(诸如呈现位置特性的信息传送装置)的情况下,驾驶者可以享有能够容易地掌握视觉识别位置的效果。应当注意,即使将初始视觉识别位置转变至新位置以后,一些诸如绘图线(drawing line)之类的指示物也能够用来显示初始显示位置。By once displaying the telematics at the initially planned visual recognition position, the driver can enjoy the effect of being able to easily grasp the visual recognition position in the case of some specific telematics such as the telematics exhibiting the characteristics of the position . It should be noted that some indicators such as drawing lines can be used to show the initial display position even after transitioning the initial visual recognition position to a new position.
另外,获得了有关车辆外部环境的信息以及有关车辆的信息,并且允许车辆驾驶者三维地识别信息传送装置,信息传送装置用于通过利用驾驶者眼睛之间的视觉差来显示信息传送装置,从而向驾驶者传送信息。此外,根据至少有关车辆外部环境的信息和/或有关车辆的信息来评估视觉可识别性,在显示信息传送装置之前,将驾驶者识别出的信息传送装置的位置、形状和颜色其中至少之一从预定的状态改变到改进后的视觉可识别性的状态。In addition, information on the external environment of the vehicle and information on the vehicle are obtained, and the driver of the vehicle is allowed to three-dimensionally recognize the information delivery device for displaying the information delivery device by utilizing the visual difference between the driver's eyes, thereby Send information to the driver. In addition, evaluating visual recognizability based on at least information about the environment outside the vehicle and/or information about the vehicle, prior to displaying the telematics device, at least one of the location, shape and color of the telematics device recognized by the driver A change from a predetermined state to a state of improved visual legibility.
应当注意,上述预定的状态是指不同于由车辆外部环境确定的状态。预定状态的一个例子是:在预定位置处以预定形状和预定颜色显示的状态。通常,有关车辆的上述信息是有关车辆当前位置和移动方向的信息。It should be noted that the aforementioned predetermined state refers to a state other than that determined by the external environment of the vehicle. An example of a predetermined state is a state displayed in a predetermined shape and a predetermined color at a predetermined position. Generally, the above-mentioned information about the vehicle is information about the vehicle's current position and moving direction.
在提供有上述结构的显示装置中,甚至使因车辆外部环境原因和其它原因一起而使得驾驶者几乎无法从视觉上识别信息传送装置的状态,转变为在显示装置上显示信息传送装置以前就使驾驶者能容易地识别信息传送装置的状态。结果是,可以向驾驶者正确地呈现信息。In the display device provided with the above-mentioned structure, even in a state where the driver can hardly visually recognize the information transmission device due to the external environment of the vehicle together with other reasons, it is shifted to using the information transmission device before displaying the information transmission device on the display device. The driver can easily recognize the state of the information transmission device. As a result, information can be correctly presented to the driver.
附图说明 Description of drawings
通过参照附图所作的以下详细说明,本发明的上述及其它目的、特征和优点将变得更加明显。在图中:The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description made with reference to the accompanying drawings. In the picture:
图1是示出通过本发明实施例实现的导航系统的示意图;FIG. 1 is a schematic diagram showing a navigation system realized by an embodiment of the present invention;
图2是示出导航系统的控制单元的方框图;2 is a block diagram illustrating a control unit of a navigation system;
图3是示出一透视图的示意图;Figure 3 is a schematic diagram showing a perspective view;
图4是示出由控制单元实现的显示过程的流程图;FIG. 4 is a flowchart showing a display process implemented by a control unit;
图5是示出信息传送装置的常用移动的示意图;FIG. 5 is a schematic diagram illustrating common movements of an information transfer device;
图6是示出信息传送装置的另一典型移动的示意图;FIG. 6 is a schematic diagram illustrating another typical movement of an information transfer device;
图7是示出信息传送装置的又一典型移动的示意图;Fig. 7 is a schematic diagram illustrating another typical movement of an information transmission device;
图8是示出常用信息传送装置的又一典型移动的示意图;Fig. 8 is a schematic diagram showing yet another typical movement of a commonly used information transmission device;
图9是示出由控制单元实现的设置过程的流程图;FIG. 9 is a flowchart showing a setting process implemented by the control unit;
图10是示出在设置过程中显示的典型设置屏幕的示意图;FIG. 10 is a schematic diagram showing a typical setting screen displayed during setting;
图11是示出在设置过程中显示的另一个典型设置屏幕的示意图;和FIG. 11 is a schematic diagram showing another typical setting screen displayed during the setting process; and
图12是在设置过程中显示的另一个典型设置屏幕的示意图。Figure 12 is a schematic illustration of another typical setup screen displayed during setup.
具体实施方式 Detailed ways
首先参照图1,导航系统100包括:挡风玻璃101、反光镜102、两个显示单元103、CCD摄像机104、激光雷达105、GPS天线106、车速传感器107、信息输入开关108、方位传感器109和控制单元110。Referring to Fig. 1 at first,
挡风玻璃101是车辆正面窗户。挡风玻璃101在其内表面上(即驾驶室侧上)作了表面处理,,以便它能用作组合器(combiner)。反光镜102是将从显示单元103输出的光束引导至挡风玻璃101的反射镜。分别为驾驶者左眼和右眼配备了显示单元103。显示单元103输出的光束被反光镜102和挡风玻璃101引导至驾驶者的左眼和右眼。The
CCD摄像机104是用于拍摄车辆前方正面景观的图片的光学摄像机。CCD摄像机104能够将图片图像作为电信号输出。激光雷达105是用于向前面目标发射激光以便测算车辆与目标之距离离的部件。激光雷达105能够将距离测算结果作为电信号输出。The
GPS天线106是用于接收来自于GPS(全球定位系统)卫星的信号的天线。GPS天线106能够将接收到的信号作为电信号输出。The
车速传感器107是用于产生表示车辆速度的信号的传感器,在所述车辆上安装有导航系统100。信息输入开关108是由驾驶者操作的开关,用以输入改变导航系统100之操作的各种信息。通常地,方位传感器109是地磁传感器或陀螺仪。方位传感器109能够产生表示诸如车辆方位和加速度的量的电信号。The
控制单元110是用于接收来自于CCD摄像机104、激光雷达105、GPS天线106、车速传感器107、信息输入开关108和方位传感器109的信号并且用于根据信号来控制显示单元103的部件。
接下来,通过参照图2的方框图来详细描述控制单元110。控制单元110包括CPU 301、ROM 302、RAM 303、输入/输出单元304、地图数据库(DB)306、绘图RAM(drawing RAM)307和显示控制器308。Next, the
一般来讲,CPU 301是公知的处理器,而ROM 302、RAM 303和绘图RAM 307每个都是通常公知的存储器模块。在通过执行存储在ROM 302中的程序来执行各类处理的过程中,CPU 301使用RAM303作为临时存储区,并且在绘图RAM 307中存储图片数据。In general,
输入/输出单元304是用于接收来自于CCD摄像机104、激光雷达105、GPS天线106、车速传感器107、信息输入开关108、方位传感器109以及地图DB 306的信号并且将信号传递给CPU 301、RAM303、绘图RAM 307和显示控制器308的接口。The input/
地图DB 306是用于存储地图数据(比如道路形状数据、道路宽度数据、道路类型数据、道路编号、道路交通规则数据、地形数据、标志数据、十字路口数据和公用设施数据)的介质。考虑到将要存储在介质中的数据量,通常将具有大存储能力的存储装置用作为所述介质。具有大存储能力的存储装置的例子是:DVD-ROM和硬盘。然而,也可以使用通常具有较小存储容量的介质,比如存储卡。The
显示控制器308是用于读出存储在绘图RAM 307中的图片数据的部件,它执行计算以便在适当位置显示信息传送装置,并且向显示单元103发出命令。The
接下来,通过参照图3的原理图来描述导航系统100的三维视野。来自用于驾驶者右眼的显示单元103a输出的光束经过反光镜102a、反光镜102b和挡风玻璃101而到达驾驶者右眼。在另一方面,来自用于驾驶者左眼的显示单元103b输出的光束经过反光镜102a、反光镜102b和挡风玻璃101而到达驾驶者左眼。Next, the three-dimensional view of the
如图3所示,图像形成位置201存在于挡风玻璃101的两侧上,即驾驶者侧和相对于挡风玻璃101与驾驶者侧相对的一侧,该两侧将挡风玻璃101夹在中间。每个图像形成位置与挡风玻璃101分开一距离,该距离等于光束从103a和103b传播到挡风玻璃101的光学路程的总长。如图3所示,驾驶者150在视觉上识别的三维显示的视觉识别位置202是如下两条线延长的交点,一条是从驾驶者150右眼到位于与驾驶者侧相对的一侧上的图像形成位置201处形成的作为用于右眼的图像所绘的直线;另一条是从驾驶者左眼到位于与驾驶者侧相对的一侧上的图像形成位置201处产生的作为用于左眼的图像所绘的直线。As shown in FIG. 3 ,
CCD摄像机104和激光雷达105作为外部信息获取获取装置。GPS天线106、车速传感器107和方位传感器109作为车辆信息获取获取装置。显示单元103、反光镜102和挡风玻璃101作为显示装置。包含在控制单元110中的CPU 301和显示控制器308作为控制装置。接下来,描述由控制单元110中采用的CPU 301执行的处理。CPU 301执行路线设定过程和路线导向过程,而这些过程通常是由常规导航系统来执行的。另外,CPU 301还执行显示过程和设定过程,以作为此实施例中实施的导航系统100所特有的处理。The
(1)显示过程(1) Display process
图4示出了由控制单元110执行的显示过程的流程图。当开启车辆的点火钥匙并且将要显示的信息存在时,重复执行该显示过程。FIG. 4 shows a flow chart of a display process performed by the
该流程图始于步骤S110,在步骤S110中确定车辆的位置和方向。可以根据GPS天线106、车速传感器107和方位传感器109所产生的信号来找到车辆的位置和方向。The flow chart starts at step S110 in which the position and orientation of the vehicle are determined. The position and orientation of the vehicle can be found from the signals generated by the
然后,在下一步骤S115中,从地图DB 306中获得在步骤S110中找到的当前位置附近的地图数据。在下一步骤S120,随后,从RAM303中获得已经在设定过程(将在下面被描述)中设定的显示设定数据。显示设定数据是代表信息传送装置的形状、颜色和显示位置的数据。Then, in the next step S115, the map data near the current position found in the step S110 is obtained from the
信息传送装置指的是用于告知驾驶者信息的显示物体。信息传送装置的例子是:导向箭头、用于表明道路状况的图像和直接描述信息的字符。应当注意:当尚未设定显示设定数据时,使用默认的显示设定数据。The information delivery device refers to a display object for informing a driver of information. Examples of information delivery devices are: directional arrows, images used to indicate road conditions, and characters that directly describe information. It should be noted that when the display setting data has not been set, the default display setting data is used.
然后,在下一步骤S122,根据在步骤S110得到的位置和方位,(诸如车辆的位置和方位)以及在步骤S115获得的地图数据来确定信息传送装置的计划的显示位置。Then, at the next step S122, the planned display position of the information delivery device is determined based on the position and orientation obtained at step S110, such as the position and orientation of the vehicle, and the map data obtained at step S115.
随后,在下一步骤S124,根据由CCD摄像机104和激光雷达105产生的信号来识别在车辆前面的视野状况。在这种情况下,状况识别指的是掌握有关所述状况之信息的操作。有关所述状况之信息的例子是:前面车辆的位置和形状、路旁的位置和形状、以及驾驶者所看到的景物。Then, at the next step S124 , the field of view situation in front of the vehicle is recognized based on the signals generated by the
接着,过程进行至下一步骤S125,通过判断在该车辆与视觉识别位置之间是否存在一些物体,来选择紧随步骤S125的步骤。当在该车辆与视觉识别位置之间存在物体时,过程前进至步骤S130。反之,当在该车辆与视觉识别位置之间不存在物体时,过程前进至步骤S135。Then, the procedure proceeds to the next step S125, and a step following step S125 is selected by judging whether there is some object between the vehicle and the visual recognition position. When there is an object between the vehicle and the visual recognition position, the process proceeds to step S130. On the contrary, when there is no object between the vehicle and the visual recognition position, the process proceeds to step S135.
在步骤S130,使信息传送装置的视觉识别位置改变或移动到存在物体的位置。视觉识别位置的移动仅导致了数据上的变化。仍然没有示出实际的图形显示。车辆侧上的物体表面是改变移动后位置的理想位置。在完成改变信息传送装置的视觉识别位置的操作以后,过程进行至下一步骤S145。In step S130, the visual recognition position of the information transmission device is changed or moved to a position where an object exists. A shift in the position of the visual recognition resulted only in a change in the data. Still no actual graphics display is shown. Object surfaces on the side of the vehicle are ideal locations to change position after a move. After the operation of changing the visual recognition position of the information delivery device is completed, the process proceeds to the next step S145.
应当注意,当在步骤S120获得的显示设定数据中的信息传送装置的显示位置指定除“自动”之外的位置时,在不改变信息传送装置的视觉识别位置的情况下,在指定的位置上显示信息传送装置。这种用以在除“自动”之外的指定位置上显示信息传送装置的操作适用于下列说明中所描述的所有移动。It should be noted that when the display position of the information delivery device in the display setting data obtained in step S120 designates a position other than "automatic", without changing the visual recognition position of the information delivery device, at the designated position The information transmission device is displayed on the display. This operation to display the information delivery device at a specified position other than "automatic" applies to all movements described in the following description.
通过参照图5中所示的图像,来描述在步骤S130执行的处理的例子。该图像是一视图:当车辆中的驱动驾驶者透过挡风玻璃101看见有东西存在于车辆前面时,该视图是可见的。在使得移动前信息传送装置901呈自然隐藏状态的位置关系上,移动前信息传送装置901位于前面车辆902的前方(远处)。当在这种状态下有意地显示移动前信息传送装置901时,尽管移动前信息传送装置901自然地被隐藏在前面的车辆902之后而进入不可见状态(在比该车辆更远处),但移动前信息传送装置901进入可见状态。由于有意显示的移动前信息传送装置901,为驾驶者带来的感觉就不同于正常的认知感觉的感觉。因此,很可能使造成驾驶者几乎不能识别出信息传送装置。An example of processing performed at step S130 is described by referring to the image shown in FIG. 5 . The image is a view: the view is visible when the driving driver in the vehicle sees through the
为了解决这个问题,将信息传送装置移动到前面车辆902的位置,即由移动后信息传送装置903表示的位置。通过这样显示移动后信息传送装置903,能够降低驾驶者感觉到的不协调感,由此就能很容易地识别出信息传送装置。In order to solve this problem, the information transmission device is moved to the position of the preceding vehicle 902 , that is, the position indicated by the moved information transmission device 903 . By displaying the information delivery device 903 after movement in this way, it is possible to reduce the sense of discomfort felt by the driver, thereby allowing the information delivery device to be easily identified.
返回图4,在步骤S135,通过判断在车辆的移动方向上、从信息传送装置当前位置处开始的预定的前向距离(远处)以内是否存在物体,来选择紧随步骤S135后的步骤。在这种情况下,优选地,将几十米的距离作为典型的预定前向距离。普通的驾驶者能够容易地识别这种预定前向距离内的物体。当在预定前向距离内存在物体时,所述过程前进至步骤S145。反之,当预定前向距离内不存在物体时,所述过程前进至步骤S140。Returning to FIG. 4, in step S135, the step following step S135 is selected by judging whether there is an object within a predetermined forward distance (distance) from the current position of the telematics device in the moving direction of the vehicle. In this case, preferably, a distance of several tens of meters is taken as a typical predetermined forward distance. An average driver can easily recognize objects within such a predetermined forward distance. When there is an object within the predetermined forward distance, the process proceeds to step S145. Conversely, when there is no object within the predetermined forward distance, the process proceeds to step S140.
在步骤S140,将信息传送装置的视觉识别位置转变为存在于一区域处的物体的位置,该区域与该车辆的距离和已存在的物体与该车辆的距离大致相同物体。在完成将信息传送装置的视觉识别位置转变为此物体的位置的操作之后,所述过程前进至步骤S145。In step S140, the visually recognized position of the information transmission device is transformed into the position of an object existing in an area whose distance from the vehicle is substantially the same as that of an existing object from the vehicle. After the operation of converting the visual recognition position of the information transmission device to the position of the object is completed, the process proceeds to step S145.
通过参照图6中所示的图像,来描述在步骤S140执行的处理的例子。该图像是一视图:当车辆中的驾驶者透过挡风玻璃101看见有东西存在于车辆前面时,该视图是可见的。移动前信息传送装置1001是显示车辆前铺设的道路为弯路的路标。使移动前信息传送装置1001定位于弯路开始上方的空间中。当移动前信息传送装置1001的背景是天空时,移动前信息传送装置1001进入悬浮在向远处延伸的空间中的状态。当在弯路开始上方的空间中显示信息传送装置1001时,很可能驾驶者不能立即识别该信息传送装置1001。这是因为实际上在天空与信息传送装置1001之间存在位置上的很大差异。An example of processing performed at step S140 is described by referring to the image shown in FIG. 6 . The image is a view that is visible when the driver in the vehicle sees through the
为了解决这个问题,将信息传送装置1001的视觉识别位置转变为直立树木1002的位置,直立树木1002存在于移动前信息传送装置1003所表示的弯路开始的附近。通过将信息传送装置1001的视觉识别位置转变到此位置,就都能看到信息传送装置与其附近背景,其中信息传送装置与其附近背景存在于大致相同的位置上。结果是,驾驶者能够很容易地识别信息传送装置1003。To solve this problem, the visually recognized position of the
返回图4。在步骤S145,检查信息传送装置的存在位置处的背景的色调分布度(或组成色分散度),以便判断色调分布度是否高于预定的参考值。优选地,将预定的参考值设定在色调分布度的预定点上。在色调分布度的此预定点上,车辆驾驶者几乎不可识别信息传送装置的比率开始增高。然而,色调分布度的此点对于不同的驾驶者有所不同。因此,优选地,允许将预定参考值设定成可调值。当色调分布度高于预定参考值时,过程前进至步骤S150。反之,当色调分布度低于预定参考值时,过程前进至步骤S155。Return to Figure 4. In step S145, the degree of tone distribution (or compositional color dispersion) of the background at the location where the information transmission device exists is checked to determine whether the degree of tone distribution is higher than a predetermined reference value. Preferably, a predetermined reference value is set at a predetermined point of the degree of tone distribution. At this predetermined point in the degree of tone distribution, the rate at which the driver of the vehicle hardly recognizes the information delivery device starts to increase. However, this point of the degree of tone distribution differs for different drivers. Therefore, preferably, the predetermined reference value is allowed to be set as an adjustable value. When the degree of tone distribution is higher than the predetermined reference value, the process proceeds to step S150. On the contrary, when the degree of tone distribution is lower than the predetermined reference value, the process proceeds to step S155.
在步骤S150,将信息传送装置的视觉识别位置转变为背景的色调分布度低的位置。在完成将信息传送装置的视觉识别位置转变为此位置的操作之后,所述过程前进至步骤S155。In step S150, the visual recognition position of the information transmission device is changed to a position where the degree of color tone distribution of the background is low. After completing the operation of shifting the visual recognition position of the information transfer device to this position, the process proceeds to step S155.
通过参照图7中所示的图像,来描述在步骤S150执行的处理的例子。该图像是一视图:当车辆中的驱动驾驶者透过挡风玻璃101看见有东西存在于车辆前面时,该视图是可见的。移动前信息传送装置1101是在车辆前方视野的右上角处显示时刻的信息传送装置。在移动前信息传送装置1101的背景上,可以看到路标1103。由于引人注意的色彩的作用(其中正常显示的路标1100),使得驾驶者在某些情况下几乎不能识别出信息传送装置1101。An example of the processing performed at step S150 is described by referring to the image shown in FIG. 7 . The image is a view: the view is visible when the driving driver in the vehicle sees through the
如移动后信息传送装置1102所示,将信息传送装置移动到与具有恒定色调的实物块(concrete block)重叠的位置。通过在此位置上放置信息传送装置1102,驾驶者变得能够很容易地识别信息传送装置1102。As shown by the moved
返回图4,在步骤S155,检查信息传送装置的视觉识别位置的背景,以便判断该背景是否具有与该信息传送装置相同的色系。当该背景具有与信息传送装置相同的色系时,过程前进至S160。反之,当该背景不具有与信息传送装置相同的色系时,过程前进至步骤S165。Returning to FIG. 4 , in step S155 , the background of the visual recognition position of the information transmission device is checked to determine whether the background has the same color system as the information transmission device. When the background has the same color system as the information delivery device, the process proceeds to S160. On the contrary, when the background does not have the same color system as that of the information delivery device, the process proceeds to step S165.
在步骤S160,将信息传送装置的颜色转变为不同于背景色的颜色。例如,可以将信息传送装置的颜色转变为背景色的互补色。在将信息传送装置的颜色转变为不同于背景色的颜色之后,过程前进至步骤S165。In step S160, the color of the messaging device is changed to a color different from the background color. For example, the color of the messaging device may be changed to the complementary color of the background color. After changing the color of the information delivery device to a color different from the background color, the process proceeds to step S165.
通过参照图8中所示的图像,来描述在步骤S160执行的处理的例子。这幅图像是一视图:当车辆中的驾驶者透过挡风玻璃101看见有东西存在于车辆前面时,该视图是可见的。信息传送装置1202表示紧随信息传送装置1202后的道路是朝右弯曲的。信息传送装置1202位于弯曲道路开始处的路旁。当以与直立树木1201的绿色类似的绿色显示信息传送装置时(正如在具有信息传送装置1202的情况下,直立树木1201存在于信息传送装置的背景当中),驾驶者可能很难从背景中辨别出信息传送装置1202并且由此识别信息传送装置1202。An example of the processing performed at step S160 is described by referring to the image shown in FIG. 8 . This image is a view that is visible when the driver in the vehicle sees through the
为了解决这个问题,将信息传送装置1202的显示颜色从绿色变化为红色。通过把信息传送装置1202的显示颜色从绿色改变为红色,驾驶者变得容易从直立树木1201中区分信息传送装置1202,并且由此来识别信息传送装置1202。当然,还可以去除信息传送装置1202的绿色显示颜色以便让信息传送装置1202易于从视觉上识别。To solve this problem, the display color of the
返回图4。在步骤S165,将信息传送装置写入到绘图RAM307中。接着,在下一步骤S170,向显示控制器308发出显示命令以便终止执行显示过程。Return to Figure 4. In step S165, the information transfer device is written into the
当接收到显示命令时,显示控制器308从绘图RAM307中读出信息传送装置的绘图数据,计算正确的视觉差,并输出用于向显示单元103显示信息传送装置的光束。When receiving a display command, the
(2)设定过程(2) Setting process
图9示出了设定过程的流程图。当驾驶者操作信息输入开关108以输入用于执行设定过程的命令时,设定过程开始。FIG. 9 shows a flowchart of the setting process. When the driver operates the
流程图始于步骤S210,在步骤S210,用于选择信息传送装置形状的屏幕显示在挡风玻璃101上。通过参照示出设定屏幕的图10来描述此屏幕的例子。设定屏幕具有:导向信息标签401、车辆信息标签403和操作支持信息标签405。导向信息标签401的屏幕显示出4种导向箭头的常用形状409、411、413和415。假定驾驶者操作信息输入开关108以将光标407移动到4种常用形状中特定的一个上,以便选择特定形状。在选择特定形状之后,当驾驶者点击显示在屏幕上的按钮417(该按钮标明了“颜色选择”的词语)时,把所选的特定形状确认为导向箭头的形状,并且正如下述的那样,以用来选择导向箭头的颜色的屏幕替换该屏幕。The flow chart starts at step S210 where a screen for selecting the shape of the telematics device is displayed on the
返回图9。在下一步骤S215,将在步骤S210选定的形状作为信息传送装置的形状存储在RAM 303中。Return to Figure 9. At the next step S215, the shape selected at step S210 is stored in the
接着,在下一步骤S220,用于选择信息传送装置的颜色的屏幕显示在挡风玻璃101上。通过参照示出设定屏幕的图11来描述这类屏幕的例子。导向信息标签401的屏幕显示出代表各种颜色的矩形颜色样本423至430。假定驾驶者操作信息输入开关108以将光标421移动到矩形颜色样本423至430中特定的一个上,以便选择特定的颜色样本。在选择特定颜色样本之后,当驾驶者点击显示在屏幕上的按钮431(该按钮标明了“位置选择”的词语)时,把所选的特定颜色确认为导向箭头的颜色,并且正如将如下所述的那样,以用来显示导向箭头位置的屏幕替换该屏幕。应当注意,显示样本419出现在导向信息标签401的最高位置。显示样本419是具有先前所选定形状和利用这个屏幕选定的颜色的导向箭头,以允许驾驶者以实时方式来核实选定了什么。Then, a screen for selecting the color of the telematics device is displayed on the
返回图9,在下一步骤S225,将在步骤S220所选的颜色作为信息传送装置的颜色存储在RAM 303中。Returning to FIG. 9, in the next step S225, the color selected in step S220 is stored in the
接着,在下一步骤S230,用于选择信息传送装置的显示位置的屏幕显示在挡风玻璃101上。通过参照示出设定屏幕的图12来描述这类屏幕的例子。在出现于导向信息标签401上的、作为挡风玻璃101的模型画面框的画面框434中,排列了信息传送装置的显示位置的九个备选项。所述备选项是:“左上方”、“向上”、“右上方”、“中间左”、“自动”、“中间右”、“左下方”、“向下”以及“右下方”。驾驶者能够操作信息输入开关108将光标433移动到备选项中指定的一个上,以便选择由所选备选项表示的显示位置。Then, at the next step S230, a screen for selecting a display position of the information delivery device is displayed on the
当选定“自动”备选项时,把早先所描述的显示过程中改变视觉识别位置而得到的显示位置作为信息传送装置的显示位置。反之,当选定除”自动”之外的备选项时,所选备选项表示的显示位置优先于早先所描述的显示过程中改变视觉识别位置而得到的显示位置。在选择特定的备选项之后,当驾驶者点击显示在屏幕上的按钮435(该按钮标以词语“终止”)时,把所选的特定备选项确认为导向箭头的显示位置,并且屏幕消失。When the "automatic" option is selected, the display position obtained by changing the visual recognition position during the display described earlier is used as the display position of the information delivery device. Conversely, when an option other than "automatic" is selected, the display position represented by the selected option has priority over the display position obtained by changing the visual recognition position during the display process described earlier. After selecting a specific alternative, when the driver clicks the
返回图9,在下一步骤S235,将在步骤S230所选的显示位置作为信息传送装置的显示位置存储在RAM 303中,并且终止执行此设定过程。Returning to FIG. 9, in the next step S235, the display position selected in step S230 is stored in the
如上所述,由于驾驶者能够设定信息传送装置的形状、颜色和显示位置,依照诸如在个体之间识别信息传送装置能力的差距和个体喜好之类的一些因素,能够改变信息传送装置的属性。结果是,能够提高信息传送装置的视觉可识别性,且由此能够以更高度的便利性来使用信息传送装置。As described above, since the driver can set the shape, color, and display position of the telematics device, the attributes of the telematics device can be changed in accordance with factors such as the gap in the ability to recognize the telematics device between individuals and individual preferences. . As a result, the visual recognizability of the information transmission device can be improved, and thus the information transmission device can be used with a higher degree of convenience.
可以对上述实施例作以下修改。The following modifications can be made to the above-described embodiment.
(a)在上述实施例中,当视觉识别位置与车辆之间存在物体时,将视觉识别位置转变为物体的位置。然而,只要新位置未被遮盖住或者从驾驶室来看没有位于该物体后面,就能够将视觉识别位置转变为任何新的位置。即使通过将视觉识别位置改变为此新位置,可以消除驾驶者所感受到的不协调感觉。结果将是,能够提高信息传送装置的视觉可识别性。(a) In the above embodiment, when an object exists between the visually recognized position and the vehicle, the visually recognized position is converted into the position of the object. However, the visually identified position can be changed to any new position as long as the new position is not obscured or behind the object from the cab. Even by changing the visual recognition position to this new position, the sense of incongruity felt by the driver can be eliminated. As a result, the visual recognizability of the information delivery device can be improved.
(b)代替执行图4中所示的流程图中步骤S140的处理(依照上述实施例,在视觉识别位置与车辆之间存在物体的情况下执行该处理),可以在一显示位置显示信息传送装置,显示位置可以变化到存在于一范围内的物体的位置上,该范围由以驾驶者为参考点的、预定前方位置与车辆之间的距离来确定。即使通过将视觉识别位置改变至此范围内的位置,驾驶者所识别出的信息传送装置的存在位置与其背景之间的距离也是正确的,从而使得驾驶者能够很容易地识别出信息传送装置。(b) Instead of executing the processing of step S140 in the flowchart shown in FIG. 4 (which is executed when there is an object between the visual recognition position and the vehicle according to the above-described embodiment), the information transmission may be displayed at a display position. A device wherein the display position can be changed to the position of an object existing within a range determined by the distance between a predetermined forward position and the vehicle with the driver as a reference point. Even by changing the visual recognition position to a position within this range, the driver recognizes that the distance between the existence position of the telematics device and its background is correct, allowing the driver to easily recognize the telematics device.
(c)在上述实施例中,当预计驾驶者从视觉上识别信息传送装置有困难时,就将信息传送装置的视觉识别位置转变为另一个位置,而不是在计划的视觉识别位置显示信息传送装置。然而,即使当在计划的视觉识别位置显示的信息传送装置的视觉可识别性的评估表明驾驶者将几乎无法从视觉上识别出显示在计划的视觉识别位置的信息传送装置时,也一度将信息传送装置显示在计划的视觉识别位置,此后,将计划的视觉识别位置转变为新的位置,在该新位置处显示信息传送装置。在信息传送装置呈现位置特征的情况下,通过一度在初始视觉识别位置显示信息传送装置,驾驶者能够享受到在信息送装置呈现位置特性的情况下容易地掌握视觉识别位置的能力的效果。具有位置特性的信息传送装置的例子是一种显示需要警示的地点的信息传送装置。需要警示的地点的例子有:铁路交叉点、混乱车辆的位置以及坠落物体的位置。应当注意,即使在将初始的视觉识别位置转变为新位置之后,诸如绘图线之类的一些指示物都可以用来显示初始的显示位置。(c) In the above embodiment, when the driver is expected to have difficulty visually identifying the telematics device, the visual recognition position of the telematics device is shifted to another position instead of displaying the telematics at the planned visual recognition position device. However, even when an assessment of the visual identifiability of the telematics displayed at the planned visual identification location indicates that the driver will barely be able to visually identify the telematics display at the planned visual identification location, the information The delivery device is displayed at the planned visually identifiable location, after which the planned visually identifiable location is transitioned to a new location at which the information delivery device is displayed. By once displaying the telematics device at the initial visually identifiable position in the case where the telematics exhibits positional characteristics, the driver can enjoy the effect of the ability to easily grasp the visually identifiable position in the case where the telematics exhibits positional characteristics. An example of a messaging device having a location feature is a messaging device that displays locations that require alerts. Examples of locations requiring alerts are: railway crossings, the location of chaotic vehicles, and the location of falling objects. It should be noted that some indicator such as a plotted line may be used to show the original display position even after the original visually recognized position is transformed to the new position.
(d)上述实施例所实施的控制单元110是一种平视显示型投影系统的控制单元。然而,自发光系统或头盔型显示器的控制单元110也能也可以工作,并提供相同的效果。(d) The
(e)只要车辆的点火钥匙处于接通状态并且将要显示的信息存在,就反复地执行上述实施例的显示过程。因此,能够根据此车辆外部的状况,以实时方式自然地改变显示信息传送装置的方法。例如,当信息传送装置正在显示的同时,干扰车辆驶入这辆车前方的道路时,会改变信息传送装置的视觉识别位置。当干扰车辆消失时,就再次改变信息传送装置的视觉识别位置。(e) As long as the ignition key of the vehicle is on and the information to be displayed exists, the display process of the above embodiment is repeatedly performed. Therefore, it is possible to naturally change the method of displaying the information delivery device in a real-time manner according to the situation outside the vehicle. For example, when an interfering vehicle enters the road in front of the vehicle while the telematics device is displaying, the visual identification position of the telematics device may be changed. When the interfering vehicle disappears, the visual recognition position of the information transmission device is changed again.
Claims (12)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200410048467XA CN100487380C (en) | 2004-06-10 | 2004-06-10 | Displaying method and apparatus for changing display position according to external environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200410048467XA CN100487380C (en) | 2004-06-10 | 2004-06-10 | Displaying method and apparatus for changing display position according to external environment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1706697A CN1706697A (en) | 2005-12-14 |
| CN100487380C true CN100487380C (en) | 2009-05-13 |
Family
ID=35580859
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB200410048467XA Expired - Fee Related CN100487380C (en) | 2004-06-10 | 2004-06-10 | Displaying method and apparatus for changing display position according to external environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100487380C (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4702437B2 (en) * | 2008-11-25 | 2011-06-15 | トヨタ自動車株式会社 | Vehicle display device |
| JP5890165B2 (en) | 2011-12-15 | 2016-03-22 | 矢崎総業株式会社 | Head-up display device |
| JP6223630B2 (en) * | 2015-04-17 | 2017-11-01 | 三菱電機株式会社 | Display control apparatus, display system, display control method, and display control program |
| CN105730237A (en) * | 2016-02-04 | 2016-07-06 | 京东方科技集团股份有限公司 | Traveling auxiliary device and method |
| CN106101667B (en) | 2016-06-30 | 2018-09-04 | 京东方科技集团股份有限公司 | Head up display and head up display display methods, mobile devices |
| CN110148224B (en) * | 2019-04-04 | 2020-05-19 | 精电(河源)显示技术有限公司 | HUD image display method, device and terminal equipment |
| CN111452616B (en) * | 2020-03-30 | 2021-10-12 | 广州小鹏汽车科技有限公司 | Information display control method and device and vehicle |
-
2004
- 2004-06-10 CN CNB200410048467XA patent/CN100487380C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1706697A (en) | 2005-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7167779B2 (en) | Display method and apparatus for changing display position based on external environment | |
| US12151560B2 (en) | Superimposed image display device | |
| US7216035B2 (en) | Method and device for displaying navigational information for a vehicle | |
| US12013254B2 (en) | Control device | |
| JP6775188B2 (en) | Head-up display device and display control method | |
| JP2006284458A (en) | Driving support information display system | |
| JP6443716B2 (en) | Image display device, image display method, and image display control program | |
| JP2008001120A (en) | Display control device for vehicle | |
| JP7476568B2 (en) | Superimposed image display device, superimposed image drawing method, and computer program | |
| US11376963B2 (en) | User interface generating apparatus and method for vehicle | |
| CN113165510B (en) | Display control device, method, and computer program | |
| JP2008014754A (en) | Navigation apparatus | |
| CN100487380C (en) | Displaying method and apparatus for changing display position according to external environment | |
| JP2019040634A (en) | Image display device, image display method, and image display control program | |
| JP6186905B2 (en) | In-vehicle display device and program | |
| JP6328366B2 (en) | Display control apparatus and display control method for head-up display | |
| JP4476741B2 (en) | Vehicle display device | |
| JP7571565B2 (en) | Overlay image display device | |
| JP7338632B2 (en) | Display device | |
| JP4534079B2 (en) | Vehicle display device | |
| JP7703954B2 (en) | Overlay image display device | |
| JP2022516849A (en) | Heads-up display systems, methods, data carriers, processing systems and vehicles | |
| JP6884639B2 (en) | Line-of-sight guidance device | |
| WO2023145857A1 (en) | Display system | |
| JP2006040223A (en) | Vehicle display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090513 Termination date: 20190610 |