WO2018198769A1 - Dispositif de reconnaissance d'environnement ambiant et dispositif de commande d'affichage - Google Patents
Dispositif de reconnaissance d'environnement ambiant et dispositif de commande d'affichage Download PDFInfo
- Publication number
- WO2018198769A1 WO2018198769A1 PCT/JP2018/015182 JP2018015182W WO2018198769A1 WO 2018198769 A1 WO2018198769 A1 WO 2018198769A1 JP 2018015182 W JP2018015182 W JP 2018015182W WO 2018198769 A1 WO2018198769 A1 WO 2018198769A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vehicle
- travel
- surrounding environment
- map
- travel risk
- Prior art date
Links
- 230000007613 environmental effect Effects 0.000 claims abstract description 54
- 230000033001 locomotion Effects 0.000 claims abstract description 26
- 230000008859 change Effects 0.000 claims abstract description 12
- 230000002093 peripheral effect Effects 0.000 claims description 8
- 230000007423 decrease Effects 0.000 claims description 7
- 238000013459 approach Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 description 52
- 230000008569 process Effects 0.000 description 47
- 238000012545 processing Methods 0.000 description 34
- 238000004364 calculation method Methods 0.000 description 26
- 230000014509 gene expression Effects 0.000 description 18
- 238000009826 distribution Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 11
- 238000007726 management method Methods 0.000 description 11
- 230000001133 acceleration Effects 0.000 description 7
- 238000012937 correction Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000012447 hatching Effects 0.000 description 3
- 208000019901 Anxiety disease Diseases 0.000 description 2
- 230000036506 anxiety Effects 0.000 description 2
- 230000001149 cognitive effect Effects 0.000 description 2
- 230000001276 controlling effect Effects 0.000 description 2
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 1
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 description 1
- 241000283070 Equus zebra Species 0.000 description 1
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000036461 convulsion Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000008014 freezing Effects 0.000 description 1
- 238000007710 freezing Methods 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0968—Systems involving transmission of navigation instructions to the vehicle
- G08G1/0969—Systems involving transmission of navigation instructions to the vehicle having a display in the form of a map
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
Definitions
- the present invention relates to a surrounding environment recognition device and a display control device.
- Patent Document 1 the risk potential of the subject vehicle calculated based on the predicted travel range of the subject vehicle and the risk potential of the subject calculated based on the predicted motion range of the subject are described.
- a technique for generating a risk potential map that represents the risk of collision between the two for each position based on the overlap is disclosed.
- the risk potential map expresses the degree of risk with a fine granularity (high accuracy) when driving at low speeds, while it is necessary to express a wide range of risks when driving at high speeds in order to judge the safety of the host vehicle.
- a fine granularity high accuracy
- the risk potential map expresses the degree of risk with a fine granularity (high accuracy) when driving at low speeds, while it is necessary to express a wide range of risks when driving at high speeds in order to judge the safety of the host vehicle.
- a surrounding environment recognition device is mounted on a vehicle, recognizes the surrounding environment of the vehicle, and acquires own vehicle information related to the movement of the vehicle including the traveling speed of the vehicle.
- the surrounding environment element acquisition unit for acquiring the surrounding environment element information for the surrounding environment elements of the vehicle, and the vehicle information and the surrounding environment element information, a plurality of surroundings of the vehicle
- a travel risk level determining unit that determines a travel risk level at each position, and an interval between the plurality of positions in the front-rear direction of the vehicle changes according to a travel speed of the vehicle.
- a display control device displays information related to the vehicle on a display device mounted on the vehicle, and displays travel risk levels at a plurality of positions around the vehicle.
- a travel risk level map acquisition unit that acquires the travel risk level map
- a travel risk level map display control unit that displays the travel risk level map acquired by the travel risk level map acquisition unit on the display device.
- the display target range of the travel risk map around the vehicle changes according to the travel speed of the vehicle.
- the present invention it is possible to obtain the degree of risk necessary for the safety judgment while suppressing the calculation amount and the memory consumption amount at both high speed running and low speed running.
- FIG. 1 is a functional block diagram showing an example of the configuration of a travel control system 1 according to an embodiment of the present invention.
- the travel control system 1 according to the present embodiment is mounted on a vehicle 2 and recognizes current and future risks in traveling of the vehicle 2 after recognizing the situation of obstacles such as a traveling road and surrounding vehicles around the vehicle 2. It is a system for judging and performing appropriate driving support and traveling control.
- the travel control system 1 includes a surrounding environment recognition device 10, an in-vehicle display control device 20, a host vehicle position determination device 30, an external sensor group 40, a vehicle sensor group 50, a map information management device 60, a travel A control device 70, an actuator group 80, a display device 90, and the like are included.
- the surrounding environment recognition device 10 is, for example, an ECU (Electronic Control Unit) mounted on the vehicle 2, and includes a processing unit 100, a storage unit 120, and a communication unit 130.
- ECU Electronic Control Unit
- the surrounding environment recognition device 10 may be integrated into the travel control device 70, the external sensor group 40, and the like.
- the processing unit 100 includes, for example, a memory such as a CPU (Central Processing Unit) and a RAM (Random Access Memory).
- the processing unit 100 includes a host vehicle information acquisition unit 101, a surrounding environment element acquisition unit 102, an environment element movement prediction unit 103, an existing time range determination unit 104, a travel risk as a part for realizing the functions of the surrounding environment recognition device 10.
- the processing unit 100 executes processing corresponding to each unit by executing a predetermined operation program stored in the storage unit 120.
- the own vehicle information acquisition unit 101 includes, as the own vehicle information related to the movement of the vehicle 2, for example, the position of the vehicle 2, the traveling speed, the steering angle, the operation amount of the accelerator, the operation amount of the brake, the control plan of the vehicle 2 Information such as a plan for controlling the vehicle 2 with such a trajectory and speed) is acquired from the own vehicle position determination device 30, the vehicle sensor group 50, the travel control device 70, the actuator group 80, and the like.
- the vehicle information acquired by the vehicle information acquisition unit 101 is stored in the storage unit 120 as the vehicle information data group 121.
- the surrounding environment element acquisition unit 102 as surrounding environment element information regarding various environment elements around the vehicle 2, for example, information on obstacles existing around the vehicle 2, features indicating road features around the vehicle 2, etc. Is acquired from the outside world sensor group 40 and the map information management device 60.
- the obstacle existing around the vehicle 2 is, for example, other vehicles moving around the vehicle 2, such as moving vehicles such as bicycles and pedestrians, and parked stationary on the road around the vehicle 2. Vehicles, fallen objects, installations, etc.
- the surrounding environment element information acquired by the surrounding environment element acquisition unit 102 is stored in the storage unit 120 as the surrounding environment element information data group 122.
- the environment element movement prediction unit 103 is based on the surrounding environment element information data group 122 stored in the storage unit 120, and is a moving body such as another vehicle, bicycle, or pedestrian included in the environment element detected by the external sensor group 40. Predict how it will move in the future.
- the movement prediction result of the moving body by the environment element movement prediction unit 103 is added to the surrounding environment element information corresponding to the moving body, and is stored in the storage unit 120 as the surrounding environment element information data group 122.
- the existence time range determination unit 104 is configured to determine a predetermined position around the vehicle 2 based on the own vehicle information data group 121 stored in the storage unit 120 and the movement prediction result of the moving object by the environment element movement prediction unit 103.
- a time range in which the vehicle 2 and environmental elements can exist is determined.
- the vehicle 2 and the environmental element existing time range determined by the existing time range determining unit 104 are referred to as the own vehicle existing time range and the environmental element existing time range, respectively.
- the own vehicle existing time range and the environmental element existing time range determined by the existing time range determining unit 104 are added to the own vehicle information and the surrounding environment element information, respectively, and the own vehicle information data group 121, the surrounding environment element information data Each group 122 is stored in the storage unit 120.
- the travel risk determination unit 105 includes various parameters represented by the parameter data group 123 stored in the storage unit 120, vehicle information and surrounding environment element information represented by the vehicle information data group 121 and the surrounding environment element information data group 122, respectively. Based on the above, the travel risk around the vehicle 2 is determined.
- the travel risk level map creation unit 106 creates a travel risk level map that represents the relationship between each position around the vehicle 2 and the travel risk level based on the travel risk level determination result by the travel risk level determination unit 105.
- Information related to the travel risk map created by the travel risk map creating unit 106 is stored in the storage unit 120 as the travel risk map data group 124.
- the travel risk map providing unit 107 provides information related to the travel risk map of the vehicle 2 based on the travel risk map data group 124 stored in the storage unit 120, other functions in the surrounding environment recognition device 10, This is provided to devices other than the surrounding environment recognition device 10 mounted on the vehicle 2.
- the storage unit 120 includes, for example, a storage device such as an HDD (Hard Disk Drive), flash memory, ROM (Read Only Memory), and a memory such as a RAM (Random Access Memory).
- the storage unit 120 stores a program executed by the processing unit 100, a data group necessary for realizing the system, and the like.
- the vehicle information data group 121, the surrounding environment element information data group 122, the parameter data group 123, and the travel risk map data group 124 are particularly used as information for realizing the function of the surrounding environment recognition device 10. Is stored in the storage unit 120.
- the own vehicle information data group 121 is a collection of data related to the vehicle 2.
- the vehicle information data group 121 includes information on the position of the vehicle 2 acquired from the vehicle position determination device 30 and the state of the vehicle 2 acquired from the vehicle sensor group 50.
- the vehicle information data group 121 also includes a time range in which the vehicle 2 can exist at the position around the vehicle 2, that is, information related to the vehicle existence time range described above.
- the surrounding environment element information data group 122 is a collection of data related to the surrounding environment of the vehicle 2. For example, digital road map data related to roads around the vehicle 2 acquired from the map information management device 60, recognition data of various environmental elements around the vehicle 2 acquired from the external sensor group 40, and these are integrated and generated.
- the surrounding environment element information data group 122 is included in the data.
- Data indicating the movement prediction result of the moving body by the environment element movement prediction unit 103 is also included in the surrounding environment element information data group 122.
- the surrounding environment element information data group 122 also includes information on a time range in which the environmental element can exist at each position around the vehicle 2, that is, the above-described environment element existence time range.
- the surrounding environment element information data group 122 the above data is set for each of a plurality of environment elements.
- “environmental element” means an information element that affects the traveling of the vehicle 2. For example, other vehicles in the vicinity of the vehicle 2, obstacles such as moving objects such as pedestrians and falling objects, road shapes such as lane and road boundary information, speed regulations, traffic rules such as one-way traffic and traffic lights, etc. The element is included in the “environment element” described above. Although these information elements have various properties, they all have a common point that they give meaning to a position or region in the space around the vehicle 2. Therefore, in the present embodiment, these information elements are handled as “environment elements” in a common framework, and are set as data accumulation targets in the surrounding environment element information data group 122.
- time in the present embodiment is indicated in a time system based on a certain reference time point.
- the vehicle 2 and the environmental element at each position around the current position of the vehicle 2 with the present time as the reference time point are determined in which time zone in the future (for example, 2 seconds to 3 seconds later). It can be indicated by the vehicle existence time range or the environmental element existence time range.
- the above “time range” does not necessarily have a wide time, and a specific time point may be set as the own vehicle existing time range or the environmental element existing time range.
- the probability distribution of the time when the vehicle 2 and the environmental element exist at each position around the current position of the vehicle 2 that is, the distribution of the existence probability of the vehicle 2 and the environmental element at each predetermined time interval at each position It may be shown as an existing time range or an environmental element existing time range.
- the parameter data group 123 is a collection of data relating to parameters used by the travel risk map creating unit 106 in creating the travel risk map.
- the parameter data group 123 includes data stored in the storage unit 120 in advance, for example, before shipment of the surrounding environment recognition device 10.
- the travel risk map data group 124 includes data on a travel risk map indicating a relationship between each position around the vehicle 2 and the travel risk of the vehicle 2, that is, the risk when the vehicle 2 travels at the position. It is an aggregate.
- the communication unit 130 transmits and receives data to and from other devices mounted on the vehicle 2 based on various protocols.
- the communication unit 130 includes, for example, a network card that conforms to a communication standard such as Ethernet (registered trademark) or CAN (Controller Area Network).
- the in-vehicle display control device 20 is connected to the display device 90, and includes a processing unit 200, a storage unit 220, a communication unit 230, and a screen input / output unit 240.
- the in-vehicle display control device 20 sends a notification to the driver regarding driving support of the vehicle 2 through the display device 90 based on information output from the surrounding environment recognition device 10 and information output from the travel control device 70. It is configured to perform by voice and screen.
- the processing unit 200 includes a memory such as a CPU and a RAM, for example.
- the processing unit 200 includes a travel risk level map acquisition unit 201, a control plan information acquisition unit 202, and a travel risk level map display control unit 203 as parts for realizing the functions of the in-vehicle display control device 20.
- the processing unit 200 performs a process corresponding to each unit by executing a predetermined operation program stored in the storage unit 220.
- the driving risk map acquisition unit 201 acquires data of the driving risk map output from the surrounding environment recognition device 10 and stores the data in the storage unit 220.
- the control plan information acquisition unit 202 acquires the control plan information of the vehicle 2 output from the travel control device 70 and stores it in the storage unit 220.
- the travel risk map display control unit 203 displays the travel risk map on the screen of the display device 90 via the screen input / output unit 240 based on the travel risk map data stored in the storage unit 220.
- the storage unit 220 includes, for example, a storage device such as an HDD, a flash memory, and a ROM, and a memory such as a RAM.
- the storage unit 220 stores a program executed by the processing unit 200, a data group necessary for realizing the system, and the like.
- the communication unit 230 transmits and receives data to and from other devices mounted on the vehicle 2 based on various protocols.
- the communication unit 230 includes, for example, a network card that conforms to a communication standard such as Ethernet or CAN.
- the screen input / output unit 240 outputs screen display information to the display device 90 and acquires touch panel operation information performed on the screen of the display device 90 by the user.
- the own vehicle position determination device 30 is a device that measures the geographical position of the vehicle 2 and provides the information.
- the own vehicle position determination device 30 is configured by, for example, a global navigation satellite system (GNSS) reception device.
- GNSS global navigation satellite system
- the own vehicle position determination device 30 may be configured to simply provide a positioning result based on the radio wave received from the GNSS satellite.
- interpolation and error correction are performed on the positioning result by the radio wave received from the GNSS satellite.
- the vehicle position determining device 30 may be configured as described above.
- the external sensor group 40 is a sensor group that can recognize obstacles (other vehicles, bicycles, pedestrians, fallen objects, etc.) and characteristic objects (road signs, white lines, landmarks, etc.) around the vehicle 2. is there.
- the outside world sensor group 40 includes, for example, a camera device, a radar, a laser radar, a sonar, and the like.
- the external sensor group 40 is connected to the detected information about obstacles and features around the vehicle 2 (for example, relative distance and relative angle from the vehicle 2) and the external sensor group 40 and the surrounding environment recognition device 10.
- the surrounding environment recognition device 10 is configured to obtain an output result from the external sensor group 40 through the in-vehicle network.
- the external sensor group 40 is configured to perform processing for detecting an obstacle or a feature.
- the surrounding environment recognition device uses signals and data output from the external sensor group 40. 10 and other devices may perform these detection processes.
- the vehicle sensor group 50 is a device group that detects the state of various parts related to the movement of the vehicle 2 (for example, travel speed, steering angle, accelerator operation amount, brake operation amount, etc.). For example, the vehicle sensor group 50 periodically outputs these detected state quantities on an in-vehicle network such as CAN.
- the surrounding environment recognition device 10 and other devices connected to the in-vehicle network are configured to be able to acquire the state quantities of various components output from the vehicle sensor group 50 through the in-vehicle network.
- the map information management device 60 is a device that manages and provides digital map information around the vehicle 2.
- the map information management device 60 is constituted by, for example, a navigation device.
- the map information management device 60 includes, for example, digital road map data of a predetermined area including the periphery of the vehicle 2, and the vehicle on the map is based on the position information of the vehicle 2 determined by the own vehicle position determination device 30. 2, that is, a road or lane on which the vehicle 2 is traveling is specified.
- it is comprised so that the present position of the specified vehicle 2 and its surrounding map data may be provided to the surrounding environment recognition apparatus 10 via vehicle-mounted networks, such as CAN.
- the traveling control device 70 is an ECU for realizing an advanced driving assistance system (ADAS: Advanced Driver Assistance Systems) of the vehicle 2 for the purpose of improving the fuel consumption performance, safety, convenience, and the like of the vehicle 2. Based on the information output from the surrounding environment recognition device 10, the travel control device 70, for example, issues an instruction to the actuator group 80 to automatically control acceleration / deceleration and steering of the vehicle 2, or the in-vehicle display control device 20. Information provision and warning are output to the driver via the display device 90.
- ADAS Advanced Driver Assistance Systems
- Actuator group 80 is a device group that controls control elements such as steering, brakes, and accelerators that determine the movement of vehicle 2.
- the actuator group 80 is configured to control the movement of the vehicle 2 based on operation information such as a steering wheel, a brake pedal, and an accelerator pedal by the driver and a target control value output from the travel control device 70.
- FIG. 2 is a diagram showing an example of a travel risk map represented by the travel risk map data group 124 of the present embodiment.
- the travel risk map data group 124 is data representing a travel risk map indicating the travel risk of the vehicle 2 at each position around the vehicle 2. As shown in FIG. 2, the travel risk map data group 124 includes, for example, a predetermined region ( ⁇ X B m to X F in the x direction) defined by an xy coordinate system centered on the current position of the vehicle 2.
- the traveling risk R (x, y) of the vehicle 2 for each position of the coordinate values (x, y) where x and y are variables are represented in -Y R m to Y L m) in the m and y directions. It is shown.
- the x-axis 250 is a central axis that penetrates the vehicle 2 in the front-rear direction, and the positive direction of the x-axis 250 corresponds to the front direction of the vehicle 2.
- the y-axis 251 is a central axis that penetrates the front portion of the vehicle 2 in the left-right direction, and the positive direction of the y-axis 251 corresponds to the left direction of the vehicle 2.
- the values that can be taken by the coordinate values (x, y) may be continuous values (for example, function expression) or discrete values (for example, grid expression). In the example of the travel risk map shown in FIG.
- the cell length (distance in the x-axis direction between points corresponding to each cell) and cell width (distance in the y-axis direction between points corresponding to each cell) of the travel risk map expressed by the grid map ) are represented by d x and dy, respectively. That is, the cell length d x and cell width d y of each cell represent respectively the spacing in the longitudinal direction and the transverse direction of the vehicle 2 for each position running risk is shown in the traveling risk map. In the example of FIG. 2, d x and dy are common to all cells in the travel risk map, but different d x and dy may be used depending on the position of the cell.
- the value of the travel risk R (x 17 , y ⁇ 4 ) stored in the cell of the coordinate value (x 17 , y ⁇ 4 ) is relative to the vehicle 2 corresponding to this coordinate value. This corresponds to the travel risk of the vehicle 2 at the position.
- the value of the travel risk R (x, y) stored in each cell of FIG. 2 is normalized by integrating the risk due to the interaction between the vehicle 2 and the environmental elements around the vehicle 2 in the cell. The higher the value, the higher the degree of danger when the vehicle 2 travels.
- the value of the travel risk R (x, y) of the vehicle 2 in each cell is represented by hatching, and the darker the hatching, the higher the travel risk.
- the surrounding environment recognition device 10 of the travel control system 1 includes a vehicle 2 and a vehicle acquired from the own vehicle position determination device 30, the external sensor group 40, the vehicle sensor group 50, and the map information management device 60, which are external devices. 2. Based on the information about the surrounding environmental elements, the surrounding environment recognition process as described below is executed to create the travel risk map around the vehicle 2 as described above. Then, the generated travel risk degree map is output to the in-vehicle display control device 20 and the travel control device 70. For example, the travel control device 70 plans a trajectory that allows the vehicle 2 to travel safely based on the acquired travel risk degree map, and controls the travel of the vehicle 2 via the actuator group 80.
- the in-vehicle display control device 20 displays, for example, the acquired travel risk map and the control plan information output from the travel control device 70, and presents the state of the travel control system 1 to the driver and the occupant. By these operations, driving assistance of the vehicle 2 is performed.
- FIG. 3 is a diagram showing a surrounding environment recognition processing flow 500 executed by the surrounding environment recognition device 10 in the travel control system 1 of the present embodiment.
- the vehicle information acquisition unit 101 waits for a predetermined time in step S501.
- the process waits for a period of time until the driving risk map generation is triggered for the surrounding environment recognition device 10 without proceeding with the processing.
- the trigger may be applied by a timer so that the travel risk map is generated at regular intervals, or may be applied on demand by detecting the necessity of updating the travel risk map.
- the vehicle information acquisition unit 101 acquires information about the vehicle 2 from the vehicle information data group 121 of the storage unit 120 as the vehicle information necessary for the surrounding environment recognition process.
- the position information of the vehicle 2 acquired from the own vehicle position determination device 30, the information related to the state of the vehicle 2 acquired from the vehicle sensor group 50, the control plan information of the vehicle 2 acquired from the travel control device 70, Etc. are acquired as own vehicle information.
- the information on the state of the vehicle 2 may indicate the current state of the vehicle 2 such as the speed, acceleration, steering angle, accelerator opening degree, yaw rate, etc. of the vehicle 2 or an average of past predetermined times (for example, 1 second).
- Statistical information related to the vehicle 2 may be shown like the speed, or predicted information related to the vehicle 2 like the predicted average speed for a predetermined time (for example, 5 seconds) in the future. As described above, these pieces of information are acquired from the own vehicle position determination device 30, the vehicle sensor group 50, the travel control device 70, and the like by the own vehicle information acquisition unit 101 at an appropriate timing via the vehicle network or the like. Information or information processed based on the information (for example, statistical information) is stored in the storage unit 120 as the vehicle information data group 121.
- the surrounding environment element acquisition unit 102 acquires information about the environment elements around the vehicle 2 from the surrounding environment element information data group 122 of the storage unit 120 as the surrounding environment element information necessary for the surrounding environment recognition processing.
- digital road map data related to roads around the vehicle 2 acquired from the map information management device 60 and recognition data of various environmental elements around the vehicle 2 acquired from the external sensor group 40 are acquired as peripheral environment element information.
- the recognition data of environmental elements around the vehicle 2 includes obstacles (other vehicles, people, fallen objects, etc.), road shapes (road edges, white lines, stop lines, zebra zones, etc.), road surface conditions (freezing, puddles, pots) Information indicating the recognition status such as hall).
- these pieces of information are acquired from the external sensor group 40 and the map information management device 60 by the peripheral environment element acquisition unit 102 through the vehicle network or the like at an appropriate timing, and are stored in the storage unit 120 in the peripheral environment element.
- the information data group 122 is stored. This may be appropriately integrated by so-called fusion processing.
- the environmental element movement prediction unit 103 determines whether or not environmental elements (vehicles, people, etc.) that can move around the vehicle 2 are within a predetermined time based on the surrounding environmental element information acquired in step S503.
- the movement prediction information indicating how to move is generated.
- recognition information relative position, moving direction, moving speed, etc.
- surrounding conditions road shape, traffic rules, obstacles
- the movement prediction information is expressed, for example, by a list of predetermined time (for example, 1 second, 2 seconds,...) And estimated position information at the time.
- step S505 the travel risk level map creation unit 106 executes a travel risk level map parameter determination process based on the information related to the state of the vehicle 2 acquired as the vehicle information in step S502.
- This driving risk map parameter determination process is a process for determining parameters related to the driving risk map created in the following steps and storing them in the storage unit 120 as part of the parameter data group 123. Details of the travel risk map parameter determination processing will be described below with reference to FIGS. 4 and 5.
- step S506 the existence time range determination unit 104 determines the vehicle based on the vehicle information acquired in step S502 and the parameters related to the travel risk map determined in the travel risk map parameter determination process in step S505.
- the vehicle presence time range determination process 600 for determining the second existence time range map is executed. Details of the vehicle existence time range determination processing 600 will be described below with reference to FIGS. 6 and 7.
- step S507 the existence time range determination unit 104 determines an environment element existence time range determination process 700 that determines an existence time range map of each environment element based on the result of the surrounding environment element movement prediction performed in step S504. Execute. Details of the environment element existence time range determination processing 700 will be described below with reference to FIG.
- the travel risk map creating unit 106 executes a travel risk map creating process 800 for creating a travel risk map around the vehicle 2 in step S508.
- a travel risk map creating process 800 for creating a travel risk map around the vehicle 2 in step S508.
- the vehicle 2 travels around the vehicle 2 Create a risk map. Details of the travel risk map creation processing 800 will be described below with reference to FIGS. 9 and 10.
- the travel risk map providing unit 107 transmits the created travel risk map data to the in-vehicle display control device 20, the travel control device 70, and the like in step S509. Output.
- the data format of the output travel risk map will be described below with reference to FIG.
- step S501 After executing the above-described steps S501 to S509, the process returns to step S501, and these steps are repeatedly executed.
- step S505 of FIG. 3 the driving risk map parameter determination process executed in step S505 of FIG. 3 will be described.
- the expression format of the travel risk map is determined according to the policy described below, and the parameters corresponding to the expression format are determined.
- the travel risk map is used, for example, when the travel control device 70 plans the travel path of the vehicle 2. If the target time of the planned travel path is T seconds, the travel risk map needs to represent at least a region where the vehicle 2 travels in T seconds.
- the travel speed of the vehicle 2 is v, in the traveling direction of the vehicle 2 (x-axis direction)
- the area to be expressed on the map extends in proportion to the traveling speed v.
- the accuracy of the travel risk map required in the travel track planning changes according to the travel speed of the vehicle 2. For example, when it is necessary to control the vehicle 2 that sews a gap at a low speed, such as a parking lot or an alley, an expression with a fine granularity (for example, 10 cm) is required in the travel risk map.
- a fine granularity for example, 10 cm
- the travel risk map is displayed with a fine granularity (for example, 10 cm) with respect to the traveling direction of the vehicle 2. There is no need to express.
- the danger level relating to vehicle travel is determined on a time scale, such as TTC (Time To Collation) used as an index of the collision risk degree. From these facts, it is considered that it is a time scale that requires a certain accuracy in the expression of the travel risk map.
- TTC Time To Collation
- a is a value corresponding to the expression accuracy of the travel risk map on the time scale.
- the width d y of each cell in the transverse direction of the vehicle 2 is set to a constant value relative to the running speed v of the vehicle 2.
- the vehicle 2 such that the area to proceed to T seconds is at least expressed on running the risk map, the length and d x and width d y of each cell, the number of cells is set.
- the number of cells N x + in the traveling direction of the vehicle 2, that is, the positive x-axis direction, and the number of cells N y + and N y ⁇ in the lateral direction of the vehicle 2, that is, the y-axis positive and negative directions 8).
- the number of cells N x + , N y + and N y ⁇ are all expressed as constants that do not depend on the traveling speed v. Therefore, the number of cells required for the travel risk map can always be kept constant regardless of the travel speed v of the vehicle 2. This means that the memory usage necessary for the travel risk map can be defined to a constant value, and it is easy to design with a built-in device with memory restrictions such as the surrounding environment recognition device 10. can do.
- the lateral direction and the distance L y of the vehicle 2 travels within the predetermined time as described above is constant regardless of the traveling speed v, so as to satisfy the required accuracy in a fixed width d y of each cell
- the risk map may be increased as the distance from the x-axis 250.
- the cell width d y of each cell varies depending on the lateral position y n, similarly to the cell length d x a time on the scale, it can always be maintained the representation accuracy of a seconds. In this way, the number of cells N y + and N y ⁇ in the horizontal direction can be kept small compared to the case where the cell width dy is fixed, and thus the memory consumption can be further reduced.
- the length d x of each cell of the travel risk map is determined based on the travel speed v of the vehicle 2 according to the policy described above, and each cell You can determine the width d y. And the parameter according to these determined values can be determined.
- FIG. 4 is an example of a graph showing the relationship between the traveling speed v of the vehicle 2 and the cell length d x of the traveling risk map.
- the horizontal axis represents the traveling speed v of the vehicle 2
- the vertical axis represents the cell length d x of the driving risk map.
- the cell length d x is changed in proportion to the traveling speed v while the traveling speed v is predetermined. when less than the value V th, the cell length d x a fixed value d x0. In this way, it is possible to avoid making the cell length d x smaller than necessary when the vehicle 2 is traveling at a low speed. That is, if the cell length d x is simply proportional to the speed, the cell length d x is required for the accuracy required for the recognition accuracy of the external sensor group 40 and the safety judgment when the traveling speed v is small.
- the position of the vehicle 2 in the travel risk map may be changed according to the travel speed v of the vehicle 2.
- the traveling speed v is low, that is, when the vehicle 2 travels at a low speed or stops, the vehicle 2 may travel backward due to the back travel. Therefore, in this case, it is important to express the degree of travel risk with respect to the rear of the vehicle 2, and it is necessary to satisfy X B > 0.
- the traveling risk level in front of the vehicle 2 is excessively expressed.
- the position of the vehicle 2 on the driving risk map is determined in the driving risk map parameter determination process.
- the parameter is determined so as to change according to the traveling speed v. More specifically, for example, as shown in the graph of FIG. 5, the travel risk map of the anterior length X F and the rear length X B a may be set respectively according to the running speed v.
- FIG. 5 is an example of a graph showing the relationship between the travel speed v of the vehicle 2 and the lengths X F and X B in the front-rear direction of the travel risk map and the number of cells N x + and N x ⁇ . In the graph 402 of FIG.
- the horizontal axis represents the traveling speed v of the vehicle 2
- the upper direction of the vertical axis represents the forward length X F of the traveling risk map, under the direction of the longitudinal axis of the rear length X B Represents.
- Thick line 421 of the graph 402 represents the relationship between the traveling speed v and the front length X F in the present embodiment
- the thick line 422 represents the relationship between the traveling speed v and the rear length X B according to this embodiment.
- the horizontal axis represents the traveling speed v of the vehicle 2
- the vertical axis represents the number of cells in the traveling risk map in the front-rear direction of the vehicle 2.
- Dashed 431 of graph 403 represents the traveling speed v and the front cell number N x + relationship in the present embodiment
- the dashed line 432 represents the traveling velocity v and the rear cell number N x- relationship in this embodiment.
- a downward vertical axis in the graph 402 shows the one obtained by reversing the sign of the right side of equation (11) by a thick line 422.
- the relationship between the number of front cells N x + and the front length X F and the relationship between the number of rear cells N x ⁇ and the rear length X B are as shown in the above-described equations (1) and (2), respectively. is there.
- X F T ⁇ v + A lon ⁇ T 2/2 ⁇ (10)
- X B ⁇ (X F ⁇ X F0 ) (11)
- the longitudinal direction of the running risk map as described above because respectively control the length X F and X B while keeping the total number of cells in the constant position with respect to the traveling direction of the vehicle 2 in the traveling risk map This corresponds to changing (the number of rear cells N x ⁇ ) according to the traveling speed v. That is, in the example of the graph 402 in FIG. 5, as shown by the graph 403, the number of rear cells N x ⁇ changes according to the traveling speed v.
- the current travel speed of the vehicle 2 may be used as the travel speed v of the vehicle 2, or an average over a past predetermined time (for example, 1 second). Statistical speeds such as speed may be used. Moreover, the prediction information regarding the vehicle 2 may be shown like a predicted average speed for a predetermined time in the future (for example, 5 seconds).
- the cell position (cell length, cell width) of the travel risk map and the position of the vehicle 2 are set as described above, and parameters according to these setting results. Is stored in the storage unit 120 as the parameter data group 123. By creating a travel risk map using the parameters determined in this way, memory consumption is suppressed while satisfying the required accuracy and required range for the travel risk map necessary for judging the safety of the vehicle 2 for travel. Is possible.
- FIG. 6 is a diagram illustrating an example of a flowchart of the own vehicle presence time range determination process 600.
- the existence time range determination unit 104 acquires parameter data related to the travel risk map from the parameter data group 123 of the storage unit 120 in step S601.
- the parameter data relating to the travel risk map acquired here is the parameter data determined in the travel risk map parameter determination process in step S505 in FIG. 3 or the ROM or the like in advance before shipping the surrounding environment recognition device 10.
- the parameter data stored in the storage unit 120 is included.
- the existence time range determination unit 104 determines the driving distance D (x, y) at the position (x, y) corresponding to each cell of the travel risk map in step S602. Subsequently, in step S603, the existence time range determination unit 104 considers the vehicle speed, acceleration, jerk, and the like of the vehicle 2 based on the driving distance D (x, y) determined in step S602. The existence time range TED (x, y) of is calculated. Then, in step S604, the existence time range determination unit 104 constructs an existence time range map of the vehicle 2 based on the calculation result of the existence time range TED (x, y) performed in step S603. Set in the car information data group 121. If the process of step S604 is executed, the existing time range determining unit 104 ends the own vehicle existing time range determining process 600.
- FIG. 7 is a diagram showing an example of the existence time range map 300 of the vehicle 2 in the own vehicle information data group 121.
- the driving distance D (x, y) determined in step S602 is a distance corresponding to the road until the vehicle 2 reaches the position of the coordinate value (x, y).
- the trajectory for the corresponding position is, for example, a fan-shaped arc having a center point on the y-axis 321 in FIG. 7 and passing through the origin and the corresponding position, or a spline curve whose tangent line between the origin and the corresponding position is the x-axis 320. Etc. are considered.
- a trajectory 331 with respect to (x a , y a ) and a trajectory 332 with respect to (x b , y b ) are shown.
- the operating distance D (x, y) when the sector arc model is used is represented by the product of the sector radius r (x, y) and the sector central angle ⁇ (x, y).
- the values of the radius r (x, y) and the central angle ⁇ (x, y) with respect to the coordinate value (x, y) can be calculated using the following equations (12) and (13), respectively.
- r (x, y) (x 2 + y 2 ) / 2y (12)
- ⁇ (x, y) arctan (x / (ry)) (13)
- the existing time range TED (x, y) calculated in step S603 is a distribution expressing the probability that the vehicle 2 exists at the position at each time.
- (x a, y a ) present time range TED (x a, y a) corresponding to a, (x b, y b) present time corresponding to the range TED (x b , Y b ) are represented as time probability distributions 301 and 302, respectively.
- the time probability distributions 301 and 302 may be approximated.
- the average arrival time T r (x, y) for the position may be treated as a representative value.
- approximation may be made with a Gaussian distribution in which the average value ⁇ is T r (x, y) and the variance value ⁇ 2 is f (T r ).
- the reason why the variance value ⁇ 2 is expressed by the function f of T r is that the time zone in which the vehicle 2 can exist stochastically increases as time elapses.
- the average arrival time T r (x, y) is calculated, for example, by dividing the driving distance D (x, y) by the traveling speed v using the traveling speed v of the vehicle 2 described above.
- the driving distance D (x, y) and the existence time range TED (x, y) need to be calculated for all cell positions in the travel risk map.
- the driving distance D (x, y) does not change even if the traveling speed v of the vehicle 2 changes. Therefore, by storing the calculation result in the storage unit 120 in advance.
- the driving distance D (x, y) can be determined with reference to it. Therefore, it is possible to reduce the calculation amount.
- the driving distance D (x, y) changes according to the traveling speed v.
- the above formula (14) is derived from the above formulas (12) and (13) when the driving distance D (x, y) has the characteristics as the following formula (15).
- D (k ⁇ x, k ⁇ y) k ⁇ D (x, y) (15)
- Expression (14) refers to the existence time range TED (x, y, V th ) when the existence time range TED (x, y, v) at an arbitrary velocity v ( ⁇ V th ) is the velocity V th . It means that it is obtained by. Therefore, in the present embodiment, the existing time range TED (x, y, V th ) at the speed V th is calculated in advance and stored in the storage unit 120 such as the ROM, so that steps S602 and S603 are performed. It is possible to greatly reduce the amount of calculation processing. When v ⁇ Vth , the cell size is fixed as described above, so that the driving distance D (x, y) is calculated in advance as in the case where the conventional cell size is not changed. By storing the data in the storage unit 120 such as a ROM, the amount of calculation can be reduced.
- the cell length d x in the traveling direction of the vehicle 2 is set to be proportional to the traveling speed v, so that it is necessary to calculate the travel risk using the previous calculation result. It is possible to perform calculations and the amount of calculations is reduced. Unlike the present embodiment, when the cell size is changed without being proportional to the traveling speed v, it is difficult to perform the above-described pre-calculation, so the amount of calculation cannot be reduced. This point should be noted in the present invention.
- FIG. 8 is a diagram illustrating an example of a flowchart of the environment element existence time range determination process 700.
- the existence time range determination unit 104 refers to the surrounding environment element information data group 122 in step S701, and selects one of the environment elements existing around the vehicle 2.
- step S702 the existence time range determination unit 104 determines whether the environmental element selected in step S701 is a moving body such as another vehicle, a bicycle, or a pedestrian. As a result, if the environmental element is a moving object, the process proceeds to step S703, and if not, the process proceeds to step S706.
- step S702 If it is determined in step S702 that the environmental element is a moving object, the existence time range determination unit 104 refers to the surrounding environmental element information data group 122 in step S703, and obtains a movement prediction result for the environmental element selected in step S701. Get the information shown.
- step S704 the existence time range determination unit 104 calculates the existence time range ETED (x, y) of the environment element at the position based on the movement prediction result of the environment element acquired in step S703.
- the travel risk map is used to determine the risk of the trajectory of the vehicle 2, and therefore, it should not be assumed that the vehicle 2 draws a specific travel trajectory. Therefore, in the above-described own vehicle existence time range determination process 600, it is necessary to calculate the existence time range of the vehicle 2 for all cell positions.
- the travel trajectory is predicted to determine the degree of risk. Therefore, the existence time range may be calculated only for the cell position related to the predicted travel path of the environment element indicated by the movement prediction result acquired in step S703.
- the existence time range determination unit 104 sets the environment element existence time range map in the surrounding environment element information data group 122 based on the calculation result in step S705.
- the existence time range determination unit 104 determines in step S706 whether all the environmental elements existing around the vehicle 2 have been selected in step S701. If there is an unselected environmental element, the process returns to step S701, and one of the environmental elements is selected in step S701, and then the process from step S702 onward is performed on the environmental element. On the other hand, when all the environmental elements have been selected, the existence time range determination unit 104 ends the environment element existence time range determination processing 700.
- the travel risk map creation unit 106 calculates coordinate values (x, y) corresponding to each cell of the travel risk map according to the parameters determined by the travel risk map parameter determination process executed in step S505 of FIG. decide.
- the travel risk determination unit 105 executes the vehicle 2 existence time range map created by the vehicle existence time range determination processing 600 executed in step S506 of FIG. 3 and the step S507 of FIG.
- the travel risk degree R (x, y) at the coordinate value (x, y) is calculated using the existing time range map of each environmental element created by the environment element existing time range determination processing 700.
- the travel risk level map creating unit 106 generates a travel risk level map based on the travel risk level R (x, y) calculated by the travel risk level determination unit 105, and travel risk level map data stored in the storage unit 120. Store in group 124.
- the driving risk R (x, y) is, for example, a weighted integrated value of the risk caused by each environmental element, and is represented by, for example, the following expression (16).
- R (x, y) w 1 ⁇ r 1 (x, y) +... + W n ⁇ r n (x, y) (16)
- the travel risk, R (x, y) may be calculated by the maximum value of the weighting of risk posed by the environmental factors (maximum value of w i ⁇ r i (x, y)).
- Running the risk r i on environmental element i using the present time range map of the vehicle 2 that has been generated in step S506 in FIG. 3, the presence time range map of each environmental elements generated in step S507 in FIG. 3 Calculated.
- the driving risk at each position on the map is calculated.
- a formula for calculating the travel risk R (x, y) of the vehicle 2 with respect to the environmental element i based on the probability distribution of the existence time range is expressed by, for example, the following formula (17).
- p (x, y) (t) represents a probability distribution of the existence time range of the vehicle 2
- p i (x, y) (t) represents the existence time range of the environmental element i. Represents a probability distribution.
- the driving risk R (x, y ) May be calculated.
- the above equation (18) is obtained by the function f (x) based on the absolute value of the difference between the representative value T repre of the existing time range of the vehicle 2 and the representative value T (i) repre of the existing time range of the environmental element i. It evaluates the driving risk.
- the function f (x) is a function that decreases in value as x increases.
- the magnitude of the function f (x) and the degree of attenuation are determined using, for example, the correction coefficients a and b according to the representative value T repre of the existing time range of the vehicle 2 and the vehicle speed of the vehicle 2. May be adjusted. Further, the probability distribution of the existence time range of the vehicle 2 and each environmental element may be approximated by a predetermined distribution (Gaussian distribution or the like) centered on the representative value, and the driving risk may be calculated by superimposing them.
- the travel risk level of the vehicle 2 is highly accurate in a form that matches the actual situation. Can be calculated.
- FIG. 9 is a diagram illustrating an example of a traveling road environment of the vehicle 2.
- FIG. 9 shows a scene in which the vehicle 2 is traveling on an opposite two-lane road.
- another vehicle 452 is parked on the road in the opposite lane near the vehicle 2, and the other vehicle 451 is about to pass the parked vehicle (other vehicle 452). Since this road is not wide enough, the other vehicle 451 needs to protrude into the opposite lane (the lane in which the vehicle 2 is traveling) in the process of overtaking the parked vehicle.
- the other vehicle 453 is traveling at the same speed as the vehicle 2 in front of the vehicle 2.
- areas 461, 462, and 463 indicated by hatching indicate the ranges of predicted traveling tracks of the other vehicles 451, 452, and 453, respectively.
- 460 indicated by a dotted line indicates a predicted traveling path when the vehicle 2 continues traveling so far.
- FIG. 10 is a generation example of a travel risk map in the scene shown in FIG.
- the travel risk map 802 is more forward of the vehicle 2 than the travel risk map 801. (X Fb > X Fa ).
- Regions 810 and 811 correspond to a non-road region and a roadside belt region on the traveling lane side of the vehicle 2, and a region 812 corresponds to a traveling lane region.
- An area 813 corresponds to an oncoming lane area including a roadside zone, and an area 814 corresponds to a non-road area on the oncoming lane side.
- regions 810 to 814 are not shown in the travel risk map 802, they are the same as the travel risk map 801.
- the travel risk in the areas 810 to 814 shown in the travel risk maps 801 and 802 are recognized as road attributes indicated by static environmental elements, and the travel risk is assigned to the corresponding cell according to the respective travel risk models. It is obtained by integrating.
- an area 815 of the travel risk map 801 and an area 817 of the travel risk map 802, an area 816 of the travel risk map 801, and an area 818 of the travel risk map 802 are travel risk levels by the other vehicles 451 and 452, respectively. Is expressed. Since the other vehicle 452 is a parked vehicle and continues to exist on the spot, a very high traveling risk is set in the vicinity of the other vehicle 452 regardless of the speed of the vehicle 2 as shown in regions 816 and 818. In these areas, the collision probability is 1 when the vehicle 2 travels through the corresponding position.
- the other vehicle 451 is a moving vehicle, and the region where the vehicle 2 and the existence time range overlap varies depending on the relative speed with the vehicle 2.
- the travel risk is set as in the area 815 in the travel risk map 801.
- the traveling track of the vehicle 2 and the traveling track of the other vehicle 451 are the timing before the other vehicle 451 protrudes into the traveling lane of the vehicle 2. Intersect with each other in time. Therefore, the travel risk is set as in the area 817 in the travel risk map 802.
- the travel control device 70 when the travel control device 70 performs travel control of the vehicle 2 using the travel risk map 801, the travel control device 70 avoids the region 815 in order to avoid a collision risk with the other vehicle 451. A track that travels to the left of the travel lane 812 is selected.
- the travel control of the vehicle 2 is performed using the travel risk map 802, a track that travels in the center of the travel lane is selected without selecting an unnecessary avoidance track. In this way, it is possible to easily determine a safe and comfortable traveling path according to the situation.
- FIG. 11 is an explanatory diagram showing an example of the data format 850 of the travel risk map output by the travel risk map providing unit 107 of the surrounding environment recognition device 10 according to the present embodiment. However, illustration of header information related to the communication protocol is omitted.
- the driving risk map data output from the surrounding environment recognition apparatus 10 includes a total cell number 851, a cell number 852 in the X direction, a cell number 853 in the Y direction, and a cell in the X direction.
- Length 854 cell length 855 in the Y direction, own vehicle position 856, own vehicle speed 857, travel risk information 858, and the like.
- the total number of cells 851 is data indicating the total number of cells constituting the travel risk map, which is equivalent to the product of the number of cells 852 in the X direction and the number of cells 853 in the Y direction.
- the cell length 854 in the X direction and the cell length 855 in the Y direction are data indicating the length in the front-rear direction and the left-right direction of the vehicle 2 of each cell in the travel risk map, respectively. is d x, it corresponds to the cell width d y.
- the own vehicle position 856 is data indicating which cell position the vehicle 2 is set on the travel risk map, and is expressed by, for example, coordinates of (position in the X direction, position in the Y direction).
- the own vehicle speed 857 is data indicating the traveling speed v of the vehicle 2 as a reference when the travel risk map is generated.
- the traveling speed v of the vehicle 2 here may be a current speed, a statistical speed, or a speed based on a future prediction as described above.
- the travel risk information 858 is data indicating information related to the travel risk of each cell in the travel risk map.
- the driving risk is expressed by a numerical value (for example, 0 to 100) within a predetermined range. For example, the larger the numerical value, the higher the risk.
- the value of the cell length 854 in the X direction is the value of the own vehicle speed 857 in the data of the travel risk map. Changes in proportion to As described with reference to FIG. 5, since the position of the vehicle 2 on the travel risk map changes according to the travel speed v, the value of the position 856 (particularly the x component) of the host vehicle is also the value of the host vehicle speed 857. It changes according to the value. On the other hand, other data values of reference numerals 851 to 853 and 855 do not change even if the value of the host vehicle speed 857 changes.
- the output data length of the travel risk map is a fixed length. Therefore, in the travel control device 70 and the in-vehicle display control device 20 that receive and process the data of the travel risk map from the surrounding environment recognition device 10, the amount of memory used for the process related to the travel risk map is deterministically estimated. This has the advantage of being easy to design.
- FIG. 12 is a diagram illustrating an example of a travel risk map display processing flow 900 executed by the in-vehicle display control device 20.
- the travel risk level map acquisition unit 201 acquires the travel risk level map output from the surrounding environment recognition apparatus 10 according to the data format 850 of FIG. 11 in step S901.
- control plan information acquisition unit 202 acquires the control plan information output from the travel control device 70 in step S902.
- the control plan information includes information on the travel path determined by the travel control device 70 based on the travel risk map.
- step S903 the travel risk map display control unit 203 generates screen information to be transmitted to the driver or the occupant using the travel risk map and the control plan information acquired in steps S901 and S902. . Then, the generated screen information is output to the display device 90 via the screen input / output unit 240 and displayed on the display device 90.
- FIG. 13 is a diagram illustrating an example of a display screen in the display device 90.
- Display screens 1001 and 1002 correspond to display screen examples when the travel risk maps 801 and 802 in FIG. 10 are acquired, respectively.
- panels 1011 and 1021 for displaying cognitive information by sensors and maps are arranged on the left side of the display screens 1001 and 1002, respectively, and the travel risk map and the travel control device 70 are determined on the right side of the display screen.
- Panels 1012, 1022 for displaying the travel trajectories are arranged. Note that the travel risk degree maps of the panels 1012, 1022 are represented by distance scales 1014, 1024 corresponding to the distance from the vehicle 2, respectively.
- the traveling tracks 1013 and 1023 of the vehicle 2 are superimposed on the traveling risk map. Accordingly, the driver or the occupant can grasp what kind of situation (risk) the vehicle 2 has traveled or how the vehicle 2 will travel in the future.
- a driver or an occupant may feel anxiety because he / she does not know what purpose the driving control system is controlling the vehicle. Therefore, like the display screens 1001 and 1002 of the present embodiment, by showing the determination contents (traveling trajectory) of the traveling control system 1 and the grounds (traveling risk degree map and cognitive information), the driver and the occupant's anxiety. It becomes possible to reduce.
- the display screen 90 in the display device 90 has a feature. Specifically, on the display screen 1002, the travel speed v is larger than that on the display screen 1001, and thus the display target range of the travel risk map extends to the front (traveling direction) of the vehicle 2. Further, although not shown in the example of FIG. 13, the position of the vehicle 2 on the travel risk map similarly changes according to the travel speed v. Specifically, when the position of the vehicle 2 changes as described with reference to FIG. 5, the position of the vehicle 2 approaches the center of the travel risk map as the travel speed v decreases and decreases, It looks like it gradually shifts upward. As described above, the change in the target area of the travel risk map on the display screen and the position of the vehicle 2 in accordance with the change in the travel speed of the vehicle 2 is one of the features of the present embodiment.
- the display target range of the travel risk map increases in proportion to the increase.
- the entire travel risk map is reduced (for example, in the front-rear direction) and displayed during high-speed travel due to restrictions on the screen size of the display device 90 or the like. , It may be necessary not to display a part.
- a method of expressing the travel risk map on a time scale instead of a distance scale by using the fact that the travel risk map extends in proportion to the speed of the vehicle 2 can be considered.
- FIG. 14 is a diagram illustrating an example of a display screen in the display device 90 when each is expressed by a distance scale and a time scale.
- a display screen 1003 is an example of a display screen on a distance scale when the traveling speed v of the vehicle 2 is smaller than the predetermined value Vth
- the display screen 1004 shows that the traveling speed v of the vehicle 2 is predetermined.
- the example of the display screen in the time scale in case it is more than the value Vth is shown.
- panels 1031 and 1041 for displaying recognition information by sensors, maps, etc. are arranged on the left side, and a driving risk map and the right side are displayed.
- Panels 1032 and 1042 for displaying the traveling tracks determined by the traveling control device 70 are arranged. Further, on the panels 1032 and 1042, the traveling tracks 1033 and 1043 of the vehicle 2 are superimposed and displayed on the traveling risk map.
- the travel risk map is expressed by switching between the distance scale and the time scale according to the travel speed of the vehicle 2.
- the display target range of the travel risk map is always constant even during high-speed travel, so that stable display is possible.
- the required accuracy and requirements required for the safety judgment are set. While satisfying the range, the required number of cells in the travel risk map can always be kept constant. As a result, the amount of memory consumed by the travel risk map can be reduced and can be regulated to a constant value, and the design with a built-in device with memory restrictions becomes easy.
- the calculation necessary for calculating the traveling risk is calculated in advance. It is possible to reduce the amount of calculation.
- the surrounding environment recognition device 10 is mounted on the vehicle 2 and recognizes the surrounding environment of the vehicle 2.
- the peripheral environment recognition apparatus 10 includes a host vehicle information acquisition unit 101 that acquires host vehicle information regarding movement of the vehicle 2 including the traveling speed of the vehicle 2, and a peripheral environment that acquires peripheral environment element information for environmental elements around the vehicle 2.
- An element acquisition unit 102 and a travel risk determination unit 105 that determines travel risk levels at a plurality of positions around the vehicle 2 based on the vehicle information and the surrounding environment element information are provided.
- the interval between a plurality of positions in the front-rear direction of the vehicle 2, that is, the length d x of each cell in the travel risk map changes according to the travel speed v of the vehicle 2. Since it did in this way, the danger required for judgment of safety can be calculated
- the interval between a plurality of positions in the front-rear direction of the vehicle 2, that is, the length d x of each cell in the travel risk map is such that the travel speed v of the vehicle 2 when the travel speed v of the vehicle 2 is equal to or greater than a predetermined value Vth. It is assumed that it is constant when the traveling speed v of the vehicle 2 is less than a predetermined value Vth . Since it did in this way, when the vehicle 2 is drive
- the number of the plurality of positions that is, the total number of cells in the travel risk map is constant with respect to the change in the travel speed v of the vehicle 2. Since it did in this way, in the apparatus which receives and processes the data of the driving risk map from the surrounding environment recognition device 10, the amount of memory used for the processing related to the driving risk map can be estimated deterministically. Can be simplified.
- the surrounding environment recognition device 10 further includes a travel risk map creating unit 106 that creates a travel risk map that represents the relationship between each of a plurality of positions around the vehicle 2 and the travel risk. Since it did in this way, the crossing relationship on the time axis of the vehicle 2 and each environmental element was projected on the parameter
- a travel risk map can be provided.
- the surrounding environment recognition device 10 determines the own vehicle existing time range indicating the existing time range of the vehicle 2 for each of a plurality of positions around the vehicle 2 based on the own vehicle information, and the surrounding environment element information Is further provided with an existence time range determination unit 104 that determines an environment element existence time range that represents the existence time range of the environment element for each of a plurality of positions around the vehicle 2.
- the travel risk level determination unit 105 determines travel risk levels at a plurality of positions based on the own vehicle presence time range and the environmental element presence time range determined by the presence time range determination unit 104. Since it did in this way, the driving
- the in-vehicle display control device 20 displays information related to the vehicle 2 on the display device 90 mounted on the vehicle 2.
- the in-vehicle display control device 20 has been acquired by a travel risk map acquisition unit 201 that acquires a travel risk map representing travel risk levels at a plurality of positions around the vehicle 2, and the travel risk map acquisition unit 201.
- a travel risk map display control unit 203 that causes the display device 90 to display a travel risk map.
- the display target range of the travel risk map around the vehicle 2 changes according to the travel speed v of the vehicle 2. Since it did in this way, the danger required for judgment of safety can be expressed with a driving
- working is a traveling risk map.
- the travel risk map is divided into a plurality of cells respectively corresponding to a plurality of positions, and the cell size in the travel risk map is such that the travel speed v of the vehicle 2 is equal to or greater than a predetermined value Vth. It changes according to the traveling speed v of the vehicle 2, and is constant when the traveling speed v of the vehicle 2 is less than a predetermined value Vth . Since it did in this way, when the vehicle 2 is drive
- the position of the vehicle 2 in the travel risk map changes according to the travel speed v of the vehicle 2. Specifically, the position of the vehicle 2 approaches the center of the travel risk map as the travel speed v of the vehicle 2 decreases.
- the travel risk map is expanded to a necessary range while suppressing an increase in calculation amount and memory consumption. can do.
- the travel risk map is divided into a plurality of cells respectively corresponding to a plurality of positions.
- the travel risk map is a time scale corresponding to the arrival time of the vehicle 2. It may be expressed as a distance scale corresponding to the distance from the vehicle 2 when the traveling speed v of the vehicle 2 is less than the predetermined value Vth . In this way, it is possible to display a stable and easy-to-see travel risk map with the display target range of the travel risk map always being constant even during high-speed travel.
- each process of the surrounding environment recognition apparatus 10 is realized by executing a predetermined operation program using a processor and a RAM, but is realized by original hardware as necessary. It is also possible. Moreover, in said embodiment, the surrounding environment recognition apparatus 10, the vehicle-mounted display control apparatus 20, the own vehicle position determination apparatus 30, the external field sensor group 40, the vehicle sensor group 50, the map information management apparatus 60, the travel control apparatus 70, an actuator Although the group 80 and the display device 90 are described as separate devices, any two or more devices may be combined as necessary.
- information such as an operation program, a table, and a file for realizing each process includes a nonvolatile semiconductor memory, a hard disk drive, an SSD (Solid State). Or a non-transitory data storage medium that can be read by a computer such as an IC card, an SD card, or a DVD.
- control lines and information lines considered necessary for describing the embodiment are shown, and all control lines and information lines included in an actual product to which the present invention is applied are not necessarily shown. Not necessarily. Actually, it may be considered that almost all the components are connected to each other.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Automation & Control Theory (AREA)
- Traffic Control Systems (AREA)
- Navigation (AREA)
Abstract
L'invention concerne un dispositif de reconnaissance d'environnement ambiant qui est installé dans un véhicule et reconnaît l'environnement entourant le véhicule, ledit dispositif comprenant : une unité d'acquisition d'informations de véhicule hôte qui acquiert des informations de véhicule hôte concernant le mouvement du véhicule, y compris la vitesse de déplacement du véhicule ; une unité d'acquisition d'éléments d'environnement ambiant qui acquiert des informations d'éléments d'environnement ambiant concernant les éléments situés dans l'environnement du véhicule ; et une unité de détermination de risque de déplacement qui détermine, d'après les informations du véhicule hôte et les informations des éléments de l'environnement ambiant, le risque de déplacement à chaque position d'une pluralité de positions entourant le véhicule, les intervalles entre la pluralité de positions dans la direction avant-arrière du véhicule évoluant en fonction de la vitesse de déplacement du véhicule.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017087322A JP6838769B2 (ja) | 2017-04-26 | 2017-04-26 | 周辺環境認識装置、表示制御装置 |
JP2017-087322 | 2017-04-26 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018198769A1 true WO2018198769A1 (fr) | 2018-11-01 |
Family
ID=63919522
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2018/015182 WO2018198769A1 (fr) | 2017-04-26 | 2018-04-11 | Dispositif de reconnaissance d'environnement ambiant et dispositif de commande d'affichage |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP6838769B2 (fr) |
WO (1) | WO2018198769A1 (fr) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111332310A (zh) * | 2018-11-30 | 2020-06-26 | 采埃孚主动安全股份有限公司 | 通过间接信号反射来识别物体 |
JP2022159094A (ja) * | 2021-03-31 | 2022-10-17 | ホンダ リサーチ インスティテュート ヨーロッパ ゲーエムベーハー | 車両の運転者を支援するための高度運転者支援システム |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113467438B (zh) * | 2020-03-31 | 2023-07-18 | 华为技术有限公司 | 路径规划的方法、装置、控制器及移动物体 |
JP7666261B2 (ja) | 2021-09-17 | 2025-04-22 | トヨタ自動車株式会社 | マップデータ、マップ更新方法、車両制御方法、及び車両制御システム |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008070998A (ja) * | 2006-09-13 | 2008-03-27 | Hitachi Ltd | 車両周囲情報表示装置 |
WO2009078294A1 (fr) * | 2007-12-19 | 2009-06-25 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Dispositif d'affichage d'informations |
WO2011101988A1 (fr) * | 2010-02-22 | 2011-08-25 | トヨタ自動車株式会社 | Dispositif de calcul des niveaux de danger |
JP2011253302A (ja) * | 2010-06-01 | 2011-12-15 | Toyota Motor Corp | 車両用危険度算出装置 |
WO2012033173A1 (fr) * | 2010-09-08 | 2012-03-15 | 株式会社豊田中央研究所 | Dispositif de prédiction pour objets mouvants, dispositif de prédiction pour objets mouvants virtuels, programme, procédé de prédiction pour objets mouvants et procédé de prédiction pour objets mouvants virtuels |
JP2013196032A (ja) * | 2012-03-15 | 2013-09-30 | Toyota Motor Corp | 運転支援装置 |
JP2013196033A (ja) * | 2012-03-15 | 2013-09-30 | Toyota Motor Corp | 運転支援装置 |
JP2017047694A (ja) * | 2015-08-31 | 2017-03-09 | 日立オートモティブシステムズ株式会社 | 車両制御装置および車両制御システム |
JP2017224237A (ja) * | 2016-06-17 | 2017-12-21 | 日立オートモティブシステムズ株式会社 | 周辺環境認識装置 |
-
2017
- 2017-04-26 JP JP2017087322A patent/JP6838769B2/ja active Active
-
2018
- 2018-04-11 WO PCT/JP2018/015182 patent/WO2018198769A1/fr active Application Filing
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008070998A (ja) * | 2006-09-13 | 2008-03-27 | Hitachi Ltd | 車両周囲情報表示装置 |
WO2009078294A1 (fr) * | 2007-12-19 | 2009-06-25 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Dispositif d'affichage d'informations |
WO2011101988A1 (fr) * | 2010-02-22 | 2011-08-25 | トヨタ自動車株式会社 | Dispositif de calcul des niveaux de danger |
JP2011253302A (ja) * | 2010-06-01 | 2011-12-15 | Toyota Motor Corp | 車両用危険度算出装置 |
WO2012033173A1 (fr) * | 2010-09-08 | 2012-03-15 | 株式会社豊田中央研究所 | Dispositif de prédiction pour objets mouvants, dispositif de prédiction pour objets mouvants virtuels, programme, procédé de prédiction pour objets mouvants et procédé de prédiction pour objets mouvants virtuels |
JP2013196032A (ja) * | 2012-03-15 | 2013-09-30 | Toyota Motor Corp | 運転支援装置 |
JP2013196033A (ja) * | 2012-03-15 | 2013-09-30 | Toyota Motor Corp | 運転支援装置 |
JP2017047694A (ja) * | 2015-08-31 | 2017-03-09 | 日立オートモティブシステムズ株式会社 | 車両制御装置および車両制御システム |
JP2017224237A (ja) * | 2016-06-17 | 2017-12-21 | 日立オートモティブシステムズ株式会社 | 周辺環境認識装置 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111332310A (zh) * | 2018-11-30 | 2020-06-26 | 采埃孚主动安全股份有限公司 | 通过间接信号反射来识别物体 |
JP2022159094A (ja) * | 2021-03-31 | 2022-10-17 | ホンダ リサーチ インスティテュート ヨーロッパ ゲーエムベーハー | 車両の運転者を支援するための高度運転者支援システム |
JP7633202B2 (ja) | 2021-03-31 | 2025-02-19 | ホンダ リサーチ インスティテュート ヨーロッパ ゲーエムベーハー | 車両の運転者を支援するための高度運転者支援システム |
Also Published As
Publication number | Publication date |
---|---|
JP2018185668A (ja) | 2018-11-22 |
JP6838769B2 (ja) | 2021-03-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6622148B2 (ja) | 周辺環境認識装置 | |
CN112572451B (zh) | 用于自主驾驶车辆执行的方法和装置 | |
JP7722921B2 (ja) | 車両制御 | |
WO2020097011A2 (fr) | Modification de trajectoire de véhicule pour réalisation d'un suivi | |
US9405727B2 (en) | Driving support device, driving support method, and driving support program | |
WO2019152888A1 (fr) | Analyse de procédure de sécurité pour évitement d'obstacle dans un véhicule autonome | |
US20190283751A1 (en) | Vehicle control device, vehicle control method, and storage medium | |
JP7188325B2 (ja) | 運転支援装置 | |
CN111547051A (zh) | 基于相互作用长时确定机动车的轨迹的控制系统和控制方法 | |
JP6468261B2 (ja) | 自動運転システム | |
JP7435787B2 (ja) | 経路確認装置および経路確認方法 | |
CN113165670A (zh) | 一种智能驾驶方法、装置、存储介质及计算机程序 | |
JP6508114B2 (ja) | 移動体の自動運転制御システム | |
CN104340152A (zh) | 在避免碰撞任务中用于情形评估和决策的动态安全防护罩 | |
WO2018198769A1 (fr) | Dispositif de reconnaissance d'environnement ambiant et dispositif de commande d'affichage | |
JP7193202B2 (ja) | 動作予測方法及び動作予測装置 | |
KR20190045308A (ko) | 차량 판정 방법, 주행 경로 보정 방법, 차량 판정 장치, 및 주행 경로 보정 장치 | |
CN115158359B (zh) | 改进自主驾驶车辆的规划模块的方法及系统 | |
JP7206048B2 (ja) | 運転特性推定方法及び運転特性推定装置 | |
WO2022158272A1 (fr) | Procédé de traitement, système de traitement, programme de traitement et dispositif de traitement | |
JP7364111B2 (ja) | 処理方法、処理システム、処理プログラム | |
CN115447607A (zh) | 用于规划车辆行驶轨迹的方法和装置 | |
JP2020053069A (ja) | 車載用電子制御装置 | |
US12179792B2 (en) | Vehicle control | |
JP2020163968A (ja) | 車両運転支援システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18792133 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18792133 Country of ref document: EP Kind code of ref document: A1 |