[go: up one dir, main page]

CN109116846B - An automatic driving method, device, computer equipment and storage medium - Google Patents

An automatic driving method, device, computer equipment and storage medium Download PDF

Info

Publication number
CN109116846B
CN109116846B CN201810994402.6A CN201810994402A CN109116846B CN 109116846 B CN109116846 B CN 109116846B CN 201810994402 A CN201810994402 A CN 201810994402A CN 109116846 B CN109116846 B CN 109116846B
Authority
CN
China
Prior art keywords
current vehicle
distance
sign
video image
automatic driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810994402.6A
Other languages
Chinese (zh)
Other versions
CN109116846A (en
Inventor
何国辉
甘俊英
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuyi University Fujian
Original Assignee
Wuyi University Fujian
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuyi University Fujian filed Critical Wuyi University Fujian
Priority to CN201810994402.6A priority Critical patent/CN109116846B/en
Publication of CN109116846A publication Critical patent/CN109116846A/en
Application granted granted Critical
Publication of CN109116846B publication Critical patent/CN109116846B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0214Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory in accordance with safety or protection criteria, e.g. avoiding hazardous areas
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0221Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving a learning process
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0223Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving speed control of the vehicle
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0257Control of position or course in two dimensions specially adapted to land vehicles using a radar
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0276Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle
    • G05D1/0285Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle using signals transmitted via a public communication network, e.g. GSM network

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Traffic Control Systems (AREA)

Abstract

本申请涉及一种自动驾驶方法、装置、计算机设备和存储介质。所述自动驾驶方法包括:获取当前行驶车道上的行驶方向的指示标志,以及前方交通信号灯的状态标志;感知当前车辆与周围物体之间的距离;根据所述指示标志、所述状态标志以及所述距离,获取当前车辆自动驾驶的动作指示信号。上述自动驾驶方法,既提高了行车的安全性,也增加了行驶路线选择方式的多样性。

Figure 201810994402

The present application relates to an automatic driving method, apparatus, computer equipment and storage medium. The automatic driving method includes: acquiring an indication sign of the driving direction on the current driving lane and a status sign of a traffic light ahead; sensing the distance between the current vehicle and surrounding objects; The above distance is used to obtain the action indication signal of the current vehicle's automatic driving. The above-mentioned automatic driving method not only improves the safety of driving, but also increases the diversity of the way of driving route selection.

Figure 201810994402

Description

Automatic driving method, device, computer equipment and storage medium
Technical Field
The present application relates to the field of image recognition technologies, and in particular, to an automatic driving method, an automatic driving apparatus, a computer device, and a storage medium.
Background
With the rapid development of the automatic driving technology of automobiles, various automatic driving sample automobiles and automatic driving road test experiments of different forms are continuously generated.
The traditional automatic driving mode is mainly characterized in that the driving state is determined and the driving route is selected by a method of detecting the distance between the current vehicle and surrounding obstacles through a ranging radar, so that the decision mode of selecting driving is single in the traditional automatic driving process.
Disclosure of Invention
In view of the above, it is necessary to provide an automatic driving method, an automatic driving apparatus, a computer device, and a storage medium, which can improve driving safety and increase diversity of driving route selection modes during automatic driving.
An autonomous driving method comprising:
acquiring an indication sign of a driving direction on a current driving lane and a state sign of a front traffic signal lamp;
sensing a distance between a current vehicle and a surrounding object;
and acquiring an action indicating signal of the current automatic driving of the vehicle according to the indicating mark, the state mark and the distance.
In one embodiment, the automatic driving method, which acquires a first video image of a road sign indication in front of a vehicle on a current driving lane and a second video image of a traffic signal lamp, comprises:
the method comprises the steps of collecting a first video image indicated by a road sign in front of a vehicle on a current driving lane and a second video image of a traffic signal lamp, and automatically adjusting the frequency of collecting the first video image and the second video image according to the current vehicle speed.
In one embodiment, the automatic driving method, before obtaining the indication sign of the driving direction on the current driving lane and the status sign of the front traffic signal lamp, comprises:
the method comprises the steps of collecting a first video image indicated by a road sign in front of a vehicle on a current driving lane and a second video image of a traffic signal lamp.
In one embodiment, the automatic driving method, which obtains the indication sign of the driving direction on the current driving lane and the status sign of the front traffic signal lamp, includes:
and acquiring an indication sign of the driving direction on the current driving lane by analyzing the first video image, and acquiring a state sign of a front traffic signal lamp by analyzing the second video image.
In one embodiment, the automatic driving method, which obtains the indication sign of the driving direction on the current driving lane by analyzing the first video image and obtains the status sign of the front traffic signal lamp by analyzing the second video image, includes:
acquiring the indicator by inputting the first video image into a first analysis model established in advance; the first analysis model is obtained by training a first image sample indicated by a road sign on the lane;
acquiring the state mark by inputting the second video image into a pre-established second analysis model; the second analysis model is obtained by training a second image sample of the traffic signal lamp.
In one embodiment, the automatic driving method, the sensing a distance between the current vehicle and a surrounding object, includes:
the distance between the current vehicle and surrounding objects is measured through a laser range finder arranged on the roof of the current vehicle and a radar arranged on the head of the current vehicle.
In one embodiment, the automatic driving method further includes:
and according to the action indication signal, indicating a controller on the current vehicle to control the current vehicle to automatically drive.
An autopilot device comprising:
the acquisition module is used for acquiring an indication sign of the driving direction on the current driving lane and a state sign of a front traffic signal lamp;
the distance sensing module is used for sensing the distance between the current vehicle and the surrounding objects;
and the indicating module is used for acquiring an action indicating signal of the current automatic driving of the vehicle according to the indicating mark, the state mark and the distance.
A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
acquiring an indication sign of a driving direction on a current driving lane and a state sign of a front traffic signal lamp;
sensing a distance between a current vehicle and a surrounding object;
and acquiring an action indicating signal of the current automatic driving of the vehicle according to the indicating mark, the state mark and the distance.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
acquiring an indication sign of a driving direction on a current driving lane and a state sign of a front traffic signal lamp;
sensing a distance between a current vehicle and a surrounding object;
and acquiring an action indicating signal of the current automatic driving of the vehicle according to the indicating mark, the state mark and the distance.
According to the automatic driving method, the automatic driving device, the automatic driving computer equipment and the storage medium, the indication mark of the driving direction on the current driving lane and the state mark of the front traffic light are obtained, the distance between the current vehicle and the surrounding objects is sensed, the action indication signal of the automatic driving of the current vehicle is obtained according to the indication mark, the state mark and the distance, when the driving route is selected, the distance between the current vehicle and the surrounding objects is considered, the indication mark of the driving direction on the current driving lane and the state mark of the front traffic light are combined to obtain the action indication signal of the automatic driving of the current vehicle, the driving safety is improved, and the diversity of the driving route selection mode is increased.
Drawings
FIG. 1 is a diagram of an exemplary environment in which an autopilot system may be implemented;
FIG. 2 is a schematic flow diagram of an automated driving method in one embodiment;
FIG. 3 is a schematic flow chart illustrating the steps of obtaining a ground landmark indication and a traffic light status in one embodiment;
FIG. 4 is a schematic exterior view of a vehicle according to another embodiment;
FIG. 5 is a block diagram showing the structure of an automatic driving apparatus according to an embodiment;
FIG. 6 is a block diagram showing the construction of an automatic driving apparatus according to another embodiment;
FIG. 7 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The automatic driving method provided by the application can be applied to the application environment shown in fig. 1. Wherein the terminal 102 and the server 104 communicate through a wired or wireless network. The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 104 may be implemented by a server stored locally or a server cluster formed by a plurality of servers stored remotely.
In one embodiment, as shown in fig. 2, an automatic driving method is provided, which is described by taking the method as an example applied to the server in fig. 1, and includes the following steps:
step 202, acquiring an indication sign of the driving direction on the current driving lane and a state sign of a front traffic light.
Specifically, the indication sign of the driving direction on the current driving lane and the status sign of the front traffic signal lamp can be acquired through a camera preset on the vehicle. The cameras for acquiring the state signs of the traffic signal lamps in front can be multiple, and one camera for acquiring the indication sign of the driving direction on the current driving lane can be provided.
Step 204, the distance between the current vehicle and the surrounding objects is sensed.
Specifically, the distance information between the current vehicle and the surrounding object (obstacle) may be acquired by a ranging radar, a laser range finder, or the like preset on the vehicle.
And step 206, acquiring an action indication signal of the current automatic driving of the vehicle according to the indication mark, the state mark and the distance.
Specifically, the action indicating signal of the current vehicle automatic driving may include one of four states of "ready to run", "ready to stop", and "stop".
According to the automatic driving method, the indication mark of the driving direction on the current driving lane and the state mark of the front traffic light are obtained, the distance between the current vehicle and the surrounding objects is sensed, the action indication signal of the automatic driving of the current vehicle is obtained according to the indication mark, the state mark and the distance, and when the driving route is selected, the distance between the current vehicle and the surrounding objects is considered, the action indication signal of the automatic driving of the current vehicle is obtained by combining the indication mark of the driving direction on the current driving lane and the state mark of the front traffic light, so that the driving safety is improved, and the diversity of the driving route selection mode is increased.
In one embodiment, step 202 may be preceded by the steps of: the method comprises the steps of collecting a first video image indicated by a road sign in front of a vehicle on a current driving lane and a second video image of a traffic signal lamp.
In the automatic driving method, when the ground road sign indicating sign is collected, a road sign indicating video image signal on the current driving lane can be obtained through a preset video collecting device (such as a camera) on the vehicle, and the frequency of the collected image is automatically adjusted according to the current vehicle speed in the process of obtaining the video image. When the state mark of the traffic signal lamp in the front is collected, the video image signal of the traffic signal lamp in the front can be acquired through the preset video acquisition equipment on the vehicle, more than one video acquisition equipment of the traffic signal lamp can be set, and distance detection and signal lamp identification are realized according to the pre-established binocular vision model.
In the embodiment, the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light are acquired, the distance between the current vehicle and the surrounding object is sensed, the action indication signal of the automatic driving of the current vehicle is acquired according to the indication sign, the state sign and the distance, and when the driving route is selected, the distance between the current vehicle and the surrounding object is considered, the action indication signal of the automatic driving of the current vehicle is acquired by combining the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light, so that the driving safety is improved, and the diversity of the driving route selection mode is increased.
In one embodiment, when the first video image of the road sign indication in front of the vehicle on the current driving lane and the second video image of the traffic signal lamp are collected, the frequency of collecting the first video image and the second video image can be automatically adjusted according to the current vehicle speed.
In the above embodiment, the frequency of acquiring the first video image and the second video image is automatically adjusted according to the current vehicle speed, so that memory resources are not consumed on the premise of acquiring necessary video images.
In the embodiment, the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light are acquired, the distance between the current vehicle and the surrounding object is sensed, the action indication signal of the automatic driving of the current vehicle is acquired according to the indication sign, the state sign and the distance, and when the driving route is selected, the distance between the current vehicle and the surrounding object is considered, the action indication signal of the automatic driving of the current vehicle is acquired by combining the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light, so that the driving safety is improved, and the diversity of the driving route selection mode is increased.
In one embodiment, the indication sign of the driving direction on the current driving lane and the status sign of the traffic signal light ahead may be acquired by: and acquiring an indication sign of the driving direction on the current driving lane by analyzing the first video image, and acquiring a state sign of a front traffic signal lamp by analyzing the second video image.
In the above embodiment, when the indication sign of the driving direction on the current driving lane is obtained, the road sign indication on the current driving lane may be obtained according to the pre-established machine learning analysis model, and the traffic light state of the current driving intersection may be obtained according to the pre-established machine learning analysis model.
In the embodiment, the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light are acquired, the distance between the current vehicle and the surrounding object is sensed, the action indication signal of the automatic driving of the current vehicle is acquired according to the indication sign, the state sign and the distance, and when the driving route is selected, the distance between the current vehicle and the surrounding object is considered, the action indication signal of the automatic driving of the current vehicle is acquired by combining the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light, so that the driving safety is improved, and the diversity of the driving route selection mode is increased.
In one embodiment, the indicator of the driving direction on the current driving lane and the status flag of the traffic signal lamp in front may be acquired by performing the following steps: acquiring an indication mark by inputting a first video image into a first analysis model established in advance; the first analysis model is obtained by training a first image sample indicated by a road sign on the lane; acquiring a state mark by inputting a second video image into a pre-established second analysis model; the second analysis model is trained from a second image sample of the traffic signal lamp.
The ground road markings in the first image sample may include: the left turn, the straight line, the right turn, the left turn plus the straight line, the right turn plus the straight line and the identification with uncertain types are totally 6 types; the traffic signal status in the second image sample may include: circular lamps, left-turn arrow lamps, straight arrow lamps, right-turn arrow lamps, signal lamps with uncertain types and non-signal lamps are 6 types. As shown in fig. 3, the ground road sign indication and the traffic light status can be obtained by the following steps:
step 302, preliminarily detecting a road sign image area aiming at a first video image; and aiming at the second video image, preliminarily detecting the lamp panel position of the traffic signal lamp in the image plane by using a monocular vision model and an active learning method.
The detection classifier of the traffic signal lamp panel can be trained by pre-establishing a two-dimensional depth network according to the monocular vision model, and the candidate area of the traffic signal lamp panel is found out preliminarily by performing traversal search on a single image. The traffic signal lamp panel detection classifier is composed of a visual layer, a hidden layer 1, a hidden layer 2 and a label layer, wherein the visual layer and the hidden layer are connected through a group of weights, and the network weights are obtained through unsupervised training and supervised training.
And 304, acquiring the depth information of the detected traffic signal lamp by using the binocular vision model, and screening out a correct traffic signal lamp panel for subsequent further identification.
The correct traffic signal lamp panel area can be screened out by establishing a position information model based on the traffic signal lamps in an image coordinate system and a world coordinate system according to a binocular vision model for candidate areas possibly having the traffic signal lamp panel, and the approximate position relation between the traffic signal lamps and the vehicles can be obtained.
And step 306, identifying the ground road sign indication and the traffic light state through the established machine learning model.
The ground road sign indicating and the screened traffic signal lamp panel area can be trained off line respectively, a ground road sign indicating training model and a traffic signal lamp training model are established, a ground road sign indicating classifier and a traffic signal lamp state recognition classifier are obtained, and then relevant recognition information is obtained.
In the embodiment, the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light are acquired, the distance between the current vehicle and the surrounding object is sensed, the action indication signal of the automatic driving of the current vehicle is acquired according to the indication sign, the state sign and the distance, and when the driving route is selected, the distance between the current vehicle and the surrounding object is considered, the action indication signal of the automatic driving of the current vehicle is acquired by combining the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light, so that the driving safety is improved, and the diversity of the driving route selection mode is increased.
In one embodiment, the distance between the current vehicle and the surrounding objects may be perceived by: the distance between the current vehicle and surrounding objects is measured through a laser range finder arranged on the roof of the current vehicle and a radar arranged on the head of the current vehicle.
In the above embodiment, as shown in fig. 4, a laser range finder may be disposed at the roof position, a plurality of radars may be disposed at the head position, a plurality of traffic signal light video capture cameras may be disposed at the roof position, and a ground road sign capture camera may be disposed at the head position.
In the embodiment, the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light are acquired, the distance between the current vehicle and the surrounding object is sensed, the action indication signal of the automatic driving of the current vehicle is acquired according to the indication sign, the state sign and the distance, and when the driving route is selected, the distance between the current vehicle and the surrounding object is considered, the action indication signal of the automatic driving of the current vehicle is acquired by combining the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light, so that the driving safety is improved, and the diversity of the driving route selection mode is increased.
In one embodiment, the automatic driving method may further include the steps of: and according to the action indication signal, indicating a controller on the current vehicle to control the current vehicle to automatically drive.
In the above embodiment, the action indication signal may be obtained according to the decision table shown in table 1. The next driving action of the vehicle can be acquired according to the state condition information. The vehicle state condition information may include a traffic light turning state and a distance from a preceding obstacle, and the driving action may include a left turn, a straight run, and a right turn.
TABLE 1
Figure BDA0001781549830000101
In the embodiment, the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light are acquired, the distance between the current vehicle and the surrounding object is sensed, the action indication signal of the automatic driving of the current vehicle is acquired according to the indication sign, the state sign and the distance, and when the driving route is selected, the distance between the current vehicle and the surrounding object is considered, the action indication signal of the automatic driving of the current vehicle is acquired by combining the indication sign of the driving direction on the current driving lane and the state sign of the front traffic light, so that the driving safety is improved, and the diversity of the driving route selection mode is increased.
It should be understood that although the steps in the flowcharts of fig. 2 and 3 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2 and 3 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 5, there is provided an automatic driving apparatus including: the system comprises an acquisition module 502, a distance sensing module 504 and an indication module 506, wherein the acquisition module 502 and the distance sensing module 504 are respectively connected with the indication module 506.
An obtaining module 502, configured to obtain an indication sign of a driving direction on a current driving lane and a status sign of a traffic signal light in front;
a distance sensing module 504 for sensing a distance between the current vehicle and a surrounding object;
and the indicating module 506 is used for acquiring an action indicating signal of the current automatic driving of the vehicle according to the indicating mark, the state mark and the distance.
In one embodiment, as shown in fig. 6, there is further provided an automatic driving apparatus, wherein the obtaining module 502 includes: a video acquisition module 5021 and an image analysis module 5022. In addition, a control module 508 may be included. The video capture module 5021 is connected to the image analysis module 5022, and the image analysis module 5022, the distance sensing module 504 and the control module 508 are respectively connected to the indication module 506.
The video collecting module 5021 is used for collecting a first video image indicated by a road sign in front of a vehicle on a current driving lane and a second video image of a traffic signal lamp.
The image analysis module 5022 is used for obtaining the indication sign of the driving direction on the current driving lane by analyzing the first video image and obtaining the state sign of the front traffic signal lamp by analyzing the second video image.
And the control module 508 is used for instructing a controller on the current vehicle to control the current vehicle to automatically drive according to the action indication signal.
For specific limitations of the automatic driving device, reference may be made to the above limitations of the automatic driving method, which are not described in detail herein. The various modules in the autopilot unit described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
It should be noted that the terms "first \ second \ third" related to the embodiments of the present invention are only used for distinguishing similar objects, and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may exchange a specific order or sequence order if allowed. It should be understood that the terms first, second, and third, as used herein, are interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or otherwise described herein.
The terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or (module) elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Reference herein to "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 7. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used to store the autopilot data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an autopilot method.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
acquiring an indication sign of a driving direction on a current driving lane and a state sign of a front traffic signal lamp;
sensing a distance between a current vehicle and a surrounding object;
and acquiring the action indication signal of the current automatic driving of the vehicle according to the indication mark, the state mark and the distance.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring an indication sign of a driving direction on a current driving lane and a state sign of a front traffic signal lamp;
sensing a distance between a current vehicle and a surrounding object;
and acquiring the action indication signal of the current automatic driving of the vehicle according to the indication mark, the state mark and the distance.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), synchronous link (S7nchlink) DRAM (SLDRAM), Rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1.一种自动驾驶方法,其特征在于,包括:1. an automatic driving method, is characterized in that, comprises: 采集当前行驶车道上车辆前方路标指示的第一视频图像和交通信号灯的第二视频图像;collecting the first video image indicated by the road sign in front of the vehicle on the current driving lane and the second video image of the traffic light; 通过将所述第一视频图像输入预先建立的第一分析模型,获取当前行驶车道上的行驶方向的指示标志;所述第一分析模型由车道上路标指示的第一图像样本训练得到;By inputting the first video image into a pre-established first analysis model, the indication signs of the driving direction on the current driving lane are obtained; the first analysis model is obtained by training the first image samples indicated by the road signs on the lane; 通过将所述第二视频图像输入预先建立的第二分析模型,获取前方交通信号灯的状态标志;所述第二分析模型由当前车辆前方交通信号灯的第二图像样本训练得到;By inputting the second video image into a pre-established second analysis model, the status flag of the traffic light in front is obtained; the second analysis model is obtained by training the second image sample of the traffic light in front of the current vehicle; 感知当前车辆与周围物体之间的距离;Perceive the distance between the current vehicle and surrounding objects; 根据所述指示标志、所述状态标志以及所述距离,获取当前车辆自动驾驶的动作指示信号;According to the indication sign, the status sign and the distance, obtain the action indication signal of the current vehicle's automatic driving; 所述根据所述指示标志、所述状态标志以及所述距离,获取当前车辆自动驾驶的动作指示信号,包括:设定车辆与周围物体之间的安全距离;判断当前车辆与周围物体之间的距离与所述安全距离之间的大小关系;根据所述指示标志、所述状态标志以及所述大小关系,获取当前车辆自动驾驶的动作指示信号;所述动作指示信号用于指示当前车辆左转、右转以及直行。The obtaining the action indication signal of the current vehicle for automatic driving according to the indication sign, the status sign and the distance includes: setting a safe distance between the vehicle and surrounding objects; judging the distance between the current vehicle and surrounding objects; The magnitude relationship between the distance and the safety distance; according to the indication sign, the status sign and the magnitude relationship, the action indication signal of the current vehicle's automatic driving is obtained; the action indication signal is used to instruct the current vehicle to turn left , turn right and go straight. 2.根据权利要求1所述的自动驾驶方法,其特征在于,所述采集当前行驶车道上车辆前方路标指示的第一视频图像和交通信号灯的第二视频图像,包括:2. The automatic driving method according to claim 1, wherein the collecting the first video image indicated by the road sign in front of the vehicle on the current driving lane and the second video image of the traffic signal comprises: 采集当前行驶车道上车辆前方路标指示的第一视频图像和交通信号灯的第二视频图像,并根据当前车辆速度自动调整采集所述第一视频图像和所述第二视频图像的频率。Collect the first video image indicated by the road sign in front of the vehicle on the current driving lane and the second video image of the traffic signal, and automatically adjust the frequency of collecting the first video image and the second video image according to the current vehicle speed. 3.根据权利要求1或2所述的自动驾驶方法,其特征在于,所述感知当前车辆与周围物体之间的距离,包括:3. The automatic driving method according to claim 1 or 2, wherein the sensing the distance between the current vehicle and surrounding objects comprises: 通过设置于当前车辆车顶激光测距仪以及设置于当前车辆车头的雷达,测量当前车辆与周围物体的距离。The distance between the current vehicle and surrounding objects is measured by a laser rangefinder set on the roof of the current vehicle and a radar set on the front of the current vehicle. 4.根据权利要求1或2所述的自动驾驶方法,其特征在于,还包括:4. The automatic driving method according to claim 1 or 2, characterized in that, further comprising: 根据所述动作指示信号,指示当前车辆上的控制器控制当前车辆进行自动驾驶。According to the action instruction signal, the controller on the current vehicle is instructed to control the current vehicle to perform automatic driving. 5.一种自动驾驶装置,其特征在于,包括:5. An automatic driving device, characterized in that, comprising: 获取模块,用于采集当前行驶车道上车辆前方路标指示的第一视频图像和交通信号灯的第二视频图像;通过将所述第一视频图像输入预先建立的第一分析模型,获取当前行驶车道上的行驶方向的指示标志;所述第一分析模型由车道上路标指示的第一图像样本训练得到;通过将所述第二视频图像输入预先建立的第二分析模型,获取前方交通信号灯的状态标志;所述第二分析模型由当前车辆前方交通信号灯的第二图像样本训练得到;The acquisition module is used to collect the first video image indicated by the road sign in front of the vehicle on the current driving lane and the second video image of the traffic signal; by inputting the first video image into the pre-established first analysis model, acquire the current driving lane. The first analysis model is obtained by training the first image samples indicated by the road signs on the lane; by inputting the second video image into the second pre-established analysis model, the status signs of the traffic lights ahead are obtained. ; The second analysis model is obtained by training the second image sample of the traffic light in front of the current vehicle; 距离感知模块,用于感知当前车辆与周围物体之间的距离;The distance perception module is used to perceive the distance between the current vehicle and surrounding objects; 指示模块,用于根据所述指示标志、所述状态标志以及所述距离,获取当前车辆自动驾驶的动作指示信号;所述根据所述指示标志、所述状态标志以及所述距离,获取当前车辆自动驾驶的动作指示信号,包括:设定车辆与周围物体之间的安全距离;判断当前车辆与周围物体之间的距离与所述安全距离之间的大小关系;根据所述指示标志、所述状态标志以及所述大小关系,获取当前车辆自动驾驶的动作指示信号;所述动作指示信号用于指示当前车辆左转、右转以及直行。an indication module, configured to obtain the action indication signal of the automatic driving of the current vehicle according to the indication sign, the status sign and the distance; and obtain the current vehicle according to the indication sign, the status sign and the distance The action indication signal of automatic driving includes: setting the safety distance between the vehicle and surrounding objects; judging the magnitude relationship between the distance between the current vehicle and surrounding objects and the safety distance; The status flag and the magnitude relationship are used to obtain an action indication signal of the current vehicle for automatic driving; the action indication signal is used to instruct the current vehicle to turn left, turn right and go straight. 6.根据权利要求5所述的装置,其特征在于,所述获取模块,还用于采集当前行驶车道上车辆前方路标指示的第一视频图像和交通信号灯的第二视频图像,并根据当前车辆速度自动调整采集所述第一视频图像和所述第二视频图像的频率。6 . The device according to claim 5 , wherein the acquisition module is further configured to collect the first video image indicated by the road sign in front of the vehicle on the current driving lane and the second video image of the traffic signal, and collect the data according to the current vehicle. 7 . The speed automatically adjusts the frequency of capturing the first video image and the second video image. 7.根据权利要求5或6所述的装置,其特征在于,所述距离感知模块,用于通过设置于当前车辆车顶激光测距仪以及设置于当前车辆车头的雷达,测量当前车辆与周围物体的距离。7. The device according to claim 5 or 6, wherein the distance sensing module is used to measure the current vehicle and its surroundings by means of a laser range finder set on the roof of the current vehicle and a radar set on the front of the current vehicle distance of the object. 8.根据权利要求5或6所述的装置,其特征在于,所述指示模块,还用于根据所述动作指示信号,指示当前车辆上的控制器控制当前车辆进行自动驾驶。8. The device according to claim 5 or 6, wherein the instruction module is further configured to instruct the controller on the current vehicle to control the current vehicle to perform automatic driving according to the action instruction signal. 9.一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至4中任一项所述的自动驾驶方法的步骤。9. A computer device comprising a memory, a processor and a computer program stored on the memory and running on the processor, wherein the processor implements any one of claims 1 to 4 when the processor executes the computer program. The steps of a method for autonomous driving. 10.一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至4中任一项所述的自动驾驶方法的步骤。10. A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the automatic driving method according to any one of claims 1 to 4 are implemented.
CN201810994402.6A 2018-08-29 2018-08-29 An automatic driving method, device, computer equipment and storage medium Active CN109116846B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810994402.6A CN109116846B (en) 2018-08-29 2018-08-29 An automatic driving method, device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810994402.6A CN109116846B (en) 2018-08-29 2018-08-29 An automatic driving method, device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109116846A CN109116846A (en) 2019-01-01
CN109116846B true CN109116846B (en) 2022-04-05

Family

ID=64861185

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810994402.6A Active CN109116846B (en) 2018-08-29 2018-08-29 An automatic driving method, device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109116846B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102018203092A1 (en) * 2018-03-01 2019-09-05 Robert Bosch Gmbh Method, apparatus and computer program for teaching a machine learning system
CN109991978B (en) * 2019-03-19 2021-04-02 莫日华 Intelligent automatic driving method and device based on network
CN110155007A (en) * 2019-04-28 2019-08-23 深圳市元征科技股份有限公司 Brake control method, mobile unit and the braking control device of vehicle
CN112016344A (en) * 2019-05-28 2020-12-01 深圳市商汤科技有限公司 State detection method and device of signal indicator, driving control method and device
CN110727269B (en) * 2019-10-09 2023-06-23 陈浩能 Vehicle control method and related product
US20210155158A1 (en) * 2019-11-22 2021-05-27 Telenav, Inc. Navigation system with lane estimation mechanism and method of operation thereof
CN112987707B (en) * 2019-11-29 2025-02-25 北京京东乾石科技有限公司 A method and device for controlling automatic driving of a vehicle
CN113160548B (en) * 2020-01-23 2023-03-10 宝马股份公司 Method, device and vehicle for automatic driving of vehicle
CN113287076A (en) * 2020-05-20 2021-08-20 深圳元戎启行科技有限公司 Sensor module and automatic driving system and vehicle comprising same
CN112904843B (en) * 2021-01-14 2022-04-08 清华大学苏州汽车研究院(吴江) A kind of automatic driving scene determination method, device, electronic device and storage medium
CN112859884B (en) * 2021-04-25 2021-07-30 北京三快在线科技有限公司 Method and device for controlling unmanned equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542260A (en) * 2011-12-30 2012-07-04 中南大学 Method for recognizing road traffic sign for unmanned vehicle
CN206038325U (en) * 2016-09-18 2017-03-22 中国石油大学(华东) Unmanned intelligent test vehicle
CN107316486A (en) * 2017-07-11 2017-11-03 湖南星云智能科技有限公司 Pilotless automobile visual identifying system based on dual camera
CN207473410U (en) * 2017-11-16 2018-06-08 尹新通 A kind of automobile intelligent servomechanism

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9070305B1 (en) * 2010-01-22 2015-06-30 Google Inc. Traffic light detecting system and method
CN102819263B (en) * 2012-07-30 2014-11-05 中国航天科工集团第三研究院第八三五七研究所 Multi-camera visual perception system for UGV (Unmanned Ground Vehicle)
JP5883833B2 (en) * 2013-08-05 2016-03-15 富士重工業株式会社 Outside environment recognition device
CN111351494B (en) * 2015-02-10 2024-07-26 御眼视觉技术有限公司 Navigation system and computer readable medium
US9721472B2 (en) * 2015-09-22 2017-08-01 Ford Global Technologies, Llc Formulating lane level routing plans
CN105718870B (en) * 2016-01-15 2019-06-14 武汉光庭科技有限公司 Based on the preceding roadmarking extracting method to camera in automatic Pilot
CN106205170B (en) * 2016-08-30 2020-06-12 上海交通大学 A kind of intersection accurate parking device and method for automatic driving
CN107831789A (en) * 2017-12-12 2018-03-23 成都育芽科技有限公司 A kind of unmanned automatic driving mechanical transport signal lamp synchronisation control means

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542260A (en) * 2011-12-30 2012-07-04 中南大学 Method for recognizing road traffic sign for unmanned vehicle
CN206038325U (en) * 2016-09-18 2017-03-22 中国石油大学(华东) Unmanned intelligent test vehicle
CN107316486A (en) * 2017-07-11 2017-11-03 湖南星云智能科技有限公司 Pilotless automobile visual identifying system based on dual camera
CN207473410U (en) * 2017-11-16 2018-06-08 尹新通 A kind of automobile intelligent servomechanism

Also Published As

Publication number Publication date
CN109116846A (en) 2019-01-01

Similar Documents

Publication Publication Date Title
CN109116846B (en) An automatic driving method, device, computer equipment and storage medium
CN114450703B (en) System and method for predicting pedestrian movement trajectory
CN113284366B (en) Vehicle blind area early warning method, early warning device, MEC platform and storage medium
CN110096059B (en) Automatic driving method, device, equipment and storage medium
US11200432B2 (en) Method and apparatus for determining driving information
US20180373943A1 (en) Computer implemented detecting method, computer implemented learning method, detecting apparatus, learning apparatus, detecting system, and recording medium
US11371851B2 (en) Method and system for determining landmarks in an environment of a vehicle
JP6444835B2 (en) Image processing apparatus, image processing program, and image processing system
US20190213887A1 (en) Pedestrian detection apparatus and pedestrian detection method
JP2019099138A (en) Lane-keep auxiliary method and device
CN110723072B (en) Assisted driving method, device, computer equipment and storage medium
CN104885122B (en) Vehicle periphery monitoring device
CN114556249A (en) System and method for predicting vehicle trajectory
EP3121764A1 (en) Animal type determination device
KR20200043252A (en) Overlooking image generation system of vehicle and method thereof
CN114401876A (en) System and method for predicting bicycle trajectory
WO2021062594A1 (en) Systems and methods for jointly predicting trajectories of multiple moving objects
CN109144052B (en) Navigation system for autonomous vehicle and method thereof
JP7140483B2 (en) Information processing device, information processing method and information processing program
CN110727269A (en) Vehicle control method and related products
JP6753915B2 (en) Image processing equipment, image processing methods, image processing programs and image processing systems
JP6593240B2 (en) Recommended lane guidance system and recommended lane guidance program
US12384424B2 (en) Device, method, and computer program for lane determination
CN118770283B (en) Vehicle control method and device based on intervener gesture recognition, automobile and medium
JP2018097541A (en) Driving support device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant