CN115782757B - A detection method, device, equipment and storage medium for rearview mirror display function - Google Patents
A detection method, device, equipment and storage medium for rearview mirror display function Download PDFInfo
- Publication number
- CN115782757B CN115782757B CN202211232722.0A CN202211232722A CN115782757B CN 115782757 B CN115782757 B CN 115782757B CN 202211232722 A CN202211232722 A CN 202211232722A CN 115782757 B CN115782757 B CN 115782757B
- Authority
- CN
- China
- Prior art keywords
- icon
- rearview mirror
- display
- image
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The application is applicable to the technical field of driving assistance and provides a method, a device, equipment and a storage medium for detecting a display function of a rearview mirror, wherein the method comprises the steps of acquiring a first display instruction and a first shooting image of the rearview mirror, wherein the first shooting image is an image which is shot by the rearview mirror and contains a display area of the rearview mirror after displaying an icon based on the first display instruction; detecting whether the first icon exists in the first shooting image, and generating an icon display detection result. The application judges whether the display function of the rearview mirror is normal by detecting whether the first icon exists in the first shooting image so as to determine whether the intelligent rearview mirror can correctly display information, thereby avoiding the safety problem caused by the display error of the intelligent rearview mirror.
Description
Technical Field
The application belongs to the technical field of auxiliary driving, and particularly relates to a method, a device, equipment and a storage medium for detecting a rearview mirror display function.
Background
Automobiles are becoming more popular, and people are also increasingly looking at the driving safety of automobiles. When driving, extreme weather such as rain, snow and fog is inevitably encountered, and at this time, a driver can not basically see the driving conditions of the road outside the vehicle and other vehicles through the traditional rearview mirror, so that great potential safety hazards exist.
At present, many automobiles are provided with intelligent rearview mirrors, the intelligent rearview mirrors recognize and detect surrounding conditions in the driving process through algorithms, some information in the driving process can be displayed on the intelligent rearview mirrors, and a driver assists driving through information such as icons and the like displayed by the intelligent rearview mirrors. Therefore, the normal display of the intelligent rearview mirror is extremely important.
Disclosure of Invention
In view of this, the embodiment of the application provides a method, a device, equipment and a storage medium for detecting the display function of a rearview mirror, which can detect whether the display function of the rearview mirror installed on an automobile is normal.
In a first aspect, an embodiment of the present application provides a method for detecting a display function of a rearview mirror, including:
Acquiring a first display instruction and a first shooting image of a rearview mirror, wherein the first shooting image is an image of a display area of the rearview mirror after the rearview mirror displays an icon based on the first display instruction;
acquiring a first icon corresponding to the first display instruction;
And detecting whether the first icon exists in the first shooting image, and generating an icon display detection result.
In a second aspect, an embodiment of the present application provides a detection apparatus for a display function, including:
The first acquisition module is used for acquiring a first display instruction and a first shooting image of the rearview mirror, wherein the first shooting image is an image which is shot after the rearview mirror displays an icon based on the first display instruction and contains a display area of the rearview mirror;
the second acquisition module is used for acquiring a first icon corresponding to the first display instruction;
The first detection module is used for detecting whether the characteristic information of the first icon exists in the first shooting image and generating an icon display detection result.
In a third aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the method for detecting the display function of the rearview mirror according to any one of the first aspect when the processor executes the computer program.
In a fourth aspect, an embodiment of the present application provides a computer readable storage medium storing a computer program which, when executed by a processor, implements a method for detecting a display function of a rearview mirror according to any one of the first aspects.
In a fifth aspect, an embodiment of the present application provides a computer program product, which when run on a terminal device, causes the terminal device to perform the method for detecting a display function of a rearview mirror according to any one of the first aspects.
The method comprises the steps of obtaining a first display instruction and a first shooting image of a rearview mirror, wherein the first shooting image is an image which is shot by the rearview mirror and contains a display area of the rearview mirror after the first shooting image is based on the first display instruction display icon, obtaining a first icon corresponding to the first display instruction, detecting whether the first icon exists in the first shooting image, and generating an icon display detection result. In the application, after the first icon is displayed based on the first display instruction, a first shooting image containing the display area of the rearview mirror is shot, if the first icon is detected in the display area of the rearview mirror in the first shooting image, an icon display detection result can be generated, whether the rearview mirror can correctly display the first icon based on the first display instruction or not can be judged according to the icon display detection result, and whether the rearview mirror can correctly display information or not can be determined by the detection method of the rearview mirror display function, so that the safety problem caused by the display error of the intelligent rearview mirror can be avoided.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a block diagram of a terminal device for implementing a detection method for a display function of a rearview mirror according to an embodiment of the present application;
FIG. 2 is a flow chart of a method for detecting a display function of a rearview mirror according to an embodiment of the application;
FIG. 3 is a flowchart of a method for detecting a shift of a rearview mirror according to an embodiment of the application;
FIG. 4 is a schematic block diagram of a detecting device for displaying a function of a rearview mirror according to an embodiment of the present application;
FIG. 5 is a schematic block diagram of a device for detecting displacement of a rearview mirror according to an embodiment of the present application;
Fig. 6 is a schematic block diagram of a terminal device according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in the present description and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".
Furthermore, the terms "first," "second," "third," and the like in the description of the present specification and in the appended claims, are used for distinguishing between descriptions and not necessarily for indicating or implying a relative importance.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
Fig. 1 is a block diagram of a terminal device for implementing a method for detecting a display function of a rearview mirror according to an embodiment of the present application.
Wherein the image capturing device 10 is adapted to capture an image of a display area comprising said mirror. The image capturing apparatus 10 may be any apparatus capable of capturing an image, such as various types of cameras, etc., and may be installed inside or outside a vehicle, and the specific installation position is related to the position of the mirror to be captured, without being particularly limited in the present application.
As one example, the rear view mirror may display an icon on the display area of the rear view mirror based on the first display instruction, and the image capturing apparatus may capture an image including the display area of the rear view mirror, which is noted as a first captured image, in theory including the icon displayed by the rear view mirror, when the rear view mirror displays the icon based on the first display instruction.
As another example, the display area of the rear view mirror may display a first image block, and the image capturing apparatus may capture an image including the display area of the rear view mirror when the rear view mirror displays the first image block, the image being noted as a second captured image including, in theory, the first image block displayed by the rear view mirror.
As another example, the rear view mirror may move the position of the first image block in the display area based on the first shift instruction, and the image photographing apparatus may photograph an image including the display area of the rear view mirror, which is noted as a third photographed image, after the rear view mirror performs shift display of the first image block based on the first shift instruction. In theory, the third shot image includes a first image block displayed by the rearview mirror, and the position of the first image block in the third shot image in the display area is different from the position of the first image block in the second shot image in the display area.
The processor 20 is configured to acquire a first display instruction and a first captured image, where the first display instruction is configured to instruct to display a first icon, and the processor is configured to detect whether the first icon exists in the first captured image, and generate an icon display detection result, where the icon display detection result is configured to determine whether the rearview mirror can correctly display the icon based on the first display instruction.
The processor 20 is further configured to acquire shift information corresponding to the second captured image and the third captured image and the first shift instruction, so as to generate a shift detection result, where the shift detection result is used to determine whether the rearview mirror successfully shifts the first image block based on the first shift instruction.
The processor 20 is further configured to send a prompt instruction to the prompt device 30 when generating the icon display detection result or when generating the shift detection result.
The prompting device 30 is used for prompting a driver according to a prompting instruction, for example, prompting the driver that the first icon is correctly displayed or the first icon is incorrectly displayed when the icon display detection result is generated, and prompting the driver that the first image block is successfully shifted based on the first shifting instruction or fails to shift based on the first shifting instruction when the shifting detection result is generated.
As another example, the driver may be alerted when the first icon is displayed incorrectly or the first tile is not shifted correctly, and may not be alerted when the display is correct while the shift is correct.
The application shoots an image containing a display area of the rearview mirror through the image shooting device 10, the processor 20 generates an icon display detection result according to detecting whether a first target exists in a first shooting image, generates a shift detection result according to shift information corresponding to a first shift instruction, and sends a prompt instruction to the prompt device 30 when the icon display detection result is generated or the shift detection result is generated, and the prompt device 30 is used for prompting a driver according to the prompt instruction. In the application, after the first icon is displayed based on the first display instruction, a first shooting image containing the display area of the rearview mirror is shot, if the first icon is detected in the display area of the rearview mirror in the first shooting image, an icon display detection result can be generated, whether the first icon can be correctly displayed by the rearview mirror based on the first display instruction is judged according to the icon display detection result, and whether the information can be correctly displayed by the intelligent rearview mirror can be determined by the detection method of the rearview mirror display function, so that the safety problem caused by the display error of the intelligent rearview mirror is avoided. When a first image block is displayed on the basis of the rearview mirror, a first position of the first image block in the second shot image in a display area of the rearview mirror is calculated, after the first image block is subjected to shift display on the basis of a first shift instruction, a second position of the first image block in the third shot image in the display area of the rearview mirror is calculated, a shift detection result can be generated on the basis of target shift information corresponding to the first position, the second position and the first shift instruction, whether the first image block can be successfully shifted by the rearview mirror on the basis of the first shift instruction is judged according to the shift detection result, and normal refreshing of the display area of the intelligent rearview mirror can be determined by a shift detection method, so that safety problems caused by the fact that the intelligent rearview mirror cannot be normally refreshed are avoided.
It should be noted that the terminal device shown in fig. 1 may also be in the form of a system including, for example, the image capturing device 10, an electronic device including a processor, and a presentation device.
The following describes a method for detecting the display function of the rearview mirror according to the embodiment of the application in detail with reference to fig. 1.
Fig. 2 is a schematic flow chart of a method for detecting a display function of a rearview mirror according to the present application, and referring to fig. 2, the method includes:
s101, acquiring a first display instruction and a first shooting image of a rearview mirror, wherein the first shooting image is an image which is shot and contains a display area of the rearview mirror after the rearview mirror displays an icon based on the first display instruction.
In the embodiment of the application, the rearview mirror is not a convex mirror with a single function in a narrow sense, but an intelligent automobile rearview mirror with functions of driving record, GPS (Global Positioning System), electronic speed measurement reminding, reversing vision, real-time online video and audio entertainment and the like can be provided. Of course, the rearview mirror can display various types of icons, such as overtaking warning, reversing assistance, high-speed mode, reversing early warning, door opening warning, fog lamp mode, turning mode and the like. The embodiment of the application does not limit the specific type of the icon displayed by the rearview mirror.
The first display instruction is used for indicating the rearview mirror to display an icon, for example, the first display instruction is used for indicating the rearview mirror to display the first icon, and the second display instruction is used for indicating the rearview mirror to display the second icon. Of course, in practical applications, if there is an abnormality in the display function of the rearview mirror, when the rearview mirror displays the first icon based on the first display instruction, the icon that may be displayed is not the first icon, and in this case, there is an abnormality in the display function of the rearview mirror.
In the embodiment of the application, when the display function of the rearview mirror is detected, an image containing the display area of the rearview mirror needs to be shot, so that the rearview mirror is provided with the display area, and the display area of the rearview mirror exists in the shot image.
In the embodiment of the present application, the first captured image may be an image acquired by the processor from the external storage device. The image photographing device stores a photographed first photographed image including a display area of the rear view mirror in an external storage device, and the processor directly obtains from the external storage device. Of course, the image capturing device may also directly send the first captured image to the processor or the terminal device where the processing is located after capturing the first captured image.
In the embodiment of the application, the first shot image can be detected by a rearview mirror display function detection model (for example, an image classification model, an image detection model or a detection model corresponding to other detection methods) in the processor.
S102, acquiring a first icon corresponding to the first display instruction.
In the embodiment of the application, the terminal equipment can store icons corresponding to various display instructions one by one, such as a first icon corresponding to a first display instruction, a second icon corresponding to a second display instruction, a third icon corresponding to a third display instruction and the like, and in order to detect whether the display function of the rearview mirror is normally displayed, one of the icons can be selected as a reference icon.
Taking the first icon corresponding to the first display instruction as an example, the rearview mirror can be controlled to display the icon based on the first display instruction, if the first icon is displayed by the rearview mirror, the icon display function of the rearview mirror is normal, and if the second icon is not displayed by the rearview mirror, for example, the icon display function of the rearview mirror is abnormal.
In practical application, the rearview mirror can be controlled to display one icon based on one display instruction, so that whether the icon display function of the rearview mirror is normal is determined according to the displayed one icon, or the rearview mirror can be controlled to display a plurality of icons based on a plurality of display instructions respectively, and the icon display function of the rearview mirror is determined to be normal under the condition that the icons are correctly displayed.
In another embodiment of the present application, the obtaining the first icon corresponding to the first display instruction includes obtaining feature information of the first icon corresponding to the first display instruction.
In the embodiment of the application, the characteristic information of the icon is a graphic symbol indicating the characteristic of the icon, and in the application, the characteristic information of the first icon can be color information of the first icon, shape information of the first icon, track information of the first icon or other characteristic information of the first icon. The present application is not particularly limited in this regard.
As another embodiment of the present application, before obtaining the feature information of the first icon corresponding to the first display instruction, the method further includes:
Acquiring an image of an icon corresponding to an icon display instruction supported by the rearview mirror;
Extracting feature information of an image of an icon corresponding to an icon display instruction supported by the rearview mirror, and generating a feature information base, wherein the feature information base comprises feature information of a first icon corresponding to the first display instruction.
In practical application, the rearview mirror can display various information, and different information can correspond to different icons, such as overtaking reminding, reversing assistance, a high-speed mode, reversing early warning, door opening reminding, a fog lamp mode, a turning mode and the like. The icons are displayed by the rearview mirror based on different display instructions, and the display instructions capable of controlling the rearview mirror to display the icons are icon display instructions supported by the rearview mirror, such as a first display instruction, a second display instruction and a third display instruction as described above.
The method comprises the steps of obtaining characteristic information of icons corresponding to the icon display instructions supported by the rearview mirror, wherein different display icons correspond to different images and can be displayed in a display area of the rearview mirror, the icons corresponding to the icon display instructions supported by the rearview mirror also correspond to corresponding images, and extracting the characteristic information of the icons corresponding to the display instructions is the characteristic information of the images of the icons corresponding to the display instructions, so that the characteristic information of the images of the icons corresponding to the icon display instructions supported by the rearview mirror can be extracted, and a characteristic information base is generated.
S103, detecting whether the first icon exists in the first shooting image, and generating an icon display detection result.
As described above, since the feature information library stores the feature information of the images of the icons corresponding to the different display instructions, the feature information of the first icon can be directly acquired from the feature information library, and therefore, whether or not the feature information of the first icon exists in the first captured image can be detected, thereby generating the icon display detection result.
If the feature information of the first icon exists in the first shooting image is detected, determining that the first icon exists in the first shooting image, and generating an icon display detection result that the rearview mirror can correctly display the first icon based on the first display instruction;
if the fact that the feature information of the first icon does not exist in the first shooting image is detected, the fact that the first icon does not exist in the first shooting image is determined, and the generated icon display detection result is that the rearview mirror cannot accurately display the first icon based on the first display instruction.
As one embodiment of the present application, the detecting whether the feature information of the first icon exists in the first captured image, generating an icon display detection result includes:
searching the characteristic information of the first icon in the display area of the rearview mirror in the first shooting image to obtain a probability value of the characteristic information of the first icon in the first shooting image;
If the probability value is larger than a first value, the detection result is that the rearview mirror correctly displays the first icon based on the first display instruction;
And if the probability value is smaller than or equal to the first value, the detection result is that the rearview mirror does not correctly display the first icon based on the first display instruction.
In the embodiment of the present application, the probability value of the feature information of the first icon in the first shot image indicates the probability of the feature information of the first icon in the first shot image, and the larger the probability value is, the larger the probability of the feature information of the first icon in the first shot image is, and the smaller the probability value is, the smaller the probability of the feature information of the first icon in the first shot image is. The critical value of the feature information of the first icon existing in the first captured image may be set to the first value.
As an example, the first value is 85%, and if the probability value is 95%, it is obvious that the probability value is greater than the first value, the detection result is that the rearview mirror can correctly display the first icon based on the first display instruction;
If the probability value is 75%, it is obvious that the probability value is smaller than the first value, and the detection result is that the rearview mirror cannot correctly display the first icon based on the first display instruction;
If the probability value is 85%, it is obvious that the probability value is equal to the first value, and the detection result is that the rearview mirror cannot correctly display the first icon based on the first display instruction.
In the embodiment of the present application, the probability value equal to the first value indicates that the detection result is that the rearview mirror cannot correctly display the first icon based on the first display instruction, and in practical application, the probability value equal to the first value may also be set to indicate that the detection result is that the rearview mirror can correctly display the first icon based on the first display instruction.
As another embodiment of the present application, the detecting whether the feature information of the first icon exists in the first captured image, generating an icon display detection result, further includes:
identifying icon feature information from a display area of the rearview mirror in the first captured image;
calculating the matching score of the identified icon feature information and the feature information of the first icon;
if the matching score is larger than a second value, the detection result is that the rearview mirror correctly displays the first icon based on the first display instruction;
And if the matching score is smaller than or equal to the second value, the detection result is that the rearview mirror does not correctly display the first icon based on the first display instruction.
In the embodiment of the application, the matching score of the icon feature information in the first shooting image and the feature information of the first icon is calculated and identified, the matching score represents the similarity of the icon feature information in the first shooting image and the first icon feature information, the larger the value of the matching score is, the higher the similarity of the icon feature information in the first shooting image and the first icon feature information is, the smaller the value of the matching score is, and the lower the similarity of the icon feature information in the first shooting image and the first icon feature information is. The threshold value of the matching score of the first icon, which is correctly displayed by the rearview mirror based on the first display instruction, may be set to be a second value.
As an example, the second value is 85, and if the matching score is 95, it is obvious that the matching score is greater than the second value, and the detection result is that the rearview mirror can correctly display the first icon based on the first display instruction.
If the matching score is 75, it is obvious that the matching score is smaller than the second value, and the detection result is that the rearview mirror cannot correctly display the first icon based on the first display instruction.
If the matching score is also 85, it is obvious that the matching score is equal to the second value, and the detection result is that the rearview mirror cannot correctly display the first icon based on the first display instruction.
In the embodiment of the present application, the matching score equal to the second value indicates that the detection result is that the rearview mirror cannot correctly display the first icon based on the first display instruction, and in practical application, the matching score equal to the second value may also be set to indicate that the detection result is that the rearview mirror correctly displays the first icon based on the first display instruction.
The first value and the second value may be the same value or different values. The present application is not particularly limited in this regard.
Fig. 3 is a schematic flow chart of a method for detecting displacement of a rearview mirror according to an embodiment of the present application, and referring to fig. 3, the method includes:
s201, acquiring a second shot image of the rearview mirror, wherein the second shot image is an image of a display area of the rearview mirror when the rearview mirror displays a first image block.
In the embodiment of the application, the second shot image is an image including the display area of the rearview mirror shot before the first shift instruction. The first tile may be any form (shape and color) of tile.
When the embodiment of the application is used for detecting the displacement of the rearview mirror, the rearview mirror can be controlled to display the first image block. The image photographing apparatus may photograph an image of the display area when the rear view mirror displays the first image block, the image being the second photographed image. Therefore, the second captured image includes the first image block.
S202, acquiring a third shot image of the rearview mirror, wherein the third shot image is an image which is shot and contains a display area of the rearview mirror after the rearview mirror shifts and displays the first image block based on a first shifting instruction.
In the embodiment of the application, the rearview mirror needs to move the display position of the first image block in the display area of the rearview mirror based on the shift instruction.
The shift instruction may be plural, for example, a first shift instruction is for instructing the mirror to perform shift display in a first direction on the first image block, and a second shift instruction is for instructing the mirror to perform shift display in a second direction on the first image block.
After the rearview mirror redisplays the first image block in the display area based on the first shift instruction, a display position of the first image block in the display area of the rearview mirror changes. At this time, the image capturing apparatus captures an image of the display area of the rearview mirror, which is noted as a third captured image, which also includes the first image block. Since the rear view mirror shifts the position of the first image block in the display area based on the first shift instruction, theoretically, there is a difference in the position of the first image block in the display area of the rear view mirror in the third captured image and the second captured image.
S203, calculating a first position of the first image block in the second shooting image in the display area of the rearview mirror and a second position of the first image block in the third shooting image in the display area of the rearview mirror.
The first position is the position of the first image block in the display area of the rearview mirror in the second shooting image before the first shifting instruction, and the second position is the position of the first image block in the display area of the rearview mirror in the third shooting image after the first shifting instruction.
S204, generating a shift detection result based on the first position, the second position and target shift information corresponding to the first movement instruction.
In an embodiment of the present application, the generating a shift detection result based on the first position, the second position, and target shift information corresponding to the first movement instruction includes:
generating actual shift information based on the first position and the second position;
if the difference between the actual shift information and the target shift information meets a first condition, the shift detection result is that the rearview mirror is successfully shifted based on the first shift instruction;
And if the difference between the actual shift information and the target shift information does not meet a first condition, the shift detection result is that the rearview mirror is not successfully shifted based on the first shift instruction.
Theoretically, the difference between the second position and the first position, i.e. the actual shift information and the target shift information in the first shift instruction are the same. Therefore, the shift detection result can be determined by comparing the difference between the actual shift information generated at the first position and the second position and the target shift information in the first shift instruction.
The actual shift information and the target shift information may be represented in a rectangular planar coordinate or a polar coordinate form, or may be represented by other representation methods. The present application is not particularly limited in this regard.
As another embodiment of the present application, the actual displacement information includes a first actual displacement in a first direction and a second actual displacement in a second direction;
The target displacement information comprises a first target displacement in a first direction and a second target displacement in a second direction;
the difference between the actual shift information and the target shift information satisfying a first condition includes:
The first difference absolute value of the first actual displacement and the first target displacement is smaller than a third value, and the second difference absolute value of the second actual displacement and the second target displacement is smaller than a fourth value. Or the sum of the first difference absolute value of the first actual displacement and the first target displacement and the second difference absolute value of the second actual displacement and the second target displacement is smaller than a fifth value.
The difference between the actual displacement information and the target displacement information does not meet a first condition, wherein the first difference absolute value of the first actual displacement and the first target displacement is larger than or equal to a third value, or the second difference absolute value of the second actual displacement and the second target displacement is larger than or equal to a fourth value. Or the sum of the first difference absolute value of the first actual displacement and the first target displacement and the second difference absolute value of the second actual displacement and the second target displacement is larger than or equal to a fifth value.
For example, in a planar rectangular coordinate system, the first direction is the horizontal direction (x-axis), and the second direction is the vertical direction (y-axis). If the first position is a (3, 4), the second position is B (3.14,4.25), the first actual displacement in the first direction is 0.14, the second actual displacement in the second direction is 0.25, and if the first target displacement in the first direction is 0.1, the second target displacement in the second direction is 0.22, the absolute value of the first difference between the first actual displacement and the first target displacement is 0.04, and the absolute value of the second difference between the second actual displacement and the second target displacement is 0.03.
In one example, if the third value is 0.05 and the fourth value is 0.11, it is obvious that the first difference absolute value of the first actual displacement and the first target displacement is 0.04 less than the third value 0.05 and the second difference absolute value of the second actual displacement and the second target displacement is 0.03 less than the fourth value 0.11. The difference between the actual shift information and the target shift information satisfies a first condition.
In another example, if the fifth value is 0.12, it is obvious that the sum of the absolute value of the first difference between the first actual displacement and the first target displacement and the absolute value of the second difference between the second actual displacement and the second target displacement, 0.04 and 0.03, is smaller than the fifth value, 0.12, and the difference between the actual displacement information and the target displacement information satisfies the first condition.
Wherein the third value and the fourth value may be the same value, e.g. the third value and the fourth value are both 0.11, or may be different values, e.g. the third value is 0.05 and the fourth value is 0.11, and the fifth value may be set smaller than the sum of the third value and the fourth value and larger than the larger value of the third value and the fourth value.
The third and fourth values may also be percentages of the target displacement, for example, the third value is twenty percent of the first target displacement. The present application is not particularly limited in this regard.
As another example, the actual shift information and the target shift information may be information in polar coordinates.
For example, the actual displacement information may further include a third actual displacement (before displacement) of the first angle and a fourth actual displacement (after displacement) of the second angle.
The target shift information includes a third target shift (before shift) of the first angle and a fourth target shift (after shift) of the second angle.
The shift information in the polar coordinate may be converted into shift information in the rectangular coordinate system, respectively, and then it is determined whether the difference between the actual shift information and the target shift information satisfies the first condition by using the method of the above embodiment.
It should be noted that, the foregoing only lists possible implementation manners of the method for detecting a display function of a rearview mirror, which is used for describing the method for detecting a display function of a rearview mirror claimed in the present application, generates an icon display detection result as long as detecting whether the first icon exists in the first captured image, and generates a shift detection result based on the first position, the second position and the target shift information corresponding to the first shift instruction, where the storage manner of the shift information of the first icon and the target corresponding to the first shift instruction in the first captured image is not limited.
The method comprises the steps of obtaining a first display instruction and a first shooting image of a rearview mirror, wherein the first shooting image is an image which is shot by the rearview mirror and contains a display area of the rearview mirror after the first shooting image is based on the first display instruction display icon, obtaining a first icon corresponding to the first display instruction, detecting whether the first icon exists in the first shooting image, and generating an icon display detection result. In the application, after the first icon is displayed based on the first display instruction, a first shooting image containing the display area of the rearview mirror is shot, if the first icon is detected in the display area of the rearview mirror in the first shooting image, an icon display detection result can be generated, whether the first icon can be correctly displayed by the rearview mirror based on the first display instruction is judged according to the icon display detection result, and whether the information can be correctly displayed by the intelligent rearview mirror can be determined by the detection method of the rearview mirror display function, so that the safety problem caused by the display error of the intelligent rearview mirror is avoided.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present application.
Fig. 4 shows a device for detecting a display function of a rearview mirror according to an embodiment of the present application, and for convenience of explanation, only the portions related to the embodiment of the present application are shown.
The detection device for the display function of the rearview mirror comprises:
a first obtaining module 41, configured to obtain a first display instruction of a rearview mirror and a first shot image, where the first shot image is an image that is taken by the rearview mirror and includes a display area of the rearview mirror after the rearview mirror displays an icon based on the first display instruction;
A second obtaining module 42, configured to obtain a first icon corresponding to the first display instruction;
The first detection module 43 is configured to detect whether feature information of the first icon exists in the first captured image, and generate an icon display detection result.
The modules listed above may also implement other steps in the method embodiments described above to implement icon detection for the display function of the rearview mirror.
Corresponding to the method for detecting the displacement of the rearview mirror according to the embodiment described above, fig. 5 shows the device for detecting the displacement of the rearview mirror according to the embodiment of the application, and for convenience of explanation, only the parts related to the embodiment of the application are shown.
A third obtaining module 51, configured to obtain a second captured image of the rearview mirror, where the second captured image is an image of a display area including the rearview mirror that is captured when the rearview mirror displays the first image block;
a fourth obtaining module 52, configured to obtain a third captured image of the rearview mirror, where the third captured image is an image of a display area of the rearview mirror that is captured after the rearview mirror performs shift display on the first image block based on a shift instruction;
a calculating module 53, configured to calculate a first position of the first image block in the second shot image in the display area of the rearview mirror and a second position of the first image block in the third shot image in the display area of the rearview mirror;
The second detection module 54 is configured to generate a shift detection result based on the first position, the second position, and target shift information corresponding to the first movement instruction.
The modules listed above may also implement other steps in the method embodiments described above to enable displacement detection of the rear view mirror.
It should be noted that, because the content of information interaction and execution process between the above devices/units is based on the same concept as the method embodiment of the present application, specific functions and technical effects thereof may be referred to in the method embodiment section, and will not be described herein.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
The embodiment of the present application further provides a terminal device, referring to fig. 6, the terminal device 60 may include at least one processor 61, a memory 62, and a computer program stored in the memory 62 and executable on the at least one processor 61, where the steps in any of the above-mentioned method embodiments are implemented by the processor 61 when the computer program is executed, for example, step S101 to step S103 in the embodiment shown in fig. 2, and step S201 to step S204 in the embodiment shown in fig. 3. Or processor 61, when executing the computer program, performs the functions of the modules/units of the apparatus embodiments described above, such as the functions of modules 41-43 shown in fig. 4, such as the functions of modules 51-54 shown in fig. 5.
By way of example, a computer program may be partitioned into one or more modules/units that are stored in the memory 62 and executed by the processor 61 to accomplish the present application. The one or more modules/units may be a series of computer program segments capable of performing specific functions for describing the execution of the computer program in the terminal device 60.
It will be appreciated by those skilled in the art that fig. 6 is merely an example of a terminal device and is not limiting of the terminal device and may include more or fewer components than shown, or may combine certain components, or different components, such as input-output devices, network access devices, buses, etc.
The Processor 61 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (DIGITAL SIGNAL Processor, DSP), application SPECIFIC INTEGRATED Circuit (ASIC), off-the-shelf Programmable gate array (Field-Programmable GATE ARRAY, FPGA) or other Programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 62 may be an internal storage unit of the terminal device, or may be an external storage device of the terminal device, such as a plug-in hard disk, a smart memory card (SMART MEDIA CARD, SMC), a Secure Digital (SD) card, a flash memory card (FLASH CARD), or the like. The memory 520 is used to store the computer program and other programs and data required by the terminal device. The memory 520 may also be used to temporarily store data that has been output or is to be output.
The method for detecting the display function of the rearview mirror provided by the embodiment of the application is applied to terminal equipment such as a computer, a tablet personal computer, a notebook computer, a netbook, a Personal Digital Assistant (PDA) and the like, and the embodiment of the application does not limit the specific type of the terminal equipment.
Embodiments of the present application also provide a computer readable storage medium storing a computer program which, when executed by a processor, implements steps for implementing the various method embodiments described above.
Embodiments of the present application provide a computer program product enabling a terminal device to carry out the steps of the method embodiments described above when the computer program product is run on the terminal device.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiments, and may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include at least any entity or device capable of carrying computer program code to a camera device/terminal equipment, a recording medium, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, and a software distribution medium. Such as a U-disk, removable hard disk, magnetic or optical disk, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical function division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
The foregoing embodiments are merely illustrative of the technical solutions of the present application, and not restrictive, and although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that modifications may still be made to the technical solutions described in the foregoing embodiments or equivalent substitutions of some technical features thereof, and that such modifications or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims (8)
1. A method for detecting a display function of a rearview mirror, the method comprising:
Acquiring a first display instruction and a first shooting image of a rearview mirror, wherein the first shooting image is an image of a display area of the rearview mirror after the rearview mirror displays an icon based on the first display instruction;
acquiring a first icon corresponding to the first display instruction;
Detecting whether the first icon exists in the first shooting image, and generating an icon display detection result;
The obtaining the first icon corresponding to the first display instruction includes:
acquiring characteristic information of a first icon corresponding to the first display instruction;
correspondingly, the detecting whether the first icon exists in the first shot image, and generating an icon display detection result includes:
detecting whether the characteristic information of the first icon exists in the first shooting image, and generating an icon display detection result;
the detecting whether the feature information of the first icon exists in the first shot image, generating an icon display detection result, includes:
identifying icon feature information from a display area of the rearview mirror in the first captured image;
calculating the matching score of the identified icon feature information and the feature information of the first icon;
if the matching score is larger than a second value, the detection result is that the rearview mirror correctly displays the first icon based on the first display instruction;
And if the matching score is smaller than or equal to the second value, the detection result is that the rearview mirror does not correctly display the first icon based on the first display instruction.
2. The method of claim 1, wherein prior to obtaining the feature information of the first icon corresponding to the first display instruction, the method further comprises:
Acquiring an image of an icon corresponding to an icon display instruction supported by the rearview mirror;
Extracting feature information of an image of an icon corresponding to an icon display instruction supported by the rearview mirror, and generating a feature information base, wherein the feature information base comprises feature information of a first icon corresponding to the first display instruction.
3. The method of any one of claims 1 to 2, wherein the method further comprises:
Acquiring a second shooting image of the rearview mirror, wherein the second shooting image is an image which is shot and contains a display area of the rearview mirror when the rearview mirror displays a first image block;
Acquiring a third shooting image of the rearview mirror, wherein the third shooting image is an image which is shot and contains a display area of the rearview mirror after the rearview mirror shifts and displays the first image block based on a first shifting instruction;
calculating a first position of the first image block in the second shot image in the display area of the rearview mirror and a second position of the first image block in the third shot image in the display area of the rearview mirror;
And generating a shift detection result based on the first position, the second position and target shift information corresponding to the first shift instruction.
4. The method of claim 3, wherein the generating a shift detection result based on the first location, the second location, and target shift information corresponding to the first shift instruction comprises:
actual shift information generated based on the first position and the second position;
if the difference between the actual shift information and the target shift information meets a first condition, the shift detection result is that the rearview mirror is successfully shifted based on the first shift instruction;
And if the difference between the actual shift information and the target shift information does not meet a first condition, the shift detection result is that the rearview mirror is not successfully shifted based on the first shift instruction.
5. The method of claim 4, wherein the actual displacement information comprises a first actual displacement in a first direction and a second actual displacement in a second direction; the target displacement information comprises a first target displacement in a first direction and a second target displacement in a second direction;
the difference between the actual shift information and the target shift information satisfying a first condition includes:
the first difference absolute value of the first actual displacement and the first target displacement is smaller than a third value, and the second difference absolute value of the second actual displacement and the second target displacement is smaller than a fourth value;
Or the sum of the first difference absolute value of the first actual displacement and the first target displacement and the second difference absolute value of the second actual displacement and the second target displacement is smaller than a fifth value.
6. A detection device for a display function, comprising:
The first acquisition module is used for acquiring a first display instruction and a first shooting image of the rearview mirror, wherein the first shooting image is an image which is shot after the rearview mirror displays an icon based on the first display instruction and contains a display area of the rearview mirror;
the second acquisition module is used for acquiring a first icon corresponding to the first display instruction;
the first detection module is used for detecting whether the characteristic information of the first icon exists in the first shooting image and generating an icon display detection result;
The obtaining the first icon corresponding to the first display instruction includes:
acquiring characteristic information of a first icon corresponding to the first display instruction;
correspondingly, the detecting whether the first icon exists in the first shot image, and generating an icon display detection result includes:
detecting whether the characteristic information of the first icon exists in the first shooting image, and generating an icon display detection result;
the detecting whether the feature information of the first icon exists in the first shot image, generating an icon display detection result, includes:
identifying icon feature information from a display area of the rearview mirror in the first captured image;
calculating the matching score of the identified icon feature information and the feature information of the first icon;
if the matching score is larger than a second value, the detection result is that the rearview mirror correctly displays the first icon based on the first display instruction;
And if the matching score is smaller than or equal to the second value, the detection result is that the rearview mirror does not correctly display the first icon based on the first display instruction.
7. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 5 when executing the computer program.
8. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211232722.0A CN115782757B (en) | 2022-10-10 | 2022-10-10 | A detection method, device, equipment and storage medium for rearview mirror display function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211232722.0A CN115782757B (en) | 2022-10-10 | 2022-10-10 | A detection method, device, equipment and storage medium for rearview mirror display function |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115782757A CN115782757A (en) | 2023-03-14 |
| CN115782757B true CN115782757B (en) | 2025-06-17 |
Family
ID=85432648
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211232722.0A Active CN115782757B (en) | 2022-10-10 | 2022-10-10 | A detection method, device, equipment and storage medium for rearview mirror display function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115782757B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109117035A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | Hidden method, terminal recovery system and the storage medium of suspension icon |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109144379B (en) * | 2017-06-26 | 2021-02-02 | 深圳回收宝科技有限公司 | Method for operating terminal, terminal detection device, system and storage medium |
| CN108777767A (en) * | 2018-08-22 | 2018-11-09 | Oppo广东移动通信有限公司 | Photographing method, photographing device, terminal and computer-readable storage medium |
| CN110677586B (en) * | 2019-10-09 | 2021-06-25 | Oppo广东移动通信有限公司 | Image display method, image display device, and mobile terminal |
| WO2021227859A1 (en) * | 2020-05-13 | 2021-11-18 | 华为技术有限公司 | Image display method and apparatus, terminal device, storage medium, and program product |
-
2022
- 2022-10-10 CN CN202211232722.0A patent/CN115782757B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109117035A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | Hidden method, terminal recovery system and the storage medium of suspension icon |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115782757A (en) | 2023-03-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1891580B1 (en) | Method and a system for detecting a road at night | |
| CN112349144A (en) | Monocular vision-based vehicle collision early warning method and system | |
| US9183449B2 (en) | Apparatus and method for detecting obstacle | |
| CN110458086A (en) | Vehicle re-identification method and device | |
| CN109389622B (en) | Vehicle tracking method, device, identification equipment and storage medium | |
| CN112381025A (en) | Driver attention detection method and device, electronic equipment and storage medium | |
| CN114333414A (en) | Parking yield detection device, parking yield detection system, and recording medium | |
| CN113569812A (en) | Method, device and electronic device for identifying unknown obstacles | |
| CN111191603B (en) | Method and device for identifying people in vehicle, terminal equipment and medium | |
| JP2019164530A (en) | Looking away determination device, looking away determination system, looking away determination method, and program | |
| Munajat et al. | Vehicle detection and tracking based on corner and lines adjacent detection features | |
| CN112241660A (en) | A vision-based anti-theft monitoring method and device | |
| CN115782757B (en) | A detection method, device, equipment and storage medium for rearview mirror display function | |
| CN112356845B (en) | Method, device and equipment for predicting motion state of target and vehicle | |
| CN116863124B (en) | Vehicle attitude determination method, controller and storage medium | |
| CN116824549B (en) | Target detection method and device based on multi-detection network fusion and vehicle | |
| JP2018073049A (en) | Image recognition device, image recognition system, and image recognition method | |
| JP7521563B2 (en) | Electronic device, vehicle, display control method, and program | |
| CN113688662B (en) | Motor vehicle passing warning method, device, electronic device and computer equipment | |
| EP4270357A1 (en) | Image processing device, image processing method, and program | |
| CN116168325A (en) | Vehicle lane change detection method, device, electronic equipment and readable storage medium | |
| CN115965636A (en) | Vehicle side view generating method and device and terminal equipment | |
| JP2001180404A (en) | Vehicle rear monitoring device | |
| JP2000149196A (en) | Vehicle monitoring device and moving object recognition device | |
| CN115861624B (en) | Method, device, equipment and storage medium for detecting occlusion of camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |