[go: up one dir, main page]

WO2018197984A1 - Système d'affichage et corps mobile - Google Patents

Système d'affichage et corps mobile Download PDF

Info

Publication number
WO2018197984A1
WO2018197984A1 PCT/IB2018/052611 IB2018052611W WO2018197984A1 WO 2018197984 A1 WO2018197984 A1 WO 2018197984A1 IB 2018052611 W IB2018052611 W IB 2018052611W WO 2018197984 A1 WO2018197984 A1 WO 2018197984A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
imaging
wiring
circuit
function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2018/052611
Other languages
English (en)
Japanese (ja)
Inventor
山崎舜平
宮口厚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Semiconductor Energy Laboratory Co Ltd
Original Assignee
Semiconductor Energy Laboratory Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Semiconductor Energy Laboratory Co Ltd filed Critical Semiconductor Energy Laboratory Co Ltd
Priority to JP2019514878A priority Critical patent/JPWO2018197984A1/ja
Publication of WO2018197984A1 publication Critical patent/WO2018197984A1/fr
Anticipated expiration legal-status Critical
Priority to JP2022182480A priority patent/JP2023036577A/ja
Priority to JP2024081459A priority patent/JP7707366B2/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N99/00—Subject matter not provided for in other groups of this subclass
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • One embodiment of the present invention relates to a display system and a moving object.
  • Patent Document 1 Vehicles equipped with an imaging device for imaging information around a vehicle and a display device for displaying information obtained by imaging are widely used (for example, Patent Document 1).
  • a light source with high illuminance such as a vehicle headlight (headlight) approaches. Therefore, there is a problem that the obtained image data is excessively exposed around the light source, and the display of the area corresponding to the periphery of the light source becomes white.
  • the exposure around the light source can be adjusted, the displayed image becomes dark, and it becomes difficult to grasp the size and shape of the entire vehicle. That is, the information obtained is limited.
  • An object of one embodiment of the present invention is to provide a novel display system, a moving object, and the like.
  • one embodiment of the present invention provides a novel display system, a moving body, and the like that can perform normal display even if a defect (unclear) portion occurs in acquired captured data due to an imaging environment. This is one of the issues.
  • Another object of one embodiment of the present invention is to provide a novel display system, a moving object, and the like that can improve visibility.
  • the feature amount is extracted from part of the information of the subject that is clearly imaged, and the corresponding correction data is selected by collating in the database.
  • the gist is to correct the unclear area of the imaging data based on the correction data.
  • One embodiment of the present invention includes an imaging device, a display device, a feature amount output circuit, an image processing circuit, and a database.
  • the imaging device has a function of outputting imaging data.
  • the feature amount output circuit includes imaging data.
  • the database has correction data and detection data, and has a function of outputting correction data to the image processing circuit in accordance with the feature data.
  • the image processing circuit has a function of generating image data by correcting imaging data based on correction data
  • the display device is a display system having a function of performing display according to image data.
  • the database is preferably a display system having a function of selecting detection data that matches or resembles feature data and outputting correction data corresponding to the detection data to the image processing circuit.
  • the database can update detection data serving as a weight parameter by machine learning using feature data as learning data, and infer correction data that matches or is similar to the feature data.
  • detection data serving as a weight parameter by machine learning using feature data as learning data
  • infer correction data that matches or is similar to the feature data.
  • a display system with functionality is preferred.
  • One embodiment of the present invention includes an imaging device, a display device, a feature amount output circuit, an image processing circuit, and a transmission / reception circuit, the imaging device has a function of acquiring imaging data, and the feature amount output circuit includes:
  • the image processing circuit has a function of acquiring feature amount data of imaging data, and the feature amount data has a function of being transmitted to a database having correction data and detection data via a transmission / reception circuit.
  • the correction data is data corresponding to the detection data
  • the detection data is data that matches or is similar to the feature data
  • the correction data is obtained by inferring by inputting feature amount data in a database in which detection data serving as a weight parameter is updated by machine learning using the feature amount data as learning data.
  • a mobile that is data is preferred.
  • One embodiment of the present invention can provide a novel display system, a moving object including the display system, and the like.
  • one embodiment of the present invention provides a novel display system, a moving body, and the like that can perform normal display even if a defect (unclear) portion occurs in acquired captured data due to an imaging environment. be able to.
  • a novel display system, a moving object, and the like that can improve visibility can be provided.
  • the block diagram for demonstrating a display system The block diagram for demonstrating a display system.
  • FIG. 9 illustrates a configuration example of a semiconductor device.
  • FIG. 14 is a top view illustrating one embodiment of a display device.
  • FIG. 14 is a cross-sectional view illustrating one embodiment of a display device.
  • FIG. 14 is a cross-sectional view illustrating one embodiment of a display device.
  • 4A and 4B illustrate a display device in a moving object. The figure explaining an example of a moving body.
  • FIG. 1 is a block diagram for explaining an example of a display system which is one embodiment of the present invention.
  • the display system 10 illustrated in FIG. 1 includes an imaging device 11, a feature amount output circuit 12, a database 13, an image processing circuit 14, and a display device 15.
  • the imaging device 11 is specifically a camera module attached to a moving body such as an automobile.
  • the imaging device 11 has a function of outputting the imaging data 16.
  • the imaging data 16 is output to the feature amount output circuit 12 and the image processing circuit 14.
  • the imaging device 11 preferably has an imaging element with a wide dynamic range. For example, by using the imaging device 11 including an imaging element having selenium, it is possible to reduce unclear portions of imaging data when imaging a subject having a large contrast.
  • the feature amount output circuit 12 extracts the feature amount in the imaging data 16 and outputs it as feature amount data. It is effective to extract the feature amount in combination with imaging data obtained by the imaging device 11 and data that can be acquired from a sensor or the like used to detect the relative speed or relative position of the subject.
  • the feature amount includes an appearance feature amount (appearance feature amount).
  • the appearance feature amount in an automobile includes, for example, the body color of the own vehicle, the number of the license plate, the vehicle type, the vehicle width, the vehicle height, the blinker lamp, and the headlight.
  • the feature amount data of these feature amounts is output to the database 13 as encoded data or data cut out from the original imaging data.
  • the feature amount is set so that it can be easily detected by image recognition, thereby reducing the load of image recognition processing. It is also effective to exclude the blinker lamp and the brake lamp from being subject to image recognition because lighting or blinking changes depending on the situation.
  • the unclear area of the imaging data 16 is an area where it is difficult to extract a feature amount because the contrast ratio between light and dark is small. Therefore, the feature quantity output circuit 12 can reduce the data of the unclear area of the imaged data by extracting the feature quantity.
  • the feature quantity output circuit 12 extracts, for example, a Haar-like feature, a HOG (Histograms of Oriented Gradients) feature, a SIFT (Scaled Invariance Feature Transform) feature, or a SURF (Speeded Up Robust feature). It is also effective to extract and output feature amount data at a desired location by combining the above. It is also effective to smooth the imaged data 16 with a Gaussian filter and select characteristic area information.
  • a Haar-like feature for example, a HOG (Histograms of Oriented Gradients) feature, a SIFT (Scaled Invariance Feature Transform) feature, or a SURF (Speeded Up Robust feature). It is also effective to extract and output feature amount data at a desired location by combining the above. It is also effective to smooth the imaged data 16 with a Gaussian filter and select characteristic area information.
  • the feature quantity output circuit 12 may output, as feature quantity data, a feature quantity that is automatically calculated by CNN (Convolutional Neural Network) learning, for example.
  • the feature amount output circuit 12 is mainly configured as a microcomputer, and includes a processor, a memory, an I / O, and a bus connecting them.
  • various functions can be realized by executing a program stored in advance in a memory by a processor based on information of various sensors in addition to the imaging device 11.
  • the database 13 stores feature data 17, correction data 18, and detection data 19.
  • the correction data 18 is data for correcting the imaging data 16.
  • the detection data 19 is data for selecting the correction data 18 based on the feature data.
  • the correction data 18 is data for correcting the imaging data 16 in the image processing circuit 14.
  • the correction data 18 is preferably data that can be displayed with a higher resolution than the imaging data 16. With this configuration, the resolution of an image obtained by correcting the imaging data 16 can be increased, and the visibility of display on the display device 15 can be increased.
  • the image data obtained by the correction of the imaging data using the correction data 18 may be different from the image actually obtained by visual observation.
  • image data there may be image data in which the vehicle type, the shape of the vehicle body, etc. are partially different.
  • correction data may be selected from subjects having the same feature data. Even in such a case, since the entire information of the subject can be removed as compared with the image data without correction, the situation can be grasped more efficiently by the projected image.
  • the detection data 19 is data that can select the correction data 18 based on the feature value data 17 input from the feature value output circuit 12.
  • the detection data can be feature amount data such as an appearance feature amount extracted based on the correction data 18. With this configuration, it is possible to select the desired correction data 18 by selecting the detection data 19 that matches or is similar to the feature data 17.
  • the detection data 19 may be data serving as a weight parameter in CNN learning.
  • the CNN learning in the database 13 is a detection parameter which is a weighting parameter using, as learning data, data obtained by adding a correct label corresponding to the correction data 18 to the feature data 17 input from the feature data output circuit 12 collected in advance.
  • the data 19 is updated.
  • the detection data 19 is updated by repeating the CNN learning. By repeating the update, the accuracy can be improved.
  • the correction data 18 corresponding to the input of the feature data 17 can be selected with high accuracy.
  • the database 13 has a function of storing the correction data 18 and the detection data 19, a memory for storing a program for selecting the correction data 18 corresponding to the feature data 17, and a processor for executing the program It has a function as a computer equipped with. In the database 13, various functions can be realized by executing a program stored in advance in a computer.
  • the image processing circuit 14 is a circuit having a function of correcting data in a blurred region of the imaging data 16 based on the correction data 18 and outputting the corrected imaging data as image data.
  • the unclear area of the imaging data 16 corresponds to an area where it is difficult to extract a feature amount, such as an area where the contrast ratio between light and dark is small. For this reason, a configuration in which a region where feature amount extraction is difficult can be corrected based on the correction data 18 can be given as an example.
  • the correction data 18 is particularly effective when correcting the entire contour of the subject in the imaging data 16.
  • the image processing circuit 14 holds the correction data once acquired. With this configuration, once the correction data 18 is held, it can be repeatedly used for correction of imaging data.
  • the correction data 18 preferably has a higher resolution than the imaging data 16.
  • the correction data 18 can be used for the super-resolution processing of the imaging data, and the corrected and displayed image becomes clearer. be able to.
  • the display device 15 performs display based on the image data generated by the image processing circuit.
  • the display device 15 can be used in place of a room mirror in the case of an automobile.
  • the display system 10 includes an imaging device 11 and a display device 15.
  • the display system 10 extracts feature data from a part of information of the subject in the imaging data 16 obtained by the imaging device 11 and collates it in the database 13 to select correction data 18. Originally, the unclear area of the imaging data 16 is corrected.
  • the display system 10 is preferably applied to a moving body such as an automobile. Specifically, it is particularly suitable in a situation where the periphery of the automobile is imaged by an imaging device such as a camera and the state is visually recognized by a display device.
  • the moving body is a vehicle that moves like an automobile. Accordingly, the moving body is not limited to a car, but includes a bus, a train, an airplane, and the like.
  • an unclear area may occur in imaging data obtained by the imaging device according to changes in conditions such as day and night, and fine rain.
  • a headlight of a rear automobile or water droplets adhering to the imaging device causes a blurred area.
  • the feature data is extracted from the information on a part of the subject and collated in the database 13 to select the correction data 18 so that the imaging data 16 is unclear. Correct the area. Therefore, it is effective for improving visibility.
  • the application of the display system 10 of the present invention is not limited to a mobile object. This is effective when image data captured by the imaging device is displayed on the display device. For example, it is effective when correcting unclear portions of imaging data obtained by an imaging device such as a security camera or a smartphone.
  • a display system 10A shown in FIG. 2 has a configuration in which a transmission / reception circuit 20 and a network 21 are added to the configuration of the display system 10 of FIG. That is, data output from the feature amount output circuit 12 to the database 13 and data output from the database to the image processing circuit 14 are performed via the transmission / reception circuit 20 and the network 21.
  • the configuration of the display system 10A in FIG. 2 can be described with reference to the conceptual diagram illustrated in FIG. That is, the display system 10 ⁇ / b> A is configured to transmit / receive data to / from the database 13 via the relay station 24 from the automobile 22 ⁇ / b> A to which the transmission / reception circuit 20 is attached.
  • the configuration of the display system 10 in FIG. 1 can be described with reference to the conceptual diagram illustrated in FIG. That is, the imaging device 11, the feature amount output circuit 12, the database 13, the image processing circuit 14, and the display device 15 that constitute the display system 10 are configured to be included in the automobile 22.
  • the feature amount output circuit 12, the database 13, and the image processing circuit 14 are illustrated as a data processing circuit 23.
  • FIG. 4 illustrates a block diagram of a display system 10B including a plurality of imaging devices 11_1-11_n (n is a natural number) and a display device 15_1-15_n.
  • the display device 15 can include a large display portion so that image data obtained by imaging with the plurality of imaging devices 11_1-11_n can be displayed side by side.
  • FIG. 5 illustrates a block diagram of a display system 10C in which a sensor 25 is added to the configuration of the display system 10 of FIG.
  • the sensor 25 can control whether or not to stop the function of the feature value output circuit 12 according to the output. For example, when the sensor 25 is an illuminance sensor, the output of feature amount data from the feature amount output circuit 12 is stopped when the illuminance is high, and the output of feature amount data from the feature amount output circuit 12 is started when the illuminance is low. can do.
  • the switching of the output of the feature amount data from the feature amount output circuit 12 may be performed by turning on and off the switching function by the user.
  • the configuration may be such that the function can be switched between start and stop in accordance with input from a touch sensor or the like.
  • the sensor 25 may be configured to be used in combination with other sensors such as a millimeter wave radar that can be used to detect the relative speed and relative position of the subject.
  • sensors such as a millimeter wave radar that can be used to detect the relative speed and relative position of the subject.
  • the imaging data is corrected based on the correction data, and normal Image data for display can be generated. Therefore, the visibility of the image displayed on the display device can be improved.
  • FIG. 6 is a flowchart for explaining an operation example of the display system 10 described in FIG.
  • feature amount data is input to the database 13 by extracting the feature amount of the imaging data 16, and detection data 19 that matches or resembles the feature amount data 17 is compared.
  • the correction data 18 is selected. Then, the selected correction data 18 is used by the image processing circuit 14 to correct the imaging data 16.
  • step S ⁇ b> 11 is a step of acquiring the imaging data 16 by the imaging device 11.
  • the imaging data 16 is output to the feature amount output circuit 12.
  • the same imaging data 16 is also output to the image processing circuit 14.
  • Step S12 is a step of determining whether or not the input imaging data 16 has a display abnormality.
  • Step S12 may be performed together with the feature amount extraction in step S13.
  • the structure which determines display abnormality according to the output of sensors, such as an illumination intensity sensor may be sufficient.
  • the user may determine the display abnormality by looking at the display based on the imaging data 16 and perform switching using a sensor or the like. If it is determined that there is no display abnormality (No), the process proceeds to the step of displaying on the display device 15 in step S17. If it is determined that there is a display abnormality (Yes), the process proceeds to step S13.
  • Step S13 is a step in which the feature quantity output circuit 12 performs feature quantity extraction.
  • the obtained feature quantity is output to the database 13 as feature quantity data 17.
  • the feature amount data 17 is data obtained by combining the appearance feature amount based on the image recognition process and the feature amount obtained by the local gradient feature extraction technique of the characteristic region.
  • Step S14 is a step of selecting (searching) the detection data 19 stored in the database 13 corresponding to the feature data obtained in Step S13.
  • the detection data 19 is data for selecting the correction data 18 based on the feature amount data 17.
  • Step S15 is a step for causing the image processing circuit 14 to output the correction data 18 corresponding to the detection data 19 that matches or is similar to (or hits) the feature data 17 by the search in step S14.
  • the correction data 18 is data for correcting a missing (unclear) region of the imaging data 16.
  • Step S16 is a step of correcting the imaging data 16 to generate image data.
  • the image data obtained on the basis of the corrected imaging data 16 is data in which excessive exposure around the light source and information on the size and shape of the entire subject are corrected. That is, the information obtained can be complemented by the correction data 18.
  • Step S17 is a step of performing display based on the image data on the display device 15.
  • the correction data 18 can be selected by comparing the detection data 19 that matches or is similar to the feature data 17.
  • the selected correction data 18 is used to correct the imaging data 16 by the image processing circuit 14, thereby generating image data for normal display when a missing (unclear) portion occurs in the acquired imaging data. can do. Therefore, the visibility of the image displayed on the display device can be improved.
  • the correction data 18 can be selected from the feature amount data by extracting the feature amount of the imaging data 16 into the database 13.
  • the database 13 is trained so as to infer the correction data 18 corresponding to the feature data using the detection data 19 as a weight parameter in CNN learning. Then, the selected correction data 18 can be used for correction of the imaging data 16 by the image processing circuit 14.
  • FIG. 7 shows a flowchart for explaining an example of learning of the display system 10 when the detection data 19 is used as a weight parameter in CNN learning.
  • Step S21 performs the same feature amount extraction as step S13. That is, in step S12, the feature amount of the imaging data 16 having display abnormality is extracted.
  • the feature amount data obtained in step S21 is training data and test data.
  • the original imaging data is preferably different data, and it is preferable to generate and prepare a large amount of feature amount data.
  • Step S22 is a step of assigning a correct answer label to the feature data.
  • the correct answer label corresponds to correction data 18 that is optimal for correcting the imaging data 16 corresponding to the feature data.
  • Step S23 is a step in which feature data for training is given and the detection data 19 serving as a weight parameter is updated. It is effective to update the weight parameter using a known learning method such as an error back propagation method.
  • Step S24 is a step of inputting feature amount data.
  • the feature data input in step S24 is test data with a correct answer label.
  • step S25 it is determined whether the output signal obtained in step S24 corresponds to the correct label attached earlier (Yes or No). If not, the parameter update in step S23 is repeated.
  • Step S26 is a determination (Yes or No) as to whether or not the accuracy of whether the correction data 18 that matches or is similar to the feature data 17 is obtained is equal to or less than the set value. If the accuracy is less than or equal to the set value, the parameter update in step S23 is repeated.
  • Detecting data 19 is updated by repeating CNN learning. By repeating the update, the accuracy of the correction data 18 corresponding to the input of the feature data 17 can be improved. By using the CNN using the updated detection data 19 as a weight parameter, the correction data 18 corresponding to the input of the unknown feature data 17 can be selected with high accuracy.
  • FIG. 8 is a block diagram for explaining a configuration example of the CNN (convolutional neural network) explained in FIG.
  • the convolutional neural network 30 shown in FIG. 8 includes an input layer 31, an intermediate layer 32, and an output layer 33.
  • FIG. 8 illustrates the feature data 17 that is input data in the input layer 31.
  • the filter 34 in the intermediate layer 32, the filter 34, the convolution data 35, the pooling data 36, the filter 37, the convolution data 38, and the pooling data 39 are illustrated.
  • the configuration of the intermediate layer 32 is an example, and a configuration in which pooling processing and convolution calculation processing by the filters 34 and 37 are performed in multiple layers, or a configuration in which calculation processing such as padding and stride is performed may be employed.
  • the output data 41 is obtained by processing the obtained all combined data 40 (y1-ym in the figure) with a softmax function to obtain an output corresponding to the correct answer label.
  • the parameters (weight data) of the filters 34 and 37 are updated, and output data 41 (O (y1) ⁇ O (ym) in the figure) with labels is obtained. So that they can learn and infer.
  • the corresponding correction data 18 can be output to the image processing circuit 14.
  • FIG. 9A is a schematic view seen from the rear of the automobile 22.
  • a camera that is the imaging device 11 and a room mirror that is the display device 15 are illustrated.
  • FIG. 9B shows a car 22 and another car 42 behind it.
  • the automobile 42 illustrates a state in which a headlight as a light source 43 is emitted toward the automobile 22 in the irradiation direction 44.
  • FIG. 9B shows a state in which the imaging device 11 of the automobile 22 is imaged toward the automobile 42 in the imaging direction 45.
  • the automobile 42 is illustrated as the subject to be imaged by the imaging device 11, but the subject is not limited to the automobile.
  • the subject may be any object that can select correction data by extracting feature values from imaged data such as pedestrians, bicycles, street lamps, and signs. If it is a pedestrian, it is also effective to extract a feature amount from features of parts such as feet and hands, and to correct a part of the head or upper body with correction data. Visibility can be enhanced by displaying image data of the entire pedestrian on the display device.
  • the imaging data 16 obtained by the imaging device 11 can be expressed as shown in FIG. That is, as shown in FIG. 9C, the illuminance of the light source 43 increases. Although the shape of the area around the light source 43 is recognized by suppressing exposure, it is difficult to recognize the shape of the entire automobile 42. For this reason, as shown in FIG. 9D, when an automobile having a light source with high illuminance is captured during night driving or the like, a clear area 48 and an unclear area 49 are mixed in the imaging data.
  • FIG. 10A is a schematic view seen from the rear of the automobile 22A.
  • FIG. 10A illustrates a camera that is the imaging device 11 ⁇ / b> A and a room mirror that is the display device 15.
  • FIG. 10A illustrates an enlarged schematic diagram of the imaging device 11A, and illustrates a lens 46 and a water droplet 47. In the case of rain or the like, water droplets 47 or the like may adhere to the surface of the lens 46, resulting in unclear image data.
  • 10A shows a configuration in which the display device 15 is arranged at the position of the room mirror, but it is also effective for a configuration in which a display device at the position of the side mirror or the dashboard is arranged.
  • FIG. 10B shows a car 22A and another car 42 behind the car 22A.
  • FIG. 10B illustrates a state where the imaging device 11 ⁇ / b> A of the automobile 22 ⁇ / b> A is imaged toward the automobile 42 in the imaging direction 45.
  • the imaging data 16 obtained by the imaging device 11 can be represented as shown in FIG. That is, as shown in FIG. 10C, when the water droplet 47 is imaged, the image of the automobile 42 becomes unclear, and it becomes difficult to recognize the shape of the entire automobile 42. Therefore, as illustrated in FIG. 10D, when an automobile is imaged during rainy weather driving or the like, a clear area 48 and an unclear area 49 are mixed in the image data.
  • a feature amount is extracted from part of the information of the automobile 42 in the clear region 48 of the imaging data 16, and the feature amount data 17 is collated in the database 13 for correction.
  • the data 18 can be selected and the unclear area of the imaging data 16 can be corrected.
  • a corrected image can be visually recognized even if an unclear area is generated in the imaging data obtained by the imaging device in accordance with changes in conditions such as day and night and fine rain. For example, even if a headlight of a vehicle behind the vehicle or a water droplet attached to the imaging device causes a blurred region, correction data corresponding to the feature amount data can be selected and the imaging data can be corrected. Therefore, it becomes easy to grasp the size and shape of the entire subject. Moreover, since the information obtained can be increased, it is effective in improving visibility.
  • FIG. 11 is a flowchart for explaining a more specific example of the operation of the display system.
  • FIG. 11 illustrates the data flow in the imaging device 11, the feature amount output circuit 12, the database 13, the image processing circuit 14, and the display device 15 in the display system 10 described in FIG.
  • step S31 shown in FIG. 11 the imaging data is acquired by the imaging device 11 and the imaging data is output to the feature amount output circuit 12.
  • correction data and detection data are stored in the database 13.
  • the correction data 18 and the detection data 19 in the database 13 may be stored in advance.
  • Step S31 shown in FIG. 11 can be illustrated as in the block diagram shown in FIG.
  • the imaging data 16 illustrated in FIG. 9C is illustrated for easy understanding.
  • a plurality of automobile images 18 ⁇ / b> A are shown as the correction data 18 for easy understanding.
  • a headlight image 19 ⁇ / b> A which is a part of an image of an automobile, is illustrated as detection data.
  • step S32 shown in FIG. 11 the feature amount data is calculated by the feature amount output circuit 12, and the feature amount data is output from the feature amount output circuit 12 to the database 13.
  • Step S32 shown in FIG. 11 can be illustrated as in the block diagram shown in FIG. In FIG. 13, in order to facilitate understanding, a headlight image 17 ⁇ / b> A is illustrated as a part of an automobile image that is an appearance feature amount as the feature amount data 17.
  • step S33 shown in FIG. 11 the feature amount data 17 is input from the feature amount output circuit 12 to the database 13, and the detection is performed by searching for the detection data 19 that matches or resembles the feature amount data using the headlight image 17A.
  • the data 19 is selected and the correction data 18 corresponding to the detection data 19 is output to the image processing circuit 14.
  • Step S33 shown in FIG. 11 can be illustrated as in the block diagram shown in FIG. In FIG. 14, for the sake of easy understanding, it is assumed that the feature data of the headlight image 17A and the feature data of the headlight image 19A coincide with each other with correction data 18 output to the image processing circuit 14. An image 18A is illustrated.
  • step S34 shown in FIG. 11 the imaging data 16 from the imaging device 11 as correction source data and the correction data 18 from the database 13 as correction data are input to the image processing circuit 14, and imaging is performed. Data 16 is corrected.
  • the corrected imaging data is output from the image processing circuit 14 to the display device 15 as image data.
  • the display device 15 receives image data from the image processing circuit 14 and can perform a clear display.
  • Step S34 shown in FIG. 11 can be illustrated as in the block diagram shown in FIG.
  • FIG. 15 illustrates the imaging data 16 illustrated in FIG. 9C for easy understanding.
  • an image 18 ⁇ / b> A is illustrated as correction data 18 output to the image processing circuit 14 for easy understanding.
  • image data 51 corresponding to the image data output to the display device 15 is illustrated for easy understanding.
  • the feature amount is extracted from a part of information of the imaging data 16, and the feature amount data 17 is collated in the database 13. 18 is selected and the unclear area of the imaged data 16 is corrected. Therefore, it is effective for improving visibility.
  • a corrected image can be visually recognized even if an unclear area is generated in the imaging data obtained by the imaging device in accordance with changes in conditions such as day and night and fine rain. For example, even if a headlight of a vehicle behind the vehicle or a water droplet attached to the imaging device causes a blurred region, correction data corresponding to the feature amount data can be selected and the imaging data can be corrected. Therefore, it becomes easy to grasp the size and shape of the entire subject. Moreover, since the information obtained can be increased, it is effective in improving visibility.
  • Embodiment 2 In this embodiment, a configuration example of a semiconductor device that can be used for the neural network 30 described in the above embodiment will be described. In particular, it can be used in product-sum operation circuits such as the intermediate layer 32 and the output layer 33.
  • FIG. 16 shows a configuration example of the semiconductor device MAC having a function of performing a neural network operation.
  • the semiconductor device MAC can be used for at least a part of the neural network 30 described in the above embodiment.
  • the semiconductor device MAC has a function of performing a product-sum operation on the first data corresponding to the connection strength (weight) between the neurons and the second data corresponding to the input data.
  • the first data and the second data can be analog data or multivalued data (discrete data), respectively.
  • the semiconductor device MAC has a function of converting data obtained by the product-sum operation using an activation function.
  • the semiconductor device MAC includes a cell array CA, a current source circuit CS, a current mirror circuit CM, a circuit WDD, a circuit WLD, a circuit CLD, an offset circuit OFST, and an activation function circuit ACTV.
  • the cell array CA includes a plurality of memory cells MC and a plurality of memory cells MCref.
  • the cell array CA has m rows and n columns (m and n are integers of 1 or more) memory cells MC (MC [1,1] to [m, n]) and m memory cells MCref (MCref 2 shows an example of a configuration having [1] to [m]).
  • Memory cell MC has a function of storing first data.
  • the memory cell MCref has a function of storing reference data used for product-sum operation.
  • the reference data can be analog data or multi-value data.
  • the memory cell MC [i, j] (i is an integer of 1 to m, j is an integer of 1 to n) includes the wiring WL [i], the wiring RW [i], the wiring WD [j], and the wiring BL [J].
  • the memory cell MCref [i] is connected to the wiring WL [i], the wiring RW [i], the wiring WDref, and the wiring BLref.
  • a current flowing between the memory cell MC [i, j] and the wiring BL [ j] is expressed as I MC [i, j]
  • a current flowing between the memory cell MCref [i] and the wiring BLref is expressed as I MCref [ i] .
  • FIG. 17 shows a specific configuration example of the memory cell MC and the memory cell MCref.
  • FIG. 17 shows memory cells MC [1,1], [2,1] and memory cells MCref [1], [2] as representative examples, but the same applies to other memory cells MC and memory cells MCref. Can be used.
  • Each of the memory cell MC and the memory cell MCref includes transistors Tr11 and Tr12 and a capacitor C11.
  • the case where the transistors Tr11 and Tr12 are n-channel transistors will be described.
  • the gate of the transistor Tr11 is connected to the wiring WL, one of the source and the drain is connected to the gate of the transistor Tr12 and the first electrode of the capacitor C11, and the other of the source or the drain is connected to the wiring WD.
  • One of a source and a drain of the transistor Tr12 is connected to the wiring BL, and the other of the source and the drain is connected to the wiring VR.
  • the second electrode of the capacitor C11 is connected to the wiring RW.
  • the wiring VR is a wiring having a function of supplying a predetermined potential.
  • a low power supply potential such as a ground potential
  • a node connected to one of the source and the drain of the transistor Tr11, the gate of the transistor Tr12, and the first electrode of the capacitor C11 is a node NM.
  • the nodes NM of the memory cells MC [1,1] and [2,1] are denoted as nodes NM [1,1] and [2,1], respectively.
  • the memory cell MCref has the same configuration as the memory cell MC. However, the memory cell MCref is connected to the wiring WDref instead of the wiring WD, and is connected to the wiring BLref instead of the wiring BL.
  • a node connected to one of the source and the drain of the transistor Tr11, the gate of the transistor Tr12, and the first electrode of the capacitor C11 is a node NMref [1]. , [2].
  • the node NM and the node NMref function as a memory cell MC and a holding node for the memory cell MCref, respectively.
  • the node NM holds first data
  • the node NMref holds reference data.
  • currents IMC [1,1] and IMC [2,1] flow from the wiring BL [1] to the transistors Tr12 of the memory cells MC [1,1] and [2,1], respectively.
  • currents I MCref [1] and I MCref [2] flow from the wiring BLref to the transistors Tr12 of the memory cells MCref [1] and [2], respectively.
  • the transistor Tr11 Since the transistor Tr11 has a function of holding the potential of the node NM or the node NMref, the off-state current of the transistor Tr11 is preferably small. Therefore, an OS transistor with an extremely low off-state current is preferably used as the transistor Tr11. As a result, fluctuations in the potential of the node NM or the node NMref can be suppressed, and the calculation accuracy can be improved. In addition, the frequency of the operation of refreshing the potential of the node NM or the node NMref can be suppressed, and power consumption can be reduced.
  • the transistor Tr12 is not particularly limited, and for example, a Si transistor or an OS transistor can be used.
  • an OS transistor is used as the transistor Tr12, the transistor Tr12 can be manufactured using the same manufacturing apparatus as the transistor Tr11, and manufacturing cost can be reduced.
  • the transistor Tr12 may be an n-channel type or a p-channel type.
  • the current source circuit CS is connected to the wirings BL [1] to [n] and the wiring BLref.
  • the current source circuit CS has a function of supplying current to the wirings BL [1] to [n] and the wiring BLref.
  • the current value supplied to the wirings BL [1] to [n] may be different from the current value supplied to the wiring BLref.
  • the current supplied from the current source circuit CS to the wirings BL [1] to [n] is expressed as I C
  • the current supplied from the current source circuit CS to the wiring BLref is expressed as I Cref .
  • the current mirror circuit CM includes wirings IL [1] to [n] and wiring ILref.
  • the wirings IL [1] to [n] are connected to the wirings BL [1] to [n], respectively, and the wiring ILref is connected to the wiring BLref.
  • connection points between the wirings IL [1] to [n] and the wirings BL [1] to [n] are denoted as nodes NP [1] to [n].
  • a connection point between the wiring ILref and the wiring BLref is referred to as a node NPref.
  • the current mirror circuit CM has a function of flowing a current I CM corresponding to the potential of the node NPref to the wiring ILref and a function of flowing the current I CM to the wirings IL [1] to [n].
  • Figure 16 is discharged current I CM from the wiring BLref to the wiring ILref
  • wiring BL [1] to the wiring from the [n] IL [1] to [n] to the current I CM is an example to be discharged .
  • currents flowing from the current mirror circuit CM to the cell array CA via the wirings BL [1] to [n] are denoted as I B [1] to [n].
  • a current flowing from the current mirror circuit CM to the cell array CA via the wiring BLref is denoted as I Bref .
  • the circuit WDD is connected to the wirings WD [1] to [n] and the wiring WDref.
  • the circuit WDD has a function of supplying a potential corresponding to the first data stored in the memory cell MC to the wirings WD [1] to [n]. Further, the circuit WDD has a function of supplying a potential corresponding to reference data stored in the memory cell MCref to the wiring WDref.
  • the circuit WLD is connected to the wirings WL [1] to [m].
  • the circuit WLD has a function of supplying a signal for selecting the memory cell MC or the memory cell MCref to which data is written to the wirings WL [1] to [m].
  • the circuit CLD is connected to the wirings RW [1] to [m].
  • the circuit CLD has a function of supplying a potential corresponding to the second data to the wirings RW [1] to [m].
  • the offset circuit OFST is connected to the wirings BL [1] to [n] and the wirings OL [1] to [n].
  • the offset circuit OFST has a function of detecting a current amount flowing from the wirings BL [1] to [n] to the offset circuit OFST and / or a change amount of a current flowing from the wirings BL [1] to [n] to the offset circuit OFST.
  • Have The offset circuit OFST has a function of outputting the detection result to the wirings OL [1] to [n].
  • the offset circuit OFST may output a current corresponding to the detection result to the wiring OL, or may convert a current corresponding to the detection result into a voltage and output the voltage to the wiring OL.
  • the current flowing between the cell array CA and the offset circuit OFST is expressed as I ⁇ [1] to [n].
  • FIG. 18 shows a configuration example of the offset circuit OFST.
  • the offset circuit OFST illustrated in FIG. 18 includes circuits OC [1] to [n].
  • Each of the circuits OC [1] to [n] includes a transistor Tr21, a transistor Tr22, a transistor Tr23, a capacitor C21, and a resistor R1.
  • the connection relationship of each element is as shown in FIG. Note that a node connected to the first electrode of the capacitor C21 and the first terminal of the resistor element R1 is referred to as a node Na.
  • a node connected to the second electrode of the capacitor C21, one of the source or the drain of the transistor Tr21, and the gate of the transistor Tr22 is referred to as a node Nb.
  • the wiring VrefL has a function of supplying the potential Vref
  • the wiring VaL has a function of supplying the potential Va
  • the wiring VbL has a function of supplying the potential Vb.
  • the wiring VDDL has a function of supplying the potential VDD
  • the wiring VSSL has a function of supplying the potential VSS.
  • the wiring RST has a function of supplying a potential for controlling the conduction state of the transistor Tr21.
  • the transistor Tr22, the transistor Tr23, the wiring VDDL, the wiring VSSL, and the wiring VbL constitute a source follower circuit.
  • circuit OC [1] to [n] will be described.
  • or [n] can be operated similarly.
  • the transistor Tr21 is on, and the potential Va is supplied to the node Nb. Thereafter, the transistor Tr21 is turned off.
  • the potential ⁇ V Na is determined according to the amount of change from the first current to the second current, the resistance element R1, and the potential Vref.
  • the resistance element R1 and the potential Vref is known, it is possible to determine the amount of change current flowing from the potential [Delta] V Na wiring BL.
  • the signal corresponding to the amount of current detected by the offset circuit OFST and / or the amount of change in current as described above is input to the activation function circuit ACTV via the wirings OL [1] to [n].
  • the activation function circuit ACTV is connected to the wirings OL [1] to [n] and the wirings NIL [1] to [n].
  • the activation function circuit ACTV has a function of performing an operation for converting the signal input from the offset circuit OFST according to a predefined activation function.
  • a sigmoid function, a tanh function, a softmax function, a ReLU function, a threshold function, or the like can be used.
  • the signal converted by the activation function circuit ACTV is output as output data to the wirings NIL [1] to [n].
  • FIG. 19 shows a timing chart of an operation example of the semiconductor device MAC.
  • 19 includes the wiring WL [1], the wiring WL [2], the wiring WD [1], the wiring WDref, the node NM [1,1], the node NM [2,1], and the node NMref [1] in FIG. ,
  • the transition of the potential of the node NMref [2], the wiring RW [1], and the wiring RW [2] and the transition of the values of the current I B [1] ⁇ I ⁇ [1] and the current I Bref .
  • the current I B [1] ⁇ I ⁇ [1] corresponds to the sum of currents flowing from the wiring BL [1] to the memory cells MC [1,1] and [2,1].
  • the operation will be described focusing on the memory cells MC [1,1] and [2,1] and the memory cells MCref [1] and [2] shown in FIG.
  • the MC and the memory cell MCref can be operated similarly.
  • the potential of the wiring WL [1] becomes high level
  • the potential of the wiring WD [1] becomes V PR ⁇ V W [1,1] higher than the ground potential (GND)
  • the wiring potential of WDref becomes the V PR greater potential than the ground potential.
  • the potentials of the wiring RW [1] and the wiring RW [2] are the reference potential (REFP).
  • the potential V W [1, 1] is a potential corresponding to the first data stored in the memory cell MC [1, 1].
  • the potential VPR is a potential corresponding to the reference data.
  • the transistor Tr11 included in the memory cell MC [1,1] and the memory cell MCref [1] is turned on, and the potential of the node NM [1,1] is V PR ⁇ V W [1,1] and the node NMref.
  • the potential of [1] becomes VPR .
  • a current I MC [1,1], 0 flowing from the wiring BL [1] to the transistor Tr12 of the memory cell MC [1,1] can be expressed by the following equation.
  • k is a constant determined by the channel length, channel width, mobility, capacitance of the gate insulating film, and the like of the transistor Tr12.
  • V th is the threshold voltage of the transistor Tr12.
  • the potential of the wiring WL [1] is at a low level. Accordingly, the transistor Tr11 included in the memory cell MC [1,1] and the memory cell MCref [1] is turned off, and the potentials of the node NM [1,1] and the node NMref [1] are held.
  • an OS transistor is preferably used as the transistor Tr11. Accordingly, leakage current of the transistor Tr11 can be suppressed, and the potentials of the node NM [1,1] and the node NMref [1] can be accurately held.
  • the potential of the wiring WL [2] is at a high level
  • the potential of the wiring WD [1] is V PR ⁇ V W [2,1] higher than the ground potential
  • the wiring WDref The potential becomes a potential VPR larger than the ground potential.
  • the potential V W [2, 1] is a potential corresponding to the first data stored in the memory cell MC [2, 1]. Accordingly, the transistor Tr11 included in the memory cell MC [2,1] and the memory cell MCref [2] is turned on, and the potential of the node NM [2,1] is V PR ⁇ V W [2,1] and the node NMref. The potential of [2] becomes VPR .
  • the potential of the wiring WL [2] is at a low level. Accordingly, the transistor Tr11 included in the memory cell MC [2,1] and the memory cell MCref [2] is turned off, and the potentials of the node NM [2,1] and the node NMref [2] are held.
  • the first data is stored in the memory cells MC [1,1] and [2,1], and the reference data is stored in the memory cells MCref [1] and [2].
  • a current from the current source circuit CS is supplied to the wiring BL [1]. Further, the current flowing through the wiring BL [1] is discharged to the current mirror circuit CM and the memory cells MC [1,1], [2,1]. In addition, a current flows from the wiring BL [1] to the offset circuit OFST.
  • the current supplied from the current source circuit CS to the wiring BL [1] is I C, 0 and the current flowing from the wiring BL [1] to the offset circuit OFST is I ⁇ , 0 , the following equation is established.
  • the potential of the wiring RW [1] is V X [1] larger than the reference potential.
  • the potential V X [1] is supplied to the respective capacitive elements C11 of the memory cell MC [1,1] and the memory cell MCref [1], and the potential of the gate of the transistor Tr12 is increased by capacitive coupling.
  • the potential V x [1] is a potential corresponding to the second data supplied to the memory cell MC [1, 1] and the memory cell MCref [1].
  • the amount of change in the potential of the gate of the transistor Tr12 is a value obtained by multiplying the amount of change in the potential of the wiring RW by the capacitive coupling coefficient determined by the configuration of the memory cell.
  • the capacitive coupling coefficient is calculated by the capacitance of the capacitive element C11, the gate capacitance of the transistor Tr12, the parasitic capacitance, and the like.
  • the capacitive coupling coefficient is 1.
  • the potential V x may be determined in consideration of the capacitive coupling coefficient.
  • the current I MC [1,1], 1 flowing from the wiring BL [1] to the transistor Tr12 of the memory cell MC [1,1] can be expressed by the following equation.
  • current I MCref [1], 1 flowing from the wiring BLref to the transistor Tr12 of the memory cell MCref [1] from time T05 to T06 can be expressed by the following equation.
  • the wiring BL [1], the current I C is supplied from the current source circuit CS. Further, the current flowing through the wiring BL [1] is discharged to the current mirror circuit CM and the memory cells MC [1,1], [2,1]. Further, a current also flows from the wiring BL [1] to the offset circuit OFST.
  • the current flowing from the wiring BL [1] to the offset circuit OFST is I ⁇ , 1 , the following equation is established.
  • the differential current ⁇ I ⁇ has a value corresponding to the product of the potentials V W [1, 1] and V X [1] .
  • the potential of the wiring RW [1] becomes the ground potential, and the potentials of the node NM [1,1] and the node NMref [1] are the same as those of the time T04-T05.
  • the potential of the wiring RW [1] is V X [1] larger than the reference potential
  • the potential of the wiring RW [2] is V X [2] larger than the reference potential.
  • the potential V X [1] is supplied to the respective capacitive elements C11 of the memory cell MC [1,1] and the memory cell MCref [1], and the node NM [1,1] and the node NMref [ 1] is increased by V X [1] .
  • V X [2] is supplied to the respective capacitor C11 of the memory cell MC [2,1] and the memory cell MCref [2], and the node NM [2,1] and the node NMref [2 ] are connected by capacitive coupling. ] Increases by V X [2] .
  • the current I MC [2,1], 1 flowing from the wiring BL [1] to the transistor Tr12 of the memory cell MC [2,1] can be expressed by the following equation.
  • current I MCref [2], 1 flowing from the wiring BLref to the transistor Tr12 of the memory cell MCref [2] from time T05 to T06 can be expressed by the following equation.
  • the wiring BL [1], the current I C is supplied from the current source circuit CS. Further, the current flowing through the wiring BL [1] is discharged to the current mirror circuit CM and the memory cells MC [1,1], [2,1]. Further, a current also flows from the wiring BL [1] to the offset circuit OFST. Assuming that the current flowing from the wiring BL [1] to the offset circuit OFST is I ⁇ , 2 , the following equation is established.
  • the differential current ⁇ I ⁇ is obtained by adding the product of the potential V W [1, 1] and the potential V X [1] and the product of the potential V W [2, 1] and the potential V X [2]. The value depends on the combined result.
  • the difference current ⁇ I ⁇ input to the offset circuit OFST includes the potential V X corresponding to the first data (weight) and the second data (input data). ) corresponding to a value corresponding to the combined result plus the product of the potential V W. That is, by measuring the differential current ⁇ I ⁇ with the offset circuit OFST, it is possible to obtain a product-sum operation result of the first data and the second data.
  • the memory cells MC [1,1] and [2,1] and the memory cells MCref [1] and [2] are particularly focused.
  • the number of the memory cells MC and the memory cells MCref should be arbitrarily set. Can do.
  • the differential current ⁇ I ⁇ when the number of rows m of the memory cell MC and the memory cell MCref is an arbitrary number can be expressed by the following equation.
  • the number of product-sum operations executed in parallel can be increased.
  • the semiconductor device MAC by using the semiconductor device MAC, the product-sum operation of the first data and the second data can be performed. Note that by using the structure shown in FIG. 17 as the memory cell MC and the memory cell MCref, a product-sum operation circuit can be formed with a small number of transistors. Therefore, the circuit scale of the semiconductor device MAC can be reduced.
  • the number of rows m of the memory cells MC corresponds to the number of input data supplied to one neuron
  • the number of columns n of the memory cells MC corresponds to the number of neurons.
  • the semiconductor device MAC As described above, by using the semiconductor device MAC, the product-sum operation of the neural network can be performed. Further, by using the memory cell MC and the memory cell MCref shown in FIG. 17 for the cell array CA, an integrated circuit capable of improving calculation accuracy, reducing power consumption, or reducing the circuit scale can be provided. .
  • the product difference calculation can be performed by setting “positive” when the potential V X corresponding to the first data (weight) is equal to or higher than an arbitrary reference potential, and “negative” when the potential is smaller. Therefore, the semiconductor device MAC can function as a product difference arithmetic circuit.
  • FIGS. 20A and 20B are shown.
  • 20A and 20B are images showing a vehicle that is traveling in a dark place such as in a tunnel.
  • FIG. 20A shows that the vehicle 110 positioned outside the tunnel can be visually recognized due to the influence of the headlight 105 of the vehicle 100 that is suddenly turned on, but the visibility of the pedestrian 120 and the pedestrian 130 inside the tunnel is reduced. Shows the state.
  • the image processing using the product difference arithmetic circuit reduces the influence of the headlight 105 that is suddenly turned on, and not only the vehicle 110 located outside the tunnel but also the pedestrian 120 inside the tunnel. In addition, the visibility of the pedestrian 130 is also improved. Note that difference information between the current frame image and the previous frame image can be acquired by the product difference calculation circuit, and image processing can be performed using the difference information.
  • in-vehicle image sensors are expected for automated driving and as side mirrors and rearview mirrors.
  • a mechanism for adjusting sensitivity for each pixel By combining one embodiment of the present invention with a mechanism for adjusting sensitivity for each pixel, an obstacle or a person can be accurately detected even in a situation where the lights of other vehicles are dazzling.
  • This embodiment mode can be combined with any of the other embodiment modes as appropriate.
  • FIG. 21 is a top view showing a display device 700 applicable to the display device 15 exemplified in the previous embodiment.
  • a display device 700 illustrated in FIG. 21 includes a pixel portion 702 provided over a first substrate 701, a demultiplexer 703 provided in the first substrate 701, a source driver 704 and a gate driver 706, a pixel portion 702,
  • the sealant 712 is disposed so as to surround the demultiplexer 703 and the gate driver 706, and the second substrate 705 is provided so as to face the first substrate 701. Note that the first substrate 701 and the second substrate 705 are sealed with a sealant 712.
  • the pixel portion 702, the demultiplexer 703, and the gate driver 706 are sealed with the first substrate 701, the sealant 712, and the second substrate 705. Note that although not illustrated in FIG. 21, a display element is provided between the first substrate 701 and the second substrate 705.
  • the display device 700 includes a pixel portion 702, a demultiplexer 703, a source driver 704, and a gate driver 706 in different regions from the region surrounded by the sealant 712 on the first substrate 701.
  • FPC terminal portion 708 Flexible printed circuit
  • an FPC 716 is connected to the FPC terminal portion 708, and various signals are supplied to the pixel portion 702, the demultiplexer 703, the source driver 704, and the gate driver 706 by the FPC 716.
  • a signal line 710 is connected to each of the pixel portion 702, the demultiplexer 703, the source driver 704, the gate driver 706, and the FPC terminal portion 708.
  • Various signals and the like supplied from the FPC 716 are supplied to the pixel portion 702, the demultiplexer 703, the source driver 704, the gate driver 706, and the FPC terminal portion 708 through the signal line 710.
  • a plurality of gate drivers 706 may be provided in the display device 700.
  • the gate driver 706 is formed over the same first substrate 701 as the pixel portion 702 and the source driver 704 is a source driver IC is shown; however, the structure is not limited to this.
  • the source driver 704 may be formed on the first substrate 701.
  • the source driver IC can be provided by a COG (Chip On Glass) method, a wire bonding method, or the like.
  • the demultiplexer 703 can be omitted.
  • the display device 700 can have various elements.
  • the element include, for example, an electroluminescence (EL) element (an EL element including an organic substance and an inorganic substance, an organic EL element, an inorganic EL element, an LED, etc.), a light-emitting transistor (a transistor that emits light in response to a current), and electron emission.
  • EL electroluminescence
  • Element liquid crystal element, electronic ink element, electrophoretic element, electrowetting element, plasma display panel (PDP), MEMS (micro electro mechanical system) display (for example, grating light valve (GLV), digital micromirror device (DMD), digital micro shutter (DMS) element, interferometric modulation (IMOD) element, etc.), piezoelectric ceramic display, and the like.
  • An example of a display device using an EL element is an EL display.
  • a display device using an electron-emitting device there is a field emission display (FED), a SED type flat display (SED: Surface-conduction Electron-emitter Display), or the like.
  • FED field emission display
  • SED SED type flat display
  • a display device using a liquid crystal element there is a liquid crystal display (a transmissive liquid crystal display, a transflective liquid crystal display, a reflective liquid crystal display, a direct view liquid crystal display, a projection liquid crystal display) and the like.
  • An example of a display device using an electronic ink element or an electrophoretic element is electronic paper.
  • part or all of the pixel electrode may have a function as a reflective electrode.
  • part or all of the pixel electrode may have aluminum, silver, or the like.
  • a memory circuit such as an SRAM can be provided under the reflective electrode. Thereby, power consumption can be further reduced.
  • the color elements controlled by the pixels when performing color display are not limited to three colors of RGB (R represents red, G represents green, and B represents blue).
  • RGB red
  • G represents green
  • B represents blue
  • it may be composed of four pixels: an R pixel, a G pixel, a B pixel, and a W (white) pixel.
  • one color element may be configured by two colors of RGB, and two different colors may be selected and configured depending on the color element.
  • one or more colors such as yellow, cyan, and magenta may be added to RGB.
  • the size of the display area may be different for each dot of the color element.
  • the disclosed invention is not limited to a display device for color display, and can be applied to a display device for monochrome display.
  • a colored layer (also referred to as a color filter) may be used in order to display white light (W) in a backlight (an organic EL element, an inorganic EL element, an LED, a fluorescent lamp, or the like) and display a full color display device.
  • a backlight an organic EL element, an inorganic EL element, an LED, a fluorescent lamp, or the like
  • red (R), green (G), blue (B), yellow (Y), and the like can be used in appropriate combination for the colored layer.
  • the colored layer the color reproducibility can be increased as compared with the case where the colored layer is not used.
  • white light in a region having no colored layer may be directly used for display by arranging a region having a colored layer and a region having no colored layer.
  • a decrease in luminance due to the colored layer can be reduced during bright display, and power consumption can be reduced by about 20% to 30%.
  • a self-luminous element such as an organic EL element or an inorganic EL element
  • R, G, B, Y, and W may be emitted from elements having respective emission colors.
  • power consumption may be further reduced as compared with the case where a colored layer is used.
  • colorization method in addition to a method (color filter method) in which part of the light emission from the white light emission described above is converted into red, green, and blue through a color filter, red, green, and blue light emission is performed.
  • a method of using each (three-color method) or a method of converting a part of light emission from blue light emission into red or green (color conversion method, quantum dot method) may be applied.
  • FIG. 22 is a cross-sectional view taken along one-dot chain line QR shown in FIG.
  • FIG. 23 is a cross-sectional view taken along the alternate long and short dash line QR shown in FIG. 21, and includes an EL element as a display element.
  • a display device 700 illustrated in FIGS. 22 and 23 includes a lead wiring portion 711, a pixel portion 702, a demultiplexer 703, and an FPC terminal portion 708. Further, the lead wiring portion 711 includes a signal line 710. In addition, the pixel portion 702 includes a transistor 750 and a capacitor 790. In addition, the demultiplexer 703 includes a transistor 752.
  • the transistor 750 and the transistor 752 may be any of a top gate type, a bottom gate type, a channel etch type, and a channel protection type. 22 and 23 illustrate a top gate type.
  • a silicon-based semiconductor amorphous silicon, polycrystalline silicon, or the like
  • an oxide semiconductor zinc oxide, indium oxide, or the like
  • 22 and 23 illustrate the case where an oxide semiconductor is used.
  • the capacitor 790 includes a first oxide semiconductor film included in the transistor 750, a lower electrode formed through a step of processing the same oxide semiconductor film, and a conductive material functioning as a source electrode and a drain electrode included in the transistor 750. A film and an upper electrode formed through a process of processing the same conductive film. In addition, a step of forming the same insulating film as the second insulating film and the insulating film functioning as the third insulating film of the transistor 750 between the lower electrode and the upper electrode is formed. An insulating film formed through the above is provided. That is, the capacitor 790 has a stacked structure in which an insulating film functioning as a dielectric is sandwiched between a pair of electrodes.
  • a planarization insulating film 770 is provided over the transistor 750, the transistor 752, and the capacitor 790.
  • planarization insulating film 770 an organic material having heat resistance such as polyimide resin, acrylic resin, polyimide amide resin, benzocyclobutene resin, polyamide resin, or epoxy resin can be used. Note that the planarization insulating film 770 may be formed by stacking a plurality of insulating films formed using these materials. Further, the planarization insulating film 770 may be omitted.
  • the signal line 710 is formed through the same process as the conductive film functioning as the source and drain electrodes of the transistors 750 and 752.
  • the signal line 710 is a conductive film formed through a different process from the source and drain electrodes of the transistors 750 and 752, for example, an oxide semiconductor formed through the same process as an oxide semiconductor film functioning as a gate electrode.
  • a membrane may be used.
  • a material containing a copper element is used as the signal line 710, signal delay due to wiring resistance is small and display on a large screen is possible.
  • the FPC terminal portion 708 includes a connection electrode 760, an anisotropic conductive film 780, and an FPC 716.
  • the connection electrode 760 is formed through the same process as the conductive film functioning as the source and drain electrodes of the transistors 750 and 752.
  • the connection electrode 760 is electrically connected to a terminal included in the FPC 716 through an anisotropic conductive film 780.
  • first substrate 701 and the second substrate 705 for example, glass substrates can be used.
  • first substrate 701 and the second substrate 705 flexible substrates may be used. Examples of the flexible substrate include a plastic substrate.
  • a structure body 778 is provided between the first substrate 701 and the second substrate 705.
  • the structure body 778 is a columnar spacer obtained by selectively etching an insulating film, and is provided to control the distance (cell gap) between the first substrate 701 and the second substrate 705. Note that a spherical spacer may be used as the structure body 778.
  • a light shielding film 738 functioning as a black matrix, a colored film 736 functioning as a color filter, and an insulating film 734 in contact with the light shielding film 738 and the colored film 736 are provided.
  • a display device 700 illustrated in FIG. 22 includes a liquid crystal element 775.
  • the liquid crystal element 775 includes a conductive film 772, a conductive film 774, and a liquid crystal layer 776.
  • the conductive film 774 is provided on the second substrate 705 side and functions as a counter electrode.
  • the display device 700 illustrated in FIG. 22 can display an image by controlling transmission and non-transmission of light by changing the alignment state of the liquid crystal layer 776 depending on voltages applied to the conductive films 772 and 774.
  • the conductive film 772 is connected to a conductive film functioning as a source electrode and a drain electrode of the transistor 750.
  • the conductive film 772 is formed over the planarization insulating film 770 and functions as a pixel electrode, that is, one electrode of a display element.
  • the conductive film 772 functions as a transparent electrode.
  • a display device 700 illustrated in FIG. 22 is a so-called transmissive color liquid crystal display device that transmits light from a backlight through a liquid crystal layer 776 and displays the light through a colored film 736.
  • a conductive film that is transparent to visible light or a conductive film that is reflective to visible light can be used.
  • a material containing one kind selected from indium (In), zinc (Zn), and tin (Sn) may be used.
  • a material containing aluminum or silver is preferably used.
  • an alignment film may be provided on each side of the conductive films 772 and 774 in contact with the liquid crystal layer 776.
  • an optical member such as a polarizing member, a retardation member, or an antireflection member may be provided as appropriate.
  • circularly polarized light using a polarizing substrate and a retardation substrate may be used.
  • a backlight, a sidelight, or the like may be used as the light source.
  • thermotropic liquid crystal When a liquid crystal element is used as the display element, a thermotropic liquid crystal, a low molecular liquid crystal, a polymer liquid crystal, a polymer dispersed liquid crystal, a ferroelectric liquid crystal, an antiferroelectric liquid crystal, or the like can be used. These liquid crystal materials exhibit a cholesteric phase, a smectic phase, a cubic phase, a chiral nematic phase, an isotropic phase, and the like depending on conditions.
  • a liquid crystal exhibiting a blue phase without using an alignment film may be used.
  • the blue phase is one of the liquid crystal phases.
  • the temperature of the cholesteric liquid crystal is increased, the blue phase appears immediately before the transition from the cholesteric phase to the isotropic phase. Since the blue phase appears only in a narrow temperature range, a liquid crystal composition mixed with several percent by weight or more of a chiral agent is used for the liquid crystal layer in order to improve the temperature range.
  • a liquid crystal composition containing a liquid crystal exhibiting a blue phase and a chiral agent has a short response speed and is optically isotropic, so that alignment treatment is unnecessary.
  • a liquid crystal material exhibiting a blue phase has a small viewing angle dependency.
  • a liquid crystal element when used as a display element, a TN (Twisted Nematic) mode, an IPS (In-Plane-Switching) mode, an FFS (Fringe Field Switching) mode, an ASM (Axially Symmetrical Aligned MicroOcell) mode.
  • a Compensated Birefringence mode, an FLC (Ferroelectric Liquid Crystal) mode, an AFLC (Antiferroelectric Liquid Crystal) mode, and the like can be used.
  • a normally black liquid crystal display device such as a transmissive liquid crystal display device employing a vertical alignment (VA) mode may be used.
  • VA vertical alignment
  • the vertical alignment mode There are several examples of the vertical alignment mode. For example, an MVA (Multi-Domain Vertical Alignment) mode, a PVA (Patterned Vertical Alignment) mode, an ASV mode, and the like can be used.
  • a display device 700 illustrated in FIG. 23 includes a light-emitting element 782.
  • the light-emitting element 782 includes a conductive film 784, an EL layer 786, and a conductive film 788.
  • the display device 700 illustrated in FIG. 23 can display an image when the EL layer 786 included in the light-emitting element 782 emits light.
  • the conductive film 784 is connected to a conductive film functioning as a source electrode and a drain electrode of the transistor 750.
  • the conductive film 784 is formed over the planarization insulating film 770 and functions as a pixel electrode, that is, one electrode of a display element.
  • a conductive film that transmits visible light or a conductive film that reflects visible light can be used.
  • a material containing one kind selected from indium (In), zinc (Zn), and tin (Sn) may be used.
  • As the conductive film having reflectivity in visible light for example, a material containing aluminum or silver is preferably used.
  • the insulating film 730 is provided over the planarization insulating film 770 and the conductive film 784.
  • the insulating film 730 covers part of the conductive film 784.
  • the light-emitting element 782 has a top emission structure. Therefore, the conductive film 788 has a light-transmitting property and transmits light emitted from the EL layer 786.
  • the top emission structure is illustrated, but is not limited thereto. For example, a bottom emission structure in which light is emitted to the conductive film 784 side or a dual emission structure in which light is emitted to both the conductive film 784 and the conductive film 788 can be used.
  • a colored film 736 is provided at a position overlapping with the light emitting element 782, and a light shielding film 738 is provided at a position overlapping with the insulating film 730, the routing wiring portion 711, and the source driver 704. Further, the coloring film 736 and the light shielding film 738 are covered with an insulating film 734. A space between the light emitting element 782 and the insulating film 734 is filled with a sealing film 732. Note that in the display device 700 illustrated in FIG. 23, the structure in which the colored film 736 is provided is illustrated, but the present invention is not limited to this. For example, in the case where the EL layer 786 is formed by separate coating, the coloring film 736 may not be provided.
  • FIG. 24A shows the interior of an automobile in which bench seats are used for the driver's seat and the passenger seat.
  • FIG. 24A illustrates a display device 52A provided at the door, a display device 52B provided at the handle, and a display device 52C provided at the center of the seat surface of the bench seat.
  • the display device 52A can complement the view blocked by the door, for example, by displaying an image from an imaging device provided on the vehicle body on the display unit.
  • the display devices 52B and 52C have various other information such as navigation information, meters such as a speedometer and a tachometer, travel distance, oil supply amount, gear state, and air conditioner settings in addition to the image from the image pickup device provided on the vehicle body. Can be provided. In addition, display items, layouts, and the like displayed on the display device can be changed as appropriate according to user preferences.
  • the display devices 52B and 52C can also be used as lighting devices.
  • FIG. 24B is a diagram showing the periphery of the windshield in the interior of a car.
  • FIG. 24B illustrates the display device 53A attached to the dashboard.
  • the display device 53A can provide various other information such as navigation information, a speedometer and a tachometer, a travel distance, an oil supply amount, a gear state, and an air conditioner setting.
  • the display items, layout, and the like displayed on the display device can be appropriately changed according to the user's preference, and the design can be improved.
  • the display device 53A can also be used as a lighting device.
  • the display device 53A can complement the field of view (dead angle) obstructed by the vehicle body by displaying an image from the imaging means provided on the vehicle body. That is, by displaying an image from the imaging means provided outside the automobile, the blind spot can be compensated and safety can be improved. Also, by displaying a video that complements the invisible part, it is possible to confirm the safety more naturally and without a sense of incongruity.
  • the display device 53A can also be used as a lighting device.
  • the display system according to one embodiment of the present invention can be used not only for automobiles but also for various mobile objects. Specific examples of these moving objects are shown in FIGS.
  • FIG. 25A shows the bus 302.
  • the moving body according to one embodiment of the present invention can be used for the bus 302.
  • the display system can take an image outside the bus 302 and improve the visibility of the image when viewing the image. Therefore, the bus 302 can be improved in safety.
  • FIG. 25B shows the train 303.
  • the moving body according to one embodiment of the present invention can be used for the train 303.
  • the display system captures an image outside the train 303 and can improve the visibility of the image when viewing the image. Therefore, the train 303 can be improved in safety.
  • FIG. 25C shows the airplane 304.
  • the moving body according to one embodiment of the present invention can be used for the airplane 304.
  • the display system can take an image outside the airplane 304 and improve the visibility of the image when viewing the image. Therefore, the airplane 304 can be improved in safety.
  • the components are classified by function and shown as independent blocks.
  • it is difficult to separate the components for each function and there may be a case where a plurality of functions are involved in one circuit or a case where one function is involved over a plurality of circuits. Therefore, the blocks in the block diagram are not limited to the components described in the specification, and can be appropriately rephrased depending on the situation.
  • the voltage is a potential difference from a reference potential.
  • the reference potential is a ground potential (ground potential)
  • the voltage can be rephrased as a potential.
  • the ground potential does not necessarily mean 0V. Note that the potential is relative, and the potential applied to the wiring or the like may be changed depending on the reference potential.
  • a switch refers to a switch that is in a conductive state (on state) or a non-conductive state (off state) and has a function of controlling whether or not to pass a current.
  • the switch refers to a switch having a function of selecting and switching a current flow path.
  • an electrical switch or a mechanical switch can be used. That is, the switch is not limited to a specific one as long as it can control the current.
  • the “conducting state” of the transistor means a state in which the source and drain of the transistor can be regarded as being electrically short-circuited.
  • the “non-conducting state” of a transistor refers to a state where the source and drain of the transistor can be regarded as being electrically cut off.
  • the polarity (conductivity type) of the transistor is not particularly limited.
  • a and B are connected includes not only those in which A and B are directly connected, but also those that are electrically connected.
  • a and B are electrically connected.
  • 10 Display system, 10A: Display system, 10B: Display system, 10C: Display system, 11: Imaging device, 11A: Imaging device, 12: Feature output circuit, 13: Database, 14: Image processing circuit, 15: Display Device: 16: imaging data, 17: feature data, 18: correction data, 19: detection data, 20: transmission / reception circuit, 21: network, 22: automobile, 22A: automobile, 23: data processing circuit, 24: Relay station, 25: sensor, S11-S17: step, S21-S26: step, 30: neural network, 31: input layer, 32: intermediate layer, 33: output layer, 34: filter, 35: convolution data, 36: Pooling data, 37: filter, 38: convolution data, 39: pooling data, 40: all combined data, 4 : Output data, 42: automobile, 43: light source, 44: irradiation direction, 45: imaging direction, 46: lens, 47: water drop, 48: clear region, 49: unclear region, 11_1-11_n: imaging device, 15_1-15_n : Display

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Instrument Panels (AREA)

Abstract

L'invention concerne un système d'affichage qui a une nouvelle configuration et un corps mobile. L'invention concerne également un système d'affichage qui comprend un dispositif d'imagerie, un dispositif d'affichage, un circuit de sortie de valeur caractéristique, un circuit de traitement d'image et un serveur. Le dispositif d'imagerie peut acquérir des données d'imagerie. Le circuit de sortie de valeur caractéristique peut acquérir des données de valeur caractéristique pour les données d'imagerie. Une base de données comprend des données de correction et des données de détection et peut délivrer des données de correction au circuit de traitement d'image en fonction des données de valeur caractéristique. La base de données sélectionne les données de correction en fonction d'un apprentissage machine ou d'une coïncidence ou similarité avec les données de valeur caractéristique. Le circuit de traitement d'image peut générer des données d'image par la correction des données d'imagerie sur la base des données de correction. Le dispositif d'affichage peut produire un affichage conformément aux données d'image.
PCT/IB2018/052611 2017-04-28 2018-04-16 Système d'affichage et corps mobile Ceased WO2018197984A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2019514878A JPWO2018197984A1 (ja) 2017-04-28 2018-04-16 表示システムおよび移動体
JP2022182480A JP2023036577A (ja) 2017-04-28 2022-11-15 移動体
JP2024081459A JP7707366B2 (ja) 2017-04-28 2024-05-20 移動体

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2017089495 2017-04-28
JP2017-089495 2017-04-28
JP2017-125394 2017-06-27
JP2017125394 2017-06-27

Publications (1)

Publication Number Publication Date
WO2018197984A1 true WO2018197984A1 (fr) 2018-11-01

Family

ID=63920293

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2018/052611 Ceased WO2018197984A1 (fr) 2017-04-28 2018-04-16 Système d'affichage et corps mobile

Country Status (2)

Country Link
JP (3) JPWO2018197984A1 (fr)
WO (1) WO2018197984A1 (fr)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020077251A (ja) * 2018-11-08 2020-05-21 アイシン精機株式会社 周辺監視装置
WO2021130593A1 (fr) * 2019-12-27 2021-07-01 株式会社半導体エネルギー研究所 Système d'imagerie
CN114506276A (zh) * 2020-10-23 2022-05-17 欣兴电子股份有限公司 具有显示功能的后视镜
JPWO2022101982A1 (fr) * 2020-11-10 2022-05-19
JP2022553845A (ja) * 2019-11-08 2022-12-26 アウトワード・インコーポレーテッド 任意ビューの生成
US11875451B2 (en) 2016-03-25 2024-01-16 Outward, Inc. Arbitrary view generation
US11972522B2 (en) 2016-03-25 2024-04-30 Outward, Inc. Arbitrary view generation
US11989821B2 (en) 2016-03-25 2024-05-21 Outward, Inc. Arbitrary view generation
US11989820B2 (en) 2016-03-25 2024-05-21 Outward, Inc. Arbitrary view generation
US12002149B2 (en) 2016-03-25 2024-06-04 Outward, Inc. Machine learning based image attribute determination

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003189293A (ja) * 2001-09-07 2003-07-04 Matsushita Electric Ind Co Ltd 車両周囲状況表示装置および映像提示システム
JP2004260527A (ja) * 2003-02-26 2004-09-16 Mitsubishi Heavy Ind Ltd 対象物検知装置及び方法
JP2006160192A (ja) * 2004-12-10 2006-06-22 Alpine Electronics Inc 車両運転支援装置
JP2010273328A (ja) * 2009-04-20 2010-12-02 Fujifilm Corp 画像処理装置、画像処理方法およびプログラム
JP2014220655A (ja) * 2013-05-08 2014-11-20 本田技研工業株式会社 車両用画像表示装置および車両用画像表示方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003076988A (ja) * 2001-09-05 2003-03-14 Mitsubishi Heavy Ind Ltd 車輌識別方法及び装置
ATE311725T1 (de) * 2001-09-07 2005-12-15 Matsushita Electric Industrial Co Ltd Vorrichtung zum anzeigen der umgebung eines fahrzeuges und system zur bildbereitstellung
JP5051263B2 (ja) * 2010-04-02 2012-10-17 株式会社デンソー 車両用後方視認システム
KR101968115B1 (ko) * 2012-04-23 2019-08-13 엘지디스플레이 주식회사 어레이 기판 및 이의 제조방법
KR101451070B1 (ko) * 2014-06-05 2014-10-15 주식회사 다이나맥스 그림자에 의한 인식 오류를 제거하여 차량 번호를 인식하는 방법 및 차량 번호 인식 시스템
JP2016134129A (ja) * 2015-01-22 2016-07-25 株式会社Ｊｖｃケンウッド 映像表示システム、処理装置、映像表示方法、及び映像表示プログラム
IL239129A0 (en) * 2015-06-01 2015-11-30 Brightway Vision Ltd Image improvements in car imaging systems

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003189293A (ja) * 2001-09-07 2003-07-04 Matsushita Electric Ind Co Ltd 車両周囲状況表示装置および映像提示システム
JP2004260527A (ja) * 2003-02-26 2004-09-16 Mitsubishi Heavy Ind Ltd 対象物検知装置及び方法
JP2006160192A (ja) * 2004-12-10 2006-06-22 Alpine Electronics Inc 車両運転支援装置
JP2010273328A (ja) * 2009-04-20 2010-12-02 Fujifilm Corp 画像処理装置、画像処理方法およびプログラム
JP2014220655A (ja) * 2013-05-08 2014-11-20 本田技研工業株式会社 車両用画像表示装置および車両用画像表示方法

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11989820B2 (en) 2016-03-25 2024-05-21 Outward, Inc. Arbitrary view generation
US11875451B2 (en) 2016-03-25 2024-01-16 Outward, Inc. Arbitrary view generation
US12002149B2 (en) 2016-03-25 2024-06-04 Outward, Inc. Machine learning based image attribute determination
US11989821B2 (en) 2016-03-25 2024-05-21 Outward, Inc. Arbitrary view generation
US11972522B2 (en) 2016-03-25 2024-04-30 Outward, Inc. Arbitrary view generation
JP2020077251A (ja) * 2018-11-08 2020-05-21 アイシン精機株式会社 周辺監視装置
JP7271908B2 (ja) 2018-11-08 2023-05-12 株式会社アイシン 周辺監視装置
JP2022553845A (ja) * 2019-11-08 2022-12-26 アウトワード・インコーポレーテッド 任意ビューの生成
JP7410289B2 (ja) 2019-11-08 2024-01-09 アウトワード・インコーポレーテッド 任意ビューの生成
WO2021130593A1 (fr) * 2019-12-27 2021-07-01 株式会社半導体エネルギー研究所 Système d'imagerie
US11924589B2 (en) 2019-12-27 2024-03-05 Semiconductor Energy Laboratory Co., Ltd. Imaging system
JPWO2021130593A1 (fr) * 2019-12-27 2021-07-01
JP7596305B2 (ja) 2019-12-27 2024-12-09 株式会社半導体エネルギー研究所 撮像システム
CN114506276A (zh) * 2020-10-23 2022-05-17 欣兴电子股份有限公司 具有显示功能的后视镜
JPWO2022101982A1 (fr) * 2020-11-10 2022-05-19
JP7499874B2 (ja) 2020-11-10 2024-06-14 三菱電機株式会社 センサノイズ除去装置およびセンサノイズ除去方法
JP2024107047A (ja) * 2020-11-10 2024-08-08 三菱電機株式会社 センサノイズ除去装置およびセンサノイズ除去方法

Also Published As

Publication number Publication date
JP2023036577A (ja) 2023-03-14
JPWO2018197984A1 (ja) 2020-03-19
JP2024116154A (ja) 2024-08-27
JP7707366B2 (ja) 2025-07-14

Similar Documents

Publication Publication Date Title
JP7707366B2 (ja) 移動体
JP7068753B2 (ja) 機械学習方法、機械学習システム
US20180005566A1 (en) Electronic device, operation method of the electronic device, and moving vehicle
US10017114B2 (en) Vehicle vision system with display
US11828947B2 (en) Vehicle and control method thereof
WO2018002774A1 (fr) Dispositif électronique, procédé de fonctionnement du dispositif électronique et véhicule en mouvement
KR101358169B1 (ko) 표시 장치 및 그 구동방법
JP2024124515A (ja) 表示システム
US9001027B2 (en) Electrowetting display device including reset signal lines that include notch electrodes and driving method thereof
JP2019020714A (ja) 表示システム及びデータ処理方法
US20170337871A1 (en) Display System and Moving Object
US10699628B2 (en) Display system and vehicle
KR20180020126A (ko) 제어 가능한 마스킹 디스플레이를 갖는 투명 디스플레이
WO2017145015A1 (fr) Corps mobile et système antireflet
US20150234496A1 (en) Display device
CN110785321B (zh) 低成本摄像头
CN117445832A (zh) 控制车辆显示器以进行增强
JP4847884B2 (ja) 障害物検出装置、車両用表示装置及び障害物検出方法
US20210065607A1 (en) Display driver, electro-optical device, electronic apparatus, and mobile body
WO2017218658A1 (fr) Systèmes d'imagerie comprenant une lentille à électromouillage
WO2018002766A1 (fr) Dispositif d'affichage et corps mobile
WO2017221086A1 (fr) Dispositif d'affichage et objet mobile
KR20250061032A (ko) 디스플레이 시스템, 디스플레이 구동 방법 및 차량
KR20250079941A (ko) 디스플레이 장치 및 이를 구비한 차량
WO2024048221A1 (fr) Dispositif d'affichage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18790876

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019514878

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18790876

Country of ref document: EP

Kind code of ref document: A1