[go: up one dir, main page]

WO2018103105A1 - Procédé et système de correction un flou d'image causé par une inclinaison de lentille - Google Patents

Procédé et système de correction un flou d'image causé par une inclinaison de lentille Download PDF

Info

Publication number
WO2018103105A1
WO2018103105A1 PCT/CN2016/109319 CN2016109319W WO2018103105A1 WO 2018103105 A1 WO2018103105 A1 WO 2018103105A1 CN 2016109319 W CN2016109319 W CN 2016109319W WO 2018103105 A1 WO2018103105 A1 WO 2018103105A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
lens
image processor
blur
processor
Prior art date
Application number
PCT/CN2016/109319
Other languages
English (en)
Chinese (zh)
Inventor
刘锦潮
洪航庆
刘志远
麦练智
Original Assignee
东莞佩斯讯光电技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 东莞佩斯讯光电技术有限公司 filed Critical 东莞佩斯讯光电技术有限公司
Priority to PCT/CN2016/109319 priority Critical patent/WO2018103105A1/fr
Publication of WO2018103105A1 publication Critical patent/WO2018103105A1/fr

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B5/00—Adjustment of optical system relative to image or object surface other than for focusing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • the present invention relates to the field of micro-cameras with autofocus or optical image stabilization, and in particular to improvements in demolding processing.
  • the camera module will inevitably appear to tilt the lens, resulting in a decrease in the resolution of the image edge, which affects the image quality.
  • the main cause of lens tilt can be assembly or component error, or motion principle.
  • the actuator of the CN2015106221318 patent the lens may have different degrees of tilt during the optical image stabilization process.
  • the camera module includes a lens 1, an image sensor 2, and a lens actuator actuator 3 that controls the stroke of the lens and the tilt angle of the lens to achieve autofocus or optical image stabilization.
  • La and Figure lb show that the lens 1 has different degrees of lens tilt when the distance between the far focus and the near focus is different.
  • Figure lc and Figure Id show that lens 1 exhibits varying degrees of lens tilt before optical image stabilization and after optical image stabilization. The cause of the lens tilt may be caused by assembly or component errors, or by motion.
  • Figures 2a and 2b show that when the lens tilt angle " ⁇ , the imaging will be tilted, an angle ⁇ will be generated between the imaging and image sensors, and the edge between the imaging and image sensor will appear 21
  • the defocusing distance of the image causes the defocusing and resolution of the image to appear green.
  • Scheimpflug principle see GB Patent No. 1139
  • the relationship between 0 and ⁇ can be accurately estimated. If the imaging is a perfect plane ⁇ , the relationship between ⁇ , a, A Zl , and ⁇ is:
  • FIG. 3a illustrates the imaging out-of-focus distance and the X-image position (where the X-image position is 0 represents the image center position) Relationship.
  • the relationship between the image out-of-focus distance ( ⁇ ⁇ ) and the image position is:
  • FIG. 3b depicts a situation in which image defocusing results in an amount of image blur in one example.
  • the absolute value of the out-of-focus distance is large, the amount of image blur will usually increase.
  • the relationship between the out-of-focus distance and the amount of image blur depends on the optical characteristics of the lens, including the aperture and focal length.
  • the degree of defocus blur of the lens is also related to the defocus distance, the degree of defocus blur of the lens is closely related to the tilt angle of the lens.
  • the tilt angle of the lens can cause the resolution of the image edge to decrease, affecting the image quality. Because this problem cannot be cured in production and structure in most camera modules.
  • the object of the present invention is to solve the problem that the existing camera module has a large absolute value of the out-of-focus distance and the image quality is poor, and proposes a method for correcting the image blur caused by the tilt of the lens. And system.
  • a method for correcting image blur caused by lens tilt is characterized in that the steps of the method are as follows: [0016] 1), a model for accurately establishing different image positions, lens tilt angles, and lens blur amounts in advance
  • the image processor reads a model of different image positions in the memory and a relationship between the tilt angle of the lens and the amount of lens blur;
  • the image processor sends a command to the actuator driving chip, and drives the lens to perform auto focus or optical anti-shake processing;
  • the image processor sends a command to the image sensor, controls the image sensor to take a photo, and asks
  • the actuator drives the chip, and obtains a stroke and a lens tilt angle of the current lens from the actuator driving chip;
  • the image processor calculates, according to the stroke of the current lens and the lens tilt angle data, the blur amount of different positions of the image output by the image sensor according to the model;
  • the image processor defuzzifies the image according to the amount of blur of different positions of the image
  • the image processor transmits the processed defuzzified clear image to the main controller.
  • the model of the relationship between different image positions and the lens tilt angle and the lens blur amount can be accurately established by the lens optical simulation software or the experimental method.
  • a system for implementing the method characterized in that the system comprises a motherboard and a camera module;
  • the main board includes a main controller and an image processor; the main controller is connected to the control image processor, and receives and outputs a clear image that is defuzzified after being processed by the image processor;
  • the camera module includes: a lens for optical imaging, an image sensor located at the rear of the lens for photoelectric conversion to form an electronic image output, controlling the stroke of the lens and the tilt angle of the lens to achieve auto focus or optical image stabilization.
  • a lens actuator connected to an actuator driving chip that controls the lens actuator, and a memory that stores models of different image positions and relationship between the lens tilt angle and the lens blur amount;
  • the image sensor is connected to the image processor, and the image processor is provided with a real image and a photographed image; the image processor is connected to control the image sensor to take a picture;
  • the image processor is connected to control the actuator driving chip to perform auto focus or optical anti-shake processing, and the actuator driving chip outputs the stroke and lens tilt angle data of the current lens to the image processor;
  • the memory provides image processing for the image processor to perform defuzzification image processing for reference model information.
  • the main controller replaces or includes an image processor, or is integrated in a camera module.
  • the beneficial effects of the present invention are as follows:
  • the present invention proposes to achieve an optimal image quality improvement effect according to the optical characteristic model of the lens and the degree of tilt combined with the image processing method, thereby avoiding the lack of sharpness or unnaturalness of the local position of the image.
  • the invention can correct the image blur caused by the tilt of the lens, and can pass the mirror
  • the head optical simulation software accurately models the relationship between different image positions and lens tilt angles and lens blur.
  • the deblurring force can be adjusted at different image positions by the model. For example, when the tilt angle is large, the de-blurring intensity of the image edge needs to be increased, but the de-blurring force closer to the center position needs to be lowered according to the estimated relationship.
  • the present invention and the conventional defuzzification image processing can more appropriately defuzzify the images at different positions according to the optical characteristic model of the lens and the degree of tilt, thereby achieving the best image quality improvement effect. Avoid situations where the sharpness of the image is insufficient or unnatural.
  • the degree of tilt of the lens must be strictly controlled, resulting in extremely high machine and production costs, and the camera module is extremely expensive, failing to Widely promoted to ordinary users.
  • the standard of the lens tilt degree can be reduced, which is beneficial to improving the production yield and reducing the cost, so that ordinary users can enjoy the joy of high pixel shooting.
  • FIG. 1a is a state diagram of the camera module in a far focus
  • FIG. 1b is a state diagram of the camera module in a near focus state
  • FIG. 1c is a state diagram of the camera module before optical image stabilization
  • FIG. 1d is a state diagram of the camera module after optical anti-shake
  • FIG. 2a is a schematic diagram 1 of the tilting of the lens causing the imaging tilt ⁇ ;
  • FIG. 2b is a schematic diagram 2 of the tilting of the lens causing the imaging tilt ⁇ ;
  • FIG. 3a is a relationship diagram of an image out-of-focus distance and an image position
  • FIG. 3b is a relationship diagram between the out-of-focus distance and the image blur amount
  • FIG. 4a is a force relationship diagram before adjusting deblurring
  • FIG. 4b is a diagram showing the relationship of the force after adjusting the defuzzification
  • FIG. 5 is a block diagram of the present invention capable of correcting an image blurring system caused by tilting of a lens
  • FIG. 6 is a flow chart of a method for correcting image blur caused by tilt of a lens according to the present invention.
  • the present invention can correct the image blur caused by the tilt of the lens, and includes the following steps:
  • the image processor reads a model of different image positions in the memory and a relationship between the tilt angle of the lens and the amount of lens blur;
  • the image processor sends a command to the actuator driving chip, and drives the lens to perform auto focus or optical anti-shake processing;
  • the image processor sends a command to the image sensor, controls the image sensor to take a picture, and simultaneously queries the actuator drive chip to obtain the stroke and the lens tilt angle of the current lens from the actuator drive chip;
  • the image processor calculates, according to the stroke of the current lens and the lens tilt angle data, the blur amount of different positions of the image output by the image sensor according to the model;
  • the image processor defuzzifies the image according to the amount of blur of different positions of the image
  • the image processor transmits the processed defuzzified clear image to the main controller.
  • the model of the relationship between different image positions and the lens tilt angle and the lens blur amount can be accurately established by the lens optical simulation software or the experimental method.
  • FIG. 4a the velocity relationship diagram before the defuzzification is adjusted and FIG. 4b adjusts the velocity relationship diagram after the defuzzification; the invention adjusts the defuzzification intensity according to different degrees of image blur.
  • the edge of the image before correction is more blurred than the middle. After the correction, the overall image becomes clear and no unnatural images appear.
  • the core of the present invention is to estimate the degree of image blurring at different positions according to the model according to the degree of tilt of the lens in different situations, and perform appropriate defuzzification image processing on different image positions.
  • a model for establishing a blur amount of a lens at different inclinations can be obtained by actually measuring an image, or an optical simulation method.
  • the degree of tilt of the lens in different situations the degree of tilt of the individual lens under different conditions, or the mechanical structure model, can be measured according to the actual situation.
  • the present invention can correct a system for blurring an image caused by tilting of a lens, including a master. Board and camera module;
  • the main board includes a main controller and an image processor; the main controller is connected to the control image processor, and receives and outputs a clear image that is defuzzified after being processed by the image processor;
  • the camera module includes: a lens for optical imaging, an image sensor located at the rear of the lens for photoelectric conversion to form an electronic image output, controlling the stroke of the lens and the tilt angle of the lens to achieve auto focus or optical image stabilization.
  • a lens actuator connected to an actuator driving chip that controls the lens actuator, and a memory that stores models of different image positions and relationship between the lens tilt angle and the lens blur amount;
  • the image sensor is connected to the image processor, and the image processor is provided with a real image and a photographed image; the image processor is connected to control the image sensor to take a picture;
  • the image processor is connected to control the actuator driving chip to perform auto focus or optical anti-shake processing, and the actuator driving chip outputs the stroke and lens tilt angle data of the current lens to the image processor;
  • the memory provides image processing for the image processor to perform defuzzification image processing for reference model information.
  • the main controller replaces or includes an image processor, or is integrated in a camera module.
  • the present embodiment is a preferred embodiment of the present invention, and other principles and methods are the same as or similar to those of the present embodiment, and are all within the protection scope of the present invention.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Adjustment Of Camera Lenses (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un procédé et un système destinés à corriger un flou d'image causé par une inclinaison de lentille, se rapportant au domaine technique des caméras miniatures capables d'une mise au point automatique et d'une stabilisation optique d'image; l'invention résout la carence technique des modules de caméras existants présentant une faible qualité d'imagerie lorsque la valeur absolue de la distance de défocalisation est grande; un capteur d'image est commandé pour photographier tandis qu'une puce d'excitation d'actionneur est interrogée, et la trajectoire actuelle de la lentille et l'angle d'inclinaison de la lentille sont obtenus à partir de la puce d'excitation d'actionneur; d'après la trajectoire actuelle de la lentille et des données de l'angle d'inclinaison de la lentille, le modèle est combiné et la quantité de flou à différentes positions dans l'image délivrée par le capteur d'image est calculée; d'après la quantité de flou à différentes positions dans l'image, un traitement d'image pour correction du flou est effectué sur l'image pour obtenir une image nette; ainsi, une amélioration optimale de la qualité d'image est réalisée et une situation de netteté inadéquate ou non naturelle est empêchée.
PCT/CN2016/109319 2016-12-09 2016-12-09 Procédé et système de correction un flou d'image causé par une inclinaison de lentille WO2018103105A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/109319 WO2018103105A1 (fr) 2016-12-09 2016-12-09 Procédé et système de correction un flou d'image causé par une inclinaison de lentille

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/109319 WO2018103105A1 (fr) 2016-12-09 2016-12-09 Procédé et système de correction un flou d'image causé par une inclinaison de lentille

Publications (1)

Publication Number Publication Date
WO2018103105A1 true WO2018103105A1 (fr) 2018-06-14

Family

ID=62491693

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/109319 WO2018103105A1 (fr) 2016-12-09 2016-12-09 Procédé et système de correction un flou d'image causé par une inclinaison de lentille

Country Status (1)

Country Link
WO (1) WO2018103105A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116134369A (zh) * 2020-10-14 2023-05-16 宁波舜宇光电信息有限公司 用于光学致动器的驱动结构及相应的摄像模组和组装方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101233746A (zh) * 2005-08-04 2008-07-30 松下电器产业株式会社 成像装置
CN101489045A (zh) * 2008-01-17 2009-07-22 华晶科技股份有限公司 利用运动传感器及感光值决定相机成像质量的方法
US20110044554A1 (en) * 2009-08-21 2011-02-24 Konica Minolta Systems Laboratory, Inc. Adaptive deblurring for camera-based document image processing
CN103440624A (zh) * 2013-08-07 2013-12-11 华中科技大学 一种基于运动检测的图像去模糊方法及装置
CN106707658A (zh) * 2016-12-09 2017-05-24 东莞佩斯讯光电技术有限公司 能修正因镜头倾斜造成的影像模糊的方法及系统
CN206348572U (zh) * 2016-12-09 2017-07-21 东莞佩斯讯光电技术有限公司 能修正因镜头倾斜造成的影像模糊的系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101233746A (zh) * 2005-08-04 2008-07-30 松下电器产业株式会社 成像装置
CN101489045A (zh) * 2008-01-17 2009-07-22 华晶科技股份有限公司 利用运动传感器及感光值决定相机成像质量的方法
US20110044554A1 (en) * 2009-08-21 2011-02-24 Konica Minolta Systems Laboratory, Inc. Adaptive deblurring for camera-based document image processing
CN103440624A (zh) * 2013-08-07 2013-12-11 华中科技大学 一种基于运动检测的图像去模糊方法及装置
CN106707658A (zh) * 2016-12-09 2017-05-24 东莞佩斯讯光电技术有限公司 能修正因镜头倾斜造成的影像模糊的方法及系统
CN206348572U (zh) * 2016-12-09 2017-07-21 东莞佩斯讯光电技术有限公司 能修正因镜头倾斜造成的影像模糊的系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116134369A (zh) * 2020-10-14 2023-05-16 宁波舜宇光电信息有限公司 用于光学致动器的驱动结构及相应的摄像模组和组装方法

Similar Documents

Publication Publication Date Title
CN106707658B (zh) 能修正因镜头倾斜造成的影像模糊的方法及系统
JP5296307B2 (ja) デジタル撮像システムでの自動焦点を改善するシステムおよび方法
US6985177B2 (en) Image sensing system and its control method
EP2171685B1 (fr) Processeur d'images, procédé de traitement d'images, appareil photo numérique, et appareil d'imagerie
US7889983B2 (en) Imaging apparatus with camera-shake correction function, camera-shake correction device, and camera-shake correction method
CN100478728C (zh) 用于图像拍摄设备的系统和方法
US20100177979A1 (en) Image processing apparatus and image processing method
JP2004120014A (ja) カメラおよびカメラシステム
CN101945221B (zh) 摄像设备及其控制方法
CN206348572U (zh) 能修正因镜头倾斜造成的影像模糊的系统
CN115379201A (zh) 测试方法和装置、电子设备和可读存储介质
JP2002365524A (ja) オートフォーカス装置及びそれを用いた撮像装置
WO2018103105A1 (fr) Procédé et système de correction un flou d'image causé par une inclinaison de lentille
CN117523008B (zh) 一种相机主点标定方法、系统、装置及存储介质
JP2002027305A (ja) 撮像システム及びその制御方法
CN110784643B (zh) 控制设备、摄像设备、存储介质和控制方法
JP2004328606A (ja) 撮像装置
JP4816337B2 (ja) 画像補正装置、カメラ及び画像補正プログラム
JP2017161891A5 (fr)
JP2017161891A (ja) 撮像装置
WO2019041905A1 (fr) Procédé de photographie, appareil de photographie et terminal mobile
US20120188410A1 (en) Imaging device
JP6335671B2 (ja) 像振れ補正装置および像振れ補正方法
JP2022037033A (ja) 撮像装置
JP6341250B2 (ja) 交換レンズおよびカメラ

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16923171

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22.10.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16923171

Country of ref document: EP

Kind code of ref document: A1