[go: up one dir, main page]

CN106254771B - Shooting anti-shake method and device and mobile terminal - Google Patents

Shooting anti-shake method and device and mobile terminal Download PDF

Info

Publication number
CN106254771B
CN106254771B CN201610616258.3A CN201610616258A CN106254771B CN 106254771 B CN106254771 B CN 106254771B CN 201610616258 A CN201610616258 A CN 201610616258A CN 106254771 B CN106254771 B CN 106254771B
Authority
CN
China
Prior art keywords
mems
image
mobile terminal
imaging sensor
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201610616258.3A
Other languages
Chinese (zh)
Other versions
CN106254771A (en
Inventor
杨新勤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201610616258.3A priority Critical patent/CN106254771B/en
Publication of CN106254771A publication Critical patent/CN106254771A/en
Application granted granted Critical
Publication of CN106254771B publication Critical patent/CN106254771B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • H04N23/6812Motion detection based on additional sensors, e.g. acceleration sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/685Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides a shooting anti-shake method, a shooting anti-shake device and a mobile terminal, wherein the shooting anti-shake method comprises the following steps: detecting the movement information of a mobile terminal in a picture-in-picture shooting process, wherein the mobile terminal comprises an MEMS (micro electro mechanical system), a first image sensor and a second image sensor; controlling the MEMS to drive the first image sensor and the second image sensor to move according to the movement information so as to compensate the movement of the mobile terminal in the shooting process; acquiring a first image shot by the first image sensor after moving and a second image shot by the second image sensor after moving; and generating a shooting picture according to the first image and the second image. The shooting anti-shake method, the shooting anti-shake device and the mobile terminal provided by the embodiment of the invention can ensure the stability of a shot picture, prevent the picture from generating a fault and improve the shooting effect when the picture-in-picture shooting is carried out.

Description

拍摄防抖方法、装置和移动终端Shooting anti-shake method, device and mobile terminal

技术领域technical field

本发明涉及移动终端技术领域,尤其涉及一种拍摄防抖方法、装置和移动终端。The present invention relates to the technical field of mobile terminals, in particular to a method and device for anti-shake shooting and a mobile terminal.

背景技术Background technique

随着智能手机和平板电脑的普及,人们在日常生活中越来越多地使用移动设备进行拍摄。在拍摄过程中,由于手的抖动等其他原因,拍摄出的画面很容易变模糊。尤其是当同时启动前置摄像头和后置摄像头进行画中画拍摄的时候,由于前后置摄像头会同时抖动,造成原本拼接好的画面出现断层,导致拍出来的照片效果不佳,用户体验差。With the popularity of smartphones and tablets, people are increasingly using mobile devices for photography in their daily lives. During the shooting process, due to other reasons such as hand shaking, the captured picture is easily blurred. Especially when the front camera and the rear camera are activated at the same time for picture-in-picture shooting, the front and rear cameras will shake at the same time, resulting in faults in the originally spliced pictures, resulting in poor photo effects and poor user experience.

发明内容Contents of the invention

本发明旨在至少在一定程度上解决相关技术中的技术问题之一。The present invention aims to solve one of the technical problems in the related art at least to a certain extent.

为此,本发明的一个目的在于提出一种拍摄防抖方法,该方法能够在画中画拍摄时,保证拍摄画面的稳定,防止画面出现断层,提高拍摄效果。For this reason, an object of the present invention is to provide a shooting anti-shake method, which can ensure the stability of the shooting picture during picture-in-picture shooting, prevent faults in the picture, and improve the shooting effect.

本发明的另一个目的在于提出一种拍摄防抖装置。Another object of the present invention is to provide a camera anti-shake device.

本发明的另一个目的在于提出一种移动终端。Another object of the present invention is to provide a mobile terminal.

为达到上述目的,本发明第一方面实施例提出的拍摄防抖方法,包括:在画中画拍摄过程中,检测移动终端的移动信息,所述移动终端包括MEMS微电机系统、第一图像传感器和第二图像传感器;根据所述移动信息控制所述MEMS驱动所述第一图像传感器和所述第二图像传感器进行移动以补偿所述移动终端在拍摄过程中的移动;获取移动后的第一图像传感器拍摄的第一图像和移动后的第二图像传感器拍摄的第二图像;以及根据所述第一图像和所述第二图像生成拍摄画面。In order to achieve the above object, the shooting anti-shake method proposed in the embodiment of the first aspect of the present invention includes: during the picture-in-picture shooting process, detecting the movement information of the mobile terminal, the mobile terminal includes a MEMS micro-motor system, a first image sensor and the second image sensor; control the MEMS to drive the first image sensor and the second image sensor to move according to the movement information to compensate for the movement of the mobile terminal during the shooting process; obtain the moved first a first image taken by the image sensor and a second image taken by the moved second image sensor; and generating a shooting picture according to the first image and the second image.

本发明第一方面实施例提出的拍摄防抖方法,通过检测到的移动终端的移动信息,控制MEMS驱动第一图像传感器和第二图像传感器进行移动,可以补偿移动终端在拍摄过程中的移动,从而在画中画拍摄时,保证了拍摄画面的稳定,防止画面出现断层,提高拍摄效果。The shooting anti-shake method proposed in the embodiment of the first aspect of the present invention can compensate the movement of the mobile terminal during the shooting process by controlling the MEMS to drive the first image sensor and the second image sensor to move through the detected movement information of the mobile terminal. Therefore, when shooting picture-in-picture, the stability of the shooting picture is guaranteed, faults in the picture are prevented, and the shooting effect is improved.

为达到上述目的,本发明第二方面实施例提出的拍摄防抖装置,包括:检测模块,用于在画中画拍摄过程中,检测移动终端的移动信息,所述移动终端包括MEMS微电机系统、第一图像传感器和第二图像传感器;控制模块,用于根据所述移动信息控制所述MEMS驱动所述第一图像传感器和所述第二图像传感器进行移动以补偿所述移动终端在拍摄过程中的移动;获取模块,用于获取移动后的第一图像传感器拍摄的第一图像和移动后的第二图像传感器拍摄的第二图像;生成模块,用于根据所述第一图像和所述第二图像生成拍摄画面。In order to achieve the above object, the shooting anti-shake device proposed by the embodiment of the second aspect of the present invention includes: a detection module, which is used to detect the movement information of the mobile terminal during the picture-in-picture shooting process, and the mobile terminal includes a MEMS micro-motor system , a first image sensor and a second image sensor; a control module, configured to control the MEMS to drive the first image sensor and the second image sensor to move according to the movement information to compensate for the mobile terminal during the shooting process The movement in; the acquisition module is used to acquire the first image taken by the first image sensor after the movement and the second image taken by the second image sensor after the movement; the generation module is used for according to the first image and the The second image generates a shooting screen.

本发明第二方面实施例提出的拍摄防抖装置,通过检测到的移动终端的移动信息,控制MEMS驱动第一图像传感器和第二图像传感器进行移动,可以补偿移动终端在拍摄过程中的移动,从而在画中画拍摄时,保证了拍摄画面的稳定,防止画面出现断层,提高拍摄效果。The shooting anti-shake device proposed in the embodiment of the second aspect of the present invention controls the MEMS to drive the first image sensor and the second image sensor to move through the detected movement information of the mobile terminal, which can compensate the movement of the mobile terminal during the shooting process, Therefore, when shooting picture-in-picture, the stability of the shooting picture is guaranteed, faults in the picture are prevented, and the shooting effect is improved.

为达到上述目的,本发明第三方面实施例提出的移动终端,包括:外壳、处理器、存储器、电路板、电源电路、第一MEMS微电机系统、第一图像传感器、第二MEMS以及第二图像传感器;To achieve the above object, the mobile terminal proposed in the embodiment of the third aspect of the present invention includes: a housing, a processor, a memory, a circuit board, a power supply circuit, a first MEMS micro-electromechanical system, a first image sensor, a second MEMS, and a second Image Sensor;

所述电路板安置在所述外壳围成的空间内部,所述处理器、所述存储器、所述第一MEMS和所述第二MEMS设置在所述电路板上;The circuit board is placed inside the space enclosed by the housing, and the processor, the memory, the first MEMS and the second MEMS are arranged on the circuit board;

所述第一图像传感器与所述第一MEMS相连,所述第二图像传感器与所述第二MEMS相连;The first image sensor is connected to the first MEMS, and the second image sensor is connected to the second MEMS;

所述电源电路用于为移动终端的各个电路或器件供电;The power supply circuit is used to supply power to various circuits or devices of the mobile terminal;

所述存储器用于存储可执行程序代码;The memory is used to store executable program codes;

所述处理器通过读取所述存储器中存储的可执行程序代码来运行与可执行程序代码对应的程序;the processor executes a program corresponding to the executable program code by reading the executable program code stored in the memory;

所述处理器具体用于:The processor is specifically used for:

在画中画拍摄过程中,检测移动终端的移动信息;During the picture-in-picture shooting process, detect the movement information of the mobile terminal;

根据所述移动信息控制所述第一MEMS和所述第二MEMS分别驱动所述第一图像传感器和所述第二图像传感器进行移动以补偿所述移动终端在拍摄过程中的移动;controlling the first MEMS and the second MEMS to respectively drive the first image sensor and the second image sensor to move according to the movement information to compensate for the movement of the mobile terminal during the shooting process;

获取移动后的第一图像传感器拍摄的第一图像和移动后的第二图像传感器拍摄的第二图像;以及acquiring a first image taken by the moved first image sensor and a second image taken by the moved second image sensor; and

根据所述第一图像和所述第二图像生成拍摄画面。A shooting picture is generated according to the first image and the second image.

本发明第三方面实施例提出的移动终端,通过检测到的移动终端的移动信息,控制MEMS驱动第一图像传感器和第二图像传感器进行移动,可以补偿移动终端在拍摄过程中的移动,从而在画中画拍摄时,保证了拍摄画面的稳定,防止画面出现断层,提高拍摄效果。The mobile terminal proposed in the embodiment of the third aspect of the present invention controls the MEMS to drive the first image sensor and the second image sensor to move through the detected movement information of the mobile terminal, which can compensate the movement of the mobile terminal during the shooting process, thereby During picture-in-picture shooting, it ensures the stability of the shooting picture, prevents faults in the picture, and improves the shooting effect.

本发明附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

附图说明Description of drawings

本发明上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present invention will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:

图1是本发明一个实施例提出的拍摄防抖方法的流程示意图;Fig. 1 is a schematic flow chart of a shooting anti-shake method proposed by an embodiment of the present invention;

图2是画中画拍摄时的拍摄画面效果示意图;Fig. 2 is a schematic diagram of the shooting picture effect during picture-in-picture shooting;

图3是未具备防抖的情况下的发生偏移时的拍摄画面效果示意图;Fig. 3 is a schematic diagram of the shooting picture effect when the shift occurs without anti-shake;

图4是本发明一个实施例提出的拍摄防抖装置的结构示意图;FIG. 4 is a schematic structural diagram of a shooting anti-shake device proposed by an embodiment of the present invention;

图5是本发明一个实施例提出的移动终端的结构示意图。Fig. 5 is a schematic structural diagram of a mobile terminal proposed by an embodiment of the present invention.

具体实施方式detailed description

下面详细描述本发明的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的模块或具有相同或类似功能的模块。下面通过参考附图描述的实施例是示例性的,仅用于解释本发明,而不能理解为对本发明的限制。相反,本发明的实施例包括落入所附加权利要求书的精神和内涵范围内的所有变化、修改和等同物。Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals denote the same or similar modules or modules having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. On the contrary, the embodiments of the present invention include all changes, modifications and equivalents coming within the spirit and scope of the appended claims.

图1是本发明一个实施例提出的拍摄防抖方法的流程示意图。FIG. 1 is a schematic flowchart of a method for image stabilization proposed by an embodiment of the present invention.

如图1所示,本实施例的拍摄防抖方法包括:As shown in Figure 1, the shooting anti-shake method of this embodiment includes:

S101,在画中画拍摄过程中,检测移动终端的移动信息。S101. Detect movement information of a mobile terminal during a picture-in-picture shooting process.

在本发明一个实施例中,用户在使用画中画拍摄功能时,需要同时开启移动终端的前置摄像头和后置摄像头。主要通过前置摄像头捕捉画面,经过与前置摄像头连接的第一图像传感器拍摄出第一图像,然后通过后置摄像头捕捉画面,经过与后置摄像头连接的第二图像传感器拍摄出第二图像,最后拼接第一图像和第二图像,生成最终的拍摄画面。如图2所示,右上角区域显示的为第一图像,第一图像中有人脸A;剩余的区域为第二图像,第二图像中有人脸B。但是,在拍摄过程中,会产生移动终端偏移的情况,如倾斜、平移等。In an embodiment of the present invention, when using the picture-in-picture shooting function, the user needs to turn on the front camera and the rear camera of the mobile terminal at the same time. Mainly capture the picture through the front camera, take the first image through the first image sensor connected with the front camera, then capture the picture through the rear camera, and take the second image through the second image sensor connected with the rear camera, Finally, the first image and the second image are spliced to generate a final shooting picture. As shown in FIG. 2 , the area in the upper right corner displays the first image, in which there is human face A; the remaining area is the second image, in which human face B is displayed. However, during the shooting process, the mobile terminal may be shifted, such as tilted and translated.

为了补偿移动终端发生的偏移情况,需要先检测移动终端的移动信息。In order to compensate for the offset of the mobile terminal, it is necessary to first detect the movement information of the mobile terminal.

具体地,可通过陀螺仪检测移动终端的移动信息,例如轻微的向右平移等。Specifically, the movement information of the mobile terminal may be detected by the gyroscope, for example, a slight translation to the right.

S102,根据移动信息控制MEMS驱动第一图像传感器和第二图像传感器进行移动以补偿移动终端在拍摄过程中的移动。S102. Control the MEMS to drive the first image sensor and the second image sensor to move according to the movement information, so as to compensate the movement of the mobile terminal during the shooting process.

在本发明一个实施例中,在移动终端产生移动信息时,例如稍微向右平移,如图3所示,在没有防抖的情况下,第一图像实际上会向右稍微偏移,即图3中右上角区域中的人脸A会向右偏移;第二图像实际上会向左稍微偏移,即图3中除右上角区域以外的区域中的人脸B会向左偏移,从而导致最终的拍摄画面出现断层的问题。因此,需要利用光学防抖技术,实现对两个摄像头的防抖,以解决该问题。本实施例中,主要采用MEMS来实现光学防抖。MEMS(micro electro-mechanical system,微电机系统),是在微电子技术(半导体制造技术)基础上发展起来的,融合了光刻、腐蚀、薄膜、LIGA、硅微加工、非硅微加工和精密机械加工等技术制造的高科技电子机械器件,相较于现有的音圈马达具有较小的尺寸(毫米级),功耗低的优势。In one embodiment of the present invention, when the mobile terminal generates movement information, for example, it shifts slightly to the right, as shown in FIG. Face A in the upper right area in Figure 3 will be shifted to the right; the second image will actually be slightly shifted to the left, that is, face B in the area other than the upper right area in Figure 3 will be shifted to the left, As a result, there are faults in the final shooting picture. Therefore, it is necessary to use an optical anti-shake technology to achieve anti-shake for the two cameras, so as to solve this problem. In this embodiment, MEMS is mainly used to realize optical anti-shake. MEMS (micro electro-mechanical system, micro-motor system), developed on the basis of microelectronics technology (semiconductor manufacturing technology), integrates lithography, corrosion, thin film, LIGA, silicon micromachining, non-silicon micromachining and precision Compared with existing voice coil motors, high-tech electromechanical devices manufactured by machining and other technologies have the advantages of smaller size (millimeter level) and lower power consumption.

具体地,可根据移动信息从预设的位移信息与电压的对应关系表中查询到第一驱动电压,再控制第一MEMS以第一驱动电压驱动第一图像传感器以第一位移信息进行反向移动,以实现第一图像的防抖。其中,第一图像为前置摄像头通过第一图像传感器拍摄的画面。其中,第一位移信息与移动信息中的移动距离大小相等、方向相反。第一图像传感器和第二图像传感器用于感光成像,可以是CCD传感器,也可以是CMOS传感器。Specifically, the first driving voltage can be found from the preset correspondence table between displacement information and voltage according to the movement information, and then the first MEMS is controlled to drive the first image sensor with the first driving voltage to perform inversion with the first displacement information. Move to achieve stabilization of the first image. Wherein, the first image is a picture captured by the front camera through the first image sensor. Wherein, the first displacement information and the movement distance in the movement information are equal in magnitude and opposite in direction. The first image sensor and the second image sensor are used for photosensitive imaging, and may be CCD sensors or CMOS sensors.

举例来说,假设移动终端向右移动了10个像素的距离,第一图像会向右偏移10个像素,因此需要控制前置摄像头对应的第一图像传感器向左移动10个像素,从而补偿偏移产生的影响。For example, assuming that the mobile terminal moves to the right by 10 pixels, the first image will shift to the right by 10 pixels, so it is necessary to control the first image sensor corresponding to the front camera to move to the left by 10 pixels, so as to compensate The impact of the offset.

同理,为了补偿偏移产生的影响,还可根据移动信息控制第二MEMS以第二驱动电压驱动第二图像传感器以第二位移信息进行反向移动,以实现第二图像的防抖。其中,第二图像为后置摄像头通过第二图像传感器拍摄的画面。其中,第二位移信息与移动信息中的移动距离大小相等、方向相反。Similarly, in order to compensate for the impact of the offset, the second MEMS can also be controlled to drive the second image sensor with the second driving voltage to reversely move with the second displacement information according to the movement information, so as to realize the anti-shake of the second image. Wherein, the second image is a picture captured by the rear camera through the second image sensor. Wherein, the second displacement information and the movement distance in the movement information are equal in magnitude and opposite in direction.

应当理解的是,针对前置摄像头(第一图像传感器),第一位移信息与第一图像传感器对应的移动信息中的移动距离大小相等、方向相反;针对后置摄像头(第二图像传感器),第二位移信息与第二图像传感器对应的移动信息中的移动距离大小相等、方向相反。而实际上,针对同时具有前置和后置摄像头的移动终端而言,由于前置摄像头和后置摄像头的拍摄视角恰好是相反的(分别以前置摄像头和后置摄像头场景中的人物为参考系),因此第一位移信息与第二位移信息大小相等、方向相反。即将图3中的人脸A向左移动,人脸B向右移动,使得最终的拍摄效果还原为如图2所示的效果。It should be understood that, for the front camera (first image sensor), the first displacement information and the movement distance in the movement information corresponding to the first image sensor are equal in magnitude and opposite in direction; for the rear camera (second image sensor), The moving distance in the second displacement information and the movement information corresponding to the second image sensor is equal in magnitude and opposite in direction. In fact, for mobile terminals with front and rear cameras at the same time, since the shooting angles of the front camera and the rear camera are just opposite (respectively using the characters in the front camera and the rear camera scene as the reference frame ), so the first displacement information and the second displacement information are equal in magnitude and opposite in direction. That is, face A in FIG. 3 is moved to the left, and face B is moved to the right, so that the final shooting effect is restored to the effect shown in FIG. 2 .

其中,第一MEMS和第二MEMS可以是相同厂家生产的MEMS,也可以是不同厂家生产的MEMS。不同厂家生产的MEMS均对应具有不同的位移信息与电压的对应关系表。也就是说,如果第一MEMS和第二MEMS为相同厂家生产的,则两者查询的对应关系表相同,即以相等的电压驱动第一MEMS和第二MEMS,两者的移动距离相等。如果第一MEMS和第二MEMS为不同厂家生产的,那么若要移动相等的距离,那么分别驱动第一MEMS和第二MEMS的电压可以是不同的。Wherein, the first MEMS and the second MEMS may be MEMS produced by the same manufacturer, or MEMS produced by different manufacturers. MEMS produced by different manufacturers have different corresponding relationship tables between displacement information and voltage. That is to say, if the first MEMS and the second MEMS are produced by the same manufacturer, the corresponding relationship tables queried by the two are the same, that is, the first MEMS and the second MEMS are driven with the same voltage, and the moving distances of the two are equal. If the first MEMS and the second MEMS are produced by different manufacturers, the voltages for respectively driving the first MEMS and the second MEMS may be different if they are to move an equal distance.

S103,获取移动后的第一图像传感器拍摄的第一图像和移动后的第二图像传感器拍摄的第二图像。S103. Acquire a first image captured by the moved first image sensor and a second image captured by the moved second image sensor.

在第一图像传感器和第二图像传感器移动后,即进行防抖补偿之后,可以采用通常的方式采集光信号并转换为相应的图像数据,从而获取拍摄的第一图像和第二图像。After the first image sensor and the second image sensor move, that is, after the anti-shake compensation is performed, the light signal can be collected in a usual manner and converted into corresponding image data, so as to obtain the captured first image and the second image.

S104,根据第一图像和第二图像生成拍摄画面。S104. Generate a shooting frame according to the first image and the second image.

在此之后,可通过通常的方式对第一图像和第二图像进行拼接,从而生成最终的拍摄画面。After that, the first image and the second image can be spliced in a usual manner, so as to generate a final shooting picture.

应当理解的是,前置摄像头和后置摄像头处于开启状态,则始终开启第一MEMS和第二MEMS以保持拍摄画面的稳定。如果前后置摄像头处于关闭状态,则通过第一MEMS和第二MEMS分别将第一图像传感器和第二图像传感器还原至初始位置。It should be understood that, when the front camera and the rear camera are turned on, the first MEMS and the second MEMS are always turned on to keep the shooting picture stable. If the front and rear cameras are turned off, the first image sensor and the second image sensor are respectively restored to their original positions by the first MEMS and the second MEMS.

本发明实施例的拍摄防抖方法,通过检测到的移动终端的移动信息,控制MEMS驱动第一图像传感器和第二图像传感器进行移动,可以补偿移动终端在拍摄过程中的移动,从而在画中画拍摄时,保证了拍摄画面的稳定,防止画面出现断层,提高拍摄效果。The shooting anti-shake method of the embodiment of the present invention controls the MEMS to drive the first image sensor and the second image sensor to move through the detected movement information of the mobile terminal, which can compensate the movement of the mobile terminal during the shooting process, so that When shooting pictures, it ensures the stability of the shooting picture, prevents faults in the picture, and improves the shooting effect.

图4是本发明一个实施例提出的拍摄防抖装置的结构示意图。FIG. 4 is a schematic structural diagram of a shooting anti-shake device proposed by an embodiment of the present invention.

如图4所示,拍摄防抖装置可包括检测模块110、控制模块120、获取模块130以及生成模块140。As shown in FIG. 4 , the camera anti-shake device may include a detection module 110 , a control module 120 , an acquisition module 130 and a generation module 140 .

检测模块110用于在画中画拍摄过程中,检测移动终端的移动信息。The detection module 110 is configured to detect movement information of the mobile terminal during the picture-in-picture shooting process.

在本发明一个实施例中,用户在使用画中画拍摄功能时,需要同时开启移动终端的前置摄像头和后置摄像头。主要通过前置摄像头捕捉画面,经过与前置摄像头连接的第一图像传感器拍摄出第一图像,然后通过后置摄像头捕捉画面,经过与后置摄像头连接的第二图像传感器拍摄出第二图像,最后拼接第一图像和第二图像,生成最终的拍摄画面。如图2所示,右上角区域显示的为第一图像,第一图像中有人脸A;剩余的区域为第二图像,第二图像中有人脸B。但是,在拍摄过程中,会产生移动终端偏移的情况,如倾斜、平移等。In an embodiment of the present invention, when using the picture-in-picture shooting function, the user needs to turn on the front camera and the rear camera of the mobile terminal at the same time. Mainly capture the picture through the front camera, take the first image through the first image sensor connected with the front camera, then capture the picture through the rear camera, and take the second image through the second image sensor connected with the rear camera, Finally, the first image and the second image are spliced to generate a final shooting picture. As shown in FIG. 2 , the area in the upper right corner displays the first image, in which there is human face A; the remaining area is the second image, in which human face B is displayed. However, during the shooting process, the mobile terminal may be shifted, such as tilted and translated.

为了补偿移动终端发生的偏移情况,检测模块110需要先检测移动终端的移动信息。具体地,检测模块110可通过陀螺仪检测移动终端的移动信息,例如轻微的向右平移等。In order to compensate for the offset of the mobile terminal, the detection module 110 needs to first detect the movement information of the mobile terminal. Specifically, the detection module 110 may detect movement information of the mobile terminal through a gyroscope, such as a slight rightward translation.

控制模块120用于根据移动信息控制MEMS驱动第一图像传感器和第二图像传感器进行移动以补偿移动终端在拍摄过程中的移动。其中,控制模块120包括第一查询单元121、第一控制单元122、第二查询单元123和第二控制单元124。The control module 120 is used for controlling the MEMS to drive the first image sensor and the second image sensor to move according to the movement information so as to compensate the movement of the mobile terminal during the shooting process. Wherein, the control module 120 includes a first query unit 121 , a first control unit 122 , a second query unit 123 and a second control unit 124 .

在本发明一个实施例中,在移动终端产生移动信息时,例如稍微向右平移,如图3所示,在没有防抖的情况下,第一图像实际上会向右稍微偏移,即图3中右上角区域中的人脸A会向右偏移;第二图像实际上会向左稍微偏移,即图3中除右上角区域以外的区域中的人脸B会向左偏移,从而导致最终的拍摄画面出现断层的问题。因此,需要利用光学防抖技术,实现对两个摄像头的防抖,以解决该问题。本实施例中,主要采用MEMS来实现光学防抖。MEMS(micro electro-mechanical system,微电机系统),是在微电子技术(半导体制造技术)基础上发展起来的,融合了光刻、腐蚀、薄膜、LIGA、硅微加工、非硅微加工和精密机械加工等技术制造的高科技电子机械器件,相较于现有的音圈马达具有较小的尺寸(毫米级),功耗低的优势。In one embodiment of the present invention, when the mobile terminal generates movement information, for example, it shifts slightly to the right, as shown in FIG. Face A in the upper right area in Figure 3 will be shifted to the right; the second image will actually be slightly shifted to the left, that is, face B in the area other than the upper right area in Figure 3 will be shifted to the left, As a result, there are faults in the final shooting picture. Therefore, it is necessary to use an optical anti-shake technology to achieve anti-shake for the two cameras, so as to solve this problem. In this embodiment, MEMS is mainly used to realize optical anti-shake. MEMS (micro electro-mechanical system, micro-motor system), developed on the basis of microelectronics technology (semiconductor manufacturing technology), integrates lithography, corrosion, thin film, LIGA, silicon micromachining, non-silicon micromachining and precision Compared with existing voice coil motors, high-tech electromechanical devices manufactured by machining and other technologies have the advantages of smaller size (millimeter level) and lower power consumption.

具体地,第一查询单元121可根据移动信息从预设的位移信息与电压的对应关系表中查询到第一驱动电压,第一控制单元122再控制第一MEMS以第一驱动电压驱动第一图像传感器以第一位移信息进行反向移动,以实现第一图像的防抖。其中,第一图像为前置摄像头通过第一图像传感器拍摄的画面。其中,第一位移信息与移动信息中的移动距离大小相等、方向相反。第一图像传感器和第二图像传感器用于感光成像,可以是CCD传感器,也可以是CMOS传感器。Specifically, the first query unit 121 can query the first driving voltage from the preset correspondence table between displacement information and voltage according to the movement information, and the first control unit 122 controls the first MEMS to drive the first MEMS with the first driving voltage. The image sensor is reversely moved according to the first displacement information, so as to realize anti-shake of the first image. Wherein, the first image is a picture captured by the front camera through the first image sensor. Wherein, the first displacement information and the movement distance in the movement information are equal in magnitude and opposite in direction. The first image sensor and the second image sensor are used for photosensitive imaging, and may be CCD sensors or CMOS sensors.

举例来说,假设移动终端向右移动了10个像素的距离,第一图像会向右偏移10个像素,因此需要控制前置摄像头对应的第一图像传感器向左移动10个像素,从而补偿偏移产生的影响。For example, assuming that the mobile terminal moves to the right by 10 pixels, the first image will shift to the right by 10 pixels, so it is necessary to control the first image sensor corresponding to the front camera to move to the left by 10 pixels, so as to compensate The impact of the offset.

同理,为了补偿偏移产生的影响,第二查询单元123可根据移动信息从预设的位移信息与电压的对应关系表中查询到第二驱动电压,第二控制单元124再控制第二MEMS以第二驱动电压驱动第二图像传感器以第二位移信息进行反向移动,以实现第二图像的防抖。其中,第二图像为后置摄像头通过第二图像传感器拍摄的画面。其中,第二位移信息与移动信息中的移动距离大小相等、方向相反。Similarly, in order to compensate for the impact of the offset, the second query unit 123 can query the second driving voltage from the preset correspondence table between displacement information and voltage according to the movement information, and the second control unit 124 controls the second MEMS The second image sensor is driven by the second driving voltage to move in reverse with the second displacement information, so as to realize anti-shake of the second image. Wherein, the second image is a picture captured by the rear camera through the second image sensor. Wherein, the second displacement information and the movement distance in the movement information are equal in magnitude and opposite in direction.

应当理解的是,针对前置摄像头(第一图像传感器),第一位移信息与第一图像传感器对应的移动信息中的移动距离大小相等、方向相反;针对后置摄像头(第二图像传感器),第二位移信息与第二图像传感器对应的移动信息中的移动距离大小相等、方向相反。而实际上,针对同时具有前置和后置摄像头的移动终端而言,由于前置摄像头和后置摄像头的拍摄视角恰好是相反的(分别以前置摄像头和后置摄像头场景中的人物为参考系),因此第一位移信息与第二位移信息大小相等、方向相反。即将图3中的人脸A向左移动,人脸B向右移动,使得最终的拍摄效果还原为如图2所示的效果。It should be understood that, for the front camera (first image sensor), the first displacement information and the movement distance in the movement information corresponding to the first image sensor are equal in magnitude and opposite in direction; for the rear camera (second image sensor), The moving distance in the second displacement information and the movement information corresponding to the second image sensor is equal in magnitude and opposite in direction. In fact, for mobile terminals with front and rear cameras at the same time, since the shooting angles of the front camera and the rear camera are just opposite (respectively using the characters in the front camera and the rear camera scene as the reference frame ), so the first displacement information and the second displacement information are equal in magnitude and opposite in direction. That is, face A in FIG. 3 is moved to the left, and face B is moved to the right, so that the final shooting effect is restored to the effect shown in FIG. 2 .

其中,第一MEMS和第二MEMS可以是相同厂家生产的MEMS,也可以是不同厂家生产的MEMS。不同厂家生产的MEMS均对应具有不同的位移信息与电压的对应关系表。也就是说,如果第一MEMS和第二MEMS为相同厂家生产的,则两者查询的对应关系表相同,即以相等的电压驱动第一MEMS和第二MEMS,两者的移动距离相等。如果第一MEMS和第二MEMS为不同厂家生产的,那么若要移动相等的距离,那么分别驱动第一MEMS和第二MEMS的电压可以是不同的。Wherein, the first MEMS and the second MEMS may be MEMS produced by the same manufacturer, or MEMS produced by different manufacturers. MEMS produced by different manufacturers have different corresponding relationship tables between displacement information and voltage. That is to say, if the first MEMS and the second MEMS are produced by the same manufacturer, the corresponding relationship tables queried by the two are the same, that is, the first MEMS and the second MEMS are driven with the same voltage, and the moving distances of the two are equal. If the first MEMS and the second MEMS are produced by different manufacturers, the voltages for respectively driving the first MEMS and the second MEMS may be different if they are to move an equal distance.

获取模块130用于获取移动后的第一图像传感器拍摄的第一图像和移动后的第二图像传感器拍摄的第二图像。在第一图像传感器和第二图像传感器移动后,即进行防抖补偿之后,获取模块130可以采用通常的方式采集光信号并转换为相应的图像数据,从而获取拍摄的第一图像和第二图像。The acquiring module 130 is configured to acquire a first image taken by the first image sensor after movement and a second image taken by the second image sensor after movement. After the first image sensor and the second image sensor move, that is, after the anti-shake compensation is performed, the acquisition module 130 can acquire the light signal in a normal way and convert it into corresponding image data, so as to acquire the captured first image and the second image .

生成模块140用于根据第一图像和第二图像生成拍摄画面。在此之后,生成模块140可通过通常的方式对第一图像和第二图像进行拼接,从而生成最终的拍摄画面。The generating module 140 is used for generating a shooting frame according to the first image and the second image. After that, the generation module 140 may splice the first image and the second image in a common way, so as to generate a final shooting picture.

应当理解的是,前置摄像头和后置摄像头处于开启状态,则始终开启第一MEMS和第二MEMS以保持拍摄画面的稳定。如果前后置摄像头处于关闭状态,则通过第一MEMS和第二MEMS分别将第一图像传感器和第二图像传感器还原至初始位置。It should be understood that, when the front camera and the rear camera are turned on, the first MEMS and the second MEMS are always turned on to keep the shooting picture stable. If the front and rear cameras are turned off, the first image sensor and the second image sensor are respectively restored to their original positions by the first MEMS and the second MEMS.

本发明实施例的基于MEMS的拍摄防抖装置,通过检测到的移动终端的移动信息,控制MEMS驱动第一图像传感器和第二图像传感器进行移动,可以补偿移动终端在拍摄过程中的移动,从而在画中画拍摄时,保证了拍摄画面的稳定,防止画面出现断层,提高拍摄效果。The MEMS-based shooting anti-shake device of the embodiment of the present invention controls the MEMS to drive the first image sensor and the second image sensor to move through the detected movement information of the mobile terminal, which can compensate the movement of the mobile terminal during the shooting process, thereby During the picture-in-picture shooting, it ensures the stability of the shooting picture, prevents faults in the picture, and improves the shooting effect.

图5是本发明一个实施例提出的移动终端的结构示意图。Fig. 5 is a schematic structural diagram of a mobile terminal proposed by an embodiment of the present invention.

移动终端可以是手机、平板电脑等。The mobile terminal may be a mobile phone, a tablet computer, or the like.

参见图5,移动终端包括:外壳51、处理器52、存储器53、电路板54、电源电路55、第一MEMS 56、第一图像传感器57、第二MEMS58和第二图像传感器59,其中,电路板54安置在外壳51围成的空间内部,处理器52、存储器53、第一MEMS56、第二MEMS58设置在电路板54上;第一图像传感器57与第一MEMS56相连,第二图像传感器59与第二MEMS58相连;电源电路55,用于为移动终端的各个电路或器件供电;存储器53用于存储可执行程序代码;处理器52通过读取存储器53中存储的可执行程序代码来运行与可执行程序代码对应的程序;5, the mobile terminal includes: a housing 51, a processor 52, a memory 53, a circuit board 54, a power supply circuit 55, a first MEMS 56, a first image sensor 57, a second MEMS 58 and a second image sensor 59, wherein the circuit The board 54 is arranged inside the space enclosed by the shell 51, and the processor 52, the memory 53, the first MEMS56, and the second MEMS58 are arranged on the circuit board 54; the first image sensor 57 is connected with the first MEMS56, and the second image sensor 59 is connected with the first MEMS56. The second MEMS58 is connected; the power supply circuit 55 is used to supply power to each circuit or device of the mobile terminal; the memory 53 is used to store the executable program code; the processor 52 runs and can read the executable program code stored in the memory 53 Execute the program corresponding to the program code;

处理器52具体用于执行以下方法:The processor 52 is specifically configured to perform the following methods:

S101’,在画中画拍摄过程中,检测移动终端的移动信息。S101', during the picture-in-picture shooting process, detect the movement information of the mobile terminal.

在本发明一个实施例中,用户在使用画中画拍摄功能时,需要同时开启移动终端的前置摄像头和后置摄像头。主要通过前置摄像头捕捉画面,经过与前置摄像头连接的第一图像传感器拍摄出第一图像,然后通过后置摄像头捕捉画面,经过与后置摄像头连接的第二图像传感器拍摄出第二图像,最后拼接第一图像和第二图像,生成最终的拍摄画面。如图2所示,右上角区域显示的为第一图像,第一图像中有人脸A;剩余的区域为第二图像,第二图像中有人脸B。但是,在拍摄过程中,会产生移动终端偏移的情况,如倾斜、平移等。In an embodiment of the present invention, when using the picture-in-picture shooting function, the user needs to turn on the front camera and the rear camera of the mobile terminal at the same time. Mainly capture the picture through the front camera, take the first image through the first image sensor connected with the front camera, then capture the picture through the rear camera, and take the second image through the second image sensor connected with the rear camera, Finally, the first image and the second image are spliced to generate a final shooting picture. As shown in FIG. 2 , the area in the upper right corner displays the first image, in which there is human face A; the remaining area is the second image, in which human face B is displayed. However, during the shooting process, the mobile terminal may be shifted, such as tilted and translated.

为了补偿移动终端发生的偏移情况,需要先检测移动终端的移动信息。In order to compensate for the offset of the mobile terminal, it is necessary to first detect the movement information of the mobile terminal.

具体地,可通过陀螺仪检测移动终端的移动信息,例如轻微的向右平移等。Specifically, the movement information of the mobile terminal may be detected by the gyroscope, for example, a slight translation to the right.

S102’,根据移动信息控制MEMS驱动第一图像传感器和第二图像传感器进行移动以补偿移动终端在拍摄过程中的移动。S102', controlling the MEMS to drive the first image sensor and the second image sensor to move according to the movement information to compensate for the movement of the mobile terminal during the shooting process.

在本发明一个实施例中,在移动终端产生移动信息时,例如稍微向右平移,如图3所示,在没有防抖的情况下,第一图像实际上会向右稍微偏移,即图3中右上角区域中的人脸A会向右偏移;第二图像实际上会向左稍微偏移,即图3中除右上角区域以外的区域中的人脸B会向左偏移,从而导致最终的拍摄画面出现断层的问题。因此,需要利用光学防抖技术,实现对两个摄像头的防抖,以解决该问题。本实施例中,主要采用MEMS来实现光学防抖。MEMS(micro electro-mechanical system,微电机系统),是在微电子技术(半导体制造技术)基础上发展起来的,融合了光刻、腐蚀、薄膜、LIGA、硅微加工、非硅微加工和精密机械加工等技术制造的高科技电子机械器件,相较于现有的音圈马达具有较小的尺寸(毫米级),功耗低的优势。In one embodiment of the present invention, when the mobile terminal generates movement information, for example, it shifts slightly to the right, as shown in FIG. Face A in the upper right area in Figure 3 will be shifted to the right; the second image will actually be slightly shifted to the left, that is, face B in the area other than the upper right area in Figure 3 will be shifted to the left, As a result, there are faults in the final shooting picture. Therefore, it is necessary to use an optical anti-shake technology to achieve anti-shake for the two cameras, so as to solve this problem. In this embodiment, MEMS is mainly used to realize optical anti-shake. MEMS (micro electro-mechanical system, micro-motor system), developed on the basis of microelectronics technology (semiconductor manufacturing technology), integrates lithography, corrosion, thin film, LIGA, silicon micromachining, non-silicon micromachining and precision Compared with existing voice coil motors, high-tech electromechanical devices manufactured by machining and other technologies have the advantages of smaller size (millimeter level) and lower power consumption.

具体地,可根据移动信息从预设的位移信息与电压的对应关系表中查询到第一驱动电压,再控制第一MEMS以第一驱动电压驱动第一图像传感器以第一位移信息进行反向移动,以实现第一图像的防抖。其中,第一图像为前置摄像头通过第一图像传感器拍摄的画面。其中,第一位移信息与移动信息中的移动距离大小相等、方向相反。第一图像传感器和第二图像传感器用于感光成像,可以是CCD传感器,也可以是CMOS传感器。Specifically, the first driving voltage can be found from the preset correspondence table between displacement information and voltage according to the movement information, and then the first MEMS is controlled to drive the first image sensor with the first driving voltage to perform inversion with the first displacement information. Move to achieve stabilization of the first image. Wherein, the first image is a picture captured by the front camera through the first image sensor. Wherein, the first displacement information and the movement distance in the movement information are equal in magnitude and opposite in direction. The first image sensor and the second image sensor are used for photosensitive imaging, and may be CCD sensors or CMOS sensors.

举例来说,假设移动终端向右移动了10个像素的距离,第一图像会向右偏移10个像素,因此需要控制前置摄像头对应的第一图像传感器向左移动10个像素,从而补偿偏移产生的影响。For example, assuming that the mobile terminal moves to the right by 10 pixels, the first image will shift to the right by 10 pixels, so it is necessary to control the first image sensor corresponding to the front camera to move to the left by 10 pixels, so as to compensate The impact of the offset.

同理,为了补偿偏移产生的影响,还可根据移动信息控制第二MEMS以第二驱动电压驱动第二图像传感器以第二位移信息进行反向移动,以实现第二图像的防抖。其中,第二图像为后置摄像头通过第二图像传感器拍摄的画面。其中,第二位移信息与移动信息中的移动距离大小相等、方向相反。Similarly, in order to compensate for the impact of the offset, the second MEMS can also be controlled to drive the second image sensor with the second driving voltage to reversely move with the second displacement information according to the movement information, so as to realize the anti-shake of the second image. Wherein, the second image is a picture captured by the rear camera through the second image sensor. Wherein, the second displacement information and the movement distance in the movement information are equal in magnitude and opposite in direction.

应当理解的是,针对前置摄像头(第一图像传感器),第一位移信息与第一图像传感器对应的移动信息中的移动距离大小相等、方向相反;针对后置摄像头(第二图像传感器),第二位移信息与第二图像传感器对应的移动信息中的移动距离大小相等、方向相反。而实际上,针对同时具有前置和后置摄像头的移动终端而言,由于前置摄像头和后置摄像头的拍摄视角恰好是相反的(分别以前置摄像头和后置摄像头场景中的人物为参考系),因此第一位移信息与第二位移信息大小相等、方向相反。即将图3中的人脸A向左移动,人脸B向右移动,使得最终的拍摄效果还原为如图2所示的效果。It should be understood that, for the front camera (first image sensor), the first displacement information and the movement distance in the movement information corresponding to the first image sensor are equal in magnitude and opposite in direction; for the rear camera (second image sensor), The moving distance in the second displacement information and the movement information corresponding to the second image sensor is equal in magnitude and opposite in direction. In fact, for mobile terminals with front and rear cameras at the same time, since the shooting angles of the front camera and the rear camera are just opposite (respectively using the characters in the front camera and the rear camera scene as the reference frame ), so the first displacement information and the second displacement information are equal in magnitude and opposite in direction. That is, face A in FIG. 3 is moved to the left, and face B is moved to the right, so that the final shooting effect is restored to the effect shown in FIG. 2 .

其中,第一MEMS和第二MEMS可以是相同厂家生产的MEMS,也可以是不同厂家生产的MEMS。不同厂家生产的MEMS均对应具有不同的位移信息与电压的对应关系表。也就是说,如果第一MEMS和第二MEMS为相同厂家生产的,则两者查询的对应关系表相同,即以相等的电压驱动第一MEMS和第二MEMS,两者的移动距离相等。如果第一MEMS和第二MEMS为不同厂家生产的,那么若要移动相等的距离,那么分别驱动第一MEMS和第二MEMS的电压可以是不同的。Wherein, the first MEMS and the second MEMS may be MEMS produced by the same manufacturer, or MEMS produced by different manufacturers. MEMS produced by different manufacturers have different corresponding relationship tables between displacement information and voltage. That is to say, if the first MEMS and the second MEMS are produced by the same manufacturer, the corresponding relationship tables queried by the two are the same, that is, the first MEMS and the second MEMS are driven with the same voltage, and the moving distances of the two are equal. If the first MEMS and the second MEMS are produced by different manufacturers, the voltages for respectively driving the first MEMS and the second MEMS may be different if they are to move an equal distance.

S103’,获取移动后的第一图像传感器拍摄的第一图像和移动后的第二图像传感器拍摄的第二图像。S103', acquiring a first image captured by the first image sensor after the movement and a second image captured by the second image sensor after the movement.

在第一图像传感器和第二图像传感器移动后,即进行防抖补偿之后,可以采用通常的方式采集光信号并转换为相应的图像数据,从而获取拍摄的第一图像和第二图像。After the first image sensor and the second image sensor move, that is, after the anti-shake compensation is performed, the light signal can be collected in a usual manner and converted into corresponding image data, so as to obtain the captured first image and the second image.

S104’,根据第一图像和第二图像生成拍摄画面。S104', generate a shooting picture according to the first image and the second image.

在此之后,可通过通常的方式对第一图像和第二图像进行拼接,从而生成最终的拍摄画面。After that, the first image and the second image can be spliced in a usual manner, so as to generate a final shooting picture.

应当理解的是,前置摄像头和后置摄像头处于开启状态,则始终开启第一MEMS和第二MEMS以保持拍摄画面的稳定。如果前后置摄像头处于关闭状态,则通过第一MEMS和第二MEMS分别将第一图像传感器和第二图像传感器还原至初始位置。It should be understood that, when the front camera and the rear camera are turned on, the first MEMS and the second MEMS are always turned on to keep the shooting picture stable. If the front and rear cameras are turned off, the first image sensor and the second image sensor are respectively restored to their original positions by the first MEMS and the second MEMS.

本发明实施例的移动终端,通过检测到的移动终端的移动信息,控制MEMS驱动第一图像传感器和第二图像传感器进行移动,可以补偿移动终端在拍摄过程中的移动,从而在画中画拍摄时,保证了拍摄画面的稳定,防止画面出现断层,提高拍摄效果。The mobile terminal of the embodiment of the present invention controls the MEMS to drive the first image sensor and the second image sensor to move through the detected movement information of the mobile terminal, which can compensate the movement of the mobile terminal during the shooting process, so that the picture-in-picture shooting When shooting, it ensures the stability of the shooting picture, prevents faults in the picture, and improves the shooting effect.

可以理解的是,上述各实施例中相同或相似部分可以相互参考,在一些实施例中未详细说明的内容可以参见其他实施例中相同或相似的内容。It can be understood that, the same or similar parts in the above embodiments can be referred to each other, and the content that is not described in detail in some embodiments can be referred to the same or similar content in other embodiments.

需要说明的是,在本发明的描述中,术语“第一”、“第二”等仅用于描述目的,而不能理解为指示或暗示相对重要性。此外,在本发明的描述中,除非另有说明,“多个”的含义是指至少两个。It should be noted that, in the description of the present invention, the terms "first", "second" and so on are only used for description purposes, and should not be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, the meaning of "plurality" means at least two.

流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本发明的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本发明的实施例所属技术领域的技术人员所理解。Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention pertain.

应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that various parts of the present invention can be realized by hardware, software, firmware or their combination. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed , including one or a combination of the steps of the method embodiment.

此外,在本发明各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

上述提到的存储介质可以是只读存储器,磁盘或光盘等。The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like.

在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

尽管上面已经示出和描述了本发明的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本发明的限制,本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (9)

1. one kind shoots anti-fluttering method, it is characterised in that including:
In picture-in-picture shooting process, detect mobile terminal mobile message, the mobile terminal include MEMS microelectromechanical-systems, First imaging sensor and the second imaging sensor;
The MEMS driving described first image sensors and second imaging sensor is controlled to enter according to the mobile message Movement is gone to compensate the movement of the mobile terminal in shooting process;
Obtain it is mobile after the first image for shooting of the first imaging sensor and it is mobile after the second imaging sensor shoot the Two images;And
According to described first image and second image generation shooting picture;
Wherein, the MEMS drivings described first image sensor is controlled to move according to the mobile message, including:
The first MEMS driving described first image sensors are controlled to be moved backward according to the mobile message, it is described to realize The stabilization of first image;
The MEMS is controlled to drive second imaging sensor to move according to the mobile message, including:
The 2nd MEMS is controlled to drive second imaging sensor to be moved backward according to the mobile message, it is described to realize The stabilization of second image.
2. according to the method described in claim 1, it is characterised in that the mobile message of detection mobile terminal, including:
The mobile message of the mobile terminal is detected by gyroscope.
3. according to the method described in claim 1, it is characterised in that according to the mobile message controls the first MEMS drivings First imaging sensor is moved backward, and is further comprised:
First driving voltage is inquired from the mapping table of default mobile message and voltage according to the mobile message;
The first MEMS is controlled to enter with first driving voltage driving described first image sensor with the first displacement information Row reverse movement, wherein, first displacement information and displacement in the mobile message are equal in magnitude, in opposite direction.
4. according to the method described in claim 1, it is characterised in that the 2nd MEMS drivings second are controlled according to the mobile message Imaging sensor is moved backward, and is further comprised:
Second driving voltage is inquired from the mapping table of default displacement information and voltage according to the mobile message;
The 2nd MEMS is controlled to drive second imaging sensor to enter with second displacement information with second driving voltage Row reverse movement, wherein, the second displacement information and displacement in the mobile message are equal in magnitude, in opposite direction.
5. one kind shoots anti-shake apparatus, it is characterised in that including:
Detection module, in picture-in-picture shooting process, detecting the mobile message of mobile terminal, the mobile terminal includes MEMS microelectromechanical-systems, the first imaging sensor and the second imaging sensor;
Control module, for controlling the MEMS to drive described first image sensor and described second according to the mobile message Imaging sensor moves to compensate the movement of the mobile terminal in shooting process;
Acquisition module, is passed for obtaining the first image that the first imaging sensor after movement is shot with the second image after movement The second image that sensor is shot;
Generation module, for generating shooting picture according to described first image and second image;
Wherein, the control module, is used for:
The first MEMS driving described first image sensors are controlled to be moved backward according to the mobile message, it is described to realize The stabilization of first image;The 2nd MEMS is controlled to drive second imaging sensor reversely to be moved according to the mobile message It is dynamic, to realize the stabilization of second image.
6. device according to claim 5, it is characterised in that the detection module, is used for:
The mobile message of the mobile terminal is detected by gyroscope.
7. device according to claim 5, it is characterised in that the control module, including:
First query unit, for according to first displacement information from the mapping table of default displacement information and voltage Inquire the first driving voltage;
First control unit, for controlling the first MEMS with first driving voltage driving described first image sensor Moved backward with the first displacement information, wherein, first displacement information and displacement in the mobile message are big It is small equal, in opposite direction.
8. device according to claim 5, it is characterised in that the control module, including:
Second query unit, for being inquired about according to the mobile message from the mapping table of default displacement information and voltage To the second driving voltage;
Second control unit, for controlling the 2nd MEMS with second driving voltage driving, second imaging sensor Moved backward with second displacement information, wherein, the second displacement information and displacement in the mobile message are big It is small equal, in opposite direction.
9. a kind of mobile terminal, it is characterised in that including:Shell, processor, memory, circuit board, power circuit, first MEMS microelectromechanical-systems, the first imaging sensor, the 2nd MEMS and the second imaging sensor;
The circuit board is placed in the interior volume that the shell is surrounded, the processor, the memory, the first MEMS It is arranged on the 2nd MEMS on the circuit board;
Described first image sensor is connected with the first MEMS, second imaging sensor and the 2nd MEMS phases Even;
Power circuit, for being powered for each circuit or device of mobile terminal;
The processor is used to the executable program code that stores in memory by reading run and executable program code Corresponding program;
The processor specifically for:
In picture-in-picture shooting process, the mobile message of mobile terminal is detected;
The first MEMS and the 2nd MEMS is controlled to drive described first image sensor respectively according to the mobile message Move to compensate the movement of the mobile terminal in shooting process with second imaging sensor;
Obtain it is mobile after the first image for shooting of the first imaging sensor and it is mobile after the second imaging sensor shoot the Two images;And
According to described first image and second image generation shooting picture;
Wherein, the MEMS drivings described first image sensor is controlled to move according to the mobile message, including:
The first MEMS driving described first image sensors are controlled to be moved backward according to the mobile message, it is described to realize The stabilization of first image;
The MEMS is controlled to drive second imaging sensor to move according to the mobile message, including:
The 2nd MEMS is controlled to drive second imaging sensor to be moved backward according to the mobile message, it is described to realize The stabilization of second image.
CN201610616258.3A 2016-07-29 2016-07-29 Shooting anti-shake method and device and mobile terminal Expired - Fee Related CN106254771B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610616258.3A CN106254771B (en) 2016-07-29 2016-07-29 Shooting anti-shake method and device and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610616258.3A CN106254771B (en) 2016-07-29 2016-07-29 Shooting anti-shake method and device and mobile terminal

Publications (2)

Publication Number Publication Date
CN106254771A CN106254771A (en) 2016-12-21
CN106254771B true CN106254771B (en) 2017-07-28

Family

ID=57607310

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610616258.3A Expired - Fee Related CN106254771B (en) 2016-07-29 2016-07-29 Shooting anti-shake method and device and mobile terminal

Country Status (1)

Country Link
CN (1) CN106254771B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107040722B (en) 2017-04-27 2019-02-15 维沃移动通信有限公司 A shooting method and mobile terminal
CN108111761B (en) * 2017-12-27 2020-07-07 努比亚技术有限公司 Anti-shake processing method, terminal and computer readable storage medium
CN114205515B (en) 2020-09-18 2023-04-07 荣耀终端有限公司 Anti-shake processing method for video and electronic equipment
CN113709372B (en) * 2021-08-27 2024-01-23 维沃移动通信(杭州)有限公司 Image generation method and electronic device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4626684B2 (en) * 2008-07-31 2011-02-09 富士フイルム株式会社 Compound eye imaging apparatus and image blur correction method
JP5249271B2 (en) * 2010-03-19 2013-07-31 パナソニック株式会社 Imaging apparatus, image processing apparatus, and image processing program
KR20160068407A (en) * 2014-12-05 2016-06-15 삼성전기주식회사 Photographing apparatus and control method thereof

Also Published As

Publication number Publication date
CN106254771A (en) 2016-12-21

Similar Documents

Publication Publication Date Title
JP5914716B1 (en) Imaging device
CN106254771B (en) Shooting anti-shake method and device and mobile terminal
CN106303220B (en) Stabilization system calibration method, device and mobile terminal
CN106254772B (en) Multi-frame image synthesis method and device
KR102146858B1 (en) Photographing apparatus and method for making a video
CN105049682B (en) Digital camera system and the method for controlling the digital camera system
CN106303222A (en) Anti-shake processing method, device and terminal equipment
CN106060367B (en) Double-camera shooting control method and device and shooting device
CN106210677B (en) Image color processing method and device and terminal equipment
CN106231180B (en) Processing method, device and mobile terminal for panoramic photography
US9699381B2 (en) Digital photographing motion compensation system and method
CN110177200B (en) Camera module, electronic device and image capturing method
CN106060409B (en) Image pickup method, device and terminal device based on dual camera
CN106210678A (en) Image color processing method, device and terminal equipment
CN105812653A (en) Image pickup apparatus and image pickup method
CN103026716A (en) Image capturing device
JP2008054062A (en) Image pickup device
CN106162112A (en) Image color processing method, device and terminal unit
JP5724057B2 (en) Imaging device
CN106231181B (en) Panorama shooting method, device and terminal device
CN106101506A (en) Camera control method and device
JP6429060B2 (en) Imaging device
CN105872378A (en) Control method, control device and electronic device
CN106101556B (en) Image combining method, device and the mobile terminal of mobile terminal
JP2013246413A (en) Image blur correction device and imaging apparatus

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

CP01 Change in the name or title of a patent holder
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170728

CF01 Termination of patent right due to non-payment of annual fee