CN106254767B - Image zooming processing method and device and terminal equipment - Google Patents

Abstract

The application provides an image zooming processing method, an image zooming processing device and terminal equipment, wherein the method comprises the following steps: detecting zoom operation of a user on an original preview image acquired by a terminal device at an initial position, and determining a zoom multiple and an amplification area; triggering the micro-electro-mechanical system to respectively move the image sensor to reference positions corresponding to a plurality of directions according to a preset moving distance corresponding to the zoom multiple, and respectively acquiring corresponding reference preview images at the reference positions; superposing a reference pixel corresponding to the amplified region in the reference preview image and an original pixel corresponding to the amplified region in the original preview image to obtain a synthesized pixel corresponding to the amplified region; and carrying out zooming and enlarging processing on the synthesized pixels according to the size of the original preview image. Therefore, the image sensor is controlled to accurately and rapidly move through the micro-electro-mechanical system so as to carry out zooming and amplifying treatment, the number of pixel points in an amplifying area is increased, and the quality of images in the amplifying area is improved.

Description

Image zoom processing method, device and terminal equipment

technical field

The present application relates to the field of communication technologies, and in particular to an image zoom processing method, device and terminal equipment.

Background technique

Usually, an important indicator of the shooting function of the terminal device is the clarity of the image. Users can use digital zoom to capture images according to their needs. However, the purpose of zooming by cropping pixels will result in a decrease in image quality.

Contents of the invention

This application aims to solve one of the technical problems in the related art at least to a certain extent.

For this reason, the first purpose of this application is to propose an image zoom processing method, which controls the precise and fast movement of the image sensor through the micro-electromechanical system to perform zoom and zoom processing, increases the number of pixels in the zoomed-in area, and then improves the zoomed-in area. Image quality.

The second purpose of the present application is to propose an image zoom processing device.

The third purpose of the present application is to provide a terminal device.

The fourth purpose of this application is to propose another terminal device.

In order to achieve the above purpose, the embodiment of the first aspect of the present application proposes an image zoom processing method, including: detecting the zoom operation of the user on the original preview image acquired by the terminal device at the initial position, determining the zoom factor and the zoom area; triggering the micro-electromechanical The system moves the image sensor to one or more reference positions according to the preset moving distance corresponding to the zoom factor, and obtains corresponding reference preview images at the reference positions; The reference pixels corresponding to the enlarged area and the original pixels corresponding to the enlarged area in the original preview image are superimposed to obtain synthesized pixels corresponding to the enlarged area; The size is zoomed in and enlarged.

The image zooming processing method of the embodiment of the present application firstly detects the user’s zoom operation on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the enlarged area, and then triggers the MEMS to move according to the preset zoom factor. distance, move the image sensor to one or more reference positions, and obtain corresponding reference preview images at the reference positions, and then set the reference pixels corresponding to the enlarged area in the reference preview image and the corresponding reference pixels in the original preview image to the enlarged area The original pixels are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

In order to achieve the above purpose, the embodiment of the second aspect of the present application proposes an image zoom processing device, including: a determination module, which is used to detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, determine the zoom factor and zoom in area; a first acquisition module, configured to trigger the micro-electromechanical system to move the image sensor to one or more reference positions according to a preset moving distance corresponding to the zoom factor, and respectively acquire corresponding images at the reference positions A reference preview image; a second acquisition module, configured to superimpose the reference pixels corresponding to the enlarged region in the reference preview image and the original pixels corresponding to the enlarged region in the original preview image, and obtain the reference pixel corresponding to the enlarged region. Synthesized pixels corresponding to the magnified area; a processing module configured to zoom and magnify the synthesized pixels according to the size of the original preview image.

The image zoom processing device of the embodiment of the present application firstly detects the user’s zoom operation on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the zoom area, and then triggers the MEMS to move according to the preset zoom factor. distance, move the image sensor to one or more reference positions, and obtain corresponding reference preview images at the reference positions, and then set the reference pixels corresponding to the enlarged area in the reference preview image and the corresponding reference pixels in the original preview image to the enlarged area The original pixels are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

To achieve the above purpose, the embodiment of the third aspect of the present application provides a terminal device, including: the image zoom processing apparatus as described above.

The terminal device in the embodiment of the present application first detects the zoom operation of the user on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the zoom area, and then triggers the MEMS to move according to the preset moving distance corresponding to the zoom factor, Move the image sensor to one or more reference positions respectively, and obtain corresponding reference preview images at the reference positions, and then transfer the reference pixels corresponding to the enlarged area in the reference preview image, and the original pixels corresponding to the enlarged area in the original preview image The pixels are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

To achieve the above purpose, the embodiment of the fourth aspect of the present application proposes a terminal device, including: a casing and an imaging module disposed in the casing, wherein the imaging module includes: a micro-electromechanical system, an image sensor , a lens, a memory and a processor, the MEMS controls the movement of the image sensor, and the memory is used to store executable program codes; the processor executes by reading the executable program codes stored in the memory:

Detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, and determine the zoom factor and zoom area;

triggering the micro-electromechanical system to move the image sensor to one or more reference positions according to a preset moving distance corresponding to the zoom factor, and obtain corresponding reference preview images at the reference positions;

superimposing reference pixels corresponding to the enlarged region in the reference preview image and original pixels corresponding to the enlarged region in the original preview image to obtain synthesized pixels corresponding to the enlarged region;

Zooming and enlarging the synthesized pixels according to the size of the original preview image.

The terminal device in the embodiment of the present application first detects the zoom operation of the user on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the zoom area, and then triggers the MEMS to move according to the preset moving distance corresponding to the zoom factor, Move the image sensor to one or more reference positions respectively, and obtain corresponding reference preview images at the reference positions, and then transfer the reference pixels corresponding to the enlarged area in the reference preview image, and the original pixels corresponding to the enlarged area in the original preview image The pixels are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.

Description of drawings

The above and/or additional aspects and advantages of the present application will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:

FIG. 1 is a schematic flow chart of an image zoom processing method according to an embodiment of the present application;

FIG. 2 is a schematic flow diagram of a MEMS according to an embodiment of the present application;

Fig. 3 is a schematic diagram of a reference position of an embodiment of the present application;

Fig. 4 is a schematic diagram of a reference position of another embodiment of the present application;

FIG. 5 is a schematic flowchart of a panoramic shooting method according to another embodiment of the present application;

FIG. 6 is a schematic diagram of pixel synthesis in an embodiment of the present application;

FIG. 7 is a schematic structural diagram of a panoramic shooting device according to an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a panoramic shooting device according to another embodiment of the present application;

FIG. 9 is a schematic structural diagram of a panoramic shooting device according to another embodiment of the present application; and

Fig. 10 is a schematic structural diagram of a terminal device according to another embodiment of the present application.

detailed description

Embodiments of the present application are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary, and are intended to explain the present application, and should not be construed as limiting the present application.

The following describes the image zoom processing method, device, and terminal device according to the embodiments of the present application with reference to the accompanying drawings.

FIG. 1 is a schematic flowchart of an image zoom processing method according to an embodiment of the present application.

As shown in Figure 1, the image zoom processing method includes:

Step 101 : Detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, and determine the zoom factor and zoom area.

Specifically, the image zoom processing method provided in this embodiment is configured in a terminal device with a camera function as an example for specific description. It should be noted that there are many types of terminal devices, which can be selected according to application needs, such as mobile phones and tablet computers.

Specifically, in the process of taking pictures, the zoom function on the terminal device may be used to zoom in order to meet the actual application requirements of the user. The embodiment of the present application combines the characteristics of Micro-Electro-Mechanical System (MEMS for short), and proposes a method of using the Micro-Electro-Mechanical System to control the precise and fast movement of the image sensor for zooming and zooming in, which increases the number of camera pixels, thereby improving the quality of captured images. The specific structure is described in detail in conjunction with Figure 2 as follows:

Among them, microelectromechanical systems, also known as microelectromechanical systems, microsystems, micromachines, etc., are developed on the basis of microelectronics technology (semiconductor manufacturing technology), integrating lithography, corrosion, thin film, LIGA, silicon micromachining , non-silicon micromachining and precision machining technology to produce high-tech electronic mechanical devices.

As shown in FIG. 2 , the MEMS 12 is connected to the image sensor 14 , and the MEMS 12 includes a fixed electrode 122 , a movable electrode 124 and a deformable connector 126 . The movable electrode 124 cooperates with the fixed electrode 122 . The connecting member 126 is fixedly connected to the fixed electrode 122 and the movable electrode 124 . The fixed electrodes 122 and the movable electrodes 124 are used to generate electrostatic force under the action of the driving voltage. The connecting piece 126 is used to deform along the moving direction of the movable electrode 124 under the action of electrostatic force, so as to allow the movable electrode 124 to move so as to drive the image sensor 14 to move up, down, left and right in a plane precisely and finely.

Wherein, it should be noted that according to different specific application requirements, the corresponding MEMS is set to control the movement of the image sensor in different directions. Among them, the above-mentioned MEMS controls the step size of each movement of the image sensor, etc., which can be calibrated by the system based on a large amount of experimental data, or can be set by the user according to the needs. Examples are as follows:

The first MEMS is connected to the first image sensor to control the lateral movement of the first image sensor; the second MEMS is connected to the second image sensor to control the lateral movement of the second image sensor.

Specifically, during the shooting process, when the user triggers the zoom operation to perform the zoom function, detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, and determine the zoom factor and the enlarged area.

Among them, there are many ways for the user to zoom in on the original preview image acquired by the terminal device at the initial position, which can be selected according to actual needs. Examples are as follows:

Example one:

The zoom touch operation performed by the user on the interface of the original preview image.

For example, during the shooting process, the user can slide outwards on the interface of the original preview image with both fingers to determine the zoom factor as 2 times and the magnified area as the upper left corner.

Example two:

A user's touch operation on a preset zoom control button.

For example, a zoom control button can be set in the terminal device. When the button is pressed with different forces, different zoom factors and magnification areas can be determined; or, when the button is rotated by different angles, different zoom factors can be determined. Zoom factor and magnified area. For example, if the button is rotated 5 degrees to the left, the zoom factor can be determined to be 2 times and the enlarged area is the upper left corner.

Step 102 , triggering the MEMS to move the image sensor to one or more reference positions respectively according to a preset moving distance corresponding to the zoom factor, and respectively acquiring corresponding reference preview images at the reference positions.

Specifically, the moving distance of the micro-electro-mechanical system corresponding to the zoom factor is set in advance, and after the corresponding moving distance of the micro-electro-mechanical system is inquired according to the determined zoom factor, the micro-electro-mechanical system is triggered to move the image sensor from the initial position according to the respective moving distances. Move to a reference position, or multiple reference positions, and obtain corresponding reference preview images at the reference positions respectively.

Wherein, the preset moving distance of the micro-electro-mechanical system corresponding to the zoom factor can be set according to actual applications. The following example illustrates:

Example 1: Query the preset mapping relationship table between the zoom factor and the moving distance to obtain the moving distance corresponding to the current zoom factor.

For example, detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, determine that the current zoom factor is 2 times, and then obtain the current zoom factor corresponding to 2 times by querying the mapping relationship table between the zoom factor and the moving distance. The movement distance of the MEMS is the distance of half a pixel.

Example 2, by setting the calculation relationship between the zoom factor and the moving distance in advance, after the zoom is triggered, the current zoom factor is calculated according to the preset calculation relationship to determine the moving distance.

For example, detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, determine that the current zoom factor is 4 times, and then obtain the current zoom factor corresponding to 4 times by setting the calculation relationship between the zoom factor and the moving distance in advance. The moving distance of the MEMS is the distance of one pixel.

Furthermore, after the moving distance is determined, the MEMS is triggered to move the image sensor from the initial position to a reference position or multiple reference positions according to the respective moving distances, and obtain corresponding reference preview images at the reference positions. Combined with Figure 3 and Figure 4, it is illustrated as follows:

Example one:

The MEMS is triggered to move the image sensor from the initial position to the right to the first reference position according to the preset moving distance corresponding to the zoom factor, and acquire the first reference preview image. As shown in area A in Figure 3. and / or

The micro-electro-mechanical system is triggered to move the image sensor from the initial position to the left to the second reference position according to the preset moving distance corresponding to the zoom factor, so as to acquire the second reference preview image. As shown in area B in Figure 3. and / or

The micro-electro-mechanical system is triggered to move the image sensor upward from the initial position to a third reference position according to a preset moving distance corresponding to the zoom factor, to obtain a third reference preview image. As shown in area C in Figure 3. and / or

The MEMS is triggered to move the image sensor downward from the initial position to the fourth reference position according to the preset movement distance corresponding to the zoom factor, and obtain the fourth reference preview image. As shown in area D in Figure 3.

It should be noted that the number of pixels can be increased according to specific needs so that the MEMS can control the image sensor to move one reference position or multiple reference positions, and it can be only one reference position to the right. It can also be moved to the left, right and up to obtain three reference positions. You can select settings according to specific conditions.

Example two:

The MEMS is triggered to move the image sensor from the initial position to the first reference position in the first direction according to the preset moving distance corresponding to the zoom factor, and acquire the first reference preview image. As shown in area A in Figure 4.

The MEMS is triggered to move the image sensor from the first reference position to the second direction to the second reference position according to the moving distance, and acquire a second reference preview image. As shown in area B in Figure 4.

The micro-electro-mechanical system is triggered to move the image sensor from the second reference position to a third reference position in a third direction according to the moving distance, and acquire a third reference preview image. As shown in area C in Figure 4.

It should be noted that the number of pixels can be increased according to specific needs so that the micro-electromechanical system can control the image sensor to move one reference position or multiple reference positions, and two reference positions can be obtained by moving to the left and then to the right. Left, then right, then left to get three reference positions and so on. You can select settings according to specific conditions.

Step 103, superimposing the reference pixels corresponding to the enlarged area in the reference preview image and the original pixels corresponding to the enlarged area in the original preview image to obtain synthesized pixels corresponding to the enlarged area.

Step 104, zooming and enlarging the synthesized pixels according to the size of the original preview image.

Specifically, after the reference preview image is acquired, the reference pixels in the reference preview image corresponding to the enlarged area and the original pixels in the original preview image corresponding to the enlarged area are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels Zoom in and out according to the size of the original preview image. As a result, the number of pixels in the enlarged region is increased, thereby improving the image quality of the enlarged region.

The image zooming processing method provided by the embodiment of the present application firstly detects the user’s zooming operation on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the zoom area, and then triggers the micro-electromechanical system to follow the preset corresponding to the zoom factor. Moving the distance, move the image sensor to one or more reference positions, and obtain corresponding reference preview images at the reference positions, and then use the reference pixels corresponding to the enlarged area in the reference preview image, and the corresponding reference pixels in the original preview image and the enlarged area The corresponding original pixels are superimposed, and the synthesized pixels corresponding to the enlarged area are obtained, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

The image zoom processing method according to the embodiment of the present application will be further described in detail below with reference to FIG. 5 .

Fig. 5 is a schematic flowchart of an image zoom processing method according to another embodiment of the present application. As shown in Figure 5:

Step 501, acquire the horizontal resolution and vertical resolution of the image sensor.

Step 502, setting the corresponding relationship between the zoom factor and the moving distance according to the horizontal resolution and the vertical resolution.

It should be understood that, according to different application scenarios, the corresponding relationship between the zoom factor and the moving distance can be set as required, for example, the horizontal resolution W, the vertical resolution H, and the moving distance Y=W-H of the pixel can be determined. The zoom factor of resolution W and vertical resolution H is X, so that the corresponding relationship between X and Y can be determined.

Step 503: Detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, and determine the zoom factor and zoom area.

Specifically, during the shooting process, when the user triggers the zoom operation to perform the zoom function, detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, and determine the zoom factor and the enlarged area. The moving distance is determined according to the corresponding relationship between the zoom factor and the moving distance.

Step 504, trigger the MEMS to move the image sensor from the initial position to the first reference position in the first direction according to the preset moving distance corresponding to the zoom factor, and obtain the first reference preview image.

Step 505, triggering the MEMS to move the image sensor from the first reference position in the second direction to the second reference position according to the moving distance, and acquire a second reference preview image.

Step 506, triggering the MEMS to move the image sensor from the second reference position to a third reference position in a third direction according to the moving distance, and acquire a third reference preview image.

Specifically, after obtaining the corresponding moving distance of the micro-electro-mechanical system according to the determined zoom factor, trigger the micro-electro-mechanical system to move the image sensor from the initial position to the first reference position according to the moving distance, and then move the image sensor from the first reference position according to the moving distance to Move the first reference position to the second reference position in the second direction to acquire the second reference preview image, and then move the image sensor from the second reference position to the third reference position in the third direction according to the moving distance to acquire the third reference preview image image. The specific implementation process is shown in the above-mentioned example in FIG. 4 .

Step 507, superimposing the reference pixels corresponding to the enlarged area in the reference preview image and the original pixels corresponding to the enlarged area in the original preview image to obtain synthesized pixels corresponding to the enlarged area.

Step 508, zooming and enlarging the synthesized pixels according to the size of the original preview image.

Continuing to illustrate with the above example in Figure 4, after obtaining the three reference preview images, superimpose the reference pixels corresponding to the enlarged area in the three reference preview images with the original pixels corresponding to the enlarged area in the original preview image, as shown in the figure As shown on the left of 6, thus, the images are synthesized together, the pixel density is increased, and the position to be zoomed is taken out to obtain the synthesized pixels corresponding to the magnified area. Finally, the composite pixels are zoomed in according to the size of the original preview image.

The image zooming processing method of the embodiment of the present application firstly detects the user’s zoom operation on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the enlarged area, and then triggers the MEMS to move according to the preset zoom factor. distance, move the image sensor to one or more reference positions, and obtain corresponding reference preview images at the reference positions, and then set the reference pixels corresponding to the enlarged area in the reference preview image and the corresponding reference pixels in the original preview image to the enlarged area The original pixels are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of photographing pixels, thereby improving the quality of photographed images.

In order to realize the above embodiments, the present application further proposes an image zoom processing device.

Fig. 7 is a schematic structural diagram of an image zoom processing device according to an embodiment of the present application.

As shown in FIG. 7 , the image zoom processing device includes: a determination module 10 , a first acquisition module 20 , a second acquisition module 30 and a processing module 40 .

Wherein, the determining module 10 is used to detect the user's zooming operation on the original preview image acquired by the terminal device at the initial position, and determine the zoom factor and the enlarged area.

The determination module 10 is specifically configured to: determine the zoom factor and the enlarged area according to the zoom touch operation performed by the user on the interface of the original preview image. Or, the zoom factor and the magnified area are determined according to the touch operation performed by the user on the preset zoom control button.

The first acquisition module 20 is used to trigger the MEMS to move the image sensor to one or more reference positions according to the preset movement distance corresponding to the zoom factor, and acquire corresponding reference preview images at the reference positions.

The first acquisition module 20 is specifically used for:

The MEMS is triggered to move the image sensor from the initial position to the right to the first reference position according to the preset movement distance corresponding to the zoom factor, and acquire the first reference preview image. and / or,

triggering the MEMS to move the image sensor leftward from the initial position to a second reference position according to a preset moving distance corresponding to the zoom factor, and acquire a second reference preview image. and / or,

triggering the MEMS to move the image sensor upward from the initial position to a third reference position according to a preset moving distance corresponding to the zoom factor, and acquire a third reference preview image. and / or,

triggering the MEMS to move the image sensor down from the initial position to a fourth reference position according to a preset moving distance corresponding to the zoom factor, and acquire a fourth reference preview image.

In addition, the first acquisition module 20 is specifically used for:

The MEMS is triggered to move the image sensor from the initial position to the first reference position in the first direction according to the preset moving distance corresponding to the zoom factor, and acquire the first reference preview image.

The micro-electro-mechanical system is triggered to move the image sensor from the first reference position to the second direction to the second reference position according to the moving distance, so as to obtain a second reference preview image.

The micro-electro-mechanical system is triggered to move the image sensor from the second reference position to a third reference position in a third direction according to the moving distance, and acquire a third reference preview image.

The second acquiring module 30 is configured to superimpose the reference pixels corresponding to the enlarged region in the reference preview image and the original pixels corresponding to the enlarged region in the original preview image to obtain synthesized pixels corresponding to the enlarged region.

The processing module 40 is configured to perform zooming and enlarging processing on the synthesized pixels according to the size of the original preview image.

It should be noted that, the foregoing explanations for the embodiment of the image zoom processing method shown in FIG. 1 are also applicable to the image zoom processing device of this embodiment, and will not be repeated here.

The image zoom processing device provided by the embodiment of the present application first detects the user's zoom operation on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the zoom area, and then triggers the micro-electromechanical system to follow the preset corresponding to the zoom factor. Moving the distance, move the image sensor to one or more reference positions, and obtain corresponding reference preview images at the reference positions, and then use the reference pixels corresponding to the enlarged area in the reference preview image, and the corresponding reference pixels in the original preview image and the enlarged area The corresponding original pixels are superimposed, and the synthesized pixels corresponding to the enlarged area are obtained, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

FIG. 8 is a schematic structural diagram of an image zoom processing device according to another embodiment of the present application.

As shown in Figure 8, on the basis shown in Figure 7 above, it also includes:

The third acquiring module 50 is used to acquire the horizontal resolution and the vertical resolution of the image sensor.

The setting module 60 is used to set the corresponding relationship between the zoom factor and the moving distance according to the horizontal resolution and the vertical resolution.

It should be understood that, according to different application scenarios, the corresponding relationship between the zoom factor and the moving distance can be set as required, for example, the horizontal resolution W, the vertical resolution H, and the moving distance Y=W-H of the pixel can be determined. The zoom factor of resolution W and vertical resolution H is X, so that the corresponding relationship between X and Y can be determined.

It should be noted that the foregoing explanations of the embodiment of the image zoom processing method shown in FIG. 5 are also applicable to the image zoom processing apparatus of this embodiment, and details are not repeated here.

The image zoom processing device of the embodiment of the present application firstly detects the user’s zoom operation on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the zoom area, and then triggers the MEMS to move according to the preset zoom factor. distance, move the image sensor to one or more reference positions, and obtain corresponding reference preview images at the reference positions, and then set the reference pixels corresponding to the enlarged area in the reference preview image and the corresponding reference pixels in the original preview image to the enlarged area The original pixels are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

Fig. 9 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

As shown in FIG. 9 , the terminal device 1 includes: an image zoom processing device 2 , wherein the image zoom processing device 2 may adopt the image zoom processing device provided in the above-mentioned embodiment shown in FIG. 7 or FIG. 8 of the present invention.

Wherein, the terminal device 1 includes: a mobile phone or a tablet computer.

It should be noted that the foregoing explanations of the embodiment of the image zoom processing method are also applicable to the terminal device of this embodiment, and the implementation principles thereof are similar, so details are not repeated here.

The terminal device in the embodiment of the present application first detects the zoom operation of the user on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the zoom area, and then triggers the MEMS to move according to the preset moving distance corresponding to the zoom factor, Move the image sensor to one or more reference positions respectively, and obtain corresponding reference preview images at the reference positions, and then transfer the reference pixels corresponding to the enlarged area in the reference preview image, and the original pixels corresponding to the enlarged area in the original preview image The pixels are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

Fig. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

Referring to FIG. 10 , the terminal device may include: a casing 101, an imaging module 102 disposed in the casing 101, and the imaging module 102 includes: a microelectromechanical system 1021, an image sensor 1022, a memory 1023, and a processor 1024. The microelectromechanical system 1021 controls the image sensor 1022 to move, and the memory 1023 is used to store executable program codes; the processor 1024 executes by reading the executable program codes stored in the memory 1023:

Detect the user's zoom operation on the original preview image acquired by the terminal device at the initial position, and determine the zoom factor and the enlarged area.

The micro-electro-mechanical system is triggered to move the image sensor to one or more reference positions according to a preset moving distance corresponding to the zoom factor, and obtain corresponding reference preview images at the reference positions.

The reference pixels corresponding to the enlarged area in the reference preview image and the original pixels corresponding to the enlarged area in the original preview image are superimposed to obtain synthesized pixels corresponding to the enlarged area.

The composite pixels are zoomed in according to the size of the original preview image.

It should be noted that the foregoing explanations of the embodiment of the image zoom processing method are also applicable to the terminal device of this embodiment, and the implementation principles thereof are similar, so details are not repeated here.

The terminal device in the embodiment of the present application first detects the zoom operation of the user on the original preview image acquired by the terminal device at the initial position, determines the zoom factor and the zoom area, and then triggers the MEMS to move according to the preset moving distance corresponding to the zoom factor, Move the image sensor to one or more reference positions respectively, and obtain corresponding reference preview images at the reference positions, and then transfer the reference pixels corresponding to the enlarged area in the reference preview image, and the original pixels corresponding to the enlarged area in the original preview image The pixels are superimposed to obtain the synthesized pixels corresponding to the enlarged area, and finally the synthesized pixels are zoomed and enlarged according to the size of the original preview image. Therefore, the micro-electromechanical system controls the precise and rapid movement of the image sensor to perform zooming and magnification processing, which increases the number of pixels in the magnified area, thereby improving the quality of the image in the magnified area.

In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present application, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the present application includes additional implementations in which functions may be performed out of the order shown or discussed, including in substantially simultaneous fashion or in reverse order depending on the functions involved, which shall It should be understood by those skilled in the art to which the embodiments of the present application belong.

It should be understood that each part of the present application may be realized by hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, Programmable Gate Arrays (PGAs), Field Programmable Gate Arrays (FPGAs), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.

In addition, each functional unit in each embodiment of the present application may be integrated into one agent module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (12)

1. a kind of image zoom processing method, it is characterised in that comprise the following steps：

The zoom operation for the original preview image picture that detection user obtains to terminal device in initial position, determines zoom magnification and puts Big region；

MEMS is triggered according to default displacement corresponding with the zoom magnification, imaging sensor is moved respectively To one or more reference positions, and corresponding reference preview image is obtained in the reference position respectively；Wherein, pre-set The displacement of MEMS corresponding with zoom magnification, and inquired about according to the zoom magnification and obtain corresponding micro electronmechanical The displacement of system；

By in reference pixel corresponding with the magnification region, and the original preview image picture in the reference preview image with The corresponding original pixels of the magnification region are overlapped, and obtain resulting pixel corresponding with the magnification region；

The resulting pixel is subjected to zoom enhanced processing according to the size of the original preview image picture.

2. the method as described in claim 1, it is characterised in that what the detection user obtained to terminal device in initial position The zoom operation of original preview image picture, determines zoom magnification and magnification region, including：

Zoom magnification and magnification region are determined according to the zoom touch control operation that user is carried out to the interface of the original preview image picture； Or,

Zoom magnification and magnification region are determined according to the touch control operation that user is carried out to default Zoom control button.

3. the method as described in claim 1, it is characterised in that also include：

Obtain the horizontal resolution and vertical resolution of described image sensor；

Zoom magnification and the corresponding relation of displacement are set according to the horizontal resolution and vertical resolution.

4. the method as described in claim 1-3 is any, it is characterised in that the triggering MEMS is according to default and institute The corresponding displacement of zoom magnification is stated, imaging sensor is moved respectively to the corresponding reference position of multiple directions, and many The individual reference position obtains corresponding reference preview image respectively, including：

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position moved right to the first reference position, and acquisition first refers to preview image；

And/or,

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position was moved to the left to the second reference position, and acquisition second refers to preview image；

And/or,

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position was moved upwards up to the 3rd reference position, and acquisition the 3rd refers to preview image；

And/or,

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position was moved down into the 4th reference position, and acquisition the 4th refers to preview image.

5. the method as described in claim 1-3 is any, it is characterised in that the triggering MEMS is according to default and institute The corresponding displacement of zoom magnification is stated, imaging sensor is moved respectively to the corresponding reference position of multiple directions, and many The individual reference position obtains corresponding reference preview image respectively, including：

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position was moved to the first reference position to first direction, and acquisition first refers to preview image；

MEMS is triggered according to the displacement, imaging sensor is moved from first reference position to second direction Move to the second reference position, obtain second and refer to preview image；

MEMS is triggered according to the displacement, imaging sensor is moved from second reference position to third direction Move to the 3rd reference position, obtain the 3rd and refer to preview image.

6. a kind of image zoom processing unit, it is characterised in that including：

Determining module, the zoom operation for detecting the original preview image picture that user obtains to terminal device in initial position, really Determine zoom magnification and magnification region；

First acquisition module, will for triggering MEMS according to default displacement corresponding with the zoom magnification Imaging sensor is moved respectively to one or more reference positions, and obtains in the reference position corresponding reference preview respectively Image；Wherein, the displacement of MEMS corresponding with zoom magnification is pre-set, and is inquired about according to the zoom magnification Obtain the displacement of corresponding MEMS；

Second acquisition module, for by reference pixel corresponding with the magnification region, Yi Jisuo in the reference preview image State original pixels corresponding with the magnification region in original preview image picture to be overlapped, obtain corresponding with the magnification region Resulting pixel；

Processing module, for the resulting pixel to be carried out into zoom enhanced processing according to the size of the original preview image picture.

7. device as claimed in claim 6, it is characterised in that the determining module specifically for：

Zoom magnification and magnification region are determined according to the zoom touch control operation that user is carried out to the interface of the original preview image picture； Or,

Zoom magnification and magnification region are determined according to the touch control operation that user is carried out to default Zoom control button.

8. device as claimed in claim 6, it is characterised in that also include：

3rd acquisition module, horizontal resolution and vertical resolution for obtaining described image sensor；

Setup module, for setting zoom magnification corresponding with displacement according to the horizontal resolution and vertical resolution Relation.

9. the device as described in claim 6-8 is any, it is characterised in that first acquisition module specifically for：

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position moved right to the first reference position, and acquisition first refers to preview image；

And/or,

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position was moved to the left to the second reference position, and acquisition second refers to preview image；

And/or,

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position was moved upwards up to the 3rd reference position, and acquisition the 3rd refers to preview image；

And/or,

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position was moved down into the 4th reference position, and acquisition the 4th refers to preview image.

10. the device as described in claim 6-8 is any, it is characterised in that first acquisition module specifically for：

MEMS is triggered according to default displacement corresponding with the zoom magnification, by imaging sensor at the beginning of described Beginning, position was moved to the first reference position to first direction, and acquisition first refers to preview image；

MEMS is triggered according to the displacement, imaging sensor is moved from first reference position to second direction Move to the second reference position, obtain second and refer to preview image；

MEMS is triggered according to the displacement, imaging sensor is moved from second reference position to third direction Move to the 3rd reference position, obtain the 3rd and refer to preview image.

11. a kind of terminal device, it is characterised in that including：Image zoom processing unit as described in claim 6-10 is any.

12. a kind of terminal device, it is characterised in that including：Housing and the imaging modules being arranged in the housing, wherein, institute Stating imaging modules includes：MEMS, imaging sensor, camera lens, memory and processor, the MEMS control institute Imaging sensor movement is stated, memory is used to store executable program code；What processor was stored by reading in memory can Configuration processor code is to perform：

The zoom operation for the original preview image picture that detection user obtains to terminal device in initial position, determines zoom magnification and puts Big region；

MEMS is triggered according to default displacement corresponding with the zoom magnification, imaging sensor is moved respectively To one or more reference positions, and corresponding reference preview image is obtained in the reference position respectively；

By in reference pixel corresponding with the magnification region, and the original preview image picture in the reference preview image with The corresponding original pixels of the magnification region are overlapped, and obtain resulting pixel corresponding with the magnification region；

The resulting pixel is subjected to zoom enhanced processing according to the size of the original preview image picture.