CN110874829B - Image processing method and device, electronic device and storage medium - Google Patents

Abstract

The present disclosure relates to an image processing method and device, an electronic device and a storage medium. The method includes: when a photographing instruction is received, using a photosensitive element to simultaneously output a first image with a first pixel arrangement and a second pixel The second image of the arrangement; wherein, in the first pixel arrangement, the pixels of the same color component are distributed in a square array, and the second pixel arrangement is a standard Bayer arrangement; The second image is fused to obtain the image to be displayed. The technical solution of the present disclosure can make the obtained image to be displayed can balance the resolution and the sensitivity, and achieve the effect of image quality enhancement.

Description

Image processing method and device, electronic device and storage medium

technical field

The present disclosure relates to the technical field of image processing, and in particular, to an image processing method and device, an electronic device, and a storage medium.

Background technique

In the related art, images captured by the mobile phone through the front camera have different resolutions according to different ambient lighting. By adjusting the resolution, high resolution in bright environments and higher image quality in low light environments can be achieved. However, in a high-brightness environment, the image quality will be lost to ensure the high resolution of the image, and in a low-light environment, the image resolution will be lost to ensure the image quality. Therefore, the photographing method in the related art cannot achieve both image quality and image resolution. Rate.

SUMMARY OF THE INVENTION

In order to overcome the problems existing in the related art, the embodiments of the present disclosure provide an image processing method and device, an electronic device, and a storage medium, which can balance image resolution and sensitivity, and achieve the effect of image quality enhancement.

According to a first aspect of the embodiments of the present disclosure, an image processing method is provided, including:

When receiving the photographing instruction, use the photosensitive element to simultaneously output the first image with the first pixel arrangement and the second image with the second pixel arrangement;

Wherein, in the first pixel arrangement, the pixels of the same color component are distributed in a square array, and the second pixel arrangement is a standard Bayer arrangement;

The first image and the second image are fused to obtain the image to be displayed.

According to a second aspect of the embodiments of the present disclosure, there is provided an image processing apparatus, including:

an image output module for simultaneously outputting a first image with a first pixel arrangement and a second image with a second pixel arrangement by using the photosensitive element when a photographing instruction is received;

Wherein, in the first pixel arrangement, the pixels of the same color component are distributed in a square array, and the second pixel arrangement is a standard Bayer arrangement;

An image fusion module, configured to fuse the first image and the second image output by the image output module to obtain an image to be displayed.

According to a third aspect of the embodiments of the present disclosure, there is provided an electronic device, the electronic device comprising:

a photosensitive element for simultaneously outputting a first image with a first pixel arrangement and a second image with a second pixel arrangement when receiving a photographing instruction; wherein, in the first pixel arrangement, the same color component The pixels are distributed in a square array, and the second pixel arrangement is a standard Bayer arrangement;

memory for storing processor executable instructions;

The processor is configured to fuse the first image and the second image to obtain an image to be displayed.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

Obtaining one pixel on the first image through four pixels of the same color component of the photosensitive element is equivalent to increasing the photosensitive area of the pixel, so the first image can have low resolution and high sensitivity; The inherent pixel points are rearranged to obtain the second image, which is equivalent to retaining the inherent resolution of the photosensitive element, which can make the second image have high resolution and low sensitivity; by fusing the first image and the second image, it can be The resulting image to be displayed can balance the resolution and sensitivity to achieve the effect of image quality enhancement.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

FIG. 1A is a flowchart of an image processing method according to an exemplary embodiment.

FIG. 1B is a schematic diagram of the arrangement of pixels on the photosensitive element in the embodiment shown in FIG. 1A .

FIG. 1C is a schematic diagram of a first pixel arrangement of the photosensitive element in the embodiment shown in FIG. 1A .

FIG. 1D is a schematic diagram of a second pixel arrangement of the photosensitive element in the embodiment shown in FIG. 1A .

Fig. 2 is a flowchart of an image processing method according to another exemplary embodiment.

FIG. 3 is a flowchart of how to determine the preset resolution of the exemplary embodiment shown in FIG. 2 .

FIG. 4A is a flowchart of how to determine the preset resolution of another exemplary embodiment shown in FIG. 2 .

FIG. 4B is a schematic diagram of setting options in the exemplary embodiment shown in FIG. 4A .

FIG. 5 is a block diagram of an image processing apparatus according to an exemplary embodiment.

FIG. 6 is a block diagram of an image processing apparatus according to another exemplary embodiment.

FIG. 7 is a block diagram of an image processing apparatus according to yet another exemplary embodiment.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of the invention as recited in the appended claims.

FIG. 1A is a flowchart of an image processing method according to an exemplary embodiment, FIG. 1B is a schematic diagram of an arrangement of pixels on a photosensitive element in the embodiment shown in FIG. 1A , and FIG. 1C is a A schematic diagram of the first pixel arrangement of the photosensitive element, FIG. 1D is a schematic diagram of the second pixel arrangement of the photosensitive element in the embodiment shown in FIG. 1A ; the image processing method can be applied to electronic devices (such as smart phones, tablet computers) , digital cameras and other equipment), as shown in Figure 1A, the image processing method includes the following steps S101-S103:

In step S101, when a photographing instruction is received, a first image with a first pixel arrangement and a second image with a second pixel arrangement are simultaneously output using the photosensitive element; wherein, in the first pixel arrangement, the same color is The pixels of the component are distributed in a square array, and the second pixel arrangement is a standard Bayer arrangement.

In one embodiment, the first image is acquired based on the first pixel arrangement of the photosensitive element; the second image is acquired based on the second pixel arrangement within the same frame of native image data as the first image; and the first image is output simultaneously and the second image.

In one embodiment, the square array may be an N×N array, where N is greater than or equal to two. As shown in FIG. 1B , the square array is a 2×2 square array as an example for illustration. The inherent pixel arrangement pattern of the photosensitive element is a four-in-one (4in1) pixel arrangement, that is, the pixel arrangement pattern corresponding to the same color component is The 2×2 array is used as a large pixel point, and the resolution of the first image is a quarter of the resolution of the photosensitive element. Based on the color components in the 2×2 array shown in FIG. 1B , the color components of the large pixels corresponding to the 2×2 array can be determined, and then the first pixel arrangement shown in FIG. 1C can be obtained. The first pixel arrangement described above may be referred to as a Quad Bayer arrangement. In one embodiment, a frame of original image data as shown in FIG. 1B is collected by a photosensitive element, and the original image data is converted into the first pixel arrangement shown in FIG. 1C to obtain the first image.

In one embodiment, the standard Bayer arrangement pattern is shown in FIG. 1D , and the second image is obtained by rearranging the pixels of the original image data shown in FIG. 1B according to the second pixel arrangement pattern shown in FIG. 1D . The first image and the second image can be acquired through the sensor, and the first image and the second image can be simultaneously output to the processor through the sensor, and the processor executes the following step S102.

In step S102, the first image and the second image are fused to obtain an image to be displayed.

In one embodiment, the first RGB image can be obtained by performing an interpolation operation on the first image, the second RGB image can be obtained by performing an interpolation operation on the second image, and the first RGB image and the second RGB image can be fused to obtain The image that needs to be displayed on the user interface of the camera application. For the specific interpolation algorithm, reference may be made to the description of the related art, which will not be described in detail in the present disclosure.

In this embodiment, one pixel on the first image is obtained from four pixels of the same color component of the photosensitive element, which is equivalent to increasing the photosensitive area of the pixel, so the first image can have low resolution and high sensitivity ; The second image is obtained by rearranging the pixels inherent in the photosensitive element, which is equivalent to retaining the inherent resolution of the photosensitive element, so that the second image can have high resolution and low sensitivity; Fusion of images can make the images to be displayed can balance the resolution and sensitivity, and achieve the effect of image quality enhancement.

The technical solutions provided by the embodiments of the present disclosure are described below with specific embodiments.

FIG. 2 is a flowchart of an image processing method according to another exemplary embodiment; this embodiment uses the above-mentioned method provided by the embodiment of the present disclosure, and takes how to generate an image to be displayed based on the first image and the second image as an example. An exemplary illustration, as shown in Figure 2, includes the following steps:

In step S201, when a photographing instruction is received, a first image with a first pixel arrangement and a second image with a second pixel arrangement are simultaneously output by using the photosensitive element; wherein, in the first pixel arrangement, the same color is The pixels of the component are distributed in a square array, and the second pixel arrangement is a standard Bayer arrangement.

For the description of step S201, reference may be made to the description of step S101 in the embodiment shown in FIG. 1A above, which will not be described in detail here.

In step S202, the first image is enlarged from the first resolution to a preset resolution to obtain a third image.

In one embodiment, the first resolution is a quarter of the inherent resolution of the photosensitive element. For example, as shown in FIG. 1B , the inherent resolution of the photosensitive element is 16×16, and the first resolution is 4× 4.

For a description of how to determine the preset resolution, reference may be made to the following embodiments in FIG. 3 and FIG. 4A , which will not be described in detail in this embodiment. In an embodiment, reference may be made to the description of the related art for the enlargement algorithm of the first image, and the enlargement algorithm is not limited in this embodiment.

In step S203, the second image is reduced from the second resolution to a preset resolution to obtain a fourth image.

In an embodiment, reference may be made to the description of the related art for the reduction algorithm of the second image, and the reduction algorithm is not limited in this embodiment.

In step S204, the third image and the fourth image are fused to obtain an image to be displayed.

In one embodiment, an interpolation operation may be performed on the third image first to obtain a fifth RGB image corresponding to the third image; similarly, an interpolation operation may be performed on the fourth image first to obtain a sixth RGB image corresponding to the fourth image; Finally, fusion is performed based on the fifth RGB image and the sixth RGB image to obtain the image to be displayed.

In one embodiment, processing such as edge sharpening and image enhancement may also be performed on the image to be displayed, so as to further improve the user's visual experience.

In this embodiment, by adjusting the first image and the second image to the third image and the fourth image with the same resolution, the image to be displayed is obtained based on the fusion of the third image and the fourth image with the same resolution. The third image retains the high signal-to-noise ratio of the original image data collected by the photosensitive element, and the fourth image retains the high resolution of the original image data collected by the photosensitive element. Therefore, the image to be displayed based on the third image and the fourth image still remains. It can take into account high signal-to-noise ratio and high resolution to achieve the effect of image quality enhancement.

FIG. 3 is a flowchart of how to determine the preset resolution of the exemplary embodiment shown in FIG. 2 ; this embodiment uses the above-mentioned method provided by the embodiment of the present disclosure, and takes how to determine the preset resolution as an example for illustrative description, As shown in Figure 3, it includes the following steps:

In step S301, the illumination intensity of ambient light is detected.

In one embodiment, the brightness of the entire image frame may be determined through the raw image collected by the image sensor, and the illumination intensity of the ambient light may be determined based on the brightness. In another embodiment, the illumination intensity of ambient light may be detected by a light sensor disposed on the electronic device where the image sensor is located.

In step S302, a preset resolution is determined based on the light intensity, the first resolution and the second resolution.

In one embodiment, a correspondence table between the illumination intensity and the specific value of the preset resolution can be counted, and when the illumination intensity is greater than or equal to the first threshold, the specific value of the preset resolution is set equal to the second threshold. Resolution, when the light intensity is less than or equal to the second threshold, the specific value of the preset resolution is set equal to the first resolution, when the light intensity is less than the first threshold and greater than the second threshold, according to the light intensity and the preset The correspondence table between resolutions, find out the specific value of the preset resolution corresponding to the light intensity, where the first threshold is greater than the second threshold, for example, the first threshold is 800 lux (Lux), and the second threshold is 100Lux. The comparison table can be found in Table 1 below.

light intensity The specific value of the preset resolution <100Lux 2560×1920 150Lux 2000×1000 … … 750Lux 5000×3000 >800Lux 5120×3840

Table 1

The preset resolution is determined based on the size relationship between the light intensity and the first threshold and the second threshold, the first resolution, and the second resolution, which can ensure that the resolution of the image to be displayed can change with the light intensity, and at the same time It can also ensure that the images to be displayed can present better image quality and have higher resolution.

This embodiment can be executed before step S203 in the embodiment shown in FIG. 2 is executed, and this embodiment can also be executed when any step from step S201 to step S202 is executed. The present disclosure does not limit the timing of obtaining the third resolution. , as long as it can be ensured that a reasonable preset resolution can be obtained when step S203 is executed.

In this embodiment, the preset resolution is determined based on the illumination intensity, the first resolution, and the second resolution. When the illumination intensity is different, the obtained preset resolution is also different, and then the at least one third image and the at least one frame are used to determine the preset resolution. The resolution of the image to be displayed obtained by the fusion of the fourth image of the frame will also vary with the light intensity. When the light intensity is high, the image to be displayed can have a higher resolution. When the light intensity is low, it needs to The displayed image can have high definition and signal-to-noise ratio, thereby ensuring that the image to be displayed can have better resolution and signal-to-noise ratio with different light intensity.

FIG. 4A is a flowchart of how to determine the preset resolution of another exemplary embodiment shown in FIG. 2 , and FIG. 4B is a schematic diagram of setting options in the exemplary embodiment shown in FIG. 4A . This embodiment utilizes the embodiments of the present disclosure. The above-mentioned method is provided by taking how to determine the preset resolution as an example to illustrate; as shown in FIG. 4A , it includes the following steps:

In step S401, a prompt box for setting the third resolution is displayed on the currently displayed image preview interface.

In step S402, the resolution input by the user in the prompt box is detected, and the input resolution is determined as the preset resolution.

As shown in FIG. 4B , on the currently displayed image preview interface, a prompt box 41 may be displayed, and the content in the prompt box 41 is used to prompt the user of the resolution of the photo generated after taking the photo. After the user sets the specific value of the preset resolution through the prompt box, and after the user triggers the photo button, the resolution of the generated photo is the preset resolution.

In this embodiment, the preset resolution is set by means of a user interface, so that the user can select an appropriate photo resolution according to his specific needs, thereby improving the user's experience of taking photos.

In the above-mentioned embodiments shown in FIG. 3 and FIG. 4A , the embodiment shown in FIG. 3 and FIG. 4A may be executed before step S203 in the embodiment shown in FIG. 2 is executed, or any step from step S201 to step S202 may be executed. This embodiment is executed when the present disclosure does not limit the time point at which the preset resolution is obtained, as long as a reasonable preset resolution can be ensured when step S203 is executed.

FIG. 5 is a block diagram of an image processing apparatus according to an exemplary embodiment. As shown in FIG. 5 , the image processing apparatus includes:

The image output module 51 is used for simultaneously outputting the first image with the first pixel arrangement and the second image with the second pixel arrangement by using the photosensitive element when receiving the photographing instruction;

Wherein, in the first pixel arrangement, the pixels of the same color component are distributed in a square array, and the second pixel arrangement is a standard Bayer arrangement;

The image fusion module 52 is configured to fuse the first image and the second image output by the image output module 51 to obtain the image to be displayed.

FIG. 6 is a block diagram of an image processing apparatus according to another exemplary embodiment. As shown in FIG. 6 , on the basis of the embodiment shown in FIG. 5 above, the image fusion module 52 may include:

an enlarging unit 521, configured to enlarge the first image from the first resolution to a preset resolution to obtain a third image;

a reducing unit 522, for reducing the second image from the second resolution to the preset resolution to obtain a fourth image;

The fusion unit 523 is configured to fuse the third image obtained by the enlargement unit 521 and the fourth image obtained by the reduction unit 522 to obtain the image to be displayed.

In one embodiment, the apparatus further includes:

The first detection module 53 is used to detect the illumination intensity of ambient light;

The determination module 54 is configured to determine a preset resolution based on the light intensity, the first resolution and the second resolution detected by the first detection module 53 .

In one embodiment, the apparatus further includes:

A display module 55, configured to display a prompt box for setting the preset resolution on the preview interface of the displayed image;

The second detection module 56 is configured to detect the resolution input in the prompt box displayed by the display module 55, and determine the input resolution as the preset resolution.

In one embodiment, the image output module 51 may include:

a first acquiring unit 511, configured to acquire a first image based on a first pixel arrangement of the photosensitive element;

The second obtaining unit 512 is configured to obtain the second image based on the second pixel arrangement in the same frame of native image data obtained by the first obtaining unit 511;

The output unit 513 is configured to simultaneously output the first image obtained by the first obtaining unit and the second image obtained by the second obtaining unit.

In one embodiment, the first pixel arrangement is a Quad Bayer arrangement.

Regarding the apparatus in the above-mentioned embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the method, and will not be described in detail here.

Fig. 7 is a block diagram of a photo generating apparatus according to yet another exemplary embodiment. For example, apparatus 700 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, and the like.

7, the apparatus 700 may include one or more of the following components: a processing component 702, a memory 704, a power supply component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, And the communication component 716 .

The processing component 702 generally controls the overall operation of the device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing element 702 may include one or more processors 720 to execute instructions to perform all or part of the steps of the methods described above. Additionally, processing component 702 may include one or more modules to facilitate interaction between processing component 702 and other components. For example, processing component 702 may include a multimedia module to facilitate interaction between multimedia component 708 and processing component 702.

Memory 704 is configured to store various types of data to support operation at device 700 . Examples of such data include instructions for any application or method operating on device 700, contact data, phonebook data, messages, pictures, videos, and the like. Memory 704 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

Power component 706 provides power to various components of device 700 . Power components 706 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to device 700 .

Multimedia component 708 includes a screen that provides an output interface between the device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 708 includes a front-facing camera and/or a rear-facing camera. When the device 700 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.

Audio component 710 is configured to output and/or input audio signals. For example, audio component 710 includes a microphone (MIC) that is configured to receive external audio signals when device 700 is in operating modes, such as call mode, recording mode, and voice recognition mode. The received audio signal may be further stored in memory 704 or transmitted via communication component 716 . In some embodiments, audio component 710 also includes a speaker for outputting audio signals.

The I/O interface 712 provides an interface between the processing component 702 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.

Sensor assembly 714 includes one or more sensors for providing status assessment of various aspects of device 700 . For example, the sensor assembly 714 can detect the open/closed state of the device 700, the relative positioning of components, such as the display and keypad of the device 700, and the sensor assembly 714 can also detect a change in the position of the device 700 or a component of the device 700 , the presence or absence of user contact with the device 700 , the orientation or acceleration/deceleration of the device 700 and the temperature change of the device 700 . Sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 716 is configured to facilitate wired or wireless communication between apparatus 700 and other devices. Device 700 may access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 716 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, apparatus 700 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

In an exemplary embodiment, the sensor assembly 614 may further include a photosensitive element for simultaneously outputting a first image with a first pixel arrangement and a second image with a second pixel arrangement when a photographing instruction is received; The pixels of the same color component are distributed in a square array in the first pixel arrangement, and the second pixel arrangement is a standard Bayer arrangement. The processor 720 fuses the first image and the second image to obtain an image to be displayed.

In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as memory 704 including computer instructions, is also provided. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

Other embodiments of the present disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or techniques in the technical field not disclosed by the present disclosure . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (13)

1. An image processing method, characterized in that the method comprises:

when a photographing instruction is received, simultaneously outputting a first image with a first pixel arrangement mode and a second image with a second pixel arrangement mode by using a photosensitive element;

the pixels with the same color component in the first pixel arrangement mode are distributed in a square array mode, and the second pixel arrangement mode is a standard Bayer arrangement mode;

adjusting a first resolution of the first image and a second resolution of the second image to preset resolutions respectively; wherein the preset resolution is determined based on the illumination intensity of the ambient light, the first resolution, and the second resolution;

and fusing the first image with the adjusted resolution and the second image with the adjusted resolution to obtain an image to be displayed.

2. The method of claim 1, wherein the adjusting the first resolution of the first image and the second resolution of the second image to preset resolutions respectively comprises:

amplifying the first image from a first resolution to a preset resolution;

and reducing the second image from the second resolution to the preset resolution.

3. The method of claim 1, further comprising:

and detecting the illumination intensity of the ambient light to obtain the illumination intensity.

4. The method of claim 2, further comprising:

displaying a prompt box for setting the preset resolution on a preview interface for displaying an image;

and detecting the resolution input in the prompt box, and determining the input resolution as the preset resolution.

5. The method of claim 1, wherein outputting a first image having a first pixel arrangement and a second image having a second pixel arrangement simultaneously using a photosensitive element comprises:

acquiring a first image based on a first pixel arrangement mode of a photosensitive element;

acquiring a second image based on the second pixel arrangement mode in the same frame of original image data as the first image;

outputting the first image and the second image simultaneously.

6. The method of any of claims 1-5, wherein the first pixel arrangement is a Quad Bayer arrangement pattern.

7. An image processing apparatus, characterized in that the apparatus comprises:

the image output module is used for outputting a first image with a first pixel arrangement mode and a second image with a second pixel arrangement mode simultaneously by using the photosensitive element when receiving a photographing instruction;

the first pixel arrangement mode is a Quad Bayer arrangement mode, and the second pixel arrangement mode is a standard Bayer arrangement mode;

the image fusion module is used for adjusting the first resolution of the first image and the second resolution of the second image to preset resolutions respectively; wherein the preset resolution is determined based on the illumination intensity of the ambient light, the first resolution, and the second resolution; and fusing the first image with the adjusted resolution and the second image with the adjusted resolution to obtain an image to be displayed.

8. The apparatus of claim 7, wherein the image fusion module comprises:

the amplifying unit is used for amplifying the first image from a first resolution to a preset resolution;

a reducing unit, configured to reduce the second image from a second resolution to the preset resolution.

9. The apparatus of claim 8, further comprising:

the first detection module is used for detecting the illumination intensity of the ambient light to obtain the illumination intensity.

10. The apparatus of claim 8, further comprising:

the display module is used for displaying a prompt box for setting the preset resolution on a preview interface for displaying an image;

and the second detection module is used for detecting the resolution input in the prompt box displayed by the display module and determining the input resolution as the preset resolution.

11. The apparatus of claim 7, wherein the image output module comprises:

a first acquisition unit configured to acquire a first image based on a first pixel arrangement of the photosensitive element;

a second acquisition unit configured to acquire a second image based on the second pixel arrangement in the same frame of raw image data as the first image acquired by the first acquisition unit;

and the output unit is used for simultaneously outputting the first image acquired by the first acquisition unit and the second image acquired by the second acquisition unit.

12. The device according to any one of claims 7-11, wherein the first pixel arrangement is a Quad Bayer arrangement pattern.

13. An electronic device, characterized in that the electronic device comprises:

the photosensitive element is used for simultaneously outputting a first image with a first pixel arrangement mode and a second image with a second pixel arrangement mode when receiving a photographing instruction; pixels of the same color component in the first pixel arrangement mode are distributed in a square array mode, and the second pixel arrangement mode is a standard Bayer arrangement mode;

a memory for storing processor-executable instructions;

the processor is used for respectively adjusting the first resolution of the first image and the second resolution of the second image to preset resolutions; wherein the preset resolution is determined based on the illumination intensity of the ambient light, the first resolution, and the second resolution;

and fusing the first image with the adjusted resolution and the second image with the adjusted resolution to obtain an image to be displayed.

Images