CN113965668B

CN113965668B - Light processing device, camera module and electronic equipment

Info

Publication number: CN113965668B
Application number: CN202010637064.8A
Authority: CN
Inventors: 尹志东; 杨宗保; 王辉
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2020-07-03
Filing date: 2020-07-03
Publication date: 2025-01-10
Anticipated expiration: 2040-07-03
Also published as: CN113965668A

Abstract

The present disclosure relates to a light processing device, a camera module, an electronic device, a shooting method and a storage medium. The light processing device includes: a rotating shaft structure; a light deflection component, the light deflection component is installed on the rotating shaft structure, and the rotation angle of the light deflection component is different to form different light conduction paths; a plurality of light sensors are arranged around the light deflection component to receive the outgoing light transmitted through different light conduction paths. In this way, by making a plurality of light sensors revolve around the rotatable light deflection component, each light sensor can share the incident optical system such as the light deflection component installed on the rotating shaft structure, which can reduce the number of hardware structures that need to be set in the light processing system, thereby reducing the volume of the light processing device.

Description

Light processing device, camera module and electronic equipment

Technical Field

The present disclosure relates to camera light path processing technologies, and in particular, to a light processing apparatus, a camera module, an electronic device, a photographing method, and a storage medium.

Background

At present, in order to realize optical zooming or image fusion of a camera, a plurality of mutually independent camera modules are arranged in the camera modules, and the function of optical zooming or image fusion is realized through switching among the plurality of camera modules. For example, from a main lens to a tele lens, or from a color camera module to a black and white camera module. In this way, the number of camera modules in the camera module is excessive, and the volume of the camera module is increased.

Disclosure of Invention

The present disclosure provides an optical processing device, a camera module, an electronic apparatus, a photographing method, and a storage medium.

According to a first aspect of embodiments of the present disclosure, there is provided a light processing device, the device comprising:

A rotating shaft structure;

The light deflection assembly is arranged on the rotating shaft structure, and the rotation angles of the light deflection assembly are different to form different light conduction paths;

A plurality of light sensors disposed around the light deflection assembly for receiving outgoing light conducted via different ones of the light conduction paths.

Optionally, the apparatus further includes:

the lens assemblies are positioned between one light sensor and the light deflection assembly and are used for conducting the emergent light conducted by the light conduction path to the corresponding light sensor.

Optionally, the apparatus further includes:

The driving assembly is connected with the rotating shaft structure and is used for driving the rotating shaft structure to rotate so as to drive the light deflection assembly to rotate around at least one rotating shaft, and the rotating shaft is perpendicular to a lens optical axis of the lens assembly.

Optionally, the maximum focal length of the lens assembly is different.

Optionally, an intersection point of the lens optical axes of the lens assemblies coincides with a center of the light ray deflection assembly.

Optionally, the difference between the lengths of the light transmission paths from the light emitting surface of the light deflection component to the light entering surface of each light sensor is smaller than a set length value.

Optionally, the light deflection component is a triangular prism.

According to a second aspect of embodiments of the present disclosure, there is provided a camera module including:

A light collecting component for collecting reflected light of a shooting object and transmitting the reflected light as incident light to the light processing device according to any one of the first aspect;

The light processing device is used for receiving the incident light output by the light acquisition component and forming an image based on the incident light.

According to a third aspect of embodiments of the present disclosure, there is provided an electronic device in which the camera module set according to the second aspect is mounted.

According to a fourth aspect of embodiments of the present disclosure, there is provided an image capturing method applied to the electronic device described in the third aspect, the method including:

receiving a first input;

Determining a target light sensor in response to the first input;

and generating a target image of the shooting object based on the target light sensor.

Optionally, the target light sensor at least comprises a first light sensor and a second light sensor, wherein the light sampling types of the first light sensor and the second light sensor are different;

the generating a target image of the shooting object based on the target light sensor includes:

receiving a second input;

Acquiring a first image formed by the first light sensor and a second image formed by the second light sensor in response to the second input;

And fusing the first image and the second image to obtain a fused image of the shooting object.

Optionally, the determining the target light sensor in response to the first input includes:

determining expected acquisition parameters of an image to be acquired in response to the first input;

Determining a light sensor corresponding to a target lens assembly having the desired acquisition parameters as the target light sensor; the target lens component is at least one of a plurality of lens components;

The desired acquisition parameters include an acquisition focal length.

Optionally, the method further comprises:

the light deflection assembly is driven to rotate to a preset angle, and the light deflection assembly is driven to transmit incident light to the target light sensor.

According to a fifth aspect of embodiments of the present disclosure, there is provided an electronic device, comprising:

A processor;

a memory configured to store processor-executable instructions;

Wherein the processor is configured to implement the steps of any one of the image capturing methods of the fourth aspect described above when executed.

According to a sixth aspect of embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, which when executed by a processor of an electronic device, causes the electronic device to perform the steps of any one of the image capturing methods of the fourth aspect described above.

The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects:

As can be seen from the above embodiments, the light processing device in the present disclosure is provided with a rotating shaft structure, and the light deflection assembly is mounted on the rotating shaft structure, so that the rotating shaft structure can be controlled to rotate to drive the light deflection assembly to rotate in the process of image capturing, and when the rotation angles of the light deflection assembly are different, the formed light transmission paths are different, and since the plurality of light sensors are disposed around the light deflection assembly, the light emitted by the light transmission paths can be received by the different light sensors.

In this way, by making the plurality of light sensors surround the rotatable light deflection assembly, each light sensor can share the incident optical system such as the light deflection assembly mounted on the rotating shaft structure, the number of hardware structures required to be arranged in the light processing system can be reduced, and the volume of the light processing device can be further reduced.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a schematic diagram showing a structure of a light processing apparatus according to an exemplary embodiment.

Fig. 2 is a schematic cross-sectional structure of a triangular prism shown according to an exemplary embodiment.

Fig. 3 is a schematic diagram of a light processing apparatus according to an exemplary embodiment.

Fig. 4 is a schematic perspective view of a light processing device according to an exemplary embodiment.

Fig. 5 is a schematic diagram showing a composition structure of a camera module according to an exemplary embodiment.

Fig. 6 is a schematic diagram showing the composition structure of another camera module according to an exemplary embodiment.

Fig. 7 is a flowchart illustrating a method of taking a picture according to an exemplary embodiment.

Fig. 8 is a block diagram of a hardware architecture of an electronic device, according to an example embodiment.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

Fig. 1 is a schematic view of a light processing device according to an exemplary embodiment, and as shown in fig. 1, the light processing device may include a rotation shaft structure 101, a light deflection assembly 102, and a plurality of light sensors 103.

The light deflection assembly 102 is mounted on the rotating shaft structure 101, the rotation angles of the light deflection assembly 102 are different to form different light transmission paths, and a plurality of light sensors 103 are arranged around the light deflection assembly 102 and are used for receiving emergent light transmitted through different light transmission paths.

Here, the pivot structure is rotatable constructional device, because the light deflection subassembly is installed on pivot structure, in-process that realizes, rotates through the pivot structure, will drive the light deflection subassembly and rotate to have different turned angle, like this, the light deflection subassembly can form different light conduction paths with different photoinductors. In some embodiments, the spindle structure may include one spindle based on which, in the process of implementation, the spindle may rotate in a single plane of rotation. In other embodiments, the rotating shaft structure may include a first rotating shaft and a second rotating shaft, and the rotating plane of the first rotating shaft is perpendicular to the rotating plane of the second rotating shaft, and by setting the first rotating shaft and the second rotating shaft perpendicular to each other, the light deflection assembly can be driven to rotate in the three-dimensional space. In some embodiments, the first shaft may pass through the second shaft. In some embodiments, the spindle structure may comprise an in-line spindle structure, or a sphere spindle structure.

In this embodiment, the light deflection component may be configured to receive the incident light and change the transmission direction of the incident light, and then output the outgoing light, where the incident light may refer to the light transmitted to the light deflection component, and the outgoing light may refer to the light output after the incident light is deflected by the light deflection component. In embodiments of the present disclosure, the light deflecting member may include at least one light guiding surface.

In an example, the at least one light guiding surface may include a light incident surface for receiving incident light and a light emitting surface for outputting outgoing light. Therefore, the incident light can be received through the light incident surface, after the incident light is received based on the light incident surface, the transmission direction of the incident light can be changed based on the light deflection assembly, and then the light with the changed transmission direction, namely the emergent light, is output through the light emergent surface.

For example, in some alternative embodiments, the light deflecting component may be a prism, or other means of changing the direction of propagation of the incident light. Illustratively, in some embodiments, the light deflection assembly may include a triangular prism. Here, the triangular prism is a transparent body having a triangular cross section optically, and is an optical instrument having a triangular cross section made of a transparent material.

Fig. 2 is a schematic cross-sectional structure of a prism according to an exemplary embodiment, and as shown in fig. 2, the prism may include a light incident surface 201, a light reflecting surface 202, and a light emitting surface 203. In the implementation process, the prism-based light incident surface can receive incident light, after receiving the incident light, the prism-based light incident surface reflects the incident light based on reflection, changes the transmission direction of the incident light, and then outputs light with changed transmission direction, namely emergent light, based on the light emergent surface. In some alternative embodiments, the light incident surface of the prism may be perpendicular to the light incident surface, so that when the prism receives the incident light perpendicular to the light incident surface, the incident light is reflected by the light reflecting surface of the prism, and the transmission direction is changed to be perpendicular to the light incident surface of the light sensor, and then the outgoing light is transmitted to the light sensor.

In another example, divided by the principle of light conduction, the at least one light-conducting surface may comprise a light-transmitting surface for transmitting light and/or a light-reflecting surface for reflecting light. In the case where at least one light-transmitting surface includes a light-transmitting surface and a light-reflecting surface, it is possible to transmit incident light onto the light-reflecting surface based on the light-transmitting surface, change the transmission direction of the incident light based on the light-reflecting surface, and output light having the changed transmission direction, that is, outgoing light. In the case where at least one light-guiding surface includes only a reflecting surface for reflecting light, incident light may be received through the reflecting surface, the direction of transmission of the incident light is changed based on the reflecting surface, and the light with the changed direction of transmission, i.e., outgoing light, is output.

For example, the at least one light guiding surface may comprise a reflective surface for reflecting light, such that incident light is received directly based on the reflective surface, the direction of transmission of the incident light is changed based on the reflective surface, and then the light with the changed direction of transmission, i.e. the outgoing light, is outputted. For example, the light deflection assembly may be a mirror, in which case one mirror may be mounted on the shaft structure, and when the shaft structure is rotated to different angles, light is injected from the same light inlet, and the angle of incidence on the mirror up to different angles of rotation is changed, so that the angle of reflection of the light is also changed, on the one hand, deflection of the light transmission angle is achieved by reflection of the light, and on the other hand, different light sensors may be selected to receive the light by such change of the angle of deflection, wherein, in an example, the plurality of light sensors may include at least two image sensors, and different image sensors may be selected to image.

In the embodiment of the disclosure, the rotation of the rotating shaft structure can be controlled, and then the light deflection assembly is driven to rotate through the rotating shaft structure, so that the position of the light emitting surface of the light deflection assembly can be changed. For example, the rotation shaft structure can be controlled to rotate around the rotation shaft parallel to the light emitting surface of the light deflection assembly, so that the position of the light emitting surface of the light deflection assembly can be changed, and different light conduction paths can be formed between the light emitting surface at different positions and the light sensors at different positions. For example, when the light emitting surface of the light deflection assembly is located at the first position, the light emitting surface of the light deflection assembly is aligned with the first light sensor, and when the light emitting surface of the light deflection assembly is changed from the first position to the second position, the light emitting surface of the light deflection assembly is aligned with the second light sensor.

In the embodiment of the disclosure, the plurality of light sensors surround the rotatable light deflection assembly, and each light sensor can share the incident optical system such as the light deflection assembly installed on the rotating shaft structure, so that the number of hardware structures required to be arranged in the light processing system can be reduced, and the volume of the light processing device is further reduced.

In some embodiments, a difference between lengths of the light transmission paths from the light emitting surface of the light deflection component to the light incident surface of each of the light sensors is smaller than a first set length value.

Here, by making the difference between the lengths of the light transmission paths from the light emitting surface of the light deflecting component to the light incident surface of each light sensor smaller than the first set length value, the conditions of the transmission medium and the transmission paths along which the outgoing light passes are completely equivalent, that is, approximately equal, so that the possibility that the loss of the outgoing light in the transmission process is different due to the difference between the transmission medium and the transmission paths can be reduced, and the influence on the brightness and the color of the formed image is also different due to the difference between the loss and the light incident surface of each light sensor.

In some embodiments, the device may further comprise a plurality of lens assemblies, wherein one lens assembly is located between one light sensor and the light deflection assembly, and is used for conducting the emergent light conducted by the light conducting path to the corresponding light sensor.

Alternatively, in some embodiments, the plurality of photo sensors 103 may include at least two image sensors, and the number of the plurality of lens assemblies may be the same as the number of the plurality of photo sensors, i.e., one lens assembly corresponds to one photo sensor 103. For example, fig. 3 is a schematic diagram of a second structure of the light processing device according to an exemplary embodiment, and as shown in fig. 3, taking an example that the light processing device includes four light sensors and four lens assemblies, a first lens assembly 301, a second lens assembly 302, a third lens assembly 303 and a fourth lens assembly 304 are disposed adjacent to the light deflection assembly 102. The first lens assembly 301 is located between the light deflection assembly 102 and the first light sensor 305 and is used for conducting the emergent light conducted by the first light conduction path to the first light sensor 305, the second lens assembly 302 is located between the light deflection assembly 102 and the second light sensor 306 and is used for conducting the emergent light conducted by the second light conduction path to the second light sensor 306, the third lens assembly 303 is located between the light deflection assembly 102 and the third light sensor 307 and is used for conducting the emergent light conducted by the third light conduction path to the third light sensor 307, and the fourth lens assembly 304 is located between the light deflection assembly 102 and the fourth light sensor 308 and is used for conducting the emergent light conducted by the fourth light conduction path to the fourth light sensor 308.

Fig. 4 is a schematic perspective view of a light processing apparatus according to an exemplary embodiment, and as shown in fig. 4, a first lens assembly 301, a second lens assembly 302, a third lens assembly 303, and a fourth lens assembly 304 are disposed adjacent to the light deflection assembly 102. The first lens assembly 301 is located between the light deflection assembly 102 and the first light sensor 305 and is used for conducting light outputted by the first light conduction path to the first light sensor 305, the second lens assembly 302 is located between the light deflection assembly 102 and the second light sensor 306 and is used for conducting light outputted by the second light conduction path to the second light sensor 306, the third lens assembly 303 is located between the light deflection assembly 102 and the third light sensor 307 and is used for conducting light outputted by the third light conduction path to the third light sensor 307, and the fourth lens assembly 304 is located between the light deflection assembly 102 and the fourth light sensor 308 and is used for conducting light outputted by the fourth light conduction path to the fourth light sensor 308.

Because the camera modules are arranged in the camera module and a plurality of independent camera modules are arranged on the shell of the electronic equipment, when the function of optical zooming or image fusion is realized through the switching among the plurality of camera modules, a plurality of holes are also required to be arranged on the shell of the electronic equipment for each camera module, and because the camera modules are independent relatively, larger deviation exists when the optical zooming or image fusion is realized, and the image quality is influenced.

In this embodiment of the disclosure, a plurality of lens modules and a light sensor may share a light deflection assembly, so that only an opening for light input needs to be opened on an electronic device, and outgoing lights received by each lens module and the light sensor are all input through the light deflection assembly, so that the possibility that deviation exists in optical zooming or image fusion due to different outgoing lights received by each lens module and the light sensor can be reduced, and further, the image quality is improved.

Optionally, in some embodiments, the plurality of photosensors 103 may comprise at least one image sensor and at least one photosensor, which may comprise an ambient light sensor and/or a distance sensor. In this embodiment scenario, the number of lens components is the same as the number of image sensors, i.e., one lens component corresponds to one image sensor. It can be understood that, under the condition that the photoelectric sensor is required to be used, the incident light is deflected to the corresponding rotation angle by the light deflection component to obtain the corresponding light conduction path, and the incident light is conducted and output by the corresponding light conduction path, so that the incident light can be directly transmitted to the photoelectric sensor without being conducted by the lens component.

In some embodiments, the maximum focal length of the lens assembly is different from one lens assembly to another. Here, because the maximum focal lengths of the different lens assemblies in the embodiment of the disclosure are different, in the process of capturing an image, the optical zoom can be realized by rotating the rotation angle of the light deflection assembly, and compared with the zoom realized by switching among a plurality of mutually independent camera modules, in the embodiment of the disclosure, since the emergent light received by each lens assembly is the same, the deviation caused by the attribute difference between the external environment or hardware can be reduced, so that the smooth zoom is realized.

In some embodiments, the intersection of the lens optical axes of each of the lens assemblies coincides with the center of the light ray deflection assembly. Thus, the rotatable light deflection assembly can be arranged at the center of the plurality of light sensors. In the embodiment of the disclosure, the intersection point of the lens optical axes of the lens assemblies is overlapped with the center of the light deflection assembly, so that the lens assemblies and the light deflection assemblies are located on the same horizontal plane, and the possibility of poor image quality of the finally acquired image due to the position deviation of the light deflection assemblies or the lens assemblies can be reduced.

In some embodiments, a difference between an intersection point coordinate value of a position where an intersection point of the lens optical axes of the lens assembly is located and a center coordinate value of a position where a center of the light deflection assembly is located is smaller than a set threshold. Here, the set threshold value may be 2 mm, 1 mm, or the like. In the embodiment of the disclosure, as long as the difference between the intersection point coordinate value and the center coordinate value is smaller than the set threshold value, it may be determined that the intersection point of the lens optical axis of the lens assembly coincides with the center of the light deflection assembly.

In some embodiments, the difference between the lengths of the light transmission paths from the light exit surface of the light deflecting component to the light entrance surface of each lens component is smaller than the second set length value. For example, the lengths of the light conduction paths from the light emitting surface of the light deflection assembly to the light incident surface of each lens assembly are equal. In some embodiments, the second set length value may be empirically derived or experimentally derived, e.g., the second set length value may be less than or equal to 0.8 millimeters. For another example, the second set length value may be 0.5 mm, 0.01 mm, etc.

In some embodiments, the device may further include a driving component connected to the rotating shaft structure, and configured to drive the rotating shaft structure to rotate so as to drive the light deflection component to rotate around at least one rotation axis, where the rotation axis is perpendicular to the lens optical axis of the lens component.

In some alternative embodiments, the drive assembly may be an assembly having a rotor, wherein the rotor is a rotating body capable of rotating the light deflection assembly. In some embodiments, the drive assembly may be comprised of a drive motor, e.g., a linear motor, a rotor motor, etc.

In some embodiments, the light deflection assembly may be driven to rotate around at least two rotation axes based on the driving assembly, and in order to enable the driving assembly to drive the light deflection assembly to rotate around at least two rotation axes, at least two rotors with different rotation directions may be arranged inside the driving assembly. For example, if the light deflecting member is to be driven to rotate about a first rotation axis and a second rotation axis which are perpendicular to each other, a first rotor and a second rotor whose rotation directions are perpendicular to each other may be provided. And under the condition that at least two rotors with different rotation directions are arranged in the driving assembly, the light deflection assembly further comprises at least two rotating shaft structures for bearing the rotors, and the rotating shaft structures are fixedly connected with the at least two rotors respectively.

In some alternative embodiments, the driving assembly may also be a driving device formed by a magnetic attraction structure, where the driving device includes a carrier, a base, a reed, and a circuit board, where the carrier is used to carry the light deflection assembly and is rotatably connected to the base through the reed, the circuit board is mounted on the base and provided with a bottom coil and a side coil, the bottom of the carrier is provided with a bottom magnet corresponding to the bottom coil, the side of the carrier is provided with a side magnet corresponding to the side coil, the bottom coil cooperates with the bottom magnet and the side coil cooperates with the side magnet, and the light deflection assembly is driven to rotate relative to the base around two rotation axes, for example, the light deflection assembly is driven to rotate around two rotation axes perpendicular to each other.

It will be appreciated that in some alternative embodiments, the driving assembly may be configured in different forms of driving device or combinations of structures, for example, in one implementation, the driving assembly may include a first assembly and a second assembly, where the first assembly and the second assembly are capable of driving the light deflecting assembly to rotate about at least one rotation axis, respectively, and to inhibit mutual interference between the first assembly and the second assembly, where the rotation axes about which the first assembly and the second assembly are driven are different, the first assembly may be an assembly including a rotor, and the second assembly may be a driving device formed by a magnetic attraction structure.

In the embodiment of the disclosure, the driving assembly connected with the rotating shaft structure is arranged in the light processing device, and in the process of collecting light, the rotating and drawing structure can be driven to rotate based on the driving assembly to drive the light deflection assembly to rotate, so that the light emitting surface of the light deflection assembly can respectively form different light conduction paths with each light sensor under the condition of different rotation angles, and the emitted light is conducted to different light sensors through different light conduction paths without adding additional hardware support.

Fig. 5 is a schematic view illustrating a composition structure of a camera module according to an exemplary embodiment, and as shown in fig. 5, the camera module according to the embodiment of the present disclosure may include:

A light collecting component 401, configured to collect reflected light of a shooting object, and transmit the reflected light as incident light to the light processing device 402 described in any of the above embodiments;

the light processing device 402 is configured to receive the incident light output by the light collecting component and form an image based on the incident light.

In some embodiments, the camera module includes a light collecting component for directing the received light vertically to the light incident surface of the light deflecting component. Here, the light collecting member may be a transmission mirror having a light receiving function. Fig. 6 is a schematic diagram of a composition structure of another camera module according to an exemplary embodiment, as shown in fig. 6, a light emitting surface of the light collecting component 401 is opposite to a light incident surface of the light deflecting component of the light processing device 402, and the light emitting surface of the light collecting component 401 is parallel to the light incident surface of the light deflecting component.

In some embodiments, the light deflection assembly may further have an optical anti-shake function, that is, when focusing is performed on a subject, the optical anti-shake function is started, and when collecting reflected light of the subject, unstable light input caused by shake can be avoided.

In some embodiments, the electronic device comprises a camera module as in any of the embodiments above.

In the embodiment of the disclosure, the camera module may be disposed in an electronic device, where the electronic device may include a mobile terminal and a fixed terminal. The mobile terminal may include a mobile phone, a notebook computer, a tablet computer, a wearable electronic device, etc., and the fixed terminal may include a personal computer device, a monitoring device, a medical device, etc. The electronic device related to the embodiment of the disclosure comprises a display module, wherein the display module can be a display screen of the electronic device. For example, the setting interface may be displayed based on a display screen of the electronic device.

Fig. 7 is a flowchart illustrating an image capturing method according to an exemplary embodiment, and as shown in fig. 7, the method is applied to the electronic device provided in the above embodiment, and mainly includes the following steps:

In step 701, a first input is received;

in step 702, a target light sensor is determined in response to the first input;

In step 703, a target image of the photographic subject is generated based on the target photo sensor.

In one embodiment, the first input may be a focusing operation for the electronic device, such as a click or press operation of a photographing button of the electronic device, and the first input is generated in response to the focusing operation. For example, the first input may be a touch input by a user in a view screen on a display interface of the electronic device, where the touch input may be input based on a touch module of the electronic device. By way of example, the touch input may include a click input, a slide select input, etc., wherein the click input may include a single click input, a double click input, a press input, etc.

In the embodiment of the disclosure, the target light sensor may be determined based on the first input, and a target image of the shooting object may be generated based on the target light sensor. Here, the target photo sensor is at least one of a plurality of photo sensors. When the target light sensor is one of the plurality of light sensors, an image formed by the target light sensor can be directly determined as a target image, and when the target light sensor is at least two of the plurality of light sensors, fusion processing can be performed on at least two images acquired by the at least two light sensors to obtain the target image.

In one embodiment, the first input may also be a user input that determines the acquisition object. The electronic device can estimate the expected focal length for image acquisition of the acquisition object according to the current focal length and the current previewed image. The photo sensor that can provide the desired focal length is then selected as the target photo sensor based on the acquisition focal length that the photo sensor can provide.

In some embodiments, the target light sensor comprises at least a first light sensor and a second light sensor, wherein the light sampling categories of the first light sensor and the second light sensor are different;

the generating a target image of the shooting object based on the target photo sensor may include:

receiving a second input;

Here, the second input may be an image capturing operation for the electronic device, such as a click or press operation of a capturing button of the electronic device, in response to which the second input is generated. For example, the second input may be a touch input by a user in a view on a display interface of the electronic device, where the touch input may be input based on a touch module of the electronic device. By way of example, the touch input may include a click input, a slide select input, etc., wherein the click input may include a single click input, a double click input, a press input, etc.

In some embodiments, the light sensor may include a color image sensor and a black and white image sensor.

In the embodiment of the disclosure, the fusion processing of images formed by different types of photo sensors can be realized through the collocation of different photo sensors, for example, images formed by a color image sensor and a black-and-white image sensor can be fused, so that the fusion precision is ensured while the image quality of the images is improved, and the pixel level alignment is realized through sharing a front-stage optical system, thereby providing a guarantee for the accuracy of a fusion algorithm.

In some embodiments, the first image and the second image may be fused by a preset image processing algorithm, for example, an average value of pixel values at corresponding positions in the first image and the second image may be taken to obtain a target pixel value, and the target image is obtained based on the target pixel value. In other embodiments, the pixel values of the corresponding positions in the first image and the second image may be weighted and summed to obtain the target pixel value, and the target image may be obtained based on the target pixel value.

In some embodiments, the determining a target light sensor in response to the first input may include:

A light sensor corresponding to a target lens assembly having the desired acquisition parameters is determined as the target light sensor, the target lens assembly being at least one of a plurality of lens assemblies, the desired acquisition parameters may include an acquisition focal length.

In the embodiment of the disclosure, through the collocation of different lens groups, the front-section incident optical system is shared, and the target light sensor with the set focal length is determined through collecting the focal length, the smooth optical zooming can be realized, and the problems of optical axis deviation and multi-module assembly alignment of multi-camera module switching are eliminated.

In some embodiments, the acquisition parameters may also include acquisition viewing angle.

In some embodiments, the electronic device may estimate a desired acquisition view angle for image acquisition of the acquisition object based on the current acquisition view angle and the current preview image. The light sensor that can provide the desired acquisition viewing angle is then selected as the target light sensor, depending on the viewing angle that the light sensor can provide. In this way, not only smooth zooming between the respective lens components but also switching of the angle of view can be achieved, for example, switching from a lens component other than a wide angle to a wide angle lens component or the like can be achieved.

In some embodiments, the method may further include driving the light deflection assembly to rotate to a predetermined angle, driving the light deflection assembly to transmit incident light to the target light sensor. In some embodiments, the target light sensor may include at least one image sensor and at least one photosensor, which may include an ambient light sensor and/or a distance sensor. In this embodiment scenario, the number of lens components is the same as the number of image sensors, i.e., one lens component corresponds to one image sensor. It can be understood that, under the condition that the photoelectric sensor is required to be used, the incident light is deflected to the corresponding rotation angle by the light deflection component to obtain the corresponding light conduction path, and the incident light is conducted and output by the corresponding light conduction path, so that the incident light can be directly transmitted to the photoelectric sensor without being conducted by the lens component.

In some embodiments, incident light is perpendicularly incident to a light deflection assembly (e.g., prism, mirror) via a light receiving mirror, and light is incident to a lens assembly (lens group) via a prism, with a drive assembly (motor) driving the prism in rotation. For example, the prism is located at position 1, the light is reflected by the prism to the lens group 1 and finally is incident on the light sensor 1 corresponding to the lens group 1, the prism is located at position 2, the light is reflected by the prism to the lens group 2 and finally is incident on the light sensor 2 corresponding to the lens group 2, the prism is located at position 3, the light is reflected by the prism to the lens group 3 and finally is incident on the light sensor 3 corresponding to the lens group 3, the light is located at position 4, the light is reflected by the prism to the lens group 4 and finally is incident on the light sensor 4 corresponding to the lens group 4. Thus, through the rotation of the prism, the real-time switching of the wheel disc type imaging system is realized. In some embodiments, the focus and anti-shake functions may be designed as desired, e.g., they may be designed in the lens section, or they may be designed in the lens group section.

In the embodiment of the disclosure, smooth optical zooming can be realized by matching different lens groups and sharing a front-stage incident optical system, the problems of optical axis deviation and multi-module assembly alignment of multi-camera module switching are solved, fusion processing of images formed by different types of photo sensors can be realized by matching different photo sensors, for example, images formed by a color image sensor and a black-and-white image sensor can be fused, thus, the fusion precision is ensured while the image quality is improved, pixel level alignment is realized by sharing a front-stage optical system, the accuracy of a fusion algorithm is ensured, the rapid rotation of a prism is controlled by matching the same type of photo sensors, lossless multi-frame fusion of images can be realized, and the super-resolution can be improved by matching the same photo sensors and rapid rotation of the prism.

In the embodiment of the disclosure, smooth zooming and pixel level alignment image fusion can be realized through the design of a co-incident optical system, the functions of image lossless multi-frame fusion, super resolution and the like are realized through the rapid rotation of a prism (reflective mirror), focusing and anti-shake functions can be realized at a light receiving lens part or a lens group part according to the use requirement, the collocation between the lens group part and a light sensor can be adjusted according to the requirement, the mode is flexible, the functions are various, and the collocation effect of the rear end is far superior to that of a conventional multi-mode group switching scheme due to the design of the co-incident optical system.

In some embodiments, the number of lens assemblies and photosensors may be increased as desired, such as providing 6 sets of lens assemblies and photosensors, or 8 sets of lens assemblies and photosensors, etc.

The image capturing method according to the embodiments of the present disclosure may be further understood with reference to the foregoing description of the light processing device and the camera module.

Fig. 8 is a block diagram of a hardware architecture of an electronic device, according to an example embodiment. For example, electronic device 500 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, or the like.

Referring to FIG. 8, an electronic device 500 may include one or more of a processing component 502, a memory 504, a power component 506, a multimedia component 508, an audio component 510, an input/output (I/O) interface 512, a sensor component 514, and a communication component 516.

The processing component 502 generally controls overall operation of the electronic device 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 502 may include one or more processors 520 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 502 can include one or more modules that facilitate interactions between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.

The memory 504 is configured to store various types of data to support operations at the electronic device 500. Examples of such data include instructions for any application or method operating on the electronic device 500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 504 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power component 506 provides power to the various components of the electronic device 500. The power components 506 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 500.

The multimedia component 508 includes a screen between the electronic device 500 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front-facing camera and/or a rear-facing camera. When the electronic device 500 is in an operational mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 510 is configured to output and/or input audio signals. For example, the audio component 510 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 500 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 504 or transmitted via the communication component 516. In some embodiments, the audio component 510 further comprises a speaker for outputting audio signals.

The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, a home button, a volume button, an activate button, and a lock button.

The sensor assembly 514 includes one or more sensors for providing status assessment of various aspects of the electronic device 500. For example, the sensor assembly 514 may detect an on/off state of the electronic device 500, a relative positioning of components such as a display and keypad of the electronic device 500, a change in position of the electronic device 500 or a component of the electronic device 500, the presence or absence of a user's contact with the electronic device 500, an orientation or acceleration/deceleration of the electronic device 500, and a change in temperature of the electronic device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 516 is configured to facilitate communication between the electronic device 500 and other devices, either wired or wireless. The electronic device 500 may access a wireless network based on a communication standard, such as WI-FI,2G, or 6G, or a combination thereof. In one exemplary embodiment, the communication component 516 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 504, including instructions executable by processor 520 of electronic device 500 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

A non-transitory computer readable storage medium, which when executed by a processor of an electronic device, enables the electronic device to perform an image capturing method, may include:

receiving a first input;

Determining a target light sensor in response to the first input;

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1.A light processing device, the device comprising:

The rotating shaft structure comprises a first rotating shaft and a second rotating shaft, wherein the rotating plane of the first rotating shaft is perpendicular to the rotating plane of the second rotating shaft;

2. The light processing device of claim 1, wherein the device further comprises:

3. The light processing device of claim 2, wherein the device further comprises:

the driving assembly is connected with the rotating shaft structure and is used for driving the rotating shaft structure to rotate and driving the light deflection assembly to rotate around at least one rotating shaft, and the rotating shaft is perpendicular to a lens optical axis of the lens assembly.

4. A light processing device as recited in claim 2, wherein the maximum focal length of the lens assembly differs from one lens assembly to another.

5. A light processing device as recited in claim 2, wherein an intersection of lens optical axes of each of said lens assemblies coincides with a center of said light ray deflection assembly.

6. The device of claim 1, wherein a difference in length of each light transmission path between the light exit surface of the light deflecting element and the light entrance surface of each light sensor is less than a set length value.

7. The apparatus of claim 1 wherein the light deflection assembly is a triangular prism.

8. A camera module, the camera module comprising:

a light collecting assembly for collecting reflected light of a photographic subject and transmitting the reflected light as incident light to the light processing device of any one of claims 1 to 7;

9. An electronic device in which the camera module of claim 8 is mounted.