CN113965668A

CN113965668A - Optical processing device, camera module, electronic apparatus, photographing method, and storage medium

Info

Publication number: CN113965668A
Application number: CN202010637064.8A
Authority: CN
Inventors: 尹志东; 杨宗保; 王辉
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2020-07-03
Filing date: 2020-07-03
Publication date: 2022-01-21

Abstract

The present disclosure relates to an optical processing apparatus, a camera module, an electronic device, a photographing method, and a storage medium. The light processing apparatus includes: a rotating shaft structure; the light deflection assembly is arranged on the rotating shaft structure, and different light conduction paths are formed by different rotating angles of the light deflection assembly; a plurality of light sensors disposed around the light deflection assembly for receiving outgoing light conducted through different light conduction paths. In this way, by surrounding the plurality of light sensors with the rotatable light beam deflecting unit, the respective light sensors can share the incident optical system such as the light beam deflecting unit mounted on the rotary shaft structure, and the number of hardware structures to be provided in the light processing system can be reduced, thereby reducing the size of the light processing apparatus.

Description

Optical processing device, camera module, electronic apparatus, photographing method, and storage medium

Technical Field

The present disclosure relates to camera light path processing technologies, and in particular, to an optical processing device, a camera module, an electronic apparatus, a shooting method, and a storage medium.

Background

At present, in order to implement optical zooming or image fusion of a camera, a plurality of mutually independent camera modules are arranged in a camera module, and the function of optical zooming or image fusion is implemented through switching among the camera modules. For example, switching from a main-shooting lens to a telephoto lens, or switching from a color camera module to a black-and-white camera module. Therefore, the number of camera modules in the camera module is too large, and the volume of the camera module is increased.

Disclosure of Invention

The present disclosure provides an optical processing apparatus, a camera module, an electronic device, a photographing method, and a storage medium.

According to a first aspect of embodiments of the present disclosure, there is provided a light processing apparatus, the apparatus comprising:

a rotating shaft structure;

the light deflection assembly is arranged on the rotating shaft structure, and different light conduction paths are formed by different rotating angles of the light deflection assembly;

a plurality of light sensors disposed around the light deflection assembly for receiving outgoing light conducted through different light conduction paths.

Optionally, the apparatus further comprises:

a plurality of lens assemblies; the lens assembly is located between one light sensor and the light deflection assembly and used for conducting the emergent light conducted by the light conduction path to the corresponding light sensor.

Optionally, the apparatus further comprises:

the driving assembly is connected with the rotating shaft structure and used for driving the rotating shaft structure to rotate so as to drive the light deflection assembly to rotate around at least one rotating shaft; the rotating shaft is perpendicular to a lens optical axis of the lens assembly.

Optionally, the maximum focal length of different lens assemblies is different.

Optionally, an intersection point of lens optical axes of the lens assemblies coincides with the center of the light deflection assembly.

Optionally, a difference between lengths of light transmission paths from the light emitting surface of the light deflection assembly to the light incident surfaces of the light sensors is smaller than a set length value.

Optionally, the light deflecting assembly is: a triangular prism.

According to a second aspect of the embodiments of the present disclosure, there is provided a camera module including:

a light collection assembly for collecting reflected light of a photographic subject and transmitting the reflected light as incident light to the light processing device of any of the first aspects;

the light processing device is used for receiving the incident light output by the light collecting assembly and forming an image based on the incident light.

According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus in which the camera module according to the second aspect is mounted.

According to a fourth aspect of the embodiments of the present disclosure, there is provided an image capturing method applied to the electronic device of the third aspect, the method including:

receiving a first input;

determining a target light sensor in response to the first input;

and generating a target image of the shooting object based on the target light sensor.

Optionally, the target light sensor at least includes: a first light sensor and a second light sensor, the first light sensor and the second light sensor having different light sampling categories;

the generating of the target image of the shooting object based on the target light sensor comprises:

receiving a second input;

acquiring, in response to the second input, a first image formed by the first light sensor and a second image formed by the second light sensor;

and fusing the first image and the second image to obtain a fused image of the shot object.

Optionally, the determining a target light sensor in response to the first input includes:

in response to the first input, determining a desired acquisition parameter of an image to be acquired;

determining a light sensor corresponding to the target lens component with the desired acquisition parameters as the target light sensor; the target lens component is at least one of a plurality of lens components;

the desired acquisition parameters include: and collecting the focal distance.

Optionally, the method further includes:

and driving the light deflection assembly to rotate to a preset angle, and driving the light deflection assembly to transmit incident light to the target light sensor.

According to a fifth aspect of embodiments of the present disclosure, there is provided an electronic apparatus including:

a processor;

a memory configured to store processor-executable instructions;

wherein the processor is configured to: when executed, implement the steps of any of the image capture methods of the fourth aspect.

According to a sixth aspect of embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the steps of any one of the image capturing methods of the fourth aspect.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

it can be known from the above embodiments that the optical processing apparatus in the present disclosure is provided with the rotating shaft structure, and the light deflection module is installed on the rotating shaft structure, in the process of image capturing, the rotating shaft structure can be controlled to rotate to drive the light deflection module to rotate, and when the rotation angle of the light deflection module is different, the formed light conduction paths can be different, and because the plurality of photo sensors are arranged around the light deflection module, the different photo sensors can receive the emergent light conducted through the different light conduction paths.

In this way, by surrounding the plurality of light sensors with the rotatable light beam deflecting unit, the respective light sensors can share the incident optical system such as the light beam deflecting unit mounted on the rotary shaft structure, and the number of hardware structures to be provided in the light processing system can be reduced, thereby reducing the size of the light processing apparatus.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a first schematic structural diagram of a light processing device according to an exemplary embodiment.

Fig. 2 is a schematic cross-sectional structure of a triangular prism shown in accordance with an exemplary embodiment.

Fig. 3 is a schematic structural diagram ii of a light processing apparatus according to an exemplary embodiment.

Fig. 4 is a schematic perspective view of a light processing device according to an exemplary embodiment.

Fig. 5 is a schematic diagram illustrating a structure of a camera module according to an exemplary embodiment.

Fig. 6 is a schematic diagram illustrating a structure of another camera module according to an exemplary embodiment.

Fig. 7 is a flowchart illustrating a method of capturing a photographic image according to an exemplary embodiment.

Fig. 8 is a block diagram illustrating a hardware configuration of an electronic device according to an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

Fig. 1 is a schematic structural diagram of an optical processing apparatus according to an exemplary embodiment, where as shown in fig. 1, the optical processing apparatus may include: a rotating shaft structure 101, a light beam deflection assembly 102 and a plurality of light sensors 103.

The light deflection assembly 102 is mounted on the rotating shaft structure 101, and the rotating angles of the light deflection assembly 102 are different to form different light conduction paths; a plurality of photo-sensors 103 are arranged around the light deflection assembly 102 for receiving outgoing light conducted via different of the light conducting paths.

Here, the pivot structure is the structural device that can rotate, because the light deflects the subassembly and installs in the pivot structure, at the in-process of realizing, rotates through the pivot structure, will drive the rotation of light deflection subassembly to have different turned angles, like this, the light deflection subassembly can form different light conduction paths with different photo-sensors. In some embodiments, the hinge structure may include one hinge, upon which it may be rotated in a single plane of rotation during implementation. In other embodiments, the hinge structure may include: the light deflection component comprises a first rotating shaft and a second rotating shaft, wherein the rotating plane of the first rotating shaft is perpendicular to the rotating plane of the second rotating shaft, and the light deflection component can be driven to rotate in a three-dimensional space through the first rotating shaft and the second rotating shaft which are perpendicular to each other. In some embodiments, the first shaft may pass through the second shaft. In some embodiments, the hinge structure may include: a straight-line type rotating shaft structure or a spherical rotating shaft structure.

In this embodiment, the light deflection assembly can be used for receiving incident light and changing the conduction direction of incident light, then outputs emergent light, and here, the incident light can refer to the light that transmits to the light deflection assembly, and the emergent light can refer to the light that the incident light deflected the back output through the light deflection assembly. In the embodiment of the present disclosure, the light deflecting element may include at least one light transmitting surface.

In one example, the at least one light-transmitting surface is divided in such a manner that light is incident and emitted, and may include: the light source comprises a light incident surface for receiving incident light and a light emergent surface for outputting emergent light. Therefore, incident light can be received through the light incident surface, after the incident light is received based on the light incident surface, the transmission direction of the incident light can be changed based on the light deflection assembly, and then the light with the changed transmission direction, namely emergent light, is output through the light emergent surface.

For example, in some alternative embodiments, the light deflecting component may be a prism or other device that changes the direction of the incident light. For example, in some embodiments, the light deflecting assembly may include: a triangular prism. Here, the prism is a transparent body having a triangular optical cross section, and is an optical instrument having a triangular cross section and made of a transparent material.

Fig. 2 is a schematic cross-sectional structure diagram of a prism according to an exemplary embodiment, and as shown in fig. 2, the prism may include a light incident surface 201, a light reflecting surface 202, and a light emitting surface 203. In the implementation process, the incident light can be received based on the light incident surface of the prism, after the incident light is received, the incident light is reflected based on the light reflecting surface, the transmission direction of the incident light is changed, and then the light with the changed transmission direction, namely the emergent light, is output based on the light emitting surface. In some optional embodiments, the light incident surface of the prism may be perpendicular to the light exit surface, so that when the prism receives incident light perpendicular to the light incident surface, after the incident light is reflected by the light reflecting surface of the prism, the transmission direction may be changed to be perpendicular to the light incident surface of the light sensor, and at this time, the emergent light may be transmitted to the light sensor.

In another example, divided by the principle of light conduction, the at least one light-conducting face may include: a light-transmitting surface for transmitting light, and/or a light-reflecting surface for reflecting light. In the case where the at least one light transmitting surface includes a light transmitting surface and a light reflecting surface, it is possible to transmit incident light onto the light reflecting surface based on the light transmitting surface, change the transmission direction of the incident light based on the light reflecting surface, and output light whose transmission direction is changed, that is, outgoing light. In the case where at least one light transmitting surface includes only a light reflecting surface for reflecting light, incident light may be received by the light reflecting surface, a transmission direction of the incident light is changed based on the light reflecting surface, and light whose transmission direction is changed, that is, outgoing light, is output.

For example, the at least one light-conducting surface may comprise: and a reflection surface for reflecting light, so that incident light can be directly received based on the reflection surface, the conduction direction of the incident light is changed based on the reflection surface, and then the light with the changed conduction direction, that is, emergent light, is output. For example, the light deflecting component may be a mirror; in this example, a reflective mirror may be mounted on the rotating shaft structure, and when the rotating shaft structure rotates to different angles, light is incident from the same light incident port, and incident angles on the reflective mirror at different rotating angles change, so that a reflection angle of the light also changes, on one hand, deflection of a light transmission angle is realized through reflection of the light, and on the other hand, different light sensors may be selected to receive the light through change of the deflection angle; wherein, for example, the plurality of photo sensors may include at least two image sensors, different image sensors may be selected for imaging.

In the embodiment of the disclosure, the rotation of the rotating shaft structure can be controlled, and then the light deflection assembly is driven to rotate through the rotating shaft structure, so that the position of the light emergent surface of the light deflection assembly can be changed. For example, the rotation axis structure may be controlled to rotate around a rotation axis parallel to the light exit surface of the light deflection assembly, so that the position of the light exit surface of the light deflection assembly may be changed, and thus, different light transmission paths may be formed between the light exit surfaces at different positions and the light sensors at different positions. For example, when the light emitting surface of the light deflection assembly is located at the first position, the light emitting surface of the light deflection assembly is aligned with the first light sensor; when the light-emitting surface of the light deflection assembly changes from the first position to the second position, the light-emitting surface of the light deflection assembly can be aligned with the second light sensor.

In the embodiment of the present disclosure, by surrounding the rotatable light deflecting element with a plurality of light sensors, each of the light sensors can share the incident optical system such as the light deflecting element mounted on the rotating shaft structure, and the number of hardware structures required to be provided in the light processing system can be reduced, thereby reducing the size of the light processing apparatus.

In some embodiments, a difference in length between light transmission paths from the light exit surface of the light deflection assembly to the light incident surfaces of the light sensors is smaller than a first predetermined length.

Here, by making the length difference of each light conduction path between the light emitting surface of the light deflection assembly and the light incident surface of each light sensor smaller than the first set length value, the conditions of the transmission medium and the transmission path through which the emergent light passes can be completely equivalent, namely approximately equal, thus, the possibility that the loss of the emergent light is different in the transmission process due to the difference of the transmission medium and the transmission path can be reduced, because the influence on the brightness and color of the formed image is different under the condition of different loss, when the light sensor is used for forming the image based on the emergent light, the problem of the deviation between the brightness and the color of the image formed by each light sensor can be reduced by the technical scheme in the embodiment of the disclosure.

In some embodiments, the apparatus may further comprise: a plurality of lens assemblies; the lens assembly is located between one light sensor and the light deflection assembly and used for conducting the emergent light conducted by the light conduction path to the corresponding light sensor.

Optionally, in some embodiments, the plurality of light sensors 103 may include at least two image sensors, and the number of the plurality of lens assemblies may be the same as the number of the plurality of light sensors, i.e., one lens assembly corresponds to one light sensor 103. For example, fig. 3 is a schematic structural diagram of a second optical processing device according to an exemplary embodiment, as shown in fig. 3, taking the example that the optical processing device includes four optical sensors and four lens assemblies, a first lens assembly 301, a second lens assembly 302, a third lens assembly 303, and a fourth lens assembly 304 are disposed adjacent to the light deflecting assembly 102. The first lens assembly 301 is located between the light deflection assembly 102 and the first light sensor 305, and is configured to conduct the outgoing light conducted by the first light conduction path to the first light sensor 305; the second lens assembly 302 is disposed between the light deflection assembly 102 and the second photo-sensor 306, and is configured to conduct the outgoing light conducted by the second light conduction path to the second photo-sensor 306; the third lens assembly 303 is located between the light beam deflection assembly 102 and the third light sensor 307, and is configured to conduct the outgoing light conducted by the third light conduction path to the third light sensor 307; the fourth lens assembly 304 is disposed between the light deflecting assembly 102 and the fourth light sensor 308, and is configured to conduct the outgoing light conducted by the fourth light conduction path to the fourth light sensor 308.

Fig. 4 is a schematic perspective view illustrating a light processing apparatus according to an exemplary embodiment, and as shown in fig. 4, a first lens assembly 301, a second lens assembly 302, a third lens assembly 303, and a fourth lens assembly 304 are disposed adjacent to the light deflecting assembly 102. The first lens assembly 301 is located between the light deflection assembly 102 and the first light sensor 305, and is configured to guide light output by the first light conduction path to the first light sensor 305; the second lens assembly 302 is disposed between the light deflecting assembly 102 and the second light sensor 306, and is configured to guide the light output from the second light conduction path to the second light sensor 306; the third lens assembly 303 is disposed between the light deflecting assembly 102 and the third light sensor 307, and is configured to guide the light output from the third light conduction path to the third light sensor 307; the fourth lens assembly 304 is disposed between the light deflecting assembly 102 and the fourth light sensor 308, and is configured to guide light output by the fourth light conduction path to the fourth light sensor 308.

Because a plurality of mutually independent camera modules are arranged in the camera module, and when the function of optical zooming or image fusion is realized by switching among the camera modules, a plurality of holes are required to be formed in the shell of the electronic equipment for each camera module; and because each camera module is relatively independent, when optical zooming or image fusion is realized, large deviation exists, and the image quality is influenced.

In the embodiment of the disclosure, a plurality of lens modules and a light sensor can share one light deflection assembly, so that only one opening for light input needs to be formed in an electronic device, and emergent light received by each lens module and the light sensor is input through one light deflection assembly, so that the possibility of deviation in optical zooming or image fusion due to different emergent light received by each lens module and the light sensor can be reduced, and the image quality is improved.

Optionally, in some embodiments, the plurality of light sensors 103 may include at least one image sensor and at least one photosensor, which may include an ambient light sensor and/or a distance sensor. In this embodiment scenario, the number of the plurality of lens assemblies is the same as the number of the image sensors, i.e., one lens assembly corresponds to one image sensor. It can be understood that, under the condition that the photoelectric sensor is needed, the light beam deflection assembly deflects to the corresponding rotation angle to obtain the corresponding light conduction path, and the incident light is directly transmitted to the photoelectric sensor without being transmitted through the lens assembly through the outgoing light which is transmitted and output through the corresponding light conduction path.

In some embodiments, the maximum focal length of different said lens assemblies is different. Here, since the maximum focal lengths of different lens assemblies in the embodiment of the present disclosure are different, in the process of image capturing, optical zooming may be achieved by rotating the rotation angle of the light deflection assembly, and compared with zooming achieved by switching between a plurality of camera modules that are independent of each other, in the embodiment of the present disclosure, since the emergent light received by each lens assembly is the same, it is possible to reduce deviation caused by attribute differences between external environments or hardware, so as to achieve smooth zooming.

In some embodiments, the intersection of the lens optical axes of the respective lens assemblies coincides with the center of the light deflecting assembly. Thus, the rotatable light deflecting assembly can be disposed at the center of the plurality of light sensors. In the embodiment of the disclosure, by making the intersection point of the lens optical axes of the lens assemblies coincide with the center of the light deflection assembly, it can be ensured that the lens assemblies and the light deflection assembly are located on the same horizontal plane, and thus, the possibility of poor image quality of the finally acquired image due to the position deviation of the light deflection assembly or the lens assembly can be reduced.

In some embodiments, a difference between an intersection coordinate value of a position where an intersection of lens optical axes of the lens assembly is located and a center coordinate value of a position where a center of the light deflecting assembly is located is smaller than a set threshold. Here, the set threshold may be 2 mm, 1 mm, or the like. In the embodiment of the present disclosure, as long as the difference between the intersection coordinate value and the center coordinate value is smaller than the set threshold, it may be determined that the intersection point of the lens optical axis of the lens assembly coincides with the center of the light deflection assembly.

In some embodiments, a difference between lengths of the light conducting paths from the light emitting surface of the light deflection assembly to the light incident surface of each lens assembly is smaller than a second set length value. For example, the light-transmitting paths from the light-emitting surface of the light deflection assembly to the light-entering surface of each lens assembly have the same length. In some embodiments, the second set length value may be empirically or experimentally derived, for example, the second set length value may be less than or equal to 0.8 millimeters. For another example, the second set length value may be 0.5 mm, 0.01 mm, or the like.

In some embodiments, the apparatus may further comprise: the driving assembly is connected with the rotating shaft structure and used for driving the rotating shaft structure to rotate so as to drive the light deflection assembly to rotate around at least one rotating shaft; the rotating shaft is perpendicular to a lens optical axis of the lens assembly.

In some alternative embodiments, the driving assembly may be an assembly having a rotor, wherein the rotor is a rotating body capable of rotating the light beam deflecting assembly. In some embodiments, the drive assembly may be constituted by a drive motor, for example, a linear motor, a rotary motor, or the like.

In some embodiments, the light deflecting assembly may be driven to rotate around at least two rotation axes based on the driving assembly, and in order to enable the driving assembly to drive the light deflecting assembly to rotate around at least two rotation axes, at least two rotors with different rotation directions may be disposed inside the driving assembly. For example, if the light deflecting element is to be driven to rotate about a first rotational axis and a second rotational axis perpendicular to each other, a first rotor and a second rotor having rotational directions perpendicular to each other may be provided. Under the condition that at least two rotors with different rotating directions are arranged in the driving assembly, the light deflection assembly further comprises at least two rotating shaft structures used for bearing the rotors, and the rotating shaft structures are fixedly connected with the at least two rotors respectively.

In some alternative embodiments, the driving assembly may also be a driving device formed by a magnetic attraction structure, the driving device includes a carrier, a base, a spring plate, and a circuit board, the carrier is used for carrying the light deflection assembly and is rotatably connected with the base through the spring plate, the circuit board is mounted on the base and is provided with a bottom coil and a side coil, the bottom of the carrier is provided with a bottom magnet corresponding to the bottom coil, the side of the carrier is provided with a side magnet corresponding to the side coil, the bottom coil is matched with the bottom magnet and the side coil is matched with the side magnet, and the driving light deflection assembly rotates relative to the base around two rotation axes, for example, the driving light deflection assembly rotates around two rotation axes perpendicular to each other.

It will be appreciated that in alternative embodiments, the drive assembly may be formed by different forms of drive means or combinations of structures, for example, in one implementation, the drive assembly may include a first assembly and a second assembly, the first assembly and the second assembly being capable of respectively driving the light deflecting assembly to rotate around at least one rotation axis, and the rotation axes of the first assembly and the second assembly about which the first assembly and the second assembly are correspondingly driven to rotate are different in order to inhibit mutual interference therebetween, the first assembly may be an assembly including a rotor, and the second assembly may be a drive means formed by a magnetic attraction structure.

In the embodiment of the disclosure, the driving assembly connected to the rotating shaft structure is disposed in the light processing device, and during the light collection process, the light deflecting assembly is driven to rotate by the driving assembly, so that the light emergent surface of the light deflecting assembly can form different light transmission paths with each light sensor under the condition of different rotation angles, and the emergent light is transmitted to different light sensors through different light transmission paths without additional hardware support.

Fig. 5 is a schematic diagram illustrating a structure of a camera module according to an exemplary embodiment, and as shown in fig. 5, the camera module according to the embodiment of the present disclosure may include:

a light collection assembly 401, configured to collect reflected light of a photographic subject, and transmit the reflected light as incident light to the light processing apparatus 402 according to any one of the embodiments;

the light processing device 402 is configured to receive the incident light output by the light collection assembly, and form an image based on the incident light.

In some embodiments, the camera module includes a light collection assembly for directing received light perpendicularly to the light incident surface of the light deflection assembly. Here, the light collection member may be a transmission mirror having a light collecting function. Fig. 6 is a schematic diagram illustrating a composition structure of another camera module according to an exemplary embodiment, as shown in fig. 6, a light emitting surface of the light collecting assembly 401 is opposite to a light incident surface of the light deflecting assembly of the light processing device 402, and the light emitting surface of the light collecting assembly 401 is parallel to the light incident surface of the light deflecting assembly.

In some embodiments, the light deflecting assembly may further include an optical anti-shake function, that is, when focusing the photographic subject, the optical anti-shake function is activated, and when collecting the reflected light of the photographic subject, unstable light input due to shake can be avoided.

In some embodiments, the electronic device includes the camera module described in any of the above embodiments.

In the embodiment of the disclosure, the camera module may be disposed in an electronic device, wherein the electronic device may include a mobile terminal and a fixed terminal. The mobile terminal may include a mobile phone, a notebook computer, a tablet computer, a wearable electronic device, and the like, and the fixed terminal may include a personal computer device, a monitoring device, or a medical device, and the like. The electronic equipment related in the embodiment of the disclosure comprises a display module, wherein the display module can be a display screen of the electronic equipment. For example, the setting interface may be displayed based on a display screen of the electronic device.

Fig. 7 is a flowchart illustrating an image capturing method according to an exemplary embodiment, and as shown in fig. 7, the method is applied to the electronic device provided in the above embodiment, and mainly includes the following steps:

in step 701, a first input is received;

in step 702, in response to the first input, a target light sensor is determined;

in step 703, a target image of the subject is generated based on the target light sensor.

In one embodiment, the first input may be a focus adjustment operation for the electronic device, such as a click or press operation of a capture button of the electronic device, and the first input is generated in response to the focus adjustment operation. For example, the first input may be a touch input by a user in a viewfinder frame on a display interface of the electronic device, where the touch input may be input based on a touch module of the electronic device. For example, the touch input may include: click input, slide select input, etc., wherein click input may include: single click input, double click input, press input, etc.

In the embodiment of the present disclosure, a target light sensor may be determined based on the first input, and a target image of the subject may be generated based on the target light sensor. Here, the target light sensor is at least one of a plurality of light sensors. When the target light sensor is one of the plurality of light sensors, the image formed by the target light sensor may be directly determined as the target image, and when the target light sensor is at least two of the plurality of light sensors, at least two images collected by the at least two light sensors may be fused to obtain the target image.

In one embodiment, the first input may also be a user input to determine the acquisition object. The electronic device can estimate an expected focal distance for image acquisition of the acquisition object according to the current focal distance and the currently previewed image. And then selecting the light sensor which can provide the expected focal length as a target light sensor according to the collection focal length which can be provided by the light sensor.

In some embodiments, the target light sensor comprises at least: a first light sensor and a second light sensor, the first light sensor and the second light sensor having different light sampling categories;

the generating of the target image of the photographing object based on the target light sensor may include:

receiving a second input;

Here, the second input may be an image capturing operation for the electronic device, such as a click or press operation on a capture button of the electronic device, and the second input is generated in response to the image capturing operation. For example, the second input may be a touch input by a user in a viewfinder screen on a display interface of the electronic device, where the touch input may be input based on a touch module of the electronic device. For example, the touch input may include: click input, slide select input, etc., wherein click input may include: single click input, double click input, press input, etc.

In some embodiments, the light sensor may include: color image sensors and black and white image sensors.

In the embodiment of the disclosure, the fusion processing of images formed by different types of photo sensors can be realized by matching different photo sensors, for example, images formed by a color image sensor and a black-and-white image sensor can be fused, so that the image quality of the images is improved while the fusion precision is ensured, and the pixel level alignment is realized by sharing a front-stage optical system, thereby providing guarantee for the accuracy of a fusion algorithm.

In some embodiments, the first image and the second image may be subjected to image fusion through a preset image processing algorithm, for example, an average value of pixel values of corresponding positions in the first image and the second image may be taken to obtain a target pixel value, and the target image is obtained based on the target pixel value. In other embodiments, the pixel values of the corresponding positions in the first image and the second image may be weighted and then summed to obtain the target pixel value, and the target image may be obtained based on the target pixel value.

In some embodiments, said determining a target light sensor in response to said first input may comprise:

determining a light sensor corresponding to the target lens component with the desired acquisition parameters as the target light sensor; the target lens component is at least one of a plurality of lens components; the desired acquisition parameters may include: and collecting the focal distance.

In the embodiment of the disclosure, different lens groups are matched, the front-end incident optical system is shared, and the target light sensor with the set focal length is determined by collecting the focal length, so that smooth optical zooming can be realized, and the problems of optical axis deviation and multi-module assembly alignment caused by switching of multiple camera modules are solved.

In some embodiments, the acquisition parameters may also include an acquisition view angle.

In some embodiments, the electronic device may estimate a desired acquisition perspective for image acquisition of the acquisition object based on the current acquisition perspective and the currently previewed image. The light sensor that provides the desired collection view is then selected as the target light sensor based on the view angle that the light sensor can provide. In this way, not only smooth zooming between the respective lens assemblies but also switching of the angle of view, for example, switching from a lens assembly of a non-wide angle to a lens assembly of a wide angle or the like, can be achieved.

In some embodiments, the method may further comprise: and driving the light deflection assembly to rotate to a preset angle, and driving the light deflection assembly to transmit incident light to the target light sensor. In some embodiments, the target light sensor may include at least one image sensor and at least one photosensor, which may include an ambient light sensor and/or a distance sensor. In this embodiment scenario, the number of the plurality of lens assemblies is the same as the number of the image sensors, i.e., one lens assembly corresponds to one image sensor. It can be understood that, under the condition that the photoelectric sensor is needed, the light beam deflection assembly deflects to the corresponding rotation angle to obtain the corresponding light conduction path, and the incident light is directly transmitted to the photoelectric sensor without being transmitted through the lens assembly through the outgoing light which is transmitted and output through the corresponding light conduction path.

In some embodiments, the incident light is incident perpendicularly to the light deflecting component (e.g., prism, mirror) via a collection mirror; the light is incident on the lens assembly (lens group) through the prism, and the driving assembly (motor) pushes the prism to rotate. For example, the prism is located at position 1, and light is reflected to the lens group 1 through the prism and finally incident to the light sensor 1 corresponding to the lens group 1; the prism is positioned at the position 2, and light is reflected to the lens group 2 through the prism and finally enters the light sensor 2 corresponding to the lens group 2; the prism is positioned at the position 3, and light is reflected to the lens group 3 through the prism and finally enters the light sensor 3 corresponding to the lens group 3; the prism is located at the position 4, and the light is reflected to the lens group 4 through the prism and finally enters the light sensor 4 corresponding to the lens group 4. Therefore, the wheel disc type imaging system is switched in real time through the rotation of the prism. In some embodiments, the focusing and anti-shake functions may be designed according to requirements, for example, the focusing and anti-shake functions may be designed in the light collecting mirror portion, or the focusing and anti-shake functions may be designed in the lens group portion.

In the embodiment of the disclosure, by matching different lens groups and sharing the front-end incident optical system, smooth optical zooming can be realized, and the problems of optical axis deviation and multi-module assembly alignment of multi-camera module switching are solved; the fusion processing of images formed by different types of light sensors can be realized by matching different light sensors, for example, images formed by a color image sensor and a black-and-white image sensor can be fused, so that the image quality of the images is improved, the fusion precision is ensured, pixel level alignment is realized by sharing a front-stage optical system, and the accuracy of a fusion algorithm is guaranteed; through matching of the same type of light sensors, the prism is controlled to rotate rapidly, and lossless multi-frame fusion of images can be realized; by matching and matching the same light sensors, the prism can rotate rapidly, and the super-resolution can be realized to improve the image resolution.

In the embodiment of the disclosure, by the design of the common incidence optical system, smooth zooming and pixel level alignment image fusion can be realized; the functions of lossless multi-frame fusion of images, super resolution and the like are realized by the rapid rotation of a prism (a reflector); the focusing and anti-shake functions can be realized on the light-receiving mirror part or on the lens group part according to the use requirements; the collocation between the lens group part and the optical sensor can be adjusted according to requirements, the mode is flexible, the functions are various, and the collocation effect of the rear end is far better than that of the conventional multi-mode group switching scheme due to the design of the common incident optical system.

In some embodiments, the number of the lens assemblies and the light sensors may be increased as needed, for example, 6 lens assemblies and light sensors or 8 lens assemblies and light sensors may be provided.

The image capturing method according to the embodiment of the disclosure can be understood by referring to the related description of the optical processing device and the camera module.

Fig. 8 is a block diagram illustrating a hardware configuration of an electronic device according to an example embodiment. For example, the electronic device 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 8, electronic device 500 may include one or more of the following components: a processing component 502, a memory 504, a power component 506, a multimedia component 508, an audio component 510, an input/output (I/O) interface 512, a sensor component 514, and a communication component 516.

The processing component 502 generally controls overall operation of the electronic device 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 502 may include one or more processors 520 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 502 can include one or more modules that facilitate interaction between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.

The memory 504 is configured to store various types of data to support operations at the electronic device 500. Examples of such data include instructions for any application or method operating on the electronic device 500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power component 506 provides power to the various components of the electronic device 500. Power components 506 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for electronic device 500.

The multimedia component 508 includes a screen that provides an output interface between the electronic device 500 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 500 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 510 is configured to output and/or input audio signals. For example, the audio component 510 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 500 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 504 or transmitted via the communication component 516. In some embodiments, audio component 510 further includes a speaker for outputting audio signals.

The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the electronic device 500. For example, the sensor assembly 514 may detect an open/closed state of the electronic device 500, the relative positioning of components, such as a display and keypad of the electronic device 500, the sensor assembly 514 may detect a change in the position of the electronic device 500 or a component of the electronic device 500, the presence or absence of user contact with the electronic device 500, orientation or acceleration/deceleration of the electronic device 500, and a change in the temperature of the electronic device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 516 is configured to facilitate wired or wireless communication between the electronic device 500 and other devices. The electronic device 500 may access a wireless network based on a communication standard, such as WI-FI, 2G, or 6G, or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 504 comprising instructions, executable by the processor 520 of the electronic device 500 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

A non-transitory computer readable storage medium in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform an image capture method, may include:

receiving a first input;

determining a target light sensor in response to the first input;

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A light processing apparatus, the apparatus comprising:

a rotating shaft structure;

2. A light processing device as claimed in claim 1, characterized in that the device further comprises:

3. A light processing device as claimed in claim 2, characterized in that the device further comprises:

the driving assembly is connected with the rotating shaft structure and used for driving the rotating shaft structure to rotate and driving the light deflection assembly to rotate around at least one rotating shaft; the rotating shaft is perpendicular to a lens optical axis of the lens assembly.

4. The light processing apparatus of claim 2, wherein the maximum focal lengths of different ones of the lens assemblies are different.

5. The light processing apparatus of claim 2, wherein the intersection of the lens optical axes of the respective lens assemblies coincides with the center of the light deflection assembly.

6. The apparatus of claim 1, wherein a difference in length between light transmission paths from the light exit surface of the light deflecting element to the light incident surface of each of the light sensors is less than a predetermined length.

7. The apparatus of claim 1, wherein the light deflecting element is: a triangular prism.

8. A camera module, comprising:

a light collection unit for collecting reflected light of a photographic subject and transmitting the reflected light as incident light to the light processing device according to any one of claims 1 to 7;

9. An electronic apparatus, characterized in that the camera module according to claim 8 is mounted in the electronic apparatus.

10. An image capturing method applied to the electronic apparatus according to claim 9, the method comprising:

receiving a first input;

determining a target light sensor in response to the first input;

11. The method of claim 10 wherein the target light sensor comprises at least: a first light sensor and a second light sensor, the first light sensor and the second light sensor having different light sampling categories;

receiving a second input;

12. The method of claim 10, wherein said determining a target light sensor in response to said first input comprises:

determining a light sensor corresponding to the target lens component having the desired acquisition parameters as the target light sensor; the target lens component is at least one of a plurality of lens components;

the desired acquisition parameters include: and collecting the focal distance.

13. The method of claim 10, further comprising:

14. An electronic device, comprising:

a processor;

a memory configured to store processor-executable instructions;

wherein the processor is configured to: when executed, implement the steps of any of the image capturing methods of claims 10 to 13.

15. A non-transitory computer readable storage medium having instructions stored thereon that, when executed by a processor of an electronic device, enable the electronic device to perform the steps of any of the image capture methods of claims 10-13.