CN115236920A

CN115236920A - Imaging device, electronic apparatus, imaging device control method, and imaging device control apparatus

Info

Publication number: CN115236920A
Application number: CN202110435667.4A
Authority: CN
Inventors: 张巧鸽; 唐书桓; 贾卫波
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-04-22
Filing date: 2021-04-22
Publication date: 2022-10-25

Abstract

The application relates to an imaging device, an electronic apparatus, an imaging device control method and an imaging device control device. The image pickup apparatus includes: the optical axis of the first lens and the optical axis of the second lens are in the same plane; an intermediate member positioned on an optical axis of the first lens and/or the second lens; the position adjusting module adjusts the relative position between the middleware and the currently used lens based on the currently used lens in the first lens and the second lens so as to enable the light which penetrates through the currently used lens to irradiate the image sensor and enable the middleware to prevent the light which penetrates through the unused lens in the first lens and the second lens from irradiating the image sensor, and the image sensor is used for receiving the light which penetrates through the currently used lens. The camera device provided by the application has the advantages of multiple lenses, small size, low cost and high reliability, and can be applied to various electronic devices and various application scenes.

Description

Imaging device, electronic apparatus, imaging device control method, and imaging device control apparatus

Technical Field

The present disclosure relates to the field of camera technologies, and in particular, to a camera, an electronic device, and a method and an apparatus for controlling a camera.

Background

In the related art, electronic products having two lenses, such as smartwatches and smartphones, need to set corresponding devices, such as image sensors, for each lens to form two separate image capturing devices. And each camera device uses an independent image sensor and is connected with an independent circuit board, each camera device independently uses a connector of the camera device to be connected with a mainboard, and double shooting is realized through the control of the mainboard. The proposal has the advantages of more elements, large occupied space and high cost, and the increase of the elements can lead to the increase of the manufacturing process, further increase the control and assembly difficulty of the parts and influence the yield; the risk from the parts increases the risk of failure of the lens, and the reliability of the imaging device is low. Therefore, how to provide a miniaturized, low-cost and highly reliable image capturing device with multiple lenses and related electronic products is a problem to be solved.

Disclosure of Invention

In view of the above, an imaging device, an electronic apparatus, an imaging device control method, and an imaging device control apparatus are provided.

In a first aspect, an embodiment of the present application provides an image pickup apparatus, including: a first lens, a second lens, an intermediate piece, a position adjusting module and an image sensor,

the first lens is arranged towards a first direction, the second lens is arranged towards a second direction different from the first direction, and the optical axes of the first lens and the second lens are in the same plane;

the intermediate piece is positioned on the optical axis of the first lens and/or the second lens;

the position adjusting module is used for adjusting the relative position between the middleware and the currently used lens based on the currently used lens in the first lens and the second lens, so that the light passing through the currently used lens irradiates the image sensor, and the middleware prevents the light passing through the unused lens from irradiating the image sensor, wherein the unused lens is the lens which is not currently used in the first lens and the second lens;

and the image sensor is used for receiving the light transmitted through the currently used lens.

With the first aspect, there is provided a miniaturized, low-cost, and highly reliable image pickup apparatus having a plurality of lenses, which can be applied to various types of electronic devices.

In a first possible implementation form of the image pickup apparatus according to the first aspect, the first direction and the second direction are perpendicular to each other,

if the currently used lens is the first lens, the intermediate piece is located at a first relative position, the first surface of the intermediate piece reflects the first light ray which penetrates through the first lens to the image sensor, and the second surface of the intermediate piece reflects and/or absorbs the second light ray which penetrates through the second lens;

if the currently used lens is the second lens, the intermediate piece is located at a second relative position, the second light directly irradiates the image sensor, and the intermediate piece absorbs and/or reflects the first light.

In a second possible implementation form of the image pickup apparatus according to the first aspect, the first direction is opposite to the second direction,

if the currently used lens is the second lens, the intermediate piece is located at a third relative position, the first surface of the intermediate piece reflects the second light rays which penetrate through the second lens to the image sensor, and the second surface of the intermediate piece reflects and/or absorbs the first light rays which penetrate through the first lens.

In a third possible implementation form of the image capturing apparatus according to the first aspect as well as any one of the possible implementation forms of the first aspect, the apparatus further includes:

and the bracket is used for fixing the first lens, the second lens and the intermediate piece.

According to a third possible implementation manner of the first aspect, in a fourth possible implementation manner of the image capturing apparatus, the image capturing apparatus further includes:

the optical filter is used for filtering the first light rays and/or the second light rays before the first light rays and/or the second light rays are incident on the image sensor.

In a fifth possible implementation form of the imaging apparatus according to the fourth possible implementation form of the first aspect, the optical filter includes: the first optical filter and/or the second optical filter,

the first optical filter is positioned between the first lens and the intermediate piece or positioned on one side of the first lens, which is far away from the intermediate piece, and is used for filtering the first light before the first light enters the image sensor;

the second optical filter is located between the second lens and the intermediate piece or on one side of the second lens far away from the intermediate piece, and is used for filtering the second light before the second light enters the image sensor.

In a sixth possible implementation form of the imaging apparatus according to any one of the fourth possible implementation forms of the first aspect, the optical filter includes:

and the third optical filter is positioned between the intermediate piece and the image sensor and is used for filtering the first light ray or the second light ray before the first light ray or the second light ray enters the image sensor.

In a seventh possible implementation manner of the image capturing apparatus according to the fourth possible implementation manner of the first aspect, the bracket is further configured to fix the optical filter.

In an eighth possible implementation manner of the image capturing apparatus according to the third possible implementation manner of the first aspect, the middleware includes any one of:

the reflecting surface of the plane reflecting mirror is the first surface, and the surface of the plane reflecting mirror opposite to the reflecting surface is the second surface;

the bottom surface of the first triangular prism is an isosceles triangle, one side surface of the first triangular prism corresponding to the right-angle side is the second surface, and the side surface of the first triangular prism corresponding to the inclined side is the first surface;

the bottom surface is isosceles right triangle's second prism and third prism, just the second prism correspond to the hypotenuse the side with the side that the third prism corresponds to the hypotenuse contacts each other, a side of second prism does first face, a side of third prism does the second face.

In a ninth possible implementation form of the image capturing apparatus according to the third possible implementation form of the first aspect, the apparatus further includes:

the first automatic focusing assembly is used for realizing automatic focusing of the first lens; and/or

And the second automatic focusing component is used for realizing automatic focusing of the second lens.

In a tenth possible implementation form of the imaging apparatus according to the first aspect, the first f-number of the first lens is different from the second f-number of the second lens.

According to a first aspect, in an eleventh possible implementation manner of the imaging apparatus, the first lens and the second lens have different specifications, and the first lens and the second lens include any one of the following combinations:

the first lens is a close-range lens, and the second lens is a wide-depth-of-field lens;

the first lens is a standard lens, and the second lens is a wide-angle lens;

the first lens is a medium focal length lens and the second lens is a long focal length lens;

the first lens is a near-object-distance lens, and the second lens is a macro lens.

In a second aspect, an embodiment of the present application provides an electronic device, including: the imaging apparatus of the first aspect or any one of the possible implementations of the first aspect.

In a third aspect, an embodiment of the present application provides an imaging apparatus control method applied to the electronic device according to the second aspect; the method comprises the following steps:

in response to the detected input operation, determining a currently used lens of the image pickup device needing to be started, wherein the currently used lens is a first lens or a second lens of the image pickup device;

based on the currently used lens, adjusting a relative position between an intermediate piece of the image pickup device and the currently used lens so as to enable light rays penetrating through the currently used lens to irradiate an image sensor of the image pickup device and enable the intermediate piece to prevent light rays of an unused lens from not reaching the image sensor, wherein the unused lens is a lens which is not currently used in the first lens and the second lens.

In a fourth aspect, an embodiment of the present application provides an imaging apparatus control apparatus including:

the electronic device of the second aspect, or the imaging apparatus of the first aspect, or any possible implementation manner of the first aspect;

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the image pickup apparatus control method of the third aspect when executing the instructions.

In a fifth aspect, embodiments of the present application provide a computer-readable storage medium on which computer program instructions are stored, which, when executed by a processor, implement the second aspect or any one of the possible control methods of the second aspect.

In a sixth aspect, an embodiment of the present application provides a computer program product, which includes computer readable code or a non-volatile computer readable storage medium carrying computer readable code, and when the computer readable code runs in an electronic device, a processor in the electronic device executes the second aspect or any one of the possible control methods of the second aspect.

These and other aspects of the present application will be more readily apparent from the following description of the embodiment(s).

Drawings

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the application and, together with the description, serve to explain the principles of the application.

Fig. 1 to 10 are schematic structural views of an image pickup apparatus according to an embodiment of the present application.

Fig. 11A to 11D are schematic structural views illustrating an image pickup apparatus according to an embodiment of the present application.

Fig. 12A-12B, 13A-13C, 14A-14B illustrate schematic structural views of an intermediate piece according to an embodiment of the present application.

Fig. 15A and 15B are schematic structural views of an image pickup apparatus according to an embodiment of the present application.

Fig. 16 shows a schematic structural diagram of an electronic device 100 of the present application.

Detailed Description

Various exemplary embodiments, features and aspects of the present application will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present application. It will be understood by those skilled in the art that the present application may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present application.

In order to solve the above problems, the present application provides a miniaturized, low-cost, and highly reliable image pickup apparatus having a plurality of lenses, which can be applied to various types of electronic devices. Meanwhile, the application also provides the electronic equipment provided with the camera device, so that the electronic equipment can take pictures and take videos by utilizing the camera device, and take pictures of videos in the video call process by utilizing the camera device.

Fig. 1 to 11D are schematic structural views illustrating an image pickup apparatus according to an embodiment of the present application. As shown in fig. 1, the image pickup apparatus includes: a first lens 101, a second lens 102, an intermediate piece 200, an image sensor 300, and a position adjustment module (not shown in the figure). The first lens 101 is disposed toward a first direction, and the second lens 102 is disposed toward a second direction different from the first direction. Optical axes (not shown in the figure) of the first lens 101 and the second lens 102 are in the same plane. The intermediate member 200 is located on an optical axis of the first lens 101 and/or the second lens 102.

The position adjusting module is configured to adjust a relative position between the middleware 200 and a currently used lens (that is, the first lens 101 in the case shown in fig. 1) based on a currently used lens of the first lens 101 and the second lens 102, so that light passing through the currently used lens is irradiated to the image sensor 300, and so that the middleware 200 prevents light passing through an unused lens (that is, the second lens 102 in the case shown in fig. 1) from being irradiated to the image sensor 300, where the unused lens is a lens that is not currently used of the first lens 101 and the second lens 102. The image sensor 300 is a single sensor, which may also be referred to as a photo-sensing chip, for converting optical signals on a photo-sensing surface into electrical signals.

The position adjustment module is configured to control the first light or the second light to enter the image sensor 300, so that only the first light or the second light can reach the image sensor 300 at the same time. The position adjusting module can adjust the position of the intermediate piece by means of machinery, springs, magnetism, gears, clamping holes and the like. Also, the position adjustment module may determine the currently used lens by lens use information (the lens use information may indicate the currently used lens) or the like from a processor or the like of the electronic apparatus in which the image pickup apparatus is installed.

The middleware can optionally enable the light rays of the currently used lens to irradiate the image sensor and prevent the light rays of the unused lens from irradiating the optical element of the image sensor. In the process of switching the currently used lens, the relative position between the middleware and the currently used lens can be adjusted, so that the light of the currently used lens always irradiates the image sensor, and the light of the unused lens cannot irradiate the image sensor. The intermediate piece can be an optical element with a reflecting surface, and the reflecting surface can be used for realizing the purpose of keeping the light rays of the currently used lens to irradiate the image sensor, and the reflecting surface can be kept opposite to the optical axis of the currently used lens, such as forming an included angle of 45 degrees; alternatively, the optical element may be used to transmit light in other ways, so that the middleware can realize "keep the light of the currently used lens to irradiate the image sensor". In addition, the optical element needs to have a blocking performance for light transmission, so that the intermediate member can achieve "the light not using the lens cannot irradiate the image sensor" by using the blocking performance. The implementation manner of the middleware can be set by those skilled in the art according to actual needs, and the application is not limited to this. The way in which the middleware realizes that "light of a currently used lens is irradiated to the image sensor and light of an unused lens cannot be irradiated to the image sensor" by changing the relative position with respect to the currently used lens is exemplarily described below with reference to fig. 1 to 4, and the way in which the middleware is realized with reference to fig. 12A to 14B and the like is exemplarily described below.

In one possible implementation, as shown in fig. 1 and 2, the first direction and the second direction may be perpendicular to each other. Wherein the content of the first and second substances,

as shown in fig. 1, if the currently used lens is the first lens 101, the intermediate piece 200 is at a first relative position (1), the first surface S1 of the intermediate piece 200 reflects the first light transmitted through the first lens 101 to the image sensor 300, and the second surface S2 of the intermediate piece 200 reflects and/or absorbs the second light transmitted through the second lens 102.

As shown in fig. 2, if the currently used lens is the second lens 102, the intermediate part 200 is at a second relative position (2), the second light directly irradiates the image sensor 300, and the intermediate part 200 reflects the first light. As shown in fig. 2, when the intermediate member 200 is in the second relative position (2) such that the first light is incident on the first surface S1 of the intermediate member 200, the first surface S1 of the intermediate member 200 reflects the first light. If the intermediate member 200 is in the second relative position, so that the first light is incident on the second surface S2 of the intermediate member 200 (which is different from the second relative position S2 shown in fig. 2 and is not shown), the second surface S2 of the intermediate member 200 can absorb and/or reflect the first light.

The first direction and the second direction may be perpendicular to each other, that is, an included angle between the first direction and the second direction is 90 °. In this way, the first lens and the second lens can be arranged in two different vertical directions on the electronic device. For example, for an electronic device having an upper surface, a lower surface, and a plurality of side surfaces, the first lens may face the same direction as the upper surface, and the second lens may face the same direction as the side surfaces. Taking the smart watch as an example, the orientation of the first lens may be the same as the orientation of the surface where the display screen of the smart watch is located, and the orientation of the second lens may be the same as the orientation of the side surface of the smart watch body. The upper surface, the lower surface and the plurality of side surfaces of the electronic device are only one exemplary expression of the surfaces of the electronic device facing different directions, and may correspond to a certain placement state of the electronic device, and the orientation of one surface of the "upper surface, the lower surface and the plurality of side surfaces" of the electronic device is not limited to a specific direction. However, when the placement state of the electronic device changes, the orientations of the upper surface, the lower surface, and the plurality of side surfaces of the electronic device also change. For example, the smart watch is an example, the upper surface is the one side that the smart watch has the display screen, the lower surface is the one side relative with the display screen, and a plurality of sides can be the side of smart watch main part. When the display screen of the intelligent watch is placed upwards, the upper surface faces upwards; when the smart watch display screen was placed downwards, the upper surface faced down.

In one possible implementation, as shown in fig. 3 and 4, the first direction and the second direction may be opposite.

As shown in fig. 3, if the currently used lens is the first lens 101, the intermediate piece 200 is at a first relative position (1), the first surface S1 of the intermediate piece 200 reflects the first light transmitted through the first lens 101 to the image sensor 300, and the second surface S2 of the intermediate piece 200 reflects and/or absorbs the second light transmitted through the second lens 102.

As shown in fig. 4, if the currently used lens is the second lens 102, the intermediate piece is at the third relative position (3), the first surface S1 of the intermediate piece 200 reflects the second light transmitted through the second lens 102 to the image sensor 300, and the second surface S2 of the intermediate piece 200 reflects and/or absorbs the first light transmitted through the first lens 101.

Wherein the first direction and the second direction may be opposite, that is, the angle between the first direction and the second direction is 180 °. In this way, the first lens and the second lens can be arranged in two different opposite orientations on the electronic device. For example, for an electronic device having an upper surface, a lower surface and a plurality of side surfaces, the first lens may be oriented in the same direction as the upper surface, and the second lens may be oriented in the same direction as the lower surface. Taking a smart phone as an example, the orientation of the first lens may be the same as the orientation of the surface where the display screen of the smart phone is located, and the orientation of the second lens may be the same as the orientation of the lower surface of the smart phone main body, that is, the first lens is a front camera of the smart phone, and the second lens is a rear camera of the smart phone. The upper surface, the lower surface and the plurality of side surfaces of the electronic device are only one exemplary expression of the surfaces of the electronic device facing different directions, and may correspond to a certain placement state of the electronic device, and the orientation of one surface of the "upper surface, the lower surface and the plurality of side surfaces" of the electronic device is not limited to a specific direction. However, when the placement state of the electronic device changes, the orientations of the upper surface, the lower surface, and the plurality of side surfaces of the electronic device also change. For example, the smart watch is an example, the upper surface is the one side that the smart watch has the display screen, the lower surface is the one side relative with the display screen, and a plurality of sides can be the side of smart watch main part. When the display screen of the intelligent watch is placed upwards, the upper surface faces upwards; when the smart watch display screen was placed downwards, the upper surface faced down.

In one possible implementation, as shown in fig. 5, the image pickup apparatus may further include a circuit board 400. The image sensor 300 is electrically connected to a circuit board 400, and the circuit board 400 is used to convert an electrical signal, which is an analog quantity, from the image sensor 300 into an electrical signal of a digital quantity.

In the present embodiment, the first lens 101 and the second lens 102 share one image sensor 300 and a circuit board 400. The parameters (including information indicating the performance of the lens such as focus and aperture range), shape, size, and the like of the first lens 101 and the second lens 102 may be the same or different.

In a possible implementation manner, as shown in fig. 6 and 7, the image capturing apparatus may further include a bracket 500 for fixing the first lens 101, the second lens 102, and the middle piece 200.

The shape of the stent 500 may be any shape such as a cube (as shown in fig. 6 and 7), a rectangular parallelepiped, or a cylinder. The bracket may be a hollow structure capable of fixing the first lens 101, the second lens 102, and the middleware 200, or a solid structure having a space for accommodating the middleware 200 therein. The structure, shape, etc. of the bracket can be set by those skilled in the art according to actual needs, and the present application is not limited thereto.

In this way, the first lens 101, the second lens 102 and the middle piece 200 are fixed together by the support, so that the structure of each component in the image pickup device can be more compact, the size of the image pickup device can be reduced, the processing process of the image pickup device can be simplified, the cost is reduced, and the image pickup device is suitable for various electronic equipment configurations.

In a possible implementation manner, the image capturing apparatus may further include a filter configured to filter the first light and/or the second light before the first light and/or the second light enters the image sensor, so that the first light and/or the second light is irradiated to the image sensor after being filtered. According to different filtering requirements, the optical filter has the following first implementation mode, second implementation mode and the like:

the first method comprises the following steps: the filter may include a first filter 601 and/or a second filter 602.

The first filter 601 may be located between the first lens 101 and the middleware 200 (as 601 in fig. 8) or on a side of the first lens 101 away from the middleware 200 (as 601 in fig. 9). For filtering the first light before the first light is incident on the middleware 200, so that the first light is incident on the middleware 200 after being filtered.

A second filter 602 may be located between the second lens 102 and the middle part 200 (as 602 in fig. 8) or on a side of the second lens away from the middle part 200 (not shown in the drawings, a phase position between 602 and 102 may refer to a relative position between 601 and 101 in fig. 9), and is configured to filter the second light before the second light is incident on the image sensor 300.

Here, the relative positions of the first filter 601 and the second filter 602 in the image pickup apparatus may be set. The first filter 601 and the second filter 602 may be in the same or different positions relative to the lens in the imaging device. For example, as shown in fig. 8, if the first filter 601 is located between the first lens 101 and the intermediate member 200 and the second filter 602 is located between the second lens 102 and the intermediate member 200, it can be understood that the first filter 601 and the second filter 602 are located at the same position relative to the lenses in the image capturing apparatus. As shown in fig. 9, the first filter 601 is located on a side of the first lens 101 away from the intermediate part 200, and the second filter 602 is located between the second lens 102 and the intermediate part 200, it can be understood that the first filter 601 and the second filter 602 are different in relative position with respect to the lenses in the image capturing device. It is understood that, a person skilled in the art may set the relative positions of the first filter 601 and the second filter 602 in the image capturing device according to actual needs, and the present application is not limited thereto.

The filtering characteristics of the first filter 601 and the second filter 602 for light may be the same or different. If the image pickup apparatus includes the first filter 601 and the second filter 602, the filtered first light and the filtered second light incident to the image sensor 300 have the same spectral characteristics when the filter characteristics of the first filter 601 and the second filter 602 to the light are the same. If the image pickup apparatus includes the first filter 601 and the second filter 602, when the filter characteristics of the first filter 601 and the second filter 602 to the light are different, the filtered first light and the filtered second light incident to the image sensor 300 have different spectral characteristics. The filtering characteristics of the first filter 601 and the second filter 602 may be set by those skilled in the art according to actual needs, and the present application is not limited thereto.

And the second method comprises the following steps: as shown in fig. 10, the optical filter may further include a third optical filter 603 between the intermediate member 200 and the image sensor 300, for filtering the first light or the second light before the first light or the second light is incident to the image sensor. The first light and the second light are filtered and then incident on the image sensor 300.

In this implementation, the light rays (including the first light rays and/or the second light rays) from the middleware 200 can be filtered by the third filter 603, so that the filtered light rays are incident on the image sensor 300. The third filter 603 may be arranged according to filtering requirements, so that light in a corresponding wavelength range of the filtered light can be irradiated onto the image sensor 300. The first light beam irradiated to the image sensor 300 and the second light beam irradiated to the image sensor 300 are filtered by a third filter 603, and have the same spectral characteristics, that is, the wavelength ranges of the first light beam and the second light beam are the same.

In one possible implementation, the filter may be fixed using the bracket 500. This makes it possible to further reduce the size of the image pickup apparatus by fixing the filter to the first lens 101, the second lens 102, and the intermediate member 200.

Fig. 11A to 11D are schematic structural views illustrating an image pickup apparatus according to an embodiment of the present application. In one possible implementation, as shown in fig. 11A to 11D, the image capturing apparatus may further include: a first autofocus assembly 701 and/or a second autofocus assembly 702. The first auto-focus component 701 is used for implementing auto-focus of the first lens 101. The second autofocus component 702 is used to achieve autofocus for the second lens 102.

The first auto-focusing assembly and the second auto-focusing assembly may be devices capable of achieving lens auto-focusing, such as a voice coil motor, which is not limited in this application. An auto-focus assembly may be provided for any one of the first lens and the second lens. For example, a second autofocus component 702 is provided for the second lens 102 as in fig. 11B, or a first autofocus component 701 is provided for the first lens 101 as in fig. 11D. Or an auto-focus assembly may be provided for both the first lens and the second lens. For example, as shown in fig. 11A and 11C, a second autofocus assembly 702 is provided for the second lens 102, and a first autofocus assembly 701 is provided for the first lens 101.

Fig. 12A-12B, 13A-13C, 14A-14B illustrate schematic structural views of an intermediate piece according to an embodiment of the present application. Several implementations of the middleware 200 are possible as follows:

in one possible implementation, as shown in fig. 12A, 12B, the middle part 200 may include a first triangular prism 201 having an isosceles triangle bottom surface. One side surface of the first triangular prism 201 corresponding to the square edge may be the second surface S2, and the side surface of the first triangular prism 201 corresponding to the hypotenuse may be the first surface S1. One or two side surfaces of the first triangular prism 201 corresponding to the right-angle side may be configured to be surfaces capable of reflecting and/or absorbing light, that is, the second surface may be one or two side surfaces of the first triangular prism 201 corresponding to the right-angle side.

As shown in fig. 12A, if the first direction is perpendicular to the second direction and the currently used lens is the first lens 101, the first triangular prism 201 is at a first relative position (1), the first surface S1 of the first triangular prism 201 reflects the first light ray transmitted through the first lens 101 to the image sensor 300, and the second surface S2 of the first triangular prism 201 reflects and/or absorbs the second light ray transmitted through the second lens 102. If the currently used lens is the second lens 102, the first triple prism 201 is located at a second relative position (2), the second light directly irradiates the image sensor 300, and the first surface S1 of the first triple prism 201 reflects the first light (not shown in the figure).

If the intermediate member 200 is the first triangular prism 201 and the first direction is perpendicular to the second direction, the second relative position of the intermediate member 200 may be a position (2) shown in fig. 12A, or another position that can ensure that "the second light directly irradiates the image sensor and the intermediate member can absorb and/or reflect" the first light. The second relative position may also be a position where the second light ray can not enter the first triangular prism 201 and the first light ray can irradiate the second face S2 of the first triangular prism 201 (so that the second face S2 reflects and/or absorbs the first light ray). The person skilled in the art can set the second relative position according to practical needs, and the application is not limited to this.

As shown in fig. 12B, if the first direction and the second direction are opposite and the currently used lens is the first lens 101, the first triple prism 201 is at a first relative position (1), the first surface S1 of the first triple prism 201 reflects the first light ray transmitted through the first lens 101 to the image sensor 300, and the second surface S2 of the first triple prism 201 reflects and/or absorbs the second light ray transmitted through the second lens 102. If the currently used lens is the second lens 102, the first triangular prism 201 is at a third relative position (3), the first surface S1 of the first triangular prism 201 reflects the second light passing through the second lens 102 to the image sensor 300, and the second surface S2 of the first triangular prism 201 reflects and/or absorbs the first light passing through the first lens 101 (not shown in the figure).

In one possible implementation, as shown in fig. 13A, 13B, and 13C, the intermediate member 200 may include a second triangular prism 202 and a third triangular prism 203 each having an isosceles right triangle bottom surface, and a side surface of the second triangular prism 202 corresponding to the hypotenuse and a side surface of the third triangular prism 203 corresponding to the hypotenuse contact each other (a gap is left between the side surfaces corresponding to the two hypotenuses in the drawing for illustrating the relative positions). One side surface of the second triangular prism 202 is the first surface S1, and one side surface of the third triangular prism 203 is the second surface S2. In this regard, the first surface S1 may be a side surface of the second triangular prism 202 corresponding to an inner surface of the hypotenuse as shown in fig. 13A, 13B, and 13C, and the second surface S2 may be two side surfaces (as shown in fig. 13A, 13B, and 13C) or one side surface (not shown) of the third triangular prism 203 corresponding to an outer surface of the cathetus. The first surface S1 and the second surface S2 may be other side surfaces different from the examples shown in fig. 13A, 13B, and 13C, as long as it is ensured that the intermediate member can achieve "light passing through the currently used lens is irradiated to the image sensor, and light passing through the unused lens is prevented from being irradiated to the image sensor", and the present application is not limited thereto.

As shown in fig. 13A, if the first direction is perpendicular to the second direction and the currently used lens is the first lens 101, the second triangular prism 202 and the third triangular prism 203 are located at a first relative position (1), the first surface S1 reflects the first light ray passing through the first lens 101 to the image sensor 300, and the second surface S2 reflects and/or absorbs the second light ray passing through the second lens 102. If the currently used lens is the second lens 102, the second triangular prism 202 and the third triangular prism 203 are located at a second relative position (2), the second light directly irradiates the image sensor 300, and the first surface S1 of the first triangular prism 201 reflects the first light (not shown in the figure).

If the intermediate member 200 is the second triangular prism 202 and the third triangular prism 203, and the first direction is perpendicular to the second direction, the second relative position of the intermediate member 200 may be, in addition to the position (2) shown in fig. 13A, other positions that can ensure that the "second light directly irradiates the image sensor and the intermediate member can absorb and/or reflect the first light". The second relative position may also be a position where the second light ray can not enter the second triangular prism 202 and the third triangular prism 203 and the first light ray can irradiate the second surface S2 (so that the second surface S2 reflects and/or absorbs the first light ray). The person skilled in the art can set the second relative position according to practical needs, and the application is not limited to this.

As shown in fig. 13B, if the first direction and the second direction are opposite and the currently used lens is the first lens 101, the second triangular prism 202 and the third triangular prism 203 are located at a first relative position (1), the first surface S1 reflects the first light ray passing through the first lens 101 to the image sensor 300, and the second surface S2 reflects and/or absorbs the second light ray passing through the second lens 102.

As shown in fig. 13C, if the first direction and the second direction are opposite and the currently used lens is the second lens 102, when the second triangular prism 202 and the third triangular prism 203 are at the third relative position (3), the first surface S1 reflects the second light transmitted through the second lens 102 to the image sensor 300, and the second surface S2 reflects and/or absorbs the first light transmitted through the first lens 101.

In a possible implementation manner, as shown in fig. 14A and 14B, the intermediate piece 200 may also be a plane mirror 204, a reflection surface of the plane mirror 204 is the first surface S1, and a surface of the plane mirror 204 opposite to the reflection surface (i.e., a back surface of the plane mirror 204) is the second surface S2.

As shown in fig. 14A, if the first direction is perpendicular to the second direction and the currently used lens is the first lens 101, the plane mirror 204 is at a first relative position (1), the first surface S1 of the plane mirror 204 reflects the first light passing through the first lens 101 to the image sensor 300, and the second surface S2 of the plane mirror 204 reflects and/or absorbs the second light passing through the second lens 102. If the currently used lens is the second lens 102, the plane mirror 204 is at the second relative position (2), the second light directly irradiates the image sensor 300, and the first surface S1 of the plane mirror 204 reflects the first light (not shown in the figure).

If the intermediate member 200 is the plane mirror 204 and the first direction is perpendicular to the second direction, the second relative position of the intermediate member 200 may be a position (2) shown in fig. 14A, or another position that can ensure that the "second light directly irradiates the image sensor and the intermediate member can absorb and/or reflect the first light". For example, the second relative position may be a position where the second light ray does not enter the plane mirror 204 and the first light ray can irradiate the second surface S2 of the plane mirror 204 (so that the second surface S2 reflects and/or absorbs the first light ray). The person skilled in the art can set the second relative position according to practical needs, and the application is not limited to this.

As shown in fig. 14B, if the first direction and the second direction are opposite and the currently used lens is the first lens 101, the plane mirror 204 is at the first relative position (1), the first surface S1 of the plane mirror 204 reflects the first light passing through the first lens 101 to the image sensor 300, and the second surface S2 of the plane mirror 204 reflects and/or absorbs the second light passing through the second lens 102. If the currently used lens is the second lens 102, the plane mirror 204 is at a third relative position (3), the first surface S1 of the plane mirror 204 reflects the second light passing through the second lens 102 to the image sensor 300, and the second surface S2 of the plane mirror 204 reflects and/or absorbs the first light passing through the first lens 101 (not shown in the figure).

It should be noted that the middleware 200 may also be any optical device having a first surface capable of reflecting light, and the several implementation manners of the middleware 200 are only examples provided in this application, and do not limit the implementation manner of the middleware 200.

In one possible implementation, the first f-number of the first lens 101 is different from the second f-number of the second lens 102.

Wherein, can set up first f-number and second f-number according to the use scene of camera device. For example, the first f-number may be 2.0-2.8, and the first lens may be a front lens of the electronic device. The second diaphragm number can be 1.4-2.0, and the second lens can be used as a side lens or a rear lens of the electronic equipment, so that the use requirements of a user for shooting a portrait by the front lens and shooting a scene in a dark environment by the rear lens or the side lens can be met. The first f-number and the second f-number can be set by those skilled in the art according to the requirement of two-lens shooting, and the present application is not limited thereto.

The specifications of the first lens 101 and the second lens 102 may be set according to shooting requirements. As shown in fig. 1 to 11D, the specifications of the first lens 101 and the second lens 102 may be the same. Fig. 15A and 15B are schematic structural views of an image pickup apparatus according to an embodiment of the present application. In one possible implementation manner, as shown in fig. 15A and 15B, the specifications of the first lens 101 and the second lens 102 may be different, and the first lens and the second lens may include any one of the following combinations:

the first method is as follows: the first lens 101 is a short-range lens and the second lens 102 is a wide-depth lens. The depth of field of the first lens, which is a short-range object lens, may be 10cm to 50cm, and the depth of field of the second lens, which is a wide-depth-of-field lens, may be greater than or equal to 20cm (i.e., the depth of field may be 20cm to infinity). The first lens can be used as a front lens of the electronic device, and the second lens can be used as a rear lens or a side lens of the electronic device. Therefore, the use scene that the user frequently shoots the portrait at the front part and shoots the surrounding scenery at the rear part or the side part can be met.

The second method comprises the following steps: the first lens 101 is a standard lens and the second lens 102 is a wide-angle lens. The first lens which is a standard lens can be a lens with a normal field angle, the field angle can be 70-90 degrees, and the first lens can be used as a front lens of the electronic device. The second lens which is a wide-angle lens has a field angle of 80-130 degrees, and the second lens can be used as a side lens or a rear lens of the electronic device. Therefore, the use scene that the user frequently shoots the portrait at the front part and shoots the scenery with a larger visual range by the rear lens or the side lens can be met.

The third method comprises the following steps: the first lens 101 is a medium focus lens and the second lens 102 is a long focus lens. The first lens is a medium focal length lens, the focal length of the first lens can be 1.8 mm-4 mm, and the first lens can be used as a front lens of the electronic device. The second lens is a long-focus lens, the focal length of the second lens can be 2 mm-8 mm, and the second lens can be used as a side lens or a rear lens of the electronic device. Therefore, the use scene which meets the requirements of the user for frequently using the front camera to shoot the portrait and the rear camera or the side camera to shoot the distant scenery can be met.

The method is as follows: the first lens 101 is a short-range lens, and the second lens 102 is a macro lens. The first lens is a near-object-distance lens, the shooting object distance of the first lens can be 5 cm-50 cm, and the first lens can be used as a front lens. The second lens is a macro lens, the shooting object distance of the second lens can be 3 cm-20 cm, and the second lens can be used as a side lens or a rear lens. Therefore, the macro use scenes such as close-range flowers, characters and the like can be shot by the front lens and the rear lens or the side lens which are commonly used by the user.

The application also provides an electronic device which comprises the camera device.

Fig. 16 shows a schematic structural diagram of an electronic device 100 of the present application. The electronic device 100 in the present application may include at least one of a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a Personal Digital Assistant (PDA), an Augmented Reality (AR) device, a Virtual Reality (VR) device, an Artificial Intelligence (AI) device, a wearable device, an in-vehicle smart device, an intelligent home device, or a city device. The embodiment of the present application does not particularly limit the specific type of the electronic device 100.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identity Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may be a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), or the like. In some embodiments, the electronic device 100 may include 1 or more display screens 194.

The electronic device 100 may implement a camera function via the camera 193, isp, video codec, GPU, display screen 194 and application processor AP, neural network processor NPU, etc. The camera 193 may be the camera device provided in the present application.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The processor can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. The memory may hold instructions or data that are used or used more frequently by the processor 110. If the processor 110 needs to use the instructions or data, it can call directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

The processor 110 may be used to execute the camera control method provided herein.

The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signals for output, and also used to convert analog audio inputs into digital audio signals. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into a sound signal. The electronic apparatus 100 can listen to music through the speaker 170A or output an audio signal for handsfree phone call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the electronic apparatus 100 receives a call or voice information, it is possible to receive voice by placing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or sending voice information, the user can input a voice signal to the microphone 170C by uttering a voice signal close to the microphone 170C through the mouth of the user. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, perform directional recording, and so on.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association) standard interface of the USA.

The application also provides a control method of the camera device, which is applied to the electronic equipment and comprises the following steps:

based on the currently used lens, adjusting the relative position between the middleware of the camera device and the currently used lens;

the light penetrating through the currently used lens irradiates an image sensor of the image pickup device, and the light penetrating through an unused lens cannot reach the image sensor, wherein the unused lens is a lens which is not currently used in the first lens and the second lens.

The application also provides an image pickup apparatus control apparatus including:

the electronic device or the imaging device;

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the above-described image capture device control method when executing the instructions.

Embodiments of the present application provide a non-transitory computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the above-described image pickup apparatus control method.

Embodiments of the present application provide a computer program product comprising computer readable code, or a non-transitory computer readable storage medium carrying computer readable code, which when run in a processor of an electronic device, the processor in the electronic device executes the above-described image pickup apparatus control method.

The computer-readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an erasable Programmable Read-Only Memory (EPROM or flash Memory), a Static Random Access Memory (SRAM), a portable Compact Disc Read-Only Memory (CD-ROM), a Digital Versatile Disc (DVD), a Memory stick, a floppy disk, a mechanical coding device, a punch card or an in-groove protrusion structure, for example, having instructions stored thereon, and any suitable combination of the foregoing.

The computer readable program instructions or code described herein may be downloaded to the respective computing/processing device from a computer readable storage medium, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present application may be assembler instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of Network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry can execute computer-readable program instructions to implement aspects of this application by personalizing, with state information of the computer-readable program instructions, an electronic circuit such as a Programmable Logic circuit, a Field-Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).

Various aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.

It is also noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by hardware (e.g., an electronic Circuit or an ASIC (Application Specific Integrated Circuit)) for performing the corresponding functions or acts, or combinations of hardware and software, such as firmware.

While the invention has been described in connection with various embodiments, other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a review of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the word "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Having described embodiments of the present application, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. An image pickup apparatus, comprising: a first lens, a second lens, an intermediate piece, a position adjusting module and an image sensor,

the position adjusting module is used for adjusting the relative position between the middleware and the currently used lens based on the currently used lens in the first lens and the second lens so that the light which penetrates through the currently used lens irradiates the image sensor and the light which penetrates through the unused lens is prevented from irradiating the image sensor by the middleware, wherein the unused lens is the lens which is not currently used in the first lens and the second lens;

and the image sensor is used for receiving the light rays transmitted through the currently used lens.

2. The image pickup apparatus according to claim 1, wherein said first direction and said second direction are perpendicular to each other,

if the currently used lens is the first lens, the middleware is in a first relative position, a first surface of the middleware reflects first light rays which penetrate through the first lens to the image sensor, and a second surface of the middleware reflects and/or absorbs second light rays which penetrate through the second lens;

if the currently used lens is the second lens, the intermediate piece is located at a second relative position, the second light rays directly irradiate the image sensor, and the intermediate piece absorbs and/or reflects the first light rays.

3. The image pickup apparatus according to claim 1, wherein said first direction is opposite to said second direction,

4. The image pickup apparatus according to any one of claims 1 to 3, further comprising:

5. The image pickup apparatus according to claim 4, further comprising:

6. The image pickup apparatus according to claim 5, wherein the filter includes: the first optical filter and/or the second optical filter,

7. The image pickup apparatus according to claim 5, wherein the filter includes:

8. The image pickup device according to claim 5, wherein said holder is further configured to fix said filter.

9. The image pickup apparatus according to claim 4, wherein the middleware includes any one of:

the bottom surface is isosceles right triangle's second triangular prism and third triangular prism, just the second triangular prism correspond to the hypotenuse the side with the third triangular prism corresponds to the side of hypotenuse and contacts each other, a side of second triangular prism does first face, a side of third triangular prism does the second face.

10. The image pickup apparatus according to claim 4, characterized in that said apparatus further comprises:

And the second automatic focusing component is used for realizing the automatic focusing of the second lens.

11. The image pickup apparatus according to claim 1, wherein a first f-number of said first lens is different from a second f-number of said second lens.

12. The imaging apparatus according to claim 1, wherein the first lens and the second lens are different in size, and the first lens and the second lens include any one of the following combinations:

the first lens is a near-object distance lens, and the second lens is a wide-depth-of-field lens;

the first lens is a standard lens, and the second lens is a wide-angle lens;

13. An electronic device, comprising: the image pickup apparatus according to any one of claims 1 to 12.

14. An image pickup apparatus control method applied to the electronic device according to claim 13, the method comprising:

determining a currently used lens of the image pickup device needing to be started in response to the detected input operation, wherein the currently used lens is a first lens or a second lens of the image pickup device;

15. An imaging apparatus control apparatus, comprising:

the electronic device of claim 13 or the imaging apparatus of any one of claims 1-12;

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the image pickup apparatus control method of claim 14 when executing the instructions.

16. A computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the imaging apparatus control method of claim 14.

17. A computer program product comprising computer readable code or a non-transitory computer readable storage medium carrying computer readable code which, when run in an electronic device, a processor in the electronic device performs the camera control method of claim 14.