WO2020037650A1

WO2020037650A1 - Imaging assembly, touch screen, camera module, smart terminal, cameras, and distance measuring method

Info

Publication number: WO2020037650A1
Application number: PCT/CN2018/102244
Authority: WO
Inventors: 陈振宇; 周凯伦; 蒋伟杰
Original assignee: 宁波舜宇光电信息有限公司
Priority date: 2018-08-24
Filing date: 2018-08-24
Publication date: 2020-02-27
Also published as: CN112335049B; CN112335049A

Abstract

Provided in the present application is an imaging assembly, comprising a spacer and a photoelectric converter. The spacer is not light-permeable and is formed therein with a light guide channel. The photoelectric converter and the spacer are parallel to each other and spaced apart, and are positioned in correspondence with the light guide channel. Light emitted by an object to be imaged traverses the light guide channel and then reaches the photoelectric converter. Further provided in the present application are a method for fabricating an imaging assembly, a touch screen, a camera module, a smart terminal, a multiocular depth camera, a light field camera, and a distance measuring method.

Description

Imaging component, touch screen, camera module, smart terminal, camera and distance measurement method

Technical field

The present application relates to an imaging component, and more particularly to a photoelectric imaging component that performs light confinement by using a light guide channel.

Background technique

With the development and popularization of mobile terminal devices, related technologies of imaging components applied to mobile terminal devices to help users obtain images (such as videos or images) have developed rapidly and progressed. In recent years, imaging components Many fields such as medical treatment, security and industrial production have been widely used.

One of the important development trends of mobile terminal equipment is that the size of mobile terminal equipment is getting smaller and smaller. In order to meet the growing market demand, the small size and large aperture is an irreversible development trend of existing camera modules. In addition, the market has increasingly demanded the imaging quality of camera modules.

Under the premise of increasing demand for size, the structure of existing conventional camera devices cannot meet people's demand for the size of electronic products.

Specifically, the conventional imaging device mostly uses a lens imaging system. In a lens imaging system, there must be various aberrations and loss of brightness after the light passes through the lens. After the light passes through the lens, there will be a certain loss of brightness.

In addition, because the structure of the lens imaging system is more complicated, further reduction in size will inevitably lead to higher costs, and it cannot meet people's demand for thinning and thinning electronic products.

In addition, if the lens imaging system includes multiple lenses and barrels, the manufacturing tolerances of the various components of the lens imaging system continue to accumulate during the assembly process, and the assembly process also generates assembly tolerances. These tolerances limit further improvements in lens performance.

In conventional lens imaging optical systems, the maximum effective size of the chip (that is, the area where the chip can be illuminated) is limited by the size of the lens aperture. On the optical design, there is very limited space for the aperture size of the lens to be improved.

Summary of the Invention

The present invention aims to provide a solution capable of overcoming at least one of the aforementioned disadvantages of the prior art.

According to an aspect of the present invention, there is provided an imaging assembly, which may include:

A spacer, which is opaque and forms at least one light guide channel therein; and

The at least one photoelectric converter may be parallel and spaced apart from the spacer, and may be respectively set to correspond to the light guide channel one by one, so that the light emitted by the object to be imaged can reach the photoelectric converter after passing through the light guide channel.

The spacers form a plurality of light guide channels, and the light guide channels can form an array of light guide channels in the spacers.

The size of the light guide channel can be set to 800 nm or more.

The size of the light guide channel can be set to be diffracted at a specific wavelength in the passing light to perform light splitting, so that light in a specific wavelength band reaches a preset photoelectric converter.

The spacer may be made of a light absorbing material.

The photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel irradiates the entire light receiving surface of the corresponding photoelectric converter.

The spacer may be coated with a light blocking layer.

The light blocking layer may be a diffuse reflection coating or a light absorbing coating.

According to an aspect of the present application, a method for manufacturing an imaging assembly is also provided. The method may include:

At least one light guide channel may be formed in the opaque spacer;

At least one photoelectric converter may be arranged parallel to and spaced from the spacer, and the photoelectric converters respectively correspond to the light guide channels, so that the light emitted by the object to be imaged can reach the photoelectric converter after passing through the light guide channels.

According to an aspect of the present application, a touch screen is also provided. The touch screen may include:

At least one photoelectric converter may be parallel and spaced apart from the spacer, and may be respectively arranged one-to-one corresponding to the light guide channel, so that light emitted by the object to be imaged can reach the photoelectric converter after passing through the light guide channel; and

Streamer, which can be located above the spacer, including:

Streamer, which can include a total reflection plate;

A light input part, which is located in the streamer and can output light at an angle to the total reflection plate;

as well as

Light output

Wherein, the light emitted by the light input portion can be totally reflected in the streamer and can be output from the light output portion.

According to one aspect of the present application, a touch screen is provided. The touch screen may include:

At least one photoelectric converter may be parallel and spaced apart from the spacer, and may be set one-to-one corresponding to the light guide channel so that the light emitted by the object to be imaged can reach the photoelectric converter after passing through the light guide channel;

Transparent elastic mechanism, which can be located above the spacer; and

The light source may be located on a side of the spacer facing the transparent elastic mechanism and emits light to the transparent elastic mechanism.

The transparent elastic mechanism may be a transparent film.

According to an aspect of the present application, a touch screen is also provided. The touch screen includes:

At least one photoelectric converter, the photoelectric converters are parallel and spaced from the spacer, and are arranged one-to-one corresponding to the light guide channels, so that the light emitted by the object to be imaged passes through the light guide channels Reach the photoelectric converter;

Transparent elastic mechanism. The transparent elastic mechanism may be located above the spacer, and an opaque blocking member is provided in the transparent elastic mechanism.

According to an aspect of the present application, a camera module is also provided. The camera module may include the aforementioned imaging component and a display screen. The imaging component is located below the display screen.

The display screen is one of an OLED screen, an LCD screen, and an LED screen.

The substrate in the OLED screen may form a spacer.

Among them, the cathode layer in the OLED screen may form a spacer.

The anode layer in the OLED screen may form a spacer.

An optical element for condensing light may be provided above each light guide channel in the spacer of the imaging component.

The optical element may be a convex lens.

A super lens for condensing light may be provided above each photoelectric converter of the imaging component.

Wherein, an optical path turning element may be provided above the light guide channel.

The optical path turning element may include a MEMS device and a mirror.

The camera module may be located on a substrate in the OLED screen, and a driving member may be disposed on the substrate. The driving member may adjust the distance between the photoelectric converter of the imaging component and the spacer.

Among them, the color filter in the LCD screen can be integrated as the color filter of the imaging component.

The aperture of the light guide channel can be set to a specific wavelength.

According to an aspect of the present application, a smart terminal is also provided. The smart terminal may include the camera module described above.

According to one aspect of the present application, a method for distance measurement is also provided. The method may include:

Multiple light guide channels can be formed in the opaque spacer;

A plurality of photoelectric converters can be set parallel to and spaced from the spacer, and respectively corresponding to the light guide channels one by one, so that the light emitted by the object to be imaged can reach the photoelectric converter after passing through the light guide channels;

Obtaining a plurality of images formed by the object to be imaged through a plurality of light guide channels according to the electrical signals output by the photoelectric converter; and

The distance to the object to be imaged is calculated according to the degree of repetition of the multiple images.

The degree of repetition may be the area of the repeated pixels of the entire object or a local area.

According to one aspect of the present application, a light field camera is also provided. The light field camera may have a micro lens array and may further include:

A spacer, which may be opaque and form at least one light guide channel therein; and

At least one photoelectric converter, the photoelectric converter may be parallel to and spaced from the spacer, and may correspond to the light guide channel one by one,

The micro lens array may be located between the spacer and the photoelectric converter, and the light emitted by the object to be imaged passes through the light guide channel and the micro lens array and reaches the photoelectric converter.

According to one aspect of the present application, a light field camera is also provided. The light field camera may have a main lens and may further include:

At least one photoelectric converter, the photoelectric converter is parallel to and spaced from the spacer, and respectively corresponds to the light guide channel one by one,

The spacer may be located between the main lens and the photoelectric converter, and the light emitted by the object to be imaged passes through the main lens and the light guide channel and reaches the photoelectric converter.

According to an aspect of the present application, a multi-eye depth camera is also provided. The multi-eye depth camera may include:

A spacer, which may be opaque and form a plurality of light guide channels therein; and

Multiple photoelectric converters, which can be parallel and spaced apart from the spacer, and can correspond to the light guide channels one by one, so that the light emitted by the object to be imaged can reach the photoelectric converter after passing through the light guide channel;

The central axes of the light guide channels can be staggered with each other.

According to an aspect of the present application, a pixel color filter array device is also provided. The pixel filter array may include:

Matrix

A dielectric layer attached to a substrate; and

A plurality of pixel color filters are attached to the dielectric layer and form an array.

The dielectric layer is one of a photoelectric converter and a display screen.

According to an aspect of the present application, a method for forming a pixel filter array device is also provided. The method for forming a pixel filter array may include the following steps:

Setting the matrix

Attaching a dielectric layer to a substrate;

Setting a first color filter array on a first carrier plate;

The first color filter array is transferred from the first carrier plate to the second carrier plate by a printing head to form a second color filter array, wherein the printing head is over-expanded during transfer so that the The gap is suitable for the gap between the color filters in the second color filter array;

Coating transparent glue on the substrate; and

The entire second color filter array on the second carrier is adhered to the dielectric layer.

The dielectric layer is one of a photoelectric converter and a display screen.

Compared with the prior art, the present invention has at least one of the following technical effects:

1. There is no aberration problem, and the brightness loss is smaller.

2. Smaller size.

3. Simple structure and fewer assembly tolerance items.

4. By setting the light guide channels on the screen at intervals, the maximum effective size of the chip, which can illuminate the chip area, can be increased by increasing the distribution area of the light guide channels on the screen, so the chip area is not limited by the lens aperture size Large adjustable range. The light guide channel is spaced from the imaging pixel in the projection direction and is not on the same horizontal plane. The number of pixels that make up the chip × the size of the pixel = the chip area, the size of the pixel is positively related to the sensitivity, and the number is positively related to the resolution.

5. In the case of being used as a front camera, the small holes and the imaging pixels of the display screen are alternately arranged, thereby increasing the screen ratio of the smart terminal.

6. In the case of using as a back camera, reduce the overall thickness of the mobile phone, where the back camera is the maximum thickness of the smart terminal, and it is possible to reduce the thickness of the smart terminal only by reducing the back camera thickness.

7. Since the imaging does not involve a lens, the phenomenon of close defocusing does not occur, and macro imaging can be achieved.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiments are shown in reference drawings. The embodiments and figures disclosed herein are to be regarded as illustrative rather than restrictive.

1a to 1d are schematic views showing an embodiment of an imaging module according to the present invention;

FIG. 2 shows a detailed schematic diagram showing a single light guide channel in an embodiment of an imaging module according to the present invention;

3 shows a flowchart of a method for manufacturing an imaging module according to the present invention;

[Correction 16.10.2018 in accordance with Rule 26]
4a to 4b are schematic diagrams of an embodiment of a touch screen according to the present invention;

5 shows a schematic diagram of a streamer in an embodiment of a touch screen according to the present invention;

6a to 6c are schematic diagrams of another embodiment of a touch screen according to the present invention;

7a to 7b are schematic diagrams illustrating another embodiment of a touch screen according to the present invention;

8 is a schematic diagram showing an embodiment of a camera module according to the present invention;

9a to 9b are schematic diagrams of another embodiment of a camera module according to the present invention;

FIG. 10 shows a schematic diagram of the above embodiment of the camera module according to the present invention; FIG.

11 is a schematic diagram illustrating another embodiment of a camera module according to the present invention;

FIG. 12 is a schematic diagram of another embodiment of a camera module according to the present invention; FIG.

FIG. 13 is a schematic diagram of another embodiment of a camera module according to the present invention; FIG.

14 shows a flowchart of a method for distance measurement according to the present invention;

15a to 15d are schematic diagrams illustrating an embodiment of a method for distance measurement according to the present invention;

16 illustrates a schematic diagram of another embodiment of a camera module according to the present invention;

FIG. 17 shows a schematic diagram of a prior art light field camera;

18a to 18b are schematic diagrams of a prior art light field camera;

FIG. 19 shows a refocusing schematic diagram of a light field camera in the prior art; FIG.

FIG. 20 shows a refocusing effect diagram of a conventional light field camera; FIG.

21 is a schematic diagram showing an embodiment of a light field camera according to the present invention;

22 shows a refocusing effect diagram of an embodiment of a light field camera according to the present invention;

FIG. 23 shows a schematic diagram of another embodiment of a light field camera according to the present invention; FIG.

FIG. 24 shows a schematic diagram of an embodiment of a multi-eye depth camera according to the present invention;

FIG. 25 shows a flowchart of a prior art photocopying process; and

FIG. 26 shows a flowchart of the pad printing process.

detailed description

In order to better understand the present application, various aspects of the present application will be described in more detail with reference to the accompanying drawings. It should be understood that these detailed descriptions are merely descriptions of exemplary embodiments of the present application, and do not limit the scope of the present application in any way. Throughout the description, the same reference numerals refer to the same elements. The expression "and / or" includes any and all combinations of one or more of the associated listed items.

It should be noted that, in this specification, the expressions of the first, second, etc. are only used to distinguish one feature from another feature, and do not indicate any limitation on the feature. Therefore, without departing from the teachings of this application, the first subject discussed below may also be referred to as the second subject.

In the drawings, for convenience of explanation, the thickness, size, and shape of the object have been slightly exaggerated. The drawings are only examples and are not drawn to scale.

It should also be understood that the terms "including", "including", "having", "including" and / or "including" when used in this specification indicate the existence of stated features, wholes, steps, operations , Elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof. Furthermore, when an expression such as "at least one of" appears after the list of listed features, the entire listed feature is modified, rather than the individual elements in the list. In addition, when describing an embodiment of the present application, "may" is used to mean "one or more embodiments of the present application." Also, the term "exemplary" is intended to refer to an example or illustration.

As used herein, the terms "substantially", "approximately" and similar terms are used as table approximation terms, not as table level terms, and are intended to illustrate measurement, which will be recognized by those of ordinary skill in the art. The inherent deviation in the value or calculated value.

Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It should also be understood that terms (e.g. terms defined in commonly used dictionaries) should be interpreted to have a meaning consistent with their meaning in the context of the relevant technology and will not be interpreted in an idealized or overly formal sense, unless This is clearly defined in this article.

It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The application will be described in detail below with reference to the drawings and embodiments.

1a to 1d show schematic diagrams of an embodiment of an imaging module according to the present invention. As shown in FIGS. 1 a to 1 d, the imaging module 1 includes a spacer 2 and a plurality of photoelectric converters 3. The spacer 2 is opaque and a plurality of light guide channels 21 are formed therein. The photoelectric converters 3 are parallel and spaced apart from the spacer 2 and respectively correspond to the light guide channels 21 so that the light emitted by the object to be imaged passes through the light guide channels 21 and reaches the photoelectric converter 3.

FIG. 2 shows a detailed schematic diagram showing a single light guide channel 21 in the embodiment of the imaging module 1 according to the present invention. As shown in FIG. 2, according to the principle of linear light propagation, light from an object located on the object side can be received by the photoelectric converter 3 on the other side of the spacer 2 through the light guide channel 21.

The spacer 2 and the photoelectric converter 3 including the light guide channel 21 constitute an imaging module 1. The periphery of the light guide channel 21 is a spacer, and the spacer acts to block the light irradiated to the spacer, that is, the light guide channel 21 restricts the passage of light. The spacer may be made of a light absorbing material, such as a ferrous metal. In addition, in other embodiments, the spacer 2 may be coated with a light blocking layer, and the light blocking layer may be a diffuse reflection coating or a light absorbing coating.

The size of the light guide channel 21 is preferably a size that does not cause significant diffraction, that is, the size of the light guide channel 21 is preferably 800 nm or more.

In some embodiments, the size of the light guide channel 21 is preferably a size that diffracts the light passing through the light guide channel 21, that is, only a specific wavelength is diffracted, thereby achieving a color filtering function.

Specifically, the size of the light guide channel 21 diffracts a specific wavelength in the incident light to achieve light splitting, so as to distribute the light of each band on a pre-arranged photoelectric converter, that is, to make the light of the required band reach the photoelectric Converter, and unwanted light reaches the non-photosensitive area. After the photoelectric converter receives the corresponding band of light, it can synthesize a color image by processing the electrical signals provided by the photoelectric converter through an algorithm. The above process realizes a function similar to the Bayer array, and therefore, the Bayer array on the photoelectric converter can be eliminated in the embodiment according to the present invention, thereby further reducing the size.

As shown in FIG. 2, the height of the light guide channel 21 is h and the width is d. The maximum angle of the range of light passing through the light guide channel 21 on the object side is defined as 2α.

Among them, Tanα = d ÷ h, so α = arctan (d / h)

As shown in the figure, in a case where the collection angle of the light guide channel 21 is limited to 2α, the light guide channel 21 having a height h and a width d constrains a part of the object-side light. The constraint range is defined as the collection angle of the light guide channel 21 in the present invention, wherein the light on the object side can be transmitted to the image side through the light guide channel 21 only in the area of the collection angle. Object-side light outside this range is blocked by the spacer. In addition, the object-side area is divided into a collection area and a non-collection area. The relationship between the acquisition area and the image-side receiving area is restricted by the light guide channel 21 on the one hand, and controlled by the size of the photoelectric converter 3 on the other hand.

A photoelectric converter 3 is provided in the image-side receiving area to receive the object-side light. On this basis, the image-side photosensitive surface is composed of one or more imaging components 1. The light on the object side is transmitted to the photosensitive surface through the light guide channel 21, and is finally received by the photoelectric converter 3.

In the schematic diagrams shown in FIGS. 1 a to 1 d, only one cross section of an embodiment of the imaging module 1 according to the present invention is shown. It can be seen from the cross section that the spacer 2 has a plurality of light guide channels 21 arranged uniformly. In this embodiment, the imaging module 1 may have a plurality of cross sections similar to the cross section, and thus, the light guide channels 21 may form an array of the light guide channels 21 in the spacer 2, and accordingly, the photoelectric converters 3 and Since the positions of the light guide channels 21 correspond to each other, an array of photoelectric converters 3 is also formed.

Figures 1a to 1d also show the relationship between the position where the photoelectric converter 3 according to the present invention is provided and the acquisition area on the object side. In this mode, the photoelectric converter 3 of the present invention does not have a lens to constrain the received light, but receives light in all directions through the photoelectric converter 3.

The side of the photoelectric converter 3 facing the spacer 2 defines a photosensitive surface, and is located on an imaginary first boundary receiving surface formed on the image side through the acquisition range of each light guide channel 21.

The relationship between the setting position of the photoelectric converter 3 shown in FIGS. 1 a to 1 d and the acquisition area on the object side includes the following modes:

In FIGS. 1a to 1c, the photosensitive surfaces are respectively located above the first boundary receiving surface, coincide with the first boundary receiving surface, and below the first boundary receiving surface, but each photoelectric converter 3 receives a light guide channel. 21 rays of light; and

In FIG. 1 d, the light passing through the light guide channel 21 partially overlaps, and one photoelectric sensor receives light from the multiple light guide channels 21. In this case, software algorithms need to be used to reconstruct the received overlapping light information into a complete image.

In FIG. 1b and FIG. 1c, part of the light information is not received by the photoelectric converter 3.

In FIG. 1 a, there is no overlapping area of the light received by the photoelectric converter 3 through the light guide channel 21 from the object side, and the area of the photosensitive surface is the largest. In this case, the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel illuminates the entire light receiving surface of the corresponding photoelectric converter. Therefore, it is preferable that the photoelectric converter 3 is disposed at this position, wherein the black bars and the stripe grid bars in the figure are both the photoelectric converter 3.

It is worth noting that this is similar to the way in which the acquisition angle α is calculated by the above. In the actual design process, several basic parameters can be set, such as the height h, the width d, the collection angle α, and the distance between the light guide channel 21 of the light guide channel 21, and then use these basic parameters as the reference for the design. The positional relationship between the first boundary receiving surface on the image side and the light guide channel 21 is calculated step by step.

In this case, if you want the photoelectric converter to receive all light from the corresponding light guide channel, and the light corresponding to the light guide channel illuminates the entire light receiving surface of the corresponding photoelectric converter, the first demarcation receiving surface on the image side and The vertical distance H between the lower surface of the light guide channel 21 (ie, the lower surface of the spacer) can be determined by the following formula according to the size D1 of the corresponding photoelectric converter:

H = 0.5 * D1 / Tanα-0.5 * h

For example, in FIG. 1 a, the collection angle α is 45 °, that is, the height h and the width d of the light guide channel 21 are equal, then H = 0.5 * D1-0.5 * h.

In addition, for example, after the size of the photoelectric converter 3 is selected, the size of the light guide channel 21 is further determined, and the size is preferably such that no diffraction occurs. After satisfying the position on the second interface, the distance between the photoelectric converters 3 is determined, and thus the size between the light guide channels 21 is further determined. This design is advantageous in that the photoelectric converter 3 is preferably set to Receive the light from the light guide channel 21 next to it.

FIG. 3 shows a flowchart of a method of manufacturing the imaging module 1 according to the present invention.

The manufacturing method of the imaging module 1 includes the following steps:

S1: forming at least one light guide channel 21 in the opaque spacer 2;

S2: Set at least one photoelectric converter 3 parallel to and spaced from the spacer 2 and one-to-one corresponding to the light guide channel 21, so that light emitted by the object to be imaged passes through the light guide channel 21. After reaching the photoelectric converter 3.

In this method, the periphery of the light guide channel 21 is a spacer, and the spacer acts to block the light irradiated to the spacer, that is, the light guide channel 21 restricts the passage of light. The spacer may be made of a light absorbing material such as ferrous metal. In addition, in other embodiments, the spacer 2 may be coated with a light blocking layer, and the light blocking layer may be a diffuse reflection coating or a light absorbing coating. The size of the light guide channel 21 is preferably a size that does not cause light diffraction, that is, the size of the light guide channel 21 is preferably 800 nm or more.

4a to 4b are schematic diagrams of an embodiment of a touch screen 4 according to the present invention, wherein FIG. 4b is an enlarged schematic diagram of the A-A part in FIG. 4a.

As shown in FIGS. 4 a to 4 b, the touch screen 4 includes at least one spacer 2, at least one photoelectric converter 3, and a streamer 5. The spacer 2 is opaque and at least one light guide channel 21 is formed therein. The photoelectric converter 3 is parallel and spaced apart from the spacer 2, and can be set one-to-one corresponding to the light guide channel 21 so that the light emitted by the object to be imaged can reach the photoelectric converter 3 after passing through the light guide channel 21. The streamer 5 is located above the spacer 2.

In this embodiment, the periphery of the light guide channel 21 is a spacer, and the spacer acts to block the light irradiated to the spacer, that is, the light guide channel 21 restricts the passage of light. The spacer may be made of a light absorbing material, such as a ferrous metal. In addition, in other embodiments, the spacer 2 may be coated with a light blocking layer, and the light blocking layer may be a diffuse reflection coating or a light absorbing coating. The size of the light guide channel 21 is preferably a size that does not cause light diffraction, that is, the size of the light guide channel 21 is preferably 800 nm or more.

A detailed schematic view of the streamer 5 according to the present invention is shown in FIG. 5. As shown in FIG. 5, the streamer 5 includes a streamer 6, a light input section 7, and a light output section 8. The streamer 6 includes a total reflection plate 9. The light input portion is located in the streamer 6 and can output light at an angle to the total reflection plate. The light emitted from the light input section can be totally reflected in the streamer 6 and can be output from the light output section.

In this embodiment, the streamer 6 is implemented as a total reflection panel. In this paper, a total reflection panel is defined as a panel capable of total reflection. Therefore, the streamer 6 can perform a total reflection panel for light. In this way, the light can be continuously reflected in the streamer 5 to achieve the effect of flowing the light. Therefore, the streamer 5 has a light circulation area inside.

In addition, in this embodiment, the light input part of the streamer 5, that is, the light source, is located on the side of the streamer 5, and the light source on the side of the streamer 5 is used as the light input end. The other side of the streamer 5 serves as an output end of light.

The light in the streamer 5 may be invisible light such as near-infrared light or visible light. As long as the incident angle is controlled, total reflection will not be affected.

In this embodiment, the exterior of the streamer 5 is preferably the external environment, that is, ambient air. Therefore, the refractive index of the streamer 5 is preferably larger than that of air, so as to satisfy the condition that diffuse reflection occurs.

On the input area of the streamer 5, that is, on the upper surface of the streamer 5 shown in FIG. 5, when a substance replaces the original external environment, that is, when the condition of total reflection of the streamer 5 is not established, Because, for example, the sweat on the surface of the finger of the user, or even the refractive index of the texture of the skin of the finger of the user, the refractive index of sweat is higher than the refractive index of air, the total reflection conditions of the light in the streamer 5 are not established, so that light passes through the streamer The upper surface (input area) of 5 reaches the user's finger.

The finger surface itself is highly inconsistent. Generally speaking, the finger surface is divided into a ridge line and a valley line, wherein the ridge line is a skin texture higher than the valley line. During the contact of the finger with the touch screen 4, the ridge lines on the surface of the finger are in contact with the surface of the streamer 5 and the valley lines are not in contact with the surface of the streamer 5, wherein the surface of the streamer 5 is preferably a transparent medium, such as glass. Therefore, the light irradiated on the glass surface where the fingerprint ridge line touches is diffusely reflected, while the light irradiated on the glass surface corresponding to the fingerprint valley line is totally reflected. Because the valley line is not in contact with the glass surface and air is present, total reflection still occurs. Therefore, in the information captured by the photoelectric converter 3, the light intensity corresponding to the ridge line of the fingerprint is high and the light intensity corresponding to the valley line of the fingerprint is low.

In the embodiment, the photoelectric converter 3 is preferably a CCD or a CMOS sensor. Taking the output image as an example, after receiving the light signal, the part corresponding to the fingerprint ridge line is darker, and the part corresponding to the fingerprint valley line is lighter.

In this embodiment, since the photoelectric converter 3 receives the signal of the light intensity change after the finger is pressed, based on the original photoelectric converter 3, the user outputs a stimulated signal at the corresponding position of the photoelectric converter 3 when the user presses his hand . In this method, the light intensity of the natural light received from the external environment is taken as an example as a reference signal. Of course, the reference signal can be set artificially according to different usage scenarios.

Based on the change of the excited signal of the photoelectric converter 3 with respect to the reference signal, it can be known that an object is pressed on the streamer 6.

In addition, from the change in the value of the signal, the magnitude of the force with which the object is pressed can be obtained. Specifically, taking a fingerprint unit that is divided into relatively small areas on a finger as an example, the size of the contact area indicates the magnitude of the contact force. When the pressing force is increased, the finger muscles are deformed, resulting in a larger contact area between the skin texture and the upper surface.

In addition, since there are blood vessels on the finger, the blood vessels will beat over time, so the contact between the finger and the touch screen 4 will change slightly. For example, the ridge on the texture of the finger causes different effects on light due to the blood vessels. Therefore, the living body detection can be performed using the touch screen 4 in this manner.

In addition, the sweat holes on the texture of the finger are also equivalent to the valleys in the texture of the finger. When the finger and the touch screen 4 also do not affect the anti-reflection, the brightness is low, so it can also be used as a method of living body detection.

6a to 6c are schematic diagrams illustrating another embodiment of a touch screen 4 according to the present invention. In the embodiment of the touch screen 4, the pressure is measured by setting an elastic structure 9 above the corresponding light guide channel 21. Specifically, as shown in FIG. 6a, the elastic structure 9 is preferably a transparent material, such as a film.

As shown in FIG. 6b to FIG. 6c, after the user presses the film with a finger, the position and shape of the film changes as the user presses, that is, the optical properties of the film are changed when the user presses the elastic structure 9. In this way, when pressing with different forces, the light information also changes accordingly. In this embodiment, the elastic structure 9 is preferably disposed above the imaging module 1.

As can be seen from FIGS. 6 b to 6 c, the light emitting unit 10 is alternately provided with the unit imaging module 1. Specifically, reference is made to the arrangement manner of the light emitting elements of the OLED screen. Therefore, when a user's finger presses on the elastic film, the elastic film is bent or deformed, and thus the optical properties of the elastic film are changed accordingly. In this case, a portion of the light originally emitted from the light-emitting unit to the elastic film is reflected to the photoelectric converter 3. As the pressing force increases, the amount of light received by the photoelectric converter 3 also increases, so a change in the pressing force can be obtained. Further, the pressing force can be measured by the relationship between the pressing force and the amount of light information.

7a to 7b are schematic diagrams of another embodiment of a touch screen 4 according to the present invention. In this embodiment, another method is adopted to measure the pressing force on the touch screen 4. This embodiment is similar to the embodiment shown in FIGS. 6 b to 6 c, and also has an elastic structure 9 located above the imaging module 1. The difference is that, as shown in FIG. 7 a, this embodiment does not include a light emitting unit, but a filling blocking block 11 is provided in the elastic structure 9.

Specifically, in the embodiment, a filling blocking block 11 is provided in the elastic film, and a single imaging module 1 receives an image of the blocking block. As the pressing force is different, the size of the image formed by the blocking block is also different. At the same time, the size of the blocking block in the image formed in each unit imaging component 1 is related to the pressure, so that the force application point and the force area can be measured. Specifically, when used in conjunction with an OLED screen, some areas can be set up specifically for measuring pressure.

The application also includes a camera module. The camera module includes the imaging module 1 and a display screen. The imaging component 1 is located below the display screen.

In this embodiment, the plurality of imaging components 1 are combined with one of the existing OLED screen, LCD screen, and LED screen to form a device capable of shooting and displaying.

This embodiment satisfies the current development trend of full screens of mobile terminals such as mobile phones, saves the front camera, and can further increase the screen ratio of the display screen.

Taking an OLED screen as an example, the OLED screen includes a substrate, a cathode layer, an anode layer, and a light emitting layer (organic light emitting diode, OLED). There is now a new OLED-based technology-Flexible Organic Light Emitting Display (Flexible OLED, FOLED). This technology can make highly portable, foldable display technology suitable for the present invention in the future.

In this embodiment, the imaging module 1 is used in conjunction with an OLED screen, and includes a structure for carrying and packaging a substrate, a cover plate for protection, a photoelectric converter 3 for receiving light and transmitting information, and the above-mentioned OLED screen. This spacer is used to block light.

When used with FOLED, because FOLED technology can make flexible bodies, the structure in this way is the substrate, cathode, anode, and light-emitting layer. Specifically, in this manner, a flexible substrate is made of a soft material. In this way, the package is portable and bendable. For example, a metal foil is used as the substrate of the FOLED, a conductive polymer (flexibility) is used to replace the ITO film layer in the anode, and the overall structure of the FOLED is realized by using a multilayer film encapsulation method.

In addition, in an actual structure, as the substrate of the package, the substrate may be a transparent material or an opaque material, so the substrate may be preferably used as a spacer.

In addition, it is worth noting that, as a structure for emitting light, the anode layer is generally implemented as a light-transmitting ITO film. In this way, the cathode layer can also be used as a spacer.

In addition, in the inverted structure (IOLED), the cathode layer is used as the light emitting layer, and in this manner, the anode layer can also be used as the spacer.

By flexing the flexible body, the shooting range can be increased, enabling multi-angle changes. The imaging module 1 can be disposed on a substrate, and in the circuit, the anode and cathode of the OLED can be used as a power source. The OLED light emitting layer may be disposed between every two light guide channels 21.

It should be understood that although in this embodiment, the imaging module 1 is combined with an OLED screen, in a similar solution, for example, the imaging module 1 may be combined with an LED screen and an LCD screen, which does not limit the present invention.

FIG. 8 is a schematic diagram of an embodiment of a camera module according to the present invention. Specifically, when combined with an LED screen or an LCD screen, the liquid crystal layer 12 in the screen can serve as a propagation channel for turning on or off light. Therefore, in this way, the function of the imaging module 1 for external shooting can be realized. The liquid crystal layer acts like an aperture in a camera. Here, the liquid crystal layer controls the amount of light diffused on the image plane by controlling the amount of light entering the light guide channel 21, so the combined method in this embodiment can adjust the amount of light entering to blur the background. Therefore, the diameter of the diffuse circle becomes larger when the aperture becomes larger (when the amount of light is increased), thereby reducing the depth of field, that is, the background is not easy to image clearly, and the diameter of the diffuse circle becomes smaller when the aperture becomes smaller, that is, when the amount of light decreases , So that the depth of field becomes larger, so that the background is easy to image clearly.

FIG. 8 shows that the depth of field range is adjusted by controlling the liquid crystal layer. In this way, different background blur effects can be achieved depending on the depth of field range.

In addition, under such a background blurring method, a method of controlling the photoelectric converter 3 interval may be adopted to achieve the effect of further expanding the receiving range. For example, by operating the first photoelectric converter and the third photoelectric converter, closing the second photoelectric converter and the fourth photoelectric converter, and no longer receiving cross light, so as to expand the working range of the photoelectric converter, that is, clear imaging The object distance becomes larger.

In this embodiment, the light guide channel 21 is preferably a circular hole. Of course, since the light guide channel 21 may be extremely small compared to an object, in the case of satisfying the imaging of a small hole, other shapes of holes may also be selected. However, it is preferable that the graph is symmetrical about the central axis, so that the light information collected by the photoelectric converter 3 through the light guide channel 21 is symmetrical, so as to facilitate later calculation and processing.

The light from the minute details of the object located on the object side passes through the light guide channel 21 with diffuse reflection. Since the light guide channel 21 restricts the range of light passage, when the diffusely reflected light passes through the light guide channel 21, a channel is formed on the image side. The similar shape is thus formed by the tiny details of the object being continuously superimposed by the light formed by the light guide channel 21. Therefore, under this theory, selecting a hole with a central axis symmetrical shape can increase the resolution of the image during the process of superimposing the light of the minute details into an image of the object.

When the object is square and the light guide channel 21 is circular, the boundary of the image is circular, and the resolution is not high at this time.

When the object is square and the light guide channel 21 is square, the boundary of the image is square, and then the resolution is high.

In this embodiment, the minimum resolution is the light passing through the light guide channel 21 on the image side with minute details located on the object side.

In addition, by using the light-emitting function of the OLED screen itself, when the light is irradiated onto the object, the light diffusely reflected by the object is received by the photoelectric converter 3 through the light guide channel 21, and the light diffusely reflected by the object can be received. Therefore, in this way, such as fingerprint recognition, self-timer.

A fingerprint identification function can also be implemented in this embodiment. The imaging component 1 is similar to the above-mentioned imaging component 1, and specifically, according to the occluded image, the subject and the size of the photographed object or the size of the contact surface can be determined.

9a to 9b are schematic diagrams illustrating another embodiment of a camera module according to the present invention. Specifically, FIGS. 9a to 9b illustrate an imaging process of a camera module according to the present invention. As shown in FIG. 9a to FIG. 9b, in this embodiment, the object itself emits light or emits light through diffuse reflection, and the light passes through the light guide channel 21 in a straight direction, and the unit imaging component 1 undergoes small hole imaging.

After the light passes through the light guide channel 21, it is received by the photoelectric converter 3. The photoelectric converter 3 then receives the signal, processes it and outputs an image, thereby outputting an object image.

Referring to FIG. 9b, when the object is at the boundary, it is between the first imaging component 1 and the second imaging component 1, so that the first imaging component 1 and the second imaging component 1 collect complete information of the object. Therefore, only the information received by the first imaging component 1 and the second imaging component 1 can be superimposed to obtain a complete picture of the object.

Referring to FIG. 9a, when the object is outside the dividing line, for example, when the object is within the acquisition angle of the first imaging module 1 to the sixth imaging module 1, the images acquired by the first imaging module 1 to the sixth imaging module 1 The information has overlapped multiple times. After the images of the overlapping objects are merged, the non-overlapping information can also be superimposed to output the image of the complete object. This method uses many photoelectric converters 3, but has a large shooting range.

The imaging module adopts the above-mentioned method to photograph an object. For example, in this way, the screen can be scanned and scanned against a person's business card or the surface of the object, so the surface information of the object can be taken at a short distance, that is, the short-range shooting can be performed with high accuracy.

FIG. 10 shows a schematic diagram of another embodiment of a camera module according to the present invention. Different from the above embodiments of the camera module, an optical element for converging parallel light is provided above each of the imaging components 1 in this embodiment. The optical element is, for example, a convex lens 13, thereby further restricting the acquisition angle of the imaging component 1.

As shown in FIG. 10, the imaging angle of the imaging component 1 is to perform imaging of small holes by receiving only parallel rays. Therefore, in this manner, the collection angle of the imaging component 1 is a fixed angle, that is, the width of collecting parallel light is achieved. Because this method reduces the problem of overlapping information of objects outside the dividing line in the above embodiment, in this method, only a simple superimposition process can be performed after the image is acquired to form an image. In this way, an object at a certain distance can be photographed with high accuracy.

FIG. 10 shows an ideal case, and the corresponding photoelectric converter 3 is configured to collect parallel light rays with a fixed width passing through the light guide channel 21 in the optical design, thereby improving the utilization ratio of the photoelectric converter 3. In addition, optionally, different convex lenses 13 may be provided. Although the overlap area is increased in this way, the acquisition angle becomes larger, and the shooting range becomes larger.

In addition, it should also be understood that the light can be focused by the convex lens 13 corresponding to the photoelectric converter 3 or the concave lens facing away from the photoelectric converter 3.

As shown in FIG. 11, this embodiment collects only the light in the parallel area of the object-side part, thus eliminating the interference of unnecessary stray light. For the same reason, in the operations such as calculating the obtained image in the later stage, the information of each photoelectric converter 3 is facilitated to be stitched, so the calculation is simpler.

FIG. 12 is a schematic diagram of another embodiment of a camera module according to the present invention. Different from the above-mentioned embodiment of the camera module, each of the imaging components 1 in this embodiment is provided with a super lens 14 on a side close to the photoelectric converter 3 to focus light.

The super lens 14 allows light to be focused. Specifically, the nano-structures in the super lens 14 having a size smaller than the wavelength of light are used to condense light. These structures can have different shapes, sizes, and arrangements, so that photons are blocked, absorbed, enhanced, and refracted, so that the super lens 14 can achieve focusing of light. Such a super lens 14 is provided above the single imaging module 1, preferably above the photoelectric converter 3. This has the advantage that the light passing through the light guide channel 21 can be converged to a smaller range, thereby increasing the light brightness. This method is particularly suitable for the case where the number of photoelectric converters 3 in the imaging module 1 is not large, and it is ensured that the light information received by each photoelectric converter 3 is sufficient, so that compared with the method without the super lens 14, the shooting has high brightness . The super-lens 14 cancels the effect of part of the light after the light is diffracted, improves the degree of convergence, and at the same time eliminates part of the stray light.

The super lens 14 can also realize filtering. Diffraction of light of different wavelengths according to the size of the super lens 14 is realized so as to not only converge light, but also to receive only light in the wavelength range. In this way, the Bayer filter in the camera module can be cancelled. The RGB algorithm in the later period is defined according to the positions of the diffraction of different wavelengths on the design, and the size is further reduced by removing the filter.

In this embodiment, when the photoelectric converter 3 in the imaging module 1 is selected as an RGB pixel, color photography can be performed, and when it is selected as a monochrome pixel, it is easy to manufacture, and at the same time, it is suitable for a photographing method with lower requirements such as fingerprint recognition.

Of course, it should be understood that the deformation in this way can also be combined with the LCD.

FIG. 13 is a schematic diagram of another embodiment of a camera module according to the present invention. Different from the previous embodiment of the camera module, each of the imaging components 1 in this embodiment is provided with a light path turning element 15 on the light guide channel 21 to turn the light path.

Specifically, it is preferable to add a mirror through a MEMS device. The MEMS micro-electromechanical system can also realize the moving reflective surface, so as to realize large-angle shooting, so the scanning shooting mode can be realized without moving the entire imaging device. As mentioned above, when the imaging device increases with the shooting distance, the images obtained by the single imaging component 1 are superimposed. This partially overlapping image has repetitive information that is suitable for processing between the two images. Therefore, compared with the shooting mode that requires the mobile phone to be rotated for panorama, the image obtained by the camera module of the present invention is more stable, and the picture has no stitching marks.

In addition, in this embodiment, superposition processing is performed on the information of the overlapped central area, so the resolution of the central area of the image is high. At the same time, because only a few imaging components 1 receive the area around the image, the edges are relatively unclear, thereby achieving edge blurring.

The present application also provides a method of distance sensing, that is, a long-range imaging method. FIG. 14 shows a flowchart of a method for distance measurement according to the present invention.

The method includes the following steps:

S1: forming a plurality of light guide channels 21 in the opaque spacer 2;

S2: The plurality of photoelectric converters 3 are arranged parallel to and spaced from the spacer 2 and respectively correspond to the light guide channels 21 so that the light emitted by the object to be imaged passes through the light guide channels 21 and reaches the photoelectric converter 3 ;

S3: obtaining a plurality of images formed by the object to be imaged through the plurality of light guide channels 21 according to the electrical signals output by the photoelectric converter 3; and

S4: Calculate the distance to the object to be imaged according to the degree of repetition of the multiple images.

Specifically, in the manner in which the imaging module 1 and the OLED screen of the above embodiment are matched, the OLED screen emits light, and the light emitted by the screen is diffusely reflected by the subject, and then received by the imaging device. The image of the object. In the above process, in the imaging method mentioned in this application, the image obtained by photographing an object will have different degrees of repetition at different boundaries. The degree of repetition refers to the repeated pixel area of the entire object or a certain part, and the distance of the object from the camera module can be judged by the repeated pixel area.

15a to 15d show schematic diagrams of an embodiment of a method for distance measurement according to the present invention.

In this embodiment, an image is output after a single imaging component 1 captures an object. Then, the degree of repetition of an object or a local repetitiveness of the object in the output images from different single imaging components 1 is determined.

Referring to FIG. 15a to FIG. 15d, after distinguishing between different images, using different boundary lines as a reference to identify the degree of repetition, the boundary lines are used for calibration, and the degree of image repetition is calculated.

For example, as shown in FIG. 15a, an object or a part of an object is photographed only between a first boundary line and a second boundary line. In actual use, in this way, the user can take an object close to the imaging module 1 and perform a pre-calibration. For example, the pre-calibration may be performed after the user places the object at a predetermined distance, for example, the object is photographed at 20 cm, and the 20 cm is assumed to be the first dividing line.

In this way, the surface of the object needs to have different colors from the external environment in order to determine the characteristics of the object, so that in the later image information, the distance of the object is determined according to the degree of repetition of the object information.

Since the repetition rate is different between different dividing lines, this is also preset by means of calibration. The advantage of pre-calibration is that the distance can be detected in real time after the object moves. When shooting, you can change the corresponding focal length after recognizing the distance, so you can shoot the subject in time. Therefore, with this method, dynamic focusing can be achieved, and even real-time focusing can be achieved. Of course, when shooting common objects in daily life, first, for pre-stored images such as the user, when performing live or video shooting, as the distance continuously changes, fast and clear object output can also be achieved.

FIG. 16 is a schematic diagram of another embodiment of a camera module according to the present invention. It was mentioned above that the OLED screen can be implemented as a flexible screen. As shown in FIG. 16, in this embodiment, a driver 16 is provided on the substrate of the OLED screen to adjust the distance and degree of bending of the photoelectric converter 3 and the light guide channel 21 in a single imaging module 1. The driver 16 is preferably provided on a substrate below the photoelectric converter 3.

In this embodiment, the distance between the photosensitive surface and the light guide channel 21 may be adjusted or the depth of field of different single imaging components 1 may be different.

In addition, the photosensitive surface can be bent to adjust the focus of the photosensitive surface.

As shown in the figure, this method can take an image with a blurred background.

In another embodiment, similar to the OLED method, the color filter in the LCD structure can also be integrated as the color filter in the imaging device according to the present application, that is, the color filter structure is shared by the imaging screen and the camera module. . This method can also achieve color stitching. Of course, lenses can also be used instead of filters.

In another embodiment, the aperture of the light guide channel 21 is controlled. When the aperture is close to a certain wavelength, the light of that wavelength passes through the light guide channel 21 and a diffraction phenomenon occurs. By using the selectivity of the diffraction hole for light in a specific wavelength range, a color filtering function in a certain wavelength range can be realized, and the color filter can be eliminated.

The application also provides a light field camera. The light field camera may have a microlens array, and may further include: a spacer 2 which may be opaque and at least one light guide channel 21 formed therein; and at least one photoelectric converter 3, which may be spaced from the spacer The pieces 2 are parallel and spaced apart, and can respectively correspond to the light guide channels 21 one by one.

The microlens array may be located between the spacer 2 and the photoelectric converter 3, and the light emitted by the object to be imaged passes through the light guide channel 21 and the microlens array and reaches the photoelectric converter 3.

FIG. 17 shows a schematic diagram of a related art light field camera. As shown in the figure, the conventional light field camera records the light by adding a micro lens array at the focal length of a common lens, and then realizes digital refocusing through a post-processing algorithm.

The corresponding light of the subject passes through the main lens and is imaged, passes through the micro lens array, and is imaged again at the 3-pixel photoelectric converter behind the micro lens array. After the subject passes through the lens, each micro lens in the micro lens array is used to form an image on a pixel area of a different photosensor.

Any light passes through the lens microelements, microlens array microelements and photoelectric sensor in a conjugate relationship in its optical path. Information on the direction of light can be obtained from this relationship. In FIG. 17, a planar space is taken as an example, and a three-dimensional space may be deduced by analogy.

18a to 18b show schematic diagrams of a related art light field camera.

Since the focal length of the microlens is much smaller than the focal length of the main lens, the main lens can be regarded as being located at infinity of the microlens lens. Therefore, for example, it can be considered that a vertical bar area on the main lens in FIG. 18a passes through a microlens and is focused on a pixel behind the microlens. Since the microlens is a few hundredths of the main lens, It is thought that this one sensor chip pixel collected all the light information inside the other color line. In this way, a light ray inside the camera is recorded. Similarly, other pixels also correspond to one light.

Similarly, as shown in FIG. 18b, the light-sensitive chip pixels behind each microlens can also be regarded as light transmitted from different areas of the lens. Since the position of each pixel is fixed, the position of the microlens corresponding to each pixel is also fixed. Since the light travels in a straight line, the direction information of the light can also be obtained.

Light field cameras usually also need to have a refocus function. FIG. 19 shows a refocusing principle diagram of a conventional light field camera.

Since the directional information and intensity information of all rays have been obtained through the microlens array and the photoelectric converter 3, all the rays are transformed by a simple similar triangle similarity by matching the algorithm corresponding to the microlens array 17 and the pixel arrangement position of the photosensitive chip You can focus the image on different planes.

FIG. 20 shows a refocusing effect diagram of a conventional light field camera. As shown in the figure, when shooting, the focus is on the rear blinds, and the focus is shifted to the portrait after refocusing.

FIG. 21 shows a schematic diagram of an embodiment of a light field camera according to the present invention. In this embodiment, an array of light guide channels 21 is used instead of the main lens of a conventional light field camera.

Due to the refocusing function of the light field camera, the camera module does not need to be accurately calibrated during assembly, and the defocused image can also be refocused by an algorithm.

Equipped with a light field camera reduces the assembly accuracy requirements of the camera module, thereby reducing production costs.

FIG. 22 shows a refocusing effect diagram of an embodiment of a light field camera according to the present invention. An f / 4 aperture is used in the image shown on the left in FIG. 22. Due to the small depth of field, when focusing on the person in the middle of the picture, the person in the picture below cannot be clearly imaged.

In the image shown in the middle of FIG. 22, a smaller aperture of f / 22 is adopted, the depth of field becomes larger, and most people are clearly imaged. At the same time, due to the insufficient amount of light, more noise appeared, and the imaging quality deteriorated.

A sufficient amount of image depth information was collected at the time of shooting in the image shown in the right part of FIG. 22. In the later period, multiple refocused images with different focal lengths are obtained through the refocusing algorithm. The sub-images received by each sensor chip pixel are traversed through the re-focused images, and the depth of the sub-pixel at a sharpest re-focused image is taken as the sub- The depth of the image and refocus the sub-image. Then, these refocused sub-images are stitched together, so that the entire frame has a better imaging effect, achieving a large depth of field without sacrificing brightness and no noise.

The above is the case when a light field camera is used in combination with a conventional lens imaging system. The depth (object distance) is different, which affects the sharpness of the imaging. However, the method of subpixel traversing the depth of the refocused image to obtain the clearest depth cannot achieve accurate depth.

The depth accuracy taken by the sub-pixel is affected by the depth distribution of the refocused image sequence taken, and also by the sharpness evaluation algorithm.

In this embodiment, the main lens is replaced with an array of the light guide channel 21. The change in the imaging depth (object distance) of the array of the light guide channel 21 will only change the image size and image acquisition range. . Algorithmically, as long as the image with a larger acquisition range (or a smaller magnification is appropriate to contain the image whose depth is needed) is compared, each sub-pixel is compared with the corresponding area in the image to obtain a size ratio relationship. You can get depth information.

Compared with a light field camera using a main lens, the embodiment according to the present invention has the advantages that:

The main lens is replaced with an array of light guide channels 21, and all images have the same sharpness. It is only necessary to take an image of a certain depth and let all the photosensitive pixel sub-images traverse the comparison size magnification, which requires less calculation. In other words, the depth of each sub-pixel obtained using the scheme of the main lens is the depth in the pre-fetched refocused image sequence, and the accuracy also depends on the step size of the depth of the refocused image, but the more you obtain, the greater the amount of calculation .

In other words, the solution using the main lens is to first prepare a set of answer libraries, and then use the photo sensor chip image to compare the answers with the depth of the closest answer. Whether the depth calculation is accurate depends on whether the answer library is prepared. The solution using the array of the light guide channels 21 is to obtain the solutions of all the answers through the solution of the problem with the largest amount of information, so all the sub-pixel images of the photosensitive chip can rely on this problem to solve the depth.

The calculation of the depth in this embodiment is based on the following: the comparison of the corresponding image size and magnification is compared with the comparison of the sharpness of a conventional light field camera, and the judgment basis is more accurate and the obtained depth is more accurate.

In addition, if the object distance is less than double the focal length of the main lens, it is a virtual image, and the light that is a real image of the other parts passes through the micro lens array and falls on the chip at the same time. Because the virtual image and real image need to be refocused with different algorithms, that is, the virtual image needs to be processed by additional algorithms, it is difficult for the two rays to be distinguished by the chip and processed differently. Therefore, it is difficult to implement a light field camera using a conventional lens imaging system. Macro shooting.

In this embodiment, the lens in front of the traditional light field camera is replaced with a clear light channel. Regardless of the relationship between the object distance and the focal length, the image is a real image. The unified image algorithm can be used for refocusing to achieve a large macro distance. The effect of depth of field shooting.

In addition, the disadvantage of light field cameras is insufficient spatial resolution. With the same number of pixels, a conventional camera records a two-dimensional image, and the number of pixels is completely used. The light field camera records the four-dimensional image and then integrates to generate a two-dimensional image. Information is lost during the integration process, that is, the planar dot matrix is changed to a linear dot matrix, the number of pixels in the two-dimensional image is reduced, and the consequence is insufficient spatial resolution.

The spatial resolution is directly proportional to the number of microlens arrays. If a conventional mobile phone camera module is equipped with an array imaging system with a light guide channel 21, the maximum number of microlenses is limited by the amount of light transmitted, that is, limited by the aperture of the diaphragm. limited. And the light flux of the optical system imaged by the light guide channel 21 can be realized by expanding the distribution of the light flux channel, and there is a huge space for improving the light flux. This can greatly make up for the lack of spatial resolution of the light field camera.

FIG. 23 is a schematic diagram showing another embodiment of a light field camera according to the present invention. In this embodiment, an advanced lens and an outsole photosensitive chip are used. This embodiment is different from the above embodiment in that the above embodiment replaces the main lens of a conventional light field camera with an array of light guide channels 21, while this embodiment replaces the micro lens array with an array of light guide channels 21.

After the microlens array of the light field camera is replaced with the array of the light guide channel 21, the scalability of the array of the light guide channel 21 and the screen allows the mounted photosensitive chip to be designed to be larger to suit the advanced lens. Performance, so that the lens design is no longer limited by the photosensitive area of the chip.

The present invention proposes a multi-eye depth camera, which uses the method of staggering the light guide channels 21 to achieve corresponding superimposition of the acquired images and realizes the effect of performing depth recognition on objects within the overlapping range. FIG. 24 shows a schematic diagram of an embodiment of a multi-eye depth camera according to the present invention. As shown in the figure, the multi-camera depth camera includes: a spacer 2 which is opaque and forms a plurality of light guide channels 21 therein; and a plurality of photoelectric converters 3 which may be parallel to the spacer 2 They are spaced apart and can correspond to the light guide channels 21 one-to-one respectively, so that the light emitted by the object to be imaged can pass through the light guide channel 21 and reach the photoelectric converter 3. The central axes of the light guide channels 21 may be staggered with each other.

Because the included light guide channels 21 are angled, the images of objects at different angles are superimposed to form a depth image of the object during imaging. The application of the triangle theorem can be used to measure the distance of an object, and it can also further measure the characteristic information of the object surface. In this way, it is also required that the surface of the object has a difference from the external environment as a criterion for judgment.

The present application also provides a pixel color filter array device for use with a light guide channel. The pixel color filter array may include: a substrate; a dielectric layer attached to the substrate; and a plurality of pixel color filters attached to the dielectric layer to form an array. The dielectric layer is one of the photoelectric converter 3 and the display screen.

The present application also provides a method for forming the pixel color filter array device. The method for forming a pixel filter array may include the following steps: setting a substrate; attaching a dielectric layer to the substrate; transferring a three-color filter to a carrier board in an RGB array by a pad printing method to form a color filter An array; coating a transparent adhesive on the substrate; and bonding the entire color filter array on the carrier to the dielectric layer. The dielectric layer is one of the photoelectric converter 3 and the display screen.

FIG. 24 shows a flowchart of a prior art photocopying process.

It is known in the art that the manufacture of photomasks is a key part of the process connection, the most costly part of the lithography process, and one of the bottlenecks that limit the minimum line width. Traditional photolithography requires a large area mask when manufacturing a large area chip array.

The imaging principle of the photosensitive chip requires the Bayer array color filter array to be arranged on each pixel. Since the color filter has three types of RGB (RGB channels as an example), it needs to be applied to the pixels of the photosensitive chip through three photolithography processes. As shown in FIG. 24, after 6 steps, a color filter material is applied in the photoresist gap with a specific pattern, and then the photoresist is removed by light. After the above step, another color filter material is applied. , And finally process another color filter material.

Because there are three sets of similar processes, there are certain restrictions on the selection of color filter materials and processing techniques. The subsequent photolithography process must not affect the previously formed color filter area. For example, thermoplastic materials (thermal curing reversible) are not optional. Material); solvent filters cannot be selected to obtain color filters, the latter solvent will re-dissolve the solute obtained from the previous solvent.

In addition, the RGB color filter material has a high utilization rate of incoming materials. In the traditional photolithography process, a layer of color filter material needs to be vapor-deposited or sputtered on the surface of the photosensitive chip on which a specific shape of the photoresist is laid, and then the photoresist is removed through a certain stripping process, and at the same time the adhesion The color filter material on its surface leaves the color filter material evaporated in the photoresist tank. Therefore, the color filter material attached to the surface of the photoresist is wasted.

In this embodiment of the present invention, since the pad printing method is adopted, the color filter material is first made into a whole plate by a method such as evaporation. In the pad printing process, the color filter material needs to be placed on an elastic carrier having a certain elasticity The board is cut into desired units by means of laser cutting. When the pad is pressed down, these color filter units will be attached to the pad, and the interval between them will become larger. Then, the pad is further expanded by means of inflation or mechanical support, and the interval between the color filter units is further expanded. If this step is not performed, the color filter unit is transferred from the pad to the transfer carrier board, and the interval will be restored to the gap on the flexible carrier board.

The specific flow of the pad printing process is shown in FIG. 25. Specifically, in this process, firstly, a first color filter array 31 is set on the transfer carrier plate 30, and then, through three sets of pad printing processes, the pad heads 32 are used to respectively align the three color filters into the RGB arrays as required. The arrangement is transferred from the intermediate carrier plate 30 to the elastic carrier plate 33 to form a second color filter array 34, wherein the pad 32 is expanded during the transfer process so that between the color filters of the first color filter array 31 The gap is suitable for the gap between the color filters in the second color filter array 34. Then, by transparently coating the photosensitive chip on the photosensitive chip, the entire RGB color filter array on the carrier board is bonded to the photosensitive chip array without complicated photolithography process and its auxiliary components and equipment. The choice of material and molding process is relatively free.

In this embodiment, the degree and shape of the pad expansion by reasonably setting the mechanical support or inflation makes the arrangement of the color filter units when transferred to the transfer carrier board equal to the arrangement of the same color filter units on the photosensitive chip. cloth.

In addition, by reasonably setting the areas on the pad with adhesive force to the color filter material, the flat plate color filter unit can be used, and the material loss is only the loss during laser cutting and dividing.

Through three sets of pad printing processes, the three-color filters are transferred to a carrier plate according to the required arrangement of the RGB array, and then the transparent adhesive material is spin-coated on the photosensitive chip, so that the entire RGB filter array on the carrier board is stuck Connected to the photosensitive chip array. The reason for not directly printing on the photosensitive chip is that in order to evenly distribute the glue material, it is necessary to spin-coat the glue material.

The adhesion of the color filter material is as follows: transit carrier board> pad printing head> elastic carrier board

It is easy for those skilled in the art of the present invention to think that similar processes can be used in places such as LEDs that need to arrange color filter materials for arrays or chips and other original photolithography processes.

The above description is only the preferred embodiment of the present application and the explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solution of the specific combination of the above technical features, but should also cover the above technical features without departing from the inventive concept. Or other technical solutions formed by any combination of equivalent features. For example, a technical solution formed by replacing the above features with technical features disclosed in the present application (but not limited to) with similar functions.

Claims

An imaging component, comprising:

A spacer, which is opaque and forms at least one light guide channel therein; and

At least one photoelectric converter, the photoelectric converters are parallel and spaced from the spacer, and are arranged one-to-one corresponding to the light guide channels, so that the light emitted by the object to be imaged passes through the light guide channels Reach the corresponding photoelectric converter.
The imaging module according to claim 1, wherein the spacer forms a plurality of light guide channels, and the plurality of light guide channels form an array of light guide channels in the spacer.
The imaging module according to claim 1, wherein a size of the light guide channel is set to 800 nm or more.
The imaging module according to claim 1, wherein the size of the light guide channel is set to be diffracted at a specific wavelength in the passing light to perform light splitting so that the light of a specific wavelength band reaches a preset photoelectric converter.
The imaging module according to claim 1, wherein the spacer is made of a light absorbing material.
The imaging module according to claim 1, wherein the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel irradiates the entire light receiving surface of the corresponding photoelectric converter.
The imaging module according to claim 1, wherein the spacer is coated with a light blocking layer.
The imaging module according to claim 7, wherein the light blocking layer is a diffuse reflection coating or a light absorbing coating.
A method for manufacturing an imaging component, comprising the following steps:

Forming at least one light guide channel in the opaque spacer;

At least one photoelectric converter is arranged parallel to and spaced from the spacer, and one-to-one corresponding to each of the light guide channels, so that the light emitted by the object to be imaged passes through the light guide channel and reaches the photoelectric conversion Device.
The method according to claim 9, wherein the spacer forms a plurality of light guide channels, and the plurality of light guide channels form an array of light guide channels in the spacer.
The method according to claim 9, wherein a size of the light guide channel is set to 800 nm or more.
The method according to claim 9, wherein the size of the light guide channel is set to be diffracted at a specific wavelength in the passing light to perform light splitting so that light of a specific wavelength band reaches a preset photoelectric converter.
The method according to claim 9, wherein the spacer is made of a light absorbing material.
The method according to claim 9, wherein the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel irradiates the entire light receiving surface of the corresponding photoelectric converter.
The method according to claim 9, wherein the spacer is coated with a light blocking layer.
The method according to claim 15, wherein the light blocking layer is a diffuse reflection coating or a light absorbing coating.
A touch screen, comprising:

A spacer, which is opaque and forms at least one light guide channel therein; and

At least one photoelectric converter, the photoelectric converters are parallel and spaced from the spacer, and are arranged one-to-one corresponding to the light guide channels, so that the light emitted by the object to be imaged passes through the light guide channels Reach the photoelectric converter; and

A streamer, which is located above the spacer, and includes:

Streamer, including total reflection plate;

A light input portion located in the streamer and outputting light at an angle to the total reflection plate; and

A light output section, in which light emitted from the light input section is totally reflected in the streamer, and is output from the light output section.
The touch screen of claim 17, wherein the light guide channel forms an array of light guide channels in the spacer.
The touch screen according to claim 17, wherein a size of the light guide channel is set to 800 nm or more.
The touch screen according to claim 17, wherein the size of the light guide channel is set to be diffracted at a specific wavelength in the passing light to perform light splitting so that light of a specific wavelength band reaches a preset photoelectric converter.
The touch screen according to claim 17, wherein the spacer is made of a light absorbing material.
The touch screen according to claim 17, wherein the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel illuminates the entire light receiving surface of the corresponding photoelectric converter.
The touch screen according to claim 17, wherein the spacer is coated with a light blocking layer.
The touch screen according to claim 23, wherein the light blocking layer is a diffuse reflection coating or a light absorbing coating.
A touch screen, comprising:

A spacer, which is opaque and forms at least one light guide channel therein; and

At least one photoelectric converter, the photoelectric converters are parallel and spaced from the spacer, and are arranged one-to-one corresponding to the light guide channels, so that the light emitted by the object to be imaged passes through the light guide channels Reach the photoelectric converter;

A transparent elastic mechanism, which is located above the spacer; and

A light source located on a side of the spacer facing the transparent elastic mechanism and emitting light to the transparent elastic mechanism.
The touch screen of claim 25, wherein the light guide channel forms an array of light guide channels in the spacer.
The touch screen according to claim 25, wherein a size of the light guide channel is set to 800 nm or more.
The touch screen according to claim 25, wherein the size of the light guide channel is set to be diffracted at a specific wavelength in the passing light to perform light splitting so that light of a specific wavelength band reaches a preset photoelectric converter.
The touch screen according to claim 25, wherein the spacer is made of a light absorbing material.
The touch screen of claim 25, wherein the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel illuminates the entire light receiving surface of the corresponding photoelectric converter.
The touch screen according to claim 25, wherein the spacer is coated with a light blocking layer.
The touch screen according to claim 31, wherein the light blocking layer is a diffuse reflection coating or a light absorbing coating.
The touch screen according to claim 25, wherein the transparent elastic mechanism is a transparent film.
A touch screen, comprising:

A spacer, which is opaque and forms at least one light guide channel therein; and

At least one photoelectric converter, the photoelectric converters are parallel and spaced from the spacer, and are arranged one-to-one corresponding to the light guide channels, so that the light emitted by the object to be imaged passes through the light guide channels Reach the photoelectric converter;

A transparent elastic mechanism, which is located above the spacer, and an opaque blocking member is provided in the transparent elastic mechanism.
The touch screen of claim 34, wherein the light guide channel forms an array of light guide channels in the spacer.
The touch screen according to claim 34, wherein a size of the light guide channel is set to 800 nm or more.
The touch screen of claim 34, wherein the size of the light guide channel is set to be diffracted at a specific wavelength in the passing light to perform light splitting so that light of a specific wavelength band reaches a preset photoelectric converter.
The touch screen of claim 34, wherein the spacer is made of a light absorbing material.
The touch screen of claim 34, wherein the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel illuminates the entire light receiving surface of the corresponding photoelectric converter.
The touch screen of claim 34, wherein a light blocking layer is coated on the spacer.
The touch screen of claim 40, wherein the light blocking layer is a diffuse reflection coating or a light absorbing coating.
A camera module, comprising:

The imaging assembly according to any one of claims 1 to 8;

Display,

The imaging component is located below the display screen.
The camera module according to claim 42, wherein the display screen is one of an OLED screen, an LCD screen, and an LED screen.
The camera module of claim 43, wherein the substrate in the OLED screen forms a spacer.
The camera module of claim 43, wherein the cathode layer in the OLED screen forms a spacer.
The camera module of claim 43, wherein the anode layer in the OLED screen forms a spacer.
The camera module according to claim 42, wherein an optical element for condensing light is disposed above each light guide channel in the spacer of the imaging component.
The camera module according to claim 47, wherein the optical element is a convex lens.
The camera module according to claim 43, wherein a super lens for condensing light is provided above each photoelectric converter of the imaging component.
The camera module according to claim 49, wherein an optical path turning element is disposed above the light guide channel.
The camera module according to claim 50, wherein the optical path turning element comprises a MEMS device and a reflector.
The camera module according to claim 43, wherein the camera module is located on a substrate in the OLED screen, and a driver is provided on the substrate, and the driver adjusts the photoelectricity of the imaging component. The distance between the converter and the spacer.
The camera module of claim 43, wherein the color filter in the LCD screen is integrated as a color filter of the imaging component.
The camera module according to claim 42, wherein an aperture of the light guide channel is set to a specific wavelength.
A smart terminal, comprising the camera module according to any one of claims 42 to 54.
A method for distance measurement, comprising:

Forming a plurality of light guide channels in the opaque spacer;

A plurality of photoelectric converters are arranged parallel to and spaced from the spacer, and respectively correspond to the light guide channels one by one, so that the light emitted by the object to be imaged passes through the light guide channel and reaches the photoelectric conversion Device

Obtaining a plurality of images formed by the object to be imaged through the plurality of light guide channels according to an electrical signal output by the photoelectric converter; and

The distance to the object to be imaged is calculated according to the degree of repetition of the plurality of images.
The distance measurement method according to claim 56, wherein the degree of repetition is the repeated pixel area of the whole or a part of the object to be photographed.
A light field camera having a micro lens array is characterized in that it further includes:

A spacer, which is opaque and forms at least one light guide channel therein; and

At least one photoelectric converter, the photoelectric converter is parallel to and spaced from the spacer, and respectively corresponds to the light guide channel one by one,

Wherein, the micro lens array is located between the spacer and the photoelectric converter, and the light emitted by the object to be imaged passes through the light guide channel and the micro lens array and reaches the photoelectric converter.
The light field camera according to claim 58, wherein the spacer forms a plurality of light guide channels, and the plurality of light guide channels form an array of light guide channels in the spacer.
The light field camera according to claim 58, wherein the size of the light guide channel is set to 800 nm or more.
The light field camera according to claim 58, wherein the size of the light guide channel is set to diffract at a specific wavelength in the passing light to perform light splitting so that light in a specific wavelength band reaches a preset photoelectric converter. .
The light field camera according to claim 58, wherein said spacer is made of a light absorbing material.
The light field camera according to claim 58, wherein the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel illuminates the entire light receiving surface of the corresponding photoelectric converter.
The light field camera according to claim 58, wherein the spacer is coated with a light blocking layer.
The light field camera according to claim 64, wherein the light blocking layer is a diffuse reflection coating or a light absorbing coating.
A light field camera having a main lens is further characterized by:

A spacer, which is opaque and forms at least one light guide channel therein; and

At least one photoelectric converter, the photoelectric converter is parallel to and spaced from the spacer, and respectively corresponds to the light guide channel one by one,

Wherein, the spacer is located between the main lens and the photoelectric converter, and light emitted by an object to be imaged passes through the main lens and the light guide channel and reaches the photoelectric converter.
The light field camera according to claim 66, wherein the spacer forms a plurality of light guide channels, and the plurality of light guide channels form an array of light guide channels in the spacer.
The light field camera according to claim 66, wherein a size of the light guide channel is set to 800 nm or more.
The light field camera according to claim 66, wherein the size of the light guide channel is set to be diffracted at a specific wavelength in the passing light to perform light splitting so that light of a specific wavelength band reaches a preset photoelectric converter. .
The light field camera according to claim 66, wherein said spacer is made of a light absorbing material.
The light field camera according to claim 66, wherein the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel illuminates the entire light receiving surface of the corresponding photoelectric converter.
The light field camera according to claim 66, wherein the spacer is coated with a light blocking layer.
The light field camera according to claim 72, wherein the light blocking layer is a diffuse reflection coating or a light absorbing coating.
A multi-camera depth camera, comprising:

A spacer, which is opaque and forms a plurality of light guide channels therein; and

A plurality of photoelectric converters, the photoelectric converters are parallel to and spaced from the spacer, and respectively correspond to the light guide channels one by one, so that the light emitted by the object to be imaged passes through the light guide channels and arrives The photoelectric converter;

Wherein, the central axes of the light guide channels are staggered with each other.
The multi-eye depth camera according to claim 74, wherein the plurality of light guide channels form an array of light guide channels in the spacer.
The multi-eye depth camera according to claim 74, wherein a size of the light guide channel is set to 800 nm or more.
The multi-eye depth camera according to claim 74, wherein the size of the light guide channel is set to diffract at a specific wavelength in the passing light to perform light splitting so that light in a specific wavelength band reaches a preset photoelectric conversion Device.
The multi-eye depth camera according to claim 74, wherein the spacer is made of a light absorbing material.
The multi-camera depth camera according to claim 74, wherein the photoelectric converter receives all light from the corresponding light guide channel, and the light of the corresponding light guide channel illuminates the entire light receiving surface of the corresponding photoelectric converter .
The multi-eye depth camera according to claim 74, wherein the spacer is coated with a light blocking layer.
The multi-eye depth camera of claim 80, wherein the light blocking layer is a diffuse reflection coating or a light absorbing coating.
A pixel color filter array includes:

Matrix

A dielectric layer attached to the substrate; and

A plurality of pixel color filters are attached to the dielectric layer and form an array.
The pixel color filter array device according to claim 82, wherein the dielectric layer is one of a photoelectric converter and a display screen.
A method for forming a pixel color filter array, comprising:

Setting the matrix

Attaching a dielectric layer to the substrate;

Setting a first color filter array on a first carrier plate;

Transferring the first color filter array from the first carrier plate to the second carrier plate by a pad printing head to form a second color filter array, wherein the pad printing head expands during the transfer process so that A gap between the color filters is suitable for a gap between the color filters in the second color filter array;

Coating a transparent glue on the substrate; and

The whole of the second color filter array on the second carrier is adhered to the dielectric layer.
The method of forming a pixel color filter array device according to claim 84, wherein the dielectric layer is one of a photoelectric converter and a display screen.