CN112738497A

CN112738497A - Sensing device, image sensor and human-computer interaction system

Info

Publication number: CN112738497A
Application number: CN202110337196.3A
Authority: CN
Inventors: 不公告发明人
Original assignee: Beijing Ivisual 3D Technology Co Ltd
Current assignee: Beijing Ivisual 3D Technology Co Ltd
Priority date: 2021-03-30
Filing date: 2021-03-30
Publication date: 2021-04-30

Abstract

The application relates to the field of photoelectric technology, and discloses a sensing device, including: a plurality of repeating units, each of which includes a first non-color sensing unit and at least one color sensing unit group, each of which includes a plurality of color sensing units, at least some of which have a planar shape different from that of the first non-color sensing unit; wherein the color sensing unit is configured to sense light and acquire a color signal based on the sensed light; a first non-color sensing unit configured to acquire a non-color signal; the color signal and the non-color signal are used to generate an image. The sensing equipment provided by the application can effectively reduce the space occupied by the sensing equipment by arranging the color sensing unit and the first non-color sensing unit in the sensing equipment. The application also discloses an image sensor and a human-computer interaction system.

Description

Sensing device, image sensor and human-computer interaction system

Technical Field

The present application relates to the field of optoelectronic technologies, and for example, to a sensing device, an image sensor, and a human-computer interaction system.

Background

Currently, a 3D camera needs to be separately provided with a photographing sensor for obtaining a 2D image and a depth sensor for obtaining a depth image.

In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related art: at least more than two sensors are needed for acquiring the 2D image and the depth image, and the occupied space is large.

Disclosure of Invention

The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview nor is intended to identify key/critical elements or to delineate the scope of such embodiments but rather as a prelude to the more detailed description that is presented later.

The embodiment of the disclosure provides sensing equipment, an image sensor and a human-computer interaction system, and aims to solve the technical problem that at least two sensors are arranged in a 3D camera and occupy large space.

In some embodiments, a sensing device comprises: a plurality of repeating units, each of which includes a first non-color sensing unit and at least one color sensing unit group, each of which includes a plurality of color sensing units, at least some of which have a planar shape different from that of the first non-color sensing unit;

wherein the color sensing unit is configured to sense light, and acquire a color signal based on the sensed light;

the first non-color sensing unit configured to acquire a non-color signal;

the color signal and the non-color signal are used to generate an image.

In some embodiments, each repeating unit further comprises a plurality of second non-color sensing units, the first non-color sensing unit being located in the middle of the repeating unit, the plurality of second non-color sensing units surrounding the first non-color sensing unit.

In some embodiments, the same second non-color sensing cell is shared by adjacent repeating cells.

In some embodiments, each of the repeating units includes at least four color sensor cell groups, and the at least four color sensor cell groups included in each of the repeating units are sequentially arranged around the first non-color sensor cell included in the repeating unit.

In some embodiments, when the repeating unit includes a plurality of second non-color sensing units, one second non-color sensing unit is disposed at an edge of each of the color sensing unit groups.

In some embodiments, each of the color sensor cell groups includes at least three color sensor cells, at least some of the sensed light of the at least three color sensor cells being of the same color; alternatively, the colors of the light sensed by the at least three color sensing units are all different.

In some embodiments, each of the repeating units includes four color sensor cell groups, and the four color sensor cell groups included in each of the repeating units are sequentially arranged around the first non-color sensor cell included in the repeating unit.

In some embodiments, each of the color sensing cell groups includes four color sensing cells, and colors of light sensed by at least three of the four color sensing cells are different.

In some embodiments, the color of light sensed by color sensing cells adjacent to the first non-color sensing cell in the repeating cell is the same or different.

In some embodiments, the planar shape of the color sensing unit adjacent to the first non-color sensing unit among the repeating units is the same.

In some embodiments, each of the repeating units includes six color sensor cell groups, and the six color sensor cell groups included in each of the repeating units are sequentially arranged around the first non-color sensor cell included in the repeating unit.

In some embodiments, each of the color sensing cell groups includes three color sensing cells, and the colors of the light sensed by the three color sensing cells are different.

In some embodiments, the color sensing cells located at edge positions of the color sensing cell groups are shared by the adjacent color sensing cell groups.

In some embodiments, the first non-color sensing cell comprises a depth sensing cell;

when the repeating unit includes a second non-color sensing unit, the second non-color sensing unit includes a depth sensing unit.

In some embodiments, a planar shape of at least some of the plurality of color sensing cells is a triangle, a quadrangle, a pentagon, a hexagon, or a cross.

In some embodiments, at least some of the plurality of color sensing units have the same planar shape or are axisymmetric.

In some embodiments, the planar shape of the first non-color sensing unit is a quadrangle, a circle, a hexagon, or a cross;

when the repeating unit includes a second non-color sensing unit, the planar shape of the second non-color sensing unit is a quadrangle, a circle, a hexagon, or a cross.

In some embodiments, at least some of the plurality of color sensing cells have the same or different area than the first non-color sensing cell.

In some embodiments, an image sensor includes the sensing device described above.

In some embodiments, a human-computer interaction system comprises the sensing device or the image sensor.

The sensing equipment, the image sensor and the human-computer interaction system provided by the embodiment of the disclosure can realize the following technical effects:

through setting up color sensing unit and first non-color sensing unit in a sensing equipment for only setting up a sensing equipment and can satisfying the demand that 3D made a video recording in the 3D camera, effectively reduce the space that sensing equipment occupy.

The foregoing general description and the following description are exemplary and explanatory only and are not restrictive of the application.

Drawings

At least one embodiment is illustrated by the accompanying drawings, which correspond to the accompanying drawings, and which do not form a limitation on the embodiment, wherein elements having the same reference numeral designations are shown as similar elements, and which are not to scale, and wherein:

FIG. 1A is a schematic diagram of an arrangement of color sensing elements and a first non-color sensing element in a sensing device provided by an embodiment of the disclosure;

FIG. 1B is a schematic illustration of one repeating unit in the embodiment of FIG. 1A;

fig. 1C is a schematic diagram of the first color sensing unit, the second color sensing unit, and the third color sensing unit in the repeating unit shown in fig. 1B being a red light sensing unit, a green light sensing unit, and a blue light sensing unit, respectively;

FIG. 1D is a schematic diagram of the arrangement of color sensing cells adjacent to a first non-color sensing cell in the repeating unit shown in FIG. 1B for sensing different color light;

fig. 1E is a schematic diagram of the first color sensing unit, the second color sensing unit and the third color sensing unit in the repeating unit shown in fig. 1D being a red light sensing unit, a green light sensing unit and a blue light sensing unit, respectively;

fig. 2A is a schematic view of another arrangement of a color sensing unit and a first non-color sensing unit in a sensing apparatus provided by the embodiment of the present disclosure;

FIG. 2B is a schematic illustration of one repeating unit in the embodiment of FIG. 2A;

fig. 2C is a schematic view of another arrangement of the color sensing unit and the first non-color sensing unit in the sensing apparatus provided by the embodiment of the present disclosure;

FIG. 2D is a schematic illustration of one repeating unit in the embodiment of FIG. 2C;

fig. 2E is a schematic diagram of the first color sensing unit, the second color sensing unit, the third color sensing unit, and the fourth color sensing unit in the repeating unit shown in fig. 2D being a red light sensing unit, a green light sensing unit, a blue light sensing unit, and a magenta light sensing unit, respectively;

fig. 2F is a schematic diagram of the first color sensing unit, the second color sensing unit, the third color sensing unit, and the fourth color sensing unit in the repeating unit shown in fig. 2D being a magenta color sensing unit, a green color sensing unit, a cyan color sensing unit, and a yellow color sensing unit, respectively;

fig. 3A is a schematic view of another arrangement of a color sensing unit and a first non-color sensing unit in a sensing apparatus provided by the embodiment of the present disclosure;

FIG. 3B is a schematic illustration of one repeating unit in the embodiment of FIG. 3A;

fig. 4A is a schematic view of another arrangement of a color sensing unit and a first non-color sensing unit in a sensing apparatus provided by the embodiment of the present disclosure;

FIG. 4B is a schematic illustration of one repeating unit in the embodiment of FIG. 4A;

fig. 5A is a schematic view of another arrangement of a color sensing unit and a first non-color sensing unit in a sensing apparatus provided by the embodiment of the present disclosure;

FIG. 5B is a schematic illustration of one repeating unit in the embodiment of FIG. 5A;

fig. 5C is a schematic diagram of the first color sensing unit, the second color sensing unit, and the third color sensing unit in the sensing apparatus shown in fig. 5A being a red light sensing unit, a green light sensing unit, and a blue light sensing unit, respectively;

FIG. 6A is a schematic diagram of an arrangement of color sensing elements and first and second non-color sensing elements in a sensing device according to an embodiment of the disclosure;

FIG. 6B is a schematic illustration of one repeating unit in the embodiment of FIG. 6A;

fig. 6C is a schematic diagram of the first color sensing unit, the second color sensing unit, and the third color sensing unit in the repeating unit shown in fig. 6B being a red light sensing unit, a green light sensing unit, and a blue light sensing unit, respectively;

FIG. 6D is a schematic diagram of the arrangement of color sensing cells adjacent to the first non-color sensing cell in the repeating unit shown in FIG. 6B for sensing different color light;

fig. 6E is a schematic diagram of the first color sensing unit, the second color sensing unit and the third color sensing unit in the repeating unit shown in fig. 6D being a red light sensing unit, a green light sensing unit and a blue light sensing unit, respectively;

fig. 7A is a schematic view of another arrangement of a color sensing unit and a first non-color sensing unit and a second non-color sensing unit in a sensing apparatus provided by the embodiment of the disclosure;

FIG. 7B is a schematic illustration of one repeat unit in the embodiment of FIG. 7A;

fig. 7C is a schematic view of another arrangement of the color sensing unit and the first non-color sensing unit and the second non-color sensing unit in the sensing apparatus provided by the embodiment of the disclosure;

FIG. 7D is a schematic representation of one repeat unit in the embodiment of FIG. 7C;

fig. 7E is a schematic diagram of the first, second, third, and fourth color sensing units in the repeating unit shown in fig. 7D being a red light sensing unit, a green light sensing unit, a blue light sensing unit, and a magenta light sensing unit, respectively;

fig. 7F is a schematic diagram of the first color sensing unit, the second color sensing unit, the third color sensing unit, and the fourth color sensing unit in the repeating unit shown in fig. 7D being a magenta color sensing unit, a green color sensing unit, a cyan color sensing unit, and a yellow color sensing unit, respectively;

fig. 8A is a schematic view of another arrangement of a color sensing unit and a first non-color sensing unit and a second non-color sensing unit in a sensing apparatus provided by the embodiment of the disclosure;

FIG. 8B is a schematic illustration of one repeat unit in the embodiment of FIG. 8A;

fig. 9A is a schematic view of another arrangement of a color sensing unit and a first non-color sensing unit and a second non-color sensing unit in a sensing apparatus provided by the embodiment of the disclosure;

FIG. 9B is a schematic illustration of one repeat unit in the embodiment of FIG. 9A;

FIG. 10A is a schematic diagram of another arrangement of color sensing elements and first and second non-color sensing elements in a sensing device according to an embodiment of the disclosure;

FIG. 10B is a schematic illustration of one repeating unit in the embodiment of FIG. 10A;

fig. 10C is a schematic view of the first color sensing unit, the second color sensing unit, and the third color sensing unit in the sensing apparatus shown in fig. 10A being a red light sensing unit, a green light sensing unit, and a blue light sensing unit, respectively.

Reference numerals:

CS: a color sensing unit; CS 1: a first color sensing unit; CS 2: a second color sensing unit; CS 3: a third color sensing unit; CS 4: a fourth color sensing unit; CSG: a color sensing unit group; CSG 1: a first color sensing unit group; CSG 2: a second color sensing unit group; CSG 3: a third color sensing unit group; CSG 4: a fourth color sensing unit group; CSG 5: a fifth color sensing cell group; CSG 6: a sixth color sensing unit group; NCS 1: a first non-color sensing unit; NCS 2: a second non-color sensing unit; RU: a repeating unit; RU 1: a first repeating unit; RU 2: a second repeating unit; RU 3: a third repeating unit; RU 4: a fourth repeating unit; r: a red light sensing unit; g: a green light sensing unit; b: a blue light sensing unit; e: a magenta light sensing unit; m: a magenta light sensing unit; c: a cyan light sensing unit; y: a yellow light sensing unit.

Detailed Description

So that the manner in which the features and elements of the disclosed embodiments can be understood in detail, a more particular description of the disclosed embodiments, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings. In the following description of the technology, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the disclosed embodiments. However, at least one embodiment may be practiced without these specific details. In other instances, well-known structures and devices may be shown in simplified form in order to simplify the drawing.

An embodiment of the present disclosure provides a sensing apparatus, as shown in fig. 1A, fig. 2C, fig. 3A, fig. 4A, and fig. 5A, the sensing apparatus including: a plurality of repeating units RU, each of which includes one first non-color sensing unit NCS1 and at least one color sensing unit group CSG, each of which includes a plurality of color sensing units CS, at least some of which have a plane shape different from that of the first non-color sensing unit NCS 1;

wherein the color sensing unit CS is configured to sense light, and acquire a color signal based on the sensed light;

the first non-color sensing unit NCS1 configured to acquire a non-color signal;

the color signal and the non-color signal are used to generate an image.

In some embodiments, as shown in fig. 1A, 2A and 2C, the planar shape of a color sensing cell CS adjacent to the first non-color sensing cell NCS1 among the plurality of color sensing cells CS is different from the planar shape of the first non-color sensing cell NCS 1. The planar shape of the color sensing unit CS refers to a plan view shape, i.e., a shape of an orthographic projection of the color sensing unit CS on a surface on which it is carried. The planar shape of the first non-color sensing unit NCS1 refers to a top view shape, i.e., a shape of an orthographic projection of the first non-color sensing unit NCS1 on a surface bearing the same.

In some embodiments, as shown in fig. 3A, 4A and 5A, the planar shape of all the color sensing cells CS among the plurality of color sensing cells CS is different from that of the first non-color sensing cell NCS 1.

In some embodiments, the sensing device may include a display screen for displaying images, which may be displayed in the display screen; alternatively, the sensing device may not include a display screen.

In some embodiments, the first non-color sensing unit NCS1 may be used to acquire only non-color signals; alternatively, the first non-color sensing unit NCS1 may be used to acquire both color and non-color signals.

In some embodiments, the first non-color sensing element NCS1 comprises a depth sensing element. For example, the first non-color sensing unit NCS1 is a depth sensor for measuring depth information corresponding to the first non-color sensing unit NCS 1; accordingly, the plurality of first non-color sensing units NCS1 included in the sensing device may be used to measure depth information of the subject.

In some embodiments, the first non-color sensing unit NCS1 may comprise an odor sensing unit. Alternatively, the first non-color sensing element NCS1 may comprise a sound sensing element.

As shown in fig. 6A, 7C, 8A, 9A, and 10A, in some embodiments, each of the repeating units further includes a plurality of second non-color sensing units, the first non-color sensing unit being located at a central portion of the repeating unit, the plurality of second non-color sensing units surrounding the first non-color sensing unit. In some embodiments, the same second non-color sensing cell is shared by adjacent repeating cells.

In some embodiments, as shown in fig. 6A, 7C, 8A, and 9A, each repeating unit further includes 4 second non-color sensing units, the same second non-color sensing unit being shared by adjacent 4 repeating units.

In some embodiments, as shown in FIG. 10A, each repeating unit further includes 6 second non-color sensing units, the same second non-color sensing unit being shared by 3 adjacent repeating units.

In some embodiments, the second non-color sensing element NCS2 comprises a depth sensing element. For example, the second non-color sensing unit NCS2 is a depth sensor for measuring depth information corresponding to the second non-color sensing unit NCS 2; accordingly, a plurality of second non-color sensing units NCS2 included in the sensing device may be used to measure depth information of the subject.

In some embodiments, the second non-color sensing unit NCS2 may comprise an odor sensing unit. Alternatively, the second non-color sensing element NCS2 may comprise a sound sensing element.

In some embodiments, there are two ways to generate an image based on the color signals and non-color signals:

the first method comprises the following steps:

generating a 2D image (for example, a 2D color image) based on the color signal, then generating another image based on the non-color signal (for example, when the non-color information is depth information, the other image may be a depth image), and finally performing comparison and data fusion processing on the two images to finally form one image.

And the second method comprises the following steps:

1. directly performing corresponding extraction on color signals and non-color signals to form pixel information corresponding to an image one by one, for example, as shown in fig. 1A and 1B, there are four repeating units RU, each of which includes four color sensing unit groups CSG and one first non-color sensing unit NCS 1; wherein, the four color sensing unit groups CSG are respectively: a first color sensing cell group CSG1, a second color sensing cell group CSG2, a third color sensing cell group CSG3, and a fourth color sensing cell group CSG 4. For example, taking the first color sensor cell group CSG1 as an example, the first color sensor cell group CSG1 includes one first color sensor cell CS1, two second color sensor cells CS2, and one third color sensor cell CS 3; the color signals of the first color sensing unit CS1, one second color sensing unit CS2 of the two second color sensing units CS2, the third color sensing unit CS3, and the non-color signal of the first non-color sensing unit NCS1 are directly extracted to form one pixel information corresponding to an image. Alternatively, the color signals of the first color sensing unit CS1, the other second color sensing unit CS2 of the two second color sensing units CS2, the third color sensing unit CS3, and the non-color signal of the first non-color sensing unit NCS1 are directly extracted to form another pixel information corresponding to the image. As can be seen from this, the first color sensing cell group CSG1 corresponds to the two pixels, the color signals corresponding to the two pixels are from different color sensing cells CS, and the corresponding non-color signals are from the same first non-color sensing cell NCS 1. And four color sensing cell groups CSG included in one repeating unit RU correspond to eight pixels in total. The color signals and the non-color signals are directly and correspondingly extracted to form pixel information corresponding to the images one by one, so that the color signals and the non-color signals can be directly recorded by taking the pixels as units, subsequent image comparison and data fusion processing are not needed, and the data processing speed can be increased.

2. Directly performing corresponding extraction on color signals and non-color signals to form pixel information corresponding to an image one by one, for example, as shown in fig. 6A and 6B, there are four repeating units RU, each of which includes four color-sensing cell groups CSG, one first non-color-sensing cell NCS1, and four second non-color-sensing cells NCS 2; wherein, the four color sensing unit groups CSG are respectively: a first color sensing cell group CSG1, a second color sensing cell group CSG2, a third color sensing cell group CSG3, and a fourth color sensing cell group CSG 4. For example, taking the first color sensor cell group CSG1 as an example, the first color sensor cell group CSG1 includes one first color sensor cell CS1, two second color sensor cells CS2, and one third color sensor cell CS 3; the color signals of the first color sensing unit CS1, one second color sensing unit CS2 of the two second color sensing units CS2, and the third color sensing unit CS3, and the non-color signals of the first non-color sensing unit NCS1 and the second non-color sensing unit NCS2 adjacent to the first color sensing unit group CSG1 are directly extracted to form one pixel information corresponding to an image. Alternatively, the color signals of the first color sensing unit CS1, the second color sensing unit CS2 of the two second color sensing units CS2, and the third color sensing unit CS3, and the non-color signals of the first non-color sensing unit NCS1 and the second non-color sensing unit NCS2 adjacent to the first color sensing unit group CSG1 are directly extracted to form another pixel information corresponding to the image. As can be seen, the first color sensing cell group CSG1 corresponds to the two pixels, the color signals corresponding to the two pixels are from different color sensing cells CS, and the corresponding non-color signals are from the same first non-color sensing cell NCS1 and second non-color sensing cell NCS 2. And four color sensing cell groups CSG included in one repeating unit RU correspond to eight pixels in total. The color signals and the non-color signals are directly and correspondingly extracted to form pixel information corresponding to the images one by one, so that the color signals and the non-color signals can be directly recorded by taking the pixels as units, subsequent image comparison and data fusion processing are not needed, and the data processing speed can be increased.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 3B, 4B, 5B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B, 9B and 10B, each of the repeating units RU includes at least four color sensing unit groups CSG, which are sequentially arranged around the first non-color sensing unit NCS1 included in the repeating unit RU.

As shown in fig. 6B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B, 9B, and 10B, in some embodiments, when the repeating unit includes a plurality of second non-color sensing units, one second non-color sensing unit is disposed at an edge of each of the color sensing unit groups.

In some embodiments, as shown in fig. 6B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B, and 9B, each repeating unit includes 4 second non-color sensing units, each repeating unit includes 4 color sensing unit groups, and the second non-color sensing units are disposed at edges of the color sensing unit groups distant from the first non-color sensing units.

In some embodiments, as shown in fig. 10B, each repeating unit includes 6 second non-color sensing units, each repeating unit includes 6 color sensing unit groups, and the second non-color sensing units are disposed at edges of the color sensing unit groups remote from the first non-color sensing units.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 3B, 4B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B and 9B, each repeating unit RU includes four color sensing unit groups CSG, which are sequentially arranged around a first non-color sensing unit NCS1 included in the repeating unit RU. Optionally, the four color sensing cell groups CSG are a first color sensing cell group CSG1, a second color sensing cell group CSG2, a third color sensing cell group CSG3, and a fourth color sensing cell group CSG4, respectively. The first non-color sensing unit NCS1 is located at the center of the repeating unit RU, and the above four color sensing unit groups CSG are arranged around the first non-color sensing unit NCS 1.

In some embodiments, as shown in fig. 5B and 10B, each repeating unit RU includes six color sensing cell groups CSG, which are sequentially arranged around the first non-color sensing cell NCS1 included in the repeating unit RU. Optionally, the six color sensor cell groups CSG are a first color sensor cell group CSG1, a second color sensor cell group CSG2, a third color sensor cell group CSG3, a fourth color sensor cell group CSG4, a fifth color sensor cell group CSG5, and a sixth color sensor cell group CSG6, respectively. The first non-color sensing unit NCS1 is located at the center of the repeating unit RU, and the above six color sensing unit groups CSG are arranged around the first non-color sensing unit NCS 1.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 3B, 4B, 5B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B, 9B and 10B, each of the color sensing cell groups CSG includes at least three color sensing cells CS, at least some of which sense the same color of light; alternatively, the colors of the light sensed by the at least three color sensing units CS are all different.

In some embodiments, each of the color sensing cell groups CSG includes four color sensing cells CS, and colors of light sensed by at least three color sensing cells CS among the four color sensing cells CS are different.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 3B, 6C, 6D, 6E, and 8B, each color sensing cell group CSG includes four color sensing cells CS, of which three color sensing cells CS sense different colors.

In some embodiments, as shown in fig. 2B, 2D, 2E, 2F, 4B, 7D, 7E, 7F, and 9B, each color sensing cell group CSG includes four color sensing cells CS, and colors of light sensed by the four color sensing cells CS are all different.

In some embodiments, as shown in fig. 5B and 10B, each color sensing cell group CSG includes three color sensing cells CS, and the colors of light sensed by the three color sensing cells CS are all different.

In some embodiments, as shown in fig. 5B and 10B, the color sensing cells CS located at the edge position of the color sensing cell group CSG are shared by the neighboring color sensing cell groups CSG. Alternatively, the first color sensor cell CS1 located at an edge position of the first color sensor cell group CSG1 is shared by the sixth color sensor cell group CSG 6. Alternatively, the third color sensor cell CS3 located at an edge position of the first color sensor cell group CSG1 is shared by the second color sensor cell group CSG 2.

As shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 3B, 4B, 5B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B, 9B and 10B, the colors of the light sensed by the color sensing cells CS adjacent to the first non-color sensing cell NCS1 in the repeating unit RU are the same or different.

In some embodiments, as shown in fig. 1B, 1C, 2B, 6C and 7B, the color of light sensed by the color sensing cell CS adjacent to the first non-color sensing cell NCS1 is the same.

In some embodiments, as shown in fig. 1D, 1E, 2D, 2E, 2F, 3B, 4B, 5B, 6D, 6E, 7D, 7E, 7F, 8B, 9B, and 10B, the color portions of the light sensed by the color sensing cells CS adjacent to the first non-color sensing cell NCS1 are the same or all different.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 3B, 4B, 5B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B, 9B, and 10B, the planar shape of the color sensing cell CS adjacent to the first non-color sensing cell NCS1 in the repeating unit RU is the same or axisymmetric.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 6B, 6C, 6D, 6E, 7B, 7D, 7E and 7F, the planar shape of the color sensing cell CS adjacent to the first non-color sensing cell NCS1 is the same.

In some embodiments, as shown in fig. 5B and 10B, the planar shape of the part of the color sensing cells CS in the color sensing cells CS adjacent to the first non-color sensing cell NCS1 is the same. Alternatively, of the color sensor cells CS adjacent to the first non-color sensor cell NCS1, the planar shapes of any adjacent two color sensor cells CS are axisymmetric.

In some embodiments, as shown in fig. 3B, 4B, 8B, and 9B, the planar shape of the color sensing unit CS adjacent to the first non-color sensing unit NCS1 may be determined by adjusting the relative positional relationship of the first non-color sensing unit NCS1 and the color sensing unit CS adjacent thereto, and adjusting the size of the area of the first non-color sensing unit NCS 1. Alternatively, when the planar shapes of the color sensing cells CS adjacent to the first non-color sensing cell NCS1 can be made all to be a complete triangle by reducing the area of the first non-color sensing cell NCS1 and adjusting the relative positional relationship between the first non-color sensing cell NCS1 and the color sensing cell CS adjacent thereto, the planar shapes of the color sensing cells CS adjacent to the first non-color sensing cell NCS1 are the same. Alternatively, when the shapes of the color sensing cells CS adjacent to the first non-color sensing cell NCS1 can be each formed into a triangle lacking one corner by enlarging the area of the first non-color sensing cell NCS1 and adjusting the relative positional relationship between the first non-color sensing cell NCS1 and the color sensing cell CS adjacent thereto, a planar shape resembling a triangle is formed, and at this time, the planar shapes of the partial color sensing cells CS in the color sensing cells CS adjacent to the first non-color sensing cell NCS1 are the same. Alternatively, of the color sensor cells CS adjacent to the first non-color sensor cell NCS1, the planar shapes of any adjacent two color sensor cells CS are axisymmetric.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 3B, 4B, 5B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B, 9B, and 10B, the planar shape of at least some of the color sensing cells CS of the plurality of color sensing cells CS is a triangle, a quadrangle, a pentagon, a hexagon, or a cross.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 3B, 4B, 5B, 6C, 6D, 6E, 7B, 7D, 7E, 7F, 8B, 9B, and 10B, the planar shape of at least part of the plurality of color sensing units CS is the same or axisymmetric.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, 6B, 6C, 6D, 6E, 7B, 7D, 7E, and 7F, the planar shape of the color sensing cell CS adjacent to the first non-color sensing cell NCS1 is the same as a quadrangle with a cut-off corner (which may be referred to as a quadrangle-like or a hexagon).

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, the color sensing cell CS that is not adjacent to the first non-color sensing cell NCS1 has the same planar shape, being a quadrangle or a regular quadrangle.

In some embodiments, as shown in fig. 6B, 6C, 6D, 6E, 7B, 7D, 7E, and 7F, the color sensing cell CS adjacent to the second non-color sensing cell NCS2 has the same planar shape as a quadrangle (which may be referred to as a quadrangle-like or a hexagon) with a cut-off corner.

In some embodiments, as shown in fig. 6B, 6C, 6D, 6E, 7B, 7D, 7E, and 7F, the color sensing unit CS, which is not adjacent to the first non-color sensing unit NCS1 and is not adjacent to the second non-color sensing unit NCS2, has the same plane shape, and is a quadrangle or a regular quadrangle.

In some embodiments, as shown in fig. 3B and 4B, the planar shape of the color sensing unit CS adjacent to the first non-color sensing unit NCS1 may be determined by adjusting the relative positional relationship of the first non-color sensing unit NCS1 and the color sensing unit CS adjacent thereto, and adjusting the size of the area of the first non-color sensing unit NCS 1. Alternatively, when the planar shape of the color sensing unit CS adjacent to the first non-color sensing unit NCS1 is a complete triangle by reducing the area of the first non-color sensing unit NCS1 and adjusting the relative positional relationship between the first non-color sensing unit NCS1 and the color sensing unit CS adjacent thereto, the planar shape of the color sensing unit CS is the same regardless of whether it is adjacent to the first non-color sensing unit NCS1, and is a complete triangle.

In some embodiments, as shown in fig. 8B and 9B, the planar shape of the color sensing unit CS may be determined by adjusting the relative positional relationship of the first non-color sensing unit NCS1, the second non-color sensing unit NCS2, and the color sensing unit CS, and adjusting the size of the areas of the first non-color sensing unit NCS1 and the second non-color sensing unit NCS 2. Alternatively, when the planar shape of the color sensing unit CS in each of the repeating units is made a complete triangle by reducing the areas of the first non-color sensing unit NCS1 and the second non-color sensing unit NCS2 and by adjusting the relative positional relationship of the first non-color sensing unit NCS1, the second non-color sensing unit NCS2, and the color sensing unit CS.

In some embodiments, as shown in fig. 3B and 4B, when the planar shapes of the color sensing cells CS adjacent to the first non-color sensing cell NCS1 are all triangles lacking one corner by enlarging the area of the first non-color sensing cell NCS1 and adjusting the relative positional relationship of the first non-color sensing cell NCS1 and the color sensing cell CS adjacent thereto, a planar shape resembling a triangle is formed, and the shapes of the color sensing cells CS not adjacent to the first non-color sensing cell NCS1 are all full triangle shapes. At this time, the planar shape of the part of the color sensing cells CS in the color sensing cells CS adjacent to the first non-color sensing cell NCS1 is the same. Alternatively, of the color sensor cells CS adjacent to the first non-color sensor cell NCS1, the planar shapes of any adjacent two color sensor cells CS are axisymmetric. Alternatively, the planar shape of the color sensing cell CS not adjacent to the first non-color sensing cell NCS1 is the same.

In some embodiments, as shown in fig. 8B and 9B, when the planar shapes of the color sensing units CS in each of the repeating units are each a triangle lacking one corner, forming a triangle-like planar shape, by enlarging the areas of the first non-color sensing unit NCS1 and the second non-color sensing unit NCS2 and by adjusting the relative positional relationship of the first non-color sensing unit NCS1, the second non-color sensing unit NCS2, and the color sensing unit CS. Alternatively, the planar shape of the color sensing unit CS within the repeating unit may also be determined by enlarging the area of the first non-color sensing unit NCS1, reducing the area of the second non-color sensing unit NCS2, and by adjusting the relative positional relationship of the first non-color sensing unit NCS1, the second non-color sensing unit NCS2, and the color sensing unit CS. Alternatively, the planar shape of the color sensing unit CS within the repeating unit may also be determined by reducing the area of the first non-color sensing unit NCS1, enlarging the area of the second non-color sensing unit NCS2, and by adjusting the relative positional relationship of the first non-color sensing unit NCS1, the second non-color sensing unit NCS2, and the color sensing unit CS.

In some embodiments, as shown in fig. 5B, in one repeating unit RU, all the color sensing units CS are adjacent to the first non-color sensing unit NCS1, and all the color sensing units CS have a quadrangular planar shape, for example, a trapezoidal shape. Alternatively, the planar shapes of the partial color sensing units CS in the color sensing units CS are the same. Alternatively, the planar shapes of any adjacent two color sensor cells CS are axisymmetric.

In some embodiments, as shown in fig. 10B, in one repeating unit RU, all the color sensing cells CS are adjacent to the first non-color sensing cell NCS1, and all the color sensing cells CS have a pentagonal planar shape. Alternatively, the planar shapes of the partial color sensing units CS in the color sensing units CS are the same. Alternatively, the planar shapes of any adjacent two color sensor cells CS are axisymmetric.

In some embodiments, the planar shape of the first non-color sensing unit NCS1 is a quadrangle (see fig. 1B, 1C, 1D, 1E, 2B, etc.), a circle (see fig. 3B, 4B, etc.), a hexagon (see fig. 5B, etc.), or a cross.

In some embodiments, the planar shape of the second non-color sensing unit NCS2 is a quadrangle (see fig. 6B, 6C, 6D, 6E, 7B, etc.), a circle (see fig. 8B, 9B, etc.), a hexagon (see fig. 10B, etc.), or a cross.

In some embodiments, the area of at least some of the plurality of color-sensing cells CS is the same as or different from the area of the first non-color-sensing cell NCS 1.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, in one repeating unit RU, the area of the color-sensing cell CS adjacent to the first non-color-sensing cell NCS1 is different from the area of the first non-color-sensing cell NCS 1. Alternatively, in one repeating unit RU, the area of the color sensing unit CS, which is not adjacent to the first non-color sensing unit NCS1, is the same as or different from the area of the first non-color sensing unit NCS 1.

In some embodiments, as shown in fig. 6B, 6C, 6D, 6E, 7B, 7D, 7E and 7F, in one repeating unit RU, the area of the color-sensing cell CS adjacent to the first non-color-sensing cell NCS1 is different from the area of the first non-color-sensing cell NCS1, and the area of the color-sensing cell CS adjacent to the second non-color-sensing cell NCS2 is different from the area of the first non-color-sensing cell NCS 1. Alternatively, the area of the first non-color sensing unit NCS1 and the area of the second non-color sensing unit NCS2 may be the same. Alternatively, the area of the color-sensing cell CS, which is not adjacent to the first non-color-sensing cell NCS1 and is not adjacent to the second non-color-sensing cell NCS2, is the same as or different from the area of the first non-color-sensing cell NCS 1.

In some embodiments, as shown in fig. 1B, 1C, 1D, 1E, 2B, 2D, 2E, 2F, in one repeating unit RU, the area of the color-sensing cell CS adjacent to the first non-color-sensing cell NCS1 is the same as the area of the first non-color-sensing cell NCS 1. Alternatively, in one repeating unit RU, the area of the color sensing unit CS, which is not adjacent to the first non-color sensing unit NCS1, is different from the area of the first non-color sensing unit NCS 1.

In some embodiments, as shown in fig. 6B, 6C, 6D, 6E, 7B, 7D, 7E and 7F, in one repeating unit RU, the area of the color-sensing cell CS adjacent to the first non-color-sensing cell NCS1 is the same as the area of the first non-color-sensing cell NCS1, and the area of the color-sensing cell CS adjacent to the second non-color-sensing cell NCS2 is the same as the area of the first non-color-sensing cell NCS 1. Alternatively, the area of the first non-color sensing unit NCS1 and the area of the second non-color sensing unit NCS2 may be the same. Alternatively, the area of the color-sensing cell CS, which is not adjacent to the first non-color-sensing cell NCS1 and is not adjacent to the second non-color-sensing cell NCS2, is different from the area of the first non-color-sensing cell NCS 1.

In some embodiments, as shown in fig. 3B, 4B, 8B and 9B, in one repeating unit RU, when all the color sensing cells CS are full triangles, the area of the first non-color sensing cell NCS1 may be the same as or different from the area of the color sensing cell CS.

In some embodiments, as shown in fig. 3B, 4B, in one repeating unit RU, when the shape of the color sensing unit CS adjacent to the first non-color sensing unit NCS1 is a triangle lacking one corner, the area of the color sensing unit CS adjacent to the first non-color sensing unit NCS1 may be the same as the area of the first non-color sensing unit NCS1, and the area of the color sensing unit CS not adjacent to the first non-color sensing unit NCS1 may be different from the area of the first non-color sensing unit NCS 1.

In some embodiments, as shown in fig. 8B and 9B, when the shapes of the color sensing cells CS in one repeating unit RU are each a triangle lacking one corner, the area of the color sensing cell CS is the same as or different from that of the first non-color sensing cell NCS 1.

In some embodiments, as shown in fig. 3B, 4B, in one repeating unit RU, when the shape of the color sensing unit CS adjacent to the first non-color sensing unit NCS1 is a triangle lacking one corner, the area of the color sensing unit CS adjacent to the first non-color sensing unit NCS1 is different from the area of the first non-color sensing unit NCS1, and the area of the color sensing unit CS not adjacent to the first non-color sensing unit NCS1 is the same as or different from the area of the first non-color sensing unit NCS 1.

In some embodiments, as shown in fig. 5B and 10B, the area of all the color sensing cells CS may be the same as or different from the area of the first non-color sensing cell NCS 1.

The embodiment of the disclosure also provides an image sensor, which comprises the sensing device provided by any one of the above embodiments.

In some embodiments, the image sensor may also include other structures electrically connected to the sensing device, such as a display screen, a power supply, and the like.

The embodiment of the disclosure also provides a human-computer interaction system, which includes the sensing device or the image sensor provided in any one of the above embodiments.

In some embodiments, the human-computer interaction system may include a biometric device, such as an eye positioning device, a gesture recognition device, or a face recognition device, the biometric device including the sensing device or the image sensor; the man-machine interaction system can also be other types of man-machine interaction devices.

The above description and drawings sufficiently illustrate embodiments of the disclosure to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. The scope of the disclosed embodiments includes the full ambit of the claims, as well as all available equivalents of the claims. As used in this application, although the terms "first," "second," etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, unless the meaning of the description changes, so long as all occurrences of the "first element" are renamed consistently and all occurrences of the "second element" are renamed consistently. The first and second elements are both elements, but may not be the same element. Furthermore, the words used in the specification are words of description only and are not intended to limit the claims. As used in the description of the embodiments and the claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Similarly, the term "and/or" as used in this application is meant to encompass any and all possible combinations of one or more of the associated listed. Furthermore, the terms "comprises" and/or "comprising," when used in this application, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Without further limitation, an element defined by the phrase "comprising an …" does not exclude the presence of other like elements in a process, method or apparatus that comprises the element. In this document, each embodiment may be described with emphasis on differences from other embodiments, and the same and similar parts between the respective embodiments may be referred to each other. For methods, products, etc. of the embodiment disclosures, reference may be made to the description of the method section for relevance if it corresponds to the method section of the embodiment disclosure.

Those of skill in the art would appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software may depend upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments. It is clear to those skilled in the art that, for convenience and brevity of description, the working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, apparatuses, etc.) may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit may be merely a division of a logical function, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to implement the present embodiment. In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

In the drawings, the width, length, thickness, etc. of structures such as elements or layers may be exaggerated for clarity and descriptive purposes. When an element or layer is referred to as being "disposed on" (or "mounted on," "laid on," "attached to," "coated on," or the like) another element or layer, the element or layer may be directly "disposed on" or "over" the other element or layer, or intervening elements or layers may be present, or even partially embedded in the other element or layer.

Claims

1. A sensing device, comprising: a plurality of repeating units, each of which includes a first non-color sensing unit and at least one color sensing unit group, each of which includes a plurality of color sensing units, at least some of which have a planar shape different from that of the first non-color sensing unit;

the first non-color sensing unit configured to acquire a non-color signal;

the color signal and the non-color signal are used to generate an image.

2. The sensing device of claim 1, wherein each repeating unit further comprises a plurality of second non-color sensing units, the first non-color sensing unit being located in the middle of the repeating unit, the plurality of second non-color sensing units surrounding the first non-color sensing unit.

3. The sensing device of claim 2, wherein the same second non-color sensing cell is shared by adjacent repeating cells.

4. The sensing device according to any one of claims 1 to 3, wherein each of the repeating units comprises at least four color sensing unit groups, and the at least four color sensing unit groups comprised by each of the repeating units are arranged sequentially around a first non-color sensing unit comprised by the repeating unit.

5. The sensing apparatus of claim 4, wherein when the repeating unit comprises a plurality of second non-color sensing units, one second non-color sensing unit is disposed at an edge of each of the color sensing unit groups.

6. The sensing device according to claim 4, wherein each of the color sensing cell groups comprises at least three color sensing cells, at least some of the sensed light of the at least three color sensing cells being of the same color; alternatively, the colors of the light sensed by the at least three color sensing units are all different.

7. The sensing device of claim 6, wherein each of the repeating units comprises four color sensing unit groups, the four color sensing unit groups comprised by each of the repeating units being arranged sequentially around a first non-color sensing unit comprised by the repeating unit.

8. The sensing device of claim 7, wherein each of the color sensing cell groups comprises four color sensing cells, and wherein at least three of the four color sensing cells sense different colors of light.

9. The sensing device of claim 8, wherein the color of light sensed by color sensing cells adjacent to the first non-color sensing cell in the repeating cell is the same or different.

10. The sensing apparatus of claim 9, wherein the planar shape of the color sensing cells adjacent to the first non-color sensing cell in the repeating unit is the same.

11. The sensing device of claim 6, wherein each of the repeating units comprises six color-sensing unit groups, the six color-sensing unit groups comprised by each of the repeating units being arranged sequentially around a first non-color-sensing unit comprised by the repeating unit.

12. The sensing device of claim 11, wherein each of the color sensing cell groups comprises three color sensing cells, and wherein the colors of the light sensed by the three color sensing cells are different.

13. The sensing apparatus according to claim 12, wherein color sensing cells located at edge positions of the color sensing cell groups are shared by the adjacent color sensing cell groups.

14. The sensing device according to any one of claims 1 to 3, wherein the first non-color sensing unit comprises a depth sensing unit;

15. The sensing apparatus according to any one of claims 1 to 3, wherein at least some of the plurality of color sensing cells have a planar shape of a triangle, a quadrangle, a pentagon, a hexagon, or a cross.

16. The sensing apparatus according to any one of claims 1 to 3, wherein at least some of the plurality of color sensing units have the same planar shape or are axisymmetric.

17. The sensing apparatus according to any one of claims 1 to 3, wherein the planar shape of the first non-color sensing unit is a quadrangle, a circle, a hexagon, or a cross;

18. The sensing device according to any one of claims 1 to 3, wherein at least some of the plurality of color sensing cells have the same or different area as the first non-color sensing cell.

19. An image sensor characterized in that it comprises a sensing device according to any one of claims 1 to 18.

20. A human-computer interaction system, characterized in that it comprises a sensing device according to any one of claims 1 to 18 or an image sensor according to claim 19.