WO2021195946A1 - Imaging device, electrical device, method of manufacturing imaging device, and method of manufacturing electrical device - Google Patents
Imaging device, electrical device, method of manufacturing imaging device, and method of manufacturing electrical device Download PDFInfo
- Publication number
- WO2021195946A1 WO2021195946A1 PCT/CN2020/082386 CN2020082386W WO2021195946A1 WO 2021195946 A1 WO2021195946 A1 WO 2021195946A1 CN 2020082386 W CN2020082386 W CN 2020082386W WO 2021195946 A1 WO2021195946 A1 WO 2021195946A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- linear line
- distortion
- image height
- percent
- image
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 177
- 238000004519 manufacturing process Methods 0.000 title claims description 12
- 230000003287 optical effect Effects 0.000 claims abstract description 107
- 238000000034 method Methods 0.000 claims description 59
- 238000012937 correction Methods 0.000 claims description 51
- 230000008569 process Effects 0.000 claims description 36
- 241000226585 Antennaria plantaginifolia Species 0.000 claims description 5
- 230000004075 alteration Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 230000015654 memory Effects 0.000 description 7
- 230000015556 catabolic process Effects 0.000 description 6
- 238000006731 degradation reaction Methods 0.000 description 6
- 238000013461 design Methods 0.000 description 6
- 239000000463 material Substances 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20004—Adaptive image processing
- G06T2207/20012—Locally adaptive
Definitions
- the present disclosure relates to an imaging device, an electrical device, a method of manufacturing an imaging device, and a method of manufacturing an electrical device.
- the imaging device with small imaging sensor is employed in the electrical device, or a thicker projection part for the imaging device is partially formed in the electrical device.
- the projection part of the electrical device be sometimes damaged and restricts a freedom of the design of the electrical device.
- the present disclosure aims to solve at least one of the technical problems mentioned above. Accordingly, the present disclosure needs to provide an imaging device, an electrical device, a method of manufacturing imaging device, and a method of manufacturing electrical device.
- an imaging device may include:
- an optical lens wherein an object to be imaged may be located at a first side of the optical lens
- an imaging sensor located at a second side of the optical lens which may be an opposite side of the first side of the optical lens, wherein a position of 100 percent of an image height H 100 of an object image may be located at a corner of the imaging sensor.
- the object image on the imaging sensor may be subjected to a distortion correction process to generate a final target image.
- the optical lens may generate a pincushion distortion
- an edge of the final target image may be decided based on the corner of the object image at the corner of the imaging sensor, and
- an outside region of the object image which may be outside the final target image may be cut out when the final target image is generated.
- a distortion ratio D 100 at 100 percent of the image height H 100 of the object image on the imaging sensor of the optical lens may be equal to or greater than 5 percent and equal to or less than D NM , where
- M may be a number of pixels in a vertical direction of the imaging sensor
- N may be a number of pixels in a horizontal direction of the imaging sensor.
- a distortion curve of the optical lens represented in a coordinate system may be linearized by two or more linear lines, wherein an X-axis of the coordinate system may be the distortion ratio D and a Y-axis of the coordinate system may be a percentage of the image height H of the object image on the imaging sensor.
- the linear lines may be composed of a first linear line and a second linear line, wherein the first linear line may approximate a lower part of the image height of the distortion curve in the coordinate system and the second linear line may approximate a higher part of the image height of the distortion curve in the coordinate system.
- an angle ⁇ 1 may be greater than an angle ⁇ 2 , wherein the angle ⁇ 1 may be an angle formed by the first linear line and the X-axis of the coordinate system, and the angle ⁇ 2 may be an angle formed by the second linear line and the X-axis of the coordinate system.
- the percentage of the image height H A may be a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H A may be equal to or greater than 20 percent and equal to or less than 50 percent.
- the distortion ratio D A may be an X-coordinate of the intersection point of the first linear line and the second linear line
- a percentage of the image height H A may be a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2
- the distortion ratio D A may be less than D 100 X (H A /H 100 ) , where a percentage H 100 may be 100 percent, and a distortion ratio D 100 may be the distortion ratio at 100 percent of the image height H 100 .
- the linear lines may be composed of a first linear line, a second linear line and a third linear line, wherein the first linear line may approximate a lower part of the image height of the distortion curve, the second linear line may approximate a middle part of the image height of the distortion curve, and the third linear line may approximate a higher part of the image height of the distortion curve.
- an angle ⁇ 1 may be greater than an angle ⁇ 2 and the angle ⁇ 2 may be greater than an angle ⁇ 3 , wherein the angle ⁇ 1 may be an angle formed by the first linear line and the X-axis of the coordinate system, the angle ⁇ 2 may be an angle formed by the second linear line and the X-axis of the coordinate system, and the angle ⁇ 3 may be an angle formed by the third linear line and the X-axis of the coordinate system.
- a percentage of the image height H A may be a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H A may be equal to or greater than 20 percent and equal to or less than 50 percent, and
- a percentage of the image height H B may be a Y-coordinate of an intersection point of the second linear line and the third linear line, and the percentage of the image height H B may be equal to or greater than 70 percent and equal to or less than 90 percent.
- a distortion ratio D A may be an X-coordinate of the intersection point of the first linear line and the second linear line
- a distortion ratio D B may be an X-coordinate of the intersection point of the second linear line and the third linear line
- a percentage of the image height H A may be a Y-coordinate of the intersection point of the first linear line and the second linear line
- a percentage of the image height H B may be a Y-coordinate of the intersection point of the second linear line and the third linear line
- the distortion ratio D A may be less than D 100 X (H A /H 100 )
- the distortion ratio D B may be less than D 100 X (H B /H 100 )
- a percentage of the image height H 100 may be 100 percent
- a distortion ratio D 100 may be the distortion ratio at 100 percent of the image height H 100 .
- an electrical device may include:
- a distortion correction processor configured to execute the distortion correction process to correct a distortion of the object image on the imaging sensor to generate the final target image.
- a method of manufacturing an imaging device may include:
- an object to be imaged may be located at a first side of the optical lens and the imaging sensor may be located at a second side of the optical lens which may be an opposite side of the first side of the optical lens, wherein a position of 100 percent of an image height H 100 of an object image may be located at a corner of the imaging sensor.
- the object image on the imaging sensor may be subjected to a distortion correction process to generate a final target image.
- the optical lens may generate a pincushion distortion
- an edge of the final target image may be decided based on the corner of the object image at the corner of the imaging sensor, and
- an outside region of the object image which may be outside the final target image may be cut out when the final target image is generated.
- a distortion ratio D 100 at 100 percent of the image height H 100 of the object image on the imaging sensor of the optical lens may be equal to or greater than 5 percent and equal to or less than D NM , where
- M may be a number of pixels in a vertical direction of the imaging sensor
- N may be a number of pixels in a horizontal direction of the imaging sensor.
- a distortion curve of the optical lens represented in a coordinate system may be linearized by two or more linear lines, wherein an X-axis of the coordinate system may be the distortion ratio D and a Y-axis of the coordinate system may be a percentage of the image height H of the object image on the imaging sensor.
- the linear lines may be composed of a first linear line and a second linear line, wherein the first linear line may approximate a lower part of the image height of the distortion curve in the coordinate system and the second linear line may approximate a higher part of the image height of the distortion curve in the coordinate system.
- an angle ⁇ 1 may be greater than an angle ⁇ 2 , wherein the angle ⁇ 1 may be an angle formed by the first linear line and the X-axis of the coordinate system, and the angle ⁇ 2 may be an angle formed by the second linear line and the X-axis of the coordinate system.
- the percentage of the image height H A may be a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H A may be equal to or greater than 20 percent and equal to or less than 50 percent.
- the distortion ratio D A may be an X-coordinate of the intersection point of the first linear line and the second linear line
- a percentage of the image height H A may be a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2
- the distortion ratio D A may be less than D 100 X (H A /H 100 ) , where a percentage H 100 may be 100 percent, and a distortion ratio D 100 may be the distortion ratio at 100 percent of the image height H 100 .
- the linear lines may be composed of a first linear line, a second linear line and a third linear line, wherein the first linear line may approximate a lower part of the image height of the distortion curve, the second linear line may approximate a middle part of the image height of the distortion curve, and the third linear line may approximate a higher part of the image height of the distortion curve.
- an angle ⁇ 1 may be greater than an angle ⁇ 2 and the angle ⁇ 2 may be greater than an angle ⁇ 3 , wherein the angle ⁇ 1 may be an angle formed by the first linear line and the X-axis of the coordinate system, the angle ⁇ 2 may be an angle formed by the second linear line and the X-axis of the coordinate system, and the angle ⁇ 3 may be an angle formed by the third linear line and the X-axis of the coordinate system.
- a percentage of the image height H A may be a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H A may be equal to or greater than 20 percent and equal to or less than 50 percent, and
- a percentage of the image height H B may be a Y-coordinate of an intersection point of the second linear line and the third linear line, and the percentage of the image height H B may be equal to or greater than 70 percent and equal to or less than 90 percent.
- a distortion ratio D A may be an X-coordinate of the intersection point of the first linear line and the second linear line
- a distortion ratio D B may be an X-coordinate of the intersection point of the second linear line and the third linear line
- a percentage of the image height H A may be a Y-coordinate of the intersection point of the first linear line and the second linear line
- a percentage of the image height H B may be a Y-coordinate of the intersection point of the second linear line and the third linear line
- the distortion ratio D A may be less than D 100 X (H A /H 100 )
- the distortion ratio D B may be less than D 100 X (H B /H 100 )
- a percentage of the image height H 100 may be 100 percent
- a distortion ratio D 100 may be the distortion ratio at 100 percent of the image height H 100 .
- a method of manufacturing an electrical device may include:
- a distortion correction processor configured to execute the distortion correction process to correct a distortion of the object image on the imaging sensor to generate the final target image
- FIG. 1 is a schematic plan view of an electrical device equipped with an imaging device according to one of embodiments of the present disclosure
- FIG. 2 is a cross sectional view taken along line II-II of the electrical device equipped with the imaging device of FIG. 1;
- FIG. 3 illustrates a focal length f of the imaging device in no aberration case (Ideal Optical Lens Case) ;
- FIG. 4 illustrates the imaging sensor and a percentage of an image height on an imaging sensor
- FIG. 5 illustrates a distortion curve of the optical lens in no aberration case (Ideal Optical Lens Case) ;
- FIG. 6 illustrates the focal length f' of the imaging device in a positive distortion aberration case (Actual Optical Lens Case) ;
- FIG. 7 illustrates the imaging sensor and the percentage of the image height on the imaging sensor
- FIG. 8 illustrates the distortion curve of the optical lens in the positive distortion aberration case (Actual Optical Lens Case) ;
- FIG. 9 illustrates a degradation of a sharpness of an object image (final target image) after a distortion correction process
- FIG. 10 illustrates the focal length f and the focal length f' of the imaging device according to the present embodiment
- FIG. 11 illustrates the imaging sensor and the object images overlapped with the imaging sensor
- FIG. 12 illustrates a distortion correction processor, the object image before the distortion correction process and the object image (final target image) after the distortion correction process;
- FIG. 13 illustrates an example of the distortion curve of the optical lens of the imaging device according to the present embodiment (the distortion curve can be linearized by two linear lines) ;
- FIG. 14 shows conditions which the distortion curve represented in FIG. 13 should satisfy
- FIG. 15 illustrates another example of the distortion curve of the optical lens of the imaging device according to the present embodiment (the distortion curve can be linearized by two linear lines) ;
- FIG. 16 shows conditions with which the distortion curve represented in FIG. 15 should be satisfied.
- FIG. 1 illustrates an electrical device 10 according to one of embodiments of the present disclosure and FIG. 2 illustrates a cross sectional view taken along line II-II of the electrical device of FIG. 1.
- FIG. 1 illustrates a layout of a first side of the electrical device 10.
- the electrical device 10 may include an imaging device 20 and a distortion correction processor 22.
- the imaging device 20 and the distortion correction processor 22 are assembled into the electrical device 10.
- the imaging device 20 captures an object image of an object to be imaged.
- the imaging device 20 may include a protective glass 30, an optical lens 40 and an imaging sensor 50.
- the optical lens 40 may be composed of one lens or a combination of a plurality of lenses.
- a first side of the imaging device 20 and the optical lens 40 indicates a side in which an object to be imaged by the imaging device 20 is located
- a second side of the imaging device 20 and the optical lens 40 indicates a side in which the imaging sensor 50 is located.
- the second side of the imaging device 20 and the optical lens 40 is an opposite side of the first side.
- the electrical device 10 may be, for example, a smartphone, a tablet computer, a notebook type computer, and others.
- a thickness of the electrical device 10 is mainly determined by a height H imd of the imaging device 20 and the height H imd of the imaging device 20 is mainly determined by a focal length f of the imaging device 20. Therefore, the thickness of the electrical device 10 is substantially determined by the focal length f of the imaging device 20.
- the shorter focal length f can reduce the height H imd of the imaging device 20 and the shorter height H imd of the imaging device 20 can reduce the thickness of the electrical device 10.
- the distortion correction processor 22 executes a distortion correction process to correct a distortion of the object image to generate a final target image which is the object image the user would like to capture.
- the electrical device 10 has the distortion correction processor 22, the distortion correction processor 22 may be omitted in the electrical device 10.
- the distortion correction process is executed in other electrical device, for example, in a personal computer, a notebook computer and so on.
- FIG. 3 illustrates the focal length f of the imaging device 20 in no aberration case (Ideal Optical Lens Case)
- FIG 4 illustrates the imaging sensor 50 and a percentage of an image height H on the imaging sensor 50
- FIG. 5 illustrates a distortion curve of the optical lens 40 shown in FIG. 3.
- the focal length f is a distance between a center of the optical lens 40 and the imaging sensor 50.
- An angle ⁇ indicates an angle between a center light input to the center of the optical lens 40 and a light input to the optical lens 40.
- An angle ⁇ indicates an angle between a center light passing through the center of the optical lens 40 and a light input to the optical lens 40, whereas an angle ⁇ ' indicates an angle between the center light passing though the center of the optical lens 40 and a light output from the optical lens 40.
- the angle ⁇ of the light input to the optical lens 40 is equal to the angle ⁇ ' of the light output from the optical lens 40.
- the imaging sensor 50 may include M X N pixels, 0 percent of the image height H 0 corresponds to a center of the imaging sensor 50, and 100 percent of the image height H 100 corresponds to a corner C IMG of the imaging sensor 50. In this case, 100 percent of the image height H 100 is a length H r between the center of the imaging sensor 50 and the corner C IMG of the imaging sensor 50. In the ideal optical lens 40, the object image of the object on the imaging sensor 50 is not distorted.
- 100 percent of the image height H 100 and the length H r is expressed by f X tan ⁇ , or they may also be expressed by f X tan ⁇ ' because tan ⁇ is equal to tan ⁇ ' in the ideal optical lens 40.
- the distortion curve of the ideal optical lens 40 is represented on a coordinate system in which an X-axis is a distortion ratio D and a Y-axis is a percentage of the image height H of the object image on the imaging sensor 50.
- the distortion ratio D is always 0 percent. That is, the distortion ratio D 0 at 0 percent of the image height H 0 is 0 percent and the distortion ratio D 100 at 100 percent of the image height H 100 is also 0 percent.
- FIG. 6 illustrates the focal length f of the imaging device 20 in a positive distortion aberration case (Actual Optical Lens Case)
- FIG 7 illustrates the imaging sensor 50 and the percentage of the image height H on a plane of the imaging sensor 50
- FIG. 8 illustrates the distortion curve of the optical lens 40 shown in FIG. 6.
- FIG. 6, FIG. 7 and FIG. 8 correspond to FIG. 3, FIG. 4 and FIG. 5 mentioned above, respectively.
- the focal length f is a distance between the center of the optical lens 40 and the imaging sensor 50.
- the angle ⁇ also indicates an angle between the center light input to the center of the optical lens 40 and the light input to the optical lens 40.
- the angle ⁇ ' also indicates the angle between the center light passing though the center of the optical lens 40 and the light output from the optical lens 40.
- the angle ⁇ of the light input to the optical lens 40 is not equal to the angle ⁇ ' of the light output from the optical lens 40 because of an aberration of the optical lens 40.
- the example of the optical lens 40 shown in FIG. 6 generates a positive distortion aberration.
- the imaging sensor 50 may also include M X N pixels, and 0 percent of the image height H 0 corresponds to the center of the imaging sensor 50, but 100 percent of the image height H 100 corresponds to an outside of the imaging sensor 50. That is, 100 percent of the image height H 100 does not correspond to the corner C IMG of the imaging sensor 50 because of the distortion of the object image.
- a length from 0 percent of the image height H 0 to 100 percent of the image height H 100 does not correspond to the length H r between the center of the imaging sensor 50 and the corner C IMG of the imaging sensor 50.
- 100 percent of the image height H 100 of the object image on the plane of the imaging sensor 50 is not expressed by f X tan ⁇ but it is express by f X tan ⁇ ', where an angle ⁇ ' is an angle between the center light and a light forming the corner of the object image of the object on the plane of the imaging sensor 50.
- the distortion ratio D is gradually increased as the image height H is increased. That is, a graph of a relationship between the distortion ratio D and the image height H is curved as the image height H is increased.
- the distortion ratio D 0 at 0 percent of the image height H 0 is 0 percent but the distortion ratio D 100 at 100 percent of the image height H 100 is a certain percentage.
- the distortion of the object image has to be corrected by means of the distortion correction process to obtain the natural object image (final target image) .
- a sharpness of the object image which has been corrected by the distortion correction process is degraded as shown in FIG. 9.
- a center part around the center of the corrected object image is a sharpness degradation area due to the distortion correction process. This is because, in a unit area in the final target image, an image information quantity in the center part of the object image is less than an image information quantity in a peripheral part of the object image which is outside the center part of the object image.
- the focal length f should be shortened. Therefore, in the electrical device 10 of the present embodiment, the focal length f of the imaging device 20 is shortened to the focal length f'.
- FIG. 10 illustrates the focal length f' of the imaging device 20 according to the present embodiment
- FIG. 11 illustrates the object image 52 and the object image 54 which are overlapped with the imaging sensor 50.
- the focal length f' is shorter than the focal length f and thus the height H imd of the imaging device 20 can be reduced and the imaging device 20 can be smaller.
- the optical lens 40 of the imaging device 20 according to the present embodiment is closer to the imaging sensor 50.
- the optical lens 40 with the focal length f illustrated in FIG. 6 generates the object image 52 whereas the optical lens 40 with the focal length f' illustrated in FIG. 10 generates the object image 54.
- the object image 52 is subjected to the distortion correction process to correct the distortion of the object image 52.
- the object image 54 is subjected to the distortion correction process to correct the distortion of the object image 54.
- the object image 52 subjected to the distortion correction process is wider than the object image 54 subjected to the distortion correction process.
- the object image 52 is wider than the imaging sensor 50, whereas the object image 54 is within a size of the imaging sensor 50.
- each of the corners 54a of the object image 54 is located at each of the corners 50a of the imaging sensor 50. That is, four of the corners 54a of the object image 54 are located at four of the corners 50a of the imaging sensor 50, respectively.
- a positon of 100 percent of the image height H 100 of the object image 54 on the imaging sensor 50 is located at the corner 50a of the imaging sensor 50.
- edges 54b there are four edges 54b between the corners 54a in the object image 54 on the imaging sensor 50.
- the four edges 54b of the object image 54 are decided based on the corners 54a of the object image 54 at the corners 50a of the imaging sensor 50.
- the optical lens 40 generates a pincushion distortion. Therefore, each of the four edges 54b is curved inwardly, and the four edges 54b are also within the size of the imaging sensor 50.
- the light passing through the optical lens 40 may reach an outside region of the object image 54. Therefore, both an inside region inside the object image 54 and an outside region outside the object image 54 are subjected to the distortion correction process, and the outside region is cut out to create the final target image without distortion by the inside region of the object image 54.
- the distortion correction process may be applied only to the inside region of the object image 54. That is, the inside region inside the object image 54 is defined by the four edges 54b, and the distortion correction process is executed for the inside region of the object image 54 to correct the distortion of the object image 54.
- the outside region of the object image 54 may be cut out before the distortion correction process.
- 100 percent of the image height H 100 of the object image 54 is expressed by f' X tan ⁇ ”, where the angle ⁇ ” is an angle between the center light and a light forming the corner 54a of the object image 54 of the object on the plane of the imaging sensor 50.
- An angle between the center light and a light forming the edges 54b other than the corners 54a is less than the angle ⁇ ”.
- the angle ⁇ ” is the greatest angle between the center light and the light forming the corners 54a and the edges 54b of the object image 54 on the plane of the imaging sensor 50.
- FIG. 12 illustrates the distortion correction processor 22, the object image 54 before the distortion correction process and the object image 54 after the distortion correction process which is the final target image the user would like to obtain.
- the distortion correction processor 22 executes the distortion correction process for the object image 54. Before the distortion correction process, the object image 54 is distorted and thus the edges 54b of the object image 54 are curved inwardly.
- the distortion correction processor 22 stretches the object image 54 to correct the distortion of the object image 54 and generate the final target image. More specifically, the distortion correction processor 22 stretches the object image 54 outwardly in the distortion correction process. That is, the object image 54 is outwardly extended on all sides.
- the distortion correction processor 22 stretches the object image 54 in accordance with, for example, a bicubic interpolation, a bilinear interpolation, or the like. However, the distortion correction processor 22 may stretch the object image 54 in accordance with other methods.
- the distortion correction process After the distortion correction process has been applied to the object image 54, the distortion of the object image 54 is substantially eliminated and thus the edges 54b of the object image 54 become substantially straight.
- the center part of the object image 54 is degraded due to the distortion correction process.
- the center part of the object image 54 is the most important because a region of interest is often located around the center of the object image 54.
- the sharpness degradation of the object image 54 is relative to the distortion curve of the optical lens 40. Therefore, in order to improve and suppress the degradation of the object image, the optical lens 40 of the imaging device 20 of the present embodiment has a specific distortion curve.
- FIG. 13 illustrates an example of the distortion curve DC of the optical lens 40 of the imaging device 20 according to the present embodiment.
- FIG. 14 shows conditions which the distortion curve DC represented in FIG. 13 should satisfy.
- FIG. 14 shows five conditions, i.e. a condition 1 through a condition 5, the optical lens 40 is not necessarily to satisfy all of the five conditions 1-5. That is, the optical lens 40 may satisfy one, two, three or four conditions among the five conditions 1-5.
- the distortion curve DC of the optical lens 40 is represented in a coordinate system
- an X-axis of the coordinate system is the distortion ratio D of the object image 54
- a Y-axis of the coordinate system is a percentage of the image height H of the object image on the plane of the imaging sensor 50.
- a minimum of the percentage of the image height H 0 is 0 and it is located at the origin of the coordinate system.
- a maximum of the percentage of the image height H 100 is 100 and it is located on the Y-axis of the coordinate system. 0 percent of the image height H 0 corresponds to the center of the object image 54, and 100 percent of the image height H 100 corresponds to the corners 54a of the object image 54 on the plane of the imaging sensor 50.
- a minimum of the distortion ratio D 0 is 0 and it is located at the origin of the coordinate system.
- a maximum of the distortion ratio D 100 depends on the characteristics of the optical lens 40.
- the distortion ratio D 0 indicates the distortion ratio at the center of the object image 54
- the distortion ratio D 100 indicates the distortion ratio at the corners 54a of the object image 54.
- the distortion ratio D is expressed by (AD-PD) /PD X 100%.
- the predicted distance PD indicates a distance from the center of the object image to an ideal point where the object should be imaged.
- the actual distance AD indicates a distance from the center of the object image to an actual point where the object is actually imaged.
- the distortion curve DC illustrated in FIG. 13 shows the characteristics of the design of the optical lens 40 or the characteristics of the actual optical lens 40. That is, the characteristics of mass-produced optical lens 40 is not the same as each other, and each of them has own characteristics. Therefore, 1) the distortion curve DC in FIG. 13 may be considered as the characteristics of the design of the optical lens 40, 2) the distortion curve DC in FIG. 13 may be considered as the characteristics of each mass-produced optical lens 40, or 3) the distortion curve DC in FIG. 13 may be considered as an average of the characteristics of the mass-produced optical lenses 40. Therefore, the following explanation can be applied to any kind of the distortion curve DC.
- the distortion curve DC of the optical lens 40 of the imaging device 20 satisfies any combinations of the following conditions 1-5.
- the distortion curve DC can be linearized and approximated by two or more linear lines in the coordinate system.
- the distortion curve DC can be linearized and approximated by two linear lines. That is, the distortion curve DC can be linearized and approximated by a first linear line L1 and a second linear line L2.
- the first linear line L1 approximates a lower part of the image height H of the distortion curve DC
- the second linear line L2 approximates a higher part of the image height H of the distortion curve DC.
- first linear line L1 and the second linear line L2 can be calculated and decided by the method of least squares, i.e., the linear approximation.
- the other method to calculate and decide the first linear line L1 and the second linear line L2 may be employed.
- An angle ⁇ 1 is greater than an angle ⁇ 2 , where the angle ⁇ 1 is an angle formed by the first linear line L1 and the X-axis of the coordinate system and the angle ⁇ 2 is an angle formed by the second linear line L2 and the X-axis of the coordinate system.
- the distortion curve DC satisfies the condition 2
- the sharpness of the center part of the object image can be improved, because the distortion ratio D of the first linear line L1 is less than the distortion ratio of the second linear line L2.
- the distortion curve DC in the lower part of the image height H is steeper than the distortion curve DC in the higher part of the image height H.
- the steeper distortion curve DC in the lower part of the image height H improves the sharpness of the center part of the object image and the final target image, and the degradation of the sharpness of the object image and the final target image can be suppressed.
- the distortion ratio D A is less than D 100 X (H A /H 100 ) .
- a distortion ratio D A is an X-coordinate of the intersection point of the first linear line L1 and the second linear line L2
- a percentage of the image height H A is a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2.
- a percentage H 100 is 100 percent
- a distortion ratio D 100 is the distortion ratio at 100 percent of the image height H 100 .
- the distortion curve satisfies the condition 3
- the sharpness of the center part of the object image and the final target image can be improved, because the distortion ratio D A at the intersection point of the first linear line L1 and the second linear line L2 is small enough.
- a percentage of the image height H A is equal to or greater than 20 percent and equal to or less than 50 percent. Also here, the percentage of the image height H A is the Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2.
- the sharpness of the center part of the object image and the final target image can be improved, because the distortion curve DC from 0 percent to between 20 percent and 50 percent of the image height H can be linearized and approximated by the first linear line L1, which defines the sharpness of the center part of the object image and the final target image.
- the percentage of the image height H A is less than 20 percent, a fine and clear region of the object image is too small for the users.
- the percentage of the image height H A is greater than 50 percent, it is difficult for designers and engineers to design the optical lens 40 with the short focal length f'.
- a distortion ratio D 100 at 100 percent of the image height H 100 of the object image of the optical lens is equal to or greater than 5 percent and equal to or less than D NM .
- M is a number of pixels in a vertical direction of the imaging sensor 50.
- N is a number of pixels in a horizontal direction of the imaging sensor 50.
- L indicates the number of pixels in a half of a diagonal line of the imaging sensor 50, namely, the number of pixels along a line from 0 percent of the image height H 0 to 100 percent of the image height H 100 of the object image on the imaging sensor 50.
- a value of 4 is a factor to adjust D NM to define a reasonable and proper maximum value of the distortion ratio D.
- the optical lens 40 If the optical lens 40 is positioned closer to the imaging sensor 50, the distortion ratio D of the object image on the imaging sensor 50 is increased. Conversely, if a greater value of the distortion ratio D is acceptable for the design of the optical lens 40, the optical lens 40 can be positioned closer to the imaging sensor 50 and it results in the reduction of the height H imd of the imaging device 20.
- the height H imd of the imaging device 20 can be reduced as compared to conventional imaging devices.
- the distortion curve DC shown in FIG. 13 can be linearized and approximated by two of the linear lines L1 and L2
- the distortion curve DC may be linearized and approximated by three or more linear lines.
- An example in which the distortion curve DC can be linearized and approximated by three linear lines will be explained hereinafter.
- FIG. 15 illustrates the example of the distortion curve DC of the optical lens 40 in which the distortion curve DC can be approximated by three of linear lines.
- FIG. 16 shows conditions which the distortion curve DC represented in FIG. 15 should satisfy.
- FIG. 15 and FIG. 16 correspond to FIG. 13 and FIG. 14, respectively.
- the distortion curve DC shown in FIG. 15 satisfies any combinations of the following conditions 1-5.
- the distortion curve DC can be linearized and approximated by three linear lines L1, L2 and L3. That is, the distortion curve DC can be linearized and approximated by the first linear line L1, the second linear line L2 and the third linear line L3.
- the first linear line L1 approximates a lower part of the image height H of the distortion curve DC
- the second linear line L2 approximates a middle part of the image height H of the distortion curve DC
- the third linear line L3 approximates a higher part of the image height H of the distortion curve DC.
- An angle ⁇ 1 is greater than an angle ⁇ 2 and the angle ⁇ 2 is greater than an angle ⁇ 3 .
- the angle ⁇ 1 is an angle formed by the first linear line L1 and the X-axis of the coordinate system
- the angle ⁇ 2 is an angle formed by the second linear line L2 and the X-axis of the coordinate system
- the angle ⁇ 3 is an angle formed by the third linear line L3 and the X-axis of the coordinate system.
- the sharpness of the center part of the object image can be improved, because the distortion ratio D of the first linear line L1 is less than the distortion ratio D of the second linear line L2, and the distortion ratio D of the second linear line L2 is less than the distortion ratio D of the third linear line L3.
- the distortion curve DC in the lower part of the image height H is steeper than the distortion curve DC in the middle part of the image height H
- the distortion curve DC in the middle part of the image height H is steeper than the distortion curve DC in the higher part of the image height H.
- the steeper distortion curve DC in the lower part of the image height H improves the sharpness of the center part of the object image and the final target image, and the degradation of the sharpness of the object image and the final target can be suppressed.
- a distortion ratio D A is an X-coordinate of the intersection point of the first linear line L1 and the second linear line L2
- a distortion ratio D B is an X-coordinate of the intersection point of the second linear line L2 and the third linear line L3
- a percentage of the image height H A is a Y-coordinate of the intersection point of the first linear line and the second linear line
- a percentage of the image height H B is a Y-coordinate of the intersection point of the second linear line and the third linear line.
- a percentage H 100 is 100 percent
- a distortion ratio D 100 is the distortion ratio at 100 percent of the image height H 100
- the distortion ratio D A is less than D 100 X (H A /H 100 )
- the distortion ratio D B is less than D 100 X (H B /H 100 ) .
- the distortion curve satisfies the condition 3
- the sharpness of the center part of the object image and the final target image can be improved, because the distortion ratio D A is much less than the distortion ratio D B .
- the percentage H A is a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2, and the percentage H A is equal to or greater than 20 percent and equal to or less than 50 percent.
- the percentage H B is the Y-coordinate of an intersection point of the second linear line L2 and the third linear line L3, and the percentage H B is equal to or greater than 70 percent and equal to or less than 90 percent.
- the sharpness of the center part of the object image and the final target image can be improved, because the distortion curve DC from 0 percent to between 20 percent and 50 percent of the image height H can be linearized and approximated by the first linear line L1 which defines the sharpness of the center part of the object image and the final target image, and the distortion curve DC from between 20 percent and 50 percent to between 70 percent and 90 percent of the image height H can be linearized and approximated by the second linear line L2 which defines the sharpness of the middle part of the object image and the final target image.
- a distortion ratio D 100 at 100 percent of the image height H 100 of the object image of the optical lens 40 is equal to or greater than 5 percent and equal to or less than D NM .
- M is a number of pixels in a vertical direction of the imaging sensor 50.
- N is a number of pixels in a horizontal direction of the imaging sensor 50.
- the focal length f' can be shortened, the height H imd of the imaging device 20 can be reduced. Therefore, the thickness of the electrical device 10 including the imaging device 20 can also be reduced.
- the electrical device 10 can be designed with a full flat surface.
- the height H imd of the imaging device 20 can still be reduced because the focal length f' can be shortened as compared to conventional imaging devices. Therefore, the larger sized imaging sensor 50 can be equipped with the electrical device 10 and the quality of the object image and the final target image can be raised.
- first and second are used herein for purposes of description and are not intended to indicate or imply relative importance or significance or to imply the number of indicated technical features.
- the feature defined with “first” and “second” may comprise one or more of this feature.
- a plurality of means two or more than two, unless specified otherwise.
- the terms “mounted”, “connected”, “coupled” and the like are used broadly, and may be, for example, fixed connections, detachable connections, or integral connections; may also be mechanical or electrical connections ; may also be direct connections or indirect connections via intervening structures; may also be inner communications of two elements, which can be understood by those skilled in the art according to specific situations.
- a structure in which a first feature is "on" or “below” a second feature may include an embodiment in which the first feature is in direct contact with the second feature, and may also include an embodiment in which the first feature and the second feature are not in direct contact with each other, but are contacted via an additional feature formed therebetween.
- a first feature "on”, “above” or “on top of” a second feature may include an embodiment in which the first feature is right or obliquely “on”, “above” or “on top of” the second feature, or just means that the first feature is at a height higher than that of the second feature; while a first feature “below”, “under”or “on bottom of” a second feature may include an embodiment in which the first feature is right or obliquely “below”, “under” or “on bottom of” the second feature, or just means that the first feature is at a height lower than that of the second feature.
- Any process or method described in a flow chart or described herein in other ways may be understood to include one or more modules, segments or portions of codes of executable instructions for achieving specific logical functions or steps in the process, and the scope of a preferred embodiment of the present disclosure includes other implementations, in which it should be understood by those skilled in the art that functions may be implemented in a sequence other than the sequences shown or discussed, including in a substantially identical sequence or in an opposite sequence.
- the logic and/or step described in other manners herein or shown in the flow chart, for example, a particular sequence table of executable instructions for realizing the logical function may be specifically achieved in any computer readable medium to be used by the instruction execution system, device or equipment (such as the system based on computers, the system comprising processors or other systems capable of obtaining the instruction from the instruction execution system, device and equipment and executing the instruction) , or to be used in combination with the instruction execution system, device and equipment.
- the computer readable medium may be any device adaptive for including, storing, communicating, propagating or transferring programs to be used by or in combination with the instruction execution system, device or equipment.
- the computer readable medium comprise but are not limited to: an electronic connection (an electronic device) with one or more wires, a portable computer enclosure (a magnetic device) , a random access memory (RAM) , a read only memory (ROM) , an erasable programmable read-only memory (EPROM or a flash memory) , an optical fiber device and a portable compact disk read-only memory (CDROM) .
- the computer readable medium may even be a paper or other appropriate medium capable of printing programs thereon, this is because, for example, the paper or other appropriate medium may be optically scanned and then edited, decrypted or processed with other appropriate methods when necessary to obtain the programs in an electric manner, and then the programs may be stored in the computer memories.
- each part of the present disclosure may be realized by the hardware, software, firmware or their combination.
- a plurality of steps or methods may be realized by the software or firmware stored in the memory and executed by the appropriate instruction execution system.
- the steps or methods may be realized by one or a combination of the following techniques known in the art: a discrete logic circuit having a logic gate circuit for realizing a logic function of a data signal, an application-specific integrated circuit having an appropriate combination logic gate circuit, a programmable gate array (PGA) , a field programmable gate array (FPGA) , etc.
- each function cell of the embodiments of the present disclosure may be integrated in a processing module, or these cells may be separate physical existence, or two or more cells are integrated in a processing module.
- the integrated module may be realized in a form of hardware or in a form of software function modules. When the integrated module is realized in a form of software function module and is sold or used as a standalone product, the integrated module may be stored in a computer readable storage medium.
- the storage medium mentioned above may be read-only memories, magnetic disks, CD, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
An imaging device according to the embodiments of the present disclosure includes an optical lens, wherein an object to be imaged is located at a first side of the optical lens; and an imaging sensor located at a second side of the optical lens which is an opposite side of the first side of the optical lens, wherein a position of 100 percent of an image height H 100of the object image is located at a corner of the imaging sensor.
Description
The present disclosure relates to an imaging device, an electrical device, a method of manufacturing an imaging device, and a method of manufacturing an electrical device.
Nowadays, a lot of electrical devices have an imaging device to take pictures anytime and anywhere. One of the most popular electrical devices equipped with such imaging device is a smartphone.
In order to reduce a thickness of the electrical device, either the imaging device with small imaging sensor is employed in the electrical device, or a thicker projection part for the imaging device is partially formed in the electrical device. The projection part of the electrical device be sometimes damaged and restricts a freedom of the design of the electrical device.
In the past few decades, a technology of downsizing is one of the typical challenges in optical design. This resulted in a lot of technologies of modifying the optical lens itself so as to achieve downsizing. However, such techniques are becoming insufficient, because users demand thinner electrical devices for their portability and their more pleasing appearance.
SUMMARY
The present disclosure aims to solve at least one of the technical problems mentioned above. Accordingly, the present disclosure needs to provide an imaging device, an electrical device, a method of manufacturing imaging device, and a method of manufacturing electrical device.
In accordance with the present disclosure, an imaging device may include:
an optical lens, wherein an object to be imaged may be located at a first side of the optical lens; and
an imaging sensor located at a second side of the optical lens which may be an opposite side of the first side of the optical lens, wherein a position of 100 percent of an image height H
100 of an object image may be located at a corner of the imaging sensor.
In some embodiments, the object image on the imaging sensor may be subjected to a distortion correction process to generate a final target image.
In some embodiments, the optical lens may generate a pincushion distortion,
an edge of the final target image may be decided based on the corner of the object image at the corner of the imaging sensor, and
an outside region of the object image which may be outside the final target image may be cut out when the final target image is generated.
In some embodiments, a distortion ratio D
100 at 100 percent of the image height H
100 of the object image on the imaging sensor of the optical lens may be equal to or greater than 5 percent and equal to or less than D
NM, where
D
NM =4 X L /1000,
L=( (1/2 X M)
2+ (1/2 X N)
2)
1/2,
M may be a number of pixels in a vertical direction of the imaging sensor, and
N may be a number of pixels in a horizontal direction of the imaging sensor.
In some embodiments, a distortion curve of the optical lens represented in a coordinate system may be linearized by two or more linear lines, wherein an X-axis of the coordinate system may be the distortion ratio D and a Y-axis of the coordinate system may be a percentage of the image height H of the object image on the imaging sensor.
In some embodiments, the linear lines may be composed of a first linear line and a second linear line, wherein the first linear line may approximate a lower part of the image height of the distortion curve in the coordinate system and the second linear line may approximate a higher part of the image height of the distortion curve in the coordinate system.
In some embodiments, an angle α
1 may be greater than an angle α
2, wherein the angle α
1 may be an angle formed by the first linear line and the X-axis of the coordinate system, and the angle α
2 may be an angle formed by the second linear line and the X-axis of the coordinate system.
In some embodiments, the percentage of the image height H
A may be a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H
A may be equal to or greater than 20 percent and equal to or less than 50 percent.
In some embodiments, the distortion ratio D
A may be an X-coordinate of the intersection point of the first linear line and the second linear line, a percentage of the image height H
A may be a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2, and the distortion ratio D
A may be less than D
100 X (H
A/H
100) , where a percentage H
100 may be 100 percent, and a distortion ratio D
100 may be the distortion ratio at 100 percent of the image height H
100.
In some embodiments, the linear lines may be composed of a first linear line, a second linear line and a third linear line, wherein the first linear line may approximate a lower part of the image height of the distortion curve, the second linear line may approximate a middle part of the image height of the distortion curve, and the third linear line may approximate a higher part of the image height of the distortion curve.
In some embodiments, an angle α
1 may be greater than an angle α
2 and the angle α
2 may be greater than an angle α
3, wherein the angle α
1 may be an angle formed by the first linear line and the X-axis of the coordinate system, the angle α
2 may be an angle formed by the second linear line and the X-axis of the coordinate system, and the angle α
3 may be an angle formed by the third linear line and the X-axis of the coordinate system.
In some embodiments, a percentage of the image height H
A may be a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H
A may be equal to or greater than 20 percent and equal to or less than 50 percent, and
a percentage of the image height H
B may be a Y-coordinate of an intersection point of the second linear line and the third linear line, and the percentage of the image height H
B may be equal to or greater than 70 percent and equal to or less than 90 percent.
In some embodiments, a distortion ratio D
A may be an X-coordinate of the intersection point of the first linear line and the second linear line, a distortion ratio D
B may be an X-coordinate of the intersection point of the second linear line and the third linear line, a percentage of the image height H
A may be a Y-coordinate of the intersection point of the first linear line and the second linear line, a percentage of the image height H
B may be a Y-coordinate of the intersection point of the second linear line and the third linear line, the distortion ratio D
A may be less than D
100 X (H
A/H
100) , and the distortion ratio D
B may be less than D
100 X (H
B/H
100) , where a percentage of the image height H
100 may be 100 percent, and a distortion ratio D
100 may be the distortion ratio at 100 percent of the image height H
100.
In accordance with the present disclosure, an electrical device may include:
the imaging device mentioned above; and
a distortion correction processor configured to execute the distortion correction process to correct a distortion of the object image on the imaging sensor to generate the final target image.
In accordance with the present disclosure, a method of manufacturing an imaging device may include:
providing a support member;
providing an optical lens;
providing an imaging sensor; and
assembling the support member, the optical lens and the imaging sensor so that an object to be imaged may be located at a first side of the optical lens and the imaging sensor may be located at a second side of the optical lens which may be an opposite side of the first side of the optical lens, wherein a position of 100 percent of an image height H
100 of an object image may be located at a corner of the imaging sensor.
In some embodiments, the object image on the imaging sensor may be subjected to a distortion correction process to generate a final target image.
In some embodiments, the optical lens may generate a pincushion distortion,
an edge of the final target image may be decided based on the corner of the object image at the corner of the imaging sensor, and
an outside region of the object image which may be outside the final target image may be cut out when the final target image is generated.
In some embodiments, a distortion ratio D
100 at 100 percent of the image height H
100 of the object image on the imaging sensor of the optical lens may be equal to or greater than 5 percent and equal to or less than D
NM, where
D
NM =4 X L /1000,
L=( (1/2 X M)
2+ (1/2 X N)
2)
1/2,
M may be a number of pixels in a vertical direction of the imaging sensor, and
N may be a number of pixels in a horizontal direction of the imaging sensor.
In some embodiments, a distortion curve of the optical lens represented in a coordinate system may be linearized by two or more linear lines, wherein an X-axis of the coordinate system may be the distortion ratio D and a Y-axis of the coordinate system may be a percentage of the image height H of the object image on the imaging sensor.
In some embodiments, the linear lines may be composed of a first linear line and a second linear line, wherein the first linear line may approximate a lower part of the image height of the distortion curve in the coordinate system and the second linear line may approximate a higher part of the image height of the distortion curve in the coordinate system.
In some embodiments, an angle α
1 may be greater than an angle α
2, wherein the angle α
1 may be an angle formed by the first linear line and the X-axis of the coordinate system, and the angle α
2 may be an angle formed by the second linear line and the X-axis of the coordinate system.
In some embodiments, the percentage of the image height H
A may be a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H
A may be equal to or greater than 20 percent and equal to or less than 50 percent.
In some embodiments, the distortion ratio D
A may be an X-coordinate of the intersection point of the first linear line and the second linear line, a percentage of the image height H
A may be a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2, and the distortion ratio D
A may be less than D
100 X (H
A/H
100) , where a percentage H
100 may be 100 percent, and a distortion ratio D
100 may be the distortion ratio at 100 percent of the image height H
100.
In some embodiments, the linear lines may be composed of a first linear line, a second linear line and a third linear line, wherein the first linear line may approximate a lower part of the image height of the distortion curve, the second linear line may approximate a middle part of the image height of the distortion curve, and the third linear line may approximate a higher part of the image height of the distortion curve.
In some embodiments, an angle α
1 may be greater than an angle α
2 and the angle α
2 may be greater than an angle α
3, wherein the angle α
1 may be an angle formed by the first linear line and the X-axis of the coordinate system, the angle α
2 may be an angle formed by the second linear line and the X-axis of the coordinate system, and the angle α
3 may be an angle formed by the third linear line and the X-axis of the coordinate system.
In some embodiments, a percentage of the image height H
A may be a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H
A may be equal to or greater than 20 percent and equal to or less than 50 percent, and
a percentage of the image height H
B may be a Y-coordinate of an intersection point of the second linear line and the third linear line, and the percentage of the image height H
B may be equal to or greater than 70 percent and equal to or less than 90 percent.
In some embodiments, a distortion ratio D
A may be an X-coordinate of the intersection point of the first linear line and the second linear line, a distortion ratio D
B may be an X-coordinate of the intersection point of the second linear line and the third linear line, a percentage of the image height H
A may be a Y-coordinate of the intersection point of the first linear line and the second linear line, a percentage of the image height H
B may be a Y-coordinate of the intersection point of the second linear line and the third linear line, the distortion ratio D
A may be less than D
100 X (H
A/H
100) , and the distortion ratio D
B may be less than D
100 X (H
B/H
100) , where a percentage of the image height H
100 may be 100 percent, a distortion ratio D
100 may be the distortion ratio at 100 percent of the image height H
100.
In accordance with the present disclosure, a method of manufacturing an electrical device may include:
providing the imaging device mentioned above;
providing a distortion correction processor configured to execute the distortion correction process to correct a distortion of the object image on the imaging sensor to generate the final target image; and
assembling the imaging device and the distortion correction processor into the electrical device.
These and/or other aspects and advantages of embodiments of the present disclosure will become apparent and more readily appreciated from the following descriptions made with reference to the drawings, in which:
FIG. 1 is a schematic plan view of an electrical device equipped with an imaging device according to one of embodiments of the present disclosure;
FIG. 2 is a cross sectional view taken along line II-II of the electrical device equipped with the imaging device of FIG. 1;
FIG. 3 illustrates a focal length f of the imaging device in no aberration case (Ideal Optical Lens Case) ;
FIG. 4 illustrates the imaging sensor and a percentage of an image height on an imaging sensor;
FIG. 5 illustrates a distortion curve of the optical lens in no aberration case (Ideal Optical Lens Case) ;
FIG. 6 illustrates the focal length f' of the imaging device in a positive distortion aberration case (Actual Optical Lens Case) ;
FIG. 7 illustrates the imaging sensor and the percentage of the image height on the imaging sensor;
FIG. 8 illustrates the distortion curve of the optical lens in the positive distortion aberration case (Actual Optical Lens Case) ;
FIG. 9 illustrates a degradation of a sharpness of an object image (final target image) after a distortion correction process;
FIG. 10 illustrates the focal length f and the focal length f' of the imaging device according to the present embodiment;
FIG. 11 illustrates the imaging sensor and the object images overlapped with the imaging sensor;
FIG. 12 illustrates a distortion correction processor, the object image before the distortion correction process and the object image (final target image) after the distortion correction process;
FIG. 13 illustrates an example of the distortion curve of the optical lens of the imaging device according to the present embodiment (the distortion curve can be linearized by two linear lines) ;
FIG. 14 shows conditions which the distortion curve represented in FIG. 13 should satisfy;
FIG. 15 illustrates another example of the distortion curve of the optical lens of the imaging device according to the present embodiment (the distortion curve can be linearized by two linear lines) ; and
FIG. 16 shows conditions with which the distortion curve represented in FIG. 15 should be satisfied.
Embodiments of the present disclosure will be described in detail and examples of the embodiments will be illustrated in the accompanying drawings. The same or similar elements and the elements having same or similar functions are denoted by like reference numerals throughout the descriptions. The embodiments described herein with reference to the drawings are explanatory, which aim to illustrate the present disclosure, but shall not be construed to limit the present disclosure.
FIG. 1 illustrates an electrical device 10 according to one of embodiments of the present disclosure and FIG. 2 illustrates a cross sectional view taken along line II-II of the electrical device of FIG. 1. In other words, FIG. 1 illustrates a layout of a first side of the electrical device 10.
As shown in FIGS. 1 and 2, the electrical device 10 may include an imaging device 20 and a distortion correction processor 22. In other words, the imaging device 20 and the distortion correction processor 22 are assembled into the electrical device 10. The imaging device 20 captures an object image of an object to be imaged. The imaging device 20 may include a protective glass 30, an optical lens 40 and an imaging sensor 50. In the present embodiment, the optical lens 40 may be composed of one lens or a combination of a plurality of lenses.
Here, a first side of the imaging device 20 and the optical lens 40 indicates a side in which an object to be imaged by the imaging device 20 is located, and a second side of the imaging device 20 and the optical lens 40 indicates a side in which the imaging sensor 50 is located. The second side of the imaging device 20 and the optical lens 40 is an opposite side of the first side. As a result, when a user of the electrical device 10 captures the object image of the object by using the electrical device 10, the object is located at the first side of the imaging device 20 and the optical lens 40.
The electrical device 10 may be, for example, a smartphone, a tablet computer, a notebook type computer, and others. When the electrical device 10 is designed, a thickness of the electrical device 10 is mainly determined by a height H
imd of the imaging device 20 and the height H
imd of the imaging device 20 is mainly determined by a focal length f of the imaging device 20. Therefore, the thickness of the electrical device 10 is substantially determined by the focal length f of the imaging device 20. In other words, the shorter focal length f can reduce the height H
imd of the imaging device 20 and the shorter height H
imd of the imaging device 20 can reduce the thickness of the electrical device 10.
The distortion correction processor 22 executes a distortion correction process to correct a distortion of the object image to generate a final target image which is the object image the user would like to capture. Although the electrical device 10 according to the present embodiment has the distortion correction processor 22, the distortion correction processor 22 may be omitted in the electrical device 10. In this case, the distortion correction process is executed in other electrical device, for example, in a personal computer, a notebook computer and so on.
FIG. 3 illustrates the focal length f of the imaging device 20 in no aberration case (Ideal Optical Lens Case) , FIG 4 illustrates the imaging sensor 50 and a percentage of an image height H on the imaging sensor 50, and FIG. 5 illustrates a distortion curve of the optical lens 40 shown in FIG. 3.
As shown in FIG. 3, the focal length f is a distance between a center of the optical lens 40 and the imaging sensor 50. An angle θ indicates an angle between a center light input to the center of the optical lens 40 and a light input to the optical lens 40. An angle θ indicates an angle between a center light passing through the center of the optical lens 40 and a light input to the optical lens 40, whereas an angle θ' indicates an angle between the center light passing though the center of the optical lens 40 and a light output from the optical lens 40. In the ideal optical lens, the angle θ of the light input to the optical lens 40 is equal to the angle θ' of the light output from the optical lens 40.
As shown in FIG. 4, the imaging sensor 50 may include M X N pixels, 0 percent of the image height H
0 corresponds to a center of the imaging sensor 50, and 100 percent of the image height H
100 corresponds to a corner C
IMG of the imaging sensor 50. In this case, 100 percent of the image height H
100 is a length H
r between the center of the imaging sensor 50 and the corner C
IMG of the imaging sensor 50. In the ideal optical lens 40, the object image of the object on the imaging sensor 50 is not distorted.
Therefore, as shown in FIG. 3, 100 percent of the image height H
100 and the length H
r is expressed by f X tan θ, or they may also be expressed by f X tan θ' because tan θ is equal to tan θ' in the ideal optical lens 40.
As shown in FIG. 5, the distortion curve of the ideal optical lens 40 is represented on a coordinate system in which an X-axis is a distortion ratio D and a Y-axis is a percentage of the image height H of the object image on the imaging sensor 50. In the distortion curve of the optical lens 40 of the ideal optical lens 40, the distortion ratio D is always 0 percent. That is, the distortion ratio D
0 at 0 percent of the image height H
0 is 0 percent and the distortion ratio D
100 at 100 percent of the image height H
100 is also 0 percent.
FIG. 6 illustrates the focal length f of the imaging device 20 in a positive distortion aberration case (Actual Optical Lens Case) , FIG 7 illustrates the imaging sensor 50 and the percentage of the image height H on a plane of the imaging sensor 50, and FIG. 8 illustrates the distortion curve of the optical lens 40 shown in FIG. 6. FIG. 6, FIG. 7 and FIG. 8 correspond to FIG. 3, FIG. 4 and FIG. 5 mentioned above, respectively.
As shown in FIG. 6, the focal length f is a distance between the center of the optical lens 40 and the imaging sensor 50. The angle θ also indicates an angle between the center light input to the center of the optical lens 40 and the light input to the optical lens 40. The angle θ' also indicates the angle between the center light passing though the center of the optical lens 40 and the light output from the optical lens 40. In the actual optical lens 40, the angle θ of the light input to the optical lens 40 is not equal to the angle θ' of the light output from the optical lens 40 because of an aberration of the optical lens 40. The example of the optical lens 40 shown in FIG. 6 generates a positive distortion aberration.
As shown in FIG. 7, the imaging sensor 50 may also include M X N pixels, and 0 percent of the image height H
0 corresponds to the center of the imaging sensor 50, but 100 percent of the image height H
100 corresponds to an outside of the imaging sensor 50. That is, 100 percent of the image height H
100 does not correspond to the corner C
IMG of the imaging sensor 50 because of the distortion of the object image.
As a result, a length from 0 percent of the image height H
0 to 100 percent of the image height H
100 does not correspond to the length H
r between the center of the imaging sensor 50 and the corner C
IMG of the imaging sensor 50.
Therefore, as shown in FIG. 6, 100 percent of the image height H
100 of the object image on the plane of the imaging sensor 50 is not expressed by f X tan θ but it is express by f X tan θ', where an angle θ' is an angle between the center light and a light forming the corner of the object image of the object on the plane of the imaging sensor 50.
As shown in FIG. 8, in the distortion curve of the optical lens 40 of the actual optical lens, the distortion ratio D is gradually increased as the image height H is increased. That is, a graph of a relationship between the distortion ratio D and the image height H is curved as the image height H is increased. In an example of the distortion curve shown in FIG. 8, the distortion ratio D
0 at 0 percent of the image height H
0 is 0 percent but the distortion ratio D
100 at 100 percent of the image height H
100 is a certain percentage.
The distortion of the object image has to be corrected by means of the distortion correction process to obtain the natural object image (final target image) . However, a sharpness of the object image which has been corrected by the distortion correction process is degraded as shown in FIG. 9.
In FIG. 9, a center part around the center of the corrected object image (final target image) is a sharpness degradation area due to the distortion correction process. This is because, in a unit area in the final target image, an image information quantity in the center part of the object image is less than an image information quantity in a peripheral part of the object image which is outside the center part of the object image.
As mentioned above, in order to lower the height H
imd of the imaging device 20, the focal length f should be shortened. Therefore, in the electrical device 10 of the present embodiment, the focal length f of the imaging device 20 is shortened to the focal length f'.
FIG. 10 illustrates the focal length f' of the imaging device 20 according to the present embodiment, and FIG. 11 illustrates the object image 52 and the object image 54 which are overlapped with the imaging sensor 50.
As shown in FIG. 10, the focal length f' is shorter than the focal length f and thus the height H
imd of the imaging device 20 can be reduced and the imaging device 20 can be smaller. In other words, the optical lens 40 of the imaging device 20 according to the present embodiment is closer to the imaging sensor 50.
As shown in FIG. 11, the optical lens 40 with the focal length f illustrated in FIG. 6 generates the object image 52 whereas the optical lens 40 with the focal length f' illustrated in FIG. 10 generates the object image 54. The object image 52 is subjected to the distortion correction process to correct the distortion of the object image 52. Also, the object image 54 is subjected to the distortion correction process to correct the distortion of the object image 54.
The object image 52 subjected to the distortion correction process is wider than the object image 54 subjected to the distortion correction process. In other words, the object image 52 is wider than the imaging sensor 50, whereas the object image 54 is within a size of the imaging sensor 50.
More specifically, there are four corners 54a in the object image 54 and there are four corners 50a in the imaging sensor 50. Each of the corners 54a of the object image 54 is located at each of the corners 50a of the imaging sensor 50. That is, four of the corners 54a of the object image 54 are located at four of the corners 50a of the imaging sensor 50, respectively.
Therefore, a positon of 100 percent of the image height H
100 of the object image 54 on the imaging sensor 50 is located at the corner 50a of the imaging sensor 50.
There are four edges 54b between the corners 54a in the object image 54 on the imaging sensor 50. The four edges 54b of the object image 54 are decided based on the corners 54a of the object image 54 at the corners 50a of the imaging sensor 50. In the present embodiment, the optical lens 40 generates a pincushion distortion. Therefore, each of the four edges 54b is curved inwardly, and the four edges 54b are also within the size of the imaging sensor 50.
In the present embodiment, the light passing through the optical lens 40 may reach an outside region of the object image 54. Therefore, both an inside region inside the object image 54 and an outside region outside the object image 54 are subjected to the distortion correction process, and the outside region is cut out to create the final target image without distortion by the inside region of the object image 54.
Alternatively, the distortion correction process may be applied only to the inside region of the object image 54. That is, the inside region inside the object image 54 is defined by the four edges 54b, and the distortion correction process is executed for the inside region of the object image 54 to correct the distortion of the object image 54. Alternatively, the outside region of the object image 54 may be cut out before the distortion correction process.
As shown in FIG. 10 and FIG. 11, 100 percent of the image height H
100 of the object image 54 is expressed by f' X tan θ”, where the angle θ” is an angle between the center light and a light forming the corner 54a of the object image 54 of the object on the plane of the imaging sensor 50. An angle between the center light and a light forming the edges 54b other than the corners 54a is less than the angle θ”. In other words, the angle θ” is the greatest angle between the center light and the light forming the corners 54a and the edges 54b of the object image 54 on the plane of the imaging sensor 50.
FIG. 12 illustrates the distortion correction processor 22, the object image 54 before the distortion correction process and the object image 54 after the distortion correction process which is the final target image the user would like to obtain.
As shown in FIG. 12, the distortion correction processor 22 executes the distortion correction process for the object image 54. Before the distortion correction process, the object image 54 is distorted and thus the edges 54b of the object image 54 are curved inwardly.
Therefore, the distortion correction processor 22 stretches the object image 54 to correct the distortion of the object image 54 and generate the final target image. More specifically, the distortion correction processor 22 stretches the object image 54 outwardly in the distortion correction process. That is, the object image 54 is outwardly extended on all sides.
The distortion correction processor 22 stretches the object image 54 in accordance with, for example, a bicubic interpolation, a bilinear interpolation, or the like. However, the distortion correction processor 22 may stretch the object image 54 in accordance with other methods.
After the distortion correction process has been applied to the object image 54, the distortion of the object image 54 is substantially eliminated and thus the edges 54b of the object image 54 become substantially straight.
However, as explained with regard to FIG. 9, the center part of the object image 54 is degraded due to the distortion correction process. For the users of the electrical device 10, the center part of the object image 54 is the most important because a region of interest is often located around the center of the object image 54. Here, the sharpness degradation of the object image 54 is relative to the distortion curve of the optical lens 40. Therefore, in order to improve and suppress the degradation of the object image, the optical lens 40 of the imaging device 20 of the present embodiment has a specific distortion curve.
FIG. 13 illustrates an example of the distortion curve DC of the optical lens 40 of the imaging device 20 according to the present embodiment. FIG. 14 shows conditions which the distortion curve DC represented in FIG. 13 should satisfy. Although FIG. 14 shows five conditions, i.e. a condition 1 through a condition 5, the optical lens 40 is not necessarily to satisfy all of the five conditions 1-5. That is, the optical lens 40 may satisfy one, two, three or four conditions among the five conditions 1-5.
As shown in FIG. 13 and FIG. 14, the distortion curve DC of the optical lens 40 is represented in a coordinate system, an X-axis of the coordinate system is the distortion ratio D of the object image 54, and a Y-axis of the coordinate system is a percentage of the image height H of the object image on the plane of the imaging sensor 50.
A minimum of the percentage of the image height H
0 is 0 and it is located at the origin of the coordinate system. A maximum of the percentage of the image height H
100 is 100 and it is located on the Y-axis of the coordinate system. 0 percent of the image height H
0 corresponds to the center of the object image 54, and 100 percent of the image height H
100 corresponds to the corners 54a of the object image 54 on the plane of the imaging sensor 50.
Also, a minimum of the distortion ratio D
0 is 0 and it is located at the origin of the coordinate system. A maximum of the distortion ratio D
100 depends on the characteristics of the optical lens 40. The distortion ratio D
0 indicates the distortion ratio at the center of the object image 54, and the distortion ratio D
100 indicates the distortion ratio at the corners 54a of the object image 54.
In the present embodiment, the distortion ratio D is expressed by (AD-PD) /PD X 100%. The predicted distance PD indicates a distance from the center of the object image to an ideal point where the object should be imaged. The actual distance AD indicates a distance from the center of the object image to an actual point where the object is actually imaged.
Incidentally, the distortion curve DC illustrated in FIG. 13 shows the characteristics of the design of the optical lens 40 or the characteristics of the actual optical lens 40. That is, the characteristics of mass-produced optical lens 40 is not the same as each other, and each of them has own characteristics. Therefore, 1) the distortion curve DC in FIG. 13 may be considered as the characteristics of the design of the optical lens 40, 2) the distortion curve DC in FIG. 13 may be considered as the characteristics of each mass-produced optical lens 40, or 3) the distortion curve DC in FIG. 13 may be considered as an average of the characteristics of the mass-produced optical lenses 40. Therefore, the following explanation can be applied to any kind of the distortion curve DC.
The distortion curve DC of the optical lens 40 of the imaging device 20 according to the present embodiment satisfies any combinations of the following conditions 1-5.
<Condition 1>
The distortion curve DC can be linearized and approximated by two or more linear lines in the coordinate system. In the example shown in FIG. 13, the distortion curve DC can be linearized and approximated by two linear lines. That is, the distortion curve DC can be linearized and approximated by a first linear line L1 and a second linear line L2. The first linear line L1 approximates a lower part of the image height H of the distortion curve DC, and the second linear line L2 approximates a higher part of the image height H of the distortion curve DC.
For example, the first linear line L1 and the second linear line L2 can be calculated and decided by the method of least squares, i.e., the linear approximation. Of course, the other method to calculate and decide the first linear line L1 and the second linear line L2 may be employed.
<Condition 2>
An angle α
1 is greater than an angle α
2, where the angle α
1 is an angle formed by the first linear line L1 and the X-axis of the coordinate system and the angle α
2 is an angle formed by the second linear line L2 and the X-axis of the coordinate system.
If the distortion curve DC satisfies the condition 2, the sharpness of the center part of the object image can be improved, because the distortion ratio D of the first linear line L1 is less than the distortion ratio of the second linear line L2. In other words, the distortion curve DC in the lower part of the image height H is steeper than the distortion curve DC in the higher part of the image height H. The steeper distortion curve DC in the lower part of the image height H improves the sharpness of the center part of the object image and the final target image, and the degradation of the sharpness of the object image and the final target image can be suppressed.
<Condition 3>
The distortion ratio D
A is less than D
100 X (H
A/H
100) . Here, a distortion ratio D
A is an X-coordinate of the intersection point of the first linear line L1 and the second linear line L2, and a percentage of the image height H
A is a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2. Moreover, a percentage H
100 is 100 percent, and a distortion ratio D
100 is the distortion ratio at 100 percent of the image height H
100.
If the distortion curve satisfies the condition 3, the sharpness of the center part of the object image and the final target image can be improved, because the distortion ratio D
A at the intersection point of the first linear line L1 and the second linear line L2 is small enough.
<Condition 4>
A percentage of the image height H
A is equal to or greater than 20 percent and equal to or less than 50 percent. Also here, the percentage of the image height H
A is the Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2.
If the distortion curve satisfies the condition 4, the sharpness of the center part of the object image and the final target image can be improved, because the distortion curve DC from 0 percent to between 20 percent and 50 percent of the image height H can be linearized and approximated by the first linear line L1, which defines the sharpness of the center part of the object image and the final target image.
In the present embodiment, if the percentage of the image height H
A is less than 20 percent, a fine and clear region of the object image is too small for the users. On the other hand, if the percentage of the image height H
A is greater than 50 percent, it is difficult for designers and engineers to design the optical lens 40 with the short focal length f'.
<Condition 5>
A distortion ratio D
100 at 100 percent of the image height H
100 of the object image of the optical lens is equal to or greater than 5 percent and equal to or less than D
NM. Here,
D
NM =4 X L /1000,
L=( (1/2 X M)
2+ (1/2 X N)
2)
1/2,
M is a number of pixels in a vertical direction of the imaging sensor 50, and
N is a number of pixels in a horizontal direction of the imaging sensor 50.
In the condition 5, L indicates the number of pixels in a half of a diagonal line of the imaging sensor 50, namely, the number of pixels along a line from 0 percent of the image height H
0 to 100 percent of the image height H
100 of the object image on the imaging sensor 50. A value of 4 is a factor to adjust D
NM to define a reasonable and proper maximum value of the distortion ratio D.
For example, if M is 3000 pixels and N is 4000 pixels, L=((1500
2) + (2000
2) )
1/2 = 2500 and D
NM = 4 X 2500/1000 = 10 percent. That is, in accordance with this example, the maximum value of D
NM is 10 percent.
If the optical lens 40 is positioned closer to the imaging sensor 50, the distortion ratio D of the object image on the imaging sensor 50 is increased. Conversely, if a greater value of the distortion ratio D is acceptable for the design of the optical lens 40, the optical lens 40 can be positioned closer to the imaging sensor 50 and it results in the reduction of the height H
imd of the imaging device 20.
Therefore, if the distortion ratio D is equal to or greater than 5 percent is acceptable, the height H
imd of the imaging device 20 can be reduced as compared to conventional imaging devices.
However, if the distortion ratio D is too large, it is impossible to correct the distortion of the object image on the imaging sensor 50 by the distortion correction process in the distortion correction processor 22. Therefore, in the condition 5 of the present embodiment, the maximum distortion ratio D
NM is defined by D
NM =4 X L /1000 where L= ( (1/2 X M)
2+ (1/2 X N)
2)
1/2.
Although the distortion curve DC shown in FIG. 13 can be linearized and approximated by two of the linear lines L1 and L2, the distortion curve DC may be linearized and approximated by three or more linear lines. An example in which the distortion curve DC can be linearized and approximated by three linear lines will be explained hereinafter.
FIG. 15 illustrates the example of the distortion curve DC of the optical lens 40 in which the distortion curve DC can be approximated by three of linear lines. FIG. 16 shows conditions which the distortion curve DC represented in FIG. 15 should satisfy. FIG. 15 and FIG. 16 correspond to FIG. 13 and FIG. 14, respectively.
The distortion curve DC shown in FIG. 15 satisfies any combinations of the following conditions 1-5.
<Condition 1>
The distortion curve DC can be linearized and approximated by three linear lines L1, L2 and L3. That is, the distortion curve DC can be linearized and approximated by the first linear line L1, the second linear line L2 and the third linear line L3. The first linear line L1 approximates a lower part of the image height H of the distortion curve DC, the second linear line L2 approximates a middle part of the image height H of the distortion curve DC, and the third linear line L3 approximates a higher part of the image height H of the distortion curve DC.
<Condition 2>
An angle α
1 is greater than an angle α
2 and the angle α
2 is greater than an angle α
3. Here, the angle α
1 is an angle formed by the first linear line L1 and the X-axis of the coordinate system, the angle α
2 is an angle formed by the second linear line L2 and the X-axis of the coordinate system, and the angle α
3 is an angle formed by the third linear line L3 and the X-axis of the coordinate system.
If the distortion curve DC satisfies the condition 2, the sharpness of the center part of the object image can be improved, because the distortion ratio D of the first linear line L1 is less than the distortion ratio D of the second linear line L2, and the distortion ratio D of the second linear line L2 is less than the distortion ratio D of the third linear line L3. In other words, the distortion curve DC in the lower part of the image height H is steeper than the distortion curve DC in the middle part of the image height H, and the distortion curve DC in the middle part of the image height H is steeper than the distortion curve DC in the higher part of the image height H. The steeper distortion curve DC in the lower part of the image height H improves the sharpness of the center part of the object image and the final target image, and the degradation of the sharpness of the object image and the final target can be suppressed.
<Condition 3>
A distortion ratio D
A is an X-coordinate of the intersection point of the first linear line L1 and the second linear line L2, a distortion ratio D
B is an X-coordinate of the intersection point of the second linear line L2 and the third linear line L3, a percentage of the image height H
A is a Y-coordinate of the intersection point of the first linear line and the second linear line, and a percentage of the image height H
B is a Y-coordinate of the intersection point of the second linear line and the third linear line. In addition, a percentage H
100 is 100 percent, a distortion ratio D
100 is the distortion ratio at 100 percent of the image height H
100, the distortion ratio D
A is less than D
100 X (H
A/H
100) , and the distortion ratio D
B is less than D
100 X (H
B/H
100) .
If the distortion curve satisfies the condition 3, the sharpness of the center part of the object image and the final target image can be improved, because the distortion ratio D
A is much less than the distortion ratio D
B.
<Condition 4>
Also here, the percentage H
A is a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2, and the percentage H
A is equal to or greater than 20 percent and equal to or less than 50 percent. In addition, the percentage H
B is the Y-coordinate of an intersection point of the second linear line L2 and the third linear line L3, and the percentage H
B is equal to or greater than 70 percent and equal to or less than 90 percent.
If the distortion curve DC satisfies the condition 4, the sharpness of the center part of the object image and the final target image can be improved, because the distortion curve DC from 0 percent to between 20 percent and 50 percent of the image height H can be linearized and approximated by the first linear line L1 which defines the sharpness of the center part of the object image and the final target image, and the distortion curve DC from between 20 percent and 50 percent to between 70 percent and 90 percent of the image height H can be linearized and approximated by the second linear line L2 which defines the sharpness of the middle part of the object image and the final target image.
<Condition 5>
The condition 5 of the distortion curve in FIG. 15 is the same as that in FIG. 13. That is, a distortion ratio D
100 at 100 percent of the image height H
100 of the object image of the optical lens 40 is equal to or greater than 5 percent and equal to or less than D
NM. Here,
D
NM =4 X L /1000,
L=( (1/2 X M)
2+ (1/2 X N)
2)
1/2,
M is a number of pixels in a vertical direction of the imaging sensor 50, and
N is a number of pixels in a horizontal direction of the imaging sensor 50.
As explained herein above, in accordance with the imaging device 20 of the electrical device 10 of the present embodiment, since the focal length f' can be shortened, the height H
imd of the imaging device 20 can be reduced. Therefore, the thickness of the electrical device 10 including the imaging device 20 can also be reduced.
Also, since the height H
imd of the imaging device 20 can be lowered, a projection part for the imaging device 20 of the electrical device 10 can be eliminated and the thin and slim electrical device 10 can be realized. In other words, the electrical device 10 can be designed with a full flat surface.
In addition, even if a larger sized imaging sensor 50 is employed, the height H
imd of the imaging device 20 can still be reduced because the focal length f' can be shortened as compared to conventional imaging devices. Therefore, the larger sized imaging sensor 50 can be equipped with the electrical device 10 and the quality of the object image and the final target image can be raised.
In the description of embodiments of the present disclosure, it is to be understood that terms such as "central", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise" and "counterclockwise" should be construed to refer to the orientation or the position as described or as shown in the drawings under discussion. These relative terms are only used to simplify description of the present disclosure, and do not indicate or imply that the device or element referred to must have a particular orientation, or constructed or operated in a particular orientation. Thus, these terms cannot be constructed to limit the present disclosure.
In addition, terms such as "first" and "second" are used herein for purposes of description and are not intended to indicate or imply relative importance or significance or to imply the number of indicated technical features. Thus, the feature defined with "first" and "second" may comprise one or more of this feature. In the description of the present disclosure, "a plurality of" means two or more than two, unless specified otherwise.
In the description of embodiments of the present disclosure, unless specified or limited otherwise, the terms "mounted", "connected", "coupled" and the like are used broadly, and may be, for example, fixed connections, detachable connections, or integral connections; may also be mechanical or electrical connections ; may also be direct connections or indirect connections via intervening structures; may also be inner communications of two elements, which can be understood by those skilled in the art according to specific situations.
In the embodiments of the present disclosure, unless specified or limited otherwise, a structure in which a first feature is "on" or "below" a second feature may include an embodiment in which the first feature is in direct contact with the second feature, and may also include an embodiment in which the first feature and the second feature are not in direct contact with each other, but are contacted via an additional feature formed therebetween. Furthermore, a first feature "on", "above" or "on top of" a second feature may include an embodiment in which the first feature is right or obliquely "on", "above" or "on top of" the second feature, or just means that the first feature is at a height higher than that of the second feature; while a first feature "below", "under"or "on bottom of" a second feature may include an embodiment in which the first feature is right or obliquely "below", "under" or "on bottom of" the second feature, or just means that the first feature is at a height lower than that of the second feature.
Various embodiments and examples are provided in the above description to implement different structures of the present disclosure. In order to simplify the present disclosure, certain elements and settings are described in the above. However, these elements and settings are only by way of example and are not intended to limit the present disclosure. In addition, reference numbers and/or reference letters may be repeated in different examples in the present disclosure. This repetition is for the purpose of simplification and clarity and does not refer to relations between different embodiments and/or settings. Furthermore, examples of different processes and materials are provided in the present disclosure. However, it would be appreciated by those skilled in the art that other processes and/or materials may be also applied.
Reference throughout this specification to "an embodiment", "some embodiments", "an exemplary embodiment", "an example", "a specific example" or "some examples" means that a particular feature, structure, material, or characteristics described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. Thus, the appearances of the above phrases throughout this specification are not necessarily referring to the same embodiment or example of the present disclosure. Furthermore, the particular features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.
Any process or method described in a flow chart or described herein in other ways may be understood to include one or more modules, segments or portions of codes of executable instructions for achieving specific logical functions or steps in the process, and the scope of a preferred embodiment of the present disclosure includes other implementations, in which it should be understood by those skilled in the art that functions may be implemented in a sequence other than the sequences shown or discussed, including in a substantially identical sequence or in an opposite sequence.
The logic and/or step described in other manners herein or shown in the flow chart, for example, a particular sequence table of executable instructions for realizing the logical function, may be specifically achieved in any computer readable medium to be used by the instruction execution system, device or equipment (such as the system based on computers, the system comprising processors or other systems capable of obtaining the instruction from the instruction execution system, device and equipment and executing the instruction) , or to be used in combination with the instruction execution system, device and equipment. As to the specification, "the computer readable medium" may be any device adaptive for including, storing, communicating, propagating or transferring programs to be used by or in combination with the instruction execution system, device or equipment. More specific examples of the computer readable medium comprise but are not limited to: an electronic connection (an electronic device) with one or more wires, a portable computer enclosure (a magnetic device) , a random access memory (RAM) , a read only memory (ROM) , an erasable programmable read-only memory (EPROM or a flash memory) , an optical fiber device and a portable compact disk read-only memory (CDROM) . In addition, the computer readable medium may even be a paper or other appropriate medium capable of printing programs thereon, this is because, for example, the paper or other appropriate medium may be optically scanned and then edited, decrypted or processed with other appropriate methods when necessary to obtain the programs in an electric manner, and then the programs may be stored in the computer memories.
It should be understood that each part of the present disclosure may be realized by the hardware, software, firmware or their combination. In the above embodiments, a plurality of steps or methods may be realized by the software or firmware stored in the memory and executed by the appropriate instruction execution system. For example, if it is realized by the hardware, likewise in another embodiment, the steps or methods may be realized by one or a combination of the following techniques known in the art: a discrete logic circuit having a logic gate circuit for realizing a logic function of a data signal, an application-specific integrated circuit having an appropriate combination logic gate circuit, a programmable gate array (PGA) , a field programmable gate array (FPGA) , etc.
Those skilled in the art shall understand that all or parts of the steps in the above exemplifying method of the present disclosure may be achieved by commanding the related hardware with programs. The programs may be stored in a computer readable storage medium, and the programs comprise one or a combination of the steps in the method embodiments of the present disclosure when run on a computer.
In addition, each function cell of the embodiments of the present disclosure may be integrated in a processing module, or these cells may be separate physical existence, or two or more cells are integrated in a processing module. The integrated module may be realized in a form of hardware or in a form of software function modules. When the integrated module is realized in a form of software function module and is sold or used as a standalone product, the integrated module may be stored in a computer readable storage medium.
The storage medium mentioned above may be read-only memories, magnetic disks, CD, etc.
Although embodiments of the present disclosure have been shown and described, it would be appreciated by those skilled in the art that the embodiments are explanatory and cannot be construed to limit the present disclosure, and changes, modifications, alternatives and variations can be made in the embodiments without departing from the scope of the present disclosure.
Claims (28)
- An imaging device, comprising:an optical lens, wherein an object to be imaged is located at a first side of the optical lens; andan imaging sensor located at a second side of the optical lens which is an opposite side of the first side of the optical lens, wherein a position of 100 percent of an image height H 100 of an object image is located at a corner of the imaging sensor.
- The imaging device according to claim 1, wherein the object image on the imaging sensor is subjected to a distortion correction process to generate a final target image.
- The imaging device according to claim 2, wherein the optical lens generates a pincushion distortion,an edge of the final target image is decided based on the corner of the object image at the corner of the imaging sensor, andan outside region of the object image which is outside the final target image is cut out when the final target image is generated.
- The imaging device according to claim 3, wherein a distortion ratio D 100 at 100 percent of the image height H 100 of the object image of the optical lens is equal to or greater than 5 percent and equal to or less than D NM, whereD NM=4 X L/1000,L= ( (1/2 X M) 2+ (1/2 X N) 2) 1/2,M is a number of pixels in a vertical direction of the imaging sensor, andN is a number of pixels in a horizontal direction of the imaging sensor.
- The imaging device according to claim 4, wherein a distortion curve of the optical lens represented in a coordinate system is linearized by two or more linear lines, wherein an X-axis of the coordinate system is the distortion ratio D and a Y-axis of the coordinate system is a percentage of the image height H of the object image on the imaging sensor.
- The imaging device according to claim 5, wherein the linear lines are composed of a first linear line and a second linear line, wherein the first linear line approximates a lower part of the image height of the distortion curve in the coordinate system and the second linear line approximates a higher part of the image height of the distortion curve in the coordinate system.
- The imaging device according to claim 6, wherein an angle α 1 is greater than an angle α 2, wherein the angle α 1 is an angle formed by the first linear line and the X-axis of the coordinate system, and the angle α 2 is an angle formed by the second linear line and the X-axis of the coordinate system.
- The imaging device according to claim 6, wherein the percentage of the image height H A is a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H A is equal to or greater than 20 percent and equal to or less than 50 percent.
- The imaging device according to claim 6, wherein the distortion ratio D A is an X-coordinate of the intersection point of the first linear line and the second linear line, a percentage of the image height H A is a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2, and the distortion ratio D A is less than D 100 X (H A/H 100) , where a percentage H 100 is 100 percent, and a distortion ratio D 100 is the distortion ratio at 100 percent of the image height H 100.
- The imaging device according to claim 5, wherein the linear lines are composed of a first linear line, a second linear line and a third linear line, wherein the first linear line approximates a lower part of the image height of the distortion curve, the second linear line approximates a middle part of the image height of the distortion curve, and the third linear line approximates a higher part of the image height of the distortion curve.
- The imaging device according to claim 10, wherein an angle α 1 is greater than an angle α 2 and the angle α 2 is greater than an angle α 3, wherein the angle α 1 is an angle formed by the first linear line and the X-axis of the coordinate system, the angle α 2 is an angle formed by the second linear line and the X-axis of the coordinate system, and the angle α 3 is an angle formed by the third linear line and the X-axis of the coordinate system.
- The imaging device according to claim 10, wherein a percentage of the image height H A is a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H A is equal to or greater than 20 percent and equal to or less than 50 percent, anda percentage of the image height H B is a Y-coordinate of an intersection point of the second linear line and the third linear line, and the percentage of the image height H B is equal to or greater than 70 percent and equal to or less than 90 percent.
- The imaging device according to claim 10, wherein a distortion ratio D A is an X-coordinate of the intersection point of the first linear line and the second linear line, a distortion ratio D B is an X-coordinate of the intersection point of the second linear line and the third linear line, a percentage of the image height H A is a Y-coordinate of the intersection point of the first linear line and the second linear line, a percentage of the image height H B is a Y-coordinate of the intersection point of the second linear line and the third linear line, the distortion ratio D A is less than D 100 X (H A/H 100) , and the distortion ratio D B is less than D 100 X (H B/H 100) , where a percentage of the image height H 100 is 100 percent and a distortion ratio D 100 is the distortion ratio at 100 percent of the image height H 100.
- An electrical device, comprising:the imaging device according to any one of claims 1-13; anda distortion correction processor configured to execute the distortion correction process to correct a distortion of the object image on the imaging sensor to generate the final target image.
- A method of manufacturing an imaging device, comprising:providing a support member;providing an optical lens;providing an imaging sensor; andassembling the support member, the optical lens and the imaging sensor so that an object to be imaged is located at a first side of the optical lens and the imaging sensor is located at a second side of the optical lens which is an opposite side of the first side of the optical lens, wherein a position of 100 percent of an image height H 100 of an object image is located at a corner of the imaging sensor.
- The method according to claim 15, wherein the object image on the imaging sensor is subjected to a distortion correction process to generate a final target image.
- The method according to claim 16, wherein the optical lens generates a pincushion distortion,an edge of the final target image is decided based on the corner of the object image at the corner of the imaging sensor, andan outside region of the object image which is outside the final target image is cut out when the final target image is generated.
- The method according to claim 17, wherein a distortion ratio D 100 at 100 percent of the image height H 100 of the object image on the imaging sensor of the optical lens is equal to or greater than 5 percent and equal to or less than D NM, whereD NM=4 X L/1000,L= ( (1/2 X M) 2+ (1/2 X N) 2) 1/2,M is a number of pixels in a vertical direction of the imaging sensor, andN is a number of pixels in a horizontal direction of the imaging sensor.
- The method according to claim 18, wherein a distortion curve of the optical lens represented in a coordinate system is linearized by two or more linear lines, wherein an X-axis of the coordinate system is the distortion ratio D and a Y-axis of the coordinate system is a percentage of the image height H of the object image on the imaging sensor.
- The method according to claim 19, wherein the linear lines are composed of a first linear line and a second linear line, wherein the first linear line approximates a lower part of the image height of the distortion curve in the coordinate system and the second linear line approximates a higher part of the image height of the distortion curve in the coordinate system.
- The method according to claim 20, wherein an angle α 1 is greater than an angle α 2, wherein the angle α 1 is an angle formed by the first linear line and the X-axis of the coordinate system, and the angle α 2 is an angle formed by the second linear line and the X-axis of the coordinate system.
- The method according to claim 20, wherein the percentage of the image height H A is a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H A is equal to or greater than 20 percent and equal to or less than 50 percent.
- The method according to claim 20, wherein the distortion ratio D A is an X-coordinate of the intersection point of the first linear line and the second linear line, a percentage of the image height H A is a Y-coordinate of the intersection point of the first linear line L1 and the second linear line L2, and the distortion ratio D A is less than D 100 X (H A/H 100) , where a percentage H 100 is 100 percent, and a distortion ratio D 100 is the distortion ratio at 100 percent of the image height H 100.
- The method according to claim 19, wherein the linear lines are composed of a first linear line, a second linear line and a third linear line, wherein the first linear line approximates a lower part of the image height of the distortion curve, the second linear line approximates a middle part of the image height of the distortion curve, and the third linear line approximates a higher part of the image height of the distortion curve.
- The method according to claim 24, wherein an angle α 1 is greater than an angle α 2 and the angle α 2 is greater than an angle α 3, wherein the angle α 1 is an angle formed by the first linear line and the X-axis of the coordinate system, the angle α 2 is an angle formed by the second linear line and the X-axis of the coordinate system, and the angle α 3 is an angle formed by the third linear line and the X-axis of the coordinate system.
- The method according to claim 24, wherein a percentage of the image height H A is a Y-coordinate of an intersection point of the first linear line and the second linear line, and the percentage of the image height H A is equal to or greater than 20 percent and equal to or less than 50 percent, anda percentage of the image height H B is a Y-coordinate of an intersection point of the second linear line and the third linear line, and the percentage of the image height H B is equal to or greater than 70 percent and equal to or less than 90 percent.
- The method according to claim 24, wherein a distortion ratio D A is an X-coordinate of the intersection point of the first linear line and the second linear line, a distortion ratio D B is an X-coordinate of the intersection point of the second linear line and the third linear line, a percentage of the image height H A is a Y-coordinate of the intersection point of the first linear line and the second linear line, a percentage of the image height H B is a Y-coordinate of the intersection point of the second linear line and the third linear line, the distortion ratio D A is less than D 100 X (H A/H 100) , and the distortion ratio D B is less than D 100 X (H B/H 100) , where a percentage of the image height H 100 is 100 percent, and a distortion ratio D 100 is the distortion ratio at 100 percent of the image height H 100.
- A method of manufacturing an electrical device, comprising:providing the imaging device according to any one of claims 15-27;providing a distortion correction processor configured to execute the distortion correction process to correct a distortion of the object image on the imaging sensor to generate the final target image; andassembling the imaging device and the distortion correction processor into the electrical device.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202080098688.5A CN115280750A (en) | 2020-03-31 | 2020-03-31 | Imaging apparatus, electronic apparatus, method of manufacturing imaging apparatus, and method of manufacturing electronic apparatus |
PCT/CN2020/082386 WO2021195946A1 (en) | 2020-03-31 | 2020-03-31 | Imaging device, electrical device, method of manufacturing imaging device, and method of manufacturing electrical device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2020/082386 WO2021195946A1 (en) | 2020-03-31 | 2020-03-31 | Imaging device, electrical device, method of manufacturing imaging device, and method of manufacturing electrical device |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021195946A1 true WO2021195946A1 (en) | 2021-10-07 |
Family
ID=77927343
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/082386 WO2021195946A1 (en) | 2020-03-31 | 2020-03-31 | Imaging device, electrical device, method of manufacturing imaging device, and method of manufacturing electrical device |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN115280750A (en) |
WO (1) | WO2021195946A1 (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110043667A1 (en) * | 2009-08-20 | 2011-02-24 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
US20160044221A1 (en) * | 2014-08-11 | 2016-02-11 | Seiko Epson Corporation | Imaging display device and control method thereof |
US20160112646A1 (en) * | 2014-10-15 | 2016-04-21 | Canon Kabushiki Kaisha | Image processing apparatus, image pickup apparatus, and image processing method |
CN105827899A (en) * | 2015-05-26 | 2016-08-03 | 维沃移动通信有限公司 | Method and device for correcting lens distortion |
US20190102868A1 (en) * | 2017-10-04 | 2019-04-04 | Intel Corporation | Method and system of image distortion correction for images captured by using a wide-angle lens |
CN110533618A (en) * | 2019-09-03 | 2019-12-03 | 西安奇维科技有限公司 | A kind of method and photographic means of lens distortion correction |
US20190384033A1 (en) * | 2018-06-13 | 2019-12-19 | Canon Kabushiki Kaisha | Apparatus and lens apparatus |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8792028B2 (en) * | 2008-12-18 | 2014-07-29 | Omnivision Technologies, Inc. | Image sensor apparatus and method for line buffer efficient lens distortion correction |
-
2020
- 2020-03-31 WO PCT/CN2020/082386 patent/WO2021195946A1/en active Application Filing
- 2020-03-31 CN CN202080098688.5A patent/CN115280750A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110043667A1 (en) * | 2009-08-20 | 2011-02-24 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
US20160044221A1 (en) * | 2014-08-11 | 2016-02-11 | Seiko Epson Corporation | Imaging display device and control method thereof |
US20160112646A1 (en) * | 2014-10-15 | 2016-04-21 | Canon Kabushiki Kaisha | Image processing apparatus, image pickup apparatus, and image processing method |
CN105827899A (en) * | 2015-05-26 | 2016-08-03 | 维沃移动通信有限公司 | Method and device for correcting lens distortion |
US20190102868A1 (en) * | 2017-10-04 | 2019-04-04 | Intel Corporation | Method and system of image distortion correction for images captured by using a wide-angle lens |
US20190384033A1 (en) * | 2018-06-13 | 2019-12-19 | Canon Kabushiki Kaisha | Apparatus and lens apparatus |
CN110533618A (en) * | 2019-09-03 | 2019-12-03 | 西安奇维科技有限公司 | A kind of method and photographic means of lens distortion correction |
Also Published As
Publication number | Publication date |
---|---|
CN115280750A (en) | 2022-11-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11089201B2 (en) | Dual-core focusing image sensor, focusing control method for the same, and electronic device | |
AU2018263023B2 (en) | Camera assembly and mobile electronic device | |
CN102547080B (en) | Camera module and comprise the messaging device of this camera module | |
US9086558B2 (en) | Small form factor high-resolution camera | |
WO2018196704A1 (en) | Dual-core focusing image sensor, focusing control method thereof, and imaging device | |
CN103728705A (en) | Imaging lens capable of eliminating stray light | |
US10317779B2 (en) | Imaging apparatus | |
US20150373227A1 (en) | Image processing apparatus, method, and medium | |
CN114128250A (en) | Method for designing small lenses with intentional distortion | |
CN111081149B (en) | Display method and display device | |
KR20140072470A (en) | Distorted Image Processing Method For Fish-Eye Lens | |
US10395337B2 (en) | Image processing apparatus, image processing method, and storage medium | |
WO2021195946A1 (en) | Imaging device, electrical device, method of manufacturing imaging device, and method of manufacturing electrical device | |
WO2021196057A1 (en) | Optical lens, imaging device, electrical device, method of manufacturing the same | |
US20220141435A1 (en) | Projection device and projection picture correction method thereof | |
US20230176336A1 (en) | Lens assembly and electronic device including the same | |
CN213690085U (en) | Optical imaging system, image capturing module and electronic device | |
WO2022109795A1 (en) | Imaging lens assembly which takes into consideration image processing-based distortion correction, camera module and imaging device | |
WO2021212503A1 (en) | Imaging lens which takes into consideration optical image stabilization and image processing-based distortion correction, camera module and imaging device | |
CN112327461A (en) | Optical imaging system, image capturing module and electronic device | |
US20220286586A1 (en) | Imaging device and electronic device | |
CN112312056A (en) | Video conferencing with adaptive lens distortion correction and image distortion reduction | |
WO2021168802A1 (en) | Cover lens and imaging device | |
CN216356966U (en) | Camera module and terminal | |
CN216248540U (en) | Optical imaging system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20929368 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20929368 Country of ref document: EP Kind code of ref document: A1 |