JP2022122032A - Imaging apparatus and imaging method - Google Patents

Abstract

To provide an imaging apparatus and an imaging method.SOLUTION: An imaging apparatus includes at least one light-emitting unit which outputs at least one reference beam to an object to be measured, an image sensor which receives at least one reference beam reflected from the object to be measured and generates a plurality of sets of pixel data on the basis of the object to be measured, and a processing unit which is coupled to at least one light-emitting unit and the image sensor and generates a correction image by executing at least one of rearrangement, partial deletion, and partial addition with respect to the plurality of sets of pixel data on the basis of at least one reference beam received by the image sensor.SELECTED DRAWING: Figure 1

Description

The present invention relates to an imaging apparatus and an imaging method, and more particularly to an imaging apparatus and an imaging method that can accurately correct image distortion and can be easily carried around.

In the age of electronic products, people's demand and demand for images of contents such as life records, commerce and medicine are gradually increasing, and the image recording format is gradually shifting from the traditional negative film in the early days to the digital file. became. In particular, planar images frequently used in commercial and medical fields require image accuracy. Due to the insufficient accuracy of the extracted image, serious recognition and judgment results may occur, resulting in loss of life safety and property. For this purpose, image calibration is an important issue.

In the prior art, in order to obtain a more accurate image, a fixed structure image scanning device is usually adopted to avoid situations such as the user not adjusting the optimal figurine distance. Since the image scanning device also uses a pre-adjusted fixed distance pedestal, the maximum resolution of all pixels can be fully realized. However, such stationary scanning devices that use a fixed figurine distance are generally equivalent to large volumes, such as scanning machines, fax machines, multifunction office machines, or other desktop scanning machines. have weight. Alternatively, consider acquiring an image of the object under test in a non-stationary manner, for example, with a handheld or support-mounted digital camera. When a general user operates, it is not possible to correct the horizontal position of the object to be measured and the horizontal position of the digital camera at the same time. It is necessary to perform edge correction processing such as (keystone adjustment) to bring the entire image closer to reality.

However, prior art programs for distorted image acquisition and correction must first locate and mark the boundaries of the distorted image (usually areas of high contrast difference). A specific application is then used to expand or compress the entire distorted image in two dimensions. However, when a distorted image is expanded or compressed in two dimensions, it is likely that there will be texture offsets in the details, resulting in inaccurate proportionality between multiple textures (e.g. facial distortion). ), the distortion of the distorted image after correction is increased. Furthermore, it is difficult for a general user to adjust the distance between the object to be measured and the digital camera each time an image is acquired, and the maximum resolution constituted by all pixels cannot be exhibited.

Therefore, how to design the imaging device and the imaging method, especially the lack of portability of the conventional technology, the corrected distorted image is more distorted, and the maximum resolution configured by all pixels cannot be exhibited. How to solve the problem is an important issue studied by the inventors of the present application.

The object of the present invention is to avoid the technical problems of the prior art, such as lack of portability, distorted images after correction, and inability to achieve the maximum resolution constituted by all pixels, making it easy to carry, An object of the present invention is to provide an imaging device capable of achieving high precision and high resolution.

In order to achieve the above object, the imaging device according to the present invention is applied to an object under test, at least one light emitting unit each outputting at least one reference beam to the object under test; an image sensor that receives the at least one reference beam reflected from and generates a plurality of pixel data based on the object under test; a processing unit that performs at least one of rearrangement, deletion, and addition on the plurality of pixel data based on the at least one reference beam received by a sensor to generate a corrected image; including.

Also, in the imaging device, the image sensor includes a plurality of pixel units for generating the plurality of pixel data, at least one of the plurality of pixel units receiving the at least one reference beam. and marked as a light spot by the processing unit, and the processing unit performs rearrangement, deletion, and deletion on the plurality of pixel data based on the position of the light spot in the plurality of pixel units. Do at least one of the additions.

Also, in the imaging device, each of the at least one light emitting unit includes at least one of a laser and an invisible light emitting unit.

Further, in the imaging device, the number of the at least one light emitting unit is plural, and the at least one light emitting unit is provided so as to surround the image sensor and is arranged in a circle, an ellipse, or a polygon. be done.

Further, the imaging device includes: a housing for housing the at least one light emitting unit and the image sensor; and a flexible bracket.

The imaging device also includes a storage unit coupled to the processing unit for storing factory default settings, the processing unit configured to store the factory default settings and the at least one reference received by the image sensor. At least one of rearrangement, deletion, and addition is performed on the plurality of pixel data based on the beam.

Another object of the present invention is to avoid the technical problems of lack of portability of the prior art, the corrected distorted image is more distorted, and the maximum resolution constituted by all pixels cannot be exhibited, making it portable. To provide an imaging method which is easy and can achieve high precision and high resolution.

To achieve the above other object, an imaging method according to the present invention is applied to an object under test, adjusting at least one reference beam output to the object under test, and adjusting the at least one reference beam to paralleling the optical axis of an image sensor; adjusting the position of the at least one reference beam with respect to the object under test so as to project the at least one reference beam to a preset position; and the at least one reference beam. generating a factory default setting when the beams are parallel to the optical axis and the at least one reference beam is projected at the preset position; generating data and repositioning to the plurality of pixel data based on the factory settings and the at least one reference beam reflected from the object under test received by the image sensor; and performing at least one of deletion and partial addition to generate a corrected image.

Also, in the imaging method, the image sensor includes a plurality of pixel units for generating the plurality of pixel data, and the imaging method comprises: when the image sensor receives the at least one reference beam, the marking at least one of the plurality of pixel units that received at least one reference beam as a light spot; and performing at least one of placement, deletion, and addition.

In addition, the imaging method further includes adjusting distances of the image sensor and the at least one light emitting unit that outputs the at least one reference beam to the object to be measured.

Further, in the imaging method, the number of the at least one light emitting unit is plural, and the at least one light emitting unit is provided so as to surround the image sensor and is arranged in a circle, an ellipse, or a polygon. be done.

When using the imaging device and imaging method of the present invention, first, adjust at least one reference beam to be output to the object to be measured before shipment from the factory so that the at least one reference beam and the optical axis of the image sensor are parallel, Generate factory settings related to preset positions. Next, when a general user uses the imaging device, the image sensor is adjusted according to the current environment to generate multiple pixel data, even if it is not as accurate as in a pre-factory calibration environment or in a laboratory. can be photographed directly against the object to be measured. Finally, the processing unit rearranges, deletes, and deletes the plurality of pixel data based on the factory settings and at least one reference beam reflected from the object under test received by the image sensor. At least one of the additions is performed to generate the corrected image. That is, the processing unit can know the amount of offset that at least one reference beam has in the current environment by the information related to the reference beam and the preset position in the pre-stored factory settings, and furthermore, to the plurality of pixel data. perform at least one of rearrangement, partial deletion, and partial addition. These corrections are done before compositing the multiple pixel data into the corrected image, so there is no resolution loss issue and the proportional relationship between the multiple textures is incorrect (e.g. the face is distorted and the mouth is slanted). There is no such situation.

For this reason, the image pickup apparatus and image pickup method according to the present invention do not have the portability of the prior art, and the corrected distorted image is further distorted, resulting in a technical problem that the maximum resolution constituted by all pixels cannot be exhibited. can be avoided to achieve easy portability, high precision, and high resolution.

For a better understanding of the techniques, means and effects of the present invention made to achieve the objects of the present invention, the objects and features of the present invention may be better understood by referring to the detailed description of the invention and the accompanying drawings. It will be better understood that the attached drawings are provided for reference and explanation only and are not limiting of the invention.

1 is a system configuration diagram of an imaging device according to the present invention; FIG. 1 is a schematic external view of an imaging device according to the present invention; FIG. 4 is a bottom view of the housing of the imaging device according to the first embodiment of the present invention; FIG. 1 is a schematic diagram of a factory calibration of an imaging method according to the invention; FIG. 4 is a flow chart of factory calibration of the imaging method according to the present invention; 4 is a flow chart of factory calibration of the imaging method according to the present invention; FIG. 4 is an operation explanatory diagram of the imaging method according to the present invention; FIG. 4 is an operation explanatory diagram of the imaging method according to the present invention; FIG. 4 is an operation explanatory diagram of the imaging method according to the present invention; 4 is a flow chart of the operation of the imaging method according to the present invention; FIG. 11 is a bottom view of the housing of the imaging device according to the second embodiment of the present invention; FIG. 11 is a bottom view of a housing of an imaging device according to a third embodiment of the present invention; It is a bottom view of the housing of the imaging device according to the fourth embodiment of the present invention.

Preferred embodiments of the present invention will be described in detail with reference to the drawings.

1 to 3, FIG. 1 is a system configuration diagram of an imaging device according to the present invention, FIG. 2 is a schematic external view of the imaging device according to the present invention, and FIG. 4 is a bottom view of the housing of the imaging device according to the first embodiment; FIG.

The imaging device according to the present invention may be applied to an object to be measured (not shown) and include at least one light emitting unit 10, an image sensor 20, a processing unit 30 and a storage unit 40. Here, each of the at least one light emitting unit 10 outputs at least one reference beam (not shown) to the object under test. In a first embodiment of the invention, each of the at least one light emitting unit 10 includes at least one of a laser and an invisible light emitting unit and may be positioned adjacent to the image sensor 20 (shown in FIG. 3). ). Invisible light may include infrared (Infrared, IR) or ultraviolet (ultraviolet, UV).

Image sensor 20 may receive at least one reference beam reflected from the object under test and generate a plurality of pixel data based on the object under test. Further, the image sensor 20 includes a plurality of pixel units 21, and the plurality of pixel units 21 are used to generate a plurality of pixel data. Here, at least one of the plurality of pixel units 21 can receive at least one reference beam, and some pixel units 21 that have received at least one reference beam are marked as light spots by the processing unit 30. can

The processing unit 30 may be coupled with at least one light emitting unit 10 and the image sensor 20 . Image sensor 20 may include a charge-coupled device (CCD), a complementary metal oxide semiconductor (CMOS), or the like. As such, the image sensor 20 can convert the optical signals in the light beam into special electrical electrical signals.

Storage unit 40 is coupled to processing unit 30 and stores factory default settings 41 . In a first embodiment of the present invention, the processing unit 30 calculates the pixel values based on the factory settings 41 , the positions of the light spots in the pixel units 21 and at least one reference beam received by the image sensor 20 . At least one of rearrangement, deletion, and addition may be performed on the data to generate a corrected image (not shown).

In the first embodiment of the invention, the imaging device may further include a housing 100, a flexible bracket 200 and a connector 300. Here, the housing 100 can accommodate at least one light emitting unit 10 and the image sensor 20 . The flexible bracket 200 is connected to the housing 100 and can adjust the position and distance of the housing 100 with respect to the object to be measured. Connector 300 is coupled to flexible bracket 200 and can be inserted into a computer host or other electronic equipment. The connector 300 supports the flexible bracket 200 and allows the image sensor 20 to perform data transmission through the flexible bracket 200 and the connector 300 . Here, the connector 300 may be a USB port, but the invention is not limited thereto.

Furthermore, the imaging device may further include a lens 50 and a housing 60 . Here, the housing 60 covers the lens 50 and the image sensor 20 , and the lens 50 is exposed on one side of the housing 60 . As shown in FIG. 3 , a lens 50 may be positioned between the object 400 and the image sensor 20 to collect light reflected from the object 400 and input it to the image sensor 20 . Further, the light emitting units 10 may be two and arranged as shown in FIG. 3 with respect to the preset positions Pi, Pj, Pn and Pm. Also, the two light emitting units 10 may correspond to the preset positions Pi and Pj of the device under test 400 .

4-5B, FIG. 4 is a schematic diagram of the factory calibration of the imaging method according to the present invention, and FIGS. 5A and 5B are flow charts of the factory calibration of the imaging method according to the present invention. The numbers of other related components can refer to the above description and drawings, and are omitted here.

The imaging apparatus according to the present invention can be corrected at the time of factory shipment by the following method.

(Method 1)
As shown in FIG. 5A, first, the distance between the housing 100 and the center position C of the device under test 400 is arranged as H, that is, the image sensor 20 and at least one light emitting device outputting at least one reference beam. The unit 10 is adjusted so that the distance from the object 400 to be measured is H (step S1). After that, the position of the housing 100 is adjusted, that is, the position of at least one reference beam with respect to the device under test 400 is adjusted to project the two reference beams to the preset positions Pi and Pj (step S2). Finally, after confirming that the at least one reference beam is parallel to the optical axis of the image sensor 20, storing the information of the at least one reference beam reflected from Pi and Pj received by the image sensor 20. , to generate factory shipment settings 41 (step S3).

(Method 2)
As shown in FIG. 5B, the at least one reference beam output to the workpiece 400 is adjusted so that the at least one reference beam is parallel to the optical axis of the image sensor 20 (step S4). Next, the position of the housing 100 is adjusted to project the two reference beams to the preset positions Pn and Pm (step S2). Finally, the information of at least one reference beam reflected from Pn and Pm received by the image sensor 20 is stored to generate the factory settings 41 (step S3).

6 to 9, FIGS. 6 to 8 are explanatory diagrams of the operation of the imaging method according to the present invention, and FIG. 9 is a flow chart of the operation of the imaging method according to the present invention. The numbers of other related components can refer to the above description and drawings, and are omitted here.

Assuming that the DUT 400 is parallel to the plurality of light emitting units 10 and the image sensor 20, as shown in FIG. can be done. The plurality of reference beams 11 may be projected onto preset positions Pi and Pj of the object under test 400 and projected onto the image sensor 20 after primary intersection by the lens 50 . At this time, the light spot positions recorded on the image sensor 20 can be regarded as factory settings.

As shown in FIG. 7, when the user operates the imaging apparatus of the present invention, the object 400 to be measured is not parallel to any of the plurality of light emitting units 10 and the image sensor 20, and the plurality of reference beams 11 are aligned. The positions projected onto the measurement object 400 may be P'i and P'j. Furthermore, for each of the plurality of reference beams 11 , the offset amount in the plurality of pixel units 21 of the image sensor 20 may differ depending on the tilt state of the object 400 to be measured. At this time, the position of the light spot recorded on the image sensor 20 deviates from the factory setting.

As shown in FIGS. 8 and 9, the image sensor 20 can generate a plurality of pixel data based on the device under test 400 (step S5). When the factory-set light spot position in the plurality of pixel units 21 of the image sensor 20 is A, and the light spot position recorded in the image sensor 20 when the user operates the imaging device of the present invention is B, The processing unit 30 can determine the degree of offset of the object 400 with respect to the image sensor 20 based on the positions of the light spots in the plurality of pixel units 21 (step S6). Next, the processing unit 30 may generate a corrected image after performing at least one of rearrangement, partial deletion, and partial addition on the plurality of pixel data (step S7). The processing unit 30 may also determine the relative distance between the device under test 400 and the image sensor 20 based on the intensity of the optical signal.

10 to 12, FIG. 10 is a bottom view of a housing of an imaging device according to the second embodiment of the present invention, and FIG. 11 is an imaging device according to the third embodiment of the present invention. 12 is a bottom view of the housing of the imaging device according to the fourth embodiment of the present invention. FIG.

As shown in FIG. 10, the second embodiment of the invention is substantially the same as the first embodiment described above. However, in the second embodiment of the present invention, the quantity of at least one light emitting unit 10 is three. A plurality of light emitting units 10 are provided so as to surround the image sensor 20 and are arranged in a triangular shape.

As shown in FIG. 11, the third embodiment of the invention is substantially the same as the second embodiment described above. However, in the third embodiment of the present invention, a plurality of light emitting units 10 are provided so as to surround the image sensor 20 and are arranged in a circular or elliptical shape.

As shown in FIG. 12, a fourth embodiment of the invention is substantially the same as the second embodiment described above. However, in the fourth embodiment of the present invention, a plurality of light emitting units 10 are provided so as to surround the image sensor 20 and are arranged in a rectangular shape.

When using the imaging apparatus and imaging method of the present invention, first, at least one reference beam 11 to be output to the device under test 400 is adjusted before shipment from the factory so that the at least one reference beam 11 and the optical axis of the image sensor 20 are adjusted. may be paralleled to generate the factory settings 41 associated with the preset positions. Next, when using the image pickup apparatus of the present invention, general users do not need to perform accurate correction such as in the correction environment before shipment from the factory or in the laboratory. A plurality of pixel data can be generated by directly photographing the . Then, when a typical user uses the imaging device, the image sensor 20 is adjusted according to the current environment to generate multiple pixel data, even if it is not as accurate as in a pre-factory calibrated environment or in a laboratory. can be directly photographed with respect to the object 400 to be measured.

Finally, the processing unit 30 relocates to the plurality of pixel data based on the factory settings 41 and the at least one reference beam 11 reflected from the device under test 400 received by the image sensor 20. At least one of partial deletion and partial addition is performed to generate a corrected image. That is, the information relating to the reference beam 11 and the preset positions in the pre-stored factory settings 41 allows the processing unit 30 to know the amount of offset that at least one reference beam has in the current environment, and furthermore, the plurality of At least one of rearrangement, partial deletion, and partial addition is performed on the pixel data. These corrections are done before compositing the multiple pixel data into the corrected image, so there is no resolution loss issue and the proportional relationship between the multiple textures is incorrect (e.g. the face is distorted and the mouth is slanted). There is no such situation.

For this reason, the image pickup apparatus and image pickup method according to the present invention do not have the portability of the prior art, and the corrected distorted image is further distorted, resulting in a technical problem that the maximum resolution constituted by all pixels cannot be exhibited. can be avoided to achieve easy portability, high precision, and high resolution.

Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, it goes without saying that the present invention is not limited to such examples, and the scope of the present invention is not limited. The scope of is based on the following claims, and the spirit and similar variations thereof that are consistent with the scope of the claims of the present invention should be included within the scope of the present invention. , can be easily conceived within the technical scope of the present invention, and variations and modifications thereof are also included in the scope of the following claims.

It should be noted that the structures, ratios, sizes, etc. shown in the drawings of this specification are all for the purpose of making it easier for those skilled in the art to understand and read according to the contents disclosed in the specification, and they are implemented in the present invention. It is not intended to limit the possible limitations and therefore has no substantive technical significance, and any addition of structure, change in proportions or adjustment in size will result in the effects produced and achievable in the present invention. All of them are included in the technical contents disclosed in the present invention on the premise that they do not affect the purpose.

DESCRIPTION OF SYMBOLS 10... Light emitting unit 11... Reference beam 20... Image sensor 21... Pixel unit 30... Processing unit 40... Storage unit 41... Factory shipment setting 50... Lens 60... Housing 100... Housing 200... Flexible bracket 300... Connector 400 Object to be measured C Center position H Distances Pi, Pj, Pn, Pm Preset positions P'i, P'j Positions A, B Light spot position

Claims (10)

An imaging device applied to an object to be measured,
at least one light emitting unit each outputting at least one reference beam to the object under test;
an image sensor that receives the at least one reference beam reflected from the object under test and generates a plurality of pixel data based on the object under test;
coupled to the at least one light emitting unit and the image sensor, rearranging, deleting, and adding to the plurality of pixel data based on the at least one reference beam received by the image sensor; and a processing unit that performs at least one of: to generate the corrected image. the image sensor includes a plurality of pixel units for generating the plurality of pixel data;
at least one of the plurality of pixel units receiving the at least one reference beam and marked as a light spot by the processing unit;
2. The processing unit performs at least one of rearrangement, partial deletion, and partial addition on the plurality of pixel data based on the positions of the light spots in the plurality of pixel units. The imaging device according to . 2. The imaging device of claim 1, wherein each of said at least one light emitting unit comprises at least one of a laser and an invisible light light emitting unit. the number of the at least one light emitting unit is plural,
2. The imaging device according to claim 1, wherein said at least one light emitting unit is provided so as to surround said image sensor and is arranged in a circle, an ellipse, or a polygon. a housing for housing the at least one lighting unit and the image sensor;
2. The imaging device according to claim 1, further comprising a flexible bracket connected to said housing for adjusting the position and distance of said housing with respect to said object to be measured. further comprising a storage unit coupled to said processing unit for storing factory settings;
The processing unit performs at least one of rearranging, deleting, and adding to the plurality of pixel data based on the factory settings and the at least one reference beam received by the image sensor. 2. The imaging device of claim 1, performing one. An imaging method applied to an object to be measured,
adjusting at least one reference beam output to the object under test so that the at least one reference beam is parallel to an optical axis of an image sensor;
adjusting the position of the at least one reference beam with respect to the object under test so as to project the at least one reference beam to a preset position;
generating a factory setting if the at least one reference beam is parallel to the optical axis and the at least one reference beam is projected to the preset position;
the image sensor generating a plurality of pixel data based on the object under test;
rearranging, deleting, and adding to the plurality of pixel data based on the factory settings and the at least one reference beam reflected from the object under test received by the image sensor; and performing at least one to generate a corrected image. the image sensor includes a plurality of pixel units for generating the plurality of pixel data;
marking at least one of the plurality of pixel units that received the at least one reference beam as a light spot when the image sensor receives the at least one reference beam;
and performing at least one of rearrangement, partial deletion, and partial addition on the plurality of pixel data based on the positions of the light spots in the plurality of pixel units. 7. The imaging method according to 7. 8. The imaging method according to claim 7, further comprising adjusting distances of the image sensor and the at least one light emitting unit that outputs the at least one reference beam to the object under test. the number of the at least one light emitting unit is plural,
10. The imaging method according to claim 9, wherein said at least one light-emitting unit is provided so as to surround said image sensor and arranged in a circle, an ellipse, or a polygon.

Images