TWI502982B - Image capture device and image correction method thereof - Google Patents

Description

Image capturing device and image correcting method thereof

The present invention relates to an image capturing device, and more particularly to an image capturing device with a corrected image skew function and an image correcting method thereof.

In recent years, with the evolution of the electronics industry and the rapid development of industrial technology, technology is changing with each passing day. The design and development of various electronic devices are gradually moving towards light and easy to carry, so that users can apply to mobile commerce, entertainment or anytime, anywhere. Leisure and other uses.

For example, a wide variety of portable image capture devices are widely used in various fields, such as hand-held scanners, which have the advantages of small size and portability, and can be carried by users and used. It can be taken out and imaged at any time, processed and stored through, for example, a smart phone, or uploaded to the Internet through a mobile network. This not only has important commercial value, but also enhances the daily life of the general public. color.

The conventional portable image capturing device mainly slides by the user to perform image capturing. However, since the user cannot maintain the same sliding or operating level as the machine during operation, the captured image data is often compressed, elongated or skewed, thereby causing image distortion, positional shift, or image omission. The problem, and the same procedure must be repeated to re-image the image, not only causing user confusion, but also wasting a lot of energy and time costs.

Therefore, how to develop an image capturing device capable of improving the above-mentioned conventional technology and avoiding the compression, elongation or skew of the captured image data to simplify the operation process and reduce the energy and time cost The image correction method is an urgent problem to be solved.

The main purpose of the present invention is to provide an image capturing device and an image correcting method thereof, which solves the problem that the image capturing device of the conventional image is compressed, elongated or skewed due to user operation factors, thereby causing image distortion, positional shift or image omission. Such problems, as well as repeated operating procedures, are disadvantages such as increased energy consumption and time cost.

Another object of the present invention is to provide an image capturing device and an image correcting method thereof, which can be avoided by using an acceleration sensing module to extract acceleration data and calculate position data, and then correcting the image data through the control module. The effect of compressing, stretching or skewing image data.

Another object of the present invention is to provide an image capturing device and an image correcting method thereof, which can effectively avoid image distortion, positional shift, and image omission by transmitting a plane judgment algorithm, image offset compensation, and image repair algorithm. Reduce the difficulty and frequency of operation and save energy and time costs.

In order to achieve the above object, a preferred embodiment of the present invention provides an image capturing device, comprising at least: a control module configured to correct a first image data and generate a second image data; The group is connected to the control module for capturing the first image data; an acceleration sensing module is connected to the control module, and the first image data is captured by the line sensing module And acquiring a acceleration data; and a storage module connected to the control module for storing the acceleration data, the first image data and the second image data; wherein the control module is based on the acceleration The data is calculated as a location data, and the first image data is corrected according to the location data to generate the second image data.

In order to achieve the above object, another preferred embodiment of the present invention provides an image correction method, comprising at least the steps of: (a) providing an image capturing device; (b) capturing a first image data and an acceleration data; And (c) calculating a location data based on the acceleration data, and correcting the first image data according to the location data to generate a second image data.

Some exemplary embodiments embodying the features and advantages of the present invention are described in detail in the following description. It should be understood that the present invention is capable of various modifications in the various aspects of the present invention, and the description and drawings are intended to be illustrative and not limiting.

Please refer to FIG. 1 , which is a block diagram of the components of the image capturing device of the preferred embodiment of the present invention. As shown in FIG. 1 , the image capturing device 1 of the present invention includes at least a control module 2 , a line sensing module 3 , an acceleration sensing module 4 , and a storage module 5 . The control module 2 is configured to correct the first image data and generate the second image data. The line sensor module 3 is connected to the control module 2 for capturing the first image data, for example, through the photosensitive element 31. The line sensing module 3 scans a medium or a file, and the acceleration sensing module 4 is also connected to the control module 2, and captures the acceleration when the line sensing module 3 captures the first image data. For example, the acceleration sensing module 4 having the three-axis accelerometer 41 continuously samples and captures the plurality of acceleration values of the image capturing device 1 in a time interval, which are not limited thereto. The control module 2 performs secondary integration based on the acceleration data to calculate the position data, for example, but not limited to, performing secondary integration according to the plurality of acceleration values of the image capturing device 1 to calculate the image capturing device 1 The location data is corrected according to the location data to generate a second image data, such as but not limited to a scanned image product. The storage module 5 is connected to the control module 2 for storing acceleration data, first image data and second image data, and the storage module 5 can be a random access memory (Random Access Memory, RAM). ), Read-Only Memory (ROM), Flash Memory, Memory Card, Hard Disk, or Solid State Drive (Solid State Disk or Solid State Drive) Wait, but not limited to this. It can be seen that the image capturing device 1 of the present invention captures the acceleration data by using the acceleration sensing module 4 and calculates the position data, and then corrects the image data through the control module 2, thereby avoiding the compression of the image data. The effect of lengthening or skewing can effectively avoid image distortion, positional shift and image omission, thereby reducing the difficulty and frequency of operation, and achieving energy and time cost savings.

In some embodiments, the control module 2 of the present invention may be a control module including a central processing unit (CPU), a microprocessor (Micro Processing Unit (MPU), or other processor with arithmetic and control functions. 2. In other embodiments, the control module 2 includes a switching component 21 for controlling the start and stop of the image capturing device 1, for example, controlling the line sensing module 3 and the acceleration sensing module of the image capturing device 1. Group 4 begins to capture or enter the standby state of the first image data and acceleration data, but is not limited thereto.

According to the concept of the present invention, the image capturing device 1 of the present invention further includes a communication module 6 connected to the control module 2 for transmitting the second image data to a storage device or an electronic device, such as an external memory card. , hard drive, solid state drive, flash memory, computer (PC), notebook PC (Notebook PC), tablet (Tablet PC), server (Server), smart phone (Smart Phone) or personal digital assistant (Personal Digital Assistant, PDA), etc., but not limited thereto, and the storage module 6 can have a universal serial bus (USB) transmission interface, a Thunderbolt transmission interface, a Firewire transmission interface, and a high sequence. Serial Advanced Technology Attachment (SATA) transmission interface, Peripheral Component Interconnect Express (PCI-E) transmission interface or CAT-5e, CAT-6, CAT-6e or CAT-7 The Ethernet port is not limited to this.

Please refer to FIG. 2 and FIG. 1 , wherein FIG. 2 is a flow chart of the image correction method according to the preferred embodiment of the present invention. As shown in FIG. 1 and FIG. 2, the image correction method of the present invention includes at least the steps. First, as shown in step S100, the image capturing device 1 is provided, and the image capturing device 1 includes at least a control module 2 and a line. The sexy measuring module 3, the acceleration sensing module 4 and the storage module 5. Next, as shown in step S200, the image capturing device 1 captures the first image data and the acceleration data through the line sensing module 3 and the acceleration sensing module 4; then, as shown in step S300, the image capturing device 1 The control module 2 calculates the position data according to the acceleration data, and corrects the first image data according to the position data to generate the second image data, which is transmitted through the plane judgment algorithm, the image offset compensation, and the image restoration algorithm. By correcting the first image data, problems such as image distortion, positional shift, and image omission can be effectively avoided, thereby reducing the difficulty and the number of operations, and achieving the effect of saving energy and time cost.

Please refer to Fig. 3 and cooperate with Fig. 1 and Fig. 2, wherein Fig. 3 is a detailed flow chart of the image correction method of the present invention. As shown in FIG. 1 , FIG. 2 and FIG. 3 , the detailed process of the image correction method of the present invention includes at least steps: first, as shown in step S100, the image capturing device 1 is provided; secondly, as shown in FIG. 2 Step S200 further includes steps S201 to S203. As shown in step S201, the power of the image capturing device 1 is turned on, and as shown in step S202, the switching element 21 is pressed to start the image capturing and correcting process, and then the step S203 is performed. The line sensing module 3 and the acceleration sensing module 4 of the image capturing device 1 respectively capture the first image data and the acceleration data; then, the step S300 shown in FIG. 2 further includes steps S301 to S305. As shown in step S301, the image capturing device 1 calculates the position data based on the acceleration data by the control module 2, and performs a plane determination algorithm on the first image data according to the position data, as shown in steps S302-S304. The image offset compensation and the image restoration algorithm perform correction, and as shown in step S305, the second image data is generated. Then, as shown in step S400, the switching element 21 is pressed to enter the standby mode. In the standby mode, if the user wants to turn off the image capturing device 1, the power of the image capturing device 1 is turned off as shown in step S500; if the user wants to continue the image capturing and correcting process, step S202 is repeated. The switching element 21 is pressed again to activate the image capture and correction process.

Please refer to FIG. 4 and FIG. 1 , wherein FIG. 4 is a schematic diagram of image capturing by the image capturing device of the preferred embodiment of the present invention. As shown in FIG. 1 and FIG. 4, the image capturing device 1 of the present invention can be used to perform image capturing on a medium 7, such as a file, a picture, a poster, or a book, but is not limited thereto. In some embodiments, when the image capturing device 1 is operated by the user, the image capturing device 1 cannot be operated as accurately as the machine. Therefore, when the image capturing device 1 is operated to capture the image of the medium 7, the image is taken along the direction. M sliding image capturing device 1, but the actual path may be offset as the path P slides, and cannot slide at the same speed, so the acceleration sensing module 4 of the image capturing device 1 is in the line sensing module 3 Acceleration data can be captured when the first image data is captured.

The principle of correcting the first image data after the image capturing device 1 calculates the position data based on the acceleration data will be described below. Please refer to FIG. 5 and cooperate with FIG. 1 and FIG. 4 , wherein FIG. 5 is a schematic diagram of the position of the image capturing device in the regions A, B and C shown in FIG. 4 . As shown in FIG. 1 , FIG. 4 and FIG. 5 , when the image capturing device 1 of the present invention is in the first area A, the control module 2 calculates the coordinates A1 and A2 of the two ends according to the acceleration data. And when in the second region B and the third region C, the coordinates B1, B2, and C1, C2 of the two ends are respectively calculated. The control module 2 calculates the first vertical vector according to the coordinate coordinates A1, A2 at the two ends of the first region A and the coordinates B1 and B2 at the two ends of the second region B. First horizontal vector And calculating the second vertical vector according to the coordinate coordinates C1 and C2 at the two ends of the second region B, the coordinates B1 and C2 at both ends of the third region C Second horizontal vector Calculating the first unit normal vector of the coordinate plane of the image capturing device 1 in the first region A and the second region B and the image capturing device 1 in the second region B and the third region C by using the vector outer product The second unit normal vector of the coordinate plane.

Please refer to FIG. 6A and FIG. 6B and cooperate with FIG. 1 , wherein FIG. 6A and FIG. 6B are respectively a schematic diagram of a horizontal plane unit normal vector and a first unit normal vector having an angle and a horizontal plane unit normal vector and a second. Schematic diagram of the unit normal vector parallel. Horizontal plane unit normal vector as shown in Figure 1, Figure 6A and Figure 6B The coordinate representation must be X=Y=0, Z=1, which is (0, 0, 1), so the horizontal plane unit normal vector First unit normal vector Second unit normal vector The inner product calculation pushes the angle θ. In some embodiments, when the horizontal plane unit normal vector First unit normal vector When the inner product result is not equal to 1, it means that it has an angle θ, that is, the coordinate plane of the image capturing device 1 in the first area A and the second area B is not horizontal. In other embodiments, when the horizontal plane unit normal vector Second unit normal vector When the inner product result is equal to 1, it represents the horizontal plane unit normal vector Second unit normal vector The angles of the angles θ are 0 degrees, or may be said to have no angle θ, that is, the coordinate planes of the image capturing device 1 in the second region B and the third region C are horizontal.

When it is determined that the coordinate plane is not horizontal, the control module 2 of the image capturing device 1 of the present invention corrects the first image data. Please refer to FIG. 7A and FIG. 7B and cooperate with FIG. 1 , wherein FIG. 7A and FIG. 7B are schematic diagrams showing the actual traveling path of the image capturing device of the present invention and the principle of correcting the plane determining algorithm in the present case. As shown in FIG. 1 , FIG. 7A and FIG. 7B , if the image capturing device 1 of the present case is not horizontal in the coordinate plane, the actual traveling path is slid along the path l, but actually in the image recognition. It will be judged as the horizontal projection amount x of the path l. If the image correction is not performed, the actual length or width of the image equal to the path l is equal to the length or width of the projection amount x, and the image is distorted. The correction is performed by a plane judgment algorithm, which uses the Shang Gao theorem and samples in a very short time. After judging that the coordinate plane is not a plane, that is, according to the horizontal projection amount x and the height difference z of the path l, the oblique side length r of the approximate triangle is calculated by the quotient height theorem, and an image whose actual length or width is equal to the path l is generated. It is equal to the length or width of the bevel length r to avoid image distortion.

After the horizontal determination algorithm is corrected, the image capturing device 1 of the present invention performs image offset compensation correction. Please refer to FIG. 8A, FIG. 8B and FIG. 8C and cooperate with FIG. 1 and FIG. 4 , wherein FIG. 8A is a schematic diagram of image data of area A shown in FIG. 4 , and FIG. 8B is a fourth diagram. The image data of the area B shown in the figure and the 8C figure are the image data of the corrected image data shown in FIG. 8B. As shown in FIG. 1 , FIG. 4 , FIG. 8A , FIG. 8B , and FIG. 8C , the image data of the area A captured by the image capturing device 1 of the present invention is the actual sliding path P of the image capturing device 1 . There is no offset in area A, so no image correction is required. However, as for the image data of the area B shown in FIG. 8B, since the actual sliding path P of the image capturing apparatus 1 of the present invention is offset in the B area, the image shift correction must be performed. Comparing the coordinate position in the position data to calculate the horizontal offset ΔX and the vertical offset ΔY of the two adjacent data, the control module 2 校正 corrects the offset image data one by one, and reverses the horizontal offset The amount ΔX and the vertical offset ΔY are used to correct the image data to a normal image in a horizontal state (as shown in Fig. 8C).

After the image offset compensation is corrected, the image capturing device 1 of the present invention performs correction of the image restoration algorithm. Please refer to FIG. 9A and FIG. 9B, which are schematic diagrams of image data missing from the image and schematic diagrams of the image data after the image correction method is repaired. As shown in Fig. 9A and Fig. 9B, the image capture 1 of the present invention can record the missing portion of the image during the image capture process, and correct it by the image restoration algorithm of the image correction method of the present invention. In the example, the first image data captured by the image capturing device 1 has an image missing area E, and the image restoration algorithm is corrected by the control module 2, and the control module 2 calculates the adjacent data points by using the position data. The coordinates of bits P1, P2, P3 and P4, and according to the image data on the points P1, P2, P3 and P4, the approximate image data of the original image data in the missing area E of the image is obtained by mathematical interpolation. And the image missing area E is replaced by the approximate image data R, and the image restoration algorithm is corrected, and the normal image of the complete data is generated.

According to the concept of the present invention, after the control module 2 of the image capturing device 1 performs the correction of the plane determination algorithm, the correction of the image offset compensation, and the correction of the image restoration algorithm, the image data generated by the image capturing device 1 is It is the second image data, that is, the finished image after the correction is completed.

In summary, the image capturing device and the image correcting method thereof in the present invention use the acceleration sensing module to extract the acceleration data and calculate the position data by the second integral, and then use the control module to determine the algorithm by plane. The image offset compensation and the image restoration algorithm correct the first image data and generate the second image data, thereby preventing the image data from being compressed, elongated or skewed, thereby effectively preventing image distortion, positional shift, and image omission. , reducing the difficulty and frequency of operation, and achieving energy and time costs.

The present invention has been described in detail by the above-described embodiments, and may be modified by those skilled in the art, without departing from the scope of the appended claims.

1. . . Image capture device

2. . . Control module

twenty one. . . Switching element

3. . . Line sensing module

31. . . Photosensitive element

4. . . Acceleration sensing module

41. . . Triaxial speedometer

5. . . Storage module

6. . . Communication module

7. . . media

A, B, C. . . region

A1, A2, B1, B2, C1, C2. . . coordinate

E. . . Image missing area

1, P. . . path

M. . . direction

. . . First unit normal vector

. . . Second unit normal vector

. . . Horizontal plane unit normal vector

P1, P2, P3, P4. . . Point

R. . . Approximate image data

, , , . . . vector

x. . . Horizontal projection

z. . . Height difference

r. . . Beveled length

△X. . . Horizontal offset

△Y. . . Vertical offset

θ. . . Angle

S100~S300. . . step

S201~S203, S301~S305, S400, S500. . . step

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a block diagram of the components of the image capture device of the preferred embodiment of the present invention.

Figure 2 is a flow chart of the image correction method of the preferred embodiment of the present invention.

Figure 3 is a detailed flow chart of the image correction method of this case.

Figure 4 is a schematic diagram of image capture by the image capture device of the preferred embodiment of the present invention.

Fig. 5 is a schematic view showing the position of the image capturing device in the areas A, B, and C shown in Fig. 4.

Figure 6A is a schematic diagram showing the angle between the horizontal plane unit normal vector and the first unit normal vector.

Figure 6B is a schematic diagram of the horizontal plane unit normal vector and the second unit normal vector.

Figure 7A is a schematic diagram of the actual travel path of the image capturing device of the present invention.

Figure 7B is a schematic diagram of the principle of correcting the plane judgment algorithm for this case.

Fig. 8A is a schematic view of the image data of the area A shown in Fig. 4.

Fig. 8B is a schematic view of the image data of the area B shown in Fig. 4.

Fig. 8C is a schematic diagram of image data after correction of the image data shown in Fig. 8B.

Figure 9A is a schematic diagram of image data missing from the image.

Figure 9B is a schematic diagram of image data after the image is corrected by the image correction method of the present invention.

1. . . Image capture device

2. . . Control module

twenty one. . . Switching element

3. . . Line sensing module

31. . . Photosensitive element

4. . . Acceleration sensing module

41. . . Triaxial speedometer

5. . . Storage module

6. . . Communication module

Claims (10)

An image capturing device comprising at least:
a control module is configured to correct a first image data and generate a second image data;
a first-line sensing module is connected to the control module for capturing the first image data;
An acceleration sensing module is connected to the control module, and captures an acceleration data when the line sensing module captures the first image data; and a storage module is connected to the control module For storing the acceleration data, the first image data, and the second image data;
The control module calculates a location data according to the acceleration data, and corrects the first image data according to the location data to generate the second image data. The image capturing device of claim 1, wherein the acceleration sensing module comprises a three-axis accelerometer, and the three-axis accelerometer is connected to the control module for sensing three Axial acceleration value. The image capturing device of claim 1, wherein the control module includes a switching component for enabling the image capturing device to perform image capturing and image correction, or to cause the image capturing device to enter standby mode. status. The image capturing device of claim 1, wherein the control module corrects the first image data by a plane determining algorithm according to the location data. The image capturing device of claim 1, wherein the control module corrects the first image data with image offset compensation according to the position data. The image capturing device of claim 1, wherein the control module corrects the first image data by using an image restoration algorithm according to the location data. An image correction method includes at least the steps of:
(a) providing an image capture device;
(b) extracting a first image data and an acceleration data; and (c) calculating a position data based on the acceleration data, and correcting the first image data according to the position data to generate a second image data . The image correction method according to claim 7, wherein the step (b) further comprises the steps of:
(b1) turning on the power of the image capturing device;
(b2) pressing a switching element of the image capturing device; and (b3) the image capturing device capturing the first image data and the acceleration data. The image correction method of claim 8, wherein the step (c) further comprises the steps of:
(c1) the image capturing device calculates the position data according to the acceleration data;
(c2) correcting the first image data by a plane judgment algorithm according to the location data;
(c3) correcting the first image data by image offset compensation according to the location data;
(c4) correcting the first image data with an image restoration algorithm based on the location data; and (c5) generating the second image data. The image correction method of claim 9, further comprising the step of: (d) pressing the switching element to bring the image capturing device into a standby state, and after the step (d), selectively performing the step (e) ) Turn off the power or perform step (b2) again.