KR100982425B1 - Method and apparatus for displaying the motion of camera - Google Patents

Abstract

The present invention relates to a method and apparatus for preventing a certain image from being blurred due to camera movement. More particularly, the present invention relates to a method for detecting a motion of a camera and calculating a movement amount based on the detected movement of the camera. The present invention relates to a method and apparatus for expressing a motion of a camera which prevents blurring of an image by expressing the image to a user.

Description

Method and apparatus for expressing the motion of a camera {Method and apparatus for displaying the motion of camera}

1 shows light arriving from a given object through the camera's lens and reaching the surface of the film.

2 shows a functional block diagram of a camera for representing a motion of a camera, corresponding to an embodiment of the invention.

3 shows a functional block diagram of an apparatus for representing the movement of a camera, corresponding to another embodiment of the invention.

4 shows a functional block diagram of an apparatus for representing the movement of a camera, corresponding to another embodiment of the invention.

FIG. 5 shows a functional block diagram of an apparatus for displaying an image based on the amount of movement of the camera with respect to successively captured images.

6 is a flowchart of a method for representing the movement of a camera, corresponding to an embodiment of the invention.

7 illustrates an embodiment representing the calculated amount of movement of the camera.

8 shows a flowchart of a method for representing the movement of a camera, corresponding to another embodiment of the invention.

9 shows a flowchart of a method for displaying an image based on the amount of movement of the camera with respect to successively captured images.

The present invention relates to a method and apparatus for preventing a certain image from being blurred due to camera movement. More particularly, the present invention relates to a method for detecting a motion of a camera and calculating a movement amount based on the detected movement of the camera. The present invention relates to a method and apparatus for expressing a motion of a camera which prevents an image from being photographed by blurring an image to a user and automatically photographing when a motion is minimized.

In general, while photographing a predetermined image using a camera, movement such as shaking of the hand or body, movement of the hand or body, etc. is transmitted to the camera, and the captured image is blurred and blurred due to the transferred movement. The type of movement of the camera can be generally expressed in two types.

The first type of movement is to move up-down on the lens axis of the camera, and the second type of movement is to move left-right on the lens axis of the camera. The up-and-down movement is referred to as pitching, and the left-right movement is referred to as yawing. Whenever a user presses the shutter button of the camera to take a predetermined image, a movement of pitching or yawing occurs in the camera.

FIG. 1 shows light arriving from the predetermined object through the lens 10 of the camera and reaching the surface of the film 20. 1A shows a steady state in which no movement is applied to the camera. Light from the object A is precisely focused on the surface of the film 20. 1B illustrates a state in which movement is applied to the camera. When pitching movement is applied to the camera, the surface of the film 20 is focused at B '. While the shutter of the camera is open, light from the object A is moved between focus B and focus B '.

Even small movements of the camera cause the captured image to flow. When a camera movement is detected, a method and apparatus for compensating for the movement of the camera to capture a predetermined image or to open the shutter to capture a predetermined image when the amount of movement of the camera falls below a threshold has been studied.

However, the conventional image capturing method and apparatus does not feed back the amount of movement of the camera to the user, which causes inconvenience of the user not recognizing the amount of movement of the camera. In addition, when the amount of movement of the camera is more than a threshold, the shutter is forcibly closed to prevent blurry images from being photographed. In this case, the user does not receive the feedback about the amount of movement of the camera, thereby preventing the user from capturing the image.

The technical problem to be achieved by the present invention is to detect the movement of the camera to calculate the amount of movement of the camera, to express the movement of the camera based on the calculated movement amount of the camera, and to take a predetermined image when the movement is minimized The present invention provides an apparatus and method for expressing a motion of a camera.

The motion expression apparatus of the camera for achieving the technical problem is a motion detection unit for detecting the movement of the camera generated when operating the camera to take a predetermined image; A motion calculator configured to calculate an amount of motion of the camera based on the detected motion of the camera; A motion expression unit for expressing a motion amount of the camera calculated by the motion calculator; And a photographing unit configured to capture the image by opening the shutter of the camera when the amount of movement of the camera is equal to or less than a predetermined threshold so that the image is captured when the movement of the camera is minimized. .

According to another aspect of the present invention, there is provided a method of representing a motion of a camera, the method comprising: detecting a motion of a camera generated when a camera is operated to capture a predetermined image; Calculating a movement amount of the camera based on the detected movement of the camera; Expressing the calculated amount of movement of the camera; And photographing the image by opening the shutter of the camera when the amount of movement of the camera is equal to or less than a predetermined threshold so that the image is taken when the movement of the camera is minimal.

Preferably, the threshold value is automatically set by at least one of a shutter speed, a focal length, an angle of view, a motion frequency, an amount of motion, a threshold of a blurry number of pixels, and an aperture opening degree.

Preferably, the threshold value is automatically set by at least one of a shutter speed, a focal length, an angle of view, a motion frequency, an amount of motion, a threshold of a blurry number of pixels, and an aperture opening degree.

Hereinafter, a method and apparatus for representing a motion of a camera according to the present invention will be described in detail with reference to the accompanying drawings.

2 shows a functional block diagram of a camera for representing a motion of a camera, corresponding to an embodiment of the invention. Referring to FIG. 2, the apparatus for expressing motion of a camera according to the present invention includes a motion detector 210, a motion calculator 220, a motion expression unit 230, and a photographing unit 240.

The motion detector 210 detects a movement of a camera generated when a user manipulates the camera to capture a predetermined image. For example, when the user presses a photographing button (not shown) attached to the camera, the camera detects movement of the camera and generates an electrical signal corresponding to the detected movement. In addition, the movement of the camera may be caused by the shaking of the user holding the camera.

According to the field to which the present invention is applied, the motion sensor 210 may use an acceleration sensor, an angular velocity sensor, an angular acceleration sensor, an impact sensor, and the like for measuring the acceleration, the angular velocity, the angular acceleration of the camera, and the like. Other kinds of sensors can be used to detect the movement of the camera, which is within the scope of the present invention. Meanwhile, according to the field to which the present invention is applied, the angular velocity sensor, the acceleration sensor, the angular acceleration sensor, and the impact sensor are at least one of one axis in the front and rear directions, two axes in the left and right directions, or three axes in the up and down directions with respect to the lens of the camera. Detect acceleration, angular velocity, angular acceleration, or impact amount on more than one axis.

The motion calculator 220 calculates the amount of motion of the camera based on the motion of the camera detected by the motion detector 210.

According to the field to which the present invention is applied, the motion calculator 220 may perform a predetermined time with respect to a signal representing movement of at least one axis among the first to third axes of the camera detected by the motion detector 210. The amount of movement of the camera is calculated using at least one of statistics such as standard deviation, variance, mean, maximum, minimum, and norm.

According to the field to which the present invention is applied, the motion calculating unit 220 at least once outputs a signal representing at least one of the first to third axes of the camera detected by the motion detecting unit 210. The above derivative or integration is performed, and the amount of motion of the camera is calculated using at least one of statistics such as standard deviation, variance, average, maximum, minimum, norm, etc. for a predetermined time with respect to the differential or integrated signal.

The motion expression unit 230 expresses the amount of motion of the camera calculated by the motion calculator 220. The expression unit 230 may determine the amount of movement of the camera among a number, figure, icon, color change, intensity or type of sound, intensity of vibration and on / off frequency of light, intensity of light or color of light. It expresses by at least one.

For example, the expression unit 230 may express the movement amount of the camera calculated by the motion calculator 220 as a number or as a figure such as a bar. On the other hand, the expression unit 230 is provided with a sound generating means (not shown), it is possible to increase the intensity of the sound or increase the frequency of the sound according to the amount of movement of the camera. On the other hand, the expression unit 230 is provided with a means for emitting light, according to the amount of movement of the camera to increase the intensity of light, increase the frequency of light on / off or change the color of light Can be. Meanwhile, according to the field to which the present invention is applied, the expression unit 230 may express only whether the camera is moved according to whether the amount of motion of the camera calculated by the motion calculator 220 exceeds a first threshold value. Can be. On the other hand, when the amount of movement of the camera exceeds the first threshold and photographing is impossible, it may be represented by a red hand icon, and when the amount of camera movement is less than the first threshold, it may be represented by a blue hand icon. . Depending on the field to which the present invention is applied, other kinds of expression units may be used, which is within the scope of the present invention.

In a preferred embodiment of the present invention, the motion expression unit 230 expresses the amount of motion of the camera to the photographer. In another preferred embodiment of the present invention, the motion expression unit 230 expresses the amount of motion of the camera to the subject. In another preferred embodiment of the present invention, the motion expression unit 230 expresses the amount of motion of the camera to both the photographer and the subject. For example, the amount of movement of the camera may be expressed in the display unit as a number or a figure to the photographer, and may be expressed in terms of the intensity of the light or the frequency at which the light is turned on or off. Depending on the field to which the present invention is applied, the amount of movement of the camera can be expressed to the photographer and the subject in different ways, which are within the scope of the present invention.

The photographing unit 240 captures an image by opening the shutter only when the movement amount of the camera is equal to or less than a first threshold value. That is, the photographing unit 240 photographs the image by opening the shutter for a predetermined time only when the amount of motion of the camera expressed through the motion calculating unit 220 is less than or equal to the first threshold value. For example, it detects the camera movement that occurs when the user presses the shooting button attached to the camera, and then monitors for a predetermined time and automatically opens the shutter when the camera movement is minimal. Take a picture.

In a preferred embodiment of the present invention, the first threshold is set to a default value (hereinafter referred to as a mode set to a default value) or manually set by a user (hereinafter referred to as a mode set manually). Can be. In another preferred embodiment of the present invention, the first threshold value is automatically set by at least one of a shutter speed, a focal length, an angle of view, a moving frequency, an amount of motion, a threshold of a blurry number of pixels, and an aperture opening degree (hereinafter, The mode may be set automatically).

For example, the larger the focal length, which is the distance between the lens of the camera and the charge coupled device (CCD), the greater the influence of the camera movement, and the narrower the angle of view, the field of view seen through the lens, the greater the influence of the camera movement. Also, the slower the shutter speed, the greater the effect of camera movement. In addition, even if there is the same amount of camera movement, the image is blurred by the amount of movement in a dark place rather than a bright place. The first threshold value is automatically set to a predetermined value in consideration of at least one of a shutter speed, a focal length, an angle of view, a motion frequency, an amount of motion, a threshold value of a blurred number of pixels, and an aperture opening degree.

When the first threshold is set automatically, the threshold of the blurred number of pixels is set to a default value or manually by the user. In addition, the threshold value of the blurry number of pixels may be set by calculating an average motion of the camera for a predetermined time. For example, a threshold value of the number of blurred pixels may be set according to a user by calculating an average amount of hand shake of the user for a predetermined time. The boundary of the real image is clear, but the boundary of the image taken on the monitor and magnified is blurred. Suppose the user is satisfied if less than 5 pixels are blurred in an image normally taken with a 5 mega pixel camera. The threshold of the number of blurred pixels is the degree to which the user will allow the pixels to blur up to about several pixels. If the threshold value of the blurry number of pixels is set small, the first threshold value is automatically set to be small. If the threshold value of the blurry number of pixels is set large, the first threshold value is also set large. Therefore, when the user shakes his hand severely, the user can take a picture by setting a large threshold value of the number of blurred pixels.

3 shows a functional block diagram of an apparatus for representing the movement of a camera, corresponding to another embodiment of the invention. Referring to FIG. 3, the apparatus for expressing motion of a camera according to the present invention includes a motion detector 310, a motion calculator 320, a continuous shooting controller 330, a photographing unit 340, and a display 350. Doing. The motion detector 310 and the motion calculator 320 operate in the same manner as the motion detector 210 and the motion calculator 320 shown in FIG. 2, and a description thereof will be omitted below.

The continuous shooting controller 330 is configured to continuously photograph an image a predetermined number of times through the photographing unit 340 when the amount of movement of the camera calculated by the motion calculating unit 320 is equal to or less than a first threshold value. To control The continuous shooting controller 330 activates the photographing unit 340 a predetermined number of times when the amount of movement of the camera is equal to or less than a first threshold based on the amount of movement of the camera calculated by the motion calculating unit 320. The image is continuously photographed and controls to provide the display unit with the amount of movement of the camera calculated by the motion calculating unit 320 at the time of continuous shooting.

The display unit 350 displays the continuously photographed images. Preferably, the display unit 350 displays the amount of motion of each image calculated by the motion calculator 320 together with the continuously photographed images.

4 shows a functional block diagram of an apparatus for representing the movement of a camera, corresponding to another embodiment of the invention. Referring to FIG. 4, the motion expression apparatus of the camera according to the present invention includes a motion detector 410, a motion calculator 420, a continuous shooting controller 430, a photographing unit 440, a comparator 450, and a selection. The unit 460 and the display unit 470 are provided. The motion detector 410, the motion calculator 420, the continuous shooting controller 430, and the photographing unit 440 are the motion detector 310, the motion calculator 320, and the continuous shooting illustrated in FIG. 3. The same operation as the control unit 330 and the photographing unit 340, a description thereof will be omitted below.

The comparison unit 450 compares the amount of movement of the camera with respect to each of the images continuously taken under the control of the continuous shooting controller 430. The selector 460 selects an image having the least amount of camera movement based on the amount of camera movement with respect to each of the images compared through the comparison unit 450. The display unit 470 displays only an image selected by the selection unit 460.

According to the field to which the present invention is applied, the display unit 470 may display the continuously photographed images in the order of the amount of movement of the camera with respect to each of the images compared through the comparison unit 450. It is within the scope of the present invention. On the other hand, according to the field to which the present invention is applied, the display unit 470 according to the amount of movement of the camera with respect to each of the images compared through the comparison unit 450, for the continuously taken images The amount of camera movement can be displayed with the images, which is within the scope of the present invention.

FIG. 5 shows a functional block diagram of an apparatus for displaying an image based on the amount of movement of the camera with respect to successively captured images. Referring to FIG. 5, the image display apparatus according to the present invention includes a continuous shooting controller 510, a photographing unit 520, a motion detector 530, a motion calculator 540, a comparator 550, and a selector ( 560 and a display unit 570 are provided.

When the user command for capturing a predetermined image is input through a user interface (not shown), the continuous shooting controller 510 controls to photograph the image continuously a predetermined number of times through the capturing unit 520. The photographing unit 520 photographs the image by opening the shutter under the control of the continuous photographing controller 510. The user command may be input through a key panel for inputting a user command or may be input through a voice or an operation of a user. Depending on the field to which the present invention is applied, user commands may be input in different ways, which is within the scope of the present invention.

Meanwhile, the motion detector 530 detects a motion such as an acceleration, an angular velocity, an angular acceleration, an impact amount of the camera, and generates an electric signal corresponding to the detected motion of the camera. The motion calculator 540 calculates the amount of motion of the camera based on the motion of the camera detected by the motion detector 510 at the time when the photographing unit 520 is activated through the continuous shooting controller 510. do.

The comparison unit 550 compares the amount of motion of the camera with respect to each image calculated by the motion calculator 520. The selector 560 selects an image having the least amount of camera movement based on the comparison result of the comparator 550. According to the field to which the present invention is applied, the selector may select a predetermined number of images having the smallest movement amount of the camera based on the comparison result of the comparator 550, which is within the scope of the present invention. The display unit 570 displays an image selected by the selection unit 560.

According to the field to which the present invention is applied, the display unit 570 may display the continuously photographed images in the order of the amount of movement of the camera with respect to each image compared through the comparing unit 550, which is It belongs to the scope of the present invention. On the other hand, according to the field to which the present invention is applied, the display unit 570 according to the order of the amount of movement of the camera for each image compared through the comparison unit 550, the camera for the continuously photographed images The amount of motion of can be displayed with the images, which is within the scope of the present invention.

6 is a flowchart of a method for representing the movement of a camera, corresponding to an embodiment of the invention. Referring to FIG. 6, the motion of the camera is sensed and an electrical signal corresponding to the detected motion is generated (step 610). According to the field to which the present invention is applied, the movement of the camera may be the acceleration, the angular velocity, the angular acceleration of the camera, and the like. According to the field to which the present invention is applied, an acceleration, an angular velocity, an angular acceleration, or an impact amount of at least one axis among a first axis, a second axis, or a third axis may be detected based on a lens of a camera.

Based on the detected movement of the camera, the movement amount of the camera is calculated (step 620).

According to the field to which the present invention is applied, the standard deviation, variance, average, maximum, minimum, norm, etc. for a predetermined time with respect to a signal representing movement of at least one of the first to third axes of the detected camera. The amount of movement of the camera is calculated using at least one of statistics.

According to the field to which the present invention is applied, at least one differentiation or integration of a signal representing movement of at least one axis among the first to third axes of the sensed camera is performed, and a predetermined value for the differential or integrated signal is determined. Calculate the amount of camera movement using at least one of statistics such as standard deviation, variance, mean, maximum, minimum, and nom over time.

The calculated amount of movement of the camera is represented (step 630). 7 illustrates an embodiment representing the calculated amount of movement of the camera. FIG. 7A illustrates an embodiment in which the calculated movement amount of the camera is represented by a bar. In the bar, part C represents the amount of motion of the first threshold required for capturing a clear image, and part D represents the amount of motion of the camera. FIG. 7B illustrates an embodiment in which the amount of movement of the camera is represented by a number together with a bar. As shown in FIGS. 7A and 7B, according to the field to which the present invention is applied, only the calculated motion amount of the camera may be represented or the first threshold value together with the calculated motion amount of the camera. It can be expressed as FIG. 7C illustrates an embodiment in which the movement amount E of the camera is represented by a circular graph.

Depending on the field to which the present invention is applied, the amount of movement of the camera may be expressed differently, which is within the scope of the present invention.

Only when the calculated amount of movement of the camera is equal to or less than the first threshold value, the shutter is opened to capture a predetermined image (step 640). Only when the calculated movement amount of the camera is equal to or less than the first threshold value, the shutter is opened for a predetermined time to capture a predetermined image. Therefore, after the user presses the photographing button attached to the camera, the camera may detect the movement of the camera for a predetermined time and photograph the image at the time when the movement becomes the minimum. The first threshold value is automatically set by at least one of a shutter speed, a focal length, an angle of view, a motion frequency, an amount of motion, and a threshold of a blurred number of pixels.

8 shows a flowchart of a method for representing the movement of a camera, corresponding to another embodiment of the invention. Referring to FIG. 8, a movement of a camera is detected (step 810), and an amount of movement of the camera is calculated based on the detected camera movement (step 820). The calculated movement amount of the camera is displayed on a display unit (not shown) (step 830), and when the displayed movement amount of the camera is equal to or less than a first threshold value, the image is continuously photographed a predetermined number of times (step 840). The amount of camera movement for each successive image is compared (step 850), and an image having the least amount of camera movement is selected based on the comparison result (step 860). The selected image is displayed (step 870). According to the field to which the present invention is applied, it is possible to display the continuously photographed images in the order of the amount of camera movement for each image based on the comparison result, which is within the scope of the present invention. Meanwhile, according to the field to which the present invention is applied, the amount of camera movement with respect to the continuously photographed images may be displayed together with the images in the order of the amount of camera movement with respect to each image based on the comparison result. Which is within the scope of the present invention.

9 shows a flowchart of a method for displaying an image based on the amount of movement of the camera with respect to successively captured images. When a user command for capturing a predetermined image is input, the image is photographed continuously a predetermined number of times (step 910). At the time when the image is continuously photographed, motion such as acceleration, angular velocity, angular acceleration, impact amount, etc. of the camera is detected, and the amount of movement of the camera is calculated based on the detected motion of the camera (step 920).

The amount of camera movement for each of the calculated images is compared (step 930). Based on the comparison result, an image having the least amount of camera movement is selected (step 940). According to the field to which the present invention is applied, based on the comparison result, a predetermined number of images having the least amount of movement of the camera can be selected, which is within the scope of the present invention. The selected image is displayed (step 950).

According to the field to which the present invention is applied, it is possible to display the continuously photographed images in the order of the amount of camera movement for each of the compared images, which is within the scope of the present invention. On the other hand, according to the field to which the present invention is applied, according to the order of the amount of camera movement for each of the compared images, it is possible to display the amount of movement of the camera with respect to the continuously photographed images with the images, It is within the scope of the present invention.

Meanwhile, the above-described embodiments of the present invention can be written as a program that can be executed in a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable recording medium. The computer-readable recording medium may be a magnetic storage medium (for example, a ROM, a floppy disk, a hard disk, etc.), an optical reading medium (for example, a CD-ROM, DVD, etc.) and a carrier wave (for example, the Internet). Storage medium).

Although the present invention has been described with reference to the embodiments shown in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

The method and apparatus for expressing the movement of the camera according to the present invention expresses the amount of movement of the camera to the user, thereby not only allowing the user to recognize the amount of movement of the camera, but also the amount of movement of the camera from the time when the camera button is pressed. By detecting and automatically opening the shutter when the amount of movement is minimized, the image can be captured, thereby preventing the image from being blurred due to camera movement.

Claims (18)

A motion detector configured to detect movement of a camera generated when the camera is operated to capture a predetermined image; A motion calculator configured to calculate an amount of motion of the camera based on the detected motion of the camera; A motion expression unit for expressing a motion amount of the camera calculated by the motion calculator; And And a photographing unit which opens the shutter of the camera to capture the image when the amount of movement of the camera is equal to or less than a predetermined threshold so that the image is captured when the movement of the camera is minimal. . The method of claim 1, wherein the threshold is And a mode set to a default value, a mode set manually by a user, and a mode set automatically. The method of claim 1, The threshold is And at least one of a shutter speed, a focal length, an angle of view, a motion frequency, a motion amount, a blurry pixel count threshold, and an aperture opening degree. The method of claim 3, wherein the threshold value of the blurry number of pixels is And a mode set to a default value, a mode set manually by a user, and a mode set automatically. The method of claim 1, The motion expression unit, And a camera or a photographed subject for expressing the calculated movement amount of the camera. The method of claim 1, The motion expression unit, And expressing the threshold value to a photographer or a photographic subject. The method of claim 1, The calculated amount of movement of the camera or the threshold value, Number of figures, figures, icons, changes in color, intensity or type of sound, intensity of vibration and on / off frequency of light, intensity of light or color of light Motion expression device. The method of claim 1, The motion expression unit According to whether the calculated motion amount of the camera exceeds the threshold value, the motion representation apparatus of the camera, characterized in that represented by the movement of the camera. The method of claim 1, The motion expression unit Motion display device of the camera, characterized in that the display. (a) detecting a movement of a camera generated when the camera is operated to capture a predetermined image; (b) calculating an amount of movement of the camera based on the sensed movement of the camera; (c) expressing the calculated amount of movement of the camera; And (d) photographing the image by opening the shutter of the camera when the amount of movement of the camera is equal to or less than a predetermined threshold so that the image is taken when the movement of the camera is minimized. How to express movement. 11. The method of claim 10 wherein the threshold is And a mode set to a default value, a mode set manually by a user, and a mode set automatically. 11. The method of claim 10 wherein the threshold is And at least one of a shutter speed, a focal length, an angle of view, a motion frequency, a motion amount, a threshold of a blurry number of pixels, and an aperture opening degree. The method of claim 12, wherein the threshold value of the blurry number of pixels is And a mode set to a default value, a mode set manually by a user, and a mode set automatically. The method of claim 10, wherein step (c) The movement expression method of the camera, characterized in that for expressing the movement amount of the camera to the photographer or the subject. The method of claim 10, wherein step (c) And representing the calculated motion amount of the camera or the threshold value. The method of claim 10, wherein the calculated amount of movement of the camera or the first threshold value, Number, icon, figure, change of color, intensity of sound or type of sound, intensity of vibration and on / off frequency of light, intensity of light or color of light How to express movement. The method of claim 10, wherein step (c) According to whether the calculated amount of motion exceeds the threshold value, the motion representation method of the camera, characterized in that represented by the movement of the camera. A computer-readable recording medium having recorded thereon a program for executing the method according to any one of claims 10 to 17 on a computer.

Images