KR20080045578A - Apparatus for sensing clicking of subject and method thereof - Google Patents

Abstract

An apparatus and a method for sensing clicking of a subject are provided to extract a movement of a subject without the necessity of a light source for illuminating the subject. An image capturing unit(210) captures an image of a subject to generate the first image data sequentially. A clarity adjusting unit(231) adjusts clarity of the first image data to generate the second image data sequentially. An outline extracting unit(233) generates a difference value between the sequentially inputted first image data and second image data to extract outlines sequentially corresponding to one end of the subject. A subject determining unit(239-1) compares the mth subject size information calculated by using the mth outline with a pre-set first boundary value, compares the kth subject size information calculated by using the kth outline with a pre-set second boundary value, generates a function performing command corresponding to a particular position in a pre-set outline, and outputs the same.

Description

Apparatus for sensing clicking of subject and Method approximately}

1 is a diagram illustrating a case in which a subject click motion detection apparatus for implementing the present invention is provided in a mobile communication terminal.

Figure 2a is a block diagram according to an embodiment of a subject click motion detection apparatus for implementing the present invention.

FIG. 2B is a diagram illustrating a method for setting a reference luminance value used in controlling a pointer movement according to an embodiment of an apparatus for detecting a subject click motion for implementing the present invention. FIG.

3 is a diagram illustrating a method for detecting a subject click motion according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating an example of a method of detecting a subject click motion.

5 is a diagram illustrating an image generated by an embodiment of an apparatus for detecting a subject click motion for implementing the present invention.

FIG. 6 is a diagram illustrating an image generated by an embodiment of a subject click motion detecting apparatus for implementing the present invention when the brightness of a background is large.

FIG. 7 is a diagram illustrating an image generated by an embodiment of a subject click motion detecting apparatus for implementing the present invention when the brightness of a background is small.

8 is a flowchart illustrating a method of detecting a click motion of a subject according to an exemplary embodiment of the present invention.

9 is a flowchart illustrating a method of detecting a click motion of a subject according to another exemplary embodiment of the present invention.

10 is a block diagram according to another embodiment of a subject click motion detection apparatus for implementing the present invention.

11 is a flowchart illustrating another method of detecting a subject click motion.

<Explanation of symbols for the main parts of the drawings>

210: imaging unit 213: filter unit

216: lens unit 219: image sensor unit

230: image processing unit 231: sharpness adjustment unit

233: outline extraction unit 235: gamma correction unit

237: center determination unit 239: pointer position setting unit

239-1: Subject determining unit 240: Storage unit

The present invention relates to an apparatus and method for detecting a subject click operation, and more particularly, to an apparatus and method for detecting a contactless click operation of a subject.

In general, a display device is a device that converts an electrical signal into an image signal to output. Such display devices include a cathode ray tube (CRT), a liquid crystal display (LCD), a plasma display panel (PDP), and an organic light emitting diode (OLED) display device. Each display device emits light of R, G, and B corresponding to an image signal to implement colors corresponding to the image.

In addition, with the rapid development of electronics and communication engineering, users can use various devices such as internet access, video communication and video message transmission, digital music listening and satellite broadcasting by using digital home appliances or mobile communication terminals such as computers and TVs. I can enjoy function. In order to enjoy these various functions, efficient keypad input for selection is desired.

 Here, with the development of semiconductor technology, it is possible to supply a camera imaging device at a low price, so that a computer and a mobile communication terminal equipped with the same can be supplied to easily access electronic devices equipped with a camera imaging device.

Also, with the development of computer image processing technology and image recognition technology, various application fields using the same have been developed. As one of various application fields, a technology for transferring information using a camera imaging device as an input means is being developed.

However, additional keys for menu selection such as direction keys and selection keys by selecting a menu function using an existing keypad (for example, call button and wireless internet access button for a mobile communication terminal and file playback for an MP3 player). Buttons and file selection buttons). Therefore, when manufacturing a digital home appliance or a mobile communication terminal, it is necessary to work on the mold, and for this reason, there is a problem in that the manufacturing process of the electronic equipment becomes complicated and the manufacturing cost thereof increases.

An object of the present invention is to provide a subject click motion detection apparatus capable of controlling a pointer on a display by extracting movement of a subject regardless of brightness around the subject.

In addition, the present invention is to provide a subject click motion detection device that does not need a separate light source to illuminate the subject in order to extract the movement of the subject.

In addition, the present invention is to provide a subject click motion detection device that can control the pointer on the display using a camera imaging device.

In addition, the present invention can omit a part of the existing keypad to increase the spatial utilization of the electronic device, to provide a subject click motion detection device capable of miniaturization of the electronic device.

In addition, an object of the present invention is to provide a subject click motion detection device that can simplify the manufacturing process and reduce the manufacturing cost of the electronic device.

In addition, the present invention is to provide a subject click motion detection device that can maximize the utilization of the components by making it possible to use the provided camera universally.

The present invention also provides a pointer movement control method and apparatus capable of controlling an optional function such as a menu movement or a volume value in a device having no display, as well as a pointer represented on a display.

Technical problems other than the present invention will be easily understood through the following description.

According to an aspect of the present invention for solving the above problems, (a) imaging the subject to generate the first image data; (b) generating second image data by adjusting the sharpness of the first image data; (c) extracting an m-th outline corresponding to one end of the subject by extracting a difference value between the first image data and the second image data; (d) calculating m-th subject size information from the m-th outline and comparing the m-th subject size information with a first threshold value; (e) calculating k-th subject size information from a k-th outline corresponding to one end of the subject and comparing it with the first boundary value; And (f) a function corresponding to a specific position within a preset outline corresponding to a result of comparing the m-th subject size information with the first threshold and a result of comparing the k-th subject size information with the first threshold; And generating and outputting a performance command, wherein m is a natural number and k is a natural number greater than m.

Here, the method for detecting a subject click operation may include: starting measurement of click information when the m-th subject size information is larger than the first threshold value; If the k-th object size information is smaller than the first threshold value, the method may further include terminating click information measurement. The command to perform a function may be generated corresponding to a specific position in the preset outline and the click information. have.

The method for detecting a subject click operation may further include starting measurement of atmospheric information when the k-th subject size information is smaller than the first threshold, but when the atmospheric information passes a preset boundary time. The function execution command may be output.

The method of detecting a subject click motion may further include calculating first object size information and comparing the first object size information with a second threshold value, wherein l is a natural number greater than k, and the command to perform a function is the first. It may be output when the subject size information is smaller than the second boundary value.

The method for detecting a subject click operation may further include starting measurement of atmospheric information when the first subject size information is smaller than the second threshold value, but if the atmospheric information passes a preset boundary time, the function. The execution command may be output.

In addition, the method of detecting a subject click operation may include the step (f) in the preset outline if the m-th subject size information is greater than the first threshold value and the k-th subject size information is smaller than the first threshold value. It may be a step of generating and outputting a function execution command corresponding to a specific position.

 According to another aspect of the present invention for solving the above problems, (a) imaging the subject to generate the first image data; (b) generating second image data by adjusting the sharpness of the first image data; (c) extracting an m-th outline corresponding to one end of the subject by extracting a difference value between the first image data and the second image data; calculating m-th slope information by using m-th subject size information corresponding to the m-th outline; (e) comparing the m-th slope information with a third threshold value preset; calculating kth slope information by using kth subject size information corresponding to a kth outline extracted from one end of the subject; (g) comparing the k-th slope information with the fourth boundary value; and (h) comparing the m-th slope information with the third boundary value and the k-th slope information with the third boundary value. And generating and outputting a function execution command corresponding to a specific position within a preset outline corresponding to the comparison result, wherein m is a natural number and k is a natural number greater than m. A sensing method is provided.

The method for detecting a subject click operation may further include generating click-in information when the m-th tilt information is larger than the third threshold value and comparing the preset click-in threshold value with the preset click-in threshold value. If the click-in information is the same as the click-in threshold, the k-th slope information may be calculated.

In addition, the method for detecting a subject click operation may further include generating click-out information when the k-th tilt information is smaller than the fourth threshold and comparing the preset click-out information with a preset click-out threshold. If the click-out information is the same as the click-out threshold, the function execution command may be generated.

The method of detecting a subject click motion may include: starting to measure click information when the m th tilt information is larger than the third threshold value; If the k-th subject size information is smaller than the fourth threshold value, the method may further include terminating click information measurement. The command to perform a function may be generated corresponding to a specific position within the preset outline and the click information. have.

The method of detecting a subject click motion may include the step (h), when the m-th slope information is larger than the third threshold value and the k-th slope information is smaller than the fourth threshold value, the specific position within the preset outline. It may be a step of generating and outputting a function execution command corresponding to the.

According to another aspect of the present invention for solving the above problems, an imaging unit for sequentially photographing a subject to generate first image data; A sharpness controller configured to sequentially generate second image data by adjusting the sharpness of the first image data captured by the image pickup unit; An outline extracting unit configured to sequentially extract an outline corresponding to one end of the subject by generating a difference value between the first image data and the second image data that are sequentially input; The m-th subject size information calculated using the m-th outline is compared with the first threshold value preset, and the k-th subject size information calculated using the k-th outline is compared with the second preset threshold value, thereby pre-setting the outline. And a subject determining unit configured to generate and output a function execution command corresponding to a specific position in the apparatus, wherein m is a natural number and k is a natural number greater than m.

Here, the subject determining unit starts the click information measurement only when the m-th subject size information is larger than the first threshold value, and when the k-th subject size information is smaller than the first threshold value, the click information measurement is terminated. The object determining unit may generate the command to perform the function corresponding to a specific position in the preset outline and the click information.

The object determining unit may start the atmospheric information measurement when the k-th subject size information is smaller than the first threshold value, and output the command to perform the function when the atmospheric information passes a preset boundary time.

The subject determining unit may calculate first object size information and output the command to perform the function when the first subject size information is smaller than the second threshold value, and compares the preset second threshold value. May be a natural number greater than k.

In addition, the subject determination unit may start the standby information measurement only when the first subject size information is smaller than the second threshold value, and output the command to perform the function when the standby information passes a preset boundary time. .

The object determining unit may generate a command to perform a function corresponding to a specific position within the preset outline when the first subject size information is larger than the first threshold and the second subject size information is smaller than the second threshold. Can be output.

According to another aspect of the present invention for solving the above problems, an imaging unit for sequentially photographing a subject to generate first image data; A sharpness controller configured to sequentially generate second image data by adjusting the sharpness of the first image data captured by the image pickup unit; An outline extracting unit configured to sequentially extract an outline corresponding to one end of the subject by generating a difference value between the first image data and the second image data that are sequentially input; The m-th slope information calculated using the m-th subject size information corresponding to the m-th outline is compared with the third threshold value preset, and the k-th slope calculated using the k-th subject size information corresponding to the k-th outline And a subject determiner configured to generate and output a function execution command corresponding to a specific position within a preset outline by comparing the information with a fourth preset threshold value, wherein m is a natural number and k is a natural number greater than m. A subject click motion detection device is provided.

Here, when the m-th slope information is larger than the third threshold value, the subject determining unit generates click-in information and compares it with a preset click-in threshold value, wherein the click-in information is equal to the click-in threshold value. If the same, the k-th slope information may be calculated.

The object determining unit may generate click-out information when the k-th slope information is smaller than the fourth threshold value and compare the click-out threshold value with a preset click-out threshold value. If it is equal to, the function execution command can be generated.

The subject determining unit may start measuring click information when the m-th slope information is larger than the third threshold value, and when the k-th subject size information is smaller than the third threshold value, the click information measurement is terminated. A function execution command may be generated corresponding to a specific position in the m-th outline and the click information.

The object determining unit may generate a command to perform a function corresponding to a specific position in the preset outline when the m th slope information is larger than the third threshold value and the k th slope information is smaller than the fourth threshold value. You can print

According to another aspect of the present invention for solving the above problems, (a) generating a glossy image data by photographing a subject in a state in which the light source is activated; (b) photographing the subject while the light source unit is inactivated to generate matt image data; (c) generating third image data by comparing the glossy image data with the matte image data; (d) calculating m-th subject size information by analyzing the third image data; (e) comparing the m-th subject size information with a preset first threshold value; (f) calculating k-th subject size information and comparing it with the first boundary value; And (g) a function corresponding to a specific position within a preset outline corresponding to a result of comparing the m-th subject size information with the first threshold and a result of comparing the k-th subject size information with the first threshold; And generating and outputting a performance command, wherein m is a natural number and k is a natural number greater than m.

Here, the method for detecting a subject click operation may include: starting measurement of click information when the m-th subject size information is larger than the first threshold value; If the k-th object size information is smaller than the first threshold value, the method may further include terminating click information measurement. The command to perform a function may be generated corresponding to a specific position in the preset outline and the click information. have.

The method for detecting a subject click operation may further include starting measurement of atmospheric information only when the k-th subject size information is smaller than the first threshold value, but only when the atmospheric information passes a preset boundary time. The function execution command may be output.

The method may further include calculating first object size information and comparing the first object size information with a second preset threshold value, wherein l is a natural number greater than k. The function performing command may be output only when the first subject size information is smaller than the second threshold.

In addition, the method for detecting a subject click operation may further include initiating measurement of atmospheric information only when the first subject size information is smaller than the second threshold, but when the atmospheric information passes a preset boundary time. Only the function execution command may be output.

According to another aspect of the present invention for solving the above problems, (a) generating a glossy image data by photographing a subject in a state in which the light source is activated; (b) photographing the subject while the light source unit is inactivated to generate matt image data; (c) generating third image data by comparing the glossy image data with the matte image data; (d) calculating m-th subject size information by analyzing the third image data; (e) comparing m-th slope information calculated using the m-th subject size information with a third threshold value preset; calculating kth tilt information by calculating kth subject size information; (g) comparing the k-th slope information with a preset fourth threshold value; and (h) a result of comparing the m-th slope information with the third boundary value and the k-th slope information with the fourth threshold value. Generating and outputting a command to perform a function corresponding to a specific position within a preset outline corresponding to a result of comparing the above, wherein m is a natural number and k is a natural number greater than m. A motion detection method is provided.

The method for detecting a subject click operation may further include generating click-in information when the m-th slope information is greater than the third threshold value and comparing the preset click-in threshold value with the click-in information. When k is equal to the click-in threshold, the k-th slope information may be calculated.

The method for detecting a subject click operation may further include generating click-out information when the k-th tilt information is smaller than the fourth threshold value and comparing the preset click-out threshold value with the click-out threshold. The function execution command may be generated only when information is equal to the click-out threshold.

The method of detecting a subject click motion may include: starting to measure click information when the m th tilt information is larger than the third threshold value; If the k-th subject size information is smaller than the fourth threshold value, the method may further include terminating click information measurement. The command to perform a function may be generated corresponding to a specific position within the preset outline and the click information. have.

The method of detecting a subject click motion may include the step (h), in which the m-th inclination information is greater than the third threshold value and the k-th inclination information is smaller than the fourth threshold value, the specific in the preset outline is determined. It may be a step of generating and outputting a function execution command corresponding to the position.

According to another aspect of the present invention for solving the above problems, a light source unit which is turned on at a predetermined time interval; An image sensor unit for photographing a subject while the light source unit is activated to generate glossy image data, and generating matte image data by photographing the subject while the light source unit is deactivated; A subject extraction unit configured to generate third image data by comparing the polished image data and the matte image data; The m-th subject size information calculated by analyzing the third image data is compared with a preset first threshold value, and the k-th subject size information is calculated and compared with the first threshold value to correspond to a specific position within a preset outline. And a subject determining unit configured to generate and output a function performing command, wherein m is a natural number and k is a natural number greater than m.

Here, the subject determining unit starts clicking information measurement when the m-th subject size information is larger than the first threshold value, and ends measuring click information when the k-th subject size information is smaller than the first threshold value. However, the function execution command may be generated according to the specific position and the click information in the preset outline.

The object determination unit may start the atmospheric information measurement only when the k-th subject size information is smaller than the first threshold value, and output the command to perform the function when the atmospheric information passes a preset boundary time.

The object determining unit may calculate first object size information and compare the first object size information with a preset second boundary value, wherein l is a natural number greater than k, and the command to perform the function is the first subject. If the size information is smaller than the second boundary value, it may be output.

The object determination unit may start the standby information measurement only when the first subject size information is smaller than the second threshold value, and output the command to perform the function when the standby information passes a preset boundary time.

If the m-th subject size information is larger than the first threshold value and the k-th subject size information is smaller than the first threshold value, the subject determining unit may perform a function execution command corresponding to a specific position in the preset outline. Can be generated and printed.

According to another aspect of the present invention for solving the above problems, a light source unit which is turned on at a predetermined time interval; An image sensor unit for photographing a subject while the light source unit is activated to generate glossy image data, and generating matte image data by photographing the subject while the light source unit is deactivated; A subject extractor configured to generate third image data by comparing the polished image data and the matte image data; By analyzing the third image data, the subject size information is sequentially calculated, and the m-th slope information calculated using the m-th subject size information is compared with a third threshold value previously set, and the k-th subject size information is used. And a subject determiner configured to generate and output a function execution command corresponding to a specific position within a preset outline by comparing the calculated k-th slope information with a fourth preset threshold value, wherein m is a natural number and k is the m. A subject click motion detection device is provided that is a larger natural number.

Here, when the m-th slope information is larger than the third threshold value, the subject determining unit generates click-in information and compares it with a preset click-in threshold value, wherein the click-in information is equal to the click-in threshold value. If the same, the k-th slope information may be calculated.

The object determining unit may generate click-out information when the k-th slope information is smaller than the fourth threshold value and compare the click-out threshold value with a preset click-out threshold value. The function execution command can be generated only when

The subject determining unit may start measuring click information when the m-th slope information is larger than the third threshold value, and ends measuring click information when the k-th subject size information is smaller than the fourth threshold value. A function execution command may be generated corresponding to the specific position and the click information in the preset outline.

The object determining unit may generate a command to perform a function corresponding to a specific position in the preset outline when the m th slope information is larger than the third threshold value and the k th slope information is smaller than the fourth threshold value. You can print

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In the following description of the present invention, if it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, a preferred embodiment of an apparatus and method for detecting a subject click motion according to the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same components are denoted by the same reference numerals. And duplicate description thereof will be omitted. In the following description of the present invention, if it is determined that the detailed description of the related known technology may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, the pointer described in the present invention means not only a pointer expressed on a display, but also all functions that perform an optional function such as moving between menus or numerical values of a volume in a device without a display. That is, the present invention is not only a method of controlling a pointer on a display in a case where a pointer is provided on the display (for example, a computer, a mobile terminal, a PDA, etc.) and an apparatus (eg, a radio) that is not equipped with a display. , MP3 player, etc.) may be applied to a method of controlling movement / selection between menus / functions. Hereinafter, for convenience of description, the display of the mobile communication terminal will be described.

1 is a diagram illustrating a case in which a subject click motion detection apparatus for implementing the present invention is provided in a mobile communication terminal. Referring to FIG. 1, the mobile communication terminal 100 includes an image capturing unit 110, light source units 120-1 and 120-2 (hereinafter collectively referred to as “120”), and a keypad unit 130. A subject (eg, a finger of the user of the mobile communication terminal 100) 140 for extraction is shown.

The light source unit 120 is a device for irradiating a predetermined light onto the subject 140, and the light emitted from the light source unit 120 is reflected from the subject 140 to be incident on the imaging unit 110. The number and location can be determined. For example, the light source unit 120 may be formed around the imaging unit 110, and the number thereof may be implemented as two as shown in FIG. 1, but the present invention may include the number and position of the light source unit 120. It is obvious that the present invention is not limited thereto. In addition, the position of the subject 140 may be a position at which the light emitted from the light source unit 120 is reflected, and the subject 140 is in contact with or is not in contact with the imaging unit 110 or the mobile communication terminal 100. Contacts). In addition, according to another embodiment, a separate light source unit 120 is not provided, and light is emitted from the display of the mobile communication terminal 100, reflected from the subject 140, and then incident on the imaging unit 110. The present invention may be carried out.

The light irradiated from the light source unit 120 is reflected by the subject 140 and continuously enters the imaging unit 110, and the imaging unit 110 generates an image of the subject 140. The generated image of the subject 140 is processed in the form of image data by a subject click motion detection device (not shown) included in the mobile communication terminal 100 to extract the movement of the subject 140, and the subject click motion. The sensing device (not shown) controls the movement of the pointer displayed on the display of the mobile communication terminal 100 in response to the movement of the extracted subject 140 and / or the function control corresponding to the movement of the extracted subject 140. Perform Here, the pointer displayed on the display may be a pointer or a cursor having a predetermined shape (for example, an arrow shape), and the selection of buttons, numbers, figures, etc., which are not separately displayed but displayed on the display ( It may include a variety of forms to move on the display to perform the function.

In addition, according to another embodiment, the characteristic vector means the movement trajectory of the pointer in the frame of each image data continuously generated by the object click motion detection device (not shown) corresponding to the movement of the extracted object 140 May be interpreted, and a stored menu function may be executed to correspond to the interpreted characteristic vector. For example, when the movement of the extracted subject 140 is grasped up and down, left and right, or in a specific form (for example, a circle, a triangle, a square, etc.), a function preset in response to the movement may be executed. That is, according to an embodiment of the present invention, the movement of the extracted subject 140 may control the movement of the cursor on the display, or may extract a predetermined motion vector and execute a predetermined menu.

In this case, the menu may be differently designated by a separate function button (or a combination of button inputs). For example, the movement of the subject 140 is the same but the movement of the subject 140 extracted while the * button is pressed and the movement of the extracted subject 140 when the # button is pressed are performed so that different functions are performed. Can be set.

In addition, the keypad 130 may be implemented in various ways, such as a button method and / or a touch method, so that a user may input numbers, letters, special symbols, and the like.

In the above description, the subject click motion detecting apparatus has been described in general. Hereinafter, referring to the accompanying drawings, the subject 140 using the operation of the subject click motion detecting apparatus and the image data generated by the subject click motion detecting apparatus is described. It will be described how to detect the movement of the. Embodiments according to the present invention can be broadly classified into two types. First, by adjusting the sharpness of the image data generated by photographing the subject 140, the outline of one end of the subject 140 is extracted from a frame having different sharpness, and the subject The method of detecting the movement of the 140 and the second method compares a plurality of different image data obtained by capturing the subject 140 at a predetermined time interval, and extracts the center point of the subject 140 image to perform the movement of the subject 140. How to detect. In the following, it is explained in order.

FIG. 2A is a block diagram of an apparatus for detecting a subject click motion according to an exemplary embodiment of the present invention.

Referring to FIG. 2A, the subject click motion detecting apparatus 200 may include an imaging unit 210, an image processing unit 230, and a storage unit 240, and the imaging unit 210 may include a light source unit 211 and a filter. The unit 213, the lens unit 216, and the image sensor unit 219 may be included, and the image processor 230 may include a sharpness adjuster 231, an outline extractor 233, a gamma corrector 235, and the like. And a center determiner 237, a pointer position setter 239, and a subject determiner 239-1.

As described above, the light irradiated from the light source unit 211 may be reflected by the subject 140 and irradiated to the image sensor unit 219 via the filter unit 213 and the lens unit 216. The filter unit 213 allows only the light of a specific wavelength to pass so that the movement of the subject 140 can be accurately measured. That is, when the object click motion detecting apparatus 200 for implementing the present invention includes the light source unit 211, the light source unit 211 may output light having a specific wavelength, and the light may be output from the subject 140. By being reflected and passing through the filter unit 213, there is an effect that can block light of other wavelengths that may act as noise. For example, the light source unit 211 emits infrared rays, and the filter unit 213 may perform a function of allowing only infrared rays to pass therethrough. Here, the infrared rays which can be used in the present invention may be light having a relatively small ratio in sunlight. For example, the wavelength of the infrared light may be 900 to 980 nm, 1080 to 1180 nm, 1325 to 1425 nm, 1800 to 2000 nm, and the like, which are wavelengths of light having a relatively small amount of light in the solar spectrum.

Although the image capturing unit 210 including the filter unit 213 has been described herein, it is apparent that the present invention may be applied using all the light emitted from the subject 140 without the filter unit 213. Do. The lens unit 216 may perform a function of transferring the light passing through the filter unit 213 to the image sensor unit 219.

The image sensor unit 219 may be a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor. A complementary metal oxide semiconductor (CMOS) image sensor is composed of a plurality of unit pixels including a photo diode, and the signal output from the sensor is a digital electrical signal, which unit pixel is driven by a control circuit and signal processing. . A charge coupled device (CCD) image sensor includes a plurality of MOS capacitors, and is operated by outputting an analog electric signal by moving charges (carriers) to the MOS capacitors.

The image sensor unit 219 includes a plurality of pixels capable of sensing light. Therefore, the image sensor 219 detects a position at which the light corresponding to the coordinate value at which the subject 140 is located is incident by the image processor 230 to move the pointer of the display unit (not shown). The coordinate value at which the image of 140 is located may be calculated.

The image processor 230 extracts coordinate values corresponding to the movement of the subject 140 from the image data of the subject recognized by the image sensor 219. In detail, the sharpness controller 231 generates second image data different from the first image data by adjusting the sharpness of the first image data of the photographed subject 140. That is, the sharpness controller 231 may adjust the sharpness by increasing at least one of color contrast, brightness contrast, and saturation contrast of pixels of the first image data of the photographed subject 140.

Here, the sharpness of the image indicates the clarity of the contrast boundary portion of the image. When the sharpness of the image of the subject 140 increases, the clarity of the boundary portion increases, so that the subject 140 is moved. There is an advantage in that it is easy to grasp the outline (or edge) of only the predetermined subject 140 from the captured image. That is, the sharpness may be increased by increasing any one of color contrast, brightness contrast, and saturation contrast with respect to pixels having high sharpness. Here, the sharpness of the image of the subject 140 is expressed differently according to the depth of field of the lens unit 216, that is, within the range in which the image of the subject 140 generated by the lens unit 216 can be clearly seen. Can be. In general, the outline of the subject 140 positioned at a distance similar to the focal length of the lens unit 216 has a high sharpness, but the background located far from the focal length of the lens unit 216 has a low sharpness.

In the case of using the sharpness adjusting unit 231 according to the first embodiment of the present invention, the outline of the subject 140 located at a distance similar to the focal length of the lens unit 216 will further increase the sharpness, but the lens unit 216 Backgrounds located far from the focal length of the image may have a smaller sharpness. Therefore, the sharpness controller 231 makes the outline of the subject 140 larger than the background.

The outline extractor 233 extracts a difference value between the first image data generated by capturing the subject 140 and the second image data processed by the image, and extracts the outline of the subject 140 to the storage unit 240. Store sequentially. That is, the difference between the second image data having high sharpness generated by the sharpness controller 231 and the first image data of the photographed subject 140 may represent the outline of the subject 140. The outline of the extracted subject 140 may be an outline of one end of the subject 140 adjacent to the imaging unit 210.

Here, an outline corresponding to one end of the subject 140 may be extracted by extracting a difference value having a luminance value greater than a preset reference luminance value. The reference luminance value may remove noise generated by light entering the imaging unit 210 from a background other than the subject 140. That is, since the sharpness of the second image data generated by the sharpness adjuster 231 may be adjusted not only by the image data of the subject 140 but also by the background image data, only the image data whose difference is greater than or equal to the reference luminance value may be outlined. The recognition efficiency of the subject 140 may be improved by recognizing the image. Here, the reference luminance value may be fixed or may vary according to the number of pixels having a predetermined luminance value or more, which will be described later with reference to FIG. 2B.

The gamma correction unit 235 gamma-corrects the image data of the subject 140. Here, gamma of an image is generally a slope of a straight line when input / output specification is indicated by positive and large contractions in a photoelectric conversion system or an all-optical conversion system such as a television, a camera, a fax transceiver, and the like. That is, the television displays the logarithmic ratio between the camera output voltage for the brightness of the subject 140 and the cathode ray tube brightness for the input voltage of the receiver. Since the luminance value of each pixel may be changed by gamma correction according to an exemplary embodiment of the present invention, only a portion of the sharpness of the subject 140 is displayed, and a portion of the remaining sharpness remains black. Therefore, only the outline of the predetermined subject 140 is brightly displayed in the image photographing the subject 140, so that it may be determined whether or not the subject 140 is moved.

The center determiner 237 may track a predetermined outline from the gamma corrected image and extract a coordinate value determined by the predetermined outline. Here, the predetermined outline may have various shapes. For example, it may be a circular outline, and the coordinate value determined by the predetermined outline may be a center point determined by the circular outline, that is, a coordinate value of the center of the circle. In general, since the subject 140 used for the motion extraction may be one end of the user's finger, the center determination unit 237 may calculate the movement of the subject 140 by extracting a circular outline that is one end of the finger. Can be.

The center determiner 237 calculates specific coordinates located inside the figure formed by the outline of the subject extracted by the gamma corrector 235. There may be a number of ways to calculate this particular coordinate. For example, the center determiner 237 may extract a coordinate value of the center of gravity or the center point of the figure formed by the outline of the subject 140.

The center of gravity, which is a specific coordinate located inside the figure formed by the outline of the subject 140, may be calculated by the following equation.

(1)

(One)

(2)

(2)

(3)

(3)

 Where R is the center of gravity, M is the sum of luminance values of pixels representing the outline of the subject 140 (hereinafter referred to as 'outline pixels'), mi is the luminance value of the outline pixel of the subject 140, ri is a coordinate value of the outline pixel. The subscripts x and y indicate the values corresponding to the X and Y axes, respectively, and Equation (3) is a vector representation of Equation (1) and (2).

In addition, when the center determiner 237 determines the center point of the image of the subject 140 by the above-described equation, since the luminance values of the outline pixels must all be reflected, the amount of calculation increases, thereby detecting the click operation of the subject 140. Problems may occur that degrade the overall functionality of the device. Therefore, according to another embodiment, the center of gravity, which is a specific coordinate located inside the figure formed by the outline of the subject 140, may also be calculated by the following equation.

(4)

(4)

(5)

(5)

(6)

(6)

Where R is the center of gravity, ri is the coordinate value of the outline pixel, and n is the number of outline pixels. Subscripts x and y represent values corresponding to the X and Y axes, respectively, and Equation (6) is a vector representation of Equation (4) and (5). That is, the center determination unit 237 may determine the center point of the image of the subject 140 without reflecting the luminance value of the pixel. Since the luminance value of each pixel will not be significantly different, the center determination unit 237 may calculate the average value of the coordinate values of the outline pixel as the center point of the image of the subject 140 without reflecting the same.

Alternatively, when the outline of the subject 140 is curved, the center determination unit 237 may calculate a radius of curvature and extract a coordinate value of a center point corresponding to the radius of curvature. If the predetermined outline is a quadrangle, the center judging unit 237 may extract a coordinate value where a diagonal line of the quad meets as a coordinate value determined by a predetermined outline. It can also be extracted as coordinates that meet two or more lines. For example, the center determination unit 237 may calculate a distance between each pixel representing a curved outline, and may use the intermediate value of two pixels having the largest calculated distance of each pixel as the coordinate value of the center point. In another example, since the intermediate value may be represented by coordinate values for the X and Y axes in the case of a two-dimensional display, the center determination unit 237 may have the largest difference in the coordinate values for the X or Y axes. The intermediate value between two large pixels may be extracted as the coordinate value of the center point.

In addition, the center determination unit 237 calculates a coordinate value of the center point (hereinafter, referred to as a “center point”) and stores the coordinate value in the storage unit 240. That is, the center determination unit 237 may control the information about the center point calculated by the above-described method to be stored in the storage unit 240.

The pointer position setting unit 239 controls the pointer of the display unit (not shown) to be positioned at the calculated specific coordinates. That is, the pointer position setting unit 239 controls the position of the pointer to correspond to a specific coordinate (for example, the center of gravity or the coordinate value of the center point of the outline of the subject 140). In addition, in a device without a display unit (not shown), a function such as selecting a menu or increasing a volume may be performed. That is, when the calculated specific coordinates are located above the preset pixels, the user may select a previous menu of the currently selected menu or, when the calculated specific coordinates are located to the right of the preset pixels, increase the volume. have.

The subject determining unit 239-1 performs a function corresponding to the movement of the subject 140 by using the outline determined by the outline extracting unit 233 (hereinafter, referred to as 'm-th outline' (m is a natural number)). A command is generated and output to a main controller (not shown). Detailed operations of the object determining unit 239-1 will be described later with reference to FIG. 3.

Hereinafter, a method of setting a reference luminance value used for pointer movement control will be described with reference to FIG. 2B before describing the operation of the object determining unit 239-1.

2B is a diagram illustrating a method for setting a reference luminance value used in pointer movement control according to the first embodiment of the present invention. The first reference luminance value 250, the time point 253 of the first reference pixel number, the first luminance lower limit value 255, the luminance range a corresponding to the first reference pixel number, and the second reference luminance value 260. The luminance range b corresponding to the viewpoint 263 of the second reference pixel number, the second luminance lower limit 265, and the second reference pixel number is illustrated. Here, the first or the second is used to describe two embodiments in which the number of reference pixels is different, and will be omitted and collectively described below.

The reference luminance value 250 or 260 is provided to compare the luminance value of each pixel to extract the outline of the subject 140. In the following, it is assumed that the resolution of the image sensor unit 219 is 640 * 480 (horizontal * vertical), and the luminance value of each pixel is divided between 0 and 255. When the luminance value is '0', it will be black because it is the darkest case, and when the luminance value is '255', it will be expressed as white because it is the brightest case.

In addition, referring to FIG. 2B, the reference luminance value 250 or 260 may vary according to the number of pixels having a predetermined luminance value or more. The outline extractor 233 may set the number of reference pixels and extract a pixel having a high luminance value in order to extract pixels corresponding to the outline of the subject 140. For example, when the number of reference pixels is set in consideration of the amount of calculation, 10000 pixels are extracted from the histogram stored in the buffer prepared in advance in order of increasing luminance, and the pixels corresponding to the 10000th pixels (starting point of the reference pixel count 253). , 263) or a smaller value may be the reference luminance value 250 or 260. Therefore, luminance ranges a and b corresponding to the number of reference pixels may be determined. Here, since the luminance value of each pixel is stored in the buffer, the reference luminance value may be calculated by counting the number of pixels in order of decreasing luminance value. That is, if the total number of pixels is stored in the buffer, the reference luminance value may be calculated by extracting the luminance values in the order in which the luminance values are smaller by the total number of pixels minus the number of reference pixels.

Here, if the number of reference pixels is too large, most of the pixels will be extracted to the outline of the subject 140 and vice versa, only a portion of the pixels will be extracted to the outline of the subject 140. If the reference luminance value is too small (i.e., the number of reference pixels is too large), pixels irrelevant to the outline of the subject 140 (for example, pixels for the background part) may be extracted, and thus the luminance lower limit value 255 If the reference luminance value is smaller than this, the lower limit values 255 and 265 may be set as the reference luminance value. In addition, when the reference luminance value is too large (that is, when the reference pixel number is too small), the minimum number of pixels constituting the outline of the subject 140 may not be extracted. Can be set. Here, the lower limit values 255 and 265 and the upper limit value of the luminance may be generally given one by one. Referring to FIG. 2B, when the luminance lower limit values 255 and 265 change, the reference luminance values 250 and 260 change. The case is shown.

For example, if the number of reference pixels is 10000 and the lower luminance limits (255, 265) are 50, each pixel is analyzed and 10000 pixels are extracted in the order of the higher luminance values, and the greater of the luminance value and the 50th pixel is 10000. Is set to the reference luminance value. On the contrary, assuming that the number of reference pixels is 10000 and the upper limit of luminance is 200, 10000 pixels are extracted in order of increasing luminance, and the luminance value of the 10000th pixel and the smaller of 200 are set as the reference luminance values.

Further, according to another embodiment, the reference luminance value may be fixed to a specific value. For example, a pixel having a reference luminance value of 100 and above may be recognized as an outline of the subject 140. It goes without saying that the above-mentioned lower limit of luminance and upper limit of luminance can be applied even when the reference luminance is fixed.

In addition, although the control unit for controlling the operation of the subject click motion detecting apparatus 200 is not provided separately, the subject click motion detecting apparatus 200 includes the control unit for controlling the overall operation. It will be apparent to those skilled in the art that the device (not shown) may be separately provided. In addition, the subject click motion detecting apparatus 200 may be controlled by a main controller (not shown) for controlling the overall operation of the electronic device including the subject click motion detecting apparatus 200 without providing a separate controller. It is self-evident.

Referring again to FIG. 2A, the subject determiner 239-1 generates a command to perform a function corresponding to the movement of the subject 140 using the m-th outline determined by the outline extractor 233 to display the main controller (not shown). Can be output as described above. Hereinafter, an embodiment of the operation of the subject determining unit 239-1 will be described. Here, the function execution command is a command for performing various functions that can be performed by a button click. For example, menu execution, dialing of a mobile communication terminal, a lock function, a numeric / character button input, and the like may be performed by a function execution command.

The subject determining unit 239-1 calculates m-th subject size information by using the m-th outline. In this case, the m-th subject size information may be information corresponding to the diameter (or radius) of the m-th outline. That is, when the subject 140 is a user's finger, the m-th outline of the image of the subject 140 may be circular (or semicircular). Therefore, the m-th subject size information may be information corresponding to the diameter (or radius) of the m-th outline. Also, the m-th subject size information may be information corresponding to the number of pixels existing in the figure of the m-th outline pixel. That is, when the m-th outline is a circular figure or a quadrangle (or triangle) figure, the m-th subject size information may be the number of pixels existing in the figure.

In addition, the subject determining unit 239-1 detects the click operation of the subject 140 by comparing the subject size information sequentially calculated with a preset threshold value. Hereinafter, a method of detecting a subject click operation of the subject determiner 239-1 will be described with reference to FIG. 3.

3 is a diagram illustrating a method of detecting a subject click motion according to an exemplary embodiment of the present invention.

Referring to FIG. 3, the object determining unit 239-1 may generate a corresponding function execution command by comparing the subject size information sequentially calculated with a preset first boundary value and / or second boundary value. For example, if the m-th subject size information is greater than the first threshold value, the subject determiner 239-1 may generate k-th subject size information and compare it with the first threshold value. In this case, k may be a natural number larger than m. That is, after a predetermined time elapses after generating the m-th subject size information, the k-th subject size information is generated according to a change in the position, size, etc. of the subject. In addition, when the k-th subject size information is smaller than the first boundary value, the object determining unit 239-1 may generate a function execution command corresponding to a specific position within a preset outline.

For example, it is assumed that the object click motion detecting apparatus 200 is provided in the mobile communication terminal 100. In this case, the specific position in the m-th outline may be the center of gravity of the m-th outline, and if the position of the pointer corresponding to the center of gravity corresponds to the 'menu' button, the main controller of the mobile communication terminal 100 (not shown) The controller may control each component of the mobile communication terminal 100 to receive a function execution command from the subject determining unit 239-1 to perform a 'menu' function.

In this case, it is obvious that the function execution command may be set in advance even if the calculated object size information is the same as the first threshold value and / or the second threshold value. However, hereinafter, the description of the case where the calculated subject size information is the same as the first boundary value and / or the second boundary value will be omitted.

However, when the object determining unit 239-1 generates a function execution command, the coordinates of the m th outline center and the k th outline center may be different. In this case, there is no problem when the functions corresponding to the coordinates of the centers of gravity are the same (that is, when the coordinates correspond to the 'menu' functions). Can be. In this case, the object determining unit 239-1 may generate a function execution command corresponding to a specific position within a preset outline, generate a function execution command corresponding to an error, or the user's selection. It is also possible to create a corresponding function command.

For example, it is assumed that the object determiner 239-1 is set in advance to generate a function execution command corresponding to the coordinate of the kth outline center of gravity. In this case, when the coordinate of the m th outline center of gravity corresponds to the 'menu' function, and the coordinate of the k th outline center of gravity corresponds to the 'call' function, the object determining unit 239-1 may coordinate the k th outline center. A function execution command for performing a 'call' function corresponding thereto may be generated and output to a main controller (not shown).

In addition, the subject determiner 239-1 may start measuring click information when the m-th subject size information is larger than the first boundary value. The measurement of the click information is to generate the click information t1 differently according to the time that the click operation of the subject 140 continues, and thereby the object determiner 239-1 generates a command to perform a function corresponding to the click information. . That is, the click information may be a time when the click operation of the subject 140 is continued. For example, a short click when the click information is less than t2, which is a preset time, and a long click when the click information is a value between the t2 and t3, which is the preset time (t2 <t3). If the click information is greater than t3, it is assumed that the click information is previously set as a cancel click.

In this case, the object determining unit 239-1 may generate a function execution command corresponding to the measured click information and output the generated command to the main controller (not shown). That is, when the click information is less than t2, the subject determining unit 239-1 may generate and output a function execution command corresponding to a short click operation of the subject 140. For example, assuming that a short click is set in advance to correspond to a function of selecting data, and a long click corresponds to a function of selecting an option, the object determining unit 239-1 determines that the click information corresponds to a short click (that is, If the click information is less than t2), a command to perform a function for data selection may be generated.

However, when the m-th subject size information and / or the k-th subject size information is a value near the first boundary value, the detection of the click operation of the subject 140 may not be accurate. For example, the k-th subject size information sequentially input after the m-th subject size information is larger than the first threshold value and the measurement of the click information is started is repeated. It may be entered. That is, when the first threshold value is previously set to '100', the m-th subject size information is '110' and then measurement of the click information is started, but the k-th subject size information sequentially input is '102' and k + 1. The subject size information may be '98' and the k + 2th subject size information may be '101'. In such a case, the accuracy of the measurement of the click information is inferior.

To prevent such a phenomenon, the subject determining unit 239-1 starts measuring click information when the m-th subject size information is larger than the first threshold value, and k-th subject size information having a value smaller than the first threshold value is input. When repeating the predetermined number of times, the measurement of the click information is terminated, but the click information may be valid by retroactively to the time point at which the k-th subject size information having a value smaller than the first boundary value is repeatedly measured for the first time.

That is, it is assumed that the first threshold value is '100' and the end point of the click information measurement is preset when the subject size information smaller than the first threshold value is input three times in succession. In this case, the k-th subject size information is '102', the k + 1th object size information is '98', and the k + 2th object size information is '101', and the k + 3th object size is sequentially selected. If the information is '99', the k + 4th object size information is '98', and the k + 5th object size information is '98', the object determining unit 239-1 generates the kth object size information. The click information is measured from the viewpoint, and the click information is measured from the time point at which the k + 5th object size information is generated, and the click information is generated from the time point at which the kth object size information is generated. It can be valid up to the point of time.

In addition, as described above, the object determining unit 239-1 may generate a function execution command corresponding to a specific position within a preset outline in consideration of the click information and output the command to the main controller (not shown). However, unlike the case where the k-th subject size information sequentially generated as in the first case 310 continuously decreases, the k-th subject size information may be changed from a value smaller than the first boundary value to a larger value. (Second case 320). Even in this case, the click operation of the subject 140 may not be accurately detected. That is, the user may move to the subject 140 near the imaging unit 210 in order to click a button or the like corresponding to the position of the pointer and hesitate.

In this case, the object determination unit 239-1 generates a function execution command immediately after the measurement of the click information ends, but only when the subject size information sequentially input afterwards is smaller than the second boundary value. May be output to a main controller (not shown). For example, when the first threshold value is '100' and the second threshold value is '50', the subject determining unit 239-1 may perform a function command when the k-th subject size information is smaller than '50'. Output to the main control unit (not shown). However, even in this case, in order to clarify that the subject 140 is far from the image capturing unit 210, the subject determining unit 239-1 sets a predetermined time after the first subject size information smaller than the second boundary value is generated. If the k-th subject size information larger than the second threshold is not generated, the function execution command may be output to the main controller (not shown) (where l may be a natural number greater than k). That is, the subject determination unit 239-1 may start measuring atmospheric information when the first subject size information smaller than the second threshold is generated. The atmospheric information may be a time when the first subject size information larger than the second threshold is not generated. In this case, the subject determining unit 239-1 may output a generated function execution command to the main controller (not shown) when the waiting time elapses from the preset time.

In the above-described example, the method of detecting the click operation of the subject 140 using the subject size information sequentially calculated by the subject determining unit 239-1 has been described. Hereinafter, a method of detecting the click operation of the subject 140 by calculating tilt information using the outline of the subject 140 sequentially extracted by the subject determiner 239-1 will be described.

That is, the subject determiner 239-1 may calculate the m-th slope information by using the m-th subject size information and the m-th subject size information. The m-th slope information may be calculated by Equation (7) as information on the degree of inclination of the m-th subject size information and the m-th subject size information.

(7)

(7)

은 제m 피사체 크기 정보가 생성된 시간이고,

은 제m-1 피사체 크기 정보가 생성된 시간이다. 따라서, 식 (7)의 분모는 제m 피사체 크기 정보가 생성된 시점과 제m-1 피사체 크기 정보가 생성된 시점의 차이다. here,

Is the time at which the m-th subject size information was generated,

Is the time at which the m-1 subject size information was generated. Therefore, the denominator of equation (7) is the difference between the time point at which m-th subject size information is generated and the time point at which m-th subject size information is generated.

In addition, the object determining unit 239-1 compares the m-th inclination information with a third threshold value which is preset inclination information. As a result of comparison, when the m th tilt information is smaller than the third threshold value, the object determining unit 239-1 calculates the m + 1 th subject size information to calculate the tilt information. On the other hand, when the m-th tilt information is larger than the third threshold value, the subject determining unit 239-1 may recognize the movement of the subject 140 as the approach to the image capturing unit 210 for clicking. In this case, the third boundary value may be a value having a positive value as a value for the slope. That is, when the m-th inclination information is larger than the third boundary value, it means that the subject size information is rapidly increased. This means that the imaging unit 210 is close to the subject 140 for the click operation.

In this case, even when the calculated m-th slope information is the same as the third threshold value, it may mean that the subject size information is rapidly increasing, and thus it may be the same as the case where the m-th slope information is larger than the third threshold value. However, hereinafter, the description of the case where the m-th slope information calculated for convenience of understanding and explanation is the same as the third boundary value will be omitted.

)를 생성하고, 생성된 클릭-인 정보가 미리 설정된 클릭-인 경계값(

)과 동일한 경우에만 피사체(140)의 움직임을 클릭을 위한 동작으로서 인식할 수 있다. 여기서, 클릭-인 카운터는 제3 경계값보다 큰 제m 기울기 정보가 산출된 회수를 순차적으로 측정하여 클릭-인 정보(

)를 생성할 수 있다. 예를 들어, 피사체 판단부(239-1)는 제m 기울기 정보가 제3 경계값 보다 크면 클릭-인 카운터를 동작시켜 클릭-인 정보를 생성할 수 있 다(즉,

, 이때 클릭-인 정보의 초기값은 '0'일 수 있음). In addition, the subject determiner 239-1 operates a click-in counter to detect the click operation of the subject 140 accurately.

), The generated click-in information is a preset click-in threshold (

), The movement of the subject 140 may be recognized as an operation for clicking. Here, the click-in counter sequentially measures the number of times the m-th slope information larger than the third threshold value is calculated, thereby determining click-in information (

) Can be created. For example, the subject determining unit 239-1 may generate the click-in information by operating the click-in counter when the m-th tilt information is larger than the third threshold value (ie

, Where the initial value of the click-in information may be '0'.

Also, when the generated click-in information is smaller than the click-in threshold, the object determining unit 239-1 may calculate m-th + 1 slope information by calculating m-th subject size information again. When the click-in information is equal to or larger than the click-in threshold, the movement of the subject 140 may be recognized as an operation for clicking and the measurement of the click information may be started. In this case, the measurement of the click information is to generate the click information differently according to the time that the click operation of the subject 140 continues, so that the object determination unit 239-1 generates a command to perform a function corresponding to the click information. As shown.

)는 시간과 피사체 크기 정보가 형성하는 평면에서 기울기의 평균값에 의해서 산출될 수도 있다. 예를 들면, 일정 시간 동안 피사체의 크기가 커지거나 작아지는 비율을 평균 기울기로 계산하여 클릭-인 정보(

)를 산출한다. 즉, 순차적으로 추출된 피사체 크기 정보에 대해 각각 시간에 대한 기울기들을 구하고 이를 평균값으로 산출하여 평균 기울기를 구한 후 이로부터 클릭-인 정보(

)를 산출할 수 있다. 여기서, 클릭-인 경계값(

)은 기울기가 된다. In addition, click-in information (

) May be calculated by the average value of the slope in the plane formed by the time and the subject size information. For example, you can calculate the rate at which the subject grows or shrinks over time, using the average slope to calculate click-in information (

) Is calculated. That is, the slopes of time are obtained for the sequentially extracted subject size information, and the average slopes are calculated by calculating the average slopes, and then the click-in information (

) Can be calculated. Where the click-in threshold (

) Becomes a slope.

In addition, when the measurement of the click information is started, the object determining unit 239-1 calculates k-th slope information using the k-th subject size information and the k-th subject size information (where k is a natural number greater than m). Can be). The method of calculating the k-th slope information is the same as the method of calculating the m-th slope information, and a detailed description thereof will be omitted.

In addition, the object determiner 239-1 compares the k-th tilt information with a fourth threshold value preset. As a result of comparison, when the m th slope information is larger than the fourth threshold value, the object determining unit 239-1 calculates k + 1 th size information and calculates k + 1 th slope information. On the other hand, if the k-th tilt information is smaller than the fourth threshold value, the subject determiner 239-1 may recognize the movement of the subject 140 as an operation away from the image capture unit 210. In this case, the fourth boundary value may be a value having a negative value as a value for the slope. That is, when the k-th tilt information is smaller than the fourth threshold value, it means that the subject size information is rapidly reduced. This means that the subject 140 is moving away from the imaging unit 210 for the click operation.

In this case, even when the calculated k-th slope information is the same as the fourth threshold value, it may mean that the subject size information is rapidly decreasing, and thus it may be the same as the case where the k-th slope information is larger than the fourth threshold value. However, hereinafter, description will be omitted for the case where the kth slope information calculated for convenience of understanding and explanation is the same as the fourth boundary value.

)를 생성하고, 생성된 클릭-아웃 정보가 미리 설정된 클릭-아웃 경계값(

)과 동일한 경우에만 피사체(140)의 움직임을 클릭을 위하여 촬상부(210)로부터 멀어지는 동작으로서 인식할 수 있다. 여기서, 클릭-아웃 카운터는 제4 경계값보다 작은 제k 기울기 정보가 산출된 회수를 순차적으로 측정하여 클릭-아웃 정보(

)를 생성할 수 있다. 예를 들어, 피사체 판단부(239-1)는 생성된 기울기 정보가 제4 경계값 보다 작으면 클릭-아웃 카운터를 동작하여 클릭-아웃 정보를 생성할 수 있다(즉,

). In addition, the subject determiner 239-1 operates the click-out counter to detect the click operation of the subject 140 accurately, thereby performing click-out information (

), The generated click-out information is a preset click-out threshold (

), The movement of the subject 140 may be recognized as an operation away from the imaging unit 210 for clicking. Here, the click-out counter sequentially measures the number of times the k-th slope information smaller than the fourth threshold value is calculated, thereby determining the click-out information (

) Can be created. For example, the object determiner 239-1 may generate the click-out information by operating the click-out counter when the generated tilt information is smaller than the fourth threshold value (ie, the click-out counter).

).

In addition, when the generated click-out information is smaller than the click-out threshold value, the object determining unit 239-1 may calculate the k + 1th slope information by calculating the k + 1th subject size information again. When the click-out information is equal to or larger than the click-out threshold, the movement of the subject 140 may be recognized as an operation away from the image pickup unit 210 for the click, and the measurement of the click information may be terminated.

In addition, as described above, the object determining unit 239-1 may generate a function execution command corresponding to a specific position of a preset outline corresponding to the generated click information and output the generated command to the main controller (not shown). . That is, when the functions corresponding to the centers of gravity of the m-th outline and the k-th outline are different from each other, the object determining unit 239-1 may generate a function execution command corresponding to a specific position within the preset outline as described above. In addition, a function execution command corresponding to an error may be generated, and a function execution command corresponding to a user's selection may be generated.

At this time, in order to make it clear that the subject 140 is far from the image capturing unit 210, the subject determining unit 239-1 ends the measurement of the click information and the first slope information larger than the fourth threshold value is preset for a preset time. If not generated, the function execution command may be output to the main controller (not shown) (wherein l may be a natural number greater than k). That is, the subject determination unit 239-1 may start the atmospheric information measurement when the click information measurement is completed. The wait information may be a time when the first slope information larger than the fourth boundary value is not generated. In this case, the subject determining unit 239-1 may output a generated function execution command to the main controller (not shown) when the waiting time elapses from the preset time.

In the above, the method of detecting the single click operation of the subject 140 by the subject determiner 239-1 may be applied to the double click of the subject 140. For example, after the subject determining unit 239-1 detects the single click operation of the subject 140 by the method described above, the subject 140 clicks before the standby information becomes equal to the preset boundary information. When the motion is detected once more, the object determining unit 239-1 may detect the same as a double-click operation of the subject 140, generate a corresponding function execution command, and output the command to the main controller (not shown). In this case, each click operation of the double click operation of the subject 140 may be sensed by the same or similar method as described above.

4 is a flowchart illustrating an example of a method of detecting a subject click motion.

Hereinafter, an embodiment of a method of detecting a subject click motion will be described with reference to FIG. 4.

In operation S410, the imaging unit 210 captures an image including the subject 140 to generate first image data.

In operation S420, the sharpness controller 231 generates second image data by adjusting sharpness of the image of the photographed subject 140. Here, the sharpness control may vary according to the depth of the image. That is, as described above, in the case of the outline of the subject 140 positioned near the focal length of the lens unit 216, the sharpness may be greatly increased as compared to the background image.

In operation S430, the outline extractor 233 calculates a difference value between the generated first image data and the second image data, and the gamma correction unit 235 performs gamma correction on the calculated difference value, thereby providing luminance for the object outline. The value can be increased (step S440). Therefore, the outline of the image of the subject 140 photographed from the gamma-corrected difference value can be made clear. Here, the difference value is calculated for every pixel, and the following steps are performed individually for each pixel.

In operation S450, the outline extractor 233 checks whether a difference value between the first image data and the second image data is greater than a preset reference luminance value. When the difference value is larger than the preset reference luminance value, these pixels are extracted with an outline corresponding to one end of the subject. However, if the difference value is smaller than the preset reference luminance value, it is checked whether the difference value for the next pixel is larger than the preset reference luminance value. If the difference value for the pixels is smaller than the preset reference luminance value, the first step is performed. Return to the previous step can be repeated again. As described above, the reference luminance value may be set corresponding to the fixed or reference pixel number.

In operation S460, the outline extractor 233 extracts and stores an outline corresponding to one end of the subject 140 from a coordinate value in which a difference value between the first image data and the second image data is larger than a preset reference luminance value. Stored in the unit 240. The method of extracting the outline by checking whether the difference value between the first image data and the second image data is greater than the preset reference luminance value is described above, and the detailed description thereof will be omitted here. .

In operation S470, the center determination unit 237 calculates an image center point by using the outline of the photographed subject 140 and stores the image center point in the storage unit 240. That is, the above-described center of gravity may be obtained or the radius of curvature may be calculated from the extracted outline of the subject and the coordinate value of the center point corresponding to the radius of curvature may be extracted. Alternatively, the distance between each pixel representing the circular outline formed by the outline of the subject is calculated without separately calculating the radius of curvature, and the coordinate value of the current center point is obtained by using the median value of the two pixels having the largest calculated distance of each pixel. You can also extract In addition, the coordinate values of the current center point may be extracted by various preset methods.

In operation S480, the subject determiner 239-1 may determine the movement of the subject 140 using the extracted outline, generate a corresponding function execution command, and output the command to a main controller (not shown). A method of generating a function execution command in the subject determining unit 239-1 will be described later with reference to FIGS. 8 and 9. In addition, as described above, the pointer position setting unit 239 may control the pointer to be positioned to correspond to the coordinates of the center point using the calculated center point irrespective of step S480.

5 is a diagram illustrating an image generated by an embodiment of an apparatus for detecting a subject click motion for implementing the present invention.

Referring to FIG. 5, an original image 510, a sharpness-adjusted image 520, a gamma corrected image 530 with respect to a difference value, an extracted center point 540, and a circular outline 550 are illustrated.

One end of the user's finger, which is the subject 140, in the original image 510 has a round shape. Then, as the sharpness is adjusted according to the depth, the outline of the subject (user's finger) at a position similar to the focal length is increased as shown in the sharpened image 520, and the background that is not is relatively small. Thereafter, if the difference between the original image 510 and the sharpness-adjusted image 520 is obtained, and the gamma value is increased as a whole, only the outline of one end of the user's finger having high sharpness is visible in the gamma-corrected image 530. Therefore, the coordinate value of the center point described above can be extracted from the circular outline which is the outline of the subject, and the coordinate value of the center point from which the pointer of the display unit is extracted can be set.

6 is a diagram illustrating an image generated by an embodiment of an object click motion detection apparatus for implementing the present invention when the brightness of the background is large, and FIG. 7 illustrates an embodiment of the present invention when the brightness of the background is small. FIG. 3 is a diagram illustrating an image generated by an embodiment of an apparatus for detecting a subject click motion. Referring to FIG. 6 and 7, original images 610 and 710, sharpened images 620 and 120, gamma corrected images 630 and 730, extracted center points and circular outlines 640 and 740 are shown. do.

Referring to FIG. 6, the outline of the subject 140 may be extracted regardless of the brightness of the background. That is, when adjusting sharpness, not only the contour of the finger, which is the subject 140, but also a background light source formed in a straight line shape may be a problem. Appeared.

In addition, referring to FIG. 7, even when the subject 140, which is a finger, is lying down, the contour of the subject, which is a boundary value, may be extracted even when the object is not circular, that is, the outline is a semicircle. Therefore, according to an exemplary embodiment of the present invention, even if only one image frame is used, whether the subject 140 is moved or the coordinate value of the movement position may be obtained using the depth of the image.

8 is a flowchart illustrating a method of detecting a click motion of a subject according to an exemplary embodiment of the present invention.

Hereinafter, a method of detecting a click motion of a subject according to an exemplary embodiment of the present invention will be described with reference to FIG. 8. In this case, each step to be described below will be described under the assumption that the object determination unit 239-1 is performed. In addition, each step to be described below may be in a state where steps S410 to S470 described with reference to FIG. 4 are performed first.

In operation S810, the m th subject size information is calculated using the extracted m th outline. In this case, m may be a natural number.

In operation S820, the m th subject size is compared with a second preset threshold value. In this case, as described above, the second threshold value is a setting for more accurately detecting a click operation of the subject 140. As a result of the comparison, when the mth subject size information is smaller than the second boundary value, the m + 1th subject size information is calculated. In other words, the previous step is performed again. That is, in FIG. 8, the subject size information is sequentially calculated using the 'm = m + 1' block. In addition, 'k = m + 1' and 'k = k + 1' to be described later are expressions of the same meaning. Therefore, the description of the block will be omitted below.

However, when the m th subject size information is larger than the second threshold value, the click motion detection mode is started. In this case, the click motion detection mode is a mode for the subject determining unit 239-1 to detect the click operation of the subject 140, and means the full-scale click motion detection of the subject determining unit 239-1. In this case, when the m-th subject size information is the same as the second threshold value, the operation may be set in advance. That is, when the m-th subject size information is the same as the second threshold value, the click motion detection mode may be preset.

Here, comparing the second threshold value and the sequentially generated subject size information is a step for accurately detecting the click operation of the subject determining unit 239-1 and the subject 140 is surely close to the imaging unit 210. To check. Accordingly, steps S820 to S825, which are processes in which the subject 140 approaches the imaging unit 210 for the click operation, may be omitted to start the click motion detection mode.

In operation S830, the m-th subject size is compared with a preset first boundary value in the click motion detection mode. In this case, when the m th subject size information is smaller than the first threshold value, the m th +1 th subject size information is calculated. That is, the process is performed again from step S810. Of course, even when the k-th subject size information is the same as the first threshold, the m-th subject size information may be set to be calculated.

However, if the m-th subject size information is larger than the first threshold value, click information measurement is started (step S840). The measurement of the click information is to generate the click information t1 differently according to the time that the click operation of the subject 140 continues, and thereby the object determiner 239-1 generates a command to perform a function corresponding to the click information. .

In operation S850, the k th subject size information is calculated using the k th outline. In this case, the k th outline may be an outline of a subject sequentially extracted after the m th outline is extracted, and thus k may be a natural number greater than m (that is, k = m + 1).

In step S860, the k-th subject size information is compared with the first boundary value. In this case, when the k-th subject size information is larger than the first threshold value, the k + 1th subject size information is calculated.

However, when the k-th subject size information is equal to or less than the first threshold value, the measurement of the click information is terminated (step S870), and a command for performing a function corresponding to a specific position of a preset outline corresponding to the click information is generated to generate a main controller (shown in FIG. Is not displayed) (step S880). Of course, when the k-th subject size information is the same as the first threshold value, the k + 1th subject size information may be set to be calculated.

In this case, as described above, a function execution command may be output when a preset time elapses with the k-th subject size information smaller than the second threshold value, as described above, to detect the click operation of the subject 140. That is, the standby information, which is the time when the first object size information larger than the second threshold value is not generated, is calculated, and if the standby information is the same as the preset boundary information, a function execution command may be output. In this case, l may be a natural number larger than k, and the method of measuring atmospheric information and comparing with boundary information are described above, and thus a detailed description thereof will be omitted.

9 is a flowchart illustrating a method of detecting a click motion of a subject according to another exemplary embodiment of the present invention.

Hereinafter, a method of detecting a click motion of a subject according to an exemplary embodiment of the present invention will be described with reference to FIG. 9. In this case, each step to be described below will be described under the assumption that the object determination unit 239-1 is performed. In addition, each step to be described below may be in a state where steps S410 to S470 described with reference to FIG. 4 are performed first. In addition, as described above with reference to FIG. 8, m = m + 1 and k = k + 1 may mean that subject size information is sequentially calculated, and a description thereof will be omitted below.

In step S905, the m th subject size information is calculated using the extracted m th outline. In this case, m may be a natural number.

In operation S910, the m th slope information is calculated by using the m th subject size information and the m−1 th subject size information. In this case, the m th slope information may be calculated by Equation (7) described above.

In operation S920, the m th slope information is compared with a third threshold value previously set. As a result of the comparison, when the m th slope information is smaller than the third threshold value, the m + 1 th size information is calculated. In other words, step S905 is performed again. Of course, when the mth slope information is the same as the third boundary value, the m + 1th slope information may be calculated.

)가 생성된다(단계 S925). 클릭-인 정보는 정확한 클릭 동작 감지를 위한 것임은 상술한 바와 같다. On the other hand, if the m-th slope information is larger than the third threshold value, the click-in counter is operated so that the click-in information (

) Is generated (step S925). The click-in information is for accurate click motion detection as described above.

)이 비교된다. 비교 결과, 클릭-인 정보가 클릭-인 경계값 보다 작은 경우에는 다시 제m+1 피사체 크기 정보가 산출되어 제m+1 기울기 정보가 산출된다. In operation S930, the generated click-in information and the preset click-in threshold value (

) Is compared. As a result of the comparison, when the click-in information is smaller than the click-in threshold, the m + 1th object size information is calculated again, and the m + 1th slope information is calculated.

)가 클릭-인 경계값(

)과 동일한 경우에는 클릭 정보 측정이 개시된다(단계 S935). 이때, 클릭 정보 측정은 피사체(140)의 클릭 동작이 계속된 시간에 따라 클릭 정보가 상이하게 생성되어 클릭 정보에 상응하는 기능 수행 명령이 생성되도록 하기 위함이다. 상술한 예와 같이 클릭 정보에 측정된 시간에 따라 짧은 클릭, 긴 클릭 및 취소 클릭에 상응하는 기능 수향 명령이 생성될 수 있다. On the other hand, click-in information (

) Is a click-through threshold (

), Click information measurement is started (step S935). In this case, the click information measurement is to cause the click information to be generated differently according to the time for which the click operation of the subject 140 is continued to generate a function execution command corresponding to the click information. As described above, a function directing command corresponding to a short click, a long click, and a cancel click may be generated according to the time measured in the click information.

In operation S940, the k-th slope information is calculated by using the k-th subject size information and the k-th subject size information. In this case, k may be a natural number larger than m. The method of calculating the k-th slope information may be the same as the method of calculating the m-th slope information.

In step S945, the kth slope information is compared with a fourth threshold value preset. As a result, when the m th slope information is larger than the fourth threshold value, the k + 1 th size information is calculated to calculate the k + 1 th slope information. In other words, the process proceeds again from step S940. Of course, when the kth slope information is the same as the fourth boundary value, the k + 1th slope information may be calculated.

)가 생성된다(단계 S950). 클릭-인 정보도 정확한 클릭 동작 감지를 위한 것임은 상술한 바와 같다. On the other hand, if the k-th slope information is larger than the fourth threshold value, the click-out counter is operated so that the click-out information (

) Is generated (step S950). The click-in information is also for accurate click motion detection as described above.

)이 비교된다. 비교 결과, 클릭-아웃 정보가 클릭-아웃 경계값 보다 작은 경우에는 다시 제k+1 피사체 크기 정보가 산출되어 제k+1 기울기 정보가 산출된다. 즉, 단계 S940부터 다시 진행된다. In step S955, the generated click-out information and the preset click-out threshold value (

) Is compared. As a result of comparison, when the click-out information is smaller than the click-out threshold value, the k + 1th object size information is calculated again, and the k + 1th slope information is calculated. In other words, the process proceeds again from step S940.

On the other hand, if the click-out information is the same as the click-out threshold, the click information measurement is terminated (step S960).

In operation S970, a function execution command corresponding to a specific position of a preset outline corresponding to the click information is generated and output. At this time, when the click information specification is completed, the standby information measurement may be started, and the function execution command may be output when the standby information becomes the same as the preset boundary information. Since the method for measuring atmospheric information has been described above, a detailed description thereof will be omitted.

10 is a block diagram according to another embodiment of a subject click motion detection apparatus for implementing the present invention.

Referring to FIG. 10, the object click motion detecting apparatus 1000 according to the second exemplary embodiment of the present invention includes a filter unit 1012, a light source unit 1014, a lens unit 1016, and an image sensor unit 1018. The image processing unit 1030 and the storage unit 1040 including the imaging unit 1010, the subject extraction unit 1031, the center determination unit 1032, the pointer position setting unit 1034 and the subject determination unit 1036 It may include.

The operation of each component described above will be described below. However, the operations of the components of the image capturing unit 1010 and the storage unit 1040 except for the light source unit 1014 are described above, and thus detailed descriptions of these operations will be omitted.

The light source unit 1014 may output light having a specific wavelength, and the light is reflected from the subject and passes through the filter unit 1013 to emit light of another wavelength that may act as ambient noise. There is an effect that can be blocked. In particular, the light source unit 1014 may be turned on at a predetermined time interval under the control of the main controller (not shown). In this case, the image sensor unit 1018 captures the subject 140 while the light source unit 1014 outputs light, and outputs the shiny image data, and the subject 140 while the light source unit 1014 does not output the light. ), And generates matt image data, respectively, and outputs the image data to the image processor 1030.

In this case, the light source unit 1014 may be turned on at a predetermined time interval under the control of the main control unit (not shown), and the image sensor unit 1018 may be turned off immediately after generating the glossy image data. When activated, matt image data can be generated. In addition, the main controller (not shown) controls the overall operation of the electronic device (eg, a portable terminal, a laptop, etc.) including the object click motion detecting apparatus 1000 according to the third exemplary embodiment of the present invention. It may be a control unit. In addition, the light source unit 1014 may be controlled by an additional control unit (not shown) for controlling only the light source unit 1014 separately provided in the imaging unit 1010.

The subject extracting unit 1031 generates third image data by comparing the matte image data and the matte image data received from the imaging unit 1010. For example, the third image data may be data obtained by subtracting the luminance value of the matte image data corresponding to each pixel from the luminance value of the glossy image data. That is, since the gloss image data is image data captured while the light source unit 1014 is activated, the subject 140 photographed at a position close to the light source unit 1014 will have a high luminance value, and is captured at a position far from the light source unit 1014. The luminance value of the background part will be relatively small. In addition, since the matte image data is image data captured while the light source unit 1014 is inactivated, the luminance value of the subject 140 and the luminance value of the background portion will be smaller than those of the glossy image data.

In addition, since the background parts of the glossy image data and the matte image data are both located far from the light source unit 1014 and the subject, the difference in luminance value will be very small. Therefore, if the luminance value of the matte image data corresponding to each pixel is subtracted from the luminance value of the polished image data, the luminance value of the background portion except for the subject 140 will be almost 'zero'. Only the luminance value of the portion corresponding to 140 will be present. In this manner, the subject extracting unit 1031 may generate third image data obtained by extracting only the subject 140 from the captured image data.

The center determiner 1032 analyzes the third image data generated by the subject extractor 1031 to determine the center point (m center point) of the image of the subject 140 (hereinafter, Extract the &quot; reference pixel &quot; For example, it is assumed that the resolution of the image sensor unit 1018 is 640 * 480 (horizontal * vertical), and luminance values of each pixel are divided by 0 to 255. If the luminance value is '0', the brightness is '0', so it will be black, and if the luminance value is '255', it will be represented as white because it is the brightest case.

If the preset reference boundary value is '10, 000 'for extracting the reference pixel, the center determination unit 1032 may extract 10,000 reference pixels from the third image data in the order of the pixel having the highest luminance value. In this case, if the reference boundary value is too large, most pixels of the third image data will be extracted as the reference pixel, and if the reference boundary value is too small, only a portion of the third image data will be extracted as the reference pixel. In this case, the ratio of pixels (ie, noise pixels) to the background part irrelevant to the reference pixel other than the imaged image of the object 140 will be increased. That is, if the reference boundary value is too large or too small, the ratio of the noise pixels is high, so the center determination unit 1032 may have difficulty in determining the exact position of the photographed subject 140.

Therefore, the upper limit value and / or the lower limit value may be set so that the reference boundary value can ignore the ratio of the noise pixel. For example, assume that the reference boundary value is '10, 000 'and the lower limit value is' 50'. In this case, the center determination unit 1032 may extract 10,000 reference pixels in the order of the pixels having the highest luminance from only the pixels having the luminance greater than 50 in the third image data. That is, the center determination unit 1032 analyzes each pixel of the third image data and extracts 10,000 reference pixels in order of increasing luminance value, and among them, a pixel having a luminance value of less than 50 (or less) is selected from the reference pixel. Can be excluded.

In addition, since the subject 140 will generally be a user's finger, if the luminance value is too large, it is likely to correspond to a noise pixel. Therefore, assuming that the reference boundary value is '10, 000 'and the upper limit value is' 200', the center determination unit 1032 targets only pixels whose luminance value is less than (or less than) 200 in the third image data. The reference pixel can be extracted.

In addition, the reference boundary value may be a predetermined luminance value instead of the number of pixels having a large luminance value. That is, the center determiner 1032 may analyze the third image data and extract all pixels that exceed the reference boundary value as the reference pixels. For example, when the reference boundary value is set to '150', the center determination unit 1032 may extract all pixels whose luminance value exceeds '150' from the third image data as the reference pixel. In this case as well, as described above, if the reference boundary value is too large or too small, the ratio of the noise pixels in the reference pixel will be high, so it is obvious that the upper limit value and / or the lower limit value for the reference boundary value can be set.

In addition, the center determiner 1032 analyzes the reference pixel to determine a center point of the image of the subject 140 and stores the center point in the storage 1040. In this case, the center point may be the center of gravity of the subject 140. For example, the center of gravity, which is a specific coordinate located inside the subject 140, may be calculated by the following equation.

(8)

(8)

(9)

(9)

(10)

10

Here, R is the center of gravity, M is the sum of the luminance values of the reference pixels of the subject, mi is the luminance value of each reference pixel of the subject, and ri is the coordinate value of the reference pixel. The subscripts x and y indicate the values corresponding to the X and Y axes, respectively, and Equation (10) is a vector representation of Equations (8) and (9).

However, when the center determination unit 1032 determines the center point of the image of the subject 140 by the above-described equation, since the luminance values of the reference pixels must all be reflected, the calculation amount increases, and thus the subject click motion detection apparatus 1000 is performed. Problems may occur that degrade the overall functionality of. Therefore, the center point of the image of the subject 140 may be determined by the following equation.

(11)

(11)

(12)

(12)

(13)

(13)

Where R is the center of gravity, ri is the coordinate value of the reference pixel, and n is the number of reference pixels. The subscripts x and y represent the values corresponding to the X and Y axes, respectively, and Equation (13) is a vector representation of Equations (11) and (12).

That is, the center determiner 1032 may determine the center point of the image of the subject 140 without reflecting the luminance value of the reference pixel. Since the luminance value of each reference pixel will not have a large difference, the center determination unit 1032 may calculate the average value of the coordinate values of the reference pixel as the center point of the image of the subject 140 without reflecting it. For example, when the luminance value of the reference pixel is divided into '1' and the luminance value of the remaining pixels are divided into '0', the third image data displays the reference pixel (that is, the portion where the subject 140 is captured) in white. And the rest will be black. Therefore, the center of gravity of the reference pixel (that is, the object 140) displayed in white may be obtained without reflecting the luminance value of each pixel by the above equations (18 to 20).

In addition, when the outline of the reference pixel is curved, the center determination unit 1032 may calculate a radius of curvature and extract a coordinate value of a center point corresponding to the radius of curvature. The method for calculating this is described above with reference to FIG. 2A, and a detailed description thereof will be omitted herein.

The pointer position setting unit 1034 controls the pointer of the display unit (not shown) to be positioned at the calculated specific coordinates. That is, the position of the pointer is specified to a specific coordinate, for example, a coordinate value of a center point (for example, a center of gravity) of the object 140 image.

The subject determining unit 1036 corresponds to the movement of the subject 140 by using the reference pixel extracted by the subject extracting unit 1031 (hereinafter, referred to as 'm th reference pixel' (m is a natural number)). Generates a function execution command, and outputs it to the main controller (not shown).

In addition, the subject determining unit 1036 calculates m-th subject size information by using the m-th reference pixel. For example, the m-th subject size information may be information corresponding to the size of the m-th reference pixel. That is, when the subject 140 is the user's finger, the m-th reference pixel of the subject 140 image may be circular (or semi-circular). Therefore, the m-th subject size information may be information corresponding to the diameter (or radius) of the m-th reference pixel. In addition, the m-th subject size information may be information corresponding to the number of pixels existing in the figure of the m-th reference pixel. That is, when the m th reference pixel is a circular figure or a quadrangle (or triangle) figure, the m-th subject size information may be the number of pixels existing in the figure.

In addition, the subject determining unit 1036 detects a click operation of the subject 140 and generates a corresponding function execution command and outputs the command to a main controller (not shown). The operation of the subject determining unit 1036 is illustrated in FIG. The same or similar operation to that of the object determining unit 239-1 described above with reference to FIGS. 2A and 3 will not be described herein.

11 is a flowchart illustrating another method of detecting a subject click motion.

Hereinafter, another exemplary embodiment of a method for detecting a subject click operation will be described with reference to FIG. 11.

In operation S1110, the image sensor unit 1018 photographs the subject 140 while the light source unit 1014 is activated, that is, outputs light, generates glossy image data, and outputs the image data to the image processor 1030. do.

In operation S1120, the image sensor unit 1018 photographs the subject 140 while the light source unit 1014 is inactivated, that is, does not output light, generates matte image data, and outputs the image data to the image processor 1030.

In this case, the light source unit 1014 may be turned on at a predetermined time interval under the control of the main control unit (not shown), and the image sensor unit 1018 may be turned off immediately after generating the glossy image data. When activated, matt image data can be generated.

In operation S1130, the object extractor 1031 may generate third image data by comparing the matte image data and the matte image data received from the imaging unit 1010.

In operation S1140, the center determiner 1032 analyzes the third image data generated by the subject extractor 1031 to determine the center point of the image of the subject 140 (hereinafter, ' Reference pixel ').

In operation S1150, the center determination unit 1032 extracts coordinate values of the reference pixel, and in operation S1160, the center determination unit 1032 calculates a center point of the image of the subject 140.

Here, the method of generating the third image data and the method of calculating the center point of the image of the subject 140 have been described above with reference to FIG. 10, and a detailed description thereof will be omitted herein.

In operation S1170, a command for performing a function is detected by detecting a click operation of the subject 140 and output to a main controller (not shown). That is, the movement of the subject 140 is determined using the extracted reference pixel, and a corresponding function execution command is generated and output to the main controller (not shown). Here, the step of generating the function execution command may be the same as or similar to each step described above with reference to FIGS. 8 and 9. 8 and 9, the m th subject size information is calculated using the m th outline information, but may be calculated using the m th reference pixel.

Preferred embodiments of the present invention described above are disclosed for purposes of illustration, and those skilled in the art will be able to make various modifications, changes, and additions within the spirit and scope of the present invention. Additions should be considered to be within the scope of the following claims.

As described above, the method and the apparatus for controlling the pointer movement according to the present invention have the effect of controlling the pointer on the display by extracting the movement of the subject regardless of the brightness around the subject.

In addition, the pointer movement control method and apparatus according to the present invention has an effect that does not require a separate light source to illuminate the subject in order to extract the movement of the subject.

In addition, the pointer movement control method and the apparatus according to the present invention has the effect of controlling the pointer on the display using the camera imaging device.

In addition, the pointer movement control method and apparatus according to the present invention can omit a part of an existing keypad, thereby increasing spatial utilization of the electronic device, and miniaturizing the electronic device.

In addition, the pointer movement control method and apparatus according to the present invention has the effect of simplifying the manufacturing process and manufacturing cost of the electronic device.

In addition, the pointer movement control method and apparatus according to the present invention has the effect of maximizing component utilization by making it possible to universally use the provided camera.

In addition, the pointer movement control method and apparatus according to the present invention can provide an object click motion detection device and method that can adjust the position of the object click motion detection device according to a user's use environment.

Although the above has been described with reference to a preferred embodiment of the present invention, those of ordinary skill in the art to the present invention without departing from the spirit and scope of the present invention and equivalents thereof described in the claims below It will be understood that various modifications and changes can be made.

Claims (43)

(a) photographing a subject to generate first image data; (b) generating second image data by adjusting the sharpness of the first image data; (c) extracting an m-th outline corresponding to one end of the subject by extracting a difference value between the first image data and the second image data; (d) calculating m-th subject size information from the m-th outline and comparing the m-th subject size information with a first threshold value; (e) calculating k-th subject size information from a k-th outline corresponding to one end of the subject and comparing it with the first boundary value; And (f) performing a function corresponding to a specific position within a preset outline corresponding to a result of comparing the m-th subject size information with the first threshold and a result of comparing the k-th subject size information with the first threshold; Generating and outputting the command, M is a natural number, and k is a natural number greater than m. The method of claim 1, Starting click information measurement when the m-th subject size information is larger than the first threshold; If the k-th subject size information is smaller than the first threshold value, the method may further include terminating click information measurement. The function performing command is generated in response to a specific position in the preset outline and the click information. The method of claim 2, Starting measurement of atmospheric information when the k-th subject size information is smaller than the first threshold value; And if the waiting information passes a preset boundary time, outputting a command to perform a function. The method of claim 2, Calculating first object size information and comparing the first object size information with a second threshold value; And l is a natural number greater than k, and the command to perform a function is output when the first subject size information is smaller than the second boundary value. The method of claim 4, wherein Starting to measure atmospheric information when the first subject size information is smaller than the second threshold; And performing a function command when the waiting information passes a preset boundary time. The method of claim 1, Step (f) is, Generating and outputting a function execution command corresponding to a specific position within the preset outline when the m-th subject size information is larger than the first threshold value and the k-th subject size information is smaller than the first threshold value; The method of detecting a subject click operation, characterized in that. (a) photographing a subject to generate first image data; (b) generating second image data by adjusting the sharpness of the first image data; (c) extracting an m-th outline corresponding to one end of the subject by extracting a difference value between the first image data and the second image data; calculating m-th slope information by using m-th subject size information corresponding to the m-th outline; (e) comparing the m-th slope information with a third threshold value preset; calculating kth slope information by using kth subject size information corresponding to a kth outline extracted from one end of the subject; (g) comparing the kth slope information with the fourth threshold value; and (h) a command to perform a function corresponding to a specific position within a preset outline corresponding to a result of comparing the m th slope information with the third boundary value and a result of comparing the k th slope information with the third boundary value; Generating and outputting M is a natural number, and k is a natural number greater than m. The method of claim 7, wherein If the m-th slope information is larger than the third threshold value, the method may further include generating click-in information and comparing it with a preset click-in threshold value. And if the click-in information is the same as the click-in threshold value, calculating the k-th tilt information. The method of claim 7, wherein If the k-th slope information is smaller than the fourth threshold value, the method may further include generating click-out information and comparing it with a preset click-out threshold value. And generating the function execution command if the click-out information is the same as the click-out threshold. The method of claim 7, wherein Initiating click information measurement when the m th slope information is larger than the third threshold value; If the k-th subject size information is smaller than the fourth threshold value, the method may further include terminating click information measurement. The function performing command is generated in response to a specific position in the preset outline and the click information. The method of claim 7, wherein Step (h) is, Generating and outputting a function execution command corresponding to a specific position within the preset outline when the m th slope information is larger than the third boundary value and the k th slope information is smaller than the fourth boundary value. How to detect the subject click operation. An imaging unit which sequentially photographs a subject to generate first image data; A sharpness controller configured to sequentially generate second image data by adjusting the sharpness of the first image data captured by the image pickup unit; An outline extracting unit configured to sequentially extract an outline corresponding to one end of the subject by generating a difference value between the first image data and the second image data that are sequentially input; The m-th subject size information calculated using the m-th outline is compared with the first threshold value preset, and the k-th subject size information calculated using the k-th outline is compared with the second preset threshold value, thereby pre-setting the outline. Including a subject determination unit for generating and outputting a command to perform a function corresponding to a specific position within, M is a natural number, and k is a natural number greater than m. The method of claim 12, The subject determining unit starts the click information measurement only when the m-th subject size information is larger than the first threshold value, and when the k-th subject size information is smaller than the first threshold value, ends the click information measurement. And the subject determining unit generates the command to perform the function corresponding to a specific position in the preset outline and the click information. The method of claim 13, The subject determining unit starts measuring atmospheric information when the k-th subject size information is smaller than the first threshold value. And outputting the command to perform a function when the waiting information passes a preset boundary time. The method of claim 13, The subject determining unit calculates first subject size information and compares it with a second preset threshold value, and outputs the command to perform the function when the first subject size information is smaller than the second threshold value. And l is a natural number greater than k. The method of claim 15, The subject determining unit starts measurement of atmospheric information only when the first subject size information is smaller than the second threshold value. And outputting the command to perform a function when the waiting information passes a preset boundary time. The method of claim 12, If the first subject size information is greater than the first threshold value and the second subject size information is less than the second threshold value, the subject determining unit generates and outputs a function execution command corresponding to a specific position in the preset outline. The object click motion detection device, characterized in that. An imaging unit which sequentially photographs a subject to generate first image data; A sharpness controller configured to sequentially generate second image data by adjusting the sharpness of the first image data captured by the image pickup unit; An outline extracting unit configured to sequentially extract an outline corresponding to one end of the subject by generating a difference value between the first image data and the second image data that are sequentially input; The m-th slope information calculated using the m-th subject size information corresponding to the m-th outline is compared with the third threshold value preset, and the k-th slope calculated using the k-th subject size information corresponding to the k-th outline And a subject determination unit configured to generate and output a function execution command corresponding to a specific position within a preset outline by comparing the information with a fourth threshold value. M is a natural number, and k is a natural number greater than m. The method of claim 18, If the m-th slope information is greater than the third threshold value, the subject determining unit generates click-in information and compares it with a preset click-in threshold value. And the k-th tilt information is calculated when the click-in information is the same as the click-in threshold. The method of claim 18, If the k-th slope information is smaller than the fourth threshold value, the subject determining unit generates click-out information and compares the preset click-out threshold value with And generating the function execution command if the click-out information is the same as the click-out threshold. The method of claim 18, If the m-th inclination information is larger than the third threshold value, the subject determining unit starts clicking information measurement, and if the k-th subject size information is smaller than the third threshold value, the click information measurement is terminated. And generating the function performing command corresponding to a specific position in the m-th outline and the click information. The method of claim 18, If the m-th slope information is greater than the third threshold value and the k-th slope information is smaller than the fourth threshold value, the subject determining unit generates and outputs a function execution command corresponding to a specific position within the preset outline. The object click motion detection device, characterized in that. (a) photographing a subject while the light source unit is activated to generate the glossy image data; (b) photographing the subject while the light source unit is inactivated to generate matt image data; (c) generating third image data by comparing the glossy image data with the matte image data; (d) calculating m-th subject size information by analyzing the third image data; (e) comparing the m-th subject size information with a preset first threshold value; (f) calculating k-th subject size information and comparing it with the first boundary value; And (g) performing a function corresponding to a specific position within a preset outline corresponding to a result of comparing the m-th subject size information with the first threshold and a result of comparing the k-th subject size information with the first threshold; Generating and outputting the command, M is a natural number, and k is a natural number greater than m. The method of claim 23, wherein Starting click information measurement when the m-th subject size information is larger than the first threshold; If the k-th subject size information is smaller than the first threshold value, the method may further include terminating click information measurement. The function performing command is generated in response to a specific position in the preset outline and the click information. The method of claim 24, Starting to measure atmospheric information only when the k-th subject size information is smaller than the first threshold value; And the function performing command is output only when the waiting information passes a preset boundary time. The method of claim 24, Calculating first object size information and comparing the first object size information with a second preset threshold value; And l is a natural number greater than k, and the command to perform a function is output only when the first subject size information is smaller than the second threshold. The method of claim 26, Starting to measure atmospheric information only when the first subject size information is smaller than the second threshold; And the function performing command is output only when the waiting information passes a preset boundary time. (a) photographing a subject while the light source unit is activated to generate the glossy image data; (b) photographing the subject while the light source unit is inactivated to generate matt image data; (c) generating third image data by comparing the glossy image data with the matte image data; (d) calculating m-th subject size information by analyzing the third image data; (e) comparing m-th slope information calculated using the m-th subject size information with a third threshold value preset; calculating kth tilt information by calculating kth subject size information; (g) comparing the k-th slope information with a preset fourth threshold value; and (h) a command to perform a function corresponding to a specific position within a preset outline corresponding to a result of comparing the m-th slope information with the third boundary value and a result of comparing the k-th slope information with the fourth boundary value; Generating and outputting M is a natural number, and k is a natural number greater than m. The method of claim 28, If the m-th slope information is larger than the third threshold value, the method may further include generating click-in information and comparing it with a preset click-in threshold value. And the k-th tilt information is calculated if the click-in information is equal to the click-in threshold. The method of claim 28, If the k-th slope information is less than the fourth threshold value, the method may further include generating click-out information and comparing the preset click-out threshold value. And generating the function execution command only when the click-out information is the same as the click-out threshold. The method of claim 28, Initiating click information measurement when the m th slope information is larger than the third threshold value; If the k-th subject size information is smaller than the fourth threshold value, the method may further include terminating click information measurement. The function performing command is generated in response to a specific position in the preset outline and the click information. The method of claim 28, Step (h) is, Generating and outputting a function execution command corresponding to a specific position within the preset outline when the m th slope information is greater than the third boundary value and the k th slope information is smaller than the fourth boundary value. To detect the subject click operation. A light source unit which is turned on at a predetermined time interval; An image sensor unit for photographing a subject while the light source unit is activated to generate glossy image data, and generating matte image data by photographing the subject while the light source unit is deactivated; A subject extractor configured to generate third image data by comparing the polished image data and the matte image data; The m-th subject size information calculated by analyzing the third image data is compared with a preset first threshold value, and the k-th subject size information is calculated and compared with the first threshold value to correspond to a specific position within a preset outline. It includes a subject determination unit for generating and outputting a command to perform the function, M is a natural number, and k is a natural number greater than m. The method of claim 33, wherein The subject determining unit starts the click information measurement when the m-th subject size information is larger than the first threshold value, and terminates the click information measurement when the k-th subject size information is smaller than the first threshold value. And the function performing command is generated according to a specific position in the preset outline and the click information. The method of claim 34, wherein The subject determining unit starts measuring atmospheric information only when the k-th subject size information is smaller than the first threshold value. And outputting the command to perform a function when the waiting information passes a preset boundary time. The method of claim 34, wherein The subject determining unit calculates first subject size information and compares the first subject size information with a second preset threshold value, And l is a natural number greater than k, and the command to perform a function is output when the first subject size information is smaller than the second threshold value. The method of claim 36, The subject determining unit starts measurement of atmospheric information only when the first subject size information is smaller than the second threshold value. And outputting the command to perform a function when the waiting information passes a preset boundary time. The method of claim 33, wherein If the m-th subject size information is larger than the first threshold value and the k-th subject size information is smaller than the first threshold value, the subject determining unit generates a function execution command corresponding to a specific position in the preset outline. The subject click motion detection device, characterized in that output. A light source unit which is turned on at a predetermined time interval; An image sensor unit for photographing a subject while the light source unit is activated to generate glossy image data, and generating matte image data by photographing the subject while the light source unit is deactivated; A subject extractor configured to generate third image data by comparing the polished image data and the matte image data; By analyzing the third image data, the subject size information is sequentially calculated, and the m-th slope information calculated using the m-th subject size information is compared with a third threshold value previously set, and the k-th subject size information is used. And a subject determination unit configured to compare the calculated k-th slope information with a fourth threshold value and generate and output a function execution command corresponding to a specific position within a preset outline. M is a natural number, k is a natural click object detection device, characterized in that greater than the m The method of claim 39, If the m-th slope information is greater than the third threshold value, the subject determining unit generates click-in information and compares it with a preset click-in threshold value. And the k-th tilt information is calculated when the click-in information is the same as the click-in threshold. The method of claim 39, If the k-th slope information is smaller than the fourth threshold value, the subject determining unit generates click-out information and compares the preset click-out threshold value with And generating the function execution command only when the click-out information is the same as the click-out threshold. The method of claim 39, If the m-th slope information is larger than the third threshold value, the subject determining unit starts clicking information measurement, and if the k-th subject size information is smaller than the fourth threshold value, ends the click information measurement. And generating the function performing command according to a specific position in the preset outline and the click information. The method of claim 39, If the m-th slope information is greater than the third threshold value and the k-th slope information is smaller than the fourth threshold value, the subject determining unit generates and outputs a function execution command corresponding to a specific position within the preset outline. The object click motion detection device, characterized in that.

Images