KR100864288B1 - Mouse for sensing moving of subject and Method thereof - Google Patents

Abstract

The present invention relates to a mouse and a method for detecting a movement of a subject, and more particularly, to a mouse and a method for detecting a movement of a subject using an imaging unit. According to an embodiment of the present invention, the image pickup unit for photographing the subject; A subject extracting unit configured to generate subject image data by using image data captured by the subject; A center point determination unit configured to analyze the subject image data and calculate an m th center point of the subject image in which the subject is captured; And a pointer position setting unit configured to generate and output a pointer movement command for positioning the pointer at a position corresponding to the m th center point, wherein m is a natural number. According to the present invention, there is an effect that can control the pointer by detecting the movement of the subject.

Subject, Pointer, Gamma Correction, Mouse

Description

Subject movement detection Mouse and subject movement detection method

1A is a diagram illustrating a case in which a subject motion detection mouse is connected to a notebook computer according to an exemplary embodiment of the present invention.

1B is a view illustrating an image capturing unit of a subject motion detecting mouse according to an embodiment of the present invention.

1C is a diagram illustrating a subject motion detecting mouse according to another embodiment of the present invention.

Figure 2 is a block diagram of a subject motion detection mouse according to an embodiment of the present invention.

3 is a diagram of subject image data and pointer movement generated by the present invention;

4 is a diagram illustrating a method of detecting a click motion of a subject according to the present invention.

5 is a diagram illustrating a display unit of an electronic device to which a subject motion detecting mouse is connected according to the present invention;

FIG. 6 is a diagram illustrating a method of distinguishing regions of subject image data and a movement of a plurality of center points generated by the present invention; FIG.

FIG. 7A illustrates an embodiment of an mth reference pixel region and a contact identification region captured by the present invention; FIG.

FIG. 7B illustrates another embodiment of the m th reference pixel region and the contact identification region captured by the present invention; FIG.

8 is a flowchart according to an embodiment of a method for detecting a subject motion according to the present invention.

9 is a flowchart illustrating a method of detecting a subject motion according to an embodiment of the present invention.

10 is a flowchart illustrating a method of detecting a subject motion according to another embodiment of the present invention.

11 is a flowchart illustrating a method of detecting a subject motion according to another embodiment of the present invention.

12 is a block diagram of a subject motion detection mouse according to another embodiment of the present invention.

FIG. 13 illustrates a method for setting a reference luminance value used in a subject motion detecting mouse according to another embodiment of the present invention. FIG.

14 is a flowchart illustrating a method of detecting a subject motion according to another embodiment of the present invention.

FIG. 15 illustrates an image generated by a subject motion detecting mouse according to another embodiment of the present invention. FIG.

FIG. 16 illustrates an image generated by a subject motion detecting mouse according to another exemplary embodiment of the present invention when the brightness of the background is large.

FIG. 17 illustrates an image generated by a mouse movement detecting mouse according to another embodiment of the present invention when the brightness of the background is small;

<Explanation of symbols for main parts of the drawings>

210: imaging unit

212: filter section

214: light source

216: lens unit

218: image sensor unit

230: image processing unit

231: subject extraction unit

232: center judgment unit

234: pointer position setting unit

236: subject determination unit

240: storage unit

The present invention relates to a mouse and a method for detecting a movement of a subject, and more particularly, to a mouse and a method for detecting a movement of a subject using an imaging unit.

With the rapid development of current electronics and telecommunications engineering, the user has a portable computer or mobile communication terminal equipped with an imaging unit (e.g., a digital camera module, etc.), a sound source playback unit (e.g., an MP3 file playback module, etc.). It can enjoy various functions such as internet access, video communication and video message transmission, digital music listening and satellite broadcasting. In order to enjoy these various functions, efficient key input for selecting various functions has been desired.

 However, in the conventional electronic device, a user performs various key inputs (for example, a file play button, a file select button, a volume control button, etc.) using a keypad and / or a mouse. However, in the case of an optical mouse using an optical sensor, there is a problem that cannot be used on a transparent table (glass or plastic), and in the case of a ball mouse using a ball movement, a problem that is inadequate to be portable depending on the size of the ball. there was. In addition, the mouse has a problem that its use is not suitable in a narrow space.

Accordingly, an object of the present invention is to provide a mouse and a method for detecting a subject's motion, through which various key inputs can be made using a mouse having an imaging unit.

In addition, the present invention can omit a part of the key button of the existing mouse to increase the spatial utilization of the mouse, and to provide a subject motion detection mouse and a method capable of miniaturizing the mouse.

Another object of the present invention is to provide a mouse and a method for detecting a subject motion, which can simplify the manufacturing process and reduce the manufacturing cost of the mouse by omitting key buttons of the mouse.

In addition, the present invention is to provide a subject motion detection mouse and method that can be used on a transparent plate and can be used in a narrow space.

Technical problems other than the present invention will be easily understood through the following description.

According to an embodiment of the present invention for solving the above problems, a method of detecting a movement of a subject by a subject movement sensing mouse, the method comprising: photographing the subject to generate subject image data; Calculating the m th center point of the subject image photographed from the subject by analyzing the subject image data; And generating and outputting a pointer movement command for positioning the pointer at a position corresponding to the m th center point, wherein m is a natural number.

The generating of the subject image data may include: generating gloss image data by capturing the subject while the light source unit of the subject movement detecting mouse is activated; Photographing the subject while the light source unit is inactivated to generate matt image data; And generating subject image data by comparing the glossy image data with the matte image data.

In addition, the m-th center point is a subject movement detection method, characterized in that the subject is the center of gravity of the subject image captured in the subject image data.

In addition, the center of gravity may be generated by the following equation.

Where R is the center of gravity, ri is the coordinate value of the reference pixel, and n is the number of reference pixels.

The generating of the subject image data may include: photographing the subject to generate first image data; And generating subject image data by adjusting the sharpness of the first image data.

The calculating of the m th center point may include extracting a difference value between the first image data and the subject image data and extracting an m-th outline for generating subject image data, which is an outline corresponding to one end of the subject. ; And calculating an m-th center point corresponding to one end of the m-th outline.

According to another exemplary embodiment of the present invention, a method of detecting a movement of a subject by a mouse, the method comprising: photographing the subject to generate subject image data; Calculating m-th subject size information by analyzing the subject image data; Comparing the m-th subject size information with a preset first threshold value; After calculating the m-th subject size information, calculating k-th subject size information corresponding to the photographed subject and comparing the m-th subject size information with the first boundary value; And generating and outputting a click function execution command corresponding to a result of comparing the m th subject size information with the first threshold and a result of comparing the k th subject size information with the first threshold. And m is a natural number, and k is a natural number greater than m.

The generating of the subject image data may include: generating a glossy image data by photographing the subject while the light source unit of the subject movement detecting mouse is activated; Photographing the subject while the light source unit is inactivated to generate matt image data; And generating subject image data by comparing the glossy image data with the matte image data.

The generating and outputting of the click function execution command may include performing the click function when the m-th subject size information is larger than the first threshold value and the k-th subject size information is smaller than the first threshold value. You can create a command.

The subject motion detecting method may further include calculating the first subject size information after comparing the k th subject size information with a second threshold value, wherein l is a natural number greater than k. The command to execute the click function may be output when the first subject size information is smaller than the second boundary value.

The method for detecting movement of a subject may further include starting measurement of atmospheric information when the first subject size information is smaller than the second threshold, and when the atmospheric information passes a preset boundary time. Click function execution command can be output.

The generating of the subject image data may include: photographing the subject to generate first image data; And generating subject image data by adjusting the sharpness of the first image data.

The calculating of the m th center point may include extracting an m-th outline corresponding to one end of the subject by extracting a difference value between the first image data and the subject image data; And calculating the m-th subject size information by analyzing the m-th outline.

According to another embodiment of the present invention to solve the above problems, a method of detecting a movement of a subject by a subject motion detection mouse, comprising: photographing the subject to generate subject image data; Calculating m-th subject size information by analyzing the subject image data; Comparing the m-th subject size information with a preset reference pixel boundary value; And generating reference subject size information when a command for generating a reference subject size information is input, wherein m is a natural number, and the reference subject is obtained using a result of comparing the m-th subject size information with the reference pixel boundary value. A subject motion detection method is provided which generates size information.

The generating of the subject image data may include: generating a glossy image data by photographing the subject while the light source unit of the subject movement detecting mouse is activated; Photographing the subject while the light source unit is inactivated to generate matt image data; And generating subject image data by comparing the glossy image data with the matte image data.

The object movement detecting method may further include calculating k-th subject size information corresponding to the photographed subject and comparing it with the reference subject size information; And generating and outputting a pointer size change command corresponding to a result of comparing the k-th subject size information with the reference subject size information, wherein k may be a natural number greater than m.

The reference pixel boundary value may be a first reference pixel boundary value, and the subject motion detecting method may further include generating and outputting an error command if the m-th subject size information is smaller than the first reference pixel boundary value. It may further include.

The reference pixel boundary value may be a second reference pixel boundary value, and the subject motion detecting method may further include generating and outputting an error command if the m-th subject size information is larger than the second reference pixel boundary value. It may further include.

The generating of the subject image data may include: photographing the subject to generate first image data; And generating subject image data by adjusting the sharpness of the first image data.

The calculating of the m th center point may include extracting an m-th outline corresponding to one end of the subject by extracting a difference value between the first image data and the subject image data; And calculating the m-th subject size information by analyzing the m-th outline.

According to another embodiment of the present invention to solve the above problems, a method of detecting a movement of a subject by a subject motion detection mouse, comprising: photographing the subject to generate subject image data; Analyzing the subject image data to calculate an m th center point of the image photographed from the subject; Extracting m-th region information corresponding to the m-th center point by using the m-th center point; Generating m-th center point shift information by using the m-th region information and one or more region information extracted before the m-th region information is extracted; And generating and outputting a linear function execution command corresponding to the m th center point movement information, wherein m is a natural number of two or more.

The generating of the subject image data may include: generating a glossy image data by photographing the subject while the light source unit of the subject movement detecting mouse is activated; Photographing the subject while the light source unit is inactivated to generate matt image data; And generating subject image data by comparing the glossy image data with the matte image data.

The generating of the m-th center point movement information may include: comparing the m-th region information and the m-1 region information extracted immediately before the m-th region information is extracted; And generating the m-th center movement information when the m-th region information and the m-th region information are different from each other.

In addition, the m th center point movement information may include the m th center point movement direction information.

In addition, the m th center point movement information may include the m th center point movement distance information.

The subject motion detecting method may further include extracting an m-th reference pixel region in which the subject is photographed by analyzing the subject image data; And comparing the m-th reference pixel region with a plurality of preset contact identification regions, when the m-th reference pixel region includes more than a preset number of the plurality of contact identification regions. You can create a command.

The calculating of the m th center point may include: imaging the subject to generate first image data; And generating subject image data by adjusting the sharpness of the first image data.

The calculating of the m th center point may include extracting an m-th outline corresponding to one end of the subject by extracting a difference value between the first image data and the subject image data; And calculating the m-th subject size information by analyzing the m-th outline.

According to another embodiment of the present invention for solving the above problems, the image pickup unit for photographing the subject; A subject extracting unit configured to generate subject image data by using image data photographed by the subject; A center point determination unit configured to analyze the subject image data and calculate an m th center point of the subject image in which the subject is captured; And a pointer position setting unit for generating and outputting a pointer movement command for positioning the pointer at a position corresponding to the m th center point, wherein m is a natural number.

The imaging unit may include a light source unit which is turned on at a predetermined time interval; And an image sensor unit configured to photograph the subject while the light source unit is activated to generate the glossy image data, and to generate the matte image data by photographing the subject while the light source unit is inactivated. The image data of the subject may be generated by comparing the image data with the matte image data.

The m th center point may be a center of gravity of a subject image captured by the subject in the subject image data.

In addition, the center of gravity may be generated by the following equation.

Where R is the center of gravity, ri is the coordinate value of the reference pixel, and n is the number of reference pixels.

The imaging unit may be located at an upper end of the subject movement detecting mouse.

The image capturing unit may capture the first image data, and the subject extracting unit may adjust the sharpness of the first image data to sequentially generate the subject image data, and the sharpness adjusting unit of the first image data and the subject image data. The apparatus may include an outline extracting unit configured to generate a difference value to extract an m-th outline corresponding to one end of the subject, and the center point determiner may calculate an m-th center point corresponding to one end of the m-th outline.

The imaging unit may be located at an upper end of the subject detecting mouse.

According to another embodiment of the present invention for solving the above problems, the image pickup unit for photographing the subject; A subject extracting unit configured to generate subject image data by using image data photographed by the subject; And comparing the m-th subject size information calculated by analyzing the subject image data with a preset first threshold value, calculating the m-th subject size information, and calculating k-th subject size information corresponding to the photographed subject. And a subject determining unit configured to generate and output a corresponding click function execution command in comparison with the first threshold value, wherein m is a natural number and k is a natural number greater than m.

The imaging unit may include a light source unit which is turned on at a predetermined time interval; And an image sensor unit configured to photograph the subject while the light source unit is activated to generate the glossy image data, and to generate the matte image data by photographing the subject while the light source unit is inactivated. The image data of the subject may be generated by comparing the image data with the matte image data.

The subject determining unit may generate the click function execution command when the m-th subject size information is larger than the first threshold and the k-th subject size information is smaller than the first threshold.

In addition, the subject determining unit calculates the k-th subject size information and then calculates the first subject size information and compares it with a second preset threshold value, where l is a natural number greater than k and the first subject size information. When is smaller than the second threshold value, the click function execution command may be output.

The subject determining unit may start measurement of atmospheric information when the first subject size information is smaller than the second threshold, and output the click function execution command when the standby information passes a preset boundary time. Can be.

The imaging unit may be located at an upper end of the subject movement detecting mouse.

The image capturing unit may capture the first image data, and the subject extracting unit may adjust the sharpness of the first image data to sequentially generate the subject image data, and the sharpness adjusting unit of the first image data and the subject image data. And generating an difference value to extract an m-th outline corresponding to one end of the subject, wherein the subject determiner may calculate the m-th subject size information corresponding to the m-th outline.

The imaging unit may be located at an upper end of the subject detecting mouse.

According to another embodiment of the present invention for solving the above problems, the image pickup unit for photographing the subject; A subject extracting unit configured to generate subject image data by using image data photographed by the subject; And calculating the m-th subject size information by analyzing the subject image data, comparing the m-th subject size information with a preset reference pixel boundary value, and generating reference subject size information when a command to generate reference subject size information is input. And a subject determining unit, wherein m is a natural number, and the subject determining unit generates the reference subject size information using a result of comparing the m-th subject size information with the reference pixel boundary value. A mouse is provided.

The imaging unit may include a light source unit which is turned on at a predetermined time interval; And an image sensor unit configured to photograph the subject while the light source unit is activated to generate the glossy image data, and to generate the matte image data by photographing the subject while the light source unit is inactivated. The image data of the subject may be generated by comparing the image data with the matte image data.

The subject determining unit may generate and output a pointer size change command corresponding to a result of comparing the k-th subject size information corresponding to the photographed subject and the reference subject size information, wherein k may be a natural number greater than m. have.

The reference pixel boundary value may be a first reference pixel boundary value, and the subject determining unit may generate and output an error command when the m-th subject size information is smaller than the first reference pixel boundary value.

The reference pixel boundary value may be a second reference pixel boundary value, and the subject determining unit may generate and output an error command when the m-th subject size information is larger than the second reference pixel boundary value.

The imaging unit may be located at an upper end of the subject detecting mouse.

The image capturing unit may capture the first image data, and the subject extracting unit may adjust the sharpness of the first image data to sequentially generate the subject image data, and the sharpness adjusting unit of the first image data and the subject image data. And generating an difference value to extract an m-th outline corresponding to one end of the subject, wherein the subject determiner may calculate the m-th subject size information corresponding to the m-th outline.

The imaging unit may be located at an upper end of the subject detecting mouse.

According to another embodiment of the present invention for solving the above problems, the image pickup unit for photographing the subject; A subject extracting unit configured to generate subject image data by using image data photographed by the subject; A center point determination unit configured to analyze the subject image data and calculate an m th center point of the photographed subject image; And extracting m-th area information corresponding to the m-th center point by using the m-th center point, and using the m-th center point by using the m-th area information and one or more area information extracted before the m-th area information is extracted. And a subject determining unit generating movement information and generating and outputting a linear function execution command corresponding to the m th center point movement information, wherein m may be a natural number of two or more.

The imaging unit may include a light source unit which is turned on at a predetermined time interval; And an image sensor unit configured to photograph the subject while the light source unit is activated to generate the glossy image data, and to generate the matte image data by photographing the subject while the light source unit is inactivated. The subject image data may be generated by comparing the glossy image data with the matte image data.

The object determining unit may generate the m th center point movement information by comparing the m th region information and the m th region information extracted immediately before the m th region information is extracted, and the m th region information and the m th region information. When the m-th region information is different, the m-th center point movement information may be generated.

In addition, the m th center point movement information may include the m th center point movement direction information.

In addition, the m th center point movement information may include the m th center point movement distance information.

The imaging unit may be located at an upper end of the subject movement detecting mouse.

The image capturing unit may capture the first image data, and the subject extracting unit may adjust the sharpness of the first image data to sequentially generate the subject image data, and the sharpness adjusting unit of the first image data and the subject image data. The apparatus may include an outline extracting unit configured to generate a difference value to extract an m-th outline corresponding to one end of the subject, and the center point determiner may calculate an m-th center point corresponding to one end of the m-th outline.

The imaging unit may be located at an upper end of the subject detecting mouse.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In the following description of the present invention, if it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

1A is a diagram illustrating a case in which a subject movement detecting mouse is connected to a notebook computer according to an exemplary embodiment of the present invention. Here, the subject movement detecting mouse 100 according to the present invention may be connected to an electronic device by wire or wirelessly, and in particular, may be connected to a small and movable device such as a notebook computer or a PMP. The case centered on the case will be described.

Referring to FIG. 1A, the object movement detecting mouse 100 may include an image sensor unit 110, light source units 120-1, 120-2, 120-3, and 120-4 (hereinafter, collectively referred to as '120'), A subject (eg, a finger of the user of the mobile communication terminal 100) 140 for movement extraction is shown. Also, a notebook computer 130, a display unit 150, and a keypad unit 135 of the notebook computer 130 connected to the subject movement detecting mouse 100 by wire are shown. At this time, it is obvious that the subject movement detecting mouse 100 may be wirelessly connected to the notebook computer 130 or the like.

The light source unit 120 is a device for irradiating a predetermined light onto the subject 140, and the light emitted from the light source unit 120 is reflected from the subject 140 to be incident on the image sensor unit 110. The number and location of the may be determined. For example, the light source unit 120 may be formed around the image sensor unit 110, and the number thereof may be implemented as four as shown in FIG. 1. It is apparent that the present invention is not limited to the position and the like. In addition, the position of the subject 140 may be a position reflecting the light emitted from the light source unit 120, the subject 140 is in contact with or non-contact with the image sensor unit 110 or the subject motion detection mouse 100. Or contactless). In addition, the image sensor unit 110 and the light source unit 120 may be located at the top or one side of the object movement detection mouse 100.

The light irradiated from the light source unit 120 is reflected from the subject 140 and continuously incident to the image sensor unit 110, and the image sensor unit 110 generates an image of the subject 140. The generated image of the subject 140 is processed in the form of image data by an image processor (not shown) included in the subject movement detecting mouse 100, and the processed image data is analyzed to determine the movement of the subject 140. The extracted 'main controller' (not shown, hereinafter referred to as 'main controller') of the laptop computer 130 performs a function control corresponding to the movement of the extracted object 140. In this case, a function corresponding to the movement of the subject 140 may be differently designated by a separate function button (or a combination of button inputs). For example, while the movement of the subject 140 is the same but the '*' button of the keypad unit 135 of the notebook computer 130 is pressed, the extracted movement of the subject 140 and the '#' button are pressed. The movement of the extracted subject 140 may be set to perform different functions.

Alternatively, the movement of the subject 140 may be set to perform different functions while the movement of the subject 140 is the same but the extracted subject 140 is pressed while a button provided separately in the subject movement detecting mouse 100 is pressed.

In addition, the main controller (not shown) of the notebook computer 130 controls the respective components of the notebook computer 130 to correspond to the signal input from the subject motion detection mouse (100). For example, when a signal for controlling the pointer 150-1 displayed on the display unit 150 is input from the subject movement detecting mouse 100, the main controller of the computer 130 receives the pointer 150-. 1) may be controlled to be positioned at a corresponding position on the display unit 150.

In the above, the case in which the subject movement detecting mouse 100 controls the pointer 150-1 by detecting the movement of the subject 140 has been described. However, the subject movement detecting mouse 100 also functions as a conventional mouse. It may be included. That is, the subject movement detecting mouse 100 may include a function of detecting the movement of the subject 140 in the functions of the existing optical mouse and / or ball mouse. In this case, the user may select whether to use the function of the optical mouse and / or the ball mouse or the function of detecting the movement of the subject 140 by operating a button part (not shown) attached additionally.

In addition, the object movement detecting mouse 100 may simultaneously perform the function of the optical mouse and / or the ball mouse and the function of detecting the movement of the subject 140. For example, the subject movement detecting mouse 100 may control the position of the pointer 150-1 using the functions of the optical mouse and / or the ball mouse, and simultaneously detect the movement of the subject 140 to display the display unit. The scroll of 150 may be controlled. That is, when the user moves the subject 140 near the image sensor unit 110 while moving the position of the subject movement detecting mouse 100 itself, the subject movement detecting mouse 100 may be used to determine the movement of the subject movement detecting mouse 200 itself. The position of the pointer 150-1 may be controlled according to the movement, and at the same time, the scrolling of the display unit 150 may be controlled according to the movement of the subject 140.

1B is a view illustrating an image capturing unit of a subject motion detecting mouse according to an exemplary embodiment of the present invention.

Referring to FIG. 1B, the pointer movement detecting mouse 100 includes an image capturing unit 170 including an image sensor unit 110 and a light source unit 120, a housing 180 accommodating the image capturing unit 170, and a housing 180. A main control unit (not shown) provided at an upper part of the control unit and processing image data generated by the light transmitting unit 160 and the image capturing unit 170 formed on the upper case of the pointer movement detecting mouse 100 to input information. It includes. Also, the subject 140 for extracting the movement and inputting information is illustrated on the light transmitting unit 160.

That is, in the pointer movement detecting mouse 100, when the subject 140 moves in a predetermined direction on the light transmitting unit 160 through which light may pass, the image sensor unit 110 continuously photographs the subject 140 and the main body. The controller (not shown) inputs information according to the movement of the subject 140. In this case, the image sensor unit 110 and / or the light source unit 120 are provided inside the subject movement detecting mouse 100, but the transparent light transmitting unit 160 formed on the upper case of the pointer movement detecting mouse 100 is located on the upper portion. Since is located, the subject 140 can be continuously photographed.

For example, the light emitted from the light source unit 120 is reflected from the user's finger, which is the subject 140, is incident on the image sensor unit 110, and the image sensor unit 110 reflects the light reflected by the subject 140. The light may be received to generate corresponding image data. Accordingly, the movement of the subject is recognized by the main controller (not shown), so that the subject movement detecting mouse 200 may perform a function corresponding to the movement of the subject 140.

1C is a diagram illustrating a subject motion detecting mouse according to another exemplary embodiment of the present invention.

Referring to FIG. 1C, the subject motion detecting mouse 100 includes an image capturing unit including an image sensor unit 160 and light sources 170-1 and 170-2 instead of a scroll wheel of a conventional mouse. do. That is, the user may hold the subject movement detecting mouse 100 by hand and place the index finger, which is the subject 140, on the image capturing unit. Accordingly, the user may control the position of the pointer 150-1 by moving the gripped object movement detecting mouse 100, and simultaneously moves the index finger, which is the subject 140, to scroll the display unit 150. Can be controlled. That is, when the user moves the position of the subject movement detecting mouse 100 itself, the subject movement detecting mouse 100 may control the position of the pointer 150-1 according to the movement of the subject movement detecting mouse 200 itself. When the user moves the index finger, which is the subject 140, the subject movement detecting mouse 100 may control scrolling of the display unit 150 according to the movement of the subject 140.

In the above description, a general view of the subject movement detecting mouse 100 has been described. Hereinafter, the operation of the subject movement detecting mouse 100 and the image data generated by the subject movement detecting mouse 100 will be described with reference to the accompanying drawings. A method of sensing the movement of the subject 140 by using the above will be described. In addition, hereinafter, it will be described on the assumption that the subject movement detecting mouse 100 uses the function of detecting the movement of the subject 140. That is, there is no problem when the subject movement detecting mouse 100 includes only a function of detecting the movement of the subject 140 to control the pointer 150-1, but as shown in FIGS. 1A and 1B, general optical When the function of detecting the movement of the subject 140 is added to the mouse and / or the ball mouse, the subject movement detection mouse 100 detects the movement of the subject 140 by the user's selection. Assume a case where the pointer 140-1 is controlled.

In addition, embodiments according to the present invention are largely divided into two types. First, by comparing a plurality of different image data obtained by capturing the subject 140 at a predetermined time interval, the center point of the subject image is extracted to extract the subject 140. The second method is to adjust the sharpness of the image data generated by capturing the subject 140 and extract the outline of one end of the subject 140 from a frame having different clarity to detect the movement of the subject 140. How to detect. It demonstrates in order below.

2 is a block diagram of a subject movement detecting mouse according to an embodiment of the present invention.

Referring to FIG. 2, the subject motion detecting mouse 200 according to an exemplary embodiment of the present invention includes an image capturing unit including a filter unit 212, a light source unit 214, a lens unit 216, and an image sensor unit 218. The image processing unit 230 and the storage unit 240 may include a 210, a subject extractor 231, a center determiner 232, a pointer position setter 234, and a subject determiner 236. have. The operation of each of the above components will be described below. In addition, although not shown, the subject movement detecting mouse 200 may be connected to other electronic devices (eg, the notebook computer 130, etc.) to transmit / receive a signal to transmit / receive a signal, an optical sensor, or a ball. It is obvious that the sensor may further include a key input unit for generating and outputting a signal corresponding to the manipulation of the user and a user.

However, the functions of the optical mouse or the ball mouse are obvious to those skilled in the art, and a description thereof will be omitted below. Therefore, the following describes an operation in which the subject movement detecting mouse 200 detects the movement of the subject 140 and performs each function.

As described above, the light irradiated from the light source unit 214 may be reflected by the subject 140 and irradiated to the image sensor unit 218 via the filter unit 212 and the lens unit 216.

At this time, the filter unit 212 allows only the light of a specific wavelength to pass through to accurately measure the movement of the subject 140. That is, the light source unit 214 may output light having a specific wavelength, and the light is reflected by the subject 140 and passes through the filter unit 212 to emit light having a different wavelength that may act as noise. There is an effect that can be blocked. For example, it is assumed that the light source unit 214 emits infrared rays, and the filter unit 212 can pass only infrared rays. Here, the infrared rays which can be used in the present invention may be light having a relatively small ratio in sunlight. For example, the wavelength of the infrared light may be 900 to 980 nm, 1080 to 1180 nm, 1325 to 1425 nm, 1800 to 2000 nm, and the like, which are wavelengths of light having a relatively small amount of light in the solar spectrum.

Although the image capturing unit 210 including the filter unit 212 has been described herein, it is obvious that the present invention may be applied using all the light emitted from the subject 140 without the filter unit 213. Do.

The light source unit 214 may output light having a specific wavelength, and the light is reflected by the subject and passes through the filter unit 212 to emit light having a different wavelength, which may act as ambient noise. As described above, there is an effect that can be blocked. In particular, the light source unit 214 may be turned on at a predetermined time interval under the control of the main controller (not shown). At this time, the image sensor unit 218 photographs the subject 140 while the light source unit 214 outputs the light to display the shiny image data, and the subject 140 while the light source unit 214 does not output the light. ), Each of the matt image data may be generated and output to the image processor 1030.

In this case, the main controller (not shown) may be a controller for controlling the overall operation of the electronic device (for example, the notebook computer 130, etc.) to which the subject movement detecting mouse 200 is connected according to an embodiment of the present invention. have. In addition, the light source unit 214 may be controlled by an additional control unit (not shown) for controlling only the light source unit 214 separately provided in the imaging unit 210.

The lens unit 216 may perform a function of transferring the light passing through the filter unit 213 to the image sensor unit 219.

The image sensor unit 218 may be a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor. A complementary metal oxide semiconductor (CMOS) image sensor is composed of a plurality of unit pixels including a photo diode, and the signal output from the sensor is a digital electrical signal, which unit pixel is driven by a control circuit and signal processing. . A charge coupled device (CCD) image sensor includes a plurality of MOS capacitors, and is operated by outputting an analog electric signal by moving charges (carriers) to the MOS capacitors.

The image sensor unit 218 includes a plurality of pixels capable of sensing light. Accordingly, the image sensor 218 detects a position at which the light corresponding to the coordinate value at which the subject 140 is located is incident by the image processor 230 to move the pointer of the display unit 150. ) Can be used to calculate the coordinates where the image is located.

In addition, the light source unit 214 and the image sensor unit 218 may be located at the top of the subject movement detection mouse 200 as shown in FIG. Of course, it is apparent that the light source unit 214 and the image sensor unit 218 may be located on one side of the subject movement detecting mouse 200 according to a use method or a purpose.

The image processor 230 extracts coordinate values corresponding to the movement of the subject 140 from the image data of the subject recognized by the image sensor 219. In detail, the object extracting unit 231 generates the subject image data by comparing the matte image data and the matte image data received from the imaging unit 210.

The subject image data may be generated in various ways. First, a method of generating subject image data by subtracting the luminance value of the matte image data corresponding to each pixel from the luminance value of the glossy image data and the photographed subject ( There may be a method of generating the subject image data by extracting the outline of 140. Hereinafter, the first method will be described, and the second method will be described later with reference to FIG. 12.

That is, since the gloss image data is image data captured while the light source unit 214 is activated, the image of the subject 140 photographed at a position close to the light source unit 214 will have a high luminance value and a position far from the light source unit 214. The luminance value of the background partial image picked up at will be relatively small. In addition, since the matte image data is image data photographed while the light source unit 214 is inactivated, the luminance value of the subject 140 image and the luminance value of the background image will be smaller than those of the glossy image data.

In addition, since the backgrounds of the glossy image data and the matte image data are both located far from the light source 214 and the subject, the difference in luminance value will be very small. Therefore, if the luminance value of the matte image data corresponding to each pixel is subtracted from the luminance value of the glossy image data, the luminance value of the background portion except for the subject 140 will be almost 'zero'. Only the luminance value of the portion corresponding to the 140 image will be present. In this manner, the subject extractor 231 may generate subject image data obtained by extracting only the subject 140 from the captured image data.

The center determining unit 232 analyzes the subject image data generated by the subject extracting unit 231 to determine the center point of the subject image. Extract). For example, it is assumed that the resolution of the image sensor unit 1018 is 640 * 480 (horizontal * vertical), and luminance values of each pixel are divided by 0 to 255. If the luminance value is '0', the brightness is '0', so it will be black, and if the luminance value is '255', it will be represented as white because it is the brightest case.

If the preset reference boundary value is '10, 000 'in order to extract the reference pixel, the center determination unit 232 may extract 10,000 reference pixels in the order of pixels having the highest luminance value from the subject image data. In this case, if the reference boundary value is too large, most pixels of the subject image data will be extracted as reference pixels, and if the reference boundary value is too small, only a small part of the subject image data will be extracted as reference pixels. In this case, the ratio of pixels (ie, noise pixels) to the background portion irrelevant to the reference pixel other than the imaged image of the subject 140 will be increased. That is, if the reference boundary value is too large or too small, the ratio of the noise pixels is high, so the center determination unit 1032 may have difficulty in determining the exact position of the photographed subject 140.

Therefore, the upper limit and / or lower limit of the luminance may be set as the reference boundary so that the ratio of the noise pixels can be ignored. For example, assume that the reference boundary value is '10, 000 'and the lower luminance limit is' 50'. In this case, the center determination unit 232 may extract 10,000 reference pixels in the order of the pixels having the highest luminance from only the pixels having the luminance greater than 50 in the subject image data. That is, the center determination unit 232 analyzes each pixel of the subject image data and extracts 10,000 reference pixels in order of increasing luminance, excluding pixels having luminance values of less than 50 (or less) from the reference pixels. can do.

In addition, since the subject 140 will generally be a user's finger, if the luminance value is too large, it is likely to correspond to a noise pixel. Therefore, assuming that the reference boundary value is '10, 000 'and the luminance upper limit value is' 200', the center determination unit 232 targets only pixels whose luminance value is less than (or less than) 200 in the subject image data. The reference pixel can be extracted.

In addition, the reference boundary value may be a predetermined luminance value instead of the number of pixels having a large luminance value. That is, the center determination unit 232 may analyze the subject image data and extract all pixels that exceed the reference boundary value as the reference pixels. For example, when the reference boundary value is set to '150', the center determination unit 232 may extract all pixels whose luminance value exceeds '150' from the subject image data as reference pixels. In this case, too, if the reference boundary value is too large or too small, the ratio of the noise pixels in the reference pixel will be high, so it is obvious that the luminance upper limit value and / or the luminance lower limit value with respect to the reference boundary value can be set.

In addition, the center determination unit 232 analyzes the reference pixel to determine the center point of the subject image and stores it in the storage unit 240. In this case, the center point may be the center of gravity of the subject 140. For example, the center of gravity, which is a specific coordinate located inside the subject 140, may be calculated by the following equation.

(1)

(One)

(2)

(2)

(3)

(3)

Where R is the center of gravity, M is the sum of the luminance values of the reference pixels of the subject, mi is the luminance value of each reference pixel of the subject, and ri is the coordinate value of the reference pixel. The subscripts x and y indicate the values corresponding to the X and Y axes, respectively, and Equation (3) is a vector representation of Equation (1) and (2).

However, when the center determination unit 232 determines the center point of the subject image by the above-described equation, since the luminance values of the reference pixels must all be reflected, the calculation amount increases, thereby increasing the overall function of the subject motion detection mouse 200. Degrading problems may occur. Therefore, the center point of the subject image may be determined by the following equation.

(4)

(4)

(5)

(5)

(6)

(6)

Where R is the center of gravity, ri is the coordinate value of the reference pixel, and n is the number of reference pixels. Subscripts x and y represent values corresponding to the X and Y axes, respectively, and Equation (6) is a vector representation of Equation (4) and (5).

That is, the center determination unit 232 may determine the center point of the subject image without reflecting the luminance value of the reference pixel. Since the luminance value of each reference pixel will not be significantly different, the center determination unit 232 may calculate the average value of the coordinate values of the reference pixel as the center point of the subject image without reflecting it. For example, when the luminance value of the reference pixel is divided into '1' and the luminance value of the remaining pixels are divided into '0', the subject image data is displayed as white in the reference pixel (ie, the portion where the subject 140 is captured). , The rest will be displayed in black. Therefore, the center of gravity of the reference pixel (that is, the subject 140) displayed in white may be obtained without reflecting the luminance value of each pixel by the above equations (4 to 6).

In addition, when the outline of the reference pixel is curved, the center determination unit 232 may calculate a radius of curvature and extract a coordinate value of a center point corresponding to the radius of curvature. In addition, when the predetermined outline is a quadrangle, the center judging unit 232 may extract a coordinate value where a diagonal line of the quad meets as a coordinate value determined by the predetermined outline, and in the case of another polygon, connects vertices facing each other. It can also be extracted as coordinates that meet two or more lines. For example, the center determination unit 232 may calculate a distance between each pixel representing a curved outline, and may use the middle value of two pixels having the largest calculated distance of each pixel as the coordinate value of the center point.

The pointer position setting unit 234 moves the pointer so that the pointer is positioned at a specific position of the display unit 150 (that is, the display unit of the electronic device to which the subject movement detecting mouse 200 is connected) in the pointer movement mode for moving the position of the pointer. Generates a command and outputs the main controller (not shown). In this case, the pointer movement mode may be activated and / or deactivated by the user's selection. E.g,

That is, the pointer position setting unit 234 is a pointer so that the position of the pointer 150-1 of the display unit 150 corresponds to a specific coordinate (for example, the center of gravity of the subject image on the subject image data). A movement command may be generated and output to a main controller (not shown). In this case, the pointer movement command may be a signal corresponding to the coordinate value of the center of gravity, and the main controller (not shown) receiving the pointer movement command controls the pointer of the display unit 150 to be positioned at the coordinates corresponding to the pointer movement command. can do. Hereinafter, a pointer movement control method will be described with reference to FIG. 3.

3 is a diagram illustrating subject image data and pointer movement generated by the present invention. Referring to FIG. 3, the display unit 150 of the electronic device connected to the subject movement detecting mouse 200 is shown in the upper part of FIG. 3, and in the lower part of FIG. 3, the subject image data 300 extracted by the subject extractor 231. ) Is shown. Also, pointers 320-1 and 320-2 are shown on the display unit 150, and m-th center points and m-th center points that are sequentially calculated are displayed on the subject image data 300. In addition, it is assumed that the m-th center point is (a1, b1), and the m-th pointer 320-1 corresponding to the m-th center point is positioned on the display unit 150.

In this case, the pointer position setting unit 234 may generate the m-th pointer movement command corresponding to the m th center points a2 and b2 and output the command to the main controller (not shown). Receiving a pointer movement command to control the respective components of the electronic device (for example, the notebook computer 130, etc.) to which the subject movement detection mouse 200 is connected so that the m-th pointer 320-2 is positioned at the corresponding position. Can be. At this time, the process of changing the position of the pointer by the main controller (not shown) to control the respective components of the electronic device (for example, notebook computer 130, etc.) to which the subject movement detection mouse 200 is connected, Obviously, detailed description thereof is omitted here.

Referring back to FIG. 2, the subject determining unit 236 uses the reference pixel extracted by the subject extracting unit 231 (hereinafter, referred to as 'm th reference pixel' (m is a natural number)). Detects the motion of the motion controller 110, generates a function execution command corresponding to the motion of the detected subject 140, and outputs the command to the main controller (not shown). That is, the subject determining unit 236 may detect a rotation operation, a click operation, a linear operation, a perspective operation, and the like of the subject 140. Hereinafter, the subject determination unit 236 may detect a click operation, a perspective operation, and the like. The linear operation will be described as an example in order. In this case, the function execution command is a command for performing various functions that can be performed corresponding to a mouse operation such as a button click. For example, menu execution, button click of a mouse, screen scrolling, and the like may be performed by a function execution command.

The subject determiner 236 detects the click operation of the subject 140 by using the subject image data sequentially generated in the click operation detection mode for detecting the click operation of the subject 140. Can be generated and output to the main control unit. In this case, the subject determining unit 236 may operate in the click motion detection mode by the user's selection. For example, a user may manipulate an operation mode (eg, a click operation detection mode) of the subject determination unit 236 by manipulating a button unit (not shown) provided at one side of the subject movement detection mouse 200. have. Accordingly, when the user manipulates the button unit (not shown) to detect the click operation of the subject 140, the subject determination unit 236 may perform the click operation detection mode corresponding to the user's operation of the button unit (not shown). It can work as

For example, sound source data (for example, an MP3 file, etc.) to be output through a speaker (not shown) of a notebook computer 130 connected to a subject movement detection mouse 200 by a user using a click operation of the subject 140. Assume that you want to select). In this case, the subject determining unit 236 detects a click motion in response to an operation of a button unit (not shown) separately provided on the keypad 135 of the user's notebook computer 130 and / or the subject movement detecting mouse 200. Can operate in mode. That is, when the user manipulates the keypad unit 135 and / or the button unit (not shown) of the notebook computer 130 for mode switching, the keypad unit 135 and / or the button unit (not shown) of the notebook computer 130 is shown. ) May generate a mode conversion signal corresponding to a user's operation and output the mode conversion signal to the subject determining unit 236, and the subject determining unit 236 may receive the mode switching signal and operate in a corresponding mode.

For example, when a user operates a button unit (not shown) to perform a click operation by using the movement of the subject 140, the button unit (not shown) causes the subject determination unit 236 to enter the click operation detection mode. In order to operate, a corresponding mode conversion signal may be generated and output to the subject determining unit 236. In this case, the button unit (not shown) may generate and output a mode conversion signal when the user presses the button unit (not shown) once, or output the mode conversion signal while the user presses the button unit (not shown). have. That is, when the user ends the operation of the button unit (not shown), the subject determining unit 236 may generate a mode conversion end command for operating in the existing mode and output the command to the subject determining unit 236.

In addition, the subject determining unit 236 sequentially analyzes the subject image data to calculate subject size information. For example, the subject determining unit 236 may calculate the m-th subject size information by analyzing the subject image data. In this case, the m-th subject size information may be information corresponding to the size of the m-th reference pixel. That is, when the subject 140 is the user's finger, the reference pixel (hereinafter, referred to as 'm th reference pixel') of the subject image photographed on the subject image data 310 may include a circular curve. Therefore, the m-th subject size information may be information corresponding to a radius of curvature (or diameter) of the circular portion of the m-th reference pixel. The m-th subject size information may be information corresponding to the number of pixels existing in the figure of the m-th reference pixel. That is, when the m th reference pixel is a circular figure or a quadrangle (or triangle) figure, the m-th subject size information may be the number of pixels existing in the figure.

 Hereinafter, a method of detecting the click operation of the subject 140 using the m-th subject size information will be described in detail with reference to FIG. 4. In this case, as described above, the m-th subject size information may be information corresponding to the size of the m-th reference pixel.

4 is a diagram illustrating a method of detecting a subject click operation according to the present invention.

Referring to FIG. 4, the subject determiner 236 may generate a corresponding click function execution command by comparing the subject size information sequentially calculated with a preset first boundary value. For example, the subject determining unit 236 generates k-th subject size information when the m-th subject size information is larger than the first threshold value, and determines whether the k-th subject size information is the first threshold value. If it is smaller, it can generate and output a click function execution command. In this case, k may be a natural number larger than m. That is, after a predetermined time elapses after generating the m-th subject size information, the k-th subject size information is generated according to a change in the position, size, etc. of the subject, and the subject determining unit 236 receives the k-th subject size information. If it is smaller than the first boundary value, a click function execution command corresponding to a specific position within the preset reference pixel may be generated.

For example, it is assumed that the subject movement detecting mouse 200 is connected to the notebook computer 130. In this case, the specific position in the m th reference pixel may be the center of gravity of the m th reference pixel, and if the position of the pointer 150-1 corresponding to the center of gravity corresponds to the 'menu' button, the subject determining unit 236 Click function execution command for executing the menu function can be generated and output to the main control unit (not shown), the main control unit (not shown) received this configuration of each of the notebook computer 130 for the execution of the 'menu' function You can control the elements.

At this time, even if the calculated object size information is the same as the first threshold value, the click function execution command may be set in advance so as to be generated. However, hereinafter, the description will be omitted for the case in which the calculated object size information is the same as the first boundary value for convenience of understanding and explanation.

However, when the object determining unit 236 generates the click function execution command, the coordinates of the center of gravity of the m-th reference pixel may be different from the coordinates of the center of gravity of the k-th reference pixel. In this case, there is no problem when the functions corresponding to the coordinates of the centers of gravity are the same (that is, when the coordinates correspond to the 'menu' functions). Can be. In this case, the object determining unit 236 may generate a click function execution command corresponding to a specific position within a preset reference pixel, generate a click function execution command corresponding to an error, and select the user. You can also create a command to perform a click function.

For example, it is assumed that the object determining unit 236 is preset to generate a click function execution command corresponding to the coordinate of the center of gravity of the k-th reference pixel. In this case, when the coordinate of the center of gravity of the m th reference pixel corresponds to the 'menu' function, and the coordinate of the center of gravity of the k th reference pixel corresponds to the 'end' function, the object determining unit 236 determines the k th reference pixel. By generating a click function execution command for performing the 'end' function corresponding to the coordinate of the center of gravity can be output to the main controller (not shown).

In addition, the subject determiner 236 may start to measure the click information when the m-th subject size information is larger than the first boundary value. The measurement of the click information is to generate the click information t1 differently according to the time for which the click operation of the subject 140 continues, so that the subject determining unit 236 generates a click function execution command corresponding to the click information. That is, the click information may be a time when the click operation of the subject 140 is continued. For example, if the click information is shorter than t2, which is a preset time, a short click, and if the click information is a value between the t2 and t3, which is a preset time (t2 <t3), the long click If the click information is greater than t3, it is assumed that the click information is previously set as a cancel click.

In this case, the object determining unit 236 may generate a click function execution command corresponding to the measured click information and output the generated command to the main controller (not shown). That is, when the click information is less than t2, the subject determining unit 236 may generate and output a click function execution command corresponding to the short click operation of the subject 140. For example, assuming that a short click is set in advance to correspond to a 'data selection' function and a long click corresponds to a 'option selection' function, when the click information corresponds to a short click (that is, the click information) Is less than t2), a click function execution command for 'select data' can be generated.

However, when the m-th subject size information and / or the k-th subject size information is a value near the first boundary value, detection of a click operation of the subject 140 may not be accurate. For example, after the m-th subject size information is larger than the first threshold value and the measurement of the click information is started, the k-th subject size information sequentially input after the measurement value of the m-th subject size information is smaller than the first threshold value is repeated. It may be entered. That is, when the first threshold value is set to '100', the m-th subject size information is '110', and then measurement of the click information is started, but the k-th subject size information sequentially input is '102' and k + 1. The subject size information may be '98' and the k + 2th object size information may be '101'. In such a case, the accuracy of the measurement of the click information is inferior.

In order to prevent such a phenomenon, the subject determining unit 236 starts the click information measurement when the m-th subject size information is larger than the first threshold value, and k-th subject size information having a value smaller than the first threshold value is preset. If the number of times is repeated, the measurement of the click information is ended, and the click information may be made valid by retroactively to the time point at which the k-th subject size information having a value smaller than the first threshold value is first repeatedly measured.

That is, it is assumed that the first threshold value is '100' and the click information measurement end point is preset when the object size information smaller than the first threshold value is input three times in succession. At this time, the k-th subject size information is '102', the k + 1th object size information is '98', and the k + 2th object size information is '101', and the k + 3th object size is sequentially generated. If the information is '99', the k + 4th object size information is '98', and the k + 5th object size information is '98', the object determination unit 236 starts from the point where the kth object size information is generated. The click information is started to be measured and the click information is measured until the k + 5th object size information is generated, but the click information may be valid until the k + 3th object size information is generated.

In addition, as described above, the object determining unit 236 may generate a click function execution command corresponding to a specific position within a preset reference pixel in consideration of the click information and output the command to the main controller (not shown). However, unlike the case where the k-th subject size information sequentially generated as in the first case 410 is continuously reduced, there may be a case where the k-th subject size information is changed from a value smaller than the first boundary value to a larger value. (Second case 420). Even in this case, the click operation of the subject 140 may not be accurately detected. That is, the user may move to the subject 140 near the imaging unit 210 in order to click a button or the like corresponding to the position of the pointer and hesitate.

In this case, the object determining unit 236 generates a click function execution command immediately after the end of the click information measurement, and if the subject size information sequentially input afterwards is smaller than the second preset threshold value, the generated click is generated. The function execution command may be output to the main controller (not shown). For example, when the first threshold value is '100' and the second threshold value is '50', the subject determining unit 236 issues the click function execution command when the k-th subject size information is smaller than '50'. Output to a controller (not shown).

However, even in this case, in order to clarify that the subject 140 is far from the image capturing unit 210, the subject determining unit 236 may generate the first subject size information smaller than the second threshold value for a preset time. If the k-th subject size information larger than the threshold value is not generated, the command to perform a click function may be output to the main controller (not shown) (where l may be a natural number larger than k). That is, the subject determining unit 236 may start measuring atmospheric information when the first subject size information smaller than the second threshold is generated. The atmospheric information may be a time when the first object size information larger than the second threshold is not generated. In this case, the subject determining unit 236 may output the generated click function execution command to the main controller (not shown) when the waiting time elapses from the preset time.

Of course, the atmospheric information may be measured at the time point at which the k-th subject size information smaller than the first threshold value is calculated, in which case the second threshold value may be omitted.

At this time, even if the calculated object size information is the same as the second threshold value, it is apparent that the click function execution command may be preset or set in advance so that the standby information is measured. However, the description will be omitted for the case in which the calculated object size information is the same as the second boundary value for convenience of understanding and explanation.

Referring back to FIG. 2, the subject determiner 236 may remove the perspective motion in the perspective motion detection mode for detecting the perspective motion of the subject 140 (that is, the motion of the subject 140 near or away from the image capture unit 210). m Using the subject size information, the motion of the subject 140 is sensed, and a pointer size change command corresponding to the object 140 is generated and outputted to the main controller (not shown). May sense a perspective motion of the subject 140 to perform a corresponding function. That is, the pointer may be a concept including a scroll-bar as well as a pointer.

For example, it is assumed that a user adjusts a volume of sound source data output by using a perspective bar of a subject 140 using a scroll bar. That is, a scroll bar indicating a volume currently output may be displayed on a display unit (not shown), and the subject determining unit 236 detects the perspective motion of the subject 140 so that the subject 140 may detect the image sensor unit 218. ) To increase the volume, and to move the pointer size change command to the main controller (not shown) so that the volume decreases. In this case, the main controller (not shown) may control the volume of the output sound source data to correspond to a pointer size change command.

In addition, sound source data (eg, MP3 files, etc.) output by a user through a speaker (not shown) of the notebook computer 130 connected to the subject motion detection mouse 200 using a perspective motion of the subject 140. Suppose you want to adjust the volume of. At this time, the subject determining unit 236 detects the perspective motion corresponding to the manipulation of the keypad 135 of the user's notebook computer 130 and / or the manipulation of a button unit (not shown) separately provided on the subject movement detecting mouse 200. Can operate in mode.

That is, when the user manipulates the button unit (not shown) to adjust the volume of the sound source data output through the speaker (not shown) of the notebook computer 130, the button unit (not shown) may display a corresponding signal (eg, For example, a perspective motion detection command) may be output to the subject determiner 236, and the subject determiner 236 receiving the perspective motion may operate in a perspective motion detection mode. In this case, the subject determining unit 236 may generate the corresponding pointer size change command by comparing the generated m-th subject size information with the pre-stored reference subject size information and output the same to the main controller (not shown).

In this case, the reference subject size information is information on a subject size (for example, the number of reference pixels, etc.) and may be a preset value or a value set by a user's selection. In addition, the object determining unit 236 may compare the calculated subject size information with the reference subject size information to detect whether the subject 140 is near or away from the imaging unit 210. That is, the subject determining unit 236 may determine that the subject 140 approaches the imaging unit 210 when the m-th subject size information is larger than the reference subject size information, and the m-th subject size information is larger than the reference subject size information. If it is small, it may be determined that the subject 140 is far from the imaging unit 210. Hereinafter, a method of setting the reference subject size information by the user's selection will be described.

That is, the subject determining unit 236 calculates the m-th subject size information and compares it with a preset first reference pixel boundary value. In this case, the first reference pixel boundary value may be information about the number of reference pixels. The reason for comparing the m-th subject size information with the first reference pixel boundary value is that when the reference subject size information is too small, compared to the reference point (that is, the point where the subject 140 is located at the time when the reference subject size information is generated). This is because when the subject 140 moves away from the image pickup unit 210, smaller subject size information is calculated, and thus the perspective motion of the subject 140 may not be accurately detected. That is, the first reference pixel boundary value may be a lower limit value of the m th subject size information for generating the reference pixel boundary value.

In addition, the subject determining unit 236 may compare the m-th subject size information with a preset second reference pixel boundary value. In this case, the second reference pixel boundary value may be information about the number of reference pixels. The reason for comparing the m-th subject size information with the second reference pixel boundary value is that when the reference subject size information is too large, compared to the reference point (that is, the point where the subject 140 is located at the time when the reference subject size information is generated). This is because when the subject 140 approaches the imaging unit 210, larger subject size information is calculated, and thus the perspective motion of the subject 140 may not be accurately detected. That is, the second reference pixel boundary value may be an upper limit value of the m th subject size information capable of generating the reference subject size information.

In addition, the subject determining unit 236 may output a signal corresponding to an error to the main controller (not shown) when the m-th subject size information is smaller than the first reference pixel boundary value or larger than the second reference pixel boundary value. Can be. This is to allow the user to position the subject 140 closer to the imaging unit 210.

On the other hand, the subject determining unit 236 may determine whether the reference subject size information generation command is input when the m-th subject size information is larger than the first reference pixel boundary value and smaller than the second reference pixel boundary value. Here, the command for generating the reference subject size information may be a signal corresponding to the manipulation of the button unit (not shown) of the user and / or the manipulation of the keypad 135 of the notebook computer 130. For example, a user may select a button unit provided at one side of the subject movement detecting mouse 200 after the subject 140 is photographed to set a point where the current subject 140 is separated from the image pickup unit 210 as a reference point. (Not shown), and the button unit (not shown) may generate a reference subject size information generation command in response to a user's button operation and output the command to the subject determining unit 236.

As a result of determination, when the reference subject size information generation command is not input, the subject determining unit 236 may calculate the m + 1th subject size information and compare it with the first reference pixel boundary value. That is, the subject determining unit 236 may perform the above-described process by re-imaging the subject 140 to generate the reference subject size information.

However, when the command to generate the reference subject size information is input, the subject determining unit 236 may generate the corresponding reference subject size information and store it in the storage unit 240. That is, the subject determining unit 236 may use the m-th subject size information as the reference subject size information.

At this time, the subject determining unit 236 may output data corresponding to the subject image data to the main controller (not shown) in order to facilitate selection of the reference subject size information of the user, and the main controller (not shown) receives the same. To be displayed on the display unit 150. That is, the user may determine whether to select the m-th subject size information as the reference subject size information based on the subject image data displayed on the display unit 150. For example, one side of the display unit 150 displays the subject image data, and the user may measure the m-th subject size information by viewing the displayed subject image data. Accordingly, the user can operate the button unit (not shown) and / or the keypad unit 135 of the notebook computer 130 when the object size information of the appropriate size is calculated, and the button unit (not shown) and / or the notebook computer. The keypad unit 135 of 130 may generate a reference subject size information generation command and output the generated command to the subject determining unit 2326.

Also, after the reference subject size information is stored, the subject determining unit 236 may calculate the k-th subject size information in the perspective motion detection mode and compare it with the stored reference subject size information (where k is a natural number). By generating a pointer size change command corresponding to the output to the main controller (not shown). Hereinafter, a method of changing the size of the pointer by detecting the perspective motion of the subject 140 by the subject determining unit 236 will be described with reference to FIG. 5.

5 is a diagram illustrating a display unit of an electronic device to which a subject movement detecting mouse is connected according to the present invention. In this case, it is assumed that the display unit 150 displays a state in which sound source data is output. In other words, it is assumed that the media player 510 is displayed on the display unit 150. In addition, it is assumed that the object determining unit 236 changes the position of the scroll bar by detecting the perspective motion of the subject 140 in the perspective motion detection mode.

Referring to FIG. 5, the display unit 150 has a media player 510 activated and displays a first scroll bar 520 displaying a current playing time of the sound source data being output, and an output volume of the sound source data. A second scroll bar 530 and pointer 540 are shown.

In this case, the subject determining unit 236 may generate the k-th subject size information and compare the reference subject size information with each other, and change the positions of the first scroll bar 520 and / or the second scroll bar 530 according to the comparison result. Can be. For example, it will be described on the assumption that the object determining unit 236 changes the position of the first scroll bar 520 by detecting the perspective motion of the subject 140. Here, if the k-th subject size information is larger than the reference subject size information, the subject determining unit 236 moves the position of the first scroll bar 520 to the right by the correspondence between the k-th subject size information and the reference subject size information. A pointer size change command may be generated and output to a main controller (not shown), and the main controller (not shown) may receive the same and move the first scroll bar 520 to a corresponding position. In addition, the main controller (not shown) may control to output a sound source corresponding to the position of the moved first scroll bar 520.

For example, it is assumed that the currently output sound source corresponds to 3 minutes out of a total of 5 minutes running time. In this case, when the position of the first scroll bar 520 corresponding to the function execution command corresponds to 4 minutes (min), the main controller (not shown) may control to output a sound source corresponding to 4 minutes (min) of the sound source data. Can be.

Here, whether the object determining unit 236 controls the position of the first scroll bar 520 or the position of the second scroll bar 530 may vary depending on the position of the pointer 540. That is, when the pointer 540 is positioned on the first scroll bar 520, the subject determination unit 236 may generate a pointer size change command for controlling the position of the first scroll bar 520. When the pointer 540 is positioned on the second scroll bar 530, the subject determining unit 236 may generate a pointer size change command that can control the position of the second scroll bar 530.

In addition, whether the subject determiner 236 controls the position of the first scroll bar 520 or the position of the second scroll bar 530 may vary according to a user's selection. For example, when the user selects the control of the first scroll bar 520 by manipulating a button unit (not shown), the subject determining unit 236 may control the position of the first scroll bar 520.

In addition, according to another exemplary embodiment, the object determining unit 236 may control the first scroll bar 520 and / or the second scroll bar 530 in correspondence with the straight line operation of the subject 140. In this case, the straight line operation is an operation in which the subject 140 moves left and right or up and down near the image sensor unit 218 unlike a perspective operation or a click operation in which the subject 140 approaches and moves away from the image sensor unit 218. In other words, if the perspective motion and / or the click motion are three-dimensional motions for recognizing space, the linear motion is a planar two-dimensional motion.

Hereinafter, a method in which the subject determining unit 236 detects a linear operation of the subject 140 will be described.

Referring back to FIG. 2, the subject determiner 236 determines the center point determined by the center determiner 232 in the linear motion detection mode for detecting the linear motion of the subject 140 (hereinafter referred to as 'm th center point'). The m-th region information corresponding to the coordinate value of may be extracted and stored in the storage unit 240. In this case, the subject determining unit 236 may operate in the linear motion detection mode by the user's selection. For example, it is assumed that a user adjusts the first scroll bar 520 by using a linear operation of the subject 140. In this case, the user may operate the button unit (not shown) separately provided on one side of the subject movement detecting mouse so that the subject determining unit 236 may operate in the linear motion sensing mode.

Hereinafter, a method of extracting the m-th region information in the linear motion detection mode by the subject determining unit 236 will be described with reference to FIG. 6.

FIG. 6 is a diagram illustrating a method of distinguishing areas of subject image data and movement of a plurality of center points generated by the present invention.

Referring to FIG. 6, the subject image data 610 may be divided into a plurality of regions as image data calculated by comparing the glossy image data and the matte image data as described above. For example, as shown in FIG. 3, the subject image data 610 includes (a) areas 610-1, (b) areas 610-2, (c) areas 610-3, and ( d) may be divided into an area 610-4. Accordingly, the object determining unit 236 may extract m-th region information by analyzing coordinates of the m-th center point. For example, when the m th center point 620-1 is located in the region (610-1), the object determining unit 236 may extract m-th region information as 'a'. In the same way, when the m + 1 center point is located in the region (610) (b), the subject determining unit 236 may extract m + 1 region information as 'b'.

At this time, since the number of each area included in the subject image data 610 is only an example, it is obvious that the scope of the present invention is not limited thereto. In addition, in FIG. 3, the case where each region is equally divided has been described as an example, but each region may be divided evenly. For example, since the subject 140 may move most quickly near the center of the image sensor unit 218, areas (a) 610-1 and (d) which are end regions of the subject image data 610. FIG. The region 610-4 may be relatively narrowly divided, and (b) regions 610-2 and (c) regions 610-3, which are intermediate portions of the subject image data 610, may be relatively broadly divided. . Therefore, it is obvious that the area of each region constituting the subject image data 610 also does not limit the scope of rights of the present invention.

Also, the object determining unit 236 compares the m-th region information and the m-th region information extracted immediately before the m-th region information is extracted. When the m-th area information is the same as the m-th area information, it may mean that the subject 140 does not move up or down or moves very slightly. If different, this may mean that the subject 140 is moved up and down. Accordingly, when the m-th region information and the m-th region information are the same, the subject determining unit 236 may transition to the standby state and extract m-th region information corresponding to the m-th center point when the m-th center point is extracted. have.

However, the subject determining unit 236 may generate the m th center point movement information when the m th region information and the m th -th region information are not the same. For example, as shown in FIG. 3, the m-th center point 620-1 is located in (a) area 610-1, and the m-th center point 620-2 is located in (b) area 620- Assume that it is located in 2). In this case, the object determining unit 236 may extract m-th region information as 'a' and m-th region information as 'b'. Accordingly, the subject determining unit 236 compares the m-th region information and the m-th region information, and as a result, the center point has moved from the region (a) to the region (610-1) to the region (b), so that the subject 140 moves to the right. It can be seen that the movement, and corresponding to the m center point movement information can be generated.

Also, the m th center point movement information may include the m th center point movement direction information. In this case, the m-th center point moving direction information may be information indicating whether the movement of the subject 140 is a right motion or a left motion. For example, when the m-th region information is 'a' and the m-th region information is 'b', the subject determining unit 236 recognizes the movement of the subject 140 as a right motion and corresponds to the m-th center point. Movement direction information can be generated. On the contrary, when the m-th region information is 'b' and the m-th movement information is 'a', the subject determining unit 236 recognizes the movement of the subject 140 as the left motion and provides the corresponding m-th center point moving direction information. Can be generated.

The m th center point movement information may also include the m th center point movement distance information. The m-th center point moving distance information may be information indicating a distance moved by the subject 140. For example, when the m-th region information is 'a' and the m-th region information is 'c', the object determining unit 236 moves twice as much as when the m-th region information is 'b'. Recognizing to generate the corresponding m-th center point moving distance information. In the same way, when the m-th region information is 'd' and the m-th region information is 'a', the object determining unit 236 recognizes that the m-th region information is moved three times as much as when it is 'b'. Thus, the m-th center point may generate movement distance information. This is because the subject 140 does not always move in a constant direction and speed.

However, when the linear motion of the subject 140 is detected by the above-described method, there may be a problem in that the right and left motions of the subject 140 are alternately recognized. For example, it is assumed that the subject 140 is a user's finger, and the user adjusts the output volume using the subject 140. In this case, when the user wants to continuously reduce the volume of the output, the user may repeatedly perform the left operation using the subject 140. In this case, the subject 140 moves left again after the one-time left operation. In order to repeat the operation, one right operation will be generally performed. Accordingly, the object determining unit 236 generates the m-th center movement information corresponding to the left operation and outputs it to the main controller (not shown). Again, the m + p center point movement information corresponding to the right operation will be generated (where p is a natural number).

Of course, when the subject 140 performs the right operation outside the wide angle of the image sensor unit 218 after the left operation or the left operation again without the right operation using a separate subject (for example, another finger). In the case of performing the above problem, the above-described problem will not occur, but this causes a problem for the user.

Therefore, in order to solve the above-described problem, it is assumed that a light transmitting unit (not shown) is provided on the light source unit 214 and / or the image sensor unit 218. In this case, the light transmitting unit may be a transparent plate made of plastic or glass, and the object determining unit 236 may detect the movement of the subject 140 when the subject 140 moves in contact with the light transmitting unit (not shown). On the contrary, the subject determiner 236 may not detect the movement of the subject 140 when the subject 140 moves while the subject 140 is not in contact with the light emitter.

In addition, in order to solve the above-described problem, the subject determining unit 236 may detect only a predetermined operation in detecting the movement of the subject 140. That is, the subject determiner 236 may detect only one of the left operation and the right operation by the user's selection in the linear motion detection mode. For example, the subject determiner 236 may not detect the right motion of the subject 140 in the left motion detection mode for detecting the left motion.

Hereinafter, a method of determining whether the subject determining unit 236 or the subject 140 contacts the light transmitting unit (not shown) will be described with reference to FIGS. 7A and 7B.

FIG. 7A illustrates an embodiment of an mth reference pixel region and a contact identification region captured by the present invention, and FIG. 7B illustrates another embodiment of an mth reference pixel region and a contact identification region captured by the present invention. The figure shown.

7A and 7B, six contact identification areas 710-1, 710-2, 710-3, 710-4, 710-5 and 710-6, hereinafter referred to as '710' are subjects. The case where each corner part of the image data 700-1 and 700-2 is located near the center of the upper surface and the lower surface is shown. In this case, the plurality of contact identification areas may be one or more coordinates (or coordinate groups) preset in the subject image data in order to determine whether the subject determining unit 236 contacts the light emitting unit (not shown) of the subject 140.

In this case, it is assumed that the object determining unit 236 recognizes that the subject 140 contacts the light transmitting part when the m-th reference pixel area includes two or more contact identification areas 710. Referring to FIG. 7A, a case in which the m th reference pixel region 720-1 includes two contact identification regions is illustrated. Therefore, in this case, the subject determining unit 236 may recognize that the subject 140 contacts the light transmitting unit. 7B, a case in which the m th reference pixel region 720-1 does not include the contact identification region 710 is illustrated. In this case, the subject determining unit 236 may recognize that the subject 140 is not in contact with the light transmitting unit. In this case, the m th reference pixel region may be a coordinate group of the m th reference pixels constituting the subject image captured by the subject image data 610.

That is, since the m-th reference identification region when the subject 140 contacts the light emitter is larger than the case where the subject 140 does not touch the light emitter, the subject determining unit 236 uses the subject ( It is possible to distinguish whether or not the light emitting unit contacts 140. However, there may be a case in which the m-th reference identification region may include a preset number (in this case, two or more) of the contact identification regions 710 even when the subject 140 does not contact the light transmitting portion, which is the subject image. This can be solved by adjusting the width and / or length of the data. In addition, it may be solved by adjusting the size of the contact identification area 710.

Accordingly, the object determining unit 236 may detect the movement of the subject 140 when the m-th reference identification area includes the contact identification area 710 of a preset number or more. On the contrary, the subject determining unit 236 may not detect the movement of the subject when the m-th reference identification region does not include more than a preset number of contact identification regions 710.

In addition, the object determining unit 236 may generate a function execution command (hereinafter, referred to as a 'linear function execution command') corresponding to the m-th center point movement information and output the same to a main controller (not shown). That is, assuming that the volume output from the mobile communication terminal 100 is adjusted according to the linear operation of the subject 140, the subject determining unit 236 may move the m th center point included in the m th center point moving information. Information and / or the m-th center point may generate a linear function execution command for volume adjustment in accordance with the movement distance information, and the main controller (not shown) receiving the same may control the mobile communication terminal 100 for the corresponding volume adjustment. You can control other components of.

In addition, the subject determining unit 236 may determine whether to receive the end command after outputting the linear function execution command. In this case, the end command may be a signal corresponding to the manipulation of the keypad 130 for the user to end the linear motion detection mode. For example, when the user manipulates the keypad unit 130, the keypad unit may generate an end command for terminating the linear motion detection mode correspondingly and output the end command to the subject determining unit 136. The subject determining unit 236 may end the linear motion sensing mode when receiving the end command, and may continuously detect the linear motion of the subject 140 again when the subject command is not received.

Here, although the object determining unit 236 detects the left and right motions of the subject 140 during the linear motion of the subject 140 in the linear motion detection mode, it detects the up and down motion of the subject 140. In this case, it is obvious that the above-described method may be applied in the same or similar manner.

Referring back to FIG. 2, the storage unit 240 is a memory module included in the subject movement detecting mouse 200 and may include a flash memory or other nonvolatile memory. In addition, the storage unit 240 may be connected to the image processor 230 and may store various data for the operation of the subject movement detecting mouse 200. In particular, the storage unit 240 may sequentially store the m-th subject center point and / or the m-th background center point of the subject 140 calculated by the center determination unit 232. In addition, the storage unit 240 may include the m-th subject size information, the reference subject size information, the click information, the atmospheric information, and various boundary values (ie, the first boundary value and the second boundary value) sequentially extracted by the subject determination unit 236. And a first reference pixel boundary value, etc.).

8 is a flowchart illustrating a method of detecting a subject motion according to the present invention.

Hereinafter, an embodiment of a subject motion detection method according to the present invention will be described with reference to FIG. 8.

In operation S810, the image sensor unit 218 photographs the subject 140 while the light source unit 214 is activated, that is, outputs light, and generates glossy image data and outputs the image data to the image processor 230. do.

In operation S820, the image sensor unit 218 photographs the subject 140 while the light source unit 214 is inactivated, that is, does not output light, thereby generating matt image data and generating the image processor 230. Will output

At this time, the light source unit 214 may be turned on at a predetermined time interval under the control of the main control unit (not shown), and the image sensor unit 218 deactivates the light source unit 214 immediately after generating the glossy image data. When the matte image data can be generated.

In operation S830, the subject extracting unit 231 generates subject image data by comparing the matte image data and the matte image data received from the imaging unit 210.

In operation S840, the center determination unit 232 analyzes the subject image data generated by the subject extraction unit 231, and extracts the reference pixel on which the subject 140 is photographed to determine the center point of the subject image.

In operation S850, the center determination unit 232 extracts a coordinate value of the reference pixel, and in operation S860, the center determination unit 232 calculates a center point of the subject image.

Here, the method of generating the subject image data and the method of calculating the center point of the subject image have been described above, and a detailed description thereof will be omitted herein.

In operation S870, the motion of the subject 140 is detected to generate a corresponding function execution command (for example, a click function execution command when the movement of the subject 140 is a click operation) to the main controller (not shown). Is output. That is, the movement of the subject 140 is determined using the extracted reference pixel, and a corresponding function execution command is generated and output to the main controller (not shown). Hereinafter, a process of generating a function execution command corresponding to the movement of the subject 140 will be described with reference to FIGS. 9, 10, and 11.

9 is a flowchart illustrating a method of detecting a subject motion according to an embodiment of the present invention.

Hereinafter, a method of detecting a subject motion according to an exemplary embodiment of the present invention will be described with reference to FIG. 9. Here, the method of detecting the click operation of the subject 140 by the subject determiner 236 in the click operation detection mode will be described. In addition, each step to be described below may be in a state where steps S810 to S850 described above with reference to FIG. 8 are performed, and each step is assumed to be an operation performed by the object determining unit 236.

In step S910, the m th subject size information is calculated using the extracted subject image data.

In operation S920, the m th subject size information is compared with a preset first boundary value. As a result of comparison, when the m-th subject size information is smaller than the first threshold value, since the subject 140 is not close to the image sensor unit 218 for the click operation, the m-th subject size information is calculated. This is represented by the 'm = m + 1' block in FIG.

On the other hand, when the m-th subject size information is larger than the first boundary value as a result of the comparison, since the subject 140 is close to the image sensor unit 218 for the click operation, measurement of the click information is started (step S930).

In step S940, the k-th subject size information is calculated using the following subject image data. In this case, k may be a natural number larger than m, which is represented by a block 'k = m + 1' in FIG. 8.

In operation S950, the k-th subject size information is compared with the first boundary value. As a result of comparison, when the k-th object size information is larger than the first threshold value, since the object 140 is not far from the image sensor unit 218 for a full click operation, the k-th object size information is calculated again. . This is represented by the block 'k = k + 1' in FIG. 8.

On the contrary, when the k-th subject size information is smaller than the first threshold value, the click operation of the subject 140 is performed, and thus the click information measurement is terminated (step S960).

In step S970, a click function execution command corresponding to the generated click information is generated and output to the main controller (not shown). However, in order to detect the correct click operation, the time (that is, the waiting time) for which the state of the first subject size information is smaller than the preset second threshold value may be measured (that is, the waiting time). As described above, the execution command may be generated and output to the main controller (not shown).

In step S980, it is determined whether a termination command is received. In this case, the end command may be a signal corresponding to the manipulation of the keypad 130 of the user when the user wants to end the detection of the click operation of the subject 140.

If the end command is received, the end of the click operation detection of the subject 140 is terminated. If the end command is not received, the process returns to the standby state to calculate k + 1th object size information to calculate the click operation of the subject 140. You can continue to detect. This is represented by the 'm = k + 1' block in FIG.

10 is a flowchart illustrating a method of detecting a subject motion according to another embodiment of the present invention. Here, the method of detecting the perspective motion of the subject 140 by the subject determiner 236 in the perspective motion detection mode will be described. In addition, each step to be described below may be in a state where steps S810 to S850 described above with reference to FIG. 8 are performed, and each step is assumed to be an operation performed by the object determining unit 236. In the following description, it is assumed that the reference subject size information is set by the user's selection. However, when the reference subject size information is set in advance, the following steps S1010 to S1040 may be omitted.

In step S1010, the m th subject size information is calculated using the extracted subject image data.

In operation S1020, the m-th subject size information is compared with a preset third threshold value and / or fourth threshold value. As a result of comparison, when the m-th subject size information is smaller than the third threshold value, since the subject 140 is not close to the image sensor unit 218, it is not appropriate to calculate the reference subject size information, and the m + 1 subject size Calculate the information. In addition, when the m-th subject size information is larger than the fourth threshold value, the object 140 is excessively close to the image sensor unit 218 and is not suitable for calculating the reference subject size information. Calculate the information. This is represented by the 'm = m + 1' block in FIG.

In this case, an error signal may be output to the main controller (not shown) in order to allow the user to position the subject 140 closer to or slightly closer to the imaging unit 210 (step S1025). In addition, the main controller (not shown) that receives this may cause a display (eg, an alarm, an error signal display window, etc.) corresponding to the error signal to be displayed on the display unit 150.

In operation S1030, when the m th subject size information is a value between the third threshold value and the fourth threshold value, it is determined whether a reference subject size information generation command is input. As a result of the determination, when the command to generate the reference subject size information is not input, the m + 1th object size information is generated. This is represented by the 'm = m + 1' block in FIG.

 On the contrary, when the command for generating the reference subject size information is input, the reference subject size information is generated and stored in the storage unit 240 according to the m-th subject size information (step S1040).

In step S1050, the k-th subject size information is calculated, and the calculated k-th subject size information is compared with the reference subject size information (step S1060).

In operation S1070, a pointer size change command is generated and output to the main controller (not shown) corresponding to the step of comparing the calculated k-th subject size information with the reference subject size information.

In step S1080, it is determined whether a termination command is received. In this case, the end command may be a signal corresponding to a manipulation of the button unit (not shown) of the user and / or the keypad unit 135 of the notebook computer 130. That is, the user may manipulate the button unit (not shown) and / or the keypad unit 135 of the notebook computer 130 to terminate the operation of the subject determining unit 2236 in the perspective motion detection mode, and the button unit (Not shown) and / or the keypad unit 135 of the notebook computer 130 may output a corresponding termination command to the subject determining unit 236.

As a result, when the end command is received, the detection of the perspective motion of the subject 140 is terminated. If the end command is not received, the k + 1th object size information may be calculated and compared with the reference subject size information. This is represented by a 'k = k + 1' block in FIG.

11 is a flowchart illustrating a method of detecting a subject motion according to another embodiment of the present invention.

Referring to FIG. 11, a method in which the subject determining unit 236 detects a linear motion of the subject 140 in the linear motion detection mode will be described. In addition, each step to be described below may be in a state where steps S810 to S860 described above with reference to FIG. 8 are performed, and each step is assumed to be an operation performed by the object determining unit 236.

In operation S1110, the m-th region information corresponding to the m-th center point is extracted and stored.

In operation S1120, the m-th region information is compared with the m-th region information. In this case, the m-th region information may be region information extracted immediately before the m-th region information is extracted.

If the m-th region information is the same as the m-th region information, the object 140 is not moved. Therefore, when the m-th center point is calculated by transitioning to the standby state, the m-th region information is calculated. This is represented by the 'm = m + 1' block in FIG.

If the m-th region information is not the same as the m-th region information, since the subject 140 is moved, the m-th center point movement information is generated (step S1130). The m th center point moving information may include the m th center point moving direction information and / or the m th center point moving distance information, and a method of generating the m th center point moving direction information is described above.

In operation S1140, a linear function execution command corresponding to the m th center point movement information is generated and output to the main controller (not shown).

In step S1150, it is determined whether an end command is received. In this case, when the user wants to end the detection of the linear motion of the subject 140, the end command may be a signal corresponding to the manipulation of the keypad 130 of the user.

When the end command is received, the linear motion detection of the subject 140 is terminated, and when the end command is not received, the process returns to the standby state, and when the m + 1 center point is calculated, the m + 1 area information is extracted. The linear motion of the subject 140 may be detected. This is represented by the 'm = m + 1' block in FIG.

12 is a block diagram of a subject motion detection mouse according to another embodiment of the present invention.

Referring to FIG. 12, the subject motion detecting mouse 1200 according to another exemplary embodiment may include an imaging unit 1210, an image processing unit 1230, and a storage unit 1240, and an imaging unit 1210. The light source unit 1211 may include a filter unit 1213, a lens unit 1216, and an image sensor unit 1219. The image processing unit 1230 may include a sharpness adjusting unit 1231, an outline extracting unit 1233, and a gamma. It may include a corrector 1235, a center determiner 1237, a pointer position setter 1239, and a subject determiner 1239-1. Hereinafter, the operation of each component will be described in detail.

Here, each component of the image capturing unit 1210 has the same operation as that of the image capturing unit 210 configuring the object motion detecting mouse 200 according to the embodiment described above with reference to FIG. 2. Or similar, so detailed description thereof will be omitted here. However, the light source unit 1211 may not be turned on at a predetermined time interval, and may always output light during the activated time. In addition, as described above, the light source unit 1211 may not be provided and other light sources (for example, sunlight) may be used.

The image processor 1230 extracts coordinate values corresponding to the movement of the subject 140 from the image data of the subject recognized by the image sensor 1219 (hereinafter, referred to as 'first image data'). In detail, the sharpness controller 1231 may adjust the sharpness of the first image data of the photographed subject 140 to generate subject image data different from the first image data. That is, the sharpness controller 1231 may adjust the sharpness by increasing one or more of color contrast, brightness contrast, and saturation contrast of pixels of the first image data.

Here, the sharpness of the image indicates the clarity of the contrast boundary portion of the image. When the sharpness of the image of the subject 140 increases, the clarity of the boundary portion increases, so that the subject 140 is moved. In the captured image, there is an advantage of easily identifying an outline (or an edge) of only a predetermined subject 140. That is, the sharpness may be increased by increasing any one of color contrast, brightness contrast, and saturation contrast with respect to pixels having high sharpness. Here, the sharpness of the image of the subject 140 is expressed differently according to the depth of field of the lens unit 1216, that is, within the range where the image of the subject 140 generated by the lens unit 1216 can be clearly seen. Can be. In general, the outline of the subject 140 located at a distance similar to the focal length of the lens unit 1216 has a high sharpness, but the background located far from the focal length of the lens unit 1216 has a low sharpness.

That is, when the sharpness adjuster 1231 is used, the outline of the subject 140 positioned at a distance similar to the focal length of the lens unit 1216 will increase sharply, but at a distance far from the focal length of the lens unit 1216. The background where it is located can be made less sharp. Therefore, the sharpness adjuster 1231 makes the outline of the subject 140 larger than the background.

The outline extractor 1233 extracts the difference between the first image data generated by capturing the subject 140 and the subject image data processed by the image, extracts the outline of the subject 140, and sequentially stores the outline in the storage unit 1240. Save as. That is, the difference between the first image data having high sharpness generated by the sharpness controller 1231 and the subject image data of the photographed subject 140 may represent an outline of the subject 140. The outline of the extracted subject 140 may be an outline of one end of the subject 140 adjacent to the imaging unit 1210.

Here, an outline corresponding to one end of the subject 140 may be extracted by extracting a difference value having a luminance value greater than a preset reference luminance value. The reference luminance value may remove noise generated by light entering the imaging unit 1210 from a background other than the subject 140. That is, since the sharpness of the first image data generated by the sharpness adjuster 1231 may be adjusted not only by the image data of the subject 140 but also by the background image data, only the image data having a difference value greater than or equal to the reference luminance value may be outlined. The recognition efficiency of the subject 140 may be improved by recognizing the image. Here, the reference luminance value may be fixed or may vary according to the number of pixels having a predetermined luminance value or more, which will be described later with reference to FIG. 10.

The gamma correction unit 1235 gamma-corrects the image data of the subject 140. Here, gamma of an image is generally a slope of a straight line when input / output specification is indicated by positive and large contractions in a photoelectric conversion system or an all-optical conversion system such as a television, a camera, a fax transceiver, and the like. That is, the television displays the logarithmic ratio between the camera output voltage for the brightness of the subject 140 and the cathode ray tube brightness for the input voltage of the receiver. Since the luminance value of each pixel may be changed by gamma correction according to an exemplary embodiment of the present invention, only a portion of the sharpness of the subject 140 is displayed, and a portion of the remaining sharpness remains black. Therefore, only the outline of the predetermined subject 140 is brightly displayed in the image photographing the subject 140, so that it may be determined whether or not the subject 140 is moved.

The center determiner 1237 may track a predetermined outline from the gamma corrected image and extract a coordinate value determined by the predetermined outline. Here, the predetermined outline may have various shapes. For example, it may be a circular outline, and the coordinate value determined by the predetermined outline may be a center point determined by the circular outline, that is, a coordinate value of the center of the circle. In general, since the subject 140 used for the motion extraction may be one end of the user's finger, the center determination unit 1237 extracts a circular outline, which is one end of the finger, to calculate the movement of the subject 140. Can be.

The center determiner 1237 calculates specific coordinates located inside the figure formed by the outline of the subject extracted by the gamma corrector 1235. There may be a number of ways to calculate this particular coordinate. For example, the center determiner 1237 may extract a coordinate value of the center of gravity or the center point of the figure formed by the outline of the subject 140.

The center of gravity, which is a specific coordinate located inside the figure formed by the outline of the subject 140, may be calculated by the following equation.

(7)

(7)

(8)

(8)

(9)

(9)

 Here, R is the center of gravity, M is the sum of the luminance values of the pixels representing the outline of the subject 140 (hereinafter, referred to as 'outline pixels'), mi is the luminance value of the outline pixel of the subject 140, ri Is a coordinate value of the outline pixel. The subscripts x and y represent the values corresponding to the X and Y axes, respectively, and Equation (9) is a vector representation of Equations (7) and (8).

In addition, when the center determination unit 1237 determines the center point of the image of the subject 140 by the above-described equation, the center determination unit 1237 needs to reflect all the luminance values of the outline pixels, thereby increasing the amount of computation. Problems may occur that degrade the overall functionality. Therefore, according to another embodiment, the center of gravity, which is a specific coordinate located inside the figure formed by the outline of the subject 140, may also be calculated by the following equation.

(10)

10

(11)

(11)

(12)

(12)

Where R is the center of gravity, ri is the coordinate value of the outline pixel, and n is the number of outline pixels. Subscripts x and y represent values corresponding to the X and Y axes, respectively, and Equation (12) is a vector representation of Equation (10) and Equation (11).

That is, the center determiner 1237 may determine the center point of the image of the subject 140 without reflecting the luminance value of the pixel. Since the luminance value of each pixel will not have a large difference, the center determination unit 1237 may calculate the average value of the coordinate values of the outline pixel as the center point of the image of the subject 140 without reflecting it.

Alternatively, when the outline of the subject 140 is curved, the center determiner 1237 may calculate a radius of curvature and extract a coordinate value of a center point corresponding to the radius of curvature. If the predetermined outline is a quadrangle, the center judging unit 1237 may extract a coordinate value where the diagonal of the quad meets as a coordinate value determined by the predetermined outline, and in the case of another polygon, vertices facing each other. It can also be extracted as coordinates that meet two or more lines. For example, the center determiner 1237 may calculate a distance between each pixel representing a curved outline, and may use the intermediate value of two pixels having the largest calculated distance of each pixel as coordinate values of the center point. In another example, since the intermediate value may be represented as coordinate values for the X and Y axes in the case of a two-dimensional display, the center determination unit 1237 may have the largest difference in the coordinate values for the X or Y axes. The intermediate value between two large pixels may be extracted as the coordinate value of the center point.

In addition, the center determiner 1237 calculates a coordinate value (hereinafter, referred to as a “center point”) of the center point and stores it in the storage 1240. That is, the center determination unit 1237 may allow the storage unit 1240 to store information about the center point calculated by the above-described method.

The pointer position setting unit 1239 generates a pointer movement command so that the pointer is positioned at a specific position of the display unit 150 (that is, the display unit of the electronic device to which the subject movement detecting mouse 200 is connected) and outputs a main controller (not shown). do. That is, the pointer position setting unit 1239 moves the pointer so that the position of the pointer 150-1 of the display unit 150 corresponds to a specific coordinate (for example, the center of gravity of the outline on the subject image data). A command may be generated and output to a main controller (not shown). In this case, the pointer movement command may be a signal corresponding to the coordinate value of the center of gravity, and the main controller (not shown) that receives the pointer movement command is the pointer 150-1 of the display unit 150 at the coordinates corresponding to the pointer movement command. ) Can be controlled to be positioned.

The pointer position setting unit 1239 controls the pointer of the display unit (not shown) to be positioned at the calculated specific coordinates. That is, the pointer position setting unit 1239 may control the position of the pointer to correspond to a specific coordinate (for example, the center of gravity or the coordinate value of the center point of the outline of the subject 140). That is, when the calculated specific coordinate is located above the preset pixel, a function of increasing the position of the bar, which means the volume, may be performed.

The object determining unit 1239-1 performs a function corresponding to the movement of the subject 140 using the outline determined by the outline extracting unit 1233 (hereinafter, referred to as' m 'outline' (m is a natural number)). A command (for example, a click function execution command, a pointer size change command, a linear function execution command, etc.) is generated and outputted to the main controller (not shown). Detailed operations of the subject determining unit 1239-1 (hereinafter, referred to as a second subject determining unit) may include configuring the subject motion detecting mouse 200 according to an exemplary embodiment of the present invention described above with reference to FIG. 2. It is the same as or similar to the subject determining unit 236 (hereinafter, referred to as 'first subject determining unit 236'). That is, the second subject determiner 1239-1 generates m-th subject size information similar to the first subject determiner 236, and generates a function execution command corresponding to the m-th subject size information, which is then transferred to the main controller (not shown). Output

However, as described above, the first subject determiner 236 generates the m-th subject size information by using the subject image data comparing the matte image data with the matte image data, but the second subject determiner 1239-1. Extracts the m-th outline using the first image data and the subject image data processed from the first image data, and generates m-th subject size information and / or m-th region information.

That is, the second subject determiner 1239-1 calculates m-th subject size information and / or m-th region information by using the m-th outline. For example, when the subject 140 is a user's finger, the m-th outline of the image of the subject 140 may be circular (or semicircular). Therefore, the m-th subject size information may be information corresponding to the diameter (or radius) of the m-th outline. In addition, the m-th subject size information may be information corresponding to the number of pixels existing in the figure of the m-th outline pixel.

Hereinafter, referring to FIG. 13, a setting method for a reference luminance value used for pointer movement control will be described.

FIG. 13 illustrates a method for setting a reference luminance value used in a subject movement detecting mouse according to another exemplary embodiment of the present invention.

FIG. 13 is a diagram illustrating a method for setting a reference luminance value used in controlling pointer movement according to the first embodiment of the present invention. A first reference luminance value 1350, a time point 1353 of the first reference pixel number, a first luminance lower limit value 1355, a luminance range a corresponding to the first reference pixel number, and a second reference luminance value 1360. 2, a luminance range b corresponding to the viewpoint 1363 of the number of the second reference pixels, the second lower luminance value 1365, and the number of the second reference pixels is illustrated. Here, the first or the second is used to describe two embodiments in which the number of reference pixels is different, and will be omitted and collectively described below.

The reference luminance value 1350 or 1360 is provided to compare the luminance value of each pixel to extract the outline of the subject 140. Hereinafter, it is assumed that the resolution of the image sensor unit 1319 is 640 * 480 (horizontal * vertical), and the luminance value of each pixel is configured between 0 and 255. When the luminance value is '0', it will be black because it is the darkest case, and when the luminance value is '255', it will be expressed as white because it is the brightest case.

In addition, referring to FIG. 13, the reference luminance value 1350 or 1360 may change according to the number of pixels having a predetermined luminance value or more. The outline extractor 1333 sets the number of reference pixels and extracts a large luminance value in order to extract pixels corresponding to the outline of the subject 140. For example, when the number of reference pixels is set in consideration of the amount of calculation, 10000 pixels are extracted from the histogram stored in the buffer prepared in advance in order of increasing luminance, and the pixels corresponding to the 10000th pixels (the starting point of the number of reference pixels 1353). 1363) may be the reference luminance value 1350 or 1360. Therefore, luminance ranges a and b corresponding to the number of reference pixels may be determined. Here, since the luminance value of each pixel is stored in the buffer, the reference luminance value may be calculated by counting the number of pixels in order of decreasing luminance value. That is, if the total number of pixels is stored in the buffer, the reference luminance value may be calculated by extracting the luminance values in the order in which the luminance values are smaller by the total number of pixels minus the number of reference pixels.

In this case, when the number of reference pixels is too large, most pixels will be extracted to the outline of the subject 140, and vice versa, very few pixels will be extracted to the outline of the subject 140. When the reference luminance value is too small (that is, when the number of reference pixels is too large), pixels irrelevant to the outline of the subject 140 (for example, pixels for the background portion) may be extracted, and thus the luminance lower limit value 1355 , 1365, the lower limit values 1355 and 1365 may be set as the reference luminance value when the reference luminance value is smaller than this. In addition, when the reference luminance value is too large (that is, when the number of reference pixels is too small), the minimum number of pixels constituting the outline of the subject 140 may not be extracted. Can be set. Here, the lower limit luminance values 1355 and 1365 and the upper limit luminance may be generally provided, respectively. Referring to FIG. 13, when the lower luminance values 1355 and 1365 change, the reference luminance values 1350 and 260 change. The case is shown.

For example, if the number of reference pixels is 10000 and the lower luminance limits (1355 and 1365) are 50, each pixel is analyzed and 10000 pixels are extracted in the order of the higher luminance values. Is set to the reference luminance value. On the contrary, assuming that the number of reference pixels is 10000 and the upper limit of luminance is 200, 10000 pixels are extracted in order of increasing luminance, and the luminance value of the 10000th pixel and the smaller of 200 are set as the reference luminance values.

Further, according to another embodiment, the reference luminance value may be fixed to a specific value. For example, a pixel having a reference luminance value of 100 and above may be recognized as an outline of the subject 140. It goes without saying that the above-mentioned lower limit of luminance and upper limit of luminance can be applied even when the reference luminance is fixed.

In addition, although the control unit for controlling the operation of the subject movement detection mouse 1200 is not provided separately, the subject movement detection mouse 1200 may be provided with a control unit (not shown) for controlling the overall operation. It is obvious to those skilled in the art. In addition, the subject motion detection mouse 1200 may be controlled by a main controller (not shown) for controlling the overall operation of the electronic device including the subject motion detection mouse 1200 without having a separate controller. Self-explanatory

14 is a flowchart illustrating a method of detecting a subject motion according to another embodiment of the present invention.

Hereinafter, a method of detecting a subject motion according to another exemplary embodiment of the present invention will be described with reference to FIG. 14.

In operation S1410, the imaging unit 1210 photographs an image including the subject 140 to generate first image data.

In operation S1420, the sharpness controller 1231 adjusts the sharpness of the image of the photographed subject 140 to generate subject image data. Here, the sharpness control may vary according to the depth of the image. That is, as described above, in the case of the outline of the subject 140 positioned near the focal length of the lens unit 1216, the sharpness may be greatly increased as compared to the image that is the background.

In operation S1430, the outline extracting unit 1233 calculates a difference value between the generated second image data and the subject image data, and the gamma correction unit 1235 performs gamma correction on the calculated difference value to obtain a luminance value of the subject outline. Can be increased (step S1440). Therefore, the outline of the image of the subject 140 photographed from the gamma-corrected difference value can be made clear. Here, the difference value is calculated for every pixel, and the following steps are performed individually for each pixel.

In operation S1450, the outline extractor 1233 checks whether a difference value between the first image data and the subject image data is greater than a preset reference luminance value. When the difference value is larger than the preset reference luminance value, these pixels are extracted with an outline corresponding to one end of the subject. However, if the difference value is smaller than the preset reference luminance value, it is checked whether the difference value for the next pixel is larger than the preset reference luminance value. If the difference value for the pixels is smaller than the preset reference luminance value, the first step is performed. Return to the previous step can be repeated again. As described above, the reference luminance value may be set corresponding to the fixed or reference pixel number.

In operation S1460, the outline extracting unit 1233 extracts an outline corresponding to one end of the subject 140 from a coordinate value in which a difference value between the first image data and the subject image data is larger than a preset reference luminance value and extracts the storage unit ( 1240). The method of extracting the outline by checking whether the difference value between the first image data and the subject image data is larger than the preset reference luminance value is described above in the outline extracting unit 1233, and thus, a detailed description thereof will be omitted.

In operation S1470, the center determiner 1237 calculates an image center point using an outline of the photographed subject 140 and stores the image center point in the storage 1240. That is, the above-described center of gravity may be obtained or the radius of curvature may be calculated from the extracted outline of the subject and the coordinate value of the center point corresponding to the radius of curvature may be extracted. Alternatively, the distance between each pixel representing the circular outline formed by the outline of the subject is calculated without separately calculating the radius of curvature, and the coordinate value of the current center point is obtained by using the median value of the two pixels having the largest calculated distance of each pixel. You can also extract In addition, the coordinate values of the current center point may be extracted by various preset methods.

In operation S1480, the second subject determiner 1239-1 determines the movement of the subject 140 by using the extracted outline, and executes a corresponding function execution command (for example, a click function execution command or a pointer size change command). Etc.) may be generated and output to a main controller (not shown). The method of generating the function execution command in the second subject determination unit 1239-1 is the same as or similar to the method of generating the function execution command in the first subject determination unit 236 described with reference to FIG. The determination unit 1239-1 is different from generating the m th center point moving information by using the m th outline.

In addition, as described above, the pointer position setting unit 1239 may control the pointer to be positioned to correspond to the coordinates of the center point using the calculated center point irrespective of step S1480.

FIG. 15 is a diagram illustrating an image generated by a subject motion detecting mouse according to another exemplary embodiment of the present invention.

Referring to FIG. 15, an original image 1510, a sharpness-adjusted image 1520, an image gamma corrected for the difference value 1530, an extracted center point 1540, and a circular outline 1550 are shown.

One end of the user's finger, which is the subject 140, in the original image 1510 has a round shape. Then, if the sharpness is adjusted according to the depth, the outline of the subject (user's finger) at a position similar to the focal length is increased as shown in the sharpness-adjusted image 1520, and the background that is not is relatively small. Subsequently, if the difference between the original image 1510 and the sharpness-adjusted image 1520 is obtained and the gamma value is increased as a whole, only the outline of one end of the user's finger having a high sharpness is shown in the gamma corrected image 1530. Therefore, the coordinate value of the center point described above can be extracted from the circular outline which is the outline of the subject, and the coordinate value of the center point from which the pointer of the display unit is extracted can be set.

FIG. 16 is a view illustrating an image generated by a subject motion detecting mouse according to another embodiment of the present invention when the brightness of the background is large, and FIG. 17 illustrates a subject according to another embodiment of the present invention when the brightness of the background is small. A diagram illustrating an image generated by a motion sensing mouse.

16 and 17, original images 1610 and 1710, sharpness adjusted images 1620 and 1720, gamma corrected images 1630 and 1730, extracted center points and circular outlines 1640 and 1440 are shown. do.

Referring to FIG. 16, the outline of the subject 10 may be extracted regardless of the brightness of the background. That is, when adjusting sharpness, not only the contour of the finger, which is the subject 140, but also a background light source formed in a straight line shape may be a problem. Appeared.

In addition, referring to FIG. 17, even when the subject 140, which is a finger, is lying down, the contour of the subject, which is a boundary value, may be extracted even when the object is not circular, that is, the outline is a semicircle. Therefore, according to an exemplary embodiment of the present invention, even if only one image frame is used, whether the subject 140 is moved or the coordinate value of the movement position may be obtained using the depth of the image.

Preferred embodiments of the present invention described above are disclosed for purposes of illustration, and those skilled in the art will be able to make various modifications, changes, and additions within the spirit and scope of the present invention. Additions should be considered to be within the scope of the following claims.

As described above, according to the present invention, there is an effect that various key inputs can be performed using a mouse provided with an imaging unit.

In addition, the present invention can omit a part of the key button of the existing mouse can increase the spatial utilization of the mouse, there is an effect that can be miniaturized the mouse.

In addition, the present invention also has the effect of simplifying the manufacturing process at the time of manufacturing the mouse by reducing the key button of the mouse can reduce the manufacturing cost.

In addition, the present invention can also be used on a transparent plate and there is an effect that can be used in a narrow space.

Preferred embodiments of the present invention described above are disclosed for purposes of illustration, and those skilled in the art will be able to make various modifications, changes, and additions within the spirit and scope of the present invention. Additions should be considered to be within the scope of the following claims.

Claims (26)

An imaging unit for photographing a subject; A subject extracting unit configured to generate subject image data by using image data photographed by the subject; A center point determination unit configured to analyze the subject image data and calculate an m th center point of the subject image in which the subject is captured; And Including a pointer position setting unit for generating and outputting a pointer movement command for positioning the pointer at a position corresponding to the m-th center point, M is a natural number. An imaging unit for photographing a subject; A subject extracting unit configured to generate subject image data by using image data photographed by the subject; And By comparing the m-th subject size information calculated by analyzing the subject image data with a first threshold value set in advance, after calculating the m-th subject size information, k-th subject size information corresponding to the photographed subject is calculated and And a subject determining unit configured to generate and output a corresponding click function execution command in comparison with the first threshold value. Wherein m is a natural number and k is a natural number greater than m. An imaging unit for photographing a subject; A subject extracting unit configured to generate subject image data by using image data photographed by the subject; And Analyzing the subject image data to calculate m-th subject size information, comparing the m-th subject size information with a preset reference pixel boundary value, and determining a subject to generate reference subject size information when a command to generate reference subject size information is input. Including wealth, The m is a natural number, and the subject determining unit generates the reference subject size information by using the result of comparing the m-th subject size information with the reference pixel boundary value. An imaging unit for photographing a subject; A subject extracting unit configured to generate subject image data by using image data photographed by the subject; A center point determination unit configured to analyze the subject image data and calculate an m th center point of the photographed subject image; And Extracting m-th area information corresponding to the m-th center point by using the m-th center point, and using the m-th center point by using the m-th area information and one or more area information extracted before the m-th area information is extracted And a subject determining unit generating movement information and generating and outputting a linear function execution command corresponding to the m th center point movement information. The m is a subject motion detection mouse, characterized in that two or more natural numbers. The method according to any one of claims 1, 2, 3 or 4, The imaging unit, A light source unit which is turned on at a predetermined time interval; And And an image sensor unit configured to photograph the subject while the light source unit is activated to generate the glossy image data, and to generate the matte image data by photographing the subject while the light source unit is inactivated. And the subject extracting unit generates subject image data by comparing the glossy image data with the matte image data. The method according to any one of claims 1, 2, 3 or 4, The imaging unit captures the first image data, The subject extractor may adjust the sharpness of the first image data to sequentially generate subject image data, and generate a difference value between the first image data and the subject image data to correspond to one end of the subject. m includes an outline extraction unit for extracting the outline, And the center point determiner calculates an m th center point corresponding to one end of the m th outline. The method according to any one of claims 1, 2, 3 or 4, The light emitting unit may further include a light transmitting part formed on an upper portion of the mouse movement detecting mouse case. The image capturing unit is a subject movement detection mouse, characterized in that located below the light transmitting portion. The method according to claim 1 or 4, And the m-th center point is a center of gravity of a subject image captured by the subject image data. The method of claim 8, And the center of gravity is generated by the following equation.

Where R is the center of gravity, ri is the coordinate value of the reference pixel, and n is the number of reference pixels. The method of claim 2, The subject determining unit generates the click function execution command when the m-th subject size information is larger than the first threshold value and the k-th subject size information is smaller than the first threshold value. mouse. The method of claim 10, After calculating the k-th subject size information, the subject determining unit calculates the first subject size information and compares it with a second preset threshold value. And l is a natural number larger than k, and outputs the click function execution command when the first subject size information is smaller than the second threshold value. The method of claim 10, When the first subject size information is smaller than the second threshold value, the subject determining unit starts measuring atmospheric information. And outputting the click function execution command when the waiting information passes a preset boundary time. The method of claim 3, The subject determining unit generates and outputs a pointer size change command corresponding to a result of comparing the k-th subject size information corresponding to the photographed subject and the reference subject size information, And k is a natural number greater than m. The method of claim 3, The reference pixel boundary value is a first reference pixel boundary value. And the subject determining unit generates and outputs an error command when the m-th subject size information is smaller than the first reference pixel boundary value. The method of claim 3, The reference pixel boundary value is a second reference pixel boundary value. And the subject determining unit generates and outputs an error command when the m-th subject size information is larger than the second reference pixel boundary value. The method of claim 4, wherein The subject determining unit compares the m-th region information and the m-th region information extracted immediately before the m-th region information is extracted to generate the m-th center point movement information. And the m-th center point movement information is generated when the m-th region information and the m-th region information are different. The method of claim 4, wherein The m th center point movement information comprises the m th center point movement direction information. The method of claim 4, wherein The m-th center point movement information includes the m-th center point movement distance information. Subject movement detection A method for detecting a movement of a subject by a mouse, Photographing the subject to generate subject image data; Calculating the m th center point of the subject image photographed from the subject by analyzing the subject image data; And Generating and outputting a pointer movement command for positioning the pointer at a position corresponding to the m th center point; M is a natural number. Subject movement detection A method for detecting a movement of a subject by a mouse, Photographing the subject to generate subject image data; Calculating m-th subject size information by analyzing the subject image data; Comparing the m-th subject size information with a preset first threshold value; After calculating the m th subject size information, calculating k th subject size information corresponding to the photographed subject and comparing the m th subject size information with the first threshold value; And Generating and outputting a click function execution command corresponding to a result of comparing the m-th subject size information with the first threshold and a result of comparing the k-th subject size information with the first threshold; M is a natural number, and k is a natural number greater than m. Subject movement detection A method for detecting a movement of a subject by a mouse, Photographing the subject to generate subject image data; Calculating m-th subject size information by analyzing the subject image data; Comparing the m-th subject size information with a preset reference pixel boundary value; Generating reference subject size information by using a result of comparing the m-th subject size information with the reference pixel boundary value when a command to generate reference subject size information is input; Calculating k th subject size information corresponding to the photographed subject and comparing the subject subject size information with the reference subject size information; And And generating and outputting a pointer size change command corresponding to a result of comparing the k-th subject size information with the reference subject size information. M is a natural number, and k is a natural number greater than m. Subject movement detection A method for detecting a movement of a subject by a mouse, Photographing the subject to generate subject image data; Analyzing the subject image data to calculate an m th center point of the image photographed from the subject; Extracting m-th region information corresponding to the m-th center point by using the m-th center point; Generating m-th center point shift information by using the m-th region information and one or more region information extracted before the m-th region information is extracted; And Generating and outputting a linear function execution command corresponding to the m th center point movement information; M is a natural number of two or more subjects. The method according to any one of claims 19, 20, 21 or 22, The generating of the subject image data may include: Generating a glossy image data by capturing the subject while the light source unit of the subject movement detecting mouse is activated; Photographing the subject while the light source unit is inactivated to generate matt image data; And And generating subject image data by comparing the polished image data with the matte image data. The method according to any one of claims 19, 20, 21 or 22, And the m-th center point is a center of gravity of the subject image captured by the subject image data. The method according to any one of claims 19, 20, 21 or 22, The generating of the subject image data may include: Imaging the subject to generate first image data; And And generating subject image data by adjusting the sharpness of the first image data. The method of claim 19 or 22, The generating of the subject image data may include: Imaging the subject to generate first image data; And Generating subject image data by adjusting the sharpness of the first image data; Computing the m th center point, Extracting an m-th outline for generating subject image data that is an outline corresponding to one end of the subject by extracting a difference value between the first image data and the subject image data; And And calculating an m-th center point corresponding to one end of the m-th outline.

Images