KR20110064106A - Method for recognition of gesture using potable terminal and potable terminal thereof - Google Patents

Abstract

PURPOSE: A gesture recognition method using a portable terminal and portable terminal are provided to perform corresponding operation. CONSTITUTION: A control unit(140) performs a command corresponding to a local area gesture sensed by suing a sensor unit(110) in low power state consuming power of power unit(130). The controller expresses a corresponding execution result on the display unit(120). The controller recognizes that the power is received form external side through the power unit.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a method for recognizing a gesture using a portable terminal,

The present invention relates to a gesture recognition method using a portable terminal that recognizes a gesture and adjusts a sensor output for sensing a user's operation according to a power status of the portable terminal, Terminal.

The mobile terminal is rapidly replacing a fixed telephone as a necessity for a call. Also, due to the development of the mobile communication network, the increase of the wireless contents, and the dramatic development of the processor and the memory provided in the portable terminal, the portable terminal has reached an age when it competes with the personal terminal such as a computer.

The change of the function of the portable terminal makes it possible to view various contents using the portable terminal and it is difficult to view the high quality contents for a long time due to the power limitation.

In particular, the portable terminal has evolved from a method of controlling a portable terminal using a conventional keypad or a touch pad to detect a gesture of a user and perform a corresponding operation. However, there is a problem that more power consumption is required to operate the portable terminal based on the user gesture than the conventional method, which limits the use of the portable terminal of the user.

Also, when power is supplied to the portable terminal by connecting the power line, as in the case where the portable terminal consumes the internal power, only the user gesture performed within a certain range is detected and a corresponding operation is performed There is a drawback to this. In addition, when external power is supplied to the portable terminal, since the portable terminal is mostly located at a position distant from the user's body, there is a problem that accuracy of the user terminal to detect the user gesture is reduced.

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the above-mentioned problems of the prior art, and it is an object of the present invention to improve the output of a sensor for detecting a gesture of a user when the portable terminal is switched from a power- A gesture recognizing method using a portable terminal capable of detecting a gesture and performing a corresponding operation, and a portable terminal thereof.

According to an aspect of the present invention, there is provided a portable terminal including a display unit for displaying information, a sensor unit for sensing a gesture of a user, a power source unit for supplying power, And outputs the execution result to the display unit. When the controller recognizes that power is supplied from the outside through the power unit, the sensor output of the sensor unit is increased to switch to a high power state, And a control unit for executing a command corresponding to the sensed distance gesture using the sensor unit and expressing the execution result on the display unit.

In the portable terminal of the present invention, the control unit recognizes that power is supplied from the outside through the power unit connected to the cradle.

In the portable terminal of the present invention, the control unit recognizes that electric power is supplied from the outside through the power supply unit by wire or wirelessly.

In the portable terminal of the present invention, the sensor unit may include a camera for photographing a gesture of a user, and the controller may determine the gesture by comparing pixels of the image information photographed by the camera in a time sequence, The command is executed.

In the portable terminal according to the present invention, the sensor unit may include a plurality of cameras for photographing a gesture of a user, and the control unit may transmit image information captured by a specific camera among the plurality of cameras and image information captured by another camera among the plurality of cameras Comparing the image information, determining a center point of the movement of the user, and determining the gesture using the movement information of the center point.

The portable terminal of the present invention may further include a storage unit for storing RGB (Red-Green-Blue) coordinate system information or HSI (Hue Saturation Intensity) coordinate system information, and the controller may control the RGB coordinate system or the HSI coordinate system And judges the gesture by comparing pixels having a change.

In the portable terminal of the present invention, the sensor unit may include a camera for photographing a gesture of a user, and the controller may control the camera to shoot an image according to the predetermined number of pixels in the low power state to determine the nearest gesture And controls the camera to shoot an image corresponding to the number of pixels larger than the preset number of pixels in the high power state to determine the remote gesture.

In the portable terminal of the present invention, the sensor unit may include at least one of an infrared sensor, a radio frequency (RF) sensor, and an ultrasonic sensor. The controller may control the position of the sensor unit, And the distance gesture or the distance gesture is judged.

In the portable terminal of the present invention, the sensor unit includes an infrared sensor, and the controller senses infrared rays irradiated from the user's body using the infrared sensor to determine the near-field gesture or the far-field gesture.

According to another aspect of the present invention, there is provided a method for recognizing a gesture using a portable terminal, the method comprising: executing a command corresponding to a local gesture sensed using a sensor in a low- A switching step of switching the output of the sensor to a high power state when the portable terminal recognizes that power is supplied from the outside, and a step of switching the remote gesture detected by the portable terminal to the high- And displaying a result of the execution on the display device.

In the gesture recognition method using the portable terminal of the present invention, the proximity sensing step or the remote sensing step may detect a gesture using at least one of a camera, an infrared sensor, an RF sensor, and an ultrasonic sensor .

In the gesture recognition method using the portable terminal of the present invention, the switching step is characterized in that the portable terminal recognizes that the portable terminal is connected to a cradle and receives power from the outside.

In the gesture recognition method using the portable terminal of the present invention, the switching step is characterized in that the portable terminal recognizes that electric power is supplied from the outside in a wired or wireless manner.

According to the present invention, in a state in which a user is located close to a portable terminal, such as a portable terminal, the portable terminal can recognize a gesture of a user performed at a short distance using a sensor and perform a corresponding operation, Or power is supplied from the outside to the portable terminal through wireless communication, the output of the corresponding sensor may be increased to recognize a user's gesture performed at a longer distance and perform a corresponding operation.

According to the present invention, it is possible to control the portable terminal by consuming a relatively small amount of power in a state in which the portable terminal is supplied with power from its own battery, and can detect the gesture of the user in an external power supply state, The user can control the portable terminal by sensing the gesture at a long distance.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the detailed description of known functions and configurations incorporated herein will be omitted when it may unnecessarily obscure the subject matter of the present invention. The same reference numerals are used for portions having similar functions and functions throughout the drawings.

1 is a configuration diagram of a mobile terminal 100 according to an embodiment of the present invention. 1, the portable terminal 100 includes a sensor unit 110, a display unit 120, a power source unit 130, a controller 140, and a storage unit 150.

The storage unit 150 is a storage unit for storing data or contents in the portable terminal 100. The storage unit 150 of the present invention may include a volatile or nonvolatile memory for storing information.

The power supply unit 130 serves to supply power for driving the portable terminal 100. The power supply unit 130 of the present invention includes an interface for receiving power from the outside in a wired or wireless manner and may include a battery or the like for supplying operation power within the portable terminal 100.

The display unit 120 is a device for the mobile terminal 100 to visually express an operation or internal data according to a user command. The display unit 120 of the present invention may include a display unit such as a liquid crystal display (LCD), a light emitting diode (LED), or an organic light emitting diode (OLED) liquid crystal display.

The sensor unit 110 includes a sensor for sensing the operation of the user of the portable terminal 100. For this operation, the sensor unit 110 may include, for example, a camera, an infrared sensor, a radio frequency (RF) sensor, or an ultrasonic sensor.

The controller 140 controls the overall operation of the portable terminal 100 and may include a processor or the like for performing the operations.

The state where the portable terminal 100 consumes power stored in the power supply unit 130 is referred to as a low power state and the state where the portable terminal 100 receives power from the outside through the power supply unit 130 is referred to as' State '.

In the low power state, the portable terminal 100 performs an operation corresponding to the gesture of the user sensed using the sensor of the sensor unit 110. [ Such an operation can be applied to overall operation control of the portable terminal 100, such as executing functions provided by the portable terminal 100, reproducing specific contents, or executing additional functions.

If the sensor unit 110 includes a camera, the controller 140 determines the gesture of the user by comparing the pixel change of the image photographed by the camera in chronological order, and performs a corresponding command can do. If the sensor unit 110 includes a plurality of cameras, the control unit 140 compares image information captured by a specific camera among a plurality of cameras with image information captured by another camera among the plurality of cameras, And the gesture may be determined using movement information of the center point.

For this purpose, the storage unit 150 of the portable terminal 100 may store binary-red-green-blue coordinates information or Hue, Saturation, and Intensity Coordinates (HSI) And the like, and the control unit 140 may compare the pixels of the photographed image with the stored coordinate system information to perform a judgment operation.

If the sensor unit 110 includes an infrared sensor, an RF sensor, an ultrasonic sensor, or the like, the control unit 140 may block the progress of the light beam irradiated by the sensor unit 110, The position where the light beam is reflected can be grasped and the gesture of the user can be judged according to the change.

In another embodiment of the present invention, the controller 140 may detect infrared rays of a user's body using the infrared sensor of the sensor unit 110 to determine the gesture of the user.

The control unit 140 of the portable terminal 100 detects the gesture of the user and performs a corresponding command while the power is supplied to the power supply unit 130. When the power is supplied from the outside, The control unit 140 increases the output of the sensor and switches to a high power state.

Then, the controller 140 recognizes the gesture of the user and performs a corresponding operation in the same manner as described above. In this high power state, the output of the sensor increases the gesture of the user, which is performed at a relatively long distance, rather than in a low power state, which consumes power within the power source unit 130. [

For example, if the sensor unit 110 includes a camera, the control unit 140 controls the user to shoot an image according to the preset number of pixels in a low power state to determine a user's near-field gesture. If the sensor unit 110 is switched to a high- It is possible to judge the user's remote gesture by controlling the photographing so that the number of pixels is larger than the number of pixels.

In addition, if the sensor unit 110 includes an infrared sensor, an RF sensor, or an ultrasonic sensor, the controller 140 may increase the intensity of the irradiated light, shorten the sensing period of the sensor, The output can be increased.

Through this operation, the controller 140 in the high power state can detect the gesture of the user relatively far from the low power state using the sensor unit 110 in detail and perform the corresponding operation. The process of detecting the user's gesture using the sensor unit 110 in the high power state of the control unit 140 is similar to the operation in the low power state, and thus a detailed description thereof will be omitted.

The operation of the portable terminal 100 in a low power state or a high power state will be described in more detail with reference to FIG. 2 and FIG.

FIG. 2 is an explanatory diagram of the operation of the portable terminal 100 in the low power state according to the embodiment of FIG. Referring to FIG. 2, the user performs an operation for gesture input with one hand to the portable terminal 100 driven by consuming internal power.

When the portable terminal 100 senses a gesture according to the user operation through the sensor unit 110, the processor in the portable terminal 100 performs a function corresponding to the gesture, and outputs the result of the operation to the display unit 120 ) So that the user can visually recognize it.

In this embodiment, a general form in which the portable terminal 100 in proximity to the user recognizes the gesture is shown. In this embodiment, when the user holds the portable terminal 100 with one hand and takes a gesture with the other hand, Is not supplied with power from the outside is included in the technical scope of the present invention.

Also, in this embodiment, the user takes a gesture with the other hand, but the gesture of the user is not limited to this, and can be various gestures such as other gestures and facial expressions.

FIG. 3 is an explanatory diagram of the operation of the portable terminal 100 in the high power state according to the embodiment of FIG. 3, a user places the portable terminal 100 on the cradle 200 and supplies electric power to the portable terminal 100 by wire.

When the power is supplied from the outside of the portable terminal 100, the portable terminal 100 recognizing the power increases the output of the sensor and can recognize the user's remote gesture in detail.

Although the present embodiment illustrates a state in which power is supplied to the portable terminal 100 by wire using the cradle 200, the portable terminal 100 does not consume the internal power, And any state of being supplied is included in the technical scope of the present invention.

When electric power is supplied from the outside such as charging the portable terminal 100 in this way, the portable terminal 100 can sense a user gesture performed at a relatively long distance and perform a corresponding operation. Accordingly, even when the user places the portable terminal 100 at a remote position without holding the portable terminal 100, the user can control the portable terminal 100 using the gesture.

The process of detecting a gesture according to whether the portable terminal 100 receives power from the outside and performing the operation according to the present invention will be described in detail with reference to FIG.

4 is a flowchart of a gesture recognition method using the portable terminal 100 according to an embodiment of the present invention. Referring to FIG. 4, the portable terminal 100 enters a low-power state consuming internal power (S410), and performs a corresponding operation by sensing a user's near-field gesture using an internal sensor (S420).

For this operation, the portable terminal 100 may include a sensor for sensing a gesture of a user, an infrared sensor, a RF sensor, or an ultrasonic sensor.

Thereafter, when the portable terminal 100 is supplied with power from the outside (S430), the output of the sensor is increased to switch to a high power state (S440).

In step S430, the portable terminal 100 can be supplied with electric power through wired or wireless communication. For example, the portable terminal 100 can be supplied with electric power in a state where the portable terminal is placed on the base.

In step S450, the mobile terminal 100 in the high power state senses a user gesture performed at a relatively long distance from the user's gesture sensed in the low power state and performs corresponding operation.

For example, if the portable terminal 100 includes a camera, it is switched to photograph an external situation using a relatively larger number of pixels than in the low power state in step S440. In step S450, Can detect the user's gesture.

If the portable terminal 100 includes an infrared sensor, an RF sensor, an ultrasonic sensor, or the like, in step S440, the portable terminal 100 may increase the intensity of the light to be irradiated, The output of the sensor is increased in step S450. In step S450, the user recognizes the gesture of the user by recognizing the light beam blocked by the user or reflected by the user, or recognizing the infrared ray irradiated by the user can do.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be appreciated by those skilled in the art that numerous changes and modifications can be made to the invention. And all such modifications and changes as fall within the scope of the present invention are therefore to be regarded as being within the scope of the present invention.

According to the present invention, it is possible to perform an operation according to a user's near-field gesture while minimizing power consumption in a state in which the portable terminal consumes internal power, and in a state where the portable terminal is supplied with power from the outside, It is possible to perform an operation according to the gesture of the user according to the power situation of the portable terminal by allowing the user to perform the operation according to the remote gesture while taking the increase.

1 is a block diagram of a portable terminal according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram of the operation in the low power state according to the embodiment of FIG.

3 is an explanatory diagram of the operation in the high power state according to the embodiment of FIG.

4 is a flowchart illustrating a gesture recognition method using a portable terminal according to an exemplary embodiment of the present invention.

Description of the Related Art

100: portable terminal 110:

120: display unit 130:

140: control unit 150:

200: Cradle

Claims (13)

A display unit for presenting information; A sensor unit for sensing a gesture of a user; A power supply unit for supplying power; A command corresponding to the local gesture sensed by the sensor unit in a low power consumption state consuming the power of the power unit is executed to express the execution result on the display unit and when recognizing that power is supplied from the outside through the power unit A control unit for turning the sensor output of the sensor unit up to a high power state, executing a command corresponding to the sensed remote gesture using the sensor unit, and displaying the execution result on the display unit; . The apparatus of claim 1, wherein the control unit And recognizes that power is supplied from the outside via the power source unit connected to the cradle. The apparatus of claim 1, wherein the control unit And recognizes that electric power is supplied from outside through the power supply unit by wire or wireless. The method according to claim 1, Wherein the sensor unit includes a camera for photographing a gesture of a user, Wherein the controller compares pixels of the image information photographed by the camera in a time sequence to determine the gesture and executes a corresponding command. The method according to claim 1, Wherein the sensor unit includes a plurality of cameras for photographing a gesture of a user, Wherein the control unit compares image information captured by a specific camera among the plurality of cameras with image information captured by another camera among the plurality of cameras to determine a center point of the user's motion, And judges a gesture. The method according to claim 4 or 5, Further comprising a storage unit for storing Red-Green-Blue (RGB) coordinate system information or HSI (Hue Saturation Intensity) Wherein the controller determines the gesture by comparing pixels having a change of more than a threshold value using the RGB coordinate system or the HSI coordinate system. The method according to claim 1, Wherein the sensor unit includes a camera for photographing a gesture of a user, Wherein the control unit controls the camera to shoot an image in accordance with the predetermined number of pixels in the low power state to determine the near field gesture, and when the camera is in the high power state, Wherein the remote gesture is judged by controlling to shoot an image. The method according to claim 1, Wherein the sensor unit includes at least one of an infrared sensor, a radio frequency (RF) sensor, and an ultrasonic sensor, Wherein the controller determines a distance gesture or a distance gesture based on a position where the light beam emitted from the sensor unit is blocked or reflected. The method according to claim 1, Wherein the sensor unit includes an infrared sensor, Wherein the control unit senses infrared rays irradiated from a user's body using the infrared sensor to determine the near gesture or the remote gesture. A short range sensing step of executing a command corresponding to a short range gesture sensed by a sensor in a low power consumption state in which the portable terminal consumes internal power and expressing the execution result on a display device; A switching step of increasing the output of the sensor and switching to a high power state when the portable terminal recognizes that power is supplied from the outside; A remote sensing step of executing a command corresponding to the remote gesture sensed by the portable terminal using the sensor and expressing the execution result on the display device; And a gesture recognition method using the portable terminal. 11. The method of claim 10, wherein the near sensing step or the remote sensing step Wherein the gesture is detected using at least one of a camera, an infrared sensor, an RF sensor, and an ultrasonic sensor. 11. The method of claim 10, Wherein the portable terminal is connected to a cradle and recognizes that power is supplied from the outside. 11. The method of claim 10, Wherein the portable terminal recognizes that power is supplied from the outside in a wired or wireless manner.

Images