KR20130097284A - Mobile terminal performing action recognition and method thereof - Google Patents

Mobile terminal performing action recognition and method thereof Download PDF

Info

Publication number
KR20130097284A
KR20130097284A KR1020120018810A KR20120018810A KR20130097284A KR 20130097284 A KR20130097284 A KR 20130097284A KR 1020120018810 A KR1020120018810 A KR 1020120018810A KR 20120018810 A KR20120018810 A KR 20120018810A KR 20130097284 A KR20130097284 A KR 20130097284A
Authority
KR
South Korea
Prior art keywords
unit
proximity sensor
state
user
portable terminal
Prior art date
Application number
KR1020120018810A
Other languages
Korean (ko)
Inventor
김철환
Original Assignee
김철환
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 김철환 filed Critical 김철환
Priority to KR1020120018810A priority Critical patent/KR20130097284A/en
Publication of KR20130097284A publication Critical patent/KR20130097284A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Telephone Function (AREA)

Abstract

PURPOSE: A mobile terminal performing action recognition and a method thereof are provided to store an amount of rotations indicating an inclining degree from a reference position which is predetermined on the basis of at least two axes, and to determine whether a proximity sensor is activated based on the stored amount of rotations. CONSTITUTION: A state recognition unit (20) recognizes an amount of rotations indicating an inclining degree of a portable terminal from a reference position which is predetermined on the basis of at least two axes, as state information of the portable terminal. An activated state storing unit (30) stores the amount of rotations in relation to the at least two axes as a proximity sensor activation value. If the state information recognized by the state recognition unit is included in an error range predetermined based on the proximity sensor activation value, a control unit (90) activates a proximity sensor unit. The control unit controls the proximity sensor unit to perform an action recognition function. [Reference numerals] (10) Proximity sensor unit; (20) State recognition unit; (30) Activated state storing unit; (40) Situation model providing unit; (50) User input unit; (60) Camera unit; (70) Movement recognition unit; (80) Illumination sensor unit; (90) Control unit; (AA) Proximity sensor mode; (BB) Camera mode

Description

Mobile terminal performing motion recognition and its method {MOBILE TERMINAL PERFORMING ACTION RECOGNITION AND METHOD THEREOF}

The present invention relates to a mobile terminal for performing motion recognition and a method thereof, and more particularly, to a mobile terminal and method for recognizing a user's motion through a proximity sensor and performing a function corresponding to the motion. .

Recently, with the increase in the spread of smart phones, researches on the application method using the sensors and devices built in the smart phones are actively conducted. As one of such application methods, a variety of motion recognition algorithms for recognizing a user's motion using a proximity sensor, a pressure sensor, or a camera built in a smartphone and performing a function corresponding to the motion have been proposed in various ways. .

For example, Publication No. 10-2010-0118317 proposed a method for recognizing a gesture based on image data acquired through a camera, but for this purpose, an algorithm for recognizing an operation is required, so that the capacity is increased when the program is implemented, and the illuminance is increased. In a low environment, not only there is a limitation of motion recognition, but also a drawback of using a lot of battery power due to the operation of the camera.

In addition, an algorithm has been proposed to allow a call to be connected by recognizing a hand gesture when a call is received. According to this, there is an advantage that the phone can be connected without touching the mobile terminal even in a situation where touch is difficult to recognize the touch or wearing a glove foreign matters on the hand. However, due to the high sensitivity of the proximity sensor that needs to recognize the movement of an object at a short distance, the call is connected differently from the user's intention even when a slight movement is detected when the mobile device is placed in a bag or pocket. Injuries can occur.

Considering that the mobile terminal is exposed to the outside and not only in a static space, but also in a bag or pocket, it is often in a dynamic state. There is an urgent need for a portable terminal capable of preventing malfunction.

The present invention has been proposed to solve the above problems, and to provide a portable terminal and a method for preventing the malfunction of the proximity sensor when performing the operation recognition through the proximity sensor.

The above object is a portable terminal having a motion recognition function according to an aspect of the present invention, the proximity sensor unit for detecting the movement of the object in the proximity; A state recognizing unit for recognizing, as state information of the portable terminal, a rotation amount indicating a degree of inclination from a predetermined reference posture of the portable terminal with respect to at least two axes penetrating the portable terminal or formed parallel to one side; An active state storage unit which stores the rotation amount of the at least two axes as a proximity sensor active value as a reference value for activating the proximity sensor unit; And a control unit which controls the proximity sensor unit to perform an operation recognition function when the state information recognized by the state recognition unit is included in a predetermined error range based on the proximity sensor activation value. It can be achieved by a portable terminal.

The apparatus may further include a user input unit configured to receive a command from a user to set the state information in the specific state as the proximity sensor active value when the portable terminal is in the specific state, and in response to the input from the user input unit. The state recognition unit recognizes state information in the specific state, and the active state storage unit may match the state information with the information about the specific state and store the state information as the proximity sensor active value.

Preferably, the error range is characterized in that the size is determined differently corresponding to the predetermined dynamic properties of the specific state.

In addition, the portable terminal according to the present invention further includes a situation model providing unit for providing a user with a plurality of situation models given the error range of different sizes, and the active state storage unit may be configured to perform the specific state among the plurality of situation models. It may be characterized in that any one of the matching situation models is selected and stored by the user.

The user input unit may directly receive the proximity sensor activation value from the user.

The state recognition unit may recognize the state information by calculating a rotation amount of the portable terminal based on data received from at least one sensor among a direction sensor, an acceleration sensor, a gravity sensor, and a gyroscope sensor.

Preferably, the portable terminal according to the present invention further comprises a camera unit for acquiring a motion image of the user and a motion recognition unit for recognizing the motion of the user in the motion image, the control unit is an operation recognized by the motion recognition unit It may be to perform a function corresponding to the.

The apparatus may further include an illuminance sensor unit recognizing an ambient illuminance, wherein the control unit recognizes an operation recognition through a proximity sensor mode or the camera unit performing an operation recognition through the proximity sensor unit based on the illuminance recognized by the illuminance sensor unit. By selecting and activating any one of the camera modes to be performed, a more appropriate mode can be performed according to the illuminance, thereby enabling effective motion recognition.

On the other hand, the controller may deactivate the proximity sensor unit and the camera unit when a predetermined time is exceeded from the occurrence of a specific event requiring motion recognition, and may automatically perform a function corresponding to the specific event.

In addition, the above object is an operation recognition method of a mobile terminal through a proximity sensor according to an aspect of the present invention, comprising: receiving a setting command of the status information from a user in a specific state in which the mobile terminal; A rotation amount indicating a degree of inclination from a predetermined reference posture of the portable terminal with respect to at least two axes penetrating the portable terminal or formed parallel to one side in response to a setting command of the status information, the status information of the portable terminal. Recognizing as; Matching the state information with information about the specific state and storing the state information as a proximity sensor active value; And performing a motion recognition function by activating the proximity sensor when the state information at a time when a specific event requiring motion recognition occurs is within a predetermined error range based on the proximity sensor activation value. It can also be achieved by the operation recognition method of the portable terminal.

Preferably, providing a plurality of situation models to which the user is given an error range having a different size; And selecting and storing any one situation model matched with the dynamic attribute of the specific state among the plurality of situation models from the user.

The method may further include determining whether state information at a time when a specific event requiring motion recognition is included in the error range provided to the situation model selected by the user.

As described above, according to the present invention, the state information of the mobile terminal in a specific state, that is, the rotation amount indicating the degree of inclination from the predetermined reference position with respect to at least two axes is stored, and based on this activation of the proximity sensor By determining whether or not there is an effect that can prevent the malfunction of the proximity sensor.

In addition, according to the present invention, by storing a variety of information about the specific state that the proximity sensor is activated in accordance with the situation, and correspondingly by varying the range to operate the proximity sensor to provide a flexible motion recognition function in the situation It works.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
2 is a view for explaining state information recognized by a state recognition unit;
3 is an example of a screen displaying a plurality of situation models provided by a situation model providing unit;
4A and 4B are examples of screens for receiving a command for setting a proximity sensor activation value from a user input unit;
5 is an example of a screen for reference in describing an operation of automatically performing a function after a predetermined time is exceeded by the controller; And
6 is a flowchart illustrating a process of performing an operation recognition function in a mobile terminal according to an embodiment of the present invention.

The portable terminal described herein is meant to include all types of handheld devices capable of performing a motion recognition function by including a proximity sensor. For example, the portable terminal includes all types of terminals operating according to a communication protocol, and all information and communication devices such as a portable multimedia player (PMP), a digital broadcasting player, a personal digital assistant (PDA), a portable game terminal, and a smartphone. It may include a multimedia device.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

1, the portable terminal according to the embodiment of the present invention, the proximity sensor unit 10, the state recognition unit 20, the active state storage unit 30, the situation model providing unit 40, the user input unit 50 ), The camera unit 60, the motion recognition unit 70, the illumination sensor 80, and the control unit 90.

The proximity sensor unit 10 includes a proximity sensor and detects a movement of an object at a proximity distance. Proximity sensor is a generic term for a sensor that detects the movement of an object or a nearby object without direct contact by using electromagnetic force or infrared rays, and is a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, Examples include high frequency oscillation proximity sensors, capacitive proximity sensors, magnetic proximity sensors and infrared proximity sensors.

The state recognition unit 20 recognizes state information of the portable terminal. The state information may be defined as a quantitative value representing a degree of inclination of the mobile terminal from a predetermined reference posture.

Hereinafter, the meaning and shape of the state information will be described in more detail with reference to FIG. 2.

2 is a view for explaining the state information of the portable terminal recognized by the state recognition unit 20. On the other hand, Figure 2 will be described with an example where the state information is calculated based on three axes having a vertical relationship with each other.

Referring to FIG. 2, the state information of the portable terminal may be expressed in an amount rotated from a predetermined reference posture based on a virtual axis formed through or parallel to the one side of the portable terminal. In this case, the virtual axis is preferably selected from two or more orthogonal axes. On the other hand, the reference posture of the mobile terminal refers to a posture that is a reference when determining the degree of inclination of the mobile terminal when calculating the status information, and may be determined in various directions. For example, the reference posture may be determined in a state in which the lower end of the portable terminal is parallel to a horizontal plane having a perpendicular relationship to the gravity direction, and the front and rear surfaces are parallel to the gravity direction based on the display direction, the operation method, and the like of the portable terminal.

 The state recognition unit 20 receives data sensed by a direction sensor, a 3-axis acceleration sensor, a gravity sensor, a gyroscope sensor, a rotation vector sensor, and the like built in the portable terminal, and calculates a rotation amount of the portable terminal based on the state. Recognize information. Since the method of calculating the tilting degree, that is, the amount of rotation of the mobile terminal based on the results sensed by each sensor is a known technique, a detailed description thereof will be omitted for simplicity of explanation.

The active state storage unit 30 stores the proximity sensor activity value. The proximity sensor activation value is a reference value for determining whether the proximity sensor unit 10 is activated. Similar to the state information recognized by the state recognition unit 20, the mobile terminal determines a predetermined posture based on at least two axes. It is expressed as the amount of rotation representing the degree of tilt from.

The active state storage unit 30 matches and stores the state information of the portable terminal recognized by the state recognition unit 20 with information about a specific state where the portable terminal is located when obtaining the state information. In this case, the specific state refers to a state in which the portable terminal is placed, and is a concept associated with a place, a seat, or the like where the portable terminal is placed or leaned. For example, there may be a cradle and a state on a desk, or in a bag and in a pocket. In addition, for example, a state of being hung in a certain place such as a user's neck, a wall, and the like is held in a hand.

In addition, the active state storage unit 30 stores the error range of the proximity sensor active value, the error range is a range having a predetermined size based on the proximity sensor active value, that is, the dynamic properties of the specific state, that is, the mobile terminal is located It may have a different size depending on the degree of shaking or moving, fixed or not. For example, when the portable terminal is placed on the desk, the size of the error range may be determined to be small since the desk is kept in a static state, but when the portable terminal is in the hand, the user holds the portable terminal at an angle. Since it is not uniform, the magnitude of the error range needs to be determined relatively large.

The situation model providing unit 40 provides a user with a plurality of situation models to which error ranges of different sizes are given. In this case, the situation model is a kind of menu provided to determine the size of the error range, and the user selects one situation model that is more suitable for the dynamic property of a specific state among the plurality of situation models. Hereinafter, a situation model will be described in more detail with reference to FIG. 3.

3 is an example of a screen displaying a plurality of situation models provided by the situation model providing unit 40.

Referring to FIG. 3, the situation model may be classified according to the type of a specific state. As shown in FIG. 3, a specific state in which a portable terminal can be frequently placed, such as a holder, a pocket, a desk, and a hand held state, is listed, and a specific state can be selected from a user. In this case, the situation model providing unit 40 may provide an error range size determined experimentally based on the dynamic characteristics of the specific state.

In addition, the situation model may be provided by dividing the size of the error range into a plurality of stages so that the user may directly select the size of the error range.

As described above, according to the mobile terminal according to the embodiment of the present invention, the error range of the proximity sensor active value can be appropriately determined in response to the dynamic property of the specific state, which can be flexibly applied in various situations, and effectively prevents the malfunction of the proximity sensor. It can prevent.

The user input unit 50 receives a command from the user for setting the state information in a specific state in which the portable terminal is placed as the proximity sensor active value. In addition, the user input unit 50 may select one situation model from among the plurality of situation models provided by the situation model providing unit 40, or directly receive a proximity sensor activation value and an error range size from the user.

Hereinafter, as an example of an aspect of the user input unit 50, a situation in which a user inputs a command for setting a proximity sensor activation value will be described with reference to FIGS. 4A and 4B.

4A illustrates an example of a screen for receiving a command for setting a proximity sensor activation value from the user input unit 50 when the portable terminal is placed on a holder and the portable terminal is held by a user.

4A and 4B, in a specific state in which a mobile terminal is placed, such as a state mounted on a cradle or a state of being held in a hand, the user recognizes the state information in real time through the user input unit 50 and recognizes the state information. Can be set as the proximity sensor active value.

In response to the input from the user input unit 50, the state recognition unit 20 recognizes the state information in a specific state, and the active state storage unit 30 matches the state information with information about the specific state to activate the proximity sensor. Will be stored as a value.

Referring back to FIG. 1, the mobile terminal according to an embodiment of the present invention further includes a camera unit 60, an operation recognition unit 70, and an illuminance sensor unit 80 to recognize proper operation among a proximity sensor mode and a camera mode. It can provide a mode. At this time, the mode is a concept that is classified according to a means for recognizing the user's motion. Specifically, the proximity sensor mode recognizes the user's motion through the proximity sensor unit 10 and the camera mode through the camera unit 60. A mode in which a function corresponding to the recognized operation is performed.

The camera unit 60 includes a camera for acquiring a motion image of a user, and various types of cameras may be applied. For example, a CCD camera or a CMOS camera can be applied.

The motion recognition unit 70 recognizes a user's motion in the motion image of the camera unit 60. To this end, the motion recognition unit 70 is implemented to include various motion recognition algorithms including SVM (Support Vector Machine) algorithm, and is not limited to a specific algorithm.

The illuminance sensor unit 80 detects illuminance around the portable terminal and is implemented by including an illuminance sensor. The illuminance sensed by the illuminance sensor unit 80 is used as a basis for the determination for selecting a more appropriate mode among the proximity sensor mode and the camera mode.

The controller 90 is in charge of the overall operation for performing the motion recognition function through the proximity sensor unit 10 and the camera unit 60. That is, the proximity sensor mode may be performed based on the information of the state recognition unit 20 and the active state storage unit 30, and the camera mode is controlled based on the operation recognized by the operation recognition unit 70. do. Hereinafter, the operation of the controller 90 for each mode will be described in detail by dividing into a proximity sensor mode and a camera mode.

First, referring to the operation of the control unit 90 according to the proximity sensor mode, if the state information recognized by the state recognition unit 20 is included in the error range determined based on the proximity sensor active value, the proximity sensor unit 10 is The control is activated so that the proximity sensor mode can be performed. That is, when a specific event requiring operation recognition occurs, for example, when a call is received, the state recognition unit 20 recognizes current state information. The controller 90 compares the information on the proximity sensor activation value and the error range corresponding to the specific state in which the mobile terminal is currently placed among the information stored in the active state storage unit 30 with the current state information, and the state information is an error. If included in the range to activate the proximity sensor unit 10, and then, the function corresponding to the operation recognized by the proximity sensor unit 10 is performed.

Looking at the operation of the control unit 90 during the camera mode operation, and activates the camera unit 60 and the motion recognition unit 70 when a specific event requiring motion recognition, and corresponds to the operation recognized by the motion recognition unit 70 Control the function to be performed.

In addition, the controller 90 controls the appropriate mode of the proximity sensor mode or the camera mode to be activated based on the illuminance sensed by the illumination sensor 80. In an environment with low illumination, there is a limit in acquiring a user's motion image through the camera unit 60, so that the controller 90 activates the proximity sensor mode under a certain illumination. On the other hand, the camera mode has a less malfunction than the proximity sensor with high sensitivity, and the recognition distance is relatively long, so that the controller 90 activates the camera mode at a predetermined illuminance or higher.

The controller 90 may selectively activate both modes in response to the operation recognition function performed. For example, when a call arrives, it is sufficient to determine whether there is an operation. Therefore, it is necessary to recognize a pattern such as activating a proximity sensor mode with relatively low battery consumption and sending a message. You can control the camera mode to activate when it is present.

On the other hand, the controller 90 deactivates the proximity sensor unit 10 and the camera unit 60 when a predetermined time is exceeded from the time of occurrence of a specific event requiring motion recognition, and a function corresponding to the specific event is automatically performed. You can do that. In the following, it will be described in more detail with reference to FIG.

5 is an example of a screen for reference in describing an operation of automatically performing a function after a predetermined timeout by the controller 90.

Referring to FIG. 5, a user may set a waiting time for automatically connecting a specific event requiring an operation recognition, for example, after a predetermined time exceeds when a call is received. The control unit 90 is the proximity sensor unit 10 or the camera unit 60 after the waiting time is exceeded even when the user's motion for the telephone connection is not recognized in the proximity sensor unit 10 or the camera unit 60. You can disable it and control the phone to connect automatically.

 Hereinafter, a series of processes from setting the proximity sensor activation value and the error range to performing the operation recognition function will be described with reference to FIG. 6.

6 is a flowchart illustrating a process of performing an operation recognition function in a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 6, a state information setting command is input from a user through the user input unit 50 (S10), and the state recognition unit 20 recognizes state information in a specific state in which the portable terminal is placed in response to the input. (S11).

The active state storage unit 30 stores the proximity sensor activity value by matching the state information with information of a specific state in which the mobile terminal is placed (S13). For example, if the user inputs a setting command while the portable terminal is placed on the holder, the user stores the state information on the holder and a specific state of the holder.

The situation model providing unit 40 provides a plurality of situation models (S15), and the user selects the situation model matching the dynamic attribute of the specific state to determine the size of the error range. For example, the mobile terminal is fixed in the mounted state, so select a situation model with a small error range, and in the state held in the hand by considering the change of the state information by the angle of the user holding the mobile terminal and the movement of the hand. You will select a situation model with a large margin of error.

 The determined error range size is matched with information about a specific state and stored in the active state storage unit 30 (S17).

When a specific event requiring operation recognition occurs, the state recognition unit 20 recognizes the current state information, and the control unit 90 based on the proximity sensor active value corresponding to the specific state in which the mobile terminal is currently placed. It is determined whether the state information is included in the error range (S19). When the determination result is included in the error range, the controller 90 activates the proximity sensor unit 10 to perform an operation recognition function (S21).

On the other hand, the above step is not indispensable, so it will be possible to add, change and omit as necessary. For example, the error range size may be directly input from the user without going through step S15 of providing a plurality of situation models. In addition, the controller 90 may select one of the proximity sensor mode and the camera mode based on the illuminance measured by the illuminance sensor 80 when a specific event requiring motion recognition occurs.

Although some embodiments of the present invention have been described above, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope of the present invention.

For example, the plurality of situation models provided to the user may not be limited to the embodiments but may be appropriately added / modified.

Therefore, the scope of protection of the present invention should be determined by the appended claims and their equivalents.

10: proximity sensor 20: state recognition unit
30: active state storage unit 40: situation model providing unit
50: user input unit 60: camera unit
70: motion recognition unit 80: illumination sensor unit
90:

Claims (12)

In a mobile terminal having a motion recognition function,
Proximity sensor for detecting the movement of the object in the proximity distance;
A state recognizing unit for recognizing, as state information of the portable terminal, a rotation amount indicating a degree of inclination from a predetermined reference posture of the portable terminal with respect to at least two axes penetrating the portable terminal or formed parallel to one side;
An active state storage unit which stores the rotation amount of the at least two axes as a proximity sensor active value as a reference value for activating the proximity sensor unit; And
And a control unit for controlling the proximity sensor unit to perform an operation recognition function when the state information recognized by the state recognition unit is within a predetermined error range based on the proximity sensor activation value. terminal.
The method of claim 1,
And a user input unit configured to receive a command from a user to set the state information in the specific state as the proximity sensor active value when the portable terminal is in the specific state.
In response to an input from the user input unit, the state recognizing unit recognizes state information in the specific state, and the active state storage unit matches the state information with information about the specific state and stores the state information as the proximity sensor active value. Mobile terminal, characterized in that.
The method of claim 2,
And the error range is different in size in response to a predetermined dynamic attribute of the specific state.
The method of claim 3,
It further includes a situation model providing unit for providing a user with a plurality of situation models given the error range of different sizes,
And the active state storage unit selects and stores any one situation model matching the specific state among the plurality of situation models from a user.
The method of claim 2,
And the user input unit directly receives the proximity sensor activation value from the user.
The method of claim 1,
The state recognition unit recognizes the state information by calculating a rotation amount of the portable terminal based on data received from at least one sensor among a direction sensor, an acceleration sensor, a gravity sensor, and a gyroscope sensor. .
The method of claim 1,
Camera unit for acquiring the motion image of the user and
Further comprising a motion recognition unit for recognizing the motion of the user in the motion image,
The controller may be configured to perform a function corresponding to an operation recognized by the operation recognition unit.
The method of claim 7, wherein
It further includes an illumination sensor unit for recognizing the ambient illumination,
The controller selects and activates any one of a proximity sensor mode for performing an operation recognition through the proximity sensor unit or a camera mode for performing an operation recognition through the camera unit based on the illuminance recognized by the illuminance sensor unit. Characterized by a mobile terminal.
The method of claim 7, wherein
The control unit deactivates the proximity sensor unit and the camera unit when a predetermined time is exceeded from the time of occurrence of a specific event requiring operation recognition, and the mobile terminal is configured to automatically perform a function corresponding to the specific event. .
In the operation recognition method of the mobile terminal through the proximity sensor,
Receiving a setting command of status information from a user in a specific state in which the portable terminal is placed;
A rotation amount indicating a degree of inclination from a predetermined reference posture of the portable terminal with respect to at least two axes penetrating the portable terminal or formed parallel to one side in response to a setting command of the status information, the status information of the portable terminal. Recognizing as;
Matching the state information with information about the specific state and storing the state information as a proximity sensor active value; And
And when the state information at the time of occurrence of a specific event requiring motion recognition is within a predetermined error range based on the proximity sensor activation value, performing a motion recognition function by activating the proximity sensor. Motion recognition method of the terminal.
The method of claim 10,
Providing a plurality of situation models to which a user is given an error range having different sizes; And
And selecting and storing one situation model among the plurality of situation models that match the dynamic attribute of the specific state from a user.
12. The method of claim 11,
And determining whether the state information at the time of occurrence of a specific event requiring operation recognition is within the error range given to the situation model selected by the user.
KR1020120018810A 2012-02-24 2012-02-24 Mobile terminal performing action recognition and method thereof KR20130097284A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120018810A KR20130097284A (en) 2012-02-24 2012-02-24 Mobile terminal performing action recognition and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120018810A KR20130097284A (en) 2012-02-24 2012-02-24 Mobile terminal performing action recognition and method thereof

Publications (1)

Publication Number Publication Date
KR20130097284A true KR20130097284A (en) 2013-09-03

Family

ID=49449694

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120018810A KR20130097284A (en) 2012-02-24 2012-02-24 Mobile terminal performing action recognition and method thereof

Country Status (1)

Country Link
KR (1) KR20130097284A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150029285A (en) * 2013-09-10 2015-03-18 삼성전자주식회사 Image device including dynamic vision sensor, ambient light sensor, and proximity sensor
KR20150084608A (en) * 2014-01-14 2015-07-22 엘지전자 주식회사 Terminal and operating method thereof
KR20160047710A (en) * 2014-10-23 2016-05-03 에스케이텔레콤 주식회사 Method for recognizing user motion and motion recognition apparatus using the same
WO2021029461A1 (en) * 2019-08-13 2021-02-18 엘지전자 주식회사 Mobile terminal

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150029285A (en) * 2013-09-10 2015-03-18 삼성전자주식회사 Image device including dynamic vision sensor, ambient light sensor, and proximity sensor
KR20150084608A (en) * 2014-01-14 2015-07-22 엘지전자 주식회사 Terminal and operating method thereof
KR20160047710A (en) * 2014-10-23 2016-05-03 에스케이텔레콤 주식회사 Method for recognizing user motion and motion recognition apparatus using the same
WO2021029461A1 (en) * 2019-08-13 2021-02-18 엘지전자 주식회사 Mobile terminal
US11682239B2 (en) 2019-08-13 2023-06-20 Lg Electronics Inc. Mobile terminal

Similar Documents

Publication Publication Date Title
EP3100133B1 (en) Buttonless display activation
KR102141099B1 (en) Rapid screen segmentation method and apparatus, electronic device, display interface, and storage medium
KR101773650B1 (en) Camera-based orientation fix from portrait to landscape
US11775025B2 (en) Display method for device having foldable screen and foldable screen device
KR101729721B1 (en) Portable electronic device and method for controlling operation thereof based on user motion
CN108388414B (en) Screen-off control method and device for terminal, computer-readable storage medium and terminal
KR20190057284A (en) Method and apparatus for preventing wrong contact with terminal
US20170199662A1 (en) Touch operation method and apparatus for terminal
CN106203254B (en) Method and device for adjusting photographing direction
WO2013162925A2 (en) Use of proximity sensors for interacting with mobile devices
US9235238B2 (en) Mobile electronic device with dual touch displays and multitasking function, control method, and storage medium storing control program
US8634872B2 (en) Mobile terminal for distinguishing an ear during a call and method thereof
KR20150039706A (en) Method for implementing electronic magnifier and user equipment
KR20130097284A (en) Mobile terminal performing action recognition and method thereof
CN110191209A (en) A kind of screens switch control method and terminal
CN109101119B (en) Terminal control method and device and mobile terminal
KR20210041623A (en) Image display method and mobile terminal
WO2014097653A1 (en) Electronic apparatus, control method, and program
CN107111860B (en) Digital device and control method thereof
CN108304033B (en) Flexible screen terminal, folding control method thereof and computer readable storage medium
CN108984062A (en) A kind of content display method, terminal
KR102429428B1 (en) An electronic device and an operation method for the electronic device
CN106095117A (en) The determination method and device of picture display mode
JP2019083415A (en) Electronic apparatus, control method and control program
KR20200077947A (en) Fodable electronic device for providing information related to event and operating method thereof

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application