KR20100056838A - Apparatus and method for controlling electronics based on user action - Google Patents

Apparatus and method for controlling electronics based on user action Download PDF

Info

Publication number
KR20100056838A
KR20100056838A KR1020080115827A KR20080115827A KR20100056838A KR 20100056838 A KR20100056838 A KR 20100056838A KR 1020080115827 A KR1020080115827 A KR 1020080115827A KR 20080115827 A KR20080115827 A KR 20080115827A KR 20100056838 A KR20100056838 A KR 20100056838A
Authority
KR
South Korea
Prior art keywords
electronic device
control
user
operation pattern
control function
Prior art date
Application number
KR1020080115827A
Other languages
Korean (ko)
Inventor
전영규
Original Assignee
주식회사 대우일렉트로닉스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 대우일렉트로닉스 filed Critical 주식회사 대우일렉트로닉스
Priority to KR1020080115827A priority Critical patent/KR20100056838A/en
Publication of KR20100056838A publication Critical patent/KR20100056838A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

PURPOSE: A device and a method for controlling an electronic device based on user action are provided to enable a user to control an electronic device through an action after the user sets a control function of an electronic function in the action, thereby enabling the user to conveniently use control functions of various electronic devices. CONSTITUTION: A camera(100) photographs an image of a user who wants to control an electronic device. An action pattern extractor(110) uses the photographed image to extract an action pattern of the user. A function setup unit(120) sets a control function of an electronic device in the extracted action pattern. A controller(140) extracts the control function of the set electronic device. The controller controls the electronic device using the extracted control function.

Description

Device and method for controlling electronic devices based on user motion {APPARATUS AND METHOD FOR CONTROLLING ELECTRONICS BASED ON USER ACTION}

The present invention relates to electronic device control, and more particularly, to a user-based electronic device control apparatus and method that can control the electronic device through the operation after the user sets a control function for each operation.

Due to the improvement of the technical level and the economic level, the spread of the television award receiving and outputting video and audio signals transmitted from broadcasting stations has become popular. Is evolving into a form that can be implemented further.

In general, channel selection / volume adjustment or the like of the television receiver is controlled through input of a function button exposed on the outer surface of the television receiver or by using a remote controller at a short distance / distance.

In other words, the technology for controlling the television receiver has been developed by mechanically adjusting the channel and volume to generate the corresponding electric signal, and developing the electronic method of transmitting the signal by touching the PCB circuit board to the television and pressing a button. Recently, it has evolved into a control method using a remote controller, which is a generalized control method.

The conventional method of controlling an electronic device such as a television using a remote control is inconvenient for the user because it is necessary to be familiar with keys corresponding to each function, for example, a remote control key and a panel key, while various functions are included in the electronic device by the development of technology. There is a problem.

The present invention registers a function of an electronic device corresponding to a user's motion pattern, analyzes the user's motion pattern in an image obtained through the user's shooting, and operates a function of the electronic device corresponding to the analyzed motion pattern.

An electronic device control apparatus based on a user's motion according to the present invention includes an operation of extracting an operation pattern of the user using a camera photographing an image of a user located in front of the electronic device and an image of the user photographed by the camera. A pattern extractor, a function setting unit for setting an electronic device control function to the extracted operation pattern and storing the electronic device in a memory; and a control function of the electronic device set to the operation pattern extracted from the operation pattern extractor. And a controller for controlling the electronic device using the same after extraction from the memory.

In addition, the electronic device control method based on the user motion according to the present invention, the step of setting any electronic device control function to the registered operation pattern of the user extracted using the image of the user photographed by the camera, and the electronic device Storing the registered operation pattern in which the control function is set in the memory; determining whether a control operation pattern of a user extracted from an image captured by the camera exists in the memory in a motion recognition control mode; As a result of the determination, extracting a control function of the electronic device set in the extracted control operation pattern of the user when present in the memory, and controlling the electronic device based on the control function of the extracted electronic device.

According to the present invention, a user sets a control function of an electronic device in an arbitrary operation and then controls the electronic device through the operation, thereby conveniently utilizing the control function of various electronic devices.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

An embodiment of the present invention describes an apparatus and method for controlling an electronic device through an operation after the user sets a control function of the electronic device in an arbitrary operation.

1 is a block diagram illustrating an apparatus for controlling an electronic device based on a user's motion according to an embodiment of the present disclosure.

Referring to FIG. 1, the electronic device control apparatus includes a camera 100, an operation pattern extracting unit 110, a function setting unit 120, a memory 130, a control unit 140, and an interface providing unit 150. .

The electronic device of the present invention is a device having various control functions, for example, volume up / down, channel up / down, additional functions, and the like, such as a television, a set-top box, a DVD player, and the like.

The camera 100 captures an image of a user at a front position of the electronic device and provides the image to the operation pattern extractor 110, and may be located at the left and right sides or the center of the upper side of the electronic device.

The motion pattern extractor 110 extracts the motion pattern of the user using the image photographed by the camera 100 and provides the same to the function setting unit 120, where the motion pattern is a facial expression, a direction of hand indication, or the like. Can be mentioned.

The motion pattern extractor 110 may provide the extracted motion pattern to the controller 110.

The function setting unit 120 sets any one of the control functions of the electronic device in the user's operation pattern and stores it in the memory 130. That is, the function setting unit 120 sets any one of a channel increasing function, a channel decreasing function, a volume up function, a volume down function, a specific channel, and a specific menu selection to a user's operation pattern, and then stores it in the memory 130. do.

The controller 140 receives a user's motion pattern through the control of the motion pattern extractor 110 in the motion recognition control mode, searches for an electronic device control function corresponding to the received motion pattern in the memory 130, and then The control signal is output based. For example, when a fist-shaped action pattern is input from the motion pattern extraction unit 110 in a motion recognition control mode in a state in which a fist-shaped action pattern is designated as a specific channel 6, the control unit 140 determines The control signal for switching the channel to channel 6 is output.

The interface providing unit 150 provides an interface for selecting a control function of an electronic device to be set to any operation pattern in the function setting unit 120, for example, a pop-up menu type or a list type interface. Accordingly, the function setting unit 120 sets the control function of the electronic device selected by the interface to the operation pattern provided by the operation pattern extraction unit 110.

The operation of the control device of the electronic device having the above configuration will be described with reference to FIG. 2.

2 is a flowchart illustrating a process of controlling an electronic device based on a user's motion according to an embodiment of the present disclosure.

Referring to FIG. 2, first, a control function of an electronic device is set to an operation pattern desired by a user, that is, the user performs an arbitrary operation and the camera 100 extracts an image of the user (S200) from the operation pattern extractor. Provided at 110.

The operation pattern extractor 110 extracts a registration operation pattern from the captured image in operation S202, and provides the extracted registration operation pattern to the function setting unit 120.

The function setting unit 120 selects a control function of the electronic device to be set in the registration operation pattern, that is, as the user selects any one of the control functions of the various electronic devices provided by the interface providing unit 150 (S204). After setting the control function of the electronic device selected by the user in the registration operation pattern, the control operation of the registration operation pattern and the selected electronic device is stored in the memory 130 (S206).

By repeatedly performing the process of S206 to S200 as described above, different electronic device control functions may be set for each operation desired by the user.

While performing this process, the controller 140 determines whether there is a motion recognition control mode request from the user (S208).

As a result of the determination of S208, when there is a request of the motion recognition control mode, the controller 140 controls the motion pattern extractor 110, and accordingly, the motion pattern extractor 110 controls the motion pattern extractor 110 in the image captured by the camera 100. The control operation pattern is extracted (S210) and then provided to the controller 140.

The controller 140 determines whether the control operation pattern provided from the operation pattern extractor 110 exists in the memory 130 (S212).

As a result of the determination in S212, when it exists in the memory 130, the controller 140 extracts the electronic device control function set in the control operation pattern from the memory 130 (S214) and generates a control signal corresponding thereto. The control function may operate the electronic device (S216).

As a result of the determination in S212, when it is not present in the memory 130, the controller 140 proceeds to S204 to perform a subsequent step, that is, a control operation pattern through the control of the function setting unit 120 and the interface providing unit 150. After selecting the control function of the electronic device to be set in the control function and the control operation pattern of the selected electronic device is stored in the memory 130.

According to an embodiment of the present disclosure, the user sets a control function of an arbitrary electronic device in an arbitrary operation and then controls the electronic device through the operation, thereby conveniently using the control function of various electronic devices.

The present invention has been limited to the embodiments of the present invention, but it is obvious that the technology of the present invention can be easily modified by those skilled in the art. Such modified embodiments should be included in the technical spirit described in the claims of the present invention.

1 is a block diagram illustrating an electronic device control apparatus based on a user's motion according to an embodiment of the present disclosure.

2 is a flowchart illustrating a process of controlling an electronic device based on a user's motion according to an embodiment of the present disclosure.

Description of the Related Art

100: camera 110: motion pattern extraction unit

120: function setting unit 130: memory

140: control unit 150: interface providing unit

Claims (6)

A camera that captures an image of a user who wants to control an electronic device, An operation pattern extractor configured to extract an operation pattern of the user using an image of the user photographed by the camera; A function setting unit for setting an electronic device control function on the extracted operation pattern and storing the electronic device in a memory; A control unit for controlling the electronic device by extracting a control function of the electronic device set in the operation pattern extracted by the operation pattern extractor from the memory Electronic device control device based on the user's motion comprising a. The method of claim 1, Further comprising an interface providing unit for providing an interface for selecting a control function of the electronic device corresponding to any operation pattern extracted by the operation pattern extraction unit, And the function setting unit sets the control function of the electronic device selected through the interface to the arbitrary operation pattern. The method according to claim 1 or 2, The control function of the electronic device is a user control-based electronic device control device, characterized in that any one of a specific channel, channel up / down, volume up / down and a specific menu selection. Setting an arbitrary electronic device control function on the registration operation pattern of the user extracted by using the image of the user captured by the camera; Storing the registration operation pattern in which the arbitrary electronic device control function is set, in a memory; Determining whether a user's control operation pattern extracted from an image captured by the camera exists in the memory in a motion recognition control mode; Extracting a control function of an electronic device set in the extracted user's control operation pattern when the memory is present in the memory; Controlling the electronic device based on the control function of the extracted electronic device; User motion-based electronic device control method comprising a. The method of claim 4, wherein Setting the control function of the electronic device, Providing an interface for selecting a control function of the electronic device to be set in the extracted operation pattern; Setting a control function of the electronic device selected through the interface to the extracted operation pattern; User motion-based electronic device control method comprising a. The method of claim 4, wherein Providing an interface for selecting a control function of the electronic device to be set to the control operation pattern when it is not present in the memory as a result of the determination; Setting a control function of the electronic device selected through the interface to the control operation pattern and storing the control function in the memory; User motion-based electronic device control method further comprising a.
KR1020080115827A 2008-11-20 2008-11-20 Apparatus and method for controlling electronics based on user action KR20100056838A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020080115827A KR20100056838A (en) 2008-11-20 2008-11-20 Apparatus and method for controlling electronics based on user action

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020080115827A KR20100056838A (en) 2008-11-20 2008-11-20 Apparatus and method for controlling electronics based on user action

Publications (1)

Publication Number Publication Date
KR20100056838A true KR20100056838A (en) 2010-05-28

Family

ID=42280779

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020080115827A KR20100056838A (en) 2008-11-20 2008-11-20 Apparatus and method for controlling electronics based on user action

Country Status (1)

Country Link
KR (1) KR20100056838A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012093822A2 (en) * 2011-01-06 2012-07-12 Samsung Electronics Co., Ltd. Display apparatus controlled by a motion, and motion control method thereof
KR101287948B1 (en) * 2011-12-13 2013-07-19 (주) 미디어인터랙티브 Method, apparatus, and computer readable recording medium for recognizing gestures
US8675916B2 (en) 2010-10-29 2014-03-18 Samsung Electronics Co., Ltd User interface apparatus and method using movement recognition
KR101495044B1 (en) * 2013-05-11 2015-02-25 계명대학교 산학협력단 Exercising system and method based on motion capture using user movement patterns
US9398243B2 (en) 2011-01-06 2016-07-19 Samsung Electronics Co., Ltd. Display apparatus controlled by motion and motion control method thereof
US9513711B2 (en) 2011-01-06 2016-12-06 Samsung Electronics Co., Ltd. Electronic device controlled by a motion and controlling method thereof using different motions to activate voice versus motion recognition

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8675916B2 (en) 2010-10-29 2014-03-18 Samsung Electronics Co., Ltd User interface apparatus and method using movement recognition
WO2012093822A2 (en) * 2011-01-06 2012-07-12 Samsung Electronics Co., Ltd. Display apparatus controlled by a motion, and motion control method thereof
WO2012093822A3 (en) * 2011-01-06 2012-12-06 Samsung Electronics Co., Ltd. Display apparatus controlled by a motion, and motion control method thereof
US9398243B2 (en) 2011-01-06 2016-07-19 Samsung Electronics Co., Ltd. Display apparatus controlled by motion and motion control method thereof
US9513711B2 (en) 2011-01-06 2016-12-06 Samsung Electronics Co., Ltd. Electronic device controlled by a motion and controlling method thereof using different motions to activate voice versus motion recognition
KR101287948B1 (en) * 2011-12-13 2013-07-19 (주) 미디어인터랙티브 Method, apparatus, and computer readable recording medium for recognizing gestures
KR101495044B1 (en) * 2013-05-11 2015-02-25 계명대학교 산학협력단 Exercising system and method based on motion capture using user movement patterns

Similar Documents

Publication Publication Date Title
US20230245653A1 (en) Image display apparatus and method of controlling the same
US11696021B2 (en) Video recording device and camera function control program
KR101652110B1 (en) Controlling power of devices which is controllable with user's gesture
KR20100056838A (en) Apparatus and method for controlling electronics based on user action
KR101901620B1 (en) Device and method for controlling focus
WO2015143880A1 (en) Intelligent household appliance control method and device and terminal
US8675136B2 (en) Image display apparatus and detection method
KR100651521B1 (en) Method for clocking speed in wireless terminal
KR100703696B1 (en) Method for recognizing control command and apparatus using the same
JP2010134629A (en) Information processing apparatus and method
CN107145278B (en) Equipment control method and device based on mobile terminal and mobile terminal
US9554036B1 (en) Portable electronic device with shutter button for image capture, and control method thereof
JP2009223490A (en) Virtual switch, and household electric appliance control system and method using same
CN104639977A (en) Program playing method and device
KR20120130466A (en) Device and method for controlling data of external device in wireless terminal
WO2014155885A1 (en) Input device
CN106534750B (en) Display control method and device
CN112073663B (en) Audio gain adjusting method, video chat method and display device
JP6560503B2 (en) Rise notification system
CN107155139A (en) Media content player method, device and computer-readable recording medium
KR101396633B1 (en) Apparatus and method for controlling function of image out using sound signal
KR101189946B1 (en) Method and apparatus for controlling of an image display device for using motion the globe of an eye
KR20070001482A (en) Method for remote controlling of mobile terminal
KR102572935B1 (en) 4D experience apparatus and method that control an operating machine to be linked to a movie using screen key
KR100663580B1 (en) Method for image display of mobile with digital camera

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination