KR101473771B1 - Electronic apparatus, remote control apparatus and control method thereof - Google Patents

Electronic apparatus, remote control apparatus and control method thereof Download PDF

Info

Publication number
KR101473771B1
KR101473771B1 KR1020090123955A KR20090123955A KR101473771B1 KR 101473771 B1 KR101473771 B1 KR 101473771B1 KR 1020090123955 A KR1020090123955 A KR 1020090123955A KR 20090123955 A KR20090123955 A KR 20090123955A KR 101473771 B1 KR101473771 B1 KR 101473771B1
Authority
KR
South Korea
Prior art keywords
remote control
electronic
mode
information
button
Prior art date
Application number
KR1020090123955A
Other languages
Korean (ko)
Other versions
KR20110025017A (en
Inventor
최은석
유호준
최상언
소병석
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to KR1020090083204 priority Critical
Priority to KR20090083204 priority
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Priority claimed from US12/694,867 external-priority patent/US8432305B2/en
Publication of KR20110025017A publication Critical patent/KR20110025017A/en
Application granted granted Critical
Publication of KR101473771B1 publication Critical patent/KR101473771B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance interaction with lists of selectable items, e.g. menus
    • H04N5/4403
    • H04N2005/4428

Abstract

A remote control device for controlling an electronic device according to an aspect of the present invention includes: a communication unit for performing bidirectional communication with the electronic device; A user input unit for receiving a user button selection; A sensing unit for sensing movement of the remote control device; And a controller for transmitting information on the selection of the button of the user to the electronic device if the mode is a button input mode for performing a function corresponding to the inputted button, A pointing function for moving a cursor on a TV using a remote control by sensing a motion of a user by adding a motion sensor to an existing button remote control, and a controller for controlling the communication unit to transmit information about the user to the electronic device, Or a motion recognition function.
DTV, remote control, user UX

Description

TECHNICAL FIELD [0001] The present invention relates to an electronic device, a control method of the electronic device, a remote control device, and a control method of the remote control device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic device, a control method of the electronic device, a remote control device, and a control method of the remote control device, and more particularly, And to provide a universal remote control for DTV capable of performing a pointing function or a motion recognition function for moving a cursor on a TV.

On the TV, you can change the channel and adjust the volume by inputting the buttons on the remote control. The conventional TV has a simple menu, and the services that can be provided by the TV are limited except for watching TV. Now, however, TVs can play multimedia content, play games, and even connect to the Internet to provide a variety of Web-based services. Although the TV itself has been developed to perform various functions, it has been difficult for the user to easily and conveniently use various services using the remote control due to the limitation of the remote control.

Accordingly, it is an object of the present invention to provide an integrated operation remote controller for a DTV capable of performing a pointing function or a motion recognition function of moving a cursor on a TV by detecting motion of a user by adding an operation sensor to a conventional button input type remote controller .

The above object is achieved by a remote control device for controlling an electronic device according to an aspect of the present invention, comprising: a communication unit for performing bidirectional communication with the electronic device; A user input unit for receiving a user button selection; A sensing unit for sensing movement of the remote control device; And a controller for transmitting information on the selection of the button of the user to the electronic device if the mode is a button input mode for performing a function corresponding to the inputted button, And to transmit the information on the electronic device to the electronic device.

According to another aspect of the present invention, there is provided an electronic device controlled by a remote control device according to another aspect of the present invention, comprising: an image processing unit for processing and displaying an image; A communication unit for performing bidirectional communication with the remote control device; And when the communication unit receives the information on the user's button selection, operates in a button input mode for performing a function corresponding to the inputted button, and when the communication unit receives the information on the motion of the remote control device, And a control unit operating in an operation recognition mode for controlling the electronic device.

According to another aspect of the present invention, there is provided a method of controlling a remote control apparatus, the method comprising: receiving a button selection of a user; Sensing movement of the remote control device; And a controller for transmitting information on the selection of the button of the user to the electronic device if the mode is a button input mode for performing a function corresponding to the inputted button, And transmitting the information on the electronic device to the electronic device.

According to another aspect of the present invention, there is provided a method of controlling an electronic device, the method comprising: performing bidirectional communication with a remote control device; Receiving at least one of information on a user's selection of a button and / or information on a motion of the remote control device; And a button input mode for performing a function corresponding to the input button when receiving information on the selection of the user's button, and when receiving information on the motion of the remote control device, the electronic device is controlled by the motion And operating in a motion recognition mode according to an embodiment of the present invention.

As described above, according to the present invention, by performing pointing and operation input using a remote controller, it is possible to easily control a game or multimedia contents, and to provide a new and interesting UX (User Experience) to the user.

Furthermore, by switching the state of the motion sensor provided in the remote controller to the Power Save / Active and Sleep states, the user can intelligently manage the power without any control of the user, thereby dramatically extending the battery usage time.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art to which the present invention pertains. The present invention may be embodied in many different forms and is not limited to the embodiments described herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and the same or similar components are denoted by the same reference numerals throughout the specification.

1 is a diagram showing a configuration of a remote control device and an electronic device according to an embodiment of the present invention.

The remote control apparatus 100 according to an embodiment of the present invention may be a remote controller, a mobile terminal, a PDA (Personal Digital Assistant), an input device, a pointing device, or the like. Further, the remote control device 100 may be an electronic device including a motion sensor, which detects movement of the remote control device 100 and can control the electronic device 150 remotely.

Conventional remote controllers only performed unidirectional communication to transmit control signals to electronic devices. However, the remote control apparatus 100 according to the present invention can support bidirectional communication in order to provide an interface capable of interacting with a user.

The electronic device 150 according to an exemplary embodiment of the present invention may be a digital TV, a monitor, a desktop computer, a notebook computer, or the like. Further, the electronic device 150 may be an electronic device that can be controlled by the remote control device 100. [

Hereinafter, the remote control device 100 and the electronic device 150 will be described in detail.

The remote control apparatus 100 according to an embodiment of the present invention may include a communication unit 102, a user input unit 104, a sensing unit 106, a power supply unit 108, and a control unit 110.

The communication unit 102 can perform bidirectional communication with the electronic device 150. [ Specifically, the communication unit 102 can perform infrared communication, Bluetooth communication, local area network (LAN), Zigbee communication, and the like with the electronic device 150.

The user input unit 104 may receive a user's selection of a button. The selection of the user's button may be an operation of inputting a predetermined key provided in the remote control apparatus 100.

The sensing unit 106 may sense the movement of the remote control device 100. [ For this, the sensing unit 106 may include at least one of a gyro sensor, an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor. The motion sensors may convert motion into an electronic signal. The movement of the remote control device 100 may include at least one of a pointing operation indicating a predetermined area of the electronic device 150 and a predetermined type of movement. In addition, the motion of the remote control apparatus 100 may include three-dimensional motion.

The controller 110 controls operations and functions of the remote controller 100, and can perform operation processing and the like. For this, an operation processing block, a memory block, a power control block, and the like may be included. In this case, the control unit 110 may program the control algorithm and store the control algorithm in each memory block and execute it in the operation processing block.

The control unit 110 transmits information on the selection of a button of the user to the electronic device 150 in the case of a button input mode for performing a function corresponding to the inputted button, The communication unit 102 can be controlled so as to transmit information on the motion of the remote control apparatus 100 to the electronic device 150. [ Specifically, the controller 110 may transmit a packet including a field for a user's button selection, or may transmit a packet including a field for motion of the remote controller 100. The format of the packet will be described later with reference to FIGS. 2A to 2B.

Meanwhile, in the case of the motion recognition mode, the controller 110 may control the communication unit 102 to transmit the information on the user's button selection and the motion of the remote controller 100 to the electronic device 150.

The control unit 110 transmits information about the operation mode of the remote control device 100 together with information on the user's selection of the button or information on the motion of the remote control device 100 to the electronic device 150 The communication unit 102 can be controlled. Specifically, the remote control apparatus 100 transmits a field for the operation mode of the remote control apparatus 100 to a packet including a field for the user's button selection and / or a field for the motion of the remote control apparatus 100 Can be included.

According to one embodiment, the control unit 110 may operate in a button input mode or an operation recognition mode according to information received from the electronic device 150. [ For example, the control unit 110 can determine the operation mode based on the type of content received from the electronic device 150. [ If the user executes the game, the remote control apparatus 100 can operate in the motion recognition mode. On the other hand, if the control unit 110 does not receive the information from the electronic device 150, the control unit 110 can operate in the button input mode.

When the remote controller 100 according to the embodiment of the present invention operates in the operation recognition mode, the power supplied to the operation sensors such as the gyro sensor and the acceleration sensor is always kept active for pointing recognition or motion detection . Therefore, the power consumption of the battery increases, and the battery use time is shortened compared to when only the button is used.

In order to solve such a problem, according to the present invention, when the user controls the TV using only the buttons of the remote controller, it detects the TV, automatically switches the state of the motion sensor to the power save mode, Only when used, the power supplied to the motion sensor is switched to the power active state to minimize the power consumption of the battery.

To this end, the remote control apparatus 100 may include a power supply unit 108 for supplying power to the sensing unit 106.

The control unit 108 may control the power supply unit 108 to switch the power supply to the sensing unit 106 to switch to the power saving mode when the power supply unit 108 operates in the button input mode. In this case, the control unit 110 may determine whether to operate in the button input mode or the operation recognition mode according to at least one of the functions executed by the electronic device 150 and the attributes of the application.

The control unit 110 may control the power supply unit 108 to switch to the power saving mode if the operation of the remote control device 100 is not detected for a predetermined time period when the operation mode is the operation recognition mode.

According to the modified embodiment, the sensing unit 106 can sense the motion of the remote control device in a sleep state. In the sleep state, the control unit 110 may control the power supply unit 108 to supply only a predetermined minimum level of power for sensing the motion to the sensing unit 106. [ In this case, the control unit 110 manages power by the following steps.

First, when the controller 110 operates in the operation recognition mode, the controller 110 controls the power supply unit 108 to switch to the sleep state if the movement of the remote controller 100 is not detected for a predetermined time.

Thereafter, the controller 110 controls the power supply unit 108 to switch to the power saving state when the motion of the remote controller 100 is not detected for a predetermined time in the sleep state.

Meanwhile, the controller 110 may control the power supply unit 108 to switch to the power active state in which power is supplied to the sensing unit 106 when the motion of the remote controller 100 is detected in the sleep state.

The electronic device 150 according to an embodiment of the present invention may include an image processing unit 152, a communication unit 154, and a control unit 156. [

The image processing unit 152 can process and display the image. In this case, the image processing unit 152 may be a display implemented in the form of a liquid crystal display (LCD), an organic light emitting diode (OLED), and a plasma display panel (PDP) Panel.

The communication unit 154 can perform bidirectional communication with the remote control apparatus 100. [ Specifically, the communication unit 102 can perform infrared communication, Bluetooth communication, local area network (LAN), Zigbee communication, and the like with the electronic device 150.

The control unit 156 operates in a button input mode in which the communication unit 154 performs a function corresponding to the input button when the information on the user's button selection is received and when the communication unit 154 receives the movement of the remote control apparatus 100 It is possible to operate in an operation recognition mode for controlling the electronic device 150 by the movement.

The motion of the remote control apparatus 100 may include three-dimensional motion.

The control unit 156 controls the communication unit 154 to transmit information on at least one of functions, applications, and contents executed by the electronic device 150 to the remote control device 100 when the electronic device 150 is powered on Can be controlled.

Meanwhile, when the controller 156 receives information on the user's button selection or information on the motion of the remote controller 100, the controller 156 may receive information on the operation mode of the remote controller 100 together. In this case, the control unit 156 may operate in the button input mode or the operation recognition mode by referring to the information on the operation mode of the remote control device 100 received by the communication unit 154. [

The control unit 156 may control the image processing unit 152 to display a pointing cursor when operating in the motion recognition mode.

FIG. 2A is a diagram illustrating a configuration of a packet transmitted when the remote control apparatus operates in the button input mode, and FIG. 2B is a diagram illustrating a configuration of a packet transmitted when the remote control apparatus operates in the operation recognition mode.

The header field 210 indicates that the transmission of the signal is started.

The mode field 220 identifies the mode of the remote control device 100. Specifically, the mode field 220 contains data for distinguishing whether the mode is the button input mode or the operation recognition mode.

The button data field 230 informs the user about the button selection. For example, you can give information about the pressed button.

The sensor data field 240 informs the detected movement of the remote controller 100.

The Other Info field 250 indicates other data required for remote control, and a check sum field 260 stores data for confirming whether or not the transmission is successful.

When the remote control apparatus 100 operates in the button input mode, the remote control apparatus 100 can transmit information on the selection of the user's button to the electronic device 150. [ In this case, information on the motion of the remote control apparatus 100 is not transmitted. 2A, the packet to be transmitted in this case includes only the button data field 230, and the sensor data field 240 does not exist.

When the remote control apparatus 100 operates in the operation recognition mode, the remote control apparatus 100 can transmit information on the movement of the remote control apparatus 100 to the electronic apparatus 150. [ Further, both the user's selection of the button and the information about the motion of the remote control apparatus 100 may be transmitted to the electronic device 150. Referring to FIG. 2B, in this case, both the button data field 230 and the sensor data field 240 exist in the packet to be transmitted.

3 is a flowchart illustrating a process of controlling a remote control apparatus according to an exemplary embodiment of the present invention.

The remote control apparatus 100 determines the operation mode (S301).

According to one embodiment, the remote control device 100 can operate in a button input mode or a motion recognition mode according to information received from the electronic device 150. [ That is, the operation mode of the remote control apparatus 100 can be determined by information received from the electronic device 150, and can operate in a button input mode basically in a situation where information is not received. Specifically, the remote control apparatus 100 can determine whether to operate in the button input mode or the operation recognition mode according to at least one of the functions executed by the electronic device 150, the attributes of the application, and the types of contents .

According to another embodiment, in the electronic device 150, the button input mode or the operation recognition mode may be set according to the menu of the electronic device 150, and information on the button input mode or the operation recognition mode may be transmitted to the remote control device 100. [

The remote control apparatus 100 receives a user's selection of a button or detects the movement of the remote control apparatus 100. Both of the above operations may be performed.

In the case of the button input mode (S302), the remote control device 100 transmits information on the user's button selection to the electronic device 150 (S303). Specifically, a packet including a button data field 230 for informing the user about button selection may be transmitted.

In the case of the operation recognition mode (S312), the remote control device 100 transmits information on the motion of the remote control device 100 to the electronic device 150 (S313). Specifically, a packet including the sensor data field 240 informing the information on the motion of the remote control apparatus 100 can be transmitted.

4 is a diagram illustrating a process of controlling an electronic device according to an embodiment of the present invention.

With the power of the electronic device 150 turned off, the power of the electronic device 150 is turned on (S401). Specifically, the user can turn on the power of the electronic device 150 with the remote controller. Meanwhile, according to an embodiment, the electronic device 150 may be set to operate in a button input mode basically in a power-off state.

In this case, the electronic device 150 transmits information to the remote control device 100 (S402). Specifically, the electronic device 150 can transmit information about at least one of functions, applications, and contents executed by the electronic device 150 to the remote control device 100. [ Based on the information, the remote control apparatus 100 can determine whether to operate in the button input mode or the operation recognition mode.

According to a modified embodiment, the electronic device 150 can determine the operation mode according to the menu of the electronic device 150 and transmit the determined operation mode information to the remote control device 100. [

The electronic device 150 receives data from the remote control device 100 (S403).

In this case, the electronic device 150 determines the operation mode (S404). Specifically, the mode field 220 informing the mode information of the remote control apparatus 100 from the received data can be referred to.

In the case of the button input mode (S405), the electronic device 150 receives information on the user's button selection (S406). In this case, the electronic device 150 performs a function corresponding to the input button (S407). Specifically, an operation based on the button signal input by the application can be performed.

In the case of the operation recognition mode (S415), the electronic device 150 receives information about the motion of the remote control device 100 (S416). In this case, the electronic device 150 controls the electronic device 150 in response to the movement (S417). Specifically, an operation result of the pointing coordinate and the operation is generated from the sensed motion, and various controls for the application can be performed using the operation result.

Further, the electronic device 150 may display a pointer or a pointing cursor on the application.

5 is a schematic view illustrating a remote control device and an electronic device according to an embodiment of the present invention.

When the TV is used, the user enters the menu requiring the pointing function with the integrated remote control. In this case, if the user moves the remote control up, down, left, or right, The sensor detects the movement of the user. The remote control converts the sensed signal to the position coordinates of the display device through the pointing algorithm and displays the position coordinates on the TV.

Referring to FIG. 5, a broadcast screen and a game application are simultaneously displayed on the electronic device 150. The user can operate the remote control apparatus 100 in the operation recognition mode to perform the game application. For example, when the user moves the remote controller 100 in the direction a, the pointer moves vertically on three dimensions. When the user moves the pointer b in the direction b, the pointer moves in the Y axis direction on the two- Axis direction on the two-dimensional plane.

Of course, it is also possible to control the general functions of the TV by operating the remote control device 100 in the operation recognizing mode according to the user's selection. For example, the degree of channel movement may be varied depending on the angle at which the remote control apparatus 100 is moved in the vertical direction.

On the other hand, when the user wants to perform a general function of the TV, the remote controller can perform a button input function. For example, when a user watches a broadcast using the remote control apparatus 100, the remote control apparatus 100 can move the channel upward by using the channel UP key.

The electronic device 150 controlled by the remote control device 100 may perform the function corresponding to the input button or may control the electronic device 150 in response to the motion.

When using the remote control to select a TV menu or play a game, the user moves to a desired location using the four-way key. In this case, it is only possible to move in sequential order, so it is impossible to move to a desired place at once, just like using a mouse on a PC. In addition, since the same IR signal is sent several times for stable input of the key, the input speed of the key is slow and it is not suitable for performing an application such as a game.

According to the present invention, in this case, the remote control apparatus 100 can be operated in the operation recognition mode to implement a UI that matches the characteristics of the application.

6A and 6B illustrate various embodiments of a remote control device and an electronic device according to an embodiment of the present invention.

In the present invention, motion in three dimensions can be sensed using a remote controller including an operation sensor, and information on the motion can be transmitted to a TV. As a result, it is possible to control the multimedia contents such as the 3D UI or the game displayed on the TV.

Referring to FIG. 6A, a menu is displayed in a three-dimensional form on a TV screen. In this case, the user can control the three-dimensional UI by moving the remote controller on a two-dimensional plane or a three-dimensional space. For example, the user can select menu A or menu B by moving the remote control on a two-dimensional plane. Further, by moving the remote controller up and down in the three-dimensional space, the submenu 1, the submenu 2, etc. belonging to the menu A or the menu B can be selected.

Referring to FIG. 6B, a game screen is displayed on the TV screen. In this case, the user can control the three - dimensional game application by moving the remote controller on the two - dimensional plane or three - dimensional space. For example, by moving the remote control up and down in three-dimensional space, you can raise or lower the position of the ball on a step by step basis. By moving the remote control on the two-dimensional plane in the lateral direction, the positions of the holes can be shifted left and right on the same step.

6A and 6B, it is possible to precisely control the UI or the contents realized in the three-dimensional form by sensing the movement of the remote controller on the three-dimensional plane.

7A and 7B are diagrams showing a schematic control process of a remote control apparatus according to another embodiment of the present invention.

7A shows a case where a general motion sensor is used.

When operating in the button input mode, the remote control device 100 switches to power save mode. Specifically, power to be supplied to the sensing unit 106 can be cut off and the power saving state can be switched. In addition, information transmitted to the electronic device 150 can also transmit only button data, thereby minimizing power consumption.

When operating in the motion recognition mode, the remote control apparatus 100 switches to the Power active state. In addition, the information to be transmitted to the electronic device 150 includes both the button data and the detected motion data. On the other hand, even when the remote control apparatus 100 operates in the operation recognition mode, the remote control apparatus 100 switches to the power saving state if there is no movement of the remote control apparatus 100 for a predetermined time.

Further, the remote control apparatus 100 can switch between the power-saving state and the power-active state according to the functions executed by the electronic device 150 and the attributes of the application.

FIG. 7B shows a case in which a motion sensor capable of detecting an operation in a sleep state consuming only a minimum amount of electric power is used.

With the recent development of MEMS (Microelectromechanical Systems) technology, motion sensors have been introduced that can detect motion in a state of consuming only a small amount of electric power to perform a specific function (that is, in a sleep state). Such a motion sensor can detect motion in a sleep state that consumes a minimum of current.

In the case of operating in the button input mode, the remote controller 100 switches to a power save state or keeps the power saving state.

When operating in the motion recognition mode, the remote control apparatus 100 switches to the power active state or maintains the power active state. If there is no movement for a predetermined time, the remote control apparatus 100 switches to the sleep state. Specifically, only the minimum amount of power for sensing the motion of the sensing unit 106 can be supplied. If there is no movement for a predetermined period of time again in the sleep state, the remote control apparatus 100 switches to the power saving state. On the other hand, when the motion is detected in the sleep state, the remote control apparatus 100 can switch to the power active state. For example, if the user holds the remote control or moves in a certain direction, the user can enter the power active mode and perform the functions of the remote control.

For this purpose, the sensing unit 106 may monitor the movement of the user or the movement of the remote control device 100 at regular intervals.

According to the embodiment shown in FIG. 7B, when there is no movement for a predetermined period of time in the operation recognizing mode, the remote controller 100 switches to the sleep state or the power saving state. Also, in the sleep state, the remote controller 100 supplies only the minimum power for motion detection only to the motion sensor. As a result, power consumption can be minimized and efficient power management can be performed.

8 is a flowchart illustrating a control procedure of the remote control apparatus according to another embodiment of the present invention.

The remote control device 100 determines the operation mode (S801). According to one embodiment, the remote control apparatus 100 can determine the operation mode based on the information received from the electronic device 150. [ Specifically, based on information on at least one of functions, applications, and contents executed by the electronic device 150, it can be determined whether to operate in the button input mode or the operation recognition mode.

When the remote controller 100 operates in the button input mode (S802), the remote controller 100 keeps the sensing unit 106 in the power saving state or switches to the power saving state (S803). In addition, only the button information can be transmitted to the electronic device 150. [ In this case, when the user inputs a button (S804), the remote control device 100 transmits the input button information to the electronic device 150 (S805).

In the case of the operation recognition mode (S812), the remote controller 100 holds or switches the sensing unit 106 to the power active state (S813). In addition, both the button information and the motion information can be transmitted to the electronic device 150. In this case, when the user inputs a motion (S814), the remote control device 100 transmits the recognized motion information to the electronic device 150 (S815).

Meanwhile, when transmitting the button information and / or the motion information to the electronic device 150, the remote control apparatus 100 may transmit together the mode information for distinguishing the two modes.

Although several embodiments of the present invention have been shown and described, those skilled in the art will appreciate that various modifications may be made without departing from the principles and spirit of the invention . The scope of the invention will be determined by the appended claims and their equivalents.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram showing a configuration of a remote control apparatus and an electronic apparatus according to an embodiment of the present invention; Fig.

FIG. 2A is a diagram illustrating a configuration of a packet transmitted when the remote control apparatus operates in the button input mode, and FIG. 2B is a diagram illustrating a configuration of a packet transmitted when the remote control apparatus operates in the operation recognition mode.

3 is a flowchart illustrating a process of controlling a remote controller according to an exemplary embodiment of the present invention.

4 is a diagram illustrating a process of controlling an electronic device according to an embodiment of the present invention.

5 is a schematic view of a remote control device and an electronic device according to an embodiment of the present invention.

6A and 6B illustrate various forms of implementing a remote control device and an electronic device according to an embodiment of the present invention.

FIG. 7A and FIG. 7B are diagrams illustrating a schematic control process of a remote control apparatus according to another embodiment of the present invention. FIG.

8 is a flowchart illustrating a control process of the remote control apparatus according to another embodiment of the present invention.

Description of the Related Art

100: remote control device 102:

104: user input unit 106:

108: power supply unit 110:

150: electronic device 152: image processing unit

154: communication unit 156:

Claims (66)

  1. A remote control device for controlling an electronic device,
    A communication unit for performing bidirectional communication with the electronic device;
    A user input unit for receiving a user button selection;
    A sensing unit for sensing movement of the remote control device; And
    When the mode is a button input mode for performing a function corresponding to an input button, information on a button selection of the user is transmitted to the electronic device, and if the mode is an operation recognition mode in which the electronic device is controlled by movement, And a control unit for controlling the communication unit to transmit information on the electronic device to the electronic device,
    Wherein the controller operates in the button input mode or the operation recognition mode according to information received from the electronic device,
    Wherein the communication unit receives information about at least one of an operation mode of the electronic device, a function executed by the electronic device, an application, and contents from the electronic device.
  2. The method according to claim 1,
    Wherein the motion of the remote control device includes a three-dimensional motion.
  3. The method according to claim 1,
    Wherein the movement of the remote control device includes at least one of a pointing operation pointing to a predetermined area of the electronic device and a predetermined type of movement.
  4. The method according to claim 1,
    Wherein the control unit controls the communication unit to transmit information on the selection of the user's button and the motion of the remote control device to the electronic device in the operation recognition mode.
  5. The method according to claim 1,
    Wherein the control unit controls the communication unit to transmit the information on the operation mode of the remote control device together with information on the button selection of the user and / A remote control device for controlling.
  6. delete
  7. The method according to claim 1,
    Wherein the control unit operates in the button input mode if the information is not received from the electronic device.
  8. delete
  9. The method according to claim 1,
    Wherein the sensing unit includes at least one of a gyro sensor, an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor.
  10. The method according to claim 1,
    And a power supply unit for supplying power to the sensing unit.
  11. 11. The method of claim 10,
    Wherein the controller controls the power supply unit to switch to a power saving state by shutting off the power supplied to the sensing unit when operating in the button input mode.
  12. 12. The method of claim 11,
    Wherein the control unit determines whether to operate in the button input mode or the operation recognition mode according to at least one of a function executed by the electronic device and an attribute of an application.
  13. 12. The method of claim 11,
    Wherein the control unit controls the power supply unit to switch to the power saving mode if motion of the remote control device is not detected for a predetermined time period when operating in the operation recognition mode.
  14. 11. The method of claim 10,
    Wherein the sensing unit is capable of sensing movement of the remote control device in a sleep state.
  15. 15. The method of claim 14,
    Wherein the controller controls the power supply unit to switch to a power saving state by shutting off the power supplied to the sensing unit when operating in the button input mode.
  16. 15. The method of claim 14,
    Wherein the control unit controls the power supply unit to switch to the sleep state when the operation of the remote control unit is not detected for a predetermined time period when the remote control unit operates in the operation recognition mode.
  17. 17. The method of claim 16,
    Wherein the control unit controls the power supply unit to switch to a power saving state when the movement of the remote control device is not detected for a predetermined time in the sleep state.
  18. 17. The method of claim 16,
    Wherein the control unit controls the power supply unit to switch to a power active state in which power is supplied to the sensing unit when the movement of the remote control device is detected in the sleep state.
  19. An electronic device controlled by a remote control device,
    An image processing unit for processing and displaying an image;
    A communication unit for performing bidirectional communication with the remote control device; And
    Wherein the communication unit operates in a button input mode for performing a function corresponding to the input button when the communication unit receives the information on the selection of the button by the user and when the communication unit receives the information on the motion of the remote control device, And a control unit operating in an operation recognition mode for controlling the electronic device,
    Wherein the communication unit is configured to communicate with the remote control device with information on whether it is operating in the button input mode or the operation recognition mode,
    Wherein the control unit controls the communication unit to transmit to the remote control device information including at least any one of an operation mode of the electronic device, a function executed by the electronic device, an application, and contents.
  20. 20. The method of claim 19,
    Wherein the motion of the remote control device comprises a three-dimensional motion.
  21. 20. The method of claim 19,
    Wherein the movement of the remote control device comprises at least one of a pointing operation pointing to a predetermined area of the electronic device and a movement of a predetermined type.
  22. 20. The method of claim 19,
    Wherein the control section operates in the operation recognition mode in which the communication section controls the electronic device by the movement when receiving information on the user's button selection and the movement of the remote control device.
  23. delete
  24. 20. The method of claim 19,
    Wherein the control unit receives together information on the operation of the remote control device when receiving information on the selection of the user's button or information on the motion of the remote control device.
  25. 25. The method of claim 24,
    Wherein the control unit operates in the button input mode or the operation recognition mode by referring to the information on the operation mode of the remote control device received by the communication unit.
  26. 20. The method of claim 19,
    Wherein the control unit controls the image processing unit to display a pointing cursor when operating in the operation recognition mode.
  27. A control method of a remote control apparatus,
    Receiving a user's button selection;
    Sensing movement of the remote control device;
    When the mode is a button input mode for performing a function corresponding to an input button, information on a button selection of the user is transmitted to an electronic device, and if the mode is an operation recognition mode for controlling the electronic device, Transmitting information to the electronic device; And
    Receiving information about at least one of an operating mode of the electronic device, a function executed by the electronic device, an application, and contents from the electronic device,
    Wherein the remote control device selects one of the button input mode and the operation recognition mode based on the information received from the electronic device.
  28. 28. The method of claim 27,
    Wherein the motion of the remote control device includes a three-dimensional motion.
  29. 28. The method of claim 27,
    Wherein the movement of the remote control device includes at least one of a pointing operation pointing to a predetermined area of the electronic device and a predetermined type of movement.
  30. 28. The method of claim 27,
    And transmitting information on the selection of the user's button and the motion of the remote control device to the electronic device if the mode is the motion recognition mode.
  31. 28. The method of claim 27,
    And transmits information on the operation mode of the remote control device together with information on the selection of the button of the user and / or information on the motion of the remote control device to the electronic device.
  32. delete
  33. 28. The method of claim 27,
    And if the information is not received from the electronic device, operates in the button input mode.
  34. delete
  35. 28. The method of claim 27,
    And selectively supplying power to a sensing unit for sensing movement of the remote control device.
  36. 36. The method of claim 35,
    Wherein the control unit switches the power saving mode by turning off the power supplied to the sensing unit when the power supply unit operates in the button input mode.
  37. 37. The method of claim 36,
    And determining whether to operate in the button input mode or the operation recognition mode according to at least one of a function executed by the electronic device and an attribute of an application.
  38. 37. The method of claim 36,
    Wherein the control unit switches to the power saving state when the operation of the remote control unit is not detected for a predetermined time period when the operation is performed in the operation recognition mode.
  39. 36. The method of claim 35,
    Wherein the sensing unit is capable of sensing movement of the remote control device in a sleep state.
  40. 40. The method of claim 39,
    Wherein the control unit switches the power saving mode by turning off the power supplied to the sensing unit when the power supply unit operates in the button input mode.
  41. 40. The method of claim 39,
    And when the remote control apparatus operates in the operation recognition mode, the remote control apparatus switches to the sleep state if no movement of the remote control apparatus is detected for a predetermined time.
  42. 42. The method of claim 41,
    And switching to a power save state if the movement of the remote control device is not detected for a predetermined time in the sleep state.
  43. 42. The method of claim 41,
    And switching to a power active state for supplying power to the sensing unit when the movement of the remote control device is detected in the sleep state.
  44. A method of controlling an electronic device,
    Performing bi-directional communication with the remote control device;
    Receiving at least one of information on a user's selection of a button and / or information on a motion of the remote control device;
    When receiving information on a user's selection of a button, operates in a button input mode for performing a function corresponding to the input button, and when receiving information on the motion of the remote control device, Operating in a recognition mode; And
    And transmitting information on at least one of an operation mode of the electronic device, a function executed by the electronic device, an application, and contents to the remote control device,
    Wherein the electronic device communicates information operating in the button input mode or the operation recognition mode with the remote control device.
  45. 45. The method of claim 44,
    Wherein the motion of the remote control device includes a three-dimensional motion.
  46. 45. The method of claim 44,
    Wherein the movement of the remote control device includes at least one of a pointing operation pointing to a predetermined area of the electronic device and a predetermined type of movement.
  47. 45. The method of claim 44,
    Receiving the information about the user's button selection and the motion of the remote control device, operates in the motion recognition mode for controlling the electronic device by the motion.
  48. delete
  49. 45. The method of claim 44,
    When receiving information on the selection of the user's button or information on the motion of the remote control device, information on the operation mode of the remote control device.
  50. 50. The method of claim 49,
    And operating in the button input mode or the operation recognition mode by referring to the received information on the operation mode of the remote control device.
  51. 45. The method of claim 44,
    And when the electronic device operates in the operation recognition mode, displaying a pointing cursor.
  52. In the control device,
    A communication unit for communicating with a remote electronic device controlled by the control device;
    A control unit which receives information from the electronic device via the communication unit and determines whether to switch the control device to a button input mode or an operation input mode based on the received information;
    And an input for receiving an input for the determined mode.
  53. 53. The method of claim 52,
    Wherein the input unit includes a second input unit including a first input unit for receiving a button input from a user and a sensor for sensing an operation of the control unit.
  54. 54. The method of claim 53,
    Wherein the communication unit generates a first type packet including a header field, a mode field, a button data field and a Other Info field if the control apparatus is in the button input mode, and if the control apparatus is in the operation input mode, , A button data field, a sensor data field, and a Other Info field.
  55. 54. The method of claim 53,
    The electronic device is a television,
    Wherein the control device is the button input mode while the television program is being broadcasted, and is the operation input mode when the game is played back on the television.
  56. 54. The method of claim 53,
    Wherein the control device comprises a three-dimensional sensor.
  57. 20. The method of claim 19,
    Wherein the information transmitted by the communication unit is at least one of a function, an application, and contents executed by the electronic device, and the remote control device displays the button input mode or the operation recognition Mode, and transmits the determined result to the communication unit.
  58. 20. The method of claim 19,
    Wherein the control unit determines whether the information transmitted by the communication unit of the remote control apparatus includes the button input mode or the operation recognition mode determined according to the menu stored in the electronic device.
  59. The method according to claim 1,
    Wherein the channel change rate of the electronic device changes corresponding to the speed of the detected movement of the remote control device.
  60. The method according to claim 1,
    Wherein the motion of the remote control device comprises a three-dimensional motion that manipulates a three-dimensional menu displayed on the electronic device.
  61. A remote control device for controlling an electronic device,
    A user input unit for receiving a user button selection;
    A sensing unit for sensing movement of the remote control device; And
    A button input mode for performing a function corresponding to a button input as an operation mode, and an operation recognition mode for providing motion information of the electronic device in response to the motion; and when the operation mode of the remote control device is a button input mode, And a control unit for switching the sensing unit to a power save state.
  62. A control method of a remote control apparatus,
    Operating in a button input mode that performs a function corresponding to a button input as an operation mode and an operation recognition mode that provides motion information of the electronic device in response to the motion;
    Determining whether the current operation mode is the button input mode or the operation recognition mode;
    And switching the sensing unit to a power save state when the operation mode is the button input mode, wherein the sensing unit senses the movement of the remote control device.
  63. An electronic device controlled by a remote control device,
    An image processing unit for processing and displaying an image;
    A receiving unit for receiving control information from the remote control device; And
    Wherein the receiving unit operates in a non-pointing mode for performing a function corresponding to the input button when receiving information on a user's button selection, and when the receiving unit receives information on the motion of the remote control device, And a control unit operating in a pointing mode for controlling the electronic device,
    Wherein the receiving unit receives from the remote control device information for determining whether the portable terminal is in the non-pointing mode or the pointing mode.
  64. 64. The method of claim 63,
    Wherein the motion of the remote control device comprises a three-dimensional motion.
  65. 64. The method of claim 63,
    Wherein the control unit controls the image processing unit to display the pointing cursor according to the received information about the motion of the remote control device when the pointing mode is operated.
  66. A remote control device for controlling an electronic device,
    A user input unit for receiving a user button selection;
    A sensing unit for sensing movement of the remote control device; And
    A non-pointing mode for performing a function corresponding to the input button, and a pointing mode for providing motion information of the electronic device in response to the motion of the remote control device, wherein when the remote control device is in the non-pointing mode, And a control unit for switching to a power-saving state.
KR1020090123955A 2009-09-03 2009-12-14 Electronic apparatus, remote control apparatus and control method thereof KR101473771B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020090083204 2009-09-03
KR20090083204 2009-09-03

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US12/694,867 US8432305B2 (en) 2009-09-03 2010-01-27 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof
EP13186659.2A EP2683158B1 (en) 2009-09-03 2010-06-29 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof
EP18169548.7A EP3373576A1 (en) 2009-09-03 2010-06-29 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof
EP10167633A EP2306709A1 (en) 2009-09-03 2010-06-29 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof
US13/769,035 US8941530B2 (en) 2009-09-03 2013-02-15 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof
US14/269,862 US8988271B2 (en) 2009-09-03 2014-05-05 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof
US14/637,498 US9542838B2 (en) 2009-09-03 2015-03-04 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof
US15/374,001 US9911322B2 (en) 2009-09-03 2016-12-09 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof
US15/888,724 US20180158321A1 (en) 2009-09-03 2018-02-05 Electronic apparatus, control method thereof, remote control apparatus, and control method thereof

Publications (2)

Publication Number Publication Date
KR20110025017A KR20110025017A (en) 2011-03-09
KR101473771B1 true KR101473771B1 (en) 2014-12-19

Family

ID=43932762

Family Applications (3)

Application Number Title Priority Date Filing Date
KR1020090123955A KR101473771B1 (en) 2009-09-03 2009-12-14 Electronic apparatus, remote control apparatus and control method thereof
KR1020130037610A KR101445211B1 (en) 2009-09-03 2013-04-05 Electronic apparatus, remote control apparatus and control method thereof
KR1020130111380A KR101584950B1 (en) 2009-09-03 2013-09-16 Electronic apparatus, remote control apparatus and control method thereof

Family Applications After (2)

Application Number Title Priority Date Filing Date
KR1020130037610A KR101445211B1 (en) 2009-09-03 2013-04-05 Electronic apparatus, remote control apparatus and control method thereof
KR1020130111380A KR101584950B1 (en) 2009-09-03 2013-09-16 Electronic apparatus, remote control apparatus and control method thereof

Country Status (1)

Country Link
KR (3) KR101473771B1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101247428B1 (en) * 2011-07-08 2013-03-25 한국과학기술원 Remote control device and remote control system
KR101944828B1 (en) * 2012-05-02 2019-02-01 엘지전자 주식회사 Media system, electronic device, remote control device and method of adjusting zoom of content
KR101984576B1 (en) * 2012-06-28 2019-05-31 엘지전자 주식회사 Display device controlled by pointing device and method for controlling the same
KR101586321B1 (en) 2015-03-11 2016-01-19 엘지전자 주식회사 Display device and controlling method thereof

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6346891B1 (en) * 1998-08-31 2002-02-12 Microsoft Corporation Remote control system with handling sensor in remote control device
US8760522B2 (en) 2005-10-21 2014-06-24 I-Interactive Llc Multi-directional remote control system and method
JP2007335925A (en) * 2006-06-12 2007-12-27 Matsushita Electric Ind Co Ltd Remote control system
KR101451271B1 (en) * 2007-10-30 2014-10-16 삼성전자주식회사 Broadcast receiving apparatus and control method thereof
US8780278B2 (en) * 2007-11-30 2014-07-15 Microsoft Corporation Motion-sensing remote control
FR2928245B1 (en) 2008-03-10 2011-01-07 Air Liquide Process for de-freezing food products by microwaves

Also Published As

Publication number Publication date
KR20110025017A (en) 2011-03-09
KR101584950B1 (en) 2016-01-15
KR101445211B1 (en) 2014-09-29
KR20130123343A (en) 2013-11-12
KR20130041052A (en) 2013-04-24

Similar Documents

Publication Publication Date Title
US10248301B2 (en) Contextual user interface
US9978261B2 (en) Remote controller and information processing method and system
EP2895911B1 (en) Apparatus and method of providing user interface on head mounted display and head mounted display thereof
TWI592857B (en) Display system and tv apparatus
US8887049B2 (en) Device, method and timeline user interface for controlling home devices
US8982072B2 (en) Mobile device and method of controlling screen thereof
EP2876529A1 (en) Unlocking mobile device with various patterns on black screen
JP5819965B2 (en) System and apparatus
KR101561155B1 (en) Method and system for adapting the usage of external display with mobile device
US9729608B2 (en) Information processing device, table, display control method, program, portable terminal, and information processing system
CN102232211B (en) Handheld terminal device user interface automatic switching method and handheld terminal device
US9933837B2 (en) Electronic device, control method of electronic device, and program
KR101924974B1 (en) Methods and apparatus for remote controlling peripheral device in mobile communication terminal
US20140351761A1 (en) Method and apparatus for displaying picture on portable device
KR101670352B1 (en) Mobile Terminal, Electronic Device and Method Of Controlling Electronic Device
JP4281400B2 (en) Communication device, its display method, computer program, and communication method
US9453732B2 (en) Remote control for sensing movement, image display apparatus for controlling pointer by the remote control, and controlling method thereof
KR20140071118A (en) Method for displaying for virtual button an electronic device thereof
US10505752B2 (en) Electronic apparatus and method of controlling group action
US8866773B2 (en) Remote control apparatus, remote control system, remote control method, and program
US7696980B1 (en) Pointing device for use in air with improved cursor control and battery life
AU2013200965B2 (en) Method and apparatus for scrolling a screen in a display apparatus
WO2014030455A1 (en) Device and program for controlling display direction of images
US9369820B2 (en) Mobile communication device and application interface switching method
EP2219102B1 (en) Input device, control device, control system, handheld device and control method

Legal Events

Date Code Title Description
A201 Request for examination
AMND Amendment
A107 Divisional application of patent
A107 Divisional application of patent
E902 Notification of reason for refusal
AMND Amendment
E601 Decision to refuse application
AMND Amendment
X701 Decision to grant (after re-examination)
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20171129

Year of fee payment: 4

FPAY Annual fee payment

Payment date: 20181129

Year of fee payment: 5