KR101339655B1 - System for driving smart tv using motion sensor user experience bases and the method - Google Patents

Abstract

The present invention relates to a user experience-based smart TV driving system and method using a motion sensor, the RCU relay unit 200 to the motion sensing signal generated by the motion sensor module consisting of geomagnetic field sensor, acceleration sensor and gyro sensor RCU (Remote Control Unit) 100 to transmit to; An RCU intermediary unit 200 for applying the motion sensing signal received from the RCU 100 to the smart TV 300; And a smart TV 300 for controlling a UI (Uer Interface) so as to correspond to a motion sensing signal received from the RCU intermediary 200 according to the pre-installed app (APP).
According to the present invention as described above, by providing a user interface (UI) required for the app (APP) installed to provide a variety of services of the smart TV, by driving the APP embedded in the smart TV through the mouse tracking and motion recognition, Convenience and intuitiveness, localization technology to reduce foreign currency, smart TV by providing an APP that recognizes mouse point tracking and remote control motion based on sensor data received from a remote controller with a built-in motion sensor, Recognizes a motion in a three-dimensional space, and has the effect of driving the display device to correspond to each corresponding motion.

Description

Smart TV driving system based on user experience using motion sensor and its method {SYSTEM FOR DRIVING SMART TV USING MOTION SENSOR USER EXPERIENCE BASES AND THE METHOD}

The present invention relates to a smart TV driving system based on a user experience (UX) using a motion sensor and a method thereof, and more particularly, a UI required for an app (APP) installed to provide various services of a smart TV. It provides a user interface, and relates to a technology for driving the APP embedded in the smart TV through mouse tracking and motion recognition.

In the case of a commonly used pointing device, for example, a remote controller that can be remotely operated can be used. Recently, a technology for controlling a pointing on a screen to correspond to a user's motion by installing a gyro sensor on the remote controller has been developed. .

Looking at the Republic of Korea Patent Publication No. 10-2010-0126154 (motion-based pointing device and a control method for providing a tactile feedback) with reference to Figure 1, the motion detection unit for detecting the user's movement, the long axis direction or Pointing means having a tactile output for providing tactile feedback in the left and right directions; And terminal means for manipulating the pointer displayed on the screen from the movement of the user sensed by the pointing means, and outputting the corresponding tactile information to the pointing means according to the movement of the pointer and the screen change according to the manipulation of the pointer. The tactile output unit is composed of one or more linear vibrators for generating a collision or vibration in at least one of up, down, left, right, front and back according to the tactile information output from the terminal means.

That is, the prior patent is to support the mouse point tracking for the unidirectional two-dimensional space, and to generate a vibration in the up, down, left, right, front, back direction.

However, the prior patent merely increases the recognition rate of the user by providing tactile feedback based on mouse point tracking, and provides mouse point tracking for two-dimensional space, so that button input is inevitable for the actual driving of the display device. to be.

Smart TV drive system and method based on the user experience using the motion sensor according to the present invention to improve this problem, so that the smart TV, that is, the display device recognizes the motion of the three-dimensional space, and corresponding to each motion A technique for driving a display device is proposed.

The present invention has been made to solve the above problems, provides a UI (User Interface) required for the app (APP) installed to provide a variety of services of the smart TV, and embedded in the smart TV through mouse tracking and motion recognition By driving the APP, the user's convenience and intuition are improved, and the localization technology aims to reduce foreign currency.

Further, according to the present invention, by providing the smart TV with an APP that recognizes the mouse point tracking and the motion of the remote control based on the sensor data received from the remote control with a built-in motion sensor, the smart TV recognizes the motion of the three-dimensional space, The purpose is to drive the display apparatus to correspond to each of the corresponding motions.

Smart TV driving system based on the user experience using the motion sensor to achieve the technical problem, the motion sensing signal generated by the motion sensor module consisting of geomagnetic field sensor, acceleration sensor and gyro sensor to the RCU intermediary (200) A remote control unit (RCU) 100 for transmitting; An RCU intermediary unit 200 for applying the motion sensing signal received from the RCU 100 to the smart TV 300; And a smart TV 300 for controlling a UI (Uer Interface) so as to correspond to a motion sensing signal received from the RCU intermediary 200 according to the pre-installed app (APP).

The smart TV driving method based on a user experience using a motion sensor based on the above-described system includes: (a) transmitting a motion sensing signal generated by the RCU 100 to the RCU intermediary 200; (B) applying the motion sensing signal received by the RCU intermediary 200 to the smart TV 300; And (c) controlling the UI (Uer Interface) to correspond to the motion sensing signal applied by the smart TV 300.

According to the present invention as described above, by providing a user interface (UI) required for the app (APP) installed to provide a variety of services of the smart TV, by driving the APP embedded in the smart TV through the mouse tracking and motion recognition, Its convenience and intuitiveness are improved, and localization technology has the effect of reducing foreign currency.

Further, according to the present invention, by providing the smart TV with an APP that recognizes the mouse point tracking and the motion of the remote control based on the sensor data received from the remote control with a built-in motion sensor, the smart TV recognizes the motion of the three-dimensional space, There is an effect of driving the display apparatus to correspond to each of the corresponding motions.

1 is a block diagram showing a conventional motion-based pointing device for providing tactile feedback and a control method thereof.
Figure 2 is a block diagram showing a user experience based smart TV driving system using a motion sensor according to the present invention.
3 is a block diagram illustrating an RCU of a smart TV driving system based on a user experience using a motion sensor according to the present invention.
Figure 4 is a block diagram showing the RCU mediation module of the smart TV driving system based on the user experience using the motion sensor according to the present invention.
Figure 5 is a block diagram showing a smart TV of the user experience based smart TV driving system using a motion sensor according to the present invention.
6 is a flowchart illustrating a user experience-based smart TV driving method using a motion sensor according to the present invention.
7 is a flowchart illustrating a detailed process of step S10 of the user experience-based smart TV driving method using a motion sensor according to the present invention.
8 is a flowchart illustrating a detailed process of step S20 of the user experience-based smart TV driving method using a motion sensor according to the present invention.
9 is a flowchart illustrating a detailed process of step S30 of the user experience-based smart TV driving method using a motion sensor according to the present invention.
10 is a flowchart illustrating yet another detailed process of step S30 of the user experience-based smart TV driving method using a motion sensor according to the present invention.

Specific features and advantages of the present invention will become more apparent from the following detailed description based on the accompanying drawings. Prior to this, terms and words used in the present specification and claims are to be interpreted in accordance with the technical idea of the present invention based on the principle that the inventor can properly define the concept of the term in order to explain his invention in the best way. It should be interpreted in terms of meaning and concept. It is to be noted that the detailed description of known functions and constructions related to the present invention is omitted when it is determined that the gist of the present invention may be unnecessarily blurred.

Hereinafter, referring to FIG. 2, the user experience-based smart TV driving system S using the motion sensor according to the present invention will be described below.

As shown in FIG. 2, in the user experience-based smart TV driving system S using the motion sensor of the present invention, motion sensing generated by the motion sensor module 110 consisting of a geomagnetic sensor, an acceleration sensor, and a gyro sensor is generated. Remote control unit (RCU) 100 for transmitting a signal to the RCU intermediate unit 200, RCU intermediate unit 200 for applying the motion sensing signal received from the RCU 100 to the smart TV 300, and pre-installed It is configured to include a smart TV 300 for controlling the UI (Uer Interface) to correspond to the motion sensing signal received from the RCU intermediary 200 in accordance with the app (APP) driving.

Hereinafter, the RCU 100 of the user experience-based smart TV driving system S using the motion sensor according to the present invention will be described with reference to FIG. 3.

Specifically, the motion sensor module 110 of the RCU 100 is composed of a geomagnetic field sensor 111, an acceleration sensor 112 and a gyro sensor 113 to detect the position and motion, and measure the amount of movement state change, From the measured motion state variation, a motion detection result including raw data (data including raw values), azimuth, roll, and pitch on the X, Y, and Z axes is calculated. Generates a motion sensing signal.

The wireless information transmission module 120 of the RCU 100 transmits the motion sensing signal received from the motion sensor module 110 to the RCU intermediary 200 connected through the wireless communication network.

Hereinafter, the specific description will be omitted, but the wireless communication network according to the present invention wirelessly transmits the information through any one of Zigbee, Bluetooth, Wi-Fi (Wireless Fidelity) or RF4CE. It is desirable to understand the network.

Hereinafter, referring to FIG. 4, the RCU intermediary module 200 of the user experience-based smart TV driving system S using the motion sensor according to the present invention is as follows.

The wireless information receiving module 210 of the RCU intermediary 200 receives a motion sensing signal transmitted from any one of Bluetooth, Zigbee, Wi-Fi, or RF4CE from the RCU 100 to the access module 220. do.

The connection module 220 of the RCU intermediary 200 applies the motion sensing signal received from the wireless information receiving module 210 to the USB HID repeater 310 of the smart TV 300 that is physically connected. The motion sensing signal is converted and applied according to launcher data set to be compatible with the platform corresponding to the manufacturer information of the smart TV 300.

In addition, the connection module 220 of the RCU mediation unit 200 is connected to the smart TV 300 and the USB HID communication method to receive the motion sensing signal received from the wireless information transmission module 120 of the RCU 100 smart TV ( 300 to the USB HID repeater 310.

Also, referring to FIG. 5, the smart TV 300 of the user experience-based smart TV driving system S using the motion sensor according to the present invention will be described below.

The USB HID repeater 310 of the smart TV 300 amplifies and applies the motion sensing signal received from the connection module 220 of the RCU intermediary 200 to the sensor adapter 320, and the sensor adapter 320 is connected to the USB. The AC sensing motion sensing signal received from the HID repeater 310 is converted into a DC form.

In addition, the filtering module 330 of the smart TV 300 receives the motion sensing signal received from the sensor adapter 320 through a peak detector, a low pass filter, or a high pass filter. To filter.

In addition, the sensing information extraction module 340 of the smart TV 300, the raw data of the X, Y, Z axis included in the motion sensing signal filtered by the filtering module 330 (raw data: data including a raw value) ), The azimuth, roll, and pitch are extracted and determined to be motion detection information. If the tracking data is included in the motion sensing signal, it is determined to be mouse tracking information.

In this case, the motion detection information may be any one of unidirectional or bidirectional axis motion motion detection data, unidirectional or bidirectional tilt motion motion detection data, shaking motion motion detection data, or lunge motion motion detection data. Contains a single piece of data.

Specifically, the sensing information extraction module 340 generates unidirectional or bidirectional Axis motion motion detection data when the amount of change extracted by the sensing information extraction module 340 is X or Y axis direction motion data, and unidirectional or bidirectional when the amount of change change is rotational slope data. Generates tilt motion motion detection data and generates shaking motion motion detection data when the extracted change amount is shaken two to three times to the left and right, and the extracted change amount is the forward and backward motion data of the Z axis. In this case, Lunge motion motion detection data is generated.

In addition, the sensing information analysis module 350 of the smart TV 300 receives the motion detection information from the sensing information extraction module 340, and analyzes the trajectory leading to the start point and the coordinates and the end point coordinates of the motion from the motion detection information. Recognizes motion in the dimensional space and generates 'user motion control information' for driving the display device to correspond to the recognized motion.

In this case, the 'user motion control information' includes motion vector data recognizing motion in a three-dimensional space, and the motion vector data includes unidirectional axis motion values, bidirectional axis motion values, and unidirectional tilt motion. Value, bi-directional tilt motion value, knocking motion value, and shaking motion value.

First, the axis motion value is 1) -X-axis single value (Move (s): Left), 2) + X-axis single value (Move (s), which is stopped after the motion from the center coordinate in a single direction. (Right), 3) -Y-axis single value (Move (s): Down), 4) + Y-axis single value (Move (s): Up), 5) -XY-axis single value (Move (s) LeftDown) , 6) -X + Y-axis single value (Move (s): LeftUp), 7) + XY-axis single value (Move (s) RightDown), 8) + X-axis + Y-axis single value (Move (s): RightUp), 9) -Z-axis single value (Move (s): FaceDown) and 10) + Z-axis single value (Move (s): FaceUp).

In addition, the bidirectional axis motion value is 11) -X-axis return value (Move (r): Left), 12) + X-axis return value (Move), which is returned from the center coordinate to the center coordinate after the motion in a single direction. (r): Right), 13) -Y axis return value (Move (r): Down), 14) + Y axis return value (Move (r): Up), 15) -XY axis return value (Move (r ) LeftDown), 16) -X + Y axis return value (Move (r) LeftUp), 17) + XY axis return value (Move (r) RightDown), 18 + X axis + Y axis return value (Move (r) RightUp), 19) -Z-axis return value (Move (r): FaceDown) and 20) + Z-axis return value (Move (r): FaceUp).

In addition, the unidirectional tilt motion value is 1) -X-axis roll single value (Roll (s): Left), 2) + X-axis roll, which stops after a single rotation from the center coordinates toward the user's face. Single value (Roll (s): Right), 3) -Y axis pitch Single value (Pitch (s): Down) and 4) + Y axis pitch Single value (Pitch (s): Up) and left from center coordinate 5) -X-axis edge single value (Edge (s): Left) and 6) + X-axis edge single value (stops after motion that rotates unidirectionally toward the user's face relative to the top edge and the bottom right corner) 7) -X-axis Yaw single value (Yaw (s): Left) and 8) + X-axis Yaw single value (Yaw (s) ): Right).

In addition, the bidirectional tilt motion value is 9) -X axis roll return value (Roll (r): Left), 10) + X, where the recognition information is returned from the center coordinate to the center coordinate after the motion rotating in a single direction. Axis Roll Return Value (Roll (r): Right), 11) -Y Axis Pitch Return Value (Pitch (r): Down) and 12) + Y Axis Pitch Return Value (Pitch (r): Up) and Center Coordinate 13) -X-axis edge return value (Edge (r): Left) and 14) + X which rotates to the center coordinate after the motion of rotating in one direction toward the user's face with respect to the upper left corner and lower right corner Axis edge return value (Edge (r): Right), and the axis rotates back and forth from the center coordinate to the center coordinate after 15) -X axis Yaw return value (Yaw (r): Left) and 16) + X Contains any one of the axis Yaw return values (Yaw (r): Right).

The knocking motion value includes a Knocking (r): Touch value for performing click, select, zoom in / zoom out or scale up / scale down, and the shaking motion value includes a mode change (delete). , Shaking (r): Double value to return, or to terminate).

In addition, the app (APP) 360 of the smart TV 300 controls the UI (User Interface) being displayed on the screen to correspond to the 'user motion control information' received from the sensing information analysis module 350.

That is, the app 360 according to the present invention is smart based on 36 motion vector data for recognizing the movement (including stabbing and subtracting motion) of the RCU 100 in the 3D space included in the 'user motion control information'. A dedicated user interface (UI) for driving a TV can be controlled.

Meanwhile, the mouse tracking analysis module 370 of the smart TV 300 receives the mouse tracking information from the sensing information extraction module 340 and generates 'mouse tracking control information' that controls the display of the mouse cursor from the mouse tracking information. do.

The mouse tracking projection module 380 of the smart TV 300 controls the position of the mouse cursor displayed on the screen so as to correspond to the 'mouse tracking control information' received from the mouse tracking analysis module 370.

Hereinafter, referring to FIG. 6, a user experience based smart TV driving method using a motion sensor according to the present invention will be described below.

First, the motion sensing signal generated by the RCU 100 is transmitted to the RCU intermediary 200 (S10).

Subsequently, the motion sensing signal received by the RCU intermediary unit 200 is applied to the smart TV 300 (S20).

Then, the smart TV 300 controls the UI (Uer Interface) to correspond to the motion sensing signal received (S30).

Specifically, referring to FIG. 7, the detailed process of step S10 of the user experience-based smart TV driving method using the motion sensor according to the present invention will be described below.

First, the motion sensor module 110 of the RCU 100 including the geomagnetic field sensor 111, the acceleration sensor 112, and the gyro sensor 113 detects a position and an operation, and measures an amount of change in an exercise state (S11). .

Subsequently, raw data (raw data: data including raw values), azimuth, roll, and pitch of the X, Y, and Z axes are measured from the motion state change measured by the motion sensor module 110 of the RCU 100. A motion sensing signal is generated by calculating a motion detection result including information about the pitch (S12).

Then, the wireless information transmission module 120 of the RCU 100 transmits the motion sensing signal received from the motion sensor module 110 to the RCU intermediate unit 200 connected through the wireless communication network (S13).

In addition, referring to FIG. 8, the detailed process of step S20 of the user experience-based smart TV driving method using the motion sensor according to the present invention will be described below.

After step S10, the wireless information receiving module 210 of the RCU intermediary 200 receives a motion sensing signal transmitted from the RCU 100 via any one of a wireless communication network of Bluetooth, Zigbee, Wi-Fi or RF4CE (S21). ).

Subsequently, the access module 220 of the RCU intermediary 200 is received from the wireless information receiving module 210, and the launcher (Launcher) is set to be compatible with the platform corresponding to the motion sensing signal of the manufacturer information of the smart TV 300. (S22).

Then, the motion sensing signal converted by the connection module 220 of the RCU mediator 200 is applied to the USB HID repeater 310 of the smart TV 300 connected by the USB HID communication method (S23).

In addition, referring to FIG. 9, a detailed process of step S30 of the user experience-based smart TV driving method using a motion sensor according to the present invention will be described below.

After step S20, the USB HID repeater 310 of the smart TV 300 amplifies and applies the motion sensing signal received from the connection module 220 of the RCU intermediary 200 to the sensor adapter 320 (S31). .

Subsequently, the sensor adapter 320 of the smart TV 300 converts the AC sensing motion sensing signal received from the USB HID repeater 310 into a DC form (S32).

Subsequently, the filtering module 330 of the smart TV 300 receives the motion sensing signal applied from the sensor adapter 320 through a peak detector, a low pass filter, or a high pass filter. Filter (S33).

Subsequently, the sensing information extraction module 340 of the smart TV 300 includes raw data (raw data) of the X, Y, and Z axes included in the motion sensing signal filtered by the filtering module 330. ), The information about the azimuth, roll, and pitch is extracted and determined to be motion detection information. When tracking data is included in the motion sensing signal, it is determined to be mouse tracking information (S34).

As a result of the determination in step S34, when the extracted information is motion detection information, the sensing information analysis module 350 of the smart TV 300 analyzes a trajectory leading from the motion detection information to a start point, coordinates, and end point coordinates of the motion in three dimensions. Recognizing the motion of the space, and generates the user motion control information for driving the display device to correspond to the recognized motion (S35).

In addition, the app (APP) 360 of the smart TV 300 controls the UI (User Interface) displayed on the screen to correspond to the 'user motion control information' received from the sensing information analysis module 350 (S36). .

As shown in FIG. 10, when the extracted information is mouse tracking information, the mouse tracking analysis module 370 of the smart TV 300 controls the display of the mouse cursor from the mouse tracking information. 'Mouse tracking control information' is generated (S37).

Then, the mouse tracking projection module 380 of the smart TV 300 controls the position of the mouse cursor displayed on the screen to correspond to the 'mouse tracking control information' received from the mouse tracking analysis module 370 (S38).

While the present invention has been particularly shown and described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. It will be appreciated by those skilled in the art that numerous changes and modifications may be made without departing from the invention. And all such modifications and changes as fall within the scope of the present invention are therefore to be regarded as being within the scope of the present invention.

S: Smart TV driving system based on user experience using motion sensor
100: RCU 110: motion sensor module
111: geomagnetic sensor 112: acceleration sensor
113: gyro sensor 120: wireless information transmission module
200: RCU broker 210: wireless information receiving module
220: connection module 300: smart TV
310: USB HID Repeater 320: Sensor Adapter
330: filtering module 340: sensing information extraction module
350: sensing information analysis module 360: APP
370: mouse tracking analysis module 380: mouse tracking projection module

Claims (12)

In the smart TV driving system based on the user experience using the motion sensor,
A remote control unit (RCU) 100 for transmitting a motion sensing signal generated by a motion sensor module consisting of a geomagnetic sensor, an acceleration sensor, and a gyro sensor to the RCU intermediary 200;
An RCU intermediary unit 200 for applying the motion sensing signal received from the RCU 100 to the smart TV 300; And
Smart TV 300 for controlling the UI (User Interface) to correspond to the motion sensing signal received from the RCU intermediary 200 in accordance with the pre-installed APP (APP);
The smart TV 300,
A USB HID repeater 310 for amplifying the motion sensing signal received from the connection module 220 of the RCU intermediary 200 and applying it to the sensor adapter 320;
A sensor adapter 320 for converting an AC-type motion sensing signal received from the USB HID repeater 310 into a DC-type;
A filtering module 330 for filtering the motion sensing signal applied from the sensor adapter 320 through a peak detector, a low pass filter, or a high pass filter;
Regarding raw data (data including raw values), azimuth, roll, and pitch of the X, Y, and Z axes included in the motion sensing signal filtered by the filtering module 330 Sensing information extraction module 340 for extracting information and determining that the motion detection information is included, and determining that the motion sensing signal is mouse tracking information;
The display device receives motion detection information from the sensing information extraction module 340, analyzes a trajectory leading to a start point coordinate and an end point coordinate of the motion from the motion detection information to recognize a motion in a 3D space, and corresponds to the recognized motion. Sensing information analysis module 350 for generating 'user motion control information' to drive the;
An app (APP) 360 for controlling a user interface (UI) displayed on a screen so as to correspond to 'user motion control information' received from the sensing information analysis module 350;
A mouse tracking analysis module 370 receiving mouse tracking information from the sensing information extraction module 340 and generating 'mouse tracking control information' for controlling display of the mouse cursor from the mouse tracking information; And
And a mouse tracking projection module 380 for controlling the position of the mouse cursor displayed on the screen so as to correspond to the 'mouse tracking control information' received from the mouse tracking analysis module 370. Smart TV driving system based on user experience. The method of claim 1,
The RCU 100,
Geomagnetic field sensor 111, acceleration sensor 112, and gyro sensor 113 is composed of a sense of position and motion, measure the change in the state of movement, from the measured amount of change in the movement state of the row (RAW A motion sensor module 110 for generating a motion sensing signal by calculating a motion detection result including information on data, azimuth, roll, and pitch; And
A user using a motion sensor, comprising: a motion information transmission module 120 for transmitting a motion sensing signal received from the motion sensor module 110 to an RCU intermediary 200 connected through a wireless communication network. Experience-based smart TV driving system. The method of claim 1,
The RCU mediation unit 200,
A wireless information receiving module 210 which receives a motion sensing signal transmitted through any one of a wireless communication network from Bluetooth, Zigbee, Wi-Fi or RF4CE from the RCU 100 and applies it to the access module 220; And
The motion sensing signal received from the wireless information receiving module 210 is applied to the USB HID repeater 310 of the smart TV 300 physically connected,
And a connection module 220 for converting and applying the motion sensing signal according to the launcher data set to be compatible with the platform corresponding to the manufacturer information of the smart TV 300. Smart TV driving system based on a user experience. The method of claim 3, wherein
The connection module 220,
Connected to the smart TV 300 and the USB HID communication method to apply the motion sensing signal received from the wireless information transmission module 120 of the RCU 100 to the USB HID repeater 310 of the smart TV (300) Smart TV driving system based on user experience using a motion sensor. delete delete The method of claim 1,
The motion detection information,
The data includes any one of unidirectional or bidirectional Axis motion motion detection data, unidirectional or bidirectional tilt motion motion detection data, shaking motion motion detection data, or lunge motion motion detection data.
If the amount of change extracted by the sensing information extraction module 340 is motion data in the X or Y axis direction, generate unidirectional or bidirectional axis motion motion detection data, and when the amount of change is extracted in the rotational tilt data, unidirectional or bidirectional tilt (Tilt) Generates motion motion detection data and generates shaking motion motion detection data when the extracted change amount is shaken two to three times to the left and right, and stabs when the extracted change amount is the forward and backward motion data which is the Z axis. Lunge) Smart TV drive system based on user experience using motion sensor, which generates motion motion detection data. In the smart TV driving method based on the user experience using the motion sensor,
(a) transmitting the motion sensing signal generated by the RCU 100 to the RCU intermediary 200;
(b) applying the motion sensing signal received by the RCU intermediary 200 to the smart TV 300; And
(c) controlling the user interface (UI) to correspond to the motion sensing signal received by the smart TV (300);
The step (c)
(C-1) amplifying the motion sensing signal received from the connection module 220 of the RCU mediator 200 by the smart TV 300;
(C-2) the smart TV 300 converting the amplified AC motion sensing signal into DC current;
(C-3) filtering, by the smart TV 300, the motion sensing signal converted into a direct current form through a peak detector, a low pass filter, or a high pass filter;
The smart TV 300 includes raw data (raw data: data including raw values), azimuth, roll, and pitch of the X, Y, and Z axes included in the motion sensing signal filtered by the filtered motion sensing signal. (C-4) extracting information on the pitch and determining that the motion detection information is the motion detection information, and determining the mouse tracking information when the motion sensing signal includes the tracking data;
As a result of the determination in step (c-4), when the extracted information is motion detection information, the smart TV 300 recognizes motion in the 3D space by analyzing a trajectory leading from the motion detection information to the start point coordinates and the end point coordinates of the motion. (C-5) generating 'user motion control information' for driving the display apparatus to correspond to the recognized motion; And
And (c-6) controlling, by the smart TV 300, a user interface (UI) being displayed on the screen so as to correspond to 'user motion control information'.
As a result of the determination in step (c-4), when the extracted information is mouse tracking information, the smart TV 300 generates 'mouse tracking control information' for controlling display of the mouse cursor from the mouse tracking information (c-7). ) step; And
(C-8) controlling, by the smart TV 300, the position of the mouse cursor displayed on the screen so as to correspond to the 'mouse tracking control information' based on the user experience using the motion sensor. How to drive a smart TV. The method of claim 8,
The step (a)
(a-1) the RCU 100 detecting a position and an operation and measuring an exercise state change amount;
(a-2) Calculates the motion detection result including information on the RAW data, azimuth, roll, and pitch of the X, Y, and Z axes from the change in the movement state measured by the RCU 100 Generating a motion sensing signal; And
(a-3) the RCU 100 transmitting a motion sensing signal to the RCU intermediary 200 connected through a wireless communication network; driving a smart TV based on a user experience using a motion sensor, comprising: Way. The method of claim 8,
The step (b)
(b-1) receiving, by the RCU intermediary unit 200, a motion sensing signal transmitted from the RCU 100 via any one of a wireless communication network such as Bluetooth, Zigbee, Wi-Fi, or RF4CE;
(b-2) converting, by the RCU intermediary unit 200, the motion sensing signal according to launcher data set to be compatible with a platform corresponding to the manufacturer information of the smart TV 300; And
(b-3) applying the motion sensing signal converted by the RCU intermediary unit 200 to the smart TV 300 connected with the USB HID communication method; and based on a user experience using a motion sensor, comprising: Smart TV driving method. delete delete

Images