KR101239177B1 - Input apparatus for controlling smart device using mirroring system - Google Patents

Abstract

PURPOSE: An input device for smart device control is provided to offer an easy and flexible use environment by installing an embedded operating system. CONSTITUTION: A reception unit(220) receives a video signal from a smart device. A display unit(20) outputs an image corresponding to the video signal. According to a user command transmitted through the display unit or a key input unit(240), a control unit(250) generates a control signal for executing a specific function of the smart device. A transmission unit(260) transmits a control signal of the control unit to the smart device. [Reference numerals] (210) Power unit; (220) Reception unit; (230) Display unit; (240) Key input unit; (250) Control unit; (260) Transmission unit; (271) Microphone; (272) Voice sensing unit; (281) Motion sensor; (282) Motion sensing unit; (290) Memory unit

Description

INPUT APPARATUS FOR CONTROLLING SMART DEVICE USING MIRRORING SYSTEM}

The present invention relates to an input device for controlling a smart device using a mirroring system. More specifically, a smart device using a mirroring system capable of easily remotely controlling multimedia devices equipped with a smart function and performing a home automation function in parallel. It relates to a control input device.

Background Art A technique for controlling various electric and electronic devices such as a television, a DVD player, an air conditioner, a light switch, and the like by a remote control device (remote control) has been widely used in the home or office. The remote control apparatus is arranged with various buttons according to a preset function, and the type and number of these buttons are determined according to the device to be controlled by the remote control apparatus.

Recently, TVs have evolved into smart TVs with various functions including the Internet, and these smart TVs have various functions such as internet browser, YouTube, Google Maps, widgets such as weather / news, and video playback. Is added. With the emergence of smart TVs, various TV input devices, which are represented by remote controls, are attracting attention as one of the factors that differentiate TV performance. As a result, TV makers can achieve maximum efficiency with minimum input considering TV user characteristics. We are focusing on development.

Korean Patent Laid-Open Publication No. 2003-0077513 relates to a smart remote controller and a home networking system and method using the same, comprising: an infrared communication unit performing infrared communication with a predetermined device, and a plurality of devices each having an RFID tag embedded therein with control information An RFID reader / writer for reading the control information embedded in the RFID tag, a memory unit storing the control information read from the RFID reader / writer, and controlling operations of the plurality of devices based on the control information. And a control unit for controlling the overall operation of the smart remote controller.

Korean Patent Laid-Open Publication No. 2009-0125910 relates to a two-way television system and a remote control for the same, a power supply unit for supplying power, a key input unit for receiving a control signal for controlling a TV set, the input control signal to the TV set A remote control unit for transmitting to the remote control unit, an authentication unit for receiving the unique information of the user, a payment unit for receiving the payment means information according to the user, and converting the user unique information and the payment means information into the data packet for transmission to the TV set. And a wireless communication unit for transmitting the converted data packet to a TV set.

As described above, although a remote controller is used to use interactive contents such as a game in a conventional digital interactive TV, the remote controller uses a method of pushing various buttons to control interactive contents, such as a smart phone widely used these days. Users who are used to the method, the sliding method to use lightly with a finger on the screen, etc. have been given a very old way. In particular, users who enjoy the latest games, etc. can not use a variety of control methods for the game with a regular TV remote control, the game through the interactive TV gives a very out of date, it becomes a factor that loses interest in game use. have.

For example, in the IPTV, the existing remote control signal is processed by a receiver (set-top box, STB) that receives the IPTV. In order to receive the remote control signal, the application content is processed by a hierarchical module of the system. It is finally delivered to the application content. That is, the remote control signal is received by the IR receiver of the STB hardware and the operating system (RTOS) of the STB receives the signal through the device driver. Accordingly, the bidirectional content can receive a remote control signal through the middleware (M / W) to process the user's request.

Such a hierarchical processing structure has a long response time by controlling the remote control, which makes the user feel inconvenient in using the interactive content requiring a fast response time.

Korean Laid-Open Patent No. 2003-0077513 Korean Patent Publication No. 2009-0125910

The present invention is equipped with an embedded operating system to provide an easy and flexible user environment, and to implement a wireless network support function to mirror the screen of the smart device on the display unit, pointing device input, touch input, voice input, motion input, etc. Provides input device for controlling smart device using mirroring system that can provide convenient input tool for user environment by providing graphic input function of.

In addition, the present invention can search the Internet in real time the information on the TV screen in real time while watching TV, smart TV, smart set-top box, can be applied to smart devices in various environments as well as executing various application download function The update provides an input device for controlling smart devices using a mirroring system that can be applied to various home automation devices.

Among the embodiments, the input device for controlling the smart device using the mirroring system in the input device for controlling the smart device using the mirroring system for transmitting a control command to the smart device to execute a function corresponding to the selected menu according to the user's key input A power supply unit supplying driving power; A receiver configured to receive an image signal from the smart device; A display unit which outputs a screen corresponding to the video signal and supports a touch input by a user; A key input unit having a plurality of preset menu buttons for controlling various functions of the smart device; A control unit generating a control signal for executing a specific function of the smart device in response to a user command transmitted through the display unit or a key input unit, and controlling an operation of the power unit, the receiving unit, and the display unit in response to the user command ; And a transmitter for transmitting a control signal transmitted from the controller to the smart device.

In one embodiment, the receiver and the transmitter is characterized in that it has a wireless network protocol support function of at least one of Wi-Fi, Zigbee or RF4CE (Radio Frequency for Consumer Electronics).

The controller may support various graphic inputs including a pointing device, voice recognition, motion recognition, and data glove, and extract a user command by interpreting the graphic input.

In one embodiment, the input device for controlling a smart device using a mirroring system includes a microphone for inputting a user voice; And a voice recognition unit for extracting only a human voice from the voice input through the microphone, converting the voice into a digital signal, analyzing the digital signal, comparing the pre-stored voice data, and transmitting a voice recognition signal according to the comparison result to the controller. It features.

In another embodiment, an input device for controlling a smart device using a mirroring system may include a motion recognition sensor for generating a sensor signal by checking movement and movement of the input device for controlling a smart device using the mirroring system; And a motion recognition unit configured to generate a motion recognition signal corresponding to an operation based on the sensor signal collected from the motion recognition sensor and transmit the generated motion recognition signal to the controller.

The motion recognition sensor may include at least one of an acceleration sensor, a gyro sensor, a vibration sensor, a pressure sensor, a geomagnetic sensor, and an angular velocity sensor.

The control unit may include an operating system porting function, an audio / video streaming function, an internet search function, various application download functions, a game execution function, and a home automation execution function of a smartphone. At least one or more functions.

The input device for controlling a smart device using the mirroring system of the present invention is equipped with an embedded operating system to provide an easy and flexible user environment, and to implement a wireless network support function to mirror the screen of the smart device to a display unit. Graphic input functions such as pointing device input, touch input, voice input, and motion input can be provided to provide a convenient input tool suitable for a user environment.

In addition, the input device for controlling the smart device using the mirroring system of the present invention can search the Internet in real time the information on the TV screen in real time while watching TV, can be applied to smart TV, smart set-top box, smart devices of various environments In addition, by updating the information by executing various application download functions, it can be applied to various home automation devices.

1 is a diagram illustrating an input device for controlling a smart device using a smart device and a mirroring system according to an embodiment of the present invention.
2 is a perspective view illustrating an appearance of an input device for controlling a smart device using a mirroring system according to an embodiment of the present invention.
3 is a block diagram illustrating an internal configuration of an input device for controlling a smart device using a mirroring system according to an embodiment of the present invention.

Description of the present invention is only an embodiment for structural or functional description, the scope of the present invention should not be construed as limited by the embodiments described in the text. That is, the embodiments are to be construed as being variously embodied and having various forms, so that the scope of the present invention should be understood to include equivalents capable of realizing technical ideas. Also, the purpose or effect of the present invention should not be construed as limiting the scope of the present invention, since it does not mean that a specific embodiment should include all or only such effect.

On the other hand, the meaning of the terms described in the present invention will be understood as follows.

The terms "first "," second ", and the like are intended to distinguish one element from another, and the scope of the right should not be limited by these terms. For example, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" to another element, it may be directly connected to the other element, but there may be other elements in between. On the other hand, when an element is referred to as being "directly connected" to another element, it should be understood that there are no other elements in between. On the other hand, other expressions describing the relationship between the components, such as "between" and "immediately between" or "neighboring to" and "directly neighboring to", should be interpreted as well.

It should be understood that the singular " include "or" have "are to be construed as including a stated feature, number, step, operation, component, It is to be understood that the combination is intended to specify that it does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

In each step, the identification code (e.g., a, b, c, etc.) is used for convenience of explanation, the identification code does not describe the order of each step, Unless otherwise stated, it may occur differently from the stated order. That is, each step may occur in the same order as described, may be performed substantially concurrently, or may be performed in reverse order.

The present invention can be embodied as computer-readable code on a computer-readable recording medium, and the computer-readable recording medium includes all kinds of recording devices for storing data that can be read by a computer system . Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner.

All terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Generally, the terms defined in the dictionary used are to be interpreted as being consistent with the meanings in the context of the related art, and should not be interpreted as having ideal or excessively formal meanings unless clearly defined in the present invention.

1 is a diagram illustrating an input device for controlling a smart device using a smart device and a mirroring system according to an embodiment of the present invention.

Referring to FIG. 1, an input device for controlling a smart device using a mirroring system performs bidirectional communication with the smart device 100, and transmits a screen of the smart device 100 to the display unit 230 of the smart input device 200. Therefore, the smart device 100 can be remotely controlled through a mirror image.

The smart device 100 may be any one of various multimedia information devices such as a smart phone, a smart pad, an IPTV, a smart TV, a PC, a tablet PC, a digital cable box, and a satellite box. .

The smart input device 200 outputs the same initial menu screen as the smart device 100 to the display 230, and when a specific menu is selected by the user, executes a control command for executing a function corresponding to the selected menu. Send to (100).

2 is a perspective view illustrating an appearance of an input device for controlling a smart device using a mirroring system according to an embodiment of the present invention.

Referring to FIG. 2, the smart input device 200 includes a display unit 230 and menu buttons 241, 242, 243, and 244 on a front surface thereof, and maximizes grip by a curved arch design with an overall appearance. It is increasing convenience.

The smart input device 200 includes a power button 241, up, down, left, right movement button 242, channel adjustment button 243, volume adjustment button 244, mute button, home button, favorite channel button, utility button At least one or more of a play button, a setting button, and a channel guide button may be further included.

3 is a block diagram illustrating an internal configuration of an input device for controlling a smart device using a mirroring system according to an embodiment of the present invention.

Referring to FIG. 3, the smart input device 200 includes a power supply 210, a receiver 220, a display 230, a key input 240, a controller 250, and a transmitter 260.

The power supply unit 210 supplies driving power to the smart input device 200, and may provide driving power by a charging power method or a battery replacement method.

The receiver 220 receives an image signal from the smart device 100.

The display 230 outputs a screen corresponding to the image signal transmitted from the receiver 220 to output the same screen as the initial menu screen output from the smart device 100, and supports touch input by a user. It may be configured as a touch panel.

 The key input unit 240 includes a plurality of preset menu buttons 241, 242, 243, and 244 for controlling various functions of the smart device 100. When a specific button is pressed, a corresponding key signal is input. It is transmitted to the controller 250.

The controller 250 generates a control signal for executing a specific function of the smart device 100 in response to a user command transmitted through the display unit 230 or the key input unit 240, and the power supply unit 210 in response to the user command. ), And performs various control functions for the operations of the receiver 220, the transmitter 260, and the display 230.

The transmitter 260 transmits a control signal transmitted from the controller 250 to the smart device 100.

In general, the smart input device 200 is equipped with an infrared transmission module, the smart device 100 is equipped with an infrared receiver module, infrared communication (IR) is possible, but the smart device 100 and the smart input device 200 ) Can implement a wireless network protocol support function of at least one of Wi-Fi, Zigbee, or RF4CE (Radio Frequency for Consumer Electronics) rather than an infrared communication method, so that control signals can be recognized in any direction. .

Meanwhile, the controller 250 supports various graphic inputs including a pointing device, a voice recognition device, a voice recognition device, a motion recognition device, and a data glove, and extracts a user command by interpreting various graphic inputs. A control signal can be generated that executes a particular function of 100.

In an embodiment, the smart input device 200 may further include a microphone 271 and a voice recognition unit 272 to execute a key input function based on voice recognition.

The microphone 271 inputs the user's voice, and the voice recognition unit 272 removes the ambient noise from the voice input through the microphone 271, extracts only the human voice, converts it into a digital signal, and analyzes the pre-stored voice data. And a voice recognition signal according to the comparison result is transmitted to the controller 250.

 The speech recognition unit 272 adopts a natural language-based speech service technology by using a speech recognition technology that extracts a specific vector from the speech and analyzes the specific vector for easy and natural searching in a network environment.

The speech recognition unit 272 generates a speech recognition signal through speech recognition, speech detection, speech feature extraction, speech recognition algorithm execution, speech recognition determination.

 The controller 250 receives a voice recognition signal, extracts a user command corresponding to the voice recognition signal, generates a control signal according to the user command, and transmits the control command to the transmitter 260.

In another embodiment, the smart input device 200 may further include a motion recognition sensor 281 and a motion recognition unit 282 to execute a key input function based on motion recognition.

The motion recognition sensor 281 generates a sensor signal by checking the movement and movement of the smart input device 200. The motion recognition sensor 281 may include at least one of an acceleration sensor, a gyro sensor, a vibration sensor, a pressure sensor, a geomagnetic sensor, and an angular velocity sensor.

The motion recognition unit 282 generates a motion recognition signal corresponding to the operation of the smart input device 200 based on the sensor signal collected from the motion recognition sensor and transmits it to the control unit 250. The motion recognition unit 282 generates a motion recognition signal by recognizing at least one of a tapping motion, a shaking motion, a snapping motion, a tilting motion, a grabbing motion, and a no motion based on the sensor signal.

Then, the controller 250 extracts a user command according to the motion recognition signal and generates a control signal for executing a specific function of the smart device 100 and transmits it to the transmitter 260.

The controller 250 may include at least one of an operating system porting function, an audio / video streaming function, an internet search function, various application download functions, and a game execution function of a smartphone. The function can be executed. In particular, the controller 250 may further include a memory unit 290 to execute various application download functions, and a speaker module (not shown) to give the user fun and information when executing the game execution function or the Internet search function. ) May be associated with

In addition, the smart input device 200 may execute a home automation function by downloading an application that supports remote control of a home automation device such as an air conditioner, a heating device, a lighting device, a refrigerator, and then applying the application to the corresponding home automation device.

For example, a user may download an application that may execute an on / off function, a temperature control function, a dehumidification / ventilation selection function of an air conditioner owned by the smart input device 200, and then the memory unit 290 or a smart device ( The information is periodically updated after storing it in the memory unit of 100). Therefore, the user can operate the air conditioner of the room where the user lives or another room without the remote control of the air conditioner.

As such, the smart input device 200 according to an embodiment of the present invention provides a control function of a smart TV and a set-top box, internet search and pointing device technology support, a home automation function, and a smartphone operating system porting function. , Audio and video streaming capabilities, and reliable products for your environment.

In particular, in order to provide a reliable product suitable for the user environment, when the smart input device 200 falls on a concrete floor of 1 meter, the performance / environmental test so that there is no problem in the product performance, such as cracking of the display unit 230 , Life / failure test is performed.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the present invention as defined by the following claims It can be understood that

100: smart device 200: smart input device
210: power supply unit 220: receiving unit
230: display unit 240: key input unit
250: controller 260: transmitter
271: microphone 272: speech recognition unit
281: motion recognition sensor 282: motion recognition unit
290: memory

Claims (7)

In the input device for smart device control using a mirroring system for transmitting a control command to the smart device to execute a function corresponding to the selected menu according to the user's key input,
A power supply unit supplying driving power;
A receiver configured to receive an image signal from the smart device;
A display unit which outputs a screen corresponding to the video signal and supports a touch input by a user;
A key input unit having a plurality of preset menu buttons for controlling various functions of the smart device;
A control unit generating a control signal for executing a specific function of the smart device in response to a user command transmitted through the display unit or a key input unit, and controlling an operation of the power unit, the receiving unit, and the display unit in response to the user command ; And
It includes a transmitter for transmitting a control signal transmitted from the control unit to the smart device,
The receiver and the transmitter have at least one wireless network protocol support function of Wi-Fi, Zigbee, or RF4CE.
The controller supports a graphic input including a pointing device, voice recognition, motion recognition, and data glove, interprets the graphic input to extract a user command,
A microphone for inputting user voice; And
And a voice recognition unit for extracting only a human voice from the voice input through the microphone, converting the human voice into a digital signal, analyzing the same, comparing the pre-stored voice data, and transmitting a voice recognition signal according to the comparison result to the controller.
A motion recognition sensor for generating a sensor signal by checking movement and movement of the input device for controlling the smart device; And
The apparatus may further include a motion recognition unit configured to generate a motion recognition signal corresponding to an operation based on the sensor signal collected from the motion recognition sensor and transmit the generated motion recognition signal to the controller.
The motion recognition sensor includes at least one or more of an acceleration sensor, a gyro sensor, a vibration sensor, a pressure sensor, a geomagnetic sensor, an angular velocity sensor,
The controller may include at least one of an operating system porting function, an audio / video streaming function, an internet search function, various application download functions, a game execution function, and a home automation execution function of a smartphone. Execute the above functions,
The smart device control input device outputs a control command for outputting the same initial menu screen as the input device for controlling the smart device to the display unit and executing a function corresponding to the selected menu when a specific menu is selected by the user. Is sent to the control input device,
The speech recognition unit adopts the technology of a natural language-based speech service using speech recognition technology that extracts a specific vector from speech for searching in a network environment, and then analyzes the specific vector, and recognizes speech, extracts speech, extracts speech features, and recognizes speech. Generating a voice recognition signal through the execution of the algorithm, voice recognition determination, the control unit receives the voice recognition signal, extracts a user command corresponding to the voice recognition signal, generates a control signal according to the user command and transmits to the transmitter,
The motion recognition unit generates a motion recognition signal by recognizing at least one of a tapping motion, a shaking motion, a snapping motion, a tilting motion, a grabbing motion, and a no motion based on a sensor signal. Input device for smart device control using system.
delete delete delete delete delete delete

Images