KR20150051865A - Method for device control using smart device and control system the same - Google Patents

Abstract

Disclosed are a wireless control apparatus and a method for controlling a device using the same, wherein wireless control apparatus uses voice recognition function incorporated in a smart device to remotely control operations of various electric/electronic devices. The present invention comprises: a step of transmitting characteristic vectors of voice commands to a voice recognition server when the voice commands are inputted on the screen of an integrated remote controller application in smart devices, and receiving string texts from the voice recognition server to display the same on the screen; a step in which the smart device analyzes received string texts to determine whether control commands are a multi-stages command for which the same operation has to be controlled continuously; a step in which the smart device determines the number of stages for control commands determined to be a multi-stage command, matching key values predetermined for each control stage to the control stages, respectively, and sequentially transmits the control stages to a relay device to control a controlled device by one stage based on a currently set level via the relay device; and a step in which the smart device counts the number of digits of channels and the numbers for each digit if control commands are determined to be numbers to select channels, matches key values predetermined for each of the numbers to the numbers, respectively and sequentially transmits the numbers to a relay device to select a channel of a controlled device via the relay device.

Description

TECHNICAL FIELD [0001] The present invention relates to a device control method and apparatus using a smart device,

The present invention relates to a method and apparatus for controlling a device using a smart device, and more particularly, to a smart device for remotely controlling the operation of various electric / electronic devices using a voice recognition function mounted on the smart device And a device control method and apparatus using the same.

In recent years, the spread of smart devices including smart phones, smart pads, and tablet PCs has progressed at a rapid pace, and each person has at least one smart device.

With the development of the network environment and the provision of various contents, it is possible to obtain a variety of information necessary for everyday life in real time by using a smart device.

The smart device can connect the surrounding electric / electronic device with the wireless communication including Bluetooth communication or WiFi communication and provide the interface with various functions including the keyboard function, the mouse function, and the touch function have.

The smart device can be downloaded and installed from a variety of developers in the App Store or Android Market, and then the application is executed to operate the electric / electronic devices installed in the home or office Can be controlled.

However, the above-described applications of the remote control function are provided by the makers of the electric / electronic devices, and can control only one electric / electronic device corresponding thereto.

As the spread of personal smart devices becomes widespread, the control of electric / electronic devices and access to various living information become easy, and the performance of the voice recognition function mounted on the smart device is improved, It is getting higher.

The electric / electronic apparatus is operated by direct operation through a button mounted at a predetermined position of the apparatus or operation by a remote controller provided corresponding to each apparatus.

Recently, a method of applying a voice module to an electric / electronic device and controlling the operation of an electric / electronic device by using a voice recognition function has reached a level of commercialization technology.

When the voice module is used, only the uniform voice commands can be recognized. Therefore, when the intonation (dialect), voice command format, country language, etc. are changed, voice commands can not be recognized.

Therefore, it is necessary to develop a speech model according to the intonation (accent), the form of voice command, and the language of each country, which may cause an excessive time and cost.

In addition, the user can not directly select and edit voice commands, and there are many difficult limitations in overcoming the user's individual pronunciation, height, intonation, and language barrier.

In addition, there may arise a problem that it is impossible to execute multi-level control and multi-digit number control, which require the same operation to be continuously controlled, by one voice command input.

Published Patent Application No. 10-2012-0023985 (March 14, 2012) Published Japanese Patent Application No. 10-2013-0028385 (Mar. 19, 2013)

An object of the present invention is to provide a function of an integrated remote controller capable of remotely controlling the operation of various electric / electronic devices by using a voice recognition function mounted on a smart device do.

The present invention seeks to provide a multi-level control and a multi-digit number control which require the same operation to be continuously controlled in an electric / electronic device by a single voice command input by using a voice recognition function mounted on a smart device, without distinction.

SUMMARY OF THE INVENTION The present invention seeks to provide voice command recognition enhancement by allowing voice commands for performing specified actions of an electrical / electronic device to be added and edited by user's desired commands.

The present invention provides a function of an integrated remote controller capable of remotely controlling various electric / electronic devices without recognizing language barriers by recognizing voice commands in a language by changing the language used in the setting of the smart device .

The present invention provides a function of an integrated remote controller that can integrally control the power of peripheral devices operated in conjunction with a specific electric / electronic device with a single button.

According to an embodiment of the present invention, there is provided a smart device including a voice recognition function; A voice recognition server, which is constructed in a content provider, generates a voice command transmitted from a smart device as a text string and provides the generated voice command to a smart device; A wireless network connected to the smart device and a voice recognition server; And a relay device connected to the smart device via wireless communication, the integrated remote control control code being stored in a table,

The smart device extracts a feature vector of a voice command input from the screen of the integrated remote control application and transmits the extracted feature vector to the voice recognition server. The smart device analyzes the character string provided by the voice recognition server to recognize the control command, And transmits the data to the relay device in the form of a data packet to transmit the integrated remote control code stored in the relay device, thereby controlling the operation of the controlled device.

The smart device can receive an integrated remote control application from an app store or the Android market.

In the smart device, an agreed key value is set for the keys of the remote control screen configured for each device in the integrated remote control application, and when the arbitrary key is selected on the specific remote control screen, the smart device transmits the committed key value as a data packet to the relay device So that the control unit can be operated by executing the transmission of the integrated remote control code stored in the relay device.

The smart device may be provided with a button (microphone icon) for selecting a voice recognition function at a predetermined position of a remote control key structure screen of an individual electric / electronic device.

The smit device can automatically change the recognition of the voice command into the language of the corresponding country by changing the used language through the environment setting.

If the control command recognized as the analysis of the character string is a multi-level command in which the same operation is to be continuously controlled, the smart device determines whether it is a control of several stages, matches the committed key value for each step, So that the controlled device can be operated through the relay device.

If the control command recognized as the analysis of the character string is a multi-level command in which the same operation is to be continuously controlled, the smart device matches the agreed key value in one step, and sequentially transmits the key data to the relay device as a data packet, The operation of the controlled device can be controlled in one step based on the current set value.

The multi-level command recognized by the smart device includes a channel up / down, a volume up / down, a temperature up / down, a wind intensity, and a brightness of illumination, Can mean continuous operation.

If the control command recognized as the analysis of the string text is a number for selecting a channel, the smart device determines the total number of digits, identifies the digits for each digit, and sequentially matches the key values matched to the digits to the data packet It is possible to transmit the broadcast signal to the relay device and to tune the channel of the controlled device through the relay device.

The smart device transmits a data packet of the highest digit in a set time interval, transmits a data packet of the next higher digit, and finally transmits a data packet of the last digit in the set number of digits, Can be transmitted sequentially.

If the control command recognized as an analysis of the string text is power integrated control, the smart device matches power key values of peripheral devices associated with a specific electric / electronic device, and then transmits the data to the relay device as a data packet, It is possible to control the power of the peripheral device to be interlocked.

The relay device includes: a first wireless communication unit for receiving a data packet transmitted from a smart device; A USB port connected to an adapter or a USB port of the computer to supply power necessary for operation of the relay and to provide upgrade of the firmware and the integrated remote control code connected to the computer or the Internet; A memory unit in which a table of the integrated remote control code is stored in a designated area; Extracts the agreed key value from the data packet received from the first wireless communication unit, recognizes the control command word, and applies the table of the integrated remote control code stored in the memory unit to transmit the control code corresponding to the control command to the controlled device A control unit; And a second wireless communication unit for transmitting the control code of the control command under the control of the control unit to the controlled device in a predetermined communication manner to operate the controlled device.

According to another aspect of the present invention, there is provided a smart device including a voice recognition function; A voice recognition server, which is constructed in a content provider, generates a voice command transmitted from a smart device as a text string and provides the generated voice command to a smart device; A wireless network connected to the smart device and a voice recognition server; And a relay device connected to the smart device via wireless communication, the integrated remote control control code being stored in a table,

The smart device extracts a feature vector of a voice command input from the integrated remote control application screen and transmits the extracted feature vector to the voice recognition server, analyzes the character string provided by the voice recognition server, It is determined whether the control is a number of steps, and the key values are matched in one step, and then transmitted to the relay device in the form of a data packet, and the operation of the controlled device is controlled by the relay device in one step A device control apparatus using a device is provided.

According to another aspect of the present invention, there is provided a smart device including a voice recognition function; A voice recognition server, which is constructed in a content provider, generates a voice command transmitted from a smart device as a text string and provides the generated voice command to a smart device; A wireless network connected to the smart device and a voice recognition server; And a relay device connected to the smart device via wireless communication, the integrated remote control control code being stored in a table,

The smart device extracts a feature vector of a voice command detected on the activation screen of the integrated remote control application, transmits the extracted feature vector to the voice recognition server, and analyzes the character string provided by the voice recognition server. If the control command is a number, A data packet of the highest digit is transmitted at a predetermined time interval by matching the assigned key value to the digit of each digit, the data packet of the next digit of the next digit is transmitted, and finally the last digit There is provided a device control apparatus using a smart device that transmits a data packet of a number and executes a channel selection of a controlled device through a relay device.

According to another aspect of the present invention, a feature vector of a voice command is transmitted to a voice recognition server when a voice command is input in a screen of an integrated remote control application of a smart device, received as a character string from a voice recognition server, Process; Analyzing the received string text to recognize a control command and determining whether the control command is a multi-stage command in which the same operation should be continuously controlled; If the control command is a multi-level command, the smart device determines whether it is a multi-level command, matches the committed key value for each step, and sequentially transmits the matched key value to the relay device in the form of a data packet, And a step of controlling each of the plurality of devices by one step based on the reference.

The multi-level command includes a channel up / down, a volume up / down, a temperature up / down, a wind up / down and a brightness of illumination, .

According to another aspect of the present invention, a feature vector of a voice command is transmitted to a voice recognition server when a voice command is input in a screen of an integrated remote control application of a smart device, received as a character string from a voice recognition server, Process; Analyzing the received string text to determine whether the control command is a number for selecting a channel; If the control command is a number for selecting a channel, the smart device determines the number of digits of the channel number and the number of digits, matches the committed key value to each number, and sequentially transmits the data to the relay device as a data packet, There is provided a device control method using a smart device including a process of selecting a channel of a device.

The smart device transmits a data packet of the highest digit in a set time interval, transmits a data packet of the next higher digit, and finally transmits a data packet of the last digit in the set number of digits, Can be transmitted sequentially.

If the control command recognized by the analysis of the smart device data packet is power integrated control, transmits the data packet matching the power key value of the peripheral devices interlocked with the specific electric / electronic device to the relay device, Can be controlled.

According to another aspect of the present invention, a feature vector of a voice command is transmitted to a voice recognition server when a voice command is input in a screen of an integrated remote control application of a smart device, received as a character string from a voice recognition server, Process; Analyzing the received string text to determine whether the control command is a multi-step command in which the same operation should be continuously controlled; If the control command is a multi-level command, the smart device determines whether it is a multi-level command, matches the committed key value for each step, and sequentially transmits the matched key value to the relay device in the form of a data packet, A step of controlling by one step based on the reference; If the control command is a number for selecting a channel, the smart device determines the number of digits of the channel number and the number of digits, matches the committed key value to each number, and sequentially transmits the data to the relay device as a data packet, There is provided a device control method using a smart device including a process of selecting a channel of a device.

As described above, the present invention provides a function of an integrated remote controller that can remotely control the operation of various electric / electronic devices installed in a home or an office by using a voice recognition function mounted on a smart device widely available to individuals Convenience and efficiency can be provided.

The present invention can provide convenience and efficiency because it is not necessary to prepare and manage a plurality of corresponding remote controllers by remotely controlling the operation of various electric / electronic devices by a smart device that each individual is always carrying.

Further, the present invention can be effective in eliminating the use of a battery required for remote control operation, thereby providing cost reduction and preventing environmental pollution.

The present invention uses a voice recognition function mounted on a smart device, so that a separate voice module is not applied, thereby reducing production costs and securing price competitiveness.

The present invention realizes recognition of voice commands by using a voice recognition server built in a conventional contents provider such as Google, Apple, Daum, Naver, Naite, etc., Can be provided.

The present invention can perform multi-level control such as channel up / down, volume up / down, temperature up / down, wind intensity, illumination brightness, etc. in which the same operation is continuously controlled by inputting one voice command, There is an effect that convenience and efficiency of use are provided because input is not accompanied.

The present invention can provide the convenience and efficiency because the power of peripheral devices operated in conjunction with a specific electric / electronic device can be integrally controlled by one button.

In the present invention, recognition of a voice command is automatically changed to a corresponding language by changing a language to be used in setting the environment of a smart device, thereby eliminating the barriers of language in each country.

1 is a schematic block diagram of a device control apparatus using a smart device according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of a relay apparatus interworking with a smart device according to an embodiment of the present invention.
3 is a flowchart illustrating a device control procedure using a smart device according to an embodiment of the present invention.
FIG. 4 and FIG. 5 are views showing an integrated remote control application execution screen of the smart device according to the embodiment of the present invention.
6 is a view showing an integrated control screen of various devices in the integrated remote control application of the smart device according to the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention.

The present invention may be embodied in many different forms and is not limited to the embodiments described herein.

In order to clearly illustrate the present invention, parts not related to the description are omitted, and the same or similar components are given the same reference numerals throughout the specification.

In addition, since the components shown in the drawings are arbitrarily shown for convenience of explanation, the present invention is not necessarily limited to those shown in the drawings.

FIG. 1 is a schematic diagram showing a control concept of a device using a smart device according to an embodiment of the present invention.

1, the present invention relates to a smart device 100 including a smart phone, a smart pad, and a tablet PC, a voice recognition server 200 built in a conventional content provider, a wireless A network 300 for providing a connection between the smart device 100 and the voice recognition server 200 through communication, a relay device 400 connected to the smart device 100 through either Bluetooth communication or Wi-Fi communication, a relay device 400 And a controlled device 500 which is connected to one of an infrared ray (IR) communication and an RF (radio frequency) communication.

Since the smart device 100 is the same as a conventional smart device, a detailed description of the configuration will be omitted.

The smart device 100 is installed with an application of an integrated remote control function provided in an app store or an Android market, and a shortcut icon for executing an application of the integrated remote control function is installed on the desktop.

The application of the integrated remote control function provided in the above-mentioned app store or the Android market refers to an application developed and provided by the applicant of the present invention.

When the shortcut icon provided on the desktop screen is touched in the standby state, the smart device 100 activates the application of the integrated remote control function.

The smart device 100 is configured such that the application of the integrated remote controller is configured for each of the electric / electronic devices constituting the controlled device 500, and the predetermined key values correspond to the respective keys formed on the screen of the remote controller for each electric / electronic device .

If the voice recognition function provided on the application screen of the integrated remote controller function is selected, the smart device 100 accesses the voice recognition server 200 through the network 300, activates the voice recognition function, .

The smart device 100 extracts a feature vector of a voice command and transmits the extracted feature vector to the voice recognition server 200 through the network 300 when a voice command input of the user is detected within a predetermined time.

When the character string of the voice command is received from the voice recognition server 101, the smart device 100 analyzes the character string to recognize the control command and extracts the key value agreed to the recognized control command.

The smart device 100 converts the key value agreed to the control command into a data packet and transmits the data packet to the relay device 400 to control the operation of the controlled device 500 through the relay device 400. [

The connection between the smart device 100 and the relay device 400 may be connected via either Bluetooth communication or Wi-Fi communication.

The smart device 100 may receive the 'ACK' signal from the relay device 400 to determine the transmission result of the data packet, and output the message of the transmission result in the predetermined format.

When the arbitrary electric / electronic device is selected from the application screen of the integrated remote control function, the smart device 100 provides a remote control screen of the corresponding electric / electronic device, and when the arbitrary key is selected on the remote control screen, Converts it into a data packet, and transmits it to the relay apparatus 400, and controls the operation of the electric / electronic apparatus through the relay apparatus 400.

The smart device 100 is provided with a button for performing voice recognition at a predetermined position on the screen of the remote control key structure of the electric / electronic device selected in the integrated remote control application screen.

That is, a button (microphone icon) for providing a voice recognition function is provided at a predetermined position of the remote control key screen for controlling the operation of the individual electric / electronic devices, so that voice commands can be input.

If the control command recognized in the analysis of the string text is determined to be a multi-level command in which the same operation should be continuously controlled, the smart device 100 determines which of the plurality of steps N is controlled and matches the committed key value in each step .

When the agreed key values are matched in step, the smart device 100 converts the data into a data packet, and sequentially transmits the data packet one step at a time (stepwise), so that the operation of any electric / electronic device .

The smart device 100 transmits the data packet to the relay device 400 one step at a time according to the set time interval or the detection of the ACK signal from the relay device 400. [

The multi-level command refers to a continuous operation for raising or lowering the channel up / down, volume up / down, temperature up / down, wind intensity,

For example, if the control command recognized in the state of watching a television is 'loudly large 10', if the current value of the television volume is 5 levels, the volume up / down button is used to repeat ten times, Raising means stepwise action.

The smart device 400 may output a guidance sound (e.g., "") set when transmitting the data packet.

The smart device 100 determines the number of digits of the channel to be selected when the control command recognized in the analysis of the string text is a numeric command requiring channel switching, and discriminates the digits according to each digit.

The smart device 100 matches a predetermined key value to each digit of each digit and then converts each key into a data packet.

The smart device 100 transmits the data packet of the highest digit number first, transmits the data packet of the next higher digit number, and finally transmits the data packet of the last digit number, In order to transmit the data packets.

The smart device 100 sequentially transmits the data packet to the channel number at a predetermined time interval or in response to the reception of the ACK signal from the relay device 400. [

For example, when the control command recognized from the key code extracted by analyzing the data packet is 'channel 125 (mono)', 'channel 125 (hundred fifteen),' channel 125 (white) ',' Channel 125 (twelve) ', and channel 125 (twenty-five)', the key value agreed to the most significant digit '1' is matched and converted into a data packet, 2 ', then converts the key value into a data packet, matches the committed key value to the last digit' 5 ', and converts it into a data packet.

Then, first, the data packet for the most significant digit '1' is transmitted to the relay apparatus 400, the data packet for the next higher digit '2' is transmitted to the relay apparatus 400, 5 'to the relay apparatus 400. The relay apparatus 400 of FIG.

When the control command recognized as the key selection in the application screen of the specific remote controller is power integrated control, the smart device 100 converts the power key value of peripheral devices operated in conjunction with a specific electric / electronic device into a data packet, And turns on or off the power of the peripheral device through the relay device 400.

For example, when a television is connected to the set-top box, the TV power key value and the set-top box power key value are matched and sequentially transmitted, thereby sequentially controlling the power of the television power source and the set-

For example, in the case of power control of a home theater, a TV power key value, a set-top box power key value, a DVD power key value, an audio power key value, an illumination power key value and a speaker power key value are matched and converted into data packets And successively controls the power on or off of each device.

When the smart device 100 changes the language used in the environment setting, the recognition of the voice command is automatically changed to the corresponding language, thereby eliminating barriers in the language of each country.

The voice recognition server 200 is connected to the smart device 100 through the network 200 and stores at least one or more voice models used for voice recognition in a database.

The voice recognition server 200 recognizes a voice command by comparing a feature vector of a voice command provided by the smart device 100 with a feature vector of a voice model stored in a database, generates a voice command as a character string, 100).

The voice recognition server 200 can be applied to a voice recognition server built on Google, Apple, Daum, Naver, Nate, etc., which are typical contents providers.

The relay device 400 analyzes the data packet transmitted from the smart device 100, extracts the agreed key value, and controls the control of the integrated remote controller stored in the database The control code corresponding to the corresponding key value in the code is accessed and matched.

When the control code corresponding to the recognized control command is matched, the relay device 400 connects the controlled device 500 by radio communication, and transmits the control code to operate the controlled device 500.

The relay device 400 and the controlled device 500 may be connected to any one of IR communication, RF communication, Wi-Fi communication, Bluetooth communication, Zigbee, and geo-wave communication.

The controlled device 500 may be installed in various forms including a television set 501 installed in a home or office, a set top box 502, a DVD 503, an air conditioner 504, a lamp 505, a curtain 506, Of electrical / electronic equipment.

The controlled device 500 executes an arbitrary operation specified by the control code received from the relay device 400 via wireless communication.

2 is a diagram illustrating a configuration of a relay apparatus interworking with a smart device according to an embodiment of the present invention.

2, a relay apparatus according to an exemplary embodiment of the present invention includes a first wireless communication unit 410, a USB port 420, a memory unit 430, a controller 440, and a second wireless communication unit 450 can do.

The first wireless communication unit 410 receives the data packet transmitted from the smart device and provides the data packet to the control unit 440.

The first wireless communication unit 410 is connected to the smart device through either Bluetooth communication or Wi-Fi communication.

The USB port 420 is connected to an adapter or a USB port of a computer to supply power necessary for operation of the relay device 400.

The USB port 420 is connected to a computer terminal or an Internet network and provides an upgrade of a firmware and a remote control control code.

The memory unit 430 stores a table of integrated remote control codes for controlling various types of electric / electronic devices.

When the data packet is received through the first wireless communication unit 410, the control unit 440 analyzes the data packet to recognize the agreed key value, and transmits the control code corresponding to the agreed key value to the memory unit 430 Accesses from the integrated remote control code table to match the control codes, and then transmits the control codes through the second wireless communication unit 450 to operate the controlled device in the designated operation.

The second wireless communication unit 450 transmits the control code matched with the control command to the controlled device under the control of the controller 440 in a predetermined communication manner to operate the controlled device.

The second wireless communication unit 450 transmits a control code matched with a control command to the controlled device through any one of IR communication, RF communication, Wi-Fi communication, Bluetooth communication, ZigBee, and ZigWave communication to execute a designated operation.

The operation of the present invention including the functions as described above is as follows.

3 is a flowchart illustrating a device control procedure using a smart device according to an embodiment of the present invention.

It is determined whether the integrated remote control application is selected by touching the shortcut icon provided on the desktop in the standby state of the smart device 100 including the smart phone, smart pad, tablet PC, etc. according to the present invention (S101) ).

When the integrated remote control application is selected in step S102, the smart device 100 activates the application screen 600 of the integrated remote control as shown in FIG. 4A (S103).

Then, the smart device 100 determines whether voice recognition 610 is selected in the integrated remote control application screen 600 provided as shown in FIG. 4A (S104).

The selection of the speech recognition may be provided as a microphone icon.

The smart device 100 accesses the voice recognition server 200 through the network 300 when voice recognition 610 is selected in step S104 (S105).

Then, the smart device 100 activates the voice command input screen 620 as shown in FIG. 4B and waits for input of a voice command (S106).

The speech recognition server 200 refers to any one of speech recognition servers built on Google, Apple, Daum, Naver, Nate, etc., which are typical contents providers.

The smart device 100 detects the input of a voice command (S107). If the input of the voice command is not detected within a predetermined time or the voice command is not recognized correctly, or if a command other than the set command is input And outputs a message 640 of 'unknown command / speech recognition failure' as shown in (d) of FIG.

The smart device 100 extracts a feature vector of a voice command in step S107 and transmits the extracted feature vector to the voice recognition server 200 through the network 300 in step S109.

At this time, the speech recognition server 200 recognizes the voice command by comparing the feature vector of the voice command provided by the smart device 100 with the feature vector of the voice model stored in the database, generates the voice command as string text, (300) to the smart device (100).

At this time, the smart device 100 provides the character string text 630 on the screen, for example, as can be seen in FIG. 4 (c).

When the smart device 100 receives the character string text from the voice recognition server 200 (S110), the smart device 100 analyzes the character string and recognizes the control command (S111).

The smart device 100 determines whether the control command recognized in step S111 is a multi-step command to be continuously controlled in step S112.

If it is determined in step S112 that the smart device 100 is determined to be a multi-step command, the smart device 100 determines which of several steps (N) is required to control (step S113) and matches the committed key value for each step (step S114).

In step S116, the smart device 100 converts the step-by-step instructions matched in step S114 into data packets and transmits them to the relay device 400 in a stepwise manner.

Accordingly, the relay apparatus 400 extracts the committed key value included in the data packet provided from the smart device 100, accesses the control code corresponding to the key value extracted from the integrated remote control control code table, To execute the designated operation of the selected electric / electronic device (S117).

The multi-level command may be a command for controlling the temperature up / down, the wind intensity in the air conditioner system including the channel up / down, the volume up / down operation, the air conditioner and the heater in the AV system including the television or the audio, .

The multi-level command refers to a sequential continuous operation that raises or lowers the level of the currently controlled level in a specific system.

For example, assuming that the multi-level command recognized in the state of watching television is 'sound loudly 10' as shown in (c) of FIG. 4, when the television volume is currently five levels, (Stepwise) to 15 levels by repeating 10 times.

Accordingly, the smart device 100 sequentially repeats the data packet for raising the volume one level ten times in a manner similar to the case where the volume up button is selected ten times repeatedly, so that the volume of the television is controlled to be higher than the current level by ten levels, .

If the multi-level command is 'channel down 4' while watching the television, for example, the channel down button is repeatedly transmitted four times, and data packets falling by one channel are sequentially transmitted four times.

Accordingly, assuming that the user selects and watches channel 11 of the television, the channel is changed from '11 → 10 → 9 → 8 → 7 'according to the sequential four-time transmission of the data packet, .

In the above example, only the volume and channel of the television are controlled by a multi-level command. However, the control codes may be sequentially or sequentially set for the volume up / down of audio, temperature control of the air conditioner, wind intensity control, A detailed description thereof will be omitted.

The smart device 100 transmits data packets one step at a time according to the detection of the 'ACK' signal from the relay device 400 at predetermined time intervals when the multi-step commands are sequentially transmitted.

The smart device 100 determines whether the control command recognized in the analysis of the text string is a multi-step command in step S112 (S118).

If the control command recognized in S118 is a numeric instruction word that requires channel switching, the smart device 100 determines the number of digits of the channel (S119), determines the number of each digit, and matches the agreed key value (S120) .

If the agreed key values corresponding to the number of digits of the channel requesting conversion are matched in S120, the smart device 100 converts each of the data into a data packet and then transmits the data packet to the relay device 400 in order (S121).

In step S122, the smart device 100 transmits the data packet of the highest digit number first, the data packet of the next higher digit number, and finally the data packet of the last digit number in step S122.

The smart device 100 sequentially transmits the data packet to the channel number at a predetermined time interval or in response to the reception of the ACK signal from the relay device 400. [

For example, if the control command recognized as an analysis of the data packet is' 125 ',' 125 ',' 125 ', and' , The channel key 125 matches the key value assigned to the highest digit number '1' in the case of any one of the channel 125 (twelve) and the channel 125 (twenty-five), and then converts the data into a data packet. ', Converts the key value into a data packet, matches the committed key value to the last digit' 5 ', and converts it into a data packet.

Then, first, the data packet for the most significant digit '1' is transmitted to the relay apparatus 400, the data packet for the next higher digit '2' is transmitted to the relay apparatus 400, 5 'to the relay apparatus 400. The relay apparatus 400 of FIG.

Accordingly, the control code corresponding to the agreed key value included in the data packet provided by the smart device 100 of the relay device 400 is accessed in the integrated remote control control code table and transmitted to the controlled device, And tunes the channel of the television to '125' (S123).

If the control command recognized in S118 is not a numeric command requesting the channel switching, the smart device 100 matches the agreed key value corresponding to the recognized general command (S124), converts it into a data packet (S125) And transmits it to the relay apparatus 400.

Accordingly, the control code corresponding to the agreed key value included in the data packet provided in the smart device 100 of the relay apparatus 400 is accessed in the integrated remote control control code table and transmitted to the controlled device to execute the operation according to the command .

The smart device 100 determines that the voice recognition function 610 is not selected in the integrated remote control application screen 600 provided as shown in FIG. It is determined whether the device is selected (S127).

If an arbitrary control device is selected in step S127, the smart device 100 activates and provides a screen of the remote control corresponding to the control device (S128).

For example, if the television 601 is selected in the integrated remote control application screen 600 shown in FIG. 4 (a), a screen of a remote control key structure capable of remotely controlling the television as shown in FIG. 5 (a) do.

The smart device 100 displays a screen of the remote control key structure provided in S128, for example, a voice recognition 710 arranged at a predetermined position on the screen of the television remote control key structure provided with Fig. 5 (a) (S129).

If the voice recognition 710 is selected in step S129, the smart device 100 returns to step S105 and executes the processes of S105 to S124 described above.

That is, if the voice recognition 710 is selected in FIG. 5A, the voice command input screen 720 is activated and the voice command input is waited for, as shown in FIG. 5B.

If the smart device 100 can not detect a voice command input within a predetermined time or can not accurately recognize the inputted voice command or if a command other than the set command is input, Quot; missing command / voice recognition failure " message 740 is output.

In addition, if the smart device 100 detects an input of a voice command but is erroneously recognized in recognition through the voice recognition server, the smart device 100 outputs the misrecognized string text to the screen when it is determined that the command is an unknown command.

For example, if the voice command is entered as' close the curtain 'but the pronunciation of the user is incorrect or is mistakenly recognized due to the use of dialect, the' curtain dada ',' curtain dada ',' And displays the misidentified text string on the screen such as "close curtain", "close curtain", "curtain", "close curtain", "curtain da da"

However, when the input of the voice command is detected and the character string text provided from the voice recognition server 200 is received, the smart device 100 displays the character string 630 as shown in FIG. 4 (c) To the screen.

However, if the voice recognition 710 is not selected in step S129, the smart device 100 determines whether any key is selected on the screen of the television remote control key structure provided in, for example, FIG. 5 (a) ).

If a certain key is selected in step S130, the smart device 100 converts the agreed key value into a data packet (S131) and transmits it to the relay device 400 (S132).

Accordingly, the control code corresponding to the agreed key value included in the data packet provided in the smart device 100 of the relay apparatus 400 is accessed in the integrated remote control control code table and transmitted to the controlled apparatus to execute a predetermined operation .

When the smart device 100 determines that the power control button 820 is selected as shown in FIG. 6, to which the detected control command is attached, the smart device 100 matches the value of the power key 810 of the peripheral devices associated with the specific electric / Converts it into the next data packet, and transmits it to the relay apparatus 400.

Accordingly, the relay apparatus 400 accesses the control code corresponding to the key value included in the data packet provided from the smart device 100 in the integrated remote control control code table, and turns on or off the power of the associated peripheral device.

For example, when a television is connected to the set-top box, the TV power control code and the set-top box power control code are matched and sequentially transmitted, thereby sequentially controlling the power of the television power source and the set-top box to be on or off.

For example, in the case of power control of a home theater, the television power, the set-top box power, the DVD power, the audio power, the illumination power, and the speaker power are sequentially controlled on or off.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. It will be understood that various modifications and changes may be made without departing from the scope of the appended claims.

100: smart device 200: voice recognition server
300: network 400: radio control device
410: first wireless communication unit 420: USB port
430: memory unit 440:
450: second wireless communication unit 500:

Claims (4)

A device control apparatus using a smart device for controlling an operation of at least one controlled device by using a voice recognition function mounted on a smart device,
A first wireless communication unit for receiving a data packet transmitted from the smart device;
A USB port connected to an adapter or a USB port of the computer to supply power for operation and connected to a computer or the Internet to provide upgrades of firmware and integrated remote control codes;
A memory unit in which a table of the integrated remote control code is stored in a designated area;
A controller for extracting a committed key value in a data packet received from the first wireless communication unit, accessing a control code corresponding to a key value in an integrated remote control code stored in the memory unit, and transmitting the control code to a controlled device corresponding to the key value, ;
A second wireless communication unit for transmitting the control code of the control command to the controlled device in a predetermined communication manner under the control of the control unit to operate the controlled device;
And a relay device,
The smart device extracts a feature vector of a voice command input from the screen of the integrated remote control application and transmits the extracted feature vector to a voice recognition server built in a content provider,
The voice recognition server recognizes a feature vector of a voice command provided from a smart device, generates a character string text, and transmits the character string to a smart device,
The smart device analyzes the character string transmitted from the voice recognition server to recognize the control command word of the controlled device, matches the agreed key value corresponding to the recognized control command word, And transmits the control code of the integrated remote controller stored in the relay device to control the operation of the controlled device. The method according to claim 1,
In the smart device, an agreed key value is set for the keys of the remote control screen configured for each device in the integrated remote control application, and when the arbitrary key is selected on the specific remote control screen, the smart device transmits the committed key value as a data packet to the relay device And transmits the control code of the integrated remote controller stored in the relay device to control the operation of the controlled device. The method according to claim 1,
Wherein the smart device has a voice recognition function button on an individual remote control for the electric / electronic device. The method according to claim 1,
If the control command recognized as an analysis of the string text is power integrated control, the smart device matches power key values of peripheral devices associated with a specific electric / electronic device, and then transmits the data to the relay device as a data packet, A device control apparatus using a smart device for controlling power of a peripheral device to be interlocked.

Images