WO2015068954A1 - Procédé et appareil de commande d'un dispositif au moyen d'un dispositif intelligent - Google Patents

Procédé et appareil de commande d'un dispositif au moyen d'un dispositif intelligent Download PDF

Info

Publication number
WO2015068954A1
WO2015068954A1 PCT/KR2014/009571 KR2014009571W WO2015068954A1 WO 2015068954 A1 WO2015068954 A1 WO 2015068954A1 KR 2014009571 W KR2014009571 W KR 2014009571W WO 2015068954 A1 WO2015068954 A1 WO 2015068954A1
Authority
WO
WIPO (PCT)
Prior art keywords
control
smart device
command
smart
voice recognition
Prior art date
Application number
PCT/KR2014/009571
Other languages
English (en)
Korean (ko)
Inventor
이성섭
Original Assignee
주식회사 서비전자
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 서비전자 filed Critical 주식회사 서비전자
Publication of WO2015068954A1 publication Critical patent/WO2015068954A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • H04Q9/04—Arrangements for synchronous operation
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/30—User interface
    • G08C2201/31—Voice input
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q2209/00—Arrangements in telecontrol or telemetry systems
    • H04Q2209/40—Arrangements in telecontrol or telemetry systems using a wireless architecture

Definitions

  • the present invention relates to a device control method and apparatus using a smart device, and more particularly to a smart device that can remotely control the operation of a variety of electrical / electronic devices using the voice recognition function mounted on the smart device It relates to a device control method and apparatus used.
  • Smart devices can provide an interface to various functions, including keyboard functions, mouse functions, and touch functions, by connecting nearby electric / electronic devices to wireless communication including Bluetooth communication or Wi-Fi communication. have.
  • the smart device downloads and installs a remote control function application provided by various developers from the App Store or Android Market, and then executes the application to operate the electric / electronic device installed in the home or office. Can be controlled.
  • the applications of the remote control function has a disadvantage that can control only one electrical / electronic device corresponding to that provided by the manufacturer of the electrical / electronic device.
  • the electrical / electronic device is operated by a direct operation through a button mounted at a predetermined position of the device or by a remote controller provided corresponding to each device.
  • the voice module When the voice module is used, only a uniform voice command can be recognized, and thus, the voice command cannot be recognized when the intonation (diagram), the format of the voice command, or the language of each country is changed.
  • a user cannot directly select and edit a voice command, and many difficult limitations may be generated to overcome barriers of user pronunciation, height, intonation, and language of each country.
  • the present invention was developed to solve this problem, and its object is to provide a function of an integrated remote control that can remotely control the operation of various electrical / electronic devices without distance limitation by using the voice recognition function mounted on a smart device do.
  • the present invention intends to remotely control a multi-stage control, a multi-digit number control in which the same operation must be continuously controlled in an electric / electronic device with a single voice command input using a voice recognition function mounted in a smart device, without limiting distance.
  • the present invention is to provide a voice command for executing a specified operation of the electrical / electronic device to the user to add and edit the desired command to improve the recognition rate of the voice command.
  • the present invention is to provide a function of the integrated remote control that can remotely control a variety of electrical / electronic devices without the language barrier by the recognition of the voice command is executed in the language as the language used by the environment setting of the smart device .
  • the present invention is to provide a function of the integrated remote control that can be integrated control of the power of the peripheral devices that operate in conjunction with a specific electrical / electronic device with a single button.
  • a smart device equipped with a voice recognition function
  • a voice recognition server which is built in a content provider and generates a voice command transmitted from a smart device as a string text and provides the same to a smart device
  • a wireless network connecting the smart device and a voice recognition server; It is connected to the smart device in a wireless communication, and includes a relay device that the integrated remote control code is stored in a table,
  • the smart device extracts the feature vector of the voice command input from the screen of the integrated remote control application and transmits it to the voice recognition server, analyzes the text string provided by the voice recognition server, recognizes the control command, and responds to the recognized control command.
  • a device control apparatus using a smart device that matches the contracted key value and then transmits the integrated remote control code stored in the relay device to the relay device as a data packet to control the operation of the controlled device.
  • the smart device may be provided with an integrated remote control application from the App Store or the Android Market.
  • the smart device sets a predetermined key value for keys of a remote controller screen configured for each device in the integrated remote controller application, and transmits the contracted key value to the relay device as a data packet when an arbitrary key is selected on a specific remote controller screen.
  • the control device can be operated by executing transmission of the integrated remote control code stored in the relay device.
  • the smart device may be provided with a button (microphone icon) for selecting a voice recognition function at a predetermined position of a remote control key structure screen of an individual electric / electronic device.
  • the sum device may automatically change the recognition of the voice command to the corresponding language by changing the language used through the environment setting.
  • the smart device determines how many steps to control, matches the key value contracted for each step, and then sequentially transmits the data packet to the relay device.
  • the controlled device can be operated through the relay device.
  • the smart device matches the key value contracted step by step, and then sequentially transmits the data packet to the relay device through the relay device.
  • the operation of the controlled device can be controlled by one step based on the current setting value.
  • the multi-level command recognized by the smart device includes channel up / down, volume up / down, temperature up / down, wind strength, and light brightness, and increases or decreases by one step based on the current setting value of the controlled device. It may mean continuous operation.
  • the smart device determines the total number of digits when the control command recognized by the analysis of the string text is a number for selecting a channel, and determines the number for each digit and sequentially matches each key value contracted to the number as a data packet.
  • the channel of the controlled device can be tuned through the relay device by transmitting to the relay device.
  • the smart device transmits the data packet of the highest digit number, transmits the data packet of the next higher digit number, and finally the data packet of the last digit number when the key value contracted to the number of each digit is matched. Can be sent sequentially.
  • the smart device matches power key values of peripheral devices interworking with a specific electric / electronic device, and then sends the data packet to the relay device through the relay device. It is possible to control the power of the peripheral device to be interlocked.
  • the relay device includes a first wireless communication unit for receiving a data packet transmitted from a smart device; A USB port connected to an adapter or a USB port of a computer to supply power for operation of a relay device, and connected to a computer or an internet network to upgrade firmware and integrated remote control codes; A memory unit for storing a table of the integrated remote control code in a designated area; Recognizing a control command by extracting a contracted key value from a data packet received by the first wireless communication unit, and applying a table of the integrated remote control code stored in the memory unit to send a control code corresponding to the control command to the controlled device Control unit; According to the control of the control unit may include a second wireless communication unit for transmitting the control code of the control command to the controlled device by a predetermined communication method to operate the controlled device.
  • a feature according to another embodiment of the present invention is a smart device equipped with a voice recognition function;
  • a voice recognition server which is built in a content provider and generates a voice command transmitted from a smart device as a string text and provides the same to a smart device;
  • a wireless network connecting the smart device and a voice recognition server; It is connected to the smart device in a wireless communication, and includes a relay device that the integrated remote control code is stored in a table,
  • the smart device extracts the feature vector of the voice command input from the integrated remote control application screen and transmits it to the voice recognition server, and analyzes the text string provided by the voice recognition server to control the same operation of the multi-level command continuously. In this case, it is determined by how many stages of control, matching the key value promised by one stage, and then sending out data packets sequentially to the relay device to control the operation of the controlled device by one stage based on the current setting value through the relay device.
  • a device control apparatus using an apparatus is provided.
  • a feature according to another embodiment of the present invention is a smart device equipped with a voice recognition function;
  • a voice recognition server which is built in a content provider and generates a voice command transmitted from a smart device as a string text and provides the same to a smart device;
  • a wireless network connecting the smart device and a voice recognition server; It is connected to the smart device in a wireless communication, and includes a relay device that the integrated remote control code is stored in a table,
  • the smart device extracts the feature vector of the voice command detected from the activation screen of the integrated remote control application and transmits it to the voice recognition server, and analyzes the text string provided by the voice recognition server to determine the number of digits if the control command is a channel tuner number. The number of each digit is determined, the key value contracted to the number of each digit is matched, and the data packet of the highest digit number is sent at a predetermined time interval, the data packet of the next higher digit number is sent, and finally the last digit
  • a device control apparatus using a smart device that transmits a number of data packets to perform channel tuning of a controlled device through a relay device is provided.
  • a feature according to another embodiment of the present invention is that when a voice command is input on the integrated remote control application screen of the smart device, the feature vector of the voice command is transmitted to the voice recognition server, received as a string text from the voice recognition server and displayed on the screen. Making process; Analyzing, by the smart device, the received text string to recognize a control command, and determining whether the control command is a multi-level command in which the same operation must be continuously controlled; If the control command is a multi-level command, the smart device determines how many steps to control, matches key values committed for each step, and then sequentially transmits the controlled device to the relay through the relay device as a data packet.
  • a device control method using a smart device which includes a step-by-step control.
  • the multi-level command includes channel up / down, volume up / down, temperature up / down, air volume up / down, and illumination brightness, and continuously operate one-step up / down control based on the currently set level of the controlled device. Can be controlled by
  • a feature according to another embodiment of the present invention is that when a voice command is input on the integrated remote control application screen of the smart device, the feature vector of the voice command is transmitted to the voice recognition server, received as a string text from the voice recognition server and displayed on the screen. Making process; Analyzing, by the smart device, the received text string to determine whether the control command is a number for selecting a channel; The smart device determines the number of channel digits and the number of digits if the control command is a number for selecting a channel, matches the key value contracted to each number, and then transmits the data packets sequentially to the relay device through the relay device.
  • a device control method using a smart device which includes tuning a channel of an apparatus.
  • the smart device transmits the data packet of the highest digit number, transmits the data packet of the next higher digit number, and finally the data packet of the last digit number when the key value contracted to the number of each digit is matched. Can be sent sequentially.
  • the peripheral device which is sent out to the relay device as a data packet that matches the power key values of the peripheral devices interworking with a specific electric / electronic device and interlocks through the relay device Power on / off can be controlled.
  • a feature according to another embodiment of the present invention is that when a voice command is input on the integrated remote control application screen of the smart device, the feature vector of the voice command is transmitted to the voice recognition server, received as a string text from the voice recognition server and displayed on the screen. Making process; Analyzing, by the smart device, the received text string to determine whether the control command is a multi-level command in which the same operation is to be continuously controlled; If the control command is a multi-level command, the smart device determines how many steps to control, matches key values committed for each step, and then sequentially transmits the controlled device to the relay through the relay device as a data packet.
  • the smart device determines the number of channel digits and the number of digits if the control command is a number for selecting a channel, matches the key value contracted to each number, and then transmits the data packets sequentially to the relay device through the relay device.
  • a device control method using a smart device which includes tuning a channel of an apparatus.
  • the present invention provides a function of an integrated remote controller that can remotely control the operation of various electric / electronic devices installed in a home or an office by using a voice recognition function mounted on a smart device that is widely distributed to individuals. Convenience and efficiency can be provided.
  • the present invention does not require the preparation and management of a plurality of remote controls corresponding to the remote control of the operation of various electrical / electronic devices by each individual carrying a smart device may have the effect that convenience and efficiency can be provided.
  • the present invention can be effective in reducing costs and preventing environmental pollution by excluding the use of a battery required for remote control operation.
  • the present invention has the effect of securing the price competitiveness by reducing the production cost is not applied to a separate voice module by using the voice recognition function mounted on the smart device.
  • the present invention executes the recognition of voice commands using a voice recognition server built on a typical content provider, Google, Apple, Daum, Naver, Nate, etc., thus reducing the cost of building a voice recognition server and developing a voice model. Can be provided.
  • the present invention can execute multi-stage control such as channel up / down, volume up / down, temperature up / down, wind strength, lighting brightness, etc., where the same operation must be continuously controlled with one voice command input. There may be an effect that convenience and efficiency are provided due to no input.
  • the present invention can be integrated control of the power of the peripheral devices that operate in conjunction with a specific electrical / electronic device with a single button can have the effect of providing convenience and efficiency.
  • the recognition of the voice command is automatically changed to the corresponding language, thereby removing the barrier of the language of each country.
  • FIG. 1 is a schematic configuration diagram of a device control apparatus using a smart device according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating a configuration of a relay device interoperating with a smart device according to an embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating a device control procedure using a smart device according to an embodiment of the present invention.
  • 4 and 5 are diagrams illustrating the execution screen of the integrated remote control application of the smart device according to an embodiment of the present invention.
  • FIG. 6 is a diagram illustrating an integrated control screen of various devices in an integrated remote control application of a smart device according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram illustrating a control concept of a device using a smart device according to an embodiment of the present invention.
  • the present invention provides a wireless device including a smart device 100 including a smart phone, a smart pad, a tablet PC, a voice recognition server 200, 3G or 4G built in a typical content provider.
  • Network 300 providing a connection between the smart device 100 and the voice recognition server 200 by the communication, the relay device 400, the relay device 400 is connected to any one of the smart device 100 and Bluetooth communication or Wi-Fi communication )
  • a controlled device 500 connected to either IR (Infrared Ray) communication or RF (Radio Frequency) communication.
  • the smart device 100 is the same as a conventional smart device, description of a specific configuration is omitted.
  • the smart device 100 is an application of the integrated remote control function provided by the app store or the Android Market is downloaded and installed, the shortcut icon for executing the application of the integrated remote control function is installed on the desktop.
  • the smart device 100 activates the application of the integrated remote control function when the shortcut icon provided on the desktop in the standby state is touched.
  • the smart device 100 is configured for each electric / electronic device of which the application of the integrated remote control forms the controlled device 500, and contracted key values correspond to the respective keys configured on the screen of the remote controller for each electric / electronic device. Is set.
  • the smart device 100 connects the voice recognition server 200 through the network 300 when the voice recognition function provided on the application screen of the integrated remote control function is activated, activates the voice recognition function, and then inputs a voice command of the user. Wait.
  • the smart device 100 extracts a feature vector of the voice command and transmits it to the voice recognition server 200 through the network 300 when a voice command input of the user is detected within a predetermined time.
  • the smart device 100 When the smart phone 100 receives the text of the voice command from the voice recognition server 101, the smart device 100 analyzes the text of the text to recognize the control command and extracts a key value contracted to the recognized control command.
  • the smart device 100 converts the key value agreed to in the control command into a data packet and then transmits the data to the relay device 400 to control the operation of the controlled device 500 through the relay device 400.
  • connection between the smart device 100 and the relay device 400 may be connected to either Bluetooth communication or Wi-Fi communication.
  • the smart device 100 may receive an 'ACK' signal from the relay device 400 to determine a transmission result of the data packet, and output a message of the transmission result in a predetermined format.
  • the smart device 100 provides a remote control screen of the electric / electronic device when an arbitrary electric / electronic device is selected on the application screen of the integrated remote control function, and sets a contracted key value when a random key is selected on the remote control screen.
  • the data packet is converted into a data packet and then transmitted to the relay device 400 to control the operation of the electric / electronic device through the relay device 400.
  • the smart device 100 is provided with a button for executing voice recognition at a predetermined position on the screen of the remote control key structure of the electric / electronic device selected on the integrated remote control application screen.
  • a button (microphone icon) for providing a voice recognition function is provided at a predetermined position of a key screen of a remote controller for controlling the operation of individual electric / electronic devices, and a voice command can be input.
  • the smart device 100 determines whether the control of the step (N) is performed, and matches the key value contracted step by step. .
  • the smart device 100 converts into a data packet when the key value agreed in step by step is matched, and then transmits it sequentially (step by step) at a time to operate an arbitrary electrical / electronic device through the relay device 400. To control.
  • the smart device 100 transmits the data packet to the relay device 400 one step at a time according to a predetermined time interval or detection of the 'ACK' signal from the relay device 400.
  • the multi-step command refers to a continuous operation of raising or lowering a channel up / down, volume up / down, temperature up / down, wind strength, illumination brightness, etc. by a predetermined step based on a current value.
  • Raising means a step-by-step operation.
  • the smart device 400 may output a guide sound (for example, " ⁇ ") set when the data packet is transmitted.
  • a guide sound for example, " ⁇ "
  • the smart device 100 determines the number of digits of the selected channel and the number for each digit when the control command recognized in the analysis of the text string is a number command requesting channel switching.
  • the smart device 100 matches the key value contracted to each digit for each digit and then converts each to a data packet.
  • the smart device 100 transmits a data packet of the highest digit number first, then transmits a data packet of the next higher digit number, and finally the last digit number when the key value contracted to the number by digit is matched and converted into a data packet. Sent out data packets.
  • the smart device 100 sequentially executes the transmission of the data packet for the channel number in accordance with a predetermined time interval or the reception of the 'ACK' signal from the relay device 400.
  • the control command recognized from the keycode extracted from the analysis of the data packet is the channel selection command of the specific remote controller.
  • the channel 125 (Io), the channel 125 (120), and the channel 125 (Back Io) ',' Channel 125 (twelve twelve) ', or channel 125 (twenty five)' matches any key value contracted to the most significant digit '1', then converts it to a data packet, and converts it to the next higher digit number '
  • the data packet for the highest digit number '1' is sent to the relay device 400, and the data packet for the next higher digit number '2' is sent to the relay device 400, and finally the last digit number ' The data packet for 5 'is transmitted to the relay device 400.
  • the smart device 100 converts a power key value of peripheral devices operated in connection with a specific electric / electronic device into a data packet when a control command recognized as a key selection on an application screen of a specific remote control is integrated power control. By turning on or off the power of the peripheral device through the relay (400).
  • the television power key and the set-top box power key are matched and sequentially transmitted, thereby controlling the power of the television power and the set-top box sequentially on or off.
  • the power on or off of each device is sequentially controlled.
  • the smart device 100 may automatically change the recognition of the voice command to the corresponding language to remove the barrier of the language of each country.
  • the voice recognition server 200 is connected to the smart device 100 through the network 200, and at least one or more voice models used for voice recognition are stored in a database.
  • the voice recognition server 200 recognizes the voice command by comparing the feature vector of the voice command provided from the smart device 100 with the feature vector of the voice model stored in the database, and generates the voice command as a string text to generate the smart device ( 100).
  • the voice recognition server 200 may be applied as a voice recognition server built in a typical content provider Google, Apple, Daum, Naver, Nate and the like.
  • the relay device 400 is a control code of the integrated remote control is set as a table in the memory area, the data packet transmitted from the smart device 100 to extract the contracted key value, the control of the integrated remote control stored in the database The control code corresponding to the corresponding key value in the code is accessed and matched.
  • the relay device 400 connects the controlled device 500 by wireless communication, and transmits the control code to operate the controlled device 500.
  • the relay device 400 and the controlled device 500 may be connected to any one of IR communication, RF communication, Wi-Fi communication, Bluetooth communication, Zigbee, and Z-wave communication.
  • the controlled device 500 includes various forms including a television 501, a set top box 502, a DVD 503, an air conditioner 504, a light 505, a curtain 506, etc., which are installed in a home or an office. It consists of electrical and electronic equipment.
  • the controlled device 500 executes any operation designated according to the control code received from the relay device 400 in wireless communication.
  • FIG. 2 is a diagram illustrating a configuration of a relay device interoperating with a smart device according to an embodiment of the present invention.
  • a relay device includes a first wireless communication unit 410, a USB port 420, a memory unit 430, a control unit 440, and a second wireless communication unit 450. can do.
  • the first wireless communication unit 410 receives the data packet transmitted from the smart device and provides it to the control unit 440.
  • the first wireless communication unit 410 is connected to the smart device by either Bluetooth communication or Wi-Fi communication.
  • the USB port 420 is connected to the USB port of the adapter or the computer to supply power for the operation of the relay device 400.
  • the USB port 420 is connected to a computer terminal or the Internet network to provide an upgrade of firmware (Firm Ware) and integrated remote control code.
  • the memory unit 430 stores an integrated remote control code for controlling various types of electric / electronic devices as a table.
  • the controller 440 analyzes the data packet to recognize the contracted key value, and sets a control code corresponding to the contracted key value in the memory unit 430. Access from the integrated remote control code table (Access) to match the control code and then sent through the second wireless communication unit 450 to operate the controlled device in the specified operation.
  • Access from the integrated remote control code table (Access) to match the control code and then sent through the second wireless communication unit 450 to operate the controlled device in the specified operation.
  • the second wireless communication unit 450 transmits the control code matched with the control command to the controlled device according to the control of the controller 440 to operate the controlled device by a predetermined communication method.
  • the second wireless communication unit 450 transmits a control code matched with a control command to any one of the IR communication, RF communication, Wi-Fi communication, Bluetooth communication, Zigbee, and Zig wave communication to execute the designated operation.
  • FIG. 3 is a flowchart illustrating a device control procedure using a smart device according to an embodiment of the present invention.
  • the smart device 100 activates the application screen 600 of the integrated remote control as shown in FIG. 4A (S103).
  • the smart device 100 determines whether the voice recognition 610 is selected on the integrated remote control application screen 600 provided as shown in FIG. 4A (S104).
  • the voice recognition selection may be provided by a microphone icon.
  • the smart device 100 accesses the voice recognition server 200 through the network 300 (S105).
  • the smart device 100 activates the voice command input screen 620 as shown in FIG. 4B and waits for input of the voice command (S106).
  • the voice recognition server 200 refers to any one voice recognition server built in a typical content provider Google, Apple, Daum, Naver, Nate and the like.
  • the smart device 100 detects the input of the voice command (S107), if it does not detect the voice command input within a predetermined time or if it does not correctly recognize the input voice command or if a command other than the set command is input As shown in (d) of FIG. 4, a message 640 of 'unknown command / voice recognition failure' is output.
  • the smart device 100 When the input of the voice command is detected in S107, the smart device 100 extracts a feature vector of the voice command (S108) and transmits the feature vector to the voice recognition server 200 through the network 300 (S109).
  • the voice recognition server 200 recognizes the voice command by comparing the feature vector of the voice command provided from the smart device 100 with the feature vector of the voice model stored in the database, and generates the voice command as a string text to generate a network ( 300 is transmitted to the smart device (100).
  • the smart device 100 provides the text string 630 on the screen, as can be seen, for example, in FIG.
  • the smart device 100 When the smart device 100 receives the string text from the voice recognition server 200 (S110), the smart device 100 analyzes the string text to recognize a control command (S111).
  • the smart device 100 determines whether the control command recognized in S111 is a multi-level command in which the same operation is to be continuously controlled (S112).
  • the smart device 100 determines how many steps (N) control is required (S113), and matches the key value contracted for each step (S114).
  • the smart device 100 converts each step command matched with the key value contracted in step S114 into a data packet and transmits the data to the relay device 400 step by step (sequentially).
  • the relay device 400 extracts the contracted key value included in the data packet provided from the smart device 100 and accesses the control code corresponding to the key value extracted from the integrated remote control code table.
  • the controller 110 transmits the data to the electronic device, and executes the specified operation of the selected electric / electronic device.
  • the multi-level command may be used to control channel up / down, volume up / down, air conditioner and heater in an AV system including television or audio, temperature up / down, wind strength control, brightness control in an illumination system, and the like. It includes.
  • the multi-level command refers to a sequential continuous operation of raising or lowering step by step based on the currently adjusted level in a specific system.
  • the volume up / down button is used to level 1. Repeated 10 times, it means the operation to raise sequentially to 15 levels.
  • the smart device 100 repeatedly transmits a data packet that raises the volume by one level 10 times in the same way as the volume up button is repeatedly selected ten times, thereby controlling the volume of the television to be 10 levels higher than the current level to increase the volume. Adjust
  • the channel down button is repeatedly transmitted four times in the same manner as the channel down button is repeatedly selected four times.
  • channel 11 of the television is selected and viewed, the channel is changed to '11 ⁇ 10 ⁇ 9 ⁇ 8 ⁇ 7 'according to the sequential 4th transmission of the data packet so that channel 7 may be finally selected.
  • the smart device 100 transmits a data packet one step at a time according to a predetermined time interval or when detecting the 'ACK' signal from the relay device 400 when the multi-step command is sequentially transmitted.
  • the smart device 100 determines whether the control command recognized by the analysis of the string text in S112 is a numeric command requesting channel switching if it is not a multi-level command (S118).
  • control command recognized in S118 is a numeric command for requesting channel switching
  • the smart device 100 determines the number of digits of the channel (S119), determines the number for each digit, and matches the contracted key value (S120). .
  • the smart device 100 converts each data packet into data packets and sequentially transmits them to the relay device 400 at step S121.
  • the smart device 100 first transmits the data packet of the most significant digit number first, the data packet of the next highest digit number, and finally transmits the data packet of the last digit number first in S121 (S122).
  • the smart device 100 sequentially executes the transmission of the data packet for the channel number in accordance with a predetermined time interval or the reception of the 'ACK' signal from the relay device 400.
  • a control command recognized by the analysis of a data packet is a numeric command that requires channel switching of a particular remote control.
  • the channel 125 (Io), the channel 125 (120), and the channel 125 (Bio) , 'Channel 125 (twelve twelve)', or channel 125 (twenty five) ' matches the key value contracted to the most significant digit' 1 ', converts it to a data packet, and converts it to the next higher digit number' 2 '.
  • the key value contracted by ' is matched and then converted into a data packet, and the key value contracted by the last digit number' 5 'is matched and then converted into a data packet.
  • the data packet for the highest digit number '1' is sent to the relay device 400, and the data packet for the next higher digit number '2' is sent to the relay device 400, and finally the last digit number ' The data packet for 5 'is transmitted to the relay device 400.
  • an example of a device selected by accessing a control code corresponding to a contracted key value included in a data packet provided by the smart device 100 of the relay device 400 from the integrated remote control code table and transmitting the control code to the controlled device For example, the channel of the television is tuned to '125' (S123).
  • the smart device 100 matches a contracted key value corresponding to the recognized general command (S124) and converts it into a data packet (S125).
  • the relay is sent to the relay device 400.
  • control code corresponding to the contracted key value included in the data packet provided by the smart device 100 of the relay device 400 is accessed from the integrated remote control code table and transmitted to the controlled device to execute an operation according to the command. Let's do it.
  • the smart device 100 does not select the voice recognition function 610 in the integrated remote control application screen 600 provided as shown in FIG. 4A in the determination of S104. It is determined whether the device is selected (S127).
  • the smart device 100 activates and provides a screen of the remote controller corresponding to the control device (S128).
  • a screen having a remote control key structure for remotely controlling the television as shown in FIG. 5A is provided. do.
  • the smart device 100 selects a voice recognition 710 disposed at a predetermined position on the screen of the remote control key structure provided in S128, for example, the screen of the television remote control key structure provided in FIG. It is determined whether or not (S129).
  • the smart device 100 When the voice recognition 710 is selected in S129, the smart device 100 returns to the process of S105 to execute the processes of S105 to S124 described above.
  • the voice command input screen 720 is activated as shown in FIG. 5B, and the voice command input waits.
  • the smart device 100 detects an input of a voice command, but outputs a string text that is misrecognized on the screen when it is determined to be an unknown command due to a mistaken recognition in recognition through a voice recognition server.
  • the' curtain curtain ',' curtain curtain ',' close curtain ',' It outputs a text string that is misidentified such as 'Close curtain', 'Close curtain', 'Close curtain', 'Close curtain', and 'Close curtain'.
  • the smart device 100 detects an input of a voice command and receives a text string provided from the voice recognition server 200, for example, as shown in FIG. 4C, the text string 630 may be used. To the screen.
  • the smart device 100 determines whether an arbitrary key is selected on the screen of the TV remote control key structure provided with, for example, FIG. 5A (S130). ).
  • the smart device 100 converts the contracted key value into a data packet (S131) and then transmits it to the relay device 400 (S132).
  • control code corresponding to the contracted key value included in the data packet provided by the smart device 100 of the relay device 400 is accessed from the integrated remote control code table and transmitted to the controlled device to execute a predetermined operation. Let's do it.
  • the smart device 100 determines that the integrated control button 820 is detected in FIG. 6 to which the detected control command is attached, the smart device 100 matches values of the power key 810 of peripheral devices that interoperate with a specific electric / electronic device. The data is converted into the next data packet and transmitted to the relay device 400.
  • the relay device 400 accesses a control code corresponding to a key value included in the data packet provided by the smart device 100 from the integrated remote control code table to turn on or off the power of the peripheral device to be interlocked.
  • the television power control code and the set-top box power control code are matched and sequentially transmitted to control the power of the television power and the set-top box sequentially on or off.
  • the TV power, the set-top box power, the DVD power, the audio power, the lighting power, and the speaker power are sequentially controlled on or off.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)

Abstract

L'invention concerne un appareil de commande radioélectrique, qui est relié à un dispositif intelligent et peut télécommander le fonctionnement de divers dispositifs électriques/électroniques au moyen d'une fonction de reconnaissance vocale incorporée au dispositif intelligent, et un procédé de commande de dispositif utilisant l'appareil. La présente invention comporte les étapes consistant: si une consigne vocale est introduite vers l'écran d'une application intégrée de télécommande d'un dispositif intelligent, à envoyer un vecteur d'attributs de la consigne vocale à un serveur de reconnaissance vocale, à recevoir un texte en chaîne de caractères en provenance du serveur de reconnaissance vocale et à l'afficher sur l'écran; à faire analyser par le dispositif intelligent le texte en chaîne de caractères reçu et à déterminer si une consigne de commande est une consigne multiniveau dans laquelle la même opération doit être commandée consécutivement; si la consigne de commande est une consigne multiniveau, à faire déterminer par le dispositif intelligent le nombre de niveaux, à associer une valeur de touche convenue pour chaque niveau, à envoyer séquentiellement des paquets de données à un répéteur, et à commander, au moyen du répéteur, un dispositif à commander un niveau à la fois sur la base du niveau actuellement spécifié; et si la consigne de commande est un numéro destiné à sélectionner un numéro de canal, à faire déterminer par le dispositif intelligent le nombre de chiffres d'un numéro de canal et le nombre de chaque chiffre, à associer une valeur de touche convenue à chaque numéro, à envoyer séquentiellement des paquets de données au répéteur et à sélectionner, au moyen du répéteur, un numéro de canal du dispositif à commander.
PCT/KR2014/009571 2013-11-05 2014-10-13 Procédé et appareil de commande d'un dispositif au moyen d'un dispositif intelligent WO2015068954A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2013-0133720 2013-11-05
KR1020130133720A KR101465230B1 (ko) 2013-11-05 2013-11-05 스마트기기를 이용한 디바이스 제어방법 및 장치

Publications (1)

Publication Number Publication Date
WO2015068954A1 true WO2015068954A1 (fr) 2015-05-14

Family

ID=52291600

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2014/009571 WO2015068954A1 (fr) 2013-11-05 2014-10-13 Procédé et appareil de commande d'un dispositif au moyen d'un dispositif intelligent

Country Status (2)

Country Link
KR (1) KR101465230B1 (fr)
WO (1) WO2015068954A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110192177A (zh) * 2016-07-28 2019-08-30 三星电子株式会社 用于生成用于控制外部设备的gui的设备和方法
US10448762B2 (en) 2017-09-15 2019-10-22 Kohler Co. Mirror
US10663938B2 (en) 2017-09-15 2020-05-26 Kohler Co. Power operation of intelligent devices
US10887125B2 (en) 2017-09-15 2021-01-05 Kohler Co. Bathroom speaker
US11093554B2 (en) 2017-09-15 2021-08-17 Kohler Co. Feedback for water consuming appliance
US11099540B2 (en) 2017-09-15 2021-08-24 Kohler Co. User identity in household appliances
CN113535987A (zh) * 2021-09-13 2021-10-22 杭州涂鸦信息技术有限公司 联动规则匹配方法以及相关装置

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102428148B1 (ko) * 2017-08-31 2022-08-02 삼성전자주식회사 가전 기기의 음성 인식을 위한 시스템과 서버, 방법
DE112021000470T5 (de) * 2020-01-06 2022-10-27 7Hugs Labs System und verfahren zur steuerung einer vielzahl von geräten

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030013732A (ko) * 2001-08-09 2003-02-15 한국전자통신연구원 네트워크 기반 홈서버의 가전기기 제어방법 및 그 장치
JP2005072764A (ja) * 2003-08-21 2005-03-17 Hitachi Ltd 機器制御システムとそのための装置及び機器制御方法
KR20070061613A (ko) * 2005-12-10 2007-06-14 이기영 통신기기 음성인식 문자변환시스템
KR20120042585A (ko) * 2010-10-25 2012-05-03 공현식 이동통신단말기로 원격 제어되는 리모컨 발신장치 및 그 제어 방법

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101037397B1 (ko) * 2010-09-17 2011-05-30 주식회사 디지엔스 스마트폰을 이용한 디지털 기기 제어 시스템

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030013732A (ko) * 2001-08-09 2003-02-15 한국전자통신연구원 네트워크 기반 홈서버의 가전기기 제어방법 및 그 장치
JP2005072764A (ja) * 2003-08-21 2005-03-17 Hitachi Ltd 機器制御システムとそのための装置及び機器制御方法
KR20070061613A (ko) * 2005-12-10 2007-06-14 이기영 통신기기 음성인식 문자변환시스템
KR20120042585A (ko) * 2010-10-25 2012-05-03 공현식 이동통신단말기로 원격 제어되는 리모컨 발신장치 및 그 제어 방법

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110192177A (zh) * 2016-07-28 2019-08-30 三星电子株式会社 用于生成用于控制外部设备的gui的设备和方法
CN110192177B (zh) * 2016-07-28 2023-11-03 三星电子株式会社 用于生成用于控制外部设备的gui的设备和方法
US10887125B2 (en) 2017-09-15 2021-01-05 Kohler Co. Bathroom speaker
US10663938B2 (en) 2017-09-15 2020-05-26 Kohler Co. Power operation of intelligent devices
US11093554B2 (en) 2017-09-15 2021-08-17 Kohler Co. Feedback for water consuming appliance
US11099540B2 (en) 2017-09-15 2021-08-24 Kohler Co. User identity in household appliances
US11314214B2 (en) 2017-09-15 2022-04-26 Kohler Co. Geographic analysis of water conditions
US11314215B2 (en) 2017-09-15 2022-04-26 Kohler Co. Apparatus controlling bathroom appliance lighting based on user identity
US10448762B2 (en) 2017-09-15 2019-10-22 Kohler Co. Mirror
US11892811B2 (en) 2017-09-15 2024-02-06 Kohler Co. Geographic analysis of water conditions
US11921794B2 (en) 2017-09-15 2024-03-05 Kohler Co. Feedback for water consuming appliance
US11949533B2 (en) 2017-09-15 2024-04-02 Kohler Co. Sink device
CN113535987A (zh) * 2021-09-13 2021-10-22 杭州涂鸦信息技术有限公司 联动规则匹配方法以及相关装置

Also Published As

Publication number Publication date
KR101465230B1 (ko) 2014-11-25

Similar Documents

Publication Publication Date Title
WO2015068954A1 (fr) Procédé et appareil de commande d'un dispositif au moyen d'un dispositif intelligent
WO2020071712A1 (fr) Procédé de commande d'une pluralité de dispositifs de reconnaissance vocale et dispositif électronique prenant en charge ledit procédé
WO2012036475A2 (fr) Système de commande d'appareil numérique en utilisant un téléphone intelligent
WO2018066841A1 (fr) Appareil d'affichage, appareil électronique pouvant être connecté à l'appareil d'affichage, et procédé de commande associé
WO2019041856A1 (fr) Procédé, système et terminal de commande d'appareil domestique, et support d'informations
WO2019160265A1 (fr) Appareil électronique, procédé de commande d'appareil électronique et serveur
WO2016072635A1 (fr) Dispositif terminal utilisateur et procédé de commande de celui-ci, et système de fourniture de contenus
WO2016060371A1 (fr) Terminal de l'internet des objets, et procédé de fonctionnement correspondant
WO2020036299A1 (fr) Dispositif électronique, serveur et procédé de commande associé
WO2020226289A1 (fr) Appareil électronique, terminal utilisateur et procédé de commande de l'appareil électronique et du terminal utilisateur
WO2015199452A1 (fr) Dispositif électronique, procédé de réception de signal sans fil, et système le comprenant
WO2015102258A1 (fr) Méthode de modification de commande vocale pour application de télécommande universelle
WO2017090931A1 (fr) Dispositif électronique, et procédé de fourniture de service de gestion d'événements
WO2019103347A1 (fr) Dispositif électronique et son procédé de commande
WO2020007099A1 (fr) Procédé et dispositif de commande de terminal de télévision, et support d'enregistrement lisible par ordinateur
WO2020116845A1 (fr) Dispositif de télécommande, paroi d'affichage en mosaïque et système de télécommande
WO2018043992A1 (fr) Appareil d'affichage et procédé de commande d'appareil d'affichage
WO2020101178A1 (fr) Appareil électronique et procédé de connexion wifi de celui-ci
WO2017138708A1 (fr) Appareil électronique et procédé d'agencement de capteurs associé
WO2017069502A1 (fr) Dispositif d'affichage, et procédé et système de réglage de télécommande intégrée associés
KR20150051865A (ko) 스마트기기를 이용한 디바이스 제어방법 및 장치
WO2017150841A1 (fr) Dispositif électronique, système d'exécution d'application, et procédé de commande correspondant
WO2020251160A1 (fr) Appareil électronique et son procédé de commande
WO2020145536A1 (fr) Procédé d'identification de dispositif externe par enregistrement de caractéristiques d'un signal em et dispositif électronique mettant en œuvre ledit procédé
WO2020096251A1 (fr) Procédé permettant de fournir une fonction de remplissage automatique et dispositif électronique comprenant ledit procédé

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14861089

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14861089

Country of ref document: EP

Kind code of ref document: A1