KR20200053949A - Method for home networking using AI voice recognition speakers and network devices installed in the household, device and system using the same - Google Patents

Abstract

The present invention relates to a home networking method using an AI voice recognition speaker and a network device installed in a household, and an apparatus and a system for operating the same. According to one embodiment of the present invention, the home networking system, which is a home networking system using an AI voice recognition speaker and a network device installed in a household. The AI speaker transmits a received voice command of a user to a voice recognition management server through a network wireless router (AP). The home networking system comprises: a complex management server processing data received to the AI voice recognition speaker and from the AP, and transmitting a control signal controlling an operation of a network device in the household; and a security management server processing and storing operations required for home networking control based on the data received from the voice recognition management server and the complex management server.

Description

Method for home networking using AI voice recognition speakers and network devices installed in the household, devices and systems for operating the same, method for home networking using AI voice recognition speakers and network devices installed in the household, device and system using the same}

The present invention relates to a home networking method, a device and a system for operating the same, and more specifically, to a home networking method using an AI voice recognition speaker and a network device installed in a household, a wall pad device and a home networking system for operating the same It is about.

Home network refers to a technology that connects and controls household appliances, lighting, air conditioners, door locks, and various sensors in a single network. It is possible to remotely control the operation of all electronic devices, such as household appliances, lighting, air conditioners, and various sensors, by connecting to a network built in the household through the Internet or a telephone line, both inside and outside the household.

Various electronic devices may be controlled through a terminal connected in a networked generation, or remotely controlled without a time and space restriction through a terminal (for example, a smartphone) having a cloud-based portal application installed. For that remote control, a gateway is often installed within the household.

In addition, with the rapid development of digital signal processing algorithms and hardware, the development of voice communication systems has been actively conducted. Voice is the most basic and most familiar means of communication for humans, and the means of communication between humans and systems is being replaced by the user's voice on the keyboard or mouse.

Recently, attempts have been made to target control of various devices in the generation or provision of an information service by applying such a voice recognition technology to a wireless home network system beyond a simple voice recognition range.

However, most of the conventional home network systems have a problem in that a dedicated application is installed in a user's portable terminal to set default values of the voice recognition speaker, thereby limiting their use.

In the case of a home network system based on speech recognition, a networking process must be performed through a separate application in order to connect a speech recognition device and a control device of a network system to a network within a household. Although various technological advances are being made, users are still reducing discomfort.

In addition, the conventional voice recognition-based home network system does not apply a security technology between information transmission of each device and device, and thus there is a problem that damage may occur due to leakage of transmitted information or unauthorized use of unverified users. .

In particular, speech recognition-based speech recognition speakers are vulnerable to security in that they are operated based on a user's voice signal. Accordingly, there is a user's anxiety as to whether security is properly implemented for controlling a device in a household using only voice.

1. Korean Patent Publication No. 10-2018-0052876 (Name of invention: Home network system using voice recognition and control method thereof) 2. Korean Patent Registration No. 10-1506510 (Voice recognition home network system)

Accordingly, the purpose of the home networking method and system of the present invention is to solve the conventional security-related problems and to drive the home networking method and system using a wall pad device installed in a household in order to improve user convenience. have.

Specifically, the home networking method and system of the present invention can effectively improve the security problems of the home network system based on speech recognition by providing a method and means for determining whether the input voice command or control signal is by a verified user. It has its purpose.

Furthermore, the home networking method and system of the present invention is intended to increase the user's convenience by allowing the home networking setting and service to be performed using a wall pad installed in a household without having to install a separate application on the user's mobile terminal. There is this.

Home networking system according to an embodiment of the present invention for solving the above-described problems, in the home networking system using an AI voice recognition speaker and a network device installed in the household, the AI voice recognition speaker is a voice command of the received user To a voice recognition management server through a network wireless router (AP), process data received from the AI voice recognition speaker and the wireless router, and transmit a control signal to control the operation of the network device in the household. Just a management server; And a security management server that processes and stores operations required for home networking control based on data received from the speech recognition management server and the complex management server. The security management server includes: identification information of the AI voice recognition speaker and identification information of the wireless router received from the management server, and identification information of the AI voice recognition speaker received from the voice recognition management server. And compare the identification information of the wireless router, and when the identification information is valid, generate a control signal of the network device in the household based on the voice command of the user.

In addition, the home networking system of the present invention is installed in a household, and communicates with the AI voice recognition speaker and the wireless router, and is connected to the complex management server and based on a control signal received from the complex management server in the generation. Wallpad device for controlling the operation of the network device; It may further include.

A wall pad device according to an embodiment of the present invention is installed in a generation, and a wall pad device for managing an AI voice recognition speaker, a network device in the generation, and a wireless router, the AI voice recognition speaker in at least one communication method, A communication module that transmits and receives data to and from at least one of the in-generation network device and the wireless router; An input module that accepts user input; A display module for displaying a process of managing the AI voice recognition speaker, the network device in the generation, and the wireless router; And a processor that performs an operation according to a management process and controls at least one of the communication module, the input module, and the display module. Including, based on the control of the processor, the AI voice recognition speaker may be connected to a wireless network provided by the wireless router.

In a home networking method according to an embodiment of the present invention, in a home networking method in which a wall pad device installed in a household manages an AI voice recognition speaker, a network device in a generation, and a wireless router, the first communication with the AI voice recognition speaker Pairing in a manner; Obtaining connection information of the wireless router; And transmitting connection information of the wireless router to the AI voice recognition speaker by the first communication method. Including, the AI voice recognition speaker may be connected to a wireless network provided by the wireless router in a second communication method using connection information of the wireless router received from the wall pad device.

In addition, the home networking method of the present invention comprises: receiving identification information of the AI voice recognition speaker in the first communication method from the AI voice recognition speaker; Receiving identification information of the wireless router by a third communication method from the wireless router; And transmitting authentication information generated based on at least one of identification information of the AI voice recognition speaker, identification information of the wireless router, and identification information of the wall pad device to a management server; It may further include.

In addition, the home networking method of the present invention comprises the steps of: receiving a control signal to control a network device in the household from the management server; And transmitting the control signal to a network device in the household in a fourth communication method. The control signal may further include a management server that receives a user's voice command acquired by the AI voice recognition speaker, identification information of the AI voice recognition speaker, and identification information of the wireless router that has delivered the voice command, Based on the authentication information received from the wall pad device, the validity of the identification information of the received AI voice recognition speaker and the identification information of the wireless router is determined, and if the result of the validity determination is valid, from the management server It may be a control signal received by the wall pad device.

In addition, the home networking method of the present invention, the management server, a voice recognition management server for processing a user's voice command received from the AI voice recognition speaker; A management server connected to the wall pad device to control the operation of the network device in the household through the wall pad device; And a security management server that processes and stores operations required for home networking control based on data received from the speech recognition management server and the complex management server. It may include.

In addition, in the home networking method of the present invention, the security management server stores the authentication information received from the wall pad device, and the AI voice recognition speaker received with the user's voice command based on the authentication information. If the identification information of the identification information of the wireless router and the validity of the wireless router is determined, and as a result of the validity determination, the identification information of the AI voice recognition speaker and the identification information of the wireless router are invalid, the voice recognition management server and the complex When the error message is transmitted to at least one of the management servers, and the identification information of the AI voice recognition speaker and the identification information of the wireless router are valid, the management server transmits a control signal of the network device in the household based on the user's voice command. It can be transmitted to the wall pad device through.

The home networking method and system of the present invention solves the security-related problems of the conventional speech recognition based home networking system by driving the home networking method and system using a wall pad device installed in a generation, and improves user convenience. Can be improved.

The home networking method and system of the present invention can effectively improve security problems of a home network system based on speech recognition by providing a method and means for determining whether the input voice command or control signal is from a verified user.

The home networking method and system of the present invention can improve the user's convenience by allowing the home networking setting and service to be performed using a wall pad installed in a household without having to install a separate application on the user's mobile terminal.

1 is a schematic conceptual diagram showing the configuration of a home networking system according to an embodiment of the present invention.
2 is a schematic configuration diagram of a wall pad device performing the home networking method of the present invention.
3 is a flowchart illustrating a home networking method according to an embodiment of the present invention.
4 is a flowchart illustrating a home networking method according to another embodiment of the present invention.
FIG. 5 exemplarily shows a screen shown in the display module when the wall pad device of the present invention performs the home networking method according to FIG. 3.

Advantages and features of the present invention, and methods for achieving them will be clarified with reference to embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various different forms, and only the embodiments allow the disclosure of the present invention to be complete, and the ordinary knowledge in the technical field to which the present invention pertains. It is provided to fully inform the holder of the scope of the invention, and the invention is only defined by the scope of the claims.

Although the first, second, etc. are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical spirit of the present invention.

In the examples below, terms such as include or have are meant to mean the presence of features or components described in the specification, and do not preclude the possibility of adding one or more other features or components in advance.

In the drawings, the size of components may be exaggerated or reduced for convenience of description. For example, since the size and shape of each component shown in the drawings are arbitrarily shown for convenience of description, the present invention is not necessarily limited to what is illustrated.

The same reference numerals refer to the same components throughout the specification.

Each of the features of the various embodiments of the present invention may be partially or entirely combined or combined with each other, and technically various interlocking and driving may be possible as those skilled in the art can fully understand, and each embodiment may be independently implemented with respect to each other. It may be possible to work together in an association relationship.

Hereinafter, a home networking system, a wall pad device, and a home networking method performed by the wall pad device will be described in detail with reference to the accompanying drawings.

1 is a schematic conceptual diagram showing the configuration of a home networking system according to an embodiment of the present invention, and FIG. 2 is a schematic configuration diagram of a wall pad device performing the home networking method of the present invention.

Referring to FIG. 1, the home networking system 1000 of the present invention includes a wall pad device 100 installed in a household, an AI (Artificial Intelligence) voice recognition speaker 200 that transmits and receives a voice signal, and relays an external network into the household. Network wireless router 300, a wall pad device 100 and a management server 400 connected to the wireless router 300, various electronic devices and sensors installed in the household 10, a communication network connecting the above-described components to each other Includes.

Home networking system 1000 of the present invention, by communicating with the wall pad device 100, AI voice recognition speaker 200, a wireless router 300 and an external management server 400, the AI voice recognition speaker 200 Provides a voice recognition-based home networking service that remotely controls the network device 10 in at least one generation based on the acquired user's voice command.

The wall pad device 100 transmits the connection information of the wireless router 300 to the AI voice recognition speaker 200 so that the AI voice recognition speaker 200 is connected to a wireless network provided by the wireless router 300. In addition, the wall pad device 100 may receive respective identification information from the AI voice recognition speaker 200 and the wireless router 300, and transmit them to the management server 400 together with the identification information of the wall pad device 100. have. In addition, the wall pad device 100 may receive a control signal to control the in-generation network device 10 from the management server 400 and control the in-generation network devices 10 based on the control signal.

Referring to FIG. 2, the wall pad device 100 displays a communication module 110 that performs wired / wireless communication with a connected device, an input module 120 that accepts user input, and a process performed in a home networking method. It includes a display module 130 for processing, a processor 140 for performing operations and controlling the communication module 110, the input module 120 and the display module 130, and a memory 150 for storing data.

Also, although not shown in the drawings, the wall pad device 100 according to an embodiment of the present invention may further include a program storage unit.

The communication module 110 allows the wall pad device 100 to connect to other network devices such as the AI voice recognition speaker 200, the wireless router 300, the management server 400, and the in-house network device 10 through wired or wireless connection. It may be a device including hardware and software necessary to transmit and receive signals such as control signals or data signals.

The input module 120 may be configured as a button unit, an operation unit, a switch unit, etc. for the wall pad device 100 to acquire user input. The display module 130 may mean a means for displaying information to the user. In addition, the input module 120 and the display module 130 may be configured as a touch screen as an integrated form.

Processor 140 may include any kind of device capable of processing data. Here, the processor may refer to a data processing device embedded in hardware having physically structured circuits, for example, to perform functions represented by codes or instructions included in a program. As an example of such a data processing device embedded in hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, and an application-specific integrated (ASIC) Circuit), FPGA (Field Programmable Gate Array), and the like, but the scope of the present invention is not limited thereto.

The memory 150 functions to temporarily or permanently store data processed by the wall pad device 100. The memory 115 may include a magnetic storage media or a flash storage media, but the scope of the present invention is not limited thereto.

Meanwhile, although the input module 120, the display module 130, the processor 140, and the memory 150 are illustrated as being all included in the wall pad device 100, the wall pad device 100 is not limited thereto. If the configuration is configured to perform the home networking method of the present invention, the input module 120, the display module 130, the processor 140, and the memory 150 are separately arranged outside the wall pad device 100 It might be.

The home networking method performed by each configuration of the wall pad device 100 will be described later in detail with reference to FIGS. 3 to 5 below.

The AI voice recognition speaker 200 may acquire a user's voice command or generate an acoustic signal according to the received control signal. The AI voice recognition speaker 200 may cover various network sound devices used in a voice recognition-based home networking system capable of recognizing data from a user's voice using artificial intelligence (AI) technology.

The AI voice recognition speaker 200 is connected to a wireless network provided by the wireless router 300 using connection information of the wireless router 300 received from the wall pad device 100. The AI voice recognition speaker 200 may transmit the acquired user's voice command to the management server 400 through the wireless router 300. Meanwhile, the AI voice recognition speaker 200 may have identification information such as a device-specific serial number, and the AI voice recognition speaker 200 may transmit identification information together with the acquired user's voice command through the wireless router 300. It can be transmitted to the management server 400.

The home networking method performed by the AI speech recognition speaker 200 together with the wall pad device 100 will be described later in detail with reference to FIGS. 3 to 5 below.

A wireless router (access point; AP) 300 is a known route that sets the optimal path for data transmission between two or more networks and networks, and helps to communicate data from one communication network to another along the corresponding path. It is an internet access device. The wireless router 300 is connected to the wall pad device 100, the AI voice recognition speaker 200, and the external management server 400 by various communication methods, so that the wall pad device 100 provides the home networking method of the present invention. Make it possible to do.

Meanwhile, the wireless router 300 may have connection information including an SSID (Service Set Identifier) and a password, and may have unique identification information such as a Mac address.

The home networking method performed by the wireless router 300 together with the wall pad device 100 will be described later in detail with reference to FIGS. 3 to 5 below.

The management server 400 receives a user's voice command from the AI voice recognition speaker 200, processes an operation required for home networking control based on the received voice data, and sends the generated control signal to the wall pad device 100 Transfer to.

The management server 400 may be configured as a single server, but may be divided into a voice recognition management server 410, a management server 420, and a security management server 430 as shown in FIG. .

Specifically, the voice recognition management server 410 is a server that processes a user's voice command received from the AI voice recognition speaker 200, and converts the voice signal into a text signal or other electronic signal through various digital signal processing algorithms. It can be a known server to process. The complex management server 420 may be a server that is connected to the wall pad device 100 installed in the household and manages the multiple generation wall pad devices 100 included in the complex. Furthermore, the security management server 430 processes and stores calculations necessary to control the specific operation of the network device 10 in the household based on data received from the voice recognition management server 410 and the management server 420 only. Server.

The management server 400 and the voice recognition management server 410 included therein, only the management server 420 and the security management server 430 may be a co-location server or a cloud server, , It may be a server or a device included in the server, it may be implemented in a variety of well-known forms, not limited thereto.

The specific configuration of the management server 400 and the home networking method performed by the configuration together with the wall pad device 100 will be described later in detail with reference to FIGS. 3 to 5 below.

In-generation network device 10 may be a lighting, air conditioning, door lock, and various electronic devices equipped with various sensors and communication modules. The intra-generational network device 10 may cover a variety of devices, commonly referred to as Internet of Things (IoT) devices, and remote from location, motion, image, temperature, humidity, heat, gas, illuminance, and ultrasonic sensors. It is a device that can receive and transmit information from tangible objects and surrounding environments by providing various sensor means such as detection and radar.

The intra-generational network device 10 may be driven according to a control signal received from the wall pad device 100, and may transmit data sensed from a sensor provided under the control of the wall pad device 100.

The communication network connecting the components of the home networking system 1000 of the present invention serves to enable data to be transmitted and received between the components.

The first communication network connecting the wall pad device 100 and the AI voice recognition speaker 200 provides a connection path for the wall pad device 100 to transmit and receive packet data after connecting to the AI voice recognition speaker 200. do. Here, the first communication network may be preferably Bluetooth. The second communication network connecting the AI voice recognition speaker 200 and the wireless router 300 provides an access path so that the AI voice recognition speaker 200 can transmit and receive packet data after connecting to the wireless router 300. Here, the second communication network may preferably be Wi-Fi. The third communication network in which the wall pad device 100 and the wireless router 300 are respectively connected to the external management server 400 is the number of the wall pad device 100 and the wireless router 300 connected to the management server 400. An access path is provided to send and receive packet data. Here, the third communication network may be a local area network (LAN) or the like. The fourth communication network connecting the wall pad device 100 and the intra-generational network device 10 provides an access path for the wall pad device 100 to transmit and receive packet data after accessing the intra-generational network device 10. do. Here, the fourth communication network may be preferably a Zigbee.

In addition, the first to fourth communication networks include a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), and an integrated service digital network; Wired networks such as ISDN), mobile communication such as 3G or LTE (Long Term Evolution), Wi-Fi, Wi-Fi Direct, wireless networks such as satellite communication, Bluetooth, and Zigbee ), Low-power short-range wireless network IPv6 (6LoWPAN), short-range wireless network (Near Field communication), such as any one of a short-range wireless network (Wireless Personal Area Network), may be any combination of these, or any other network, , It is not limited to these.

Hereinafter, a home networking method in which the wall pad device 100 installed in the household manages the AI voice recognition speaker 200, the network device 10 in the household, and the wireless router 300 will be described in detail. For a more detailed description, refer to FIGS. 3 to 5 together.

3 is a flowchart illustrating a home networking method according to an embodiment of the present invention, FIG. 4 is a flowchart illustrating a home networking method according to another embodiment of the present invention, and FIG. 5 is a wall pad device of the present invention In performing the home networking method according to FIG. 3, a screen illustrated in a display module is exemplarily illustrated.

The wall pad device 100 remotely controls the network device 10 in the household by communicating with the AI voice recognition speaker 200 and the wireless router 300. The wall pad device 100 may operate in the following order in order to provide various voice recognition-based home networking methods.

First, the wall pad device 100 allows the AI voice recognition speaker 200 to be connected to the wireless router 300.

Referring to the flowchart of FIG. 3 showing a method of connecting the AI voice recognition speaker 200 and the wireless router 300, the wall pad device 100 first pairs with the AI voice recognition speaker 200 ( S11).

The wall pad device 100 acquires connection information of the wireless router 300 according to a user input or the like (S12). At this time, the connection information of the wireless router 300 may include an SSID and a password, and the wall pad device 100 displays a screen as shown in FIG. 5 on the display module 130 so that the wireless router 300 can be accessed from the user. ) Can receive connection information.

Thereafter, the wall pad device 100 transmits the acquired connection information of the wireless router 300 to the AI voice recognition speaker 200 (S13). The execution of these steps (S11 to S13) may be performed by the first communication method of the wall pad device 100 and the AI voice recognition speaker 200, as described above, the first communication method is preferably a Bluetooth connection date. Can be.

On the other hand, unlike this, in the case where the wall pad device 100 has previously stored connection information of the wireless router 300 in the household in the internal memory 150 and the AI voice recognition speaker 200 is paired and recognized Of course, it is also possible to directly transmit the connection information of the wireless router 300 to the AI voice recognition speaker 200 without a user's separate input.

The AI voice recognition speaker 200 requests access to the wireless router 300 based on the connection information received from the wall pad device 100 (S14). The wireless router 300 checks the validity of the connection information received from the AI voice recognition speaker 200 (S15), and in the case of valid connection information, the AI voice recognition speaker 200 and the wireless network are connected to each other by a wireless network. (S16).

Step (S15) of verifying the validity of the connection information may be verified as valid if the wireless router 300 is matched by comparing their unique SSID and password with connection information received from the AI voice recognition speaker 200. .

The AI voice recognition speaker 200 may be connected to a wireless network provided by the wireless router as a second communication method, and as described above, the second communication method may be preferably Wi-Fi communication.

According to the home networking method of FIG. 3, it is possible to improve the user's convenience by allowing the home networking setting and service to be performed using a wall pad installed in a household without having to install a separate application on the user's mobile terminal.

As described above, after the AI voice recognition speaker 200 and the wireless router 300 are connected, the wall pad device 100 and the AI voice recognition speaker 200 perform various home networking methods based on voice recognition.

Referring to FIG. 1, a user's voice command obtained from the AI voice recognition speaker 200 is transmitted to the management server 400 through the wireless router 300, and the management server 400 receives the received voice command in various digital ways. It is converted to a text signal or other electronic signal through a signal processing algorithm. The management server 400 processes an operation required for home networking control based on the processed signal, and transmits the generated control signal to the wall pad device 100. Through this series of processes, the user's voice commands are transmitted to the network devices 10 in various households connected to the wall pad device 100, and the network devices 10 in the household operate based on control signals.

For example, suppose the user says, "POSCO, set the living room temperature to 30 ° C."

The word “POSCOYA” may be a word that initiates the AI voice recognition speaker 200 to recognize a voice command from a user who continues thereafter. The AI voice recognition speaker 200 processes the voice signal “Set the living room temperature to 30 ° C” as data and transmits it to the management server 400 through the wireless router 300.

The management server 400 (specifically, the voice recognition management server 410) converts and processes the received voice command data into text signals or other electronic signals through various digital signal processing algorithms, and based on this, in the generation It is possible to generate a control signal necessary to control the specific operation of the network device 10. The management server 400 (specifically, the security management server 430) responds to the voice signal “Set the living room temperature to 30 ° C” and “a control signal to check the temperature of the living room from the temperature sensor”, It is possible to generate “control signals to activate the boiler when the living room temperature is less than 30 ° C” and “control signals to activate the air conditioner when the living room temperature is greater than 30 ° C”. Thereafter, the management server 400 (specifically, only the management server 420) transmits the generated control signal to the wall pad device 100.

The wall pad device 100 may transmit a control signal to the network device 10 within the linked generation. At this time, the control signal is transmitted to the boiler 12, the temperature sensor 13 and the air conditioner 15 connected to the wall pad device 100, the boiler 12, the temperature sensor 13 and the air conditioner 15 are received By operating according to the control signal, it becomes possible for the user to operate the boiler 12, the temperature sensor 13, and the air conditioner 15 with only voice.

In addition to the above-described voice recognition-based home networking method, the home networking method of the present invention further includes a method of determining whether the input voice command or control signal is caused by a verified user, as shown in FIG. 4.

The home networking method of the present invention comprises the step of determining whether the input voice command or control signal received from the AI voice recognition speaker 200 is by a verified user, thereby improving the security status of the home network system based on voice recognition. Effective can be strengthened.

Referring to FIG. 4, the wall pad device 100 receives identification information of the AI voice recognition speaker 200 from the AI voice recognition speaker 200 by a first communication method, for example, Bluetooth communication (S21). Here, the identification information of the AI voice recognition speaker 200 may be a serial number of the AI voice recognition speaker 200.

In addition, the wall pad device 100 receives identification information of the wireless router 300 from the wireless router 300 by a third communication method, for example, a short-range wired communication method (S22). Here, the identification information of the wireless router 300 may be a MAC address of the wireless router 300.

Meanwhile, steps S21 and S22 in which the wall pad device 100 receives respective identification information from the AI voice recognition speaker 200 and the wireless router 300 may be performed in any order, or may be simultaneously performed. It may or may not be limited to the described order.

The wall pad device 100 includes respective identification information received from the AI voice recognition speaker 200 and the wireless router 300, and the identification information of the wall pad device 100 itself (eg, household dong, lake information, etc.). Based on the authentication information is generated (S23).

Here, the authentication information may be simply a data set that includes identification information received from the AI speech recognition speaker 200 and the wireless router 300 and identification information of the wall pad device 100 itself, and the AI speech recognition speaker ( 200) and each identification information received from the wireless router 300 and the wall pad device 100 may be separate authentication information generated based on its own identification information.

The wall pad device 100 transmits authentication information including respective identification information of the AI voice recognition speaker 200 and the wireless router 300 to the management server 400 (S24).

Specifically, authentication information including respective identification information of the AI voice recognition speaker 200 and the wireless router 300 is transmitted to the management server 420 of the management server 400 only, and the management server 420 only The security management server 430 transmits authentication information including respective identification information of the AI voice recognition speaker 200 and the wireless router 300. The security management server 430 stores authentication information including respective identification information of the received AI voice recognition speaker 200 and the wireless router 300 for use in a validity determination step S28 to be described later.

Thereafter, the AI voice recognition speaker 200 acquires a voice command from the user (S25). As described above, it is assumed in this step (S25) that the user acquires a voice command “POSCOYA, set the living room temperature to 30 ° C”.

The AI voice recognition speaker 200 processes the voice command signal “Set the living room temperature to 30 ° C” as data and transmits it to the wireless router 300 (S26). In this step (S26), the AI voice recognition speaker 200 transmits the identification information of the AI voice recognition speaker 200 together with the voice command signal to the wireless router 300.

The wireless router 300 transmits a voice command signal to the management server 400 (S27). Again, in this step (S27), the wireless router 300 transmits the identification information of the wireless router 300 itself together with the identification information of the AI speech recognition speaker 200 received from the AI speech recognition speaker 200. .

The management server 400 performs a validity determination process based on the identification information of the AI voice recognition speaker 200 received from the wireless router 300 and the identification information of the wireless router 300 (S28).

In other words, the management server 400, the identification information of the AI voice recognition speaker 200 and the wireless router 300 received from the wall pad device 100 in the above-described authentication information transmission (S24) step, and voice commands In the transmitting step (S27), by validating the identification information of each of the AI voice recognition speaker 200 and the wireless router 300 received from the wireless router 300, a validity determination is performed.

In the validity determination step (S28), the identification information of the AI voice recognition speaker 200 and the wireless router 300 received from the wall pad device 100 and the voice command signal are transmitted in the authentication information transmission (S24) step. In (S27), it can be confirmed that the identification information of each of the AI voice recognition speaker 200 and the wireless router 300 received from the wireless router 300 is valid.

Specifically, the wireless router 300 is the voice recognition management server 410 of the management server 400 and the identification information of the AI voice recognition speaker 200 received from the AI voice recognition speaker 200 together with the voice command signal and the wireless After transmitting the identification information of the router 300 and processing the voice command signal of the voice recognition management server 410, the voice command data and the respective identification information of the AI voice recognition speaker 200 and the wireless router 300 are secured. Transfer to the management server 430.

Therefore, in the validity determination step (S28), the security management server 430 identifies each of the AI voice recognition speaker 200 and the wireless router 300 received from the management server 420 only in the authentication information transmission (S24) step. It can be confirmed that the information and the identification information of the AI voice recognition speaker 200 and the wireless router 300 received from the voice recognition management server 410 in the voice command signal transmission step S27 match each other. have.

When it is determined that the identification information received in the validity determination step (S28) is valid, the management server 400 (specifically, the voice recognition management server 410) receives the received voice command data through various digital signal processing algorithms. It can be converted into a text signal or other electronic signal, processed, and based on this, a control signal necessary for controlling a specific operation of the network device 10 in the generation can be generated. The management server 400 (specifically, the security management server 430) responds to the voice signal “Set the living room temperature to 30 ° C” and “a control signal to check the temperature of the living room from the temperature sensor”, It is possible to generate “control signals to activate the boiler when the living room temperature is less than 30 ° C” and “control signals to activate the air conditioner when the living room temperature is greater than 30 ° C”.

In other words, the control signal generated in the home networking method of the present invention is generated based on a user's voice command input from the verified AI voice recognition speaker 200 and the wireless router 300.

The conventional home network system based on speech recognition does not apply a security technology between information transmission of each device and device, and thus, there is a problem in that damage may occur due to leakage of transmitted information or unauthorized use of unverified users. Accordingly, there has been a user's anxiety as to whether security is properly controlled for controlling a device in a household using only voice.

Accordingly, the home networking method and system of the present invention uses the wall pad device 100 installed in the household, and determines whether the voice command or control signal input through the above-described steps S21 to S28 is caused by the verified user. It has the advantage of complementing the discrimination method.

Thereafter, the management server 400 (specifically, only the management server 420) transmits the generated control signal to the wall pad device 100 (S29).

Here, the control signal is a signal converted to drive the network device 10 in at least one generation based on a user's voice command acquired by the AI voice recognition speaker 200. That is, the control signals are “control signals to check the temperature of the living room from the temperature sensor”, “control signals to start the boiler when the living room temperature is less than 30 ° C”, and “air conditioners when the living room temperature is greater than 30 ° C” Control signal to enable this to be activated.

The wall pad device 100 may control the operation of the in-generation network device 10 by transmitting the received control signal to the in-generation network device 10.

Therefore, the wall pad device 100 includes “a control signal for confirming the temperature of the living room from the temperature sensor”, “a control signal to start the boiler when the living room temperature is less than 30 ° C”, and “a living room temperature exceeds 30 ° C In case of, the control signal for the air conditioner to be activated ”is transmitted to the boiler 12, the temperature sensor 13 and the air conditioner 15 connected to the wall pad device 100, respectively, and the boiler 12, the temperature sensor 13, and The air conditioner 15 operates according to the received control signal.

Thus, according to the voice recognition-based home networking method of the present invention, it is possible for the user to operate the boiler 12, the temperature sensor 13 and the air conditioner 15 with only voice, and within various generations by verified users. By controlling the network device 10, it is possible to significantly improve the security level of the home networking method and system.

On the other hand, if it is determined that the identification information received from the wireless router 300 is invalid in the validity determining step (S28), the management server 400 is at least one of the wall pad device 100 and the AI voice recognition speaker 200 One can send an error message.

Specifically, when it is determined in step S28 that the identification information received from the wireless router 300 is invalid, the security management server 430 includes the voice recognition management server 410 and the management server 420 only. The network device 10 in the household by transmitting an error message to at least one, and the voice recognition management server 410 and the complex management server 420 transmit the error message to the connected AI voice recognition speaker 200 or the wall pad device 100. ) May not work.

The home networking method and system of the present invention solves the security-related problems of the conventional speech recognition based home networking system by driving the home networking method and system using a wall pad device installed in a generation, and improves user convenience. Can be improved.

The home networking method and system of the present invention can effectively improve security problems of a home network system based on speech recognition by providing a method and means for determining whether the input voice command or control signal is from a verified user.

The home networking method and system of the present invention can improve the user's convenience by allowing the home networking setting and service to be performed using a wall pad installed in a household without having to install a separate application on the user's mobile terminal.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, a person skilled in the art to which the present invention pertains may be implemented in other specific forms without changing the technical spirit or essential features of the present invention. You will understand. Therefore, it should be understood that the above-described embodiments are illustrative in all respects and not restrictive.

1000… Home networking system
100… Wall pad device
200… AI voice recognition speaker
300… Wireless router
400… Management server
410… Speech recognition management server
420… Complex management server
430… Security management server
10… In-generation network devices

Claims (8)

In the home networking system using AI speech recognition speaker and a network device installed in the household,
The AI voice recognition speaker transmits the received user's voice command to the voice recognition management server through a network wireless router (AP),
A management server that processes data received from the AI voice recognition speaker and from the wireless router and transmits a control signal to control the operation of the network device in the household; And
A security management server that processes and stores calculations necessary for home networking control based on data received from the speech recognition management server and the complex management server; Including,
The security management server,
Compare the identification information of the AI voice recognition speaker and the wireless router received from the management server, and the identification information of the AI voice recognition speaker and the wireless router received from the voice recognition management server, , Generating a control signal of the network device in the household based on the user's voice command when the identification information is valid. According to claim 1,
A wall pad installed in a household, communicating with the AI voice recognition speaker and the wireless router, and connected to the complex management server to control the operation of the network device in the household based on a control signal received from the complex management server ( Wallpad) device; Further comprising, a home networking system. A wall pad device installed in a generation to manage AI voice recognition speakers, a generation network device, and a wireless router,
A communication module that transmits and receives data to and from at least one of the AI voice recognition speaker, the in-generation network device, and the wireless router in at least one communication method;
An input module that accepts user input;
A display module for displaying a process of managing the AI voice recognition speaker, the network device in the generation, and the wireless router; And
A processor that performs an operation according to a management process and controls at least one of the communication module, the input module, and the display module; Including,
A wall pad device that connects the AI voice recognition speaker to a wireless network provided by the wireless router based on the control of the processor. In the home networking method in which a wall pad device installed in a generation manages AI voice recognition speakers, a network device in the generation, and a wireless router,
Pairing the AI voice recognition speaker with a first communication method;
Obtaining connection information of the wireless router; And
Transmitting connection information of the wireless router by the first communication method to the AI voice recognition speaker; Including,
The AI voice recognition speaker,
A home networking method connected to a wireless network provided by the wireless router in a second communication method using connection information of the wireless router received from the wall pad device. According to claim 4,
Receiving identification information of the AI voice recognition speaker in the first communication method from the AI voice recognition speaker;
Receiving identification information of the wireless router by a third communication method from the wireless router; And
Transmitting authentication information generated based on at least one of identification information of the AI voice recognition speaker, identification information of the wireless router, and identification information of the wall pad device to a management server; Home networking method further comprising. The method of claim 5,
Receiving a control signal for controlling a network device in the household from the management server; And
Transmitting the control signal to a network device in the household in a fourth communication method; Further comprising,
The control signal,
The authentication information received from the wall pad device by a management server that receives the user's voice command acquired by the AI voice recognition speaker, identification information of the AI voice recognition speaker, and identification information of the wireless router that has transmitted the voice command. Based on the, it determines the validity of the identification information of the received AI voice recognition speaker and the identification information of the wireless router,
If it is valid as a result of determining the validity, it is a control signal received from the management server to the wall pad device, the home networking method. The method of claim 5,
The management server,
A voice recognition management server that processes a user's voice command received from the AI voice recognition speaker;
A management server connected to the wall pad device to control the operation of the network device in the household through the wall pad device; And
A security management server that processes and stores calculations necessary for home networking control based on data received from the speech recognition management server and the complex management server; Including, home networking method. The method of claim 7,
The security management server,
Stores the authentication information received from the wall pad device, and determines the validity of the identification information of the AI voice recognition speaker and the identification information of the wireless router received together with the user's voice command based on the authentication information,
As a result of the validity determination, when the identification information of the AI voice recognition speaker and the identification information of the wireless router are invalid, an error message is transmitted to at least one of the voice recognition management server and the complex management server,
When the identification information of the AI voice recognition speaker and the identification information of the wireless router are valid, a control signal of the network device in the household based on the voice command of the user is transmitted to the wall pad device through the complex management server. Networking method.

Images