KR102250421B1 - Method for home networking using AI voice recognition speakers and network devices installed in the household, device and system using the same - Google Patents

Abstract

The present invention relates to a home networking method using an AI voice recognition speaker and a network device installed in a household, and an apparatus and system for operating the same.
In the home networking system according to an embodiment of the present invention, in a home networking system using an AI voice recognition speaker and a network device installed in a household, the AI voice recognition speaker transmits a received user's voice command to a network wireless router (AP). A complex management server that transmits to the voice recognition management server through the AI voice recognition speaker, processes data received from the wireless router, and transmits a control signal for controlling the operation of the network device in the household; And a security management server that processes and stores an operation required for home networking control based on data received from the voice recognition management server and the complex management server. Includes.

Description

{Method for home networking using AI voice recognition speakers and network devices installed in the household, device and system using the same}

The present invention relates to a home networking method, an apparatus and a system for operating the same, and more specifically, a home networking method using an AI voice recognition speaker and a network device installed in a household, a wall pad device for operating the same, and a home networking system. About.

Home network refers to a technology that connects and controls home appliances, lighting, air conditioners, door locks, and various sensors within a household through a single network. It is possible to remotely control the operation of all electronic devices, such as home appliances, lighting, air conditioners, and various sensors, by accessing the network established within the household through the Internet or a telephone line both inside and outside the household.

Various electronic devices may be controlled through a terminal in a household connected via a network or remotely controlled through a terminal (eg, a smartphone) installed with a cloud-based portal application. Gateways are often installed in households for its remote control.

In addition, with the rapid development of digital signal processing algorithms and hardware, the development of voice communication systems has been actively made. Voice is the most basic and most familiar means of communication for humans, and the means of communication between humans and systems is being replaced by the user's voice from a keyboard or mouse.

In recent years, by applying such speech recognition technology to a wireless home network system beyond the range of simple speech recognition, attempts aimed at controlling various devices within a household and providing information services have been actively conducted.

However, most conventional home network systems have a problem in that a dedicated application is installed in a user's portable terminal to set default values of a voice recognition speaker, and limited use through this.

In the case of a home network system based on voice recognition, in order to connect the voice recognition device and the control device of the network system to a network within the household, a networking process must be performed through a separate application. Although various technological advances are being made, users are still reducing discomfort.

In addition, the conventional speech recognition-based home network system does not apply security technology between information transmission of each device and device, and thus there is a problem that damage may occur due to the leakage of transmitted information or unauthorized use by an unverified user. .

In particular, voice recognition speakers based on voice recognition are inevitably vulnerable to security in that they operate based on a user's voice signal. Accordingly, there is a situation in which users are uneasy about whether security is properly implemented in controlling devices within the household with only voice.

1. Korean Patent Publication No. 10-2018-0052876 (Name of invention: Home network system using voice recognition and its control method) 2. Korean Patent Registration No. 10-1506510 (Voice Recognition Home Network System)

Accordingly, the purpose of the home networking method and system of the present invention is to operate a home networking method and system using a wall pad device installed in the household in order to solve the conventional security-related problems and improve user convenience. have.

Specifically, the home networking method and system of the present invention has a method and means for determining whether an input voice command or control signal is from a verified user, thereby effectively improving the security problem of a home network system based on voice recognition. It has its purpose in making it possible.

Further, the home networking method and system of the present invention aims to increase the user's convenience by enabling home networking setting and service execution using a wall pad installed in the household without the need to install a separate application on the user's portable terminal. There is this.

In the home networking system according to an embodiment of the present invention for solving the above-described problem, in a home networking system using an AI voice recognition speaker and a network device installed in a household, the AI voice recognition speaker is a received user's voice command. Transmits to a voice recognition management server through a network wireless router (AP), processes data received from the AI voice recognition speaker and from the wireless router, and transmits a control signal for controlling the operation of the network device in the household. Complex management server; And a security management server that processes and stores an operation required for home networking control based on data received from the voice recognition management server and the complex management server. Including, wherein the security management server, identification information of the AI voice recognition speaker received from the complex management server and identification information of the wireless router, and identification information of the AI voice recognition speaker received from the voice recognition management server And comparing the identification information of the wireless router, and generating a control signal of the network device in the household based on the user's voice command when the identification information is valid.

In addition, the home networking system of the present invention is installed in a household, communicates with the AI voice recognition speaker and the wireless router, is connected to the complex management server, and is connected to the complex management server based on a control signal received from the complex management server. Wallpad device for controlling the operation of the network device; It may further include.

In the wall pad device according to an embodiment of the present invention, in a wall pad device installed in a household to manage an AI voice recognition speaker, a network device within the household, and a wireless router, the AI voice recognition speaker, in at least one communication method, A communication module for transmitting and receiving data with at least one of the network device and the wireless router in the household; An input module for receiving a user's input; A display module for displaying a process of managing the AI voice recognition speaker, the network device in the household, and the wireless router; And a processor that performs an operation according to a management process and controls at least one of the communication module, the input module, and the display module. Including, and based on the control of the processor, it is possible to connect the AI voice recognition speaker to a wireless network provided by the wireless router.

In the home networking method according to an embodiment of the present invention, in the home networking method in which a wall pad device installed in a household manages an AI voice recognition speaker, a network device in the household, and a wireless router, the AI voice recognition speaker and the first communication Pairing in a manner; Obtaining connection information of the wireless router; And transmitting connection information of the wireless router to the AI voice recognition speaker by the first communication method. Including, the AI voice recognition speaker, using the connection information of the wireless router received from the wall pad device may be connected to a wireless network provided by the wireless router in a second communication method.

In addition, the home networking method of the present invention comprises the steps of: receiving identification information of the AI voice recognition speaker from the AI voice recognition speaker through the first communication method; Receiving identification information of the wireless router by a third communication method from the wireless router; And transmitting authentication information generated based on at least one of identification information of the AI voice recognition speaker, identification information of the wireless router, and identification information of the wall pad device to a management server. It may further include.

In addition, the home networking method of the present invention comprises the steps of: receiving a control signal for controlling the network device within the household from the management server; And transmitting the control signal to a network device in the household through a fourth communication method. Further comprising, the control signal, the management server receiving the user's voice command obtained by the AI voice recognition speaker, identification information of the AI voice recognition speaker, and identification information of the wireless router that transmitted the voice command, Based on the authentication information received from the wall pad device, the validity of the received identification information of the AI voice recognition speaker and the identification information of the wireless router is determined, and if the validity determination result is valid, the management server It may be a control signal received by the wall pad device.

In addition, the home networking method of the present invention includes: a voice recognition management server for processing a user's voice command received from the AI voice recognition speaker; A complex management server connected to the wall pad device and controlling the operation of the network device in the household through the wall pad device; And a security management server that processes and stores an operation required for home networking control based on data received from the voice recognition management server and the complex management server. It may include.

In addition, in the home networking method of the present invention, the security management server stores the authentication information received from the wall pad device, and the AI voice recognition speaker received together with the user's voice command based on the authentication information. If the validity of the identification information of the wireless router and the identification information of the wireless router is determined, and as a result of the validity determination, the identification information of the AI voice recognition speaker and the identification information of the wireless router are not valid, the voice recognition management server and the complex When an error message is transmitted to at least one of the management servers, and the identification information of the AI voice recognition speaker and the identification information of the wireless router are valid, the control signal of the network device in the household based on the user's voice command is transmitted to the complex management server. It can be transmitted to the wall pad device through.

The home networking method and system of the present invention solves the problems related to the security of the conventional voice recognition-based home networking system by driving the home networking method and system using a wall pad device installed in the household, and improves the user's convenience. Can be improved.

The home networking method and system of the present invention can effectively improve the security problem of a home network system based on voice recognition by including a method and means for determining whether an input voice command or control signal is from a verified user.

The home networking method and system of the present invention can improve user convenience by enabling home networking setting and service execution using a wall pad installed in a household without the need to install a separate application on the user's portable terminal.

1 is a schematic conceptual diagram showing the configuration of a home networking system according to an embodiment of the present invention.
2 is a schematic configuration diagram of a wall pad device performing the home networking method of the present invention.
3 is a flowchart illustrating a home networking method according to an embodiment of the present invention.
4 is a flowchart illustrating a home networking method according to another embodiment of the present invention.
FIG. 5 exemplarily shows a screen shown on a display module when the wall pad device of the present invention performs the home networking method according to FIG. 3.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various forms different from each other, and only these embodiments make the disclosure of the present invention complete, and common knowledge in the technical field to which the present invention pertains. It is provided to completely inform the scope of the invention to the possessor, and the invention is only defined by the scope of the claims.

Although the first, second, and the like are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

In the following embodiments, terms such as include or have means that the features or elements described in the specification are present, and do not preclude the possibility of adding one or more other features or components in advance.

In the drawings, components may be exaggerated or reduced in size for convenience of description. For example, the size and shape of each component shown in the drawings are arbitrarily shown for convenience of description, and thus the present invention is not necessarily limited to what is shown.

The same reference numerals refer to the same elements throughout the specification.

Each of the features of the various embodiments of the present invention may be partially or entirely combined or combined with each other, and as a person skilled in the art can fully understand, technically various interlocking and driving are possible, and each of the embodiments may be independently implemented with respect to each other. It may be possible to do it together in a related relationship.

Hereinafter, a home networking system, a wall pad device, and a home networking method performed by the wall pad device will be described in detail with reference to the accompanying drawings.

FIG. 1 is a schematic conceptual diagram showing the configuration of a home networking system according to an embodiment of the present invention, and FIG. 2 is a schematic configuration diagram of a wall pad device performing the home networking method of the present invention.

Referring to FIG. 1, the home networking system 1000 of the present invention includes a wall pad device 100 installed in a household, an artificial intelligence (AI) voice recognition speaker 200 that transmits and receives a voice signal, and relays an external network to the household. A network wireless router 300, a wall pad device 100, and a management server 400 connected to the wireless router 300, various electronic devices and sensors 10 installed in the household, and a communication network connecting the above-described components to each other. Includes.

The home networking system 1000 of the present invention communicates with the wall pad device 100, the AI voice recognition speaker 200, the wireless router 300, and the external management server 400, so that the AI voice recognition speaker 200 is Provides a voice recognition-based home networking service that remotely controls at least one in-house network device 10 based on an acquired user's voice command.

The wall pad device 100 transmits connection information of the wireless router 300 to the AI voice recognition speaker 200 so that the AI voice recognition speaker 200 is connected to a wireless network provided by the wireless router 300. In addition, the wall pad device 100 may receive respective identification information from the AI voice recognition speaker 200 and the wireless router 300, and transmit the wall pad device 100 along with its own identification information to the management server 400. have. In addition, the wall pad device 100 may receive a control signal for controlling the network device 10 in the household from the management server 400, and control the network device 10 in the household based on the control signal.

Referring to FIG. 2, the wall pad device 100 displays a communication module 110 for performing wired/wireless communication with a connected device, an input module 120 for receiving a user's input, and a process performed in the home networking method. A display module 130 for performing an operation and a communication module 110, a processor 140 for controlling the input module 120 and the display module 130, and a memory 150 for storing data.

In addition, although not shown in the drawings, the wall pad device 100 according to an embodiment of the present invention may further include a program storage unit or the like.

The communication module 110 is a wall pad device 100 through a wired or wireless connection with other network devices such as an AI voice recognition speaker 200, a wireless router 300, a management server 400, and a network device 10 within a household. It may be a device including hardware and software necessary to transmit and receive signals such as control signals or data signals.

The input module 120 may include a button unit, an operation unit, a switch unit, or the like through which the wall pad device 100 acquires a user's input. The display module 130 may mean a means for displaying information to a user. In addition, the input module 120 and the display module 130 may be integrated into a touch screen.

The processor 140 may include all kinds of devices capable of processing data. Here, the processor may refer to a data processing device embedded in hardware having a circuit physically structured to perform a function represented by a code or instruction included in a program. As an example of such a data processing device built into the hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, and an ASIC (Application-Specific Integrated) Circuit) and processing devices such as a Field Programmable Gate Array (FPGA) may be covered, but the scope of the present invention is not limited thereto.

The memory 150 temporarily or permanently stores data processed by the wall pad device 100. The memory 115 may include a magnetic storage medium or a flash storage medium, but the scope of the present invention is not limited thereto.

Meanwhile, the input module 120, the display module 130, the processor 140, and the memory 150 have been described as being included in the wall pad device 100, but the present invention is not limited thereto, and the wall pad device 100 If is configured to perform the home networking method of the present invention, the input module 120, the display module 130, the processor 140, and the memory 150 are separately arranged outside the wall pad device 100. May be.

A home networking method performed by each component of the wall pad device 100 will be described in detail later with reference to FIGS. 3 to 5 below.

The AI voice recognition speaker 200 may acquire a user's voice command or generate a sound signal according to a received control signal. The AI voice recognition speaker 200 may include various network sound devices used in a home networking system based on voice recognition capable of recognizing data from a user's voice using artificial intelligence (AI) technology.

The AI voice recognition speaker 200 is connected to a wireless network provided by the wireless router 300 by using the connection information of the wireless router 300 received from the wall pad device 100. The AI voice recognition speaker 200 may transmit the acquired user's voice command to the management server 400 through the wireless router 300. Meanwhile, the AI voice recognition speaker 200 may have identification information such as a device-specific serial number, and the AI voice recognition speaker 200 transmits the identification information together with the acquired user’s voice command through the wireless router 300. It can be transmitted to the management server 400.

A home networking method performed by the AI voice recognition speaker 200 together with the wall pad device 100 will be described later in detail with reference to FIGS. 3 to 5 below.

A wireless router (access point; AP) 300 establishes an optimal path for data transmission between two or more networks and networks, and helps to communicate data from one communication network to another. It is an Internet access device. The wireless router 300 is connected to the wall pad device 100, the AI voice recognition speaker 200, and the external management server 400 through various communication methods, so that the wall pad device 100 uses the home networking method of the present invention. To be able to perform.

Meanwhile, the wireless router 300 may have connection information including a service set identifier (SSID) and a password, and may have unique identification information such as a Mac address.

A home networking method performed by the wireless router 300 together with the wall pad device 100 will be described later in detail with reference to FIGS. 3 to 5 below.

The management server 400 receives a user's voice command from the AI voice recognition speaker 200, processes operations necessary for home networking control based on the received voice data, and sends the generated control signal to the wall pad device 100 Transfer to.

The management server 400 may be configured as a single server, but may be subdivided into a voice recognition management server 410, a management server 420, and a security management server 430 as shown in FIG. 1. .

Specifically, the voice recognition management server 410 is a server that processes a user's voice command received from the AI voice recognition speaker 200, and converts the voice signal into a text signal or other electronic signal through various digital signal processing algorithms. It may be a known server to process. The complex management server 420 may be a server that is connected to the wall pad apparatus 100 installed in the household and manages the wall pad apparatus 100 of a plurality of generations included in the complex. Further, the security management server 430 processes and stores operations necessary to control specific operations of the network device 10 in the household based on the data received from the voice recognition management server 410 and the complex management server 420. It can be a server to do.

The management server 400 and the voice recognition management server 410 included therein, the management server 420 and the security management server 430 may be a co-location server or a cloud server, , It may be a server or device included in such a server, or may be implemented in various known forms, but is not limited thereto.

A specific configuration of the management server 400 and a home networking method in which such a configuration is performed together with the wall pad device 100 will be described later in detail with reference to FIGS. 3 to 5 below.

The network device 10 in the household may be a lighting, air conditioner, door lock, and various electronic devices provided with various sensors and communication modules. The network device 10 within the household can cover a variety of devices, which are commonly referred to as Internet of Things (IoT) devices, and remote from location, motion, image, temperature, humidity, heat, gas, illuminance, and ultrasonic sensors. It is a device capable of receiving and transmitting information from tangible objects and surrounding environments by having various sensor means such as detection and radar.

The in-house network device 10 may be driven according to a control signal received from the wall pad device 100, and may transmit data sensed from a sensor provided under the control of the wall pad device 100.

The communication network connecting the components of the home networking system 1000 of the present invention serves to transmit/receive data between the components.

The first communication network connecting the wall pad device 100 and the AI voice recognition speaker 200 provides a connection path so that the wall pad device 100 can transmit and receive packet data after accessing the AI voice recognition speaker 200 do. Here, the first communication network may preferably be Bluetooth. The second communication network connecting the AI voice recognition speaker 200 and the wireless router 300 provides a connection path so that the AI voice recognition speaker 200 can transmit and receive packet data after accessing the wireless router 300. Here, the second communication network may preferably be Wi-Fi. The third communication network in which the wall pad device 100 and the wireless router 300 are connected to the external management server 400, respectively, is the number of the wall pad device 100 and the wireless router 300 connected to the management server 400. Provides an access path to transmit and receive packet data. Here, the third communication network may be preferably a local area network (LAN) or. The fourth communication network connecting the wall pad device 100 and the network device 10 in the household provides a connection path so that the wall pad device 100 can transmit and receive packet data after accessing the network device 10 in the household. do. Here, the fourth communication network may preferably be Zigbee.

In addition, the first to fourth communication networks include a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), and an integrated service digital network; Wired network such as ISDN), mobile communication such as 3G or LTE (Long Term Evolution), or wireless network such as Wi-Fi, Wi-Fi Direct, satellite communication, Bluetooth, Zigbee ), a low-power short-range wireless network IPv6 (6LoWPAN), a short-range wireless network such as Near Field communication (Wireless Personal Area Network), further combinations thereof, or any other network. , Is not limited to these.

Hereinafter, a home networking method in which the wall pad device 100 installed in the household manages the AI voice recognition speaker 200, the network device 10 in the household, and the wireless router 300 will be described in detail. For a more detailed description, reference is made to FIGS. 3 to 5 together.

3 is a flowchart illustrating a home networking method according to an embodiment of the present invention, FIG. 4 is a flowchart illustrating a home networking method according to another embodiment of the present invention, and FIG. 5 is a wall pad device of the present invention. In performing the home networking method according to FIG. 3, a screen shown on the display module is illustrated as an example.

The wall pad device 100 remotely controls the network device 10 in the household by communicating with the AI voice recognition speaker 200 and the wireless router 300. The wall pad device 100 may operate in the following order to provide various voice recognition-based home networking methods.

First, the wall pad device 100 allows the AI voice recognition speaker 200 to be connected to the wireless router 300.

Referring to the flowchart of FIG. 3 showing a method of connecting the AI voice recognition speaker 200 and the wireless router 300, the wall pad device 100 first pairs with the AI voice recognition speaker 200 ( S11).

The wall pad device 100 acquires connection information of the wireless router 300 by a user's input (S12). At this time, the connection information of the wireless router 300 may include an SSID and a password, and the wall pad device 100 displays a screen as shown in FIG. 5 on the display module 130, so that the wireless router 300 ) Connection information can be input.

Thereafter, the wall pad device 100 transmits the obtained connection information of the wireless router 300 to the AI voice recognition speaker 200 (S13). The performance of these steps (S11 to S13) may be performed by a first communication method between the wall pad device 100 and the AI voice recognition speaker 200, and as described above, the first communication method is preferably a Bluetooth connection. I can.

On the other hand, in contrast, when the wall pad device 100 has previously stored connection information of the wireless router 300 in the household in the internal memory 150, and the AI voice recognition speaker 200 is paired and recognized It goes without saying that the connection information of the wireless router 300 may be directly transmitted to the AI voice recognition speaker 200 without a separate input from the user.

The AI voice recognition speaker 200 requests a connection to the wireless router 300 based on the connection information received from the wall pad device 100 (S14). The wireless router 300 checks the validity of the connection information received from the AI voice recognition speaker 200 (S15), and in the case of valid connection information, the AI voice recognition speaker 200 and the wireless network are connected to each other by a wireless network. (S16).

The step of checking the validity of the connection information (S15) may be verified as valid when the wireless router 300 compares its own SSID and password with the connection information received from the AI voice recognition speaker 200 to match each other. .

The AI voice recognition speaker 200 may be connected to a wireless network provided by the wireless router in a second communication method, and as described above, the second communication method may preferably be Wi-Fi communication.

According to the home networking method of FIG. 3, it is possible to improve user convenience by enabling home networking setting and service execution using a wall pad installed in a household without having to install a separate application on the user's portable terminal.

As described above, after the AI voice recognition speaker 200 and the wireless router 300 are connected, the wall pad device 100 and the AI voice recognition speaker 200 perform various home networking methods based on voice recognition.

Referring to FIG. 1, the user's voice command acquired from the AI voice recognition speaker 200 is transmitted to the management server 400 through the wireless router 300, and the management server 400 transmits the received voice command to various digital devices. It converts to a text signal or other electronic signal through a signal processing algorithm. The management server 400 processes an operation required for home networking control based on the processed signal, and transmits the generated control signal to the wall pad device 100. Through such a series of processes, the user's voice command is transmitted to the network device 10 in various households connected to the wall pad device 100, and the network device 10 in the household operates based on the control signal.

For example, suppose a user says, "It's POSCO, set the living room temperature to 30°C."

The word “POSCOYA” may be a word that initiates the AI voice recognition speaker 200 to recognize a voice command from a user that continues thereafter. The AI voice recognition speaker 200 processes the voice signal “Set the living room temperature to 30°C” as data and transmits it to the management server 400 through the wireless router 300.

The management server 400 (specifically, the voice recognition management server 410) converts and processes the received voice command data into text signals or other electronic signals through various digital signal processing algorithms, and based on this, It is possible to generate a control signal necessary for controlling specific operations of the network device 10. The management server 400 (specifically, the security management server 430) responds to the voice signal “Set the living room temperature to 30°C” and “control signal to check the temperature of the living room from the temperature sensor”, It can generate “a control signal to start the boiler when the living room temperature is less than 30°C” and “a control signal to start the air conditioner when the living room temperature is over 30°C”. Thereafter, the management server 400 (specifically, only the management server 420) transmits the generated control signal to the wall pad device 100.

The wall pad device 100 may transmit a control signal to the interlocked household network device 10. At this time, the control signal is transmitted to the boiler 12, the temperature sensor 13, and the air conditioner 15 connected to the wall pad device 100, and the boiler 12, the temperature sensor 13, and the air conditioner 15 are received. By operating according to the control signal, it becomes possible for the user to operate the boiler 12, the temperature sensor 13, and the air conditioner 15 with only a voice.

In addition to the above-described speech recognition-based home networking method, the home networking method of the present invention further includes a method of determining whether an input voice command or control signal is from a verified user, as shown in FIG. 4.

The home networking method of the present invention includes the step of determining whether an input voice command or control signal received from the AI voice recognition speaker 200 is from a verified user, thereby determining the security state of the home network system based on voice recognition. You can enhance the effectiveness.

4, the wall pad device 100 receives the identification information of the AI voice recognition speaker 200 from the AI voice recognition speaker 200 by a first communication method, for example, Bluetooth communication (S21). Here, the identification information of the AI voice recognition speaker 200 may be a serial number of the AI voice recognition speaker 200.

Further, the wall pad device 100 receives the identification information of the wireless router 300 from the wireless router 300 by a third communication method, for example, a short-range wired communication method (S22). Here, the identification information of the wireless router 300 may be a MAC address of the wireless router 300.

On the other hand, the steps (S21, S22) of the wall pad device 100 receiving each identification information from the AI voice recognition speaker 200 and the wireless router 300 may be performed independently of the order, and may be performed simultaneously. It may be possible and is not limited to the order described.

The wall pad device 100 includes identification information received from the AI voice recognition speaker 200 and the wireless router 300, and identification information of the wall pad device 100 (e.g., information about households, lakes, etc.) Authentication information is generated on the basis of (S23).

Here, the authentication information may simply be a data set including identification information of each of the identification information received from the AI speech recognition speaker 200 and the wireless router 300 and identification information of the wall pad device 100, or the AI speech recognition speaker ( 200) and the respective identification information received from the wireless router 300 and the wall pad device 100 may be separate authentication information generated based on its own identification information.

The wall pad device 100 transmits authentication information including identification information of each of the AI voice recognition speaker 200 and the wireless router 300 to the management server 400 (S24).

Specifically, authentication information including identification information of each of the AI voice recognition speaker 200 and the wireless router 300 is transmitted to the management server 420 of the management server 400, and the management server 420 is The authentication information including identification information of each of the AI voice recognition speaker 200 and the wireless router 300 is transmitted to the security management server 430. The security management server 430 stores authentication information including identification information of each of the received AI voice recognition speaker 200 and wireless router 300 and uses it in a validity determination step (S28) to be described later.

Thereafter, the AI voice recognition speaker 200 obtains a voice command from the user (S25). As described above, it is assumed that a voice command "POSCO, set the living room temperature to 30 °C" from the user is obtained in step S25.

The AI voice recognition speaker 200 processes the voice command signal “Set the living room temperature to 30°C” as data and transmits it to the wireless router 300 (S26). In this step (S26), the AI voice recognition speaker 200 transmits the AI voice recognition speaker 200's own identification information together with a voice command signal to the wireless router 300.

The wireless router 300 transmits a voice command signal to the management server 400 (S27). Again, in this step (S27), the wireless router 300 transmits the identification information of the AI speech recognition speaker 200 received from the AI speech recognition speaker 200 together with the identification information of the wireless router 300 itself. .

The management server 400 performs a validity determination process based on the identification information of the AI voice recognition speaker 200 and the identification information of the wireless router 300 received from the wireless router 300 (S28).

In other words, the management server 400 includes identification information of each of the AI voice recognition speaker 200 and the wireless router 300 received from the wall pad device 100 in the above-described authentication information transmission (S24) step, and a voice command. By comparing the identification information of each of the AI voice recognition speaker 200 and the wireless router 300 received from the wireless router 300 in the signal transmission step (S27), the validity determination is performed.

The validity determination step (S28) is a step of transmitting identification information of each of the AI voice recognition speaker 200 and the wireless router 300 received from the wall pad device 100 in the step of transmitting authentication information (S24), and a voice command signal. In (S27), it can be confirmed that it is valid when the respective identification information of the AI voice recognition speaker 200 and the wireless router 300 received from the wireless router 300 coincide with each other.

Specifically, the wireless router 300 is the identification information of the AI voice recognition speaker 200 received from the AI voice recognition speaker 200 together with a voice command signal to the voice recognition management server 410 of the management server 400 and wireless The router 300 transmits its own identification information, processes the voice command signal of the voice recognition management server 410, and then secures the voice command data and the identification information of each of the AI voice recognition speaker 200 and the wireless router 300. It transmits to the management server 430.

Therefore, in the validity determination step (S28), the security management server 430 identifies each of the AI voice recognition speaker 200 and the wireless router 300 received only from the management server 420 in the authentication information transmission (S24) step. When the information and the respective identification information of the AI voice recognition speaker 200 and the wireless router 300 received from the voice recognition management server 410 in the voice command signal transmission step (S27) coincide with each other, it can be verified as valid. have.

When it is determined that the identification information received in the validity determination step (S28) is valid, the management server 400 (specifically, the speech recognition management server 410) transmits the received voice command data through various digital signal processing algorithms. It is possible to convert a text signal or other electronic signal to be processed, and to generate a control signal necessary for controlling a specific operation of the network device 10 in the household based on this. The management server 400 (specifically, the security management server 430) responds to the voice signal “Set the living room temperature to 30°C” and “control signal to check the temperature of the living room from the temperature sensor”, It can generate “a control signal to start the boiler when the living room temperature is less than 30°C” and “a control signal to start the air conditioner when the living room temperature is over 30°C”.

In other words, the control signal generated in the home networking method of the present invention is generated based on a user's voice command input from the verified AI voice recognition speaker 200 and the wireless router 300.

The conventional speech recognition-based home network system does not apply security technology between information transmission of each device and device, and thus there is a problem that damage may occur due to leakage of transmitted information or unauthorized use of an unverified user. Accordingly, there is a situation in which users are uneasy about whether security is properly implemented in controlling devices within the household with only voice.

Accordingly, the home networking method and system of the present invention uses the wall pad device 100 installed in the household, and determines whether the voice command or control signal input through the above-described steps (S21 to S28) is from a verified user. It has an advantage to complement the method of discrimination.

Thereafter, the management server 400 (specifically, only the management server 420) transmits the generated control signal to the wall pad device 100 (S29).

Here, the control signal is a signal converted to driving the at least one intra-generation network device 10 based on the user's voice command acquired by the AI voice recognition speaker 200. In other words, the control signals are “control signal to check the temperature of the living room from the temperature sensor”, “control signal to start the boiler when the living room temperature is less than 30°C”, and “air conditioner when the living room temperature is over 30°C It includes a control signal” that causes it to be activated.

The wall pad device 100 may control the operation of the in-house network device 10 by transmitting the received control signal to the in-house network device 10.

Therefore, the wall pad device 100 has “control signal to check the temperature of the living room from the temperature sensor”, “control signal to start the boiler when the living room temperature is less than 30°C”, and “living room temperature exceeds 30°C. In the case of, a control signal for operating the air conditioner” is transmitted to the boiler 12, the temperature sensor 13 and the air conditioner 15 connected to the wall pad device 100, respectively, and the boiler 12, the temperature sensor 13, and The air conditioner 15 operates according to the received control signal.

Accordingly, according to the speech recognition-based home networking method of the present invention, it becomes possible for the user to operate the boiler 12, the temperature sensor 13, and the air conditioner 15 only with a voice, and within various households by a verified user. By allowing the network device 10 to be controlled, the security level of the home networking method and system can be remarkably improved.

On the other hand, when it is determined that the identification information received from the wireless router 300 is not valid in the validity determination step (S28), the management server 400 is at least one of the wall pad device 100 and the AI voice recognition speaker 200 One can send an error message.

Specifically, when it is determined that the identification information received from the wireless router 300 is invalid in the validity determination step (S28), the security management server 430 is among the voice recognition management server 410 and the only management server 420 By transmitting an error message to at least one, and the voice recognition management server 410 and the complex management server 420 by transmitting an error message to the connected AI voice recognition speaker 200 or the wall pad device 100, the network device 10 ) Can be disabled.

The home networking method and system of the present invention solves the problems related to the security of the conventional voice recognition-based home networking system by driving the home networking method and system using a wall pad device installed in the household, and improves the user's convenience. Can be improved.

The home networking method and system of the present invention can effectively improve the security problem of a home network system based on voice recognition by including a method and means for determining whether an input voice command or control signal is from a verified user.

The home networking method and system of the present invention can improve user convenience by enabling home networking setting and service execution using a wall pad installed in a household without the need to install a separate application on the user's portable terminal.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features of the present invention. You will be able to understand. Therefore, it should be understood that the embodiments described above are illustrative in all respects and are not limiting.

1000… Home networking system
100… Wall pad device
200… AI voice recognition speaker
300… Wireless router
400… Management server
410 ... Speech Recognition Management Server
420… Complex management server
430 ... Security management server
10… Network devices within a household

Claims (8)

In a home networking system using an AI voice recognition speaker and a network device installed in a household,
Generates authentication information based on identification information received from the AI voice recognition speaker and identification information received from a wireless router (AP) installed in the household, and is connected to a management server based on a control signal received from the management server. A wall pad device that controls the operation of network devices in the household; Including,
The control signal,
The management server compares the authentication information received from the wall pad device with the identification information of the AI voice recognition speaker obtained in the process of receiving the user's voice command and the identification information of the wireless router to determine the validity. The home networking system, which is a control signal of the network device in the household based on the user's voice command generated when the identification information is valid. The method of claim 1,
The AI voice recognition speaker transmits the received user's voice command to the voice recognition management server through the wireless router,
The management server,
A complex management server that processes data received from the AI voice recognition speaker and the wireless router, and transmits a control signal for controlling the operation of the network device in the household; And
A security management server that processes an operation required for home networking control based on data received from the voice recognition management server and the complex management server, and determines validity of the identification information; Including, home networking system. In a home networking method in which a wall pad device that is installed in a household and controls the operation of a network device in a household by receiving a valid control signal from a management server is an AI voice recognition speaker, a network device in the household, and a wireless router,
Pairing the AI voice recognition speaker with a first communication method;
Obtaining connection information of the wireless router; And
Transmitting connection information of the wireless router to the AI voice recognition speaker by the first communication method; Including,
The AI voice recognition speaker,
A home networking method that is connected to a wireless network provided by the wireless router in a second communication method using connection information of the wireless router received from the wall pad device. In a home networking method in which a wall pad device installed in a household manages an AI voice recognition speaker, a network device and a wireless router in a household,
Receiving identification information of the AI voice recognition speaker;
Receiving identification information of the wireless router;
Generating authentication information based on the identification information of the AI voice recognition speaker and the identification information of the wireless router, and transmitting the generated authentication information to a management server;
Receiving a control signal for controlling the network device in the household from the management server; And
Transmitting the control signal to a network device in the household; Including,
The control signal,
The management server compares the authentication information received from the wall pad device with the identification information of the AI voice recognition speaker obtained in the process of receiving the user's voice command and the identification information of the wireless router to determine the validity. The home networking method, which is a control signal of the network device in the household based on the user's voice command generated when the identification information is valid. The method of claim 4,
The management server,
Determine the validity of the identification information of the AI voice recognition speaker and the identification information of the wireless router received together with the user's voice command based on the authentication information received from the wall pad device,
If the identification information of the AI voice recognition speaker and the identification information of the wireless router are not valid as a result of the validity determination, an error message is generated,
When the identification information of the AI voice recognition speaker and the identification information of the wireless router are valid, transmitting a control signal of the network device in the household based on the user's voice command to the wall pad device. The method of claim 4,
The AI voice recognition speaker transmits the received user's voice command to the voice recognition management server through the wireless router,
The management server,
A complex management server that processes data received from the AI voice recognition speaker and the wireless router, and transmits a control signal for controlling the operation of the network device in the household; And
A security management server that processes an operation required for home networking control based on data received from the voice recognition management server and the complex management server, and determines validity of the identification information; Including, home networking method. delete delete

Images