KR101629169B1 - HOME NETWORK SYSTEM AND METHOD BASED ON WebRTC AND SERVICE WORKER - Google Patents

Abstract

The present invention provides a home network system and a home network method based on a web real time communication (WebRTC) and a service worker, capable of making a call and controlling remote devices by connecting a smart device and a home network device over peer-to-peer (P2P). The system comprises: a smart device connected to a home network device of an internal apartment complex network over P2P through an web application installed therein, and connecting a call with the connected home network device or remotely controlling the connected home network device; a signaling server performing relay to allow P2P connection between the smart device and the home network device through a wireless router and a home gateway; a push server receiving a call or remote device control request from the home network device or the smart device to provide a push alarm to the web application installed in the home network device or the smart device; the wireless router connecting an Internet network including the smart device and the signaling server with the home gateway included in the internal apartment complex network, and receiving a call or remote device control request signal to transfer the signal to the home gateway, or receiving the call request signal of the home network gateway to transfer the signal to the smart device; the home network devices installed in the internal apartment complex network, and performing a call function with the smart device on the Internet network through the home gateway depending on the control of the signaling server or receiving remote control by receiving the remote control request of the smart device; and the home gateway installed to be able to access the internal apartment complex network and the Internet network dually, and transmitting the call or remote control request signal to the home network device connected through the internal apartment complex network, or transmitting the call request signal to the smart device on the internet network.

Description

BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a home network system and method based on WebRTC and a service worker,

The present invention relates to a home network system and method based on WebRTC and a service worker, and more particularly, to a home network system and method based on a WebRTC and a service worker, and more particularly to a smart device connected to a signaling server for relaying a P2P connection with a home network device of an internal network, A home network system including a home gateway for connecting to the home network device under the control of a signaling server, a WebRTC and a service worker-based home Network system and method.

It is anticipated that the introduction of HTML 5, the next version of HTML, will increase the utilization of the web by reducing the load on the server, sharing the load with clients, and enhancing the utilization of the web. , Web Animations, Web Real-time Communication, and Service Worker, which are JavaScript API (Application Programming Interface) for providing integrated animation control model.

In particular, WebRTC is a real-time communication standard for the Web, which includes mechanisms for transmitting and receiving audio and video streams as well as P2P. Most services provide functionality through data communication between client and server, but in some cases, fast data exchange between clients is an implementation of the main function. In this case, WebRTC provides important infrastructure functions.

The service walker is the most important function for bringing the flow of the native application into the web, and it supports background-based processing rather than page-based processing. The main components of the service worker are a push API, a task scheduler API that performs a specific action by a scheduled alarm even when the web page is not loaded, (Background Synchronization), which functions to synchronize with the network.

On the other hand, the home network system integrates and controls the lighting, air conditioning, disaster prevention, security, entertainment and communication functions of the house into one system to make the home comfortable, safe and convenient, It is a system that improves the level. In recent years, with the growth of the home network market, various home appliances can be conveniently connected with home network services.

However, as shown in FIG. 1, the conventional home network system has a function of directly controlling the home network product 200 (home network appliance), processing a response or an event generated in the home network product 200, A server 300 including a function of controlling the home network product 200 by being connected to the terminal 400 through the Internet and a server 300 connected to the server 400 to transmit and receive data to and from the home network product 200 And a home network server 100 that is connected to the Internet.

In such a conventional home network system, it is difficult to maintain and manage the Internet leased line in order to transmit the external remote control request of the home network device to the outside through the existing internal network only. However, there is a separate home net server or a server did. In such a case, control is exerted only through the server when remote control is performed from the outside, and there is a restriction that a separate application corresponding to the device environment must be developed for each portable terminal.

Therefore, the home network system is implemented so that the integration of the development environment (One Source MultiPlatform) is possible based on the WebRTC and the service worker, It is necessary to embody it in such a way that it can be accommodated in the system.

Japanese Patent Application Laid-Open No. 10-2006-0088743

According to an embodiment of the present invention, a smart device is connected to a signaling server for relaying a P2P connection with a home network device of an internal network. The smart device is connected to the home network device in accordance with the control of the signaling server. A home network system having a home gateway for connecting to a device, and a home network system based on a WebRTC and a service worker, which are capable of P2P connection between a smart device and a home network device to perform call and device remote control .

The technical objects of the present invention are not limited to the technical matters mentioned above, and other technical subjects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the WebRTC and the service walker-based home network system of the present invention can be connected to a home network device of the internal network only through a web application installed in the device, A signaling server for relaying the smart device and the home network device through P2P connection between the smart device and the home network through a wireless router and a home gateway, A push server for providing a push alarm to a network device or a web application installed in the smart device, a push server for connecting the internet network to which the smart device and the signaling server belong, and a home gateway belonging only to the internal network, Signal, A plurality of wireless routers for transmitting to the home gateway or for receiving a call request signal of the home network device and delivering the call request signal to the smart device; a plurality of wireless routers provided in the internal network, A home network device that is connected to an internal network and the Internet and is connected to the home network device through a home network, And a home gateway that transmits a control request signal or transmits a call request signal to a smart device on the Internet.

According to another aspect of the present invention, there is provided a method for providing a home network system based on a WebRTC and a service worker, the method including: a smart device connected to a signaling server for relaying a P2P connection with a home network device of an internal network; And a home gateway system for connecting the home network device to the home network device under the control of the signaling server, the home gateway system comprising: (A) (B) transmitting a push message to the push server when the call request signal is received; (B) transmitting a push message (wake) to the web application of the smart device registered in the push server connected to the smart device via the Internet; Push message to activate the web application and wait for a response; (C) The base signaling server receives a signal for connection with the home network device from a smart device that the web application has woken up and receives periodic signaling from the home gateway, P2P connection; (D) the home gateway relaying a call signal of the smart device connected to the signaling server and P2P, and transmitting the relay signal to the home network device, thereby making a communication between the home network device and the smart device.

According to the present invention, P2P, push and offline operations are performed by WebRTC and service worker through a web application supporting HTML 5 based multi-platform environment, The home network system 700 and the web application installed in the smart device can be implemented as a single source, thereby facilitating the integrated management of the system and the application. And the maintenance cost is reduced.

As another effect, when a home network system based on the HTML 5 is configured, it is not necessary to separately construct a management server for relaying the device remote control to the internal complex network. Also, Service is possible.

1 is a diagram showing an example of the overall configuration of a conventional home network system.
2 is a block diagram of a home network system based on a WebRTC and a service worker according to a preferred embodiment of the present invention.
3 is a block diagram showing a detailed configuration of the smart device of FIG.
4 is a block diagram illustrating a detailed configuration of the home network device of FIG.
5 is a flowchart illustrating a communication process between a home network device and a smart device in a method of controlling a home network system based on a WebRTC and a service worker according to a preferred embodiment of the present invention.
6 is a flowchart illustrating a process of updating a home network device of the WebRTC and a service worker-based home network system control method according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary terms, and the inventor should appropriately interpret the concepts of the terms appropriately The present invention should be construed in accordance with the meaning and concept consistent with the technical idea of the present invention.

Therefore, the embodiments described in this specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention and do not represent all the technical ideas of the present invention. Therefore, It is to be understood that equivalents and modifications are possible.

Hereinafter, a WebRTC and a service worker-based home network system and method according to a preferred embodiment of the present invention will be described in detail.

2 is a block diagram of a home network system based on a WebRTC and a service worker according to a preferred embodiment of the present invention.

2, a home network system according to an exemplary embodiment of the present invention includes a smart device 100, a signaling server 200, an Internet 300, a push server 400, a wireless router 500, An API server 600, a home network appliance 700, a home gateway 800, a wall pad 910, a security phone 920, and a lobby phone 930.

The smart device 100 is P2P connected through the home network device 700 and the web application 110 to perform a video call with the home network device 700 or remotely control various settings of the home network device 700 Respectively. At this time, the smart device 100 can be P2P-connected to the home network device 700 on-line via the signaling server 200, the wireless router 500, and the home gateway 800. [ The smart device 100 may be, for example, a smart phone, a tablet phone, a tablet PC, a notebook computer, or a desktop computer.

The smart device 100 may be connected directly to a wireless router (wireless broadband router) 500, for example, even if the Internet 300 is in an unusable state, such as the smart device 2 103, It is possible to call the home gateway 800 directly without relay through the mobile communication terminal and perform P2P communication.

The signaling server 200 is basically a metadata exchange server for WebRTC communication and functions as a server for network address translation (NAT) and firewall correspondence by subdividing into a STUN / TURN / ICE server. The metadata may include session control messages used to open and close device-to-device communication, error messages, media metadata such as codec or media type, key data used to establish a secure connection, Lt; / RTI >

Particularly, the signaling server 200 can relay and control the P2P connection of the wireless router 500 or the home gateway 800 (corresponding to the caller) and the smart device 100 (corresponding to the callee) in the home network system of the present invention. .

The push server 400 receives a call request from the home network device 700 or the smart device 100 or receives a call request from the home network device 700 or the smart device 100 And provides a push alarm to wake up web application 110 in a mode state.

The wireless router 500 functions as a router of a wireless communication standard for connecting the smart device 100 and the Internet 300 to which the signaling server belongs and the home gateway 800 belonging only to the internal network. That is, the wireless router 500 receives a video call or a device remote control request signal from the smart device 100 and transmits it to the home gateway 800, or transmits the video call or device remote control request signal to the home gateway 800, the wall pad 910, the security phone 920, Receives a video call signal request from the same home network device 700, and transmits a signal to the smart device 100 through wireless communication.

The API server 600 is a server for updating the home network device 700 or the smart device 100 and may function as a web server and synchronize the web applications 110 and 710 of the connected devices, And may provide information or perform web application 110, 710 updates.

A plurality of home network devices 700 are provided for each household in the internal network and can perform a video call function with the smart device 100 connected to the wireless Internet network 300 through the home gateway 800. In the case of the wall pad 910, a system is constructed so that a plurality of home network devices 700 such as electric lamps, room cones, door locks, and the like can be directly controlled in the internal network without passing through the home gateway 800 do.

Each home network appliance 700 stores an IP table storing an IP address uniquely assigned to each home network appliance 700 in an internal memory (not shown) And stores and manages the connection addresses between the devices through the exchange of the IP tables in which the IP addresses allocated to the new home network devices 700 are exchanged.

In addition, in the smart device 100, it is important to check whether the web application 710 is updated in order to link the web application 710 installed in the home network device 700 at the time of remote control of the home network device 700. At this time, It is possible to receive an IP table stored from a specific one of the plurality of home network appliances 700 and confirm the updated version to the access IP address of the entire home network appliance 700. [ In addition, when the update is required, the update may be performed by connecting the smart device 100 to the network and transmitting update control signals and data to each of the home network devices 700 that need updating.

A plurality of home gateways 800 may be provided in place in order to connect to a plurality of home network appliances 700 provided in each generation of the home network. As shown in FIG. Also, the home gateway 800 controls the directly connected home network appliance 700 and also relays two types of network (Internet and internal network) connected thereto.

The communication between the home gateway 800 and the smart device 100 is performed by P2P communication with a web browser implemented on the web application 110 of the smart device 100 using a Web RTC based communication protocol.

The communication between the home gateway 800 and the smart device 100 performs online connection through the signaling server 200 when the Internet 300 network is connected, The device 100 is directly connected to the wireless router 500 and calls the home network device 700 directly through the wireless router 500 to call (voice / video call) of the home network device 700, Function is performed. As described above, the connection between the smart device 100 and the home network appliance 700 can be established even when the user is offline, because the installed web applications 110 and 710 are implemented on the basis of the service walker 113, It is possible to transmit signals by direct communication.

3 is a block diagram showing a detailed configuration of the smart device of FIG.

The smart device 100 of the present invention may further include a web application 110, an update management unit 120, and a remote control unit 130 in detail.

The web application 110 installed in the smart device 100 can perform the remote control and the call function of the home network device 700 in the smart device 100 by communication with the home gateway 800. [

The web application 110 basically performs the remote control and the call function of the home network device 700 online while the offline operation can be performed based on the service walker 113. Accordingly, The web application 110 is wake up by receiving a push message by direct communication of the wireless router 500 in an offline environment in which the network can not be connected and responding to a call of the home gateway 800 can do.

3, the web application 110 may include a front end page providing unit 111, a WebRTC communication unit 112, and a service worker 113, and may be connected to the API server 600 The home network device 700 and the smart device 100 can be developed as a single source, which facilitates design and implementation.

The front end page providing unit 111 performs a function of providing the same screen by linking the screen of the web application 110 installed in the smart device 100 with the home network appliance 700. [

The WebRTC communication unit 112 is responsible for WebRTC communication for real-time data communication in the web application 110 and supports P2P connection to function for video communication and data transmission required for remote control of the home network device 700. [

The service worker 113 is implemented such that the web application 110 registered in the smart device 100 operates as background-based processing and includes a push API unit 114, a task scheduler 115, a synchronization unit 116 ).

The push API unit 114 operates the web application 110 of the smart device 100 in the standby mode state by receiving a push message from the push server 400 at the time of a call request from the home network device 700, And allows reception of data such as a push message by communication.

The task scheduler 115 notifies the home network device 700 of the video call and remote control using the pre-stored scheduled alarm even in the offline state in which the web page is not loaded on the web application 110 executed in the smart device 100. [ .

The synchronization unit 116 performs a background synchronization function to synchronize the updated data in the off-line state of the web application 710 installed in the smart device 100 and the home network device 700, at the next online time.

The update management unit 120 may manage a plurality of home network devices 700 to confirm whether the smart device 100 updates the web application 710 installed in the home network device 700 when remotely controlling the home network device 700. [ The home network device 700 is provided with an IP table stored therein. Also, when the update is required, the device is connected to the smart device 100 only through the network, and the update control signal and data are transmitted to each home network device 700 that requires updating, so that the device update is performed.

The remote control unit 130 remotely controls the home network appliance 700 through the web application 110 or the home network appliance 700 and the communication function with the wall pad 910, the security phone 920, the lobby phone 930, As shown in FIG.

4 is a block diagram illustrating a detailed configuration of the home network device of FIG.

The home network device 700 of the present invention further includes a web application 710, an interworking device control unit 720, and an IP table management unit 730 in detail.

The web application 710 installed in the home network device 700 can perform a communication function with the smart device 100 connected to the home gateway 800 through the wireless router 500. [ In addition, when an update request for interworking of the web applications 110 and 710 from the connected smart device 100 is requested, the update can be performed synchronously from the API server 600.

Further, the web application 710 includes a front end page providing unit 711, a WebRTC communication unit 712, and a service worker 713.

The front end page providing unit 711 performs the function of providing the same screen by linking the screen of the web application 710 installed in the smart device 100 with the home network device 700. [

The WebRTC communication unit 712 is responsible for WebRTC communication for real-time data communication in the web application 710 and supports P2P connection so that it is suitable for transmission of video data necessary for performing communication with the smart device 100. [

The service worker 713 is implemented such that the web application 710 registered in the home network appliance 700 operates as background-based processing and includes a push API unit 714, a task scheduler 715, a synchronization unit 716, .

The push API unit 714 receives a push alarm from the push server 400 to operate the web application 110 in the standby mode when the smart device 100 requests a call or a remote control.

The task scheduler 715 supports the communication function with the smart device 100 in a scheduled alarm even when the web application 710 executed in the home network device 700 is offline.

The synchronization unit 716 performs a background synchronization function to synchronize the updated data in the off-line state of the web application 710 installed in the smart device 100 and the home network device 700 at the next online time.

The interlocking device control unit 720 is connected to a plurality of home network devices 700 through the internal network by the wall pad 910 and is connected directly to the plurality of home network devices 700 through the home gateway 800, And the like. For example, a direct control function can be performed only through the internal network to change the state of the home network device 700 such as a lamp, a door lock, and a room control provided in the same household as the month pad 910.

The IP table management unit stores an IP table, which is a list of IP addresses allocated to each home network device 700 for update check of the home network appliance 700, .

5 is a flowchart illustrating a call connection process between a home network device and a smart device in a home network system based on a WebRTC and a service worker according to a preferred embodiment of the present invention.

First, the home gateway 800 transmits a push message to the push server when a call request signal with the smart device 100 is received from a door phone connected to the internal network (S10, S12).

The push server activates the web application 110 by transmitting a wake push message for operating the web application 110 in the standby mode to the web application 110 of the pre-registered smart device 100, To be in a response waiting state (S14).

The smart device 100 executing the web application 110 sends a signal for connection with the door phone to the signaling server 200 while the home gateway 800 periodically signals the signaling server 200 , And can request a P2P connection with the smart device 100 (S16, S18).

The signaling server 200 transmits session information for P2P connection to the smart device 100 in which the web application 110 is executed and the home gateway 800 in steps S20 and S22.

The home gateway 800 receiving the session information is connected to the smart device 100 through the P2P communication and the home gateway 800 relays the call signals of the smart device 100 connected to the signaling server 200 and the P2P, (S24, S26), the door phone and the smart device 100 are connected to each other by a video call.

FIG. 6 is a flow chart of a process of updating a home network device of a WebRTC and a service worker-based home network system control method according to the present invention.

The smart device 100 accesses only the home network 700 through the home gateway 800 and transmits the IP table IP from the specific home network device 700 among the plurality of devices, Table, receives the IP table response from the home network appliance 700, and transmits an update request signal to the home network appliance 700 registered in the received IP table (S30, S32, S34). Upon receipt of the update request signal, the home network device 700 may perform updating after version checking.

Thereafter, the smart device 100 transmits the version check request signal to the home network device 700 that has requested the update, and determines whether the update is completed through the version check (S36, S38).

100, 101, 102, 103; Smart device
110, 710; Web application
111, 711; Front end page provider 112, 712; WebRTC communication
113, 713; Service walkers 114, 714; Push API section
115, 715; Task scheduler 116, 716; The synchronization unit
120; An update management unit 130; Remote control unit
200; A signaling server 300; Internet
400; Push server 500; Wireless router
600; API server 700; Home network appliance
800; Home gateway 910; Month pad
920; Security phone 930; Lobby phone

Claims (8)

A signaling server for relaying the P2P connection between the smart device and the home network device through a wireless router and a home gateway, and a home gateway connected to the home gateway belonging to the internal network and the signaling server, A home network device for receiving a call request signal or a device remote control request signal and transmitting the home network device's call request signal to the smart device; And
A home gateway which is provided so as to be capable of dual connection with the internal network and the Internet and transmits a call request signal or a remote control request signal to the home network device connected to the home network device through the internal network or transmits a call request signal to the smart device on the Internet However,
Wherein the home network device and the smart device are connected to each other in a P2P manner according to a control of the signaling server, the home network device receiving the session information for P2P connection between the home network device and the smart device from the signaling server, Of the home network system. The method according to claim 1,
A smart device connected to the home network device of the internal network only through a web application installed in the device and under the control of the signaling server, for making a call connection with the connected home network device or remotely controlling the home network device;
A push server for receiving a call or device remote control request from the home network device or the smart device and providing a push alarm to a web application installed in the home network device or the smart device; And
A plurality of devices are provided in the internal network, and the device performs a call function with a smart device on the Internet through the home gateway according to the control of the signaling server through a web application installed in the device, or receives a remote control request WebRTC and a service worker based home network system that further include network devices. 3. The method of claim 2,
And an API server that synchronizes the web application of the home network device or the smart device requiring updating to perform an update of the web application. 3. The system of claim 2, wherein the smart device
A WebRTC communication unit that performs WebRTC communication for real-time data communication in the web application, supports a P2P connection to transmit video or voice call with the home network device, and data necessary for remote control in real time;
A push API unit operable to receive a push message from the push server and to operate a web application of the smart device in a standby mode state when a call is requested from the home network device;
A task scheduler for performing video call and remote control with the home network device using pre-stored scheduled alarms even in an off-line state where a web page is not loaded on a web application executed in the smart device;
A synchronization unit configured to perform a background synchronization function to synchronize updated data in an off-line state of a web application installed in the smart device and a home network device at the next online time;
In order to check whether the web application installed in the home network appliance is updated at the time of remote control of the home network appliance, an IP table stored from a specific one of the plurality of home network appliances is received, An update management unit for checking the device update version with the IP address of the home network device and transmitting an update control signal and data to each home network device that needs updating, And
And a remote control unit for remotely controlling the home network device or performing a call connection function through the web application. The home network system according to claim 2,
A WebRTC communication unit that performs WebRTC communication for real-time data communication in the web application, transmits a video or voice call with the home network device in real time by supporting a P2P connection, and transmits data required for remote control in real time;
A push API unit for receiving a push alarm for operating the web application in a standby mode from the push server when a call or a remote control is requested from the smart device;
A task scheduler that performs a call function with the smart device in a scheduled alarm in an off-line state in which the web application executed in the home network device is not connected to the Internet;
A synchronization unit configured to perform a background synchronization function to synchronize updated data in an off-line state of a web application installed in the smart device and a home network device at the next online time;
An interworking device control unit for directly controlling a plurality of home network devices connected to the home network device through direct communication through an internal network without being connected to the home gateway; And
Further comprising an IP table management unit for storing an IP table that is a list of IP addresses allocated to each home network device for update check of the home network device and providing a stored IP table upon request from the smart device, Service walker based home network system.
A smart device connected to a signaling server for relaying a P2P connection with a home network device of an internal network; a home network system having a home gateway for connecting the smart device to the home network device under the control of the signaling server; In the providing method,
(A) when the home gateway receives a call request signal from the home network device connected to the internal network only, transmitting a push message to the push server;
(B) a push server connected to the smart device via the Internet transmits a wake push message to the web application of the smart device registered in advance, activating the web application and waiting for a response;
(C) When the signaling server receives a signal for connection with the home network device from a smart device that is woken up by the web application and receives periodic signaling from the home gateway, P2P connection of the home gateway; And
(D) the home gateway relaying a call signal of the smart device connected to the signaling server in a P2P manner and transmitting a call signal to the home network device, thereby making a call between the home network device and the smart device,
The step (C)
The signaling server transmitting session information for P2P connection to the smart device and the home gateway in which the web application is executed; And
Wherein the home gateway and the smart device receiving the session information further comprise a P2P communication connection according to the control of the signaling server. The method according to claim 6,
(E) when the update of the home network device is required, the smart device accesses only the internal network through the home gateway and transmits an update request signal to the home network device that requires updating;
(F) receiving the update request signal, the home network device accesses an API server to perform update after checking for an update version;
(G), the smart device transmits a version check request signal to the home network device, and determines whether the update is completed through version checking; And
(H) The method for providing a home network system based on a WebRTC and a service worker, wherein the smart device is connected to the home network device, which has been updated, with a web application to perform a remote control or a call function. 8. The method of claim 7, wherein step (E)
The smart device receiving an IP table from a specific home network device among a plurality of home network devices; And
Wherein the smart device is connected to each home network device with an IP address assigned to each home network device included in the received IP table to confirm an updated version of the device and a service router based home network system Delivery method.

Images