JP6186066B1 - System and method for notifying event occurrence - Google Patents

Abstract

Provided is a communication system capable of confirming a communication partner before responding in a communication device such as an interphone. A relay system 10 installed in a cloud in a communication system 1 sends a push notification P1 including an authentication token 13x, which is a one-time password related to a call, to a mobile terminal 5 via a network 3 when the interphone 21 is called. A push server 15 for distribution, and a web server 16 for distributing the visitor image 16p of the interphone 21 to the mobile terminal 5 based on the terminal authentication information including the authentication token 13x supplied from the mobile terminal 5 via the network 3. Have [Selection] Figure 1

Description

  The present invention relates to a system and method for notifying an event occurrence via a network.

  Patent Document 1 includes an interphone device and an external server that is connected to the interphone device via a communication network and establishes a communication channel between clients. The interphone device includes a server unit that establishes a communication channel between clients. A first client unit that functions as a client of the server unit and functions as a client of the external server, and the first client unit is established between the first client unit and the communication terminal by the external server It is described that an interphone system is provided that transmits data captured by an interphone device to a communication terminal via a first communication channel.

Japanese Patent Laid-Open No. 2006-29781

When a call is made by connecting an interphone and an external terminal using a SIP (Session Initiation Protocol) server, a program (application program, application) corresponding to the SIP server must be running on the external terminal such as a smart phone. . It is not realistic from the viewpoint of power consumption or the like to always operate a specific application in the smart phone. On the other hand, since the smart phone accesses the network using various communication networks, the address on the network changes, and there is also a problem that communication cannot be performed using the SIP server unless it follows it. Furthermore, in a communication device such as an interphone, there is a demand for confirming the communication partner before responding because the communication partner is not specified.

One aspect of the present invention is an application that is activated by a push notification upon occurrence of a first event that includes an interphone call in a first terminal that includes an interphone that includes a camera function . A one-time password related to the occurrence of the first event via a network to a second terminal that includes an application that includes a function to display the occurrence , including communication between the first terminal and the second terminal A push-type information distribution server that distributes a push notification including a one-time password that is cleared when the session ends, and a web server whose address is known in advance in the second terminal, automatically in response to the push notification the second terminal including a one-time password that is supplied from the second terminal via the network Based on the testimony information, the second terminal to deliver a first content associated with the first event including the image obtained by calling the interphone, which is supplied from the first terminal, intercom to the second terminal And a web server that displays a call to the image together with the image display .

  By the push notification, an application corresponding to the push notification and installed in the second terminal can be activated. Although the amount of information that can be transmitted by push notification is limited, by transmitting the one-time password by push notification, the application can access the web server using the one-time password and receive the first content It becomes. Therefore, on the application side, the first content can be displayed via the web server at the timing when the push notification is received.

Another aspect of the present invention is an application that activates the occurrence of a first event including an interphone call in a first terminal having an interphone including a camera function via a network by a push notification. And displaying on the second terminal including the application including the function of displaying the occurrence of the first event . Displaying includes the following steps :
1. The push type information distribution server includes a one-time password related to the occurrence of the first event, and includes a one-time password that is cleared when a session including communication between the first terminal and the second terminal ends. Deliver notifications.
2. A second server including a one-time password automatically supplied from the second terminal in response to the push notification to the address of the web server whose address is known in advance in the second terminal via the network; The first content related to the first event including the image acquired by calling the interphone supplied from the first terminal is distributed to the second terminal based on the authentication information of the terminal.
3. The application of the second terminal displays the intercom call together with the image display.

  One of the different aspects of the present invention is an application implemented in a terminal having a function of connecting to a network, and the terminal on which the application is mounted is a first terminal in the first terminal by the above method. This includes displaying the occurrence of the event. Further, another different aspect is a method for controlling a terminal having a function of connecting to a network, in which the terminal displays the occurrence of a first event in the first terminal by the above method. Is included.

The block diagram which shows the outline | summary of the communication system containing a relay system. The figure which shows the operation | movement sequence (communication method) of a communication system. The figure which shows the operation | movement sequence of a communication system following FIG. The flowchart which shows schematic operation | movement of an intercom application.

  This system includes a push information distribution server and a web server, and can be provided as a system (relay system) realized on the cloud. The present system can also be provided as a system (communication system) including the first terminal and / or the second terminal. A typical example of the first content provided from the web server is an image, but any other content or content that can be output on the second terminal side may be used. The web server can provide content that increases the amount of information with respect to text information such as voice, music, smell, etc. including the specified phrase.

  If the first terminal is an interphone, an image taken when a third party calls with the interphone can be displayed on the second terminal in real time, and the user of the second terminal can identify a visitor who has accessed the interphone . Also, in a call between mobile phones or smart phones, the caller (caller) image can be displayed on the callee in real time when the call is received, so that the caller can be confirmed before answering the call. It is also possible to provide a message application for receiving an image in real time from the first terminal to the second terminal. The first terminal may be a security device including a web camera, a monitoring device, or the like, and can call the second terminal under specific conditions and display an image at that time on the second terminal in real time.

  The system further includes an authentication server including a function of registering an ID for push notification to the second terminal when user authentication information related to the first terminal is supplied from the second terminal via the network. It may be. In the method (communication method, communication protocol) provided by this system, the authentication server supplies user authentication information related to the first terminal from the second terminal via the network before displaying. And registering an ID for push notification to the second terminal. An environment in which a user of the first terminal receives a push notification by registering as a user via the second terminal can be constructed.

In addition, a function for receiving and registering the network address of the second terminal on the network from the second terminal and a communication required via the network between the first terminal and the second terminal are necessary. And a communication control server including a function for performing call control for establishing a session. In the communication method, after the display, the communication control server uses the network address of the second terminal on the network registered from the second terminal due to the push notification, and the second terminal and the second terminal. It may further include establishing a session necessary for performing communication with the other terminal via the network. A typical communication control server is a SIP server. The application started in the second terminal by the push notification transmits the network address of the second terminal on the network from the second terminal to the communication control server, so that the communication control server is connected to the first terminal and the second terminal. Can be specified, and a session can be established according to a predetermined protocol using peer-to-peer or the like.

  Furthermore, it is desirable that the system includes a gateway server connected to the first terminal via the network and including a function of supplying content related to the first event to the web server. The content related to the first event can be stored in the web server in real time from the first terminal via the gateway server, and can be provided as the first content from the web server to the second terminal. The gateway server may be further connected to the first terminal via a network, and may have a function of relaying the first terminal and the communication control server. By providing a gateway server, it is possible to solve the NAT problem, and further, it is possible to absorb the difference in specifications of intercoms of each company and to convert the data into data suitable for a connection line on which a session is performed.

  The system may be a communication system further including a second terminal. The second terminal is an application that is activated by a push notification, and displays the occurrence of the first event together with the display of the first content. An application including the function to be performed may be included.

  The push-type information distribution server may include a function of distributing push notifications to a plurality of second terminals via a network, and can make a simultaneous call to the plurality of second terminals. . In this case, the web server that receives the request for supplying the first content from the plurality of second terminals transmits a signal permitting establishment of communication with the first terminal from any of the plurality of second terminals. It is desirable to include the function to receive. With this signal, the simultaneous call is terminated and an individual session by the communication control server can be started.

  That is, delivering the push notification in this communication method includes that the push type information delivery server delivers the push notification to the plurality of second terminals via the network, and the web server You may have receiving the signal which permits establishment of communication between 1st terminals from either of 2nd terminals.

  The first terminal included in this system is an interphone that typically includes a camera function, the first event is an interphone call, and the web server uses a protocol suitable for transferring content such as HTTP. The image supplied from one terminal is distributed as the first content. Therefore, the content can be transmitted to the second terminal even if a peer-to-peer session such as SIP is not started. If the first terminal is an interphone including an unlocking function, the web server may further include a function of relaying an operation for unlocking from the second terminal.

FIG. 1 shows a schematic configuration of a system (communication system) 1 that connects an interphone to a mobile terminal (information terminal, typically a smart phone) via a network as an example of the system described above. The communication system 1 includes an interphone (door phone) system 20 provided in an apartment 2, an information terminal (mobile terminal, portable terminal, smart phone, second terminal) 5, and an interphone (interphone parent) included in the interphone system 20. A relay system (relay server) 10 that connects the information terminal (second terminal) 5 and the information terminal (second terminal) 5 via a network (cloud) 3. The intercom system 20 may be for an apartment or may be a system corresponding to each individual detached building.

  The relay system 10 includes an authentication server (management server) 12 that manages a user of each interphone 21 included in the interphone system 20 and the information terminal 5 owned by the user, an authentication database (authentication DB) 13, an interphone 21, and information. A SIP server 14 that controls a session with the terminal 5 and a push type information distribution server (push server) 15 that distributes the push notification P1 to the information terminal 5 (specifically, the application 50 installed in the information terminal 5). A web server 16 that distributes contents such as images to the information terminal 5 using a file transfer protocol such as HTTP, a service server 17 that provides other web services to the information terminal 5, a relay system 10, and an interphone system 20. Gateway server to connect to Honsaba) and a 11.

Cloud computing (cloud) 3 is used as a general term for services that use various software, hardware, database, server, and other resources via a computer network such as the Internet. The relay system (relay server) 10 indicates a server or server group that provides a server or cloud service built on the cloud 3. In recent years, companies provide hardware environments (servers, storage, networks), and development services such as middleware and OS can be freely selected by developers (users) (IaaS, Infrastructure as a Service), businesses There is a service (IDC, Internet Data Center) for lending a cloud server as a resource.

  Due to the spread of flat-rate mobile phone packets, mobile terminals 5 such as tablets and smart phones are always connected. However, most of the intercoms (doorphones) that can be linked to the commercially available smart phone 5 are premised on wireless LAN connection. Commercially available interphones and doorphones that are compatible with the SIP protocol are generally products that are assumed to be used in wired or wireless LAN (assumed to be used indoors or in buildings).

  Many of these products use the SIP protocol to make voice calls, and can be used in terminals other than the LAN in theory by going through a SIP server installed on the Internet. Although there is a possibility, at present, such usage is not widespread for the following reasons.

  The first reason is that it is difficult to stably call a mobile terminal outdoors. In the case of mobile communication, if the IP address changes depending on the area used, or the IP address information registered in the SIP server changes to another address when calling by SIP, due to priority switching between the wireless LAN and the mobile line, etc. Cannot call.

The second reason is the SIP NAT (Network Address Translation) problem. If NAT exists on each of the sending side and the receiving side, the address of the other party cannot be specified, and a silent state occurs.

The third reason is that because of LAN-based products, packet communication using a mobile line is too much. That is, a quality that allows stable conversation and video viewing even when 3G packets, LTE (Long Term Evolution) or 4G bandwidth is limited is required. In a LAN environment, packet usage, speed limitations, external attacks, etc. will not be a problem. Considering the use of mobile lines and public WIFI networks in the outdoors, these problems can be solved. Without it, it is difficult to commercialize and provide services.

  The fourth reason is that if the Internet can be referred to from the outside, the video is stolen or the interphone device is hacked. For example, if the intercom is easily connected to the Internet, it will be possible to remotely unlock the room.

  A method for solving the first reason is to provide a mechanism capable of receiving a call without depending on a communication bearer. It is possible to make a call in either the WIFI environment or the mobile network, that is, it is possible to reliably receive a call while switching between the WIFI and the mobile network, or when both are valid. In the communication system 1, a device call by a PUSH notification (push notification) P <b> 1 provided by the push server 15 is used. By using the push notification P1, even when the application 50 is not activated in the mobile terminal 5, the application can be activated upon receipt of an incoming call. It may take several seconds (about 1 to 5 seconds) from the room call in the intercom 21 as the first terminal to the actual call in the mobile terminal 5 as the second terminal. Loss time during a call is usually of little concern in providing service.

  Connecting to the SIP server 14 at all times (maintaining the sip resist state) is a general VoIP (SIP telephone) system, and the time lag from the call to the incoming call is minimized, but the application must always be running. As described above, there is a problem. Furthermore, since the IP address of the terminal 5 is different between the WIFI and the mobile line, if the WIFI and the mobile line are both valid or the IP is switched while moving, the information registered in the SIP server 14 needs to be updated. Become. For this reason, it is necessary to frequently register to the SIP server 14, and the battery consumption of the terminal 5 tends to increase.

It is also possible to use device calling by SMS (Short Message Service). In addition to messages, the amount of data that can be transmitted and received is limited, but there is an advantage that other information such as video can be notified together. On the other hand, a SIM (Subscriber Identification Module) is indispensable for a service provided by a mobile phone company, and there is a problem that it cannot be used in a data communication dedicated SIM or a terminal without a SIM model. Therefore, the communication system 1 solves this problem by using a push call that can be used without being conscious of the line type, such as WIFI or mobile, indoors or outdoors.

  In order to solve the second and third reasons, the gateway server 11 is provided in the relay system 10 in the system 1 and the communication method. In order to realize a method for reducing the amount of data used for voice and video to the limit that satisfies the interphone function for the mobile terminal 5, that is, enabling video display of conversations and visitors even when data communication is limited to packets. The system 1 does not require any original interphone equipment (hardware), and aims to enable use on a mobile line with a ready-made interphone (door phone) or SIP-compatible interphone as a target.

As a solution, the gateway server 11 is provided with a function (connection relay / conversion function) 11b for converting audio and video data from the interphone 21 into a data format and codec that is considered optimal for the mobile terminal 5. In addition to codec conversion, the gateway server 11 also serves as a proxy server for connecting a condominium or resident LAN network and the Internet (mobile) network. Further, by providing the gateway server 11, an external device (such as a mobile terminal) does not directly communicate with intercom equipment existing in the resident side LAN. For this reason, the risk of an attack on each device of the intercom system 20 from the outside can be minimized.

  In addition, each manufacturer has various interphone hardware, and although the external interface specifications differ depending on the model, the relay system 10 can be provided with a function to absorb these differences. Therefore, the application 50 on the mobile terminal 5 side can provide a common interphone application 50 to the interphone systems of each manufacturer without being conscious of the manufacturer or model of the interphone.

  In order to solve the fourth reason, in this communication system 1 and communication method, a mechanism has been introduced that prevents a third party from pretending to be a resident and seeing the video on the interphone or making a call. Yes. If the incoming call of the interphone 21 is provided via the Internet (cloud) 3, the incoming call of the interphone can be taken theoretically anywhere in the world if there is a line connected to the Internet. For this reason, if only ID and password authentication is used, if the ID and password are leaked, anyone can see the video or make a call. Therefore, there is a need for a mechanism that prevents a third party from receiving an intercom call without permission or referring to a visitor's history due to leakage of an ID or password.

  For this reason, in the authentication server 12 of this system, a unique ID 13b that can identify an individual mobile terminal and a user ID (ID registered as an interphone user) 13a are associated with a password 13p at the time of first login. An authentication function (authentication unit) 12a to be (activated) is included. This prevents the interphone application 50 from being used on devices other than the registered terminal 5.

The unique ID 13b that can identify an individual mobile terminal 5 such as a smart phone needs to be an ID that can be proved unique, and the device token information for push notification corresponds to this. On the other hand, when the device token information 13b, which is an ID for push notification, is used as the unique ID 13b that can identify an individual mobile terminal, the device token information 13b is stored in the IMEI (International Mobile Equipment Identify) or MA
Unlike C address etc., it is guaranteed to be unique, but it may not be a static value. That is, there is a possibility that the value of the push notification ID 13b may be changed due to an application to be notified of push notification or an OS upgrade.

  Therefore, the authentication server 12 includes a terminal registration code issuing function (terminal registration code issuing unit) 12b. The smart phone application 50 installed in the mobile terminal 5 notifies the device token 13b when logging in to the authentication server (management server) 12 having an authentication function. When the registration of the terminal 5 is successful, the terminal registration code issuing function 12b of the authentication server 12 issues a registration code 13c to notify the smart phone application 50 of the mobile terminal 5. The registration code 13c is a one-time value that is changed every time login authentication is performed. When the next login to the authentication server 12 becomes necessary due to version upgrade or the like, the smart phone application 50 displays the registration code 13c. 13c is notified. By doing so, even if the device tokens 13b for push notification are different, if the registration codes 13c match, it is possible to prove that they are the same terminal 5, and a new device for push notification The token 13b can be used by the push server 15 for push transmission.

Since a commercially available SIP interphone is based on a normal VoIP (SIP phone), the communication system 1 has a mechanism for starting a call application with a push notification as a trigger. However, with this alone, a third party may register with the SIP server (Re
If it is possible, anyone may receive a call or a video can be referred to.

  In consideration of ensuring security when starting communication, it is desirable to refer to the visitor image (image of the communication partner) before answering the incoming call. For this purpose, it is necessary to acquire video regardless of the SIP session. There is. In other words, if a visitor video is acquired using a SIP session, the video cannot be displayed until an incoming call response (SIP session establishment) is performed.

  For this reason, in the present system 1, a web server 16 is provided, and apart from SIP calling, an interphone 21 used for calling is specified and a mechanism for referring to a video of a camera mounted on the interphone 21 is provided. ing. When video is transmitted by SIP, the video can be sent to a terminal that correctly responds to the call (user authentication is possible). However, such a mechanism cannot be taken before answering the incoming call. For this reason, the push server 15 of the present system 1 includes a call function (call unit) 15a for supplying a one-time password (authentication token) 13x together with a push notification P1 for calling the terminal 5. The authentication token 13x may be issued by the push server 15 or may be issued by the authentication server 12. In this example, the SIP server 14 that receives the incoming call from the interphone 21 via the gateway server 11 is used. A function (unit) 14a for registering the authentication token 13x is included.

  The authentication token 13x, which is a one-time password, is cleared when the web server 16 finishes providing the content accompanying the push notification P1 to which the authentication token 13x is notified. For example, a push notification P1 is made by calling the interphone 21 (first event), and after the incoming call screen is supplied from the web server 16 based on the authentication token 13x, a session with the interphone 21 is started and the session is ended. Then, the authentication token 13x is cleared.

  The web server 16 includes a relay unit 16a that uniquely identifies a user from the web server 16 based on the one-time authentication token 13x and provides a visitor (communication partner) image. With this mechanism, the visitor's video 16p is also private information, but in the present system 1, it can be referred only to the called terminal 5.

  Further, the web server 16 stores a visitor's video (regardless of moving images and still images) 16p as history information on the web server 16 for a certain period of time, and is limited to a specific user (resident) on the server. A browsing service unit 16c. This browsing service 16c can also be safely provided by using a one-time authentication token 13x that can be obtained by accessing the SIP server 14 by the user-registered mobile terminal (second terminal) 5.

  Therefore, in the communication system 1 including the relay system 10, the caller terminal (second terminal) 5 obtains the video (visitor image) of the interphone 21 before the response of the SIP call (Invite). Can be displayed. Further, by using the one-time authentication token 13x, the video of the interphone 21 cannot be referred to from other than the terminal 5 belonging to the room of the interphone 21.

This method can be used not only for the image of the visitor but also for making various requests to the intercom device (acquisition of camera video, unlocking request of electric lock, etc.). For this reason, the web server 16 has a function 16 a that can be confirmed by the interphone 21 (locked state, security state in the apartment or home, operation state of the air conditioner and other electrical devices), a function 16 a that relays video, And an intercom 21 or a function 16b that relays the operation to a door or a device in the home via the intercom 21.

  Furthermore, the call function 15a of the push server 15 can make a plurality of mobile terminals 5 callable per room in the case of an interphone service. The calling function 15a can deliver the one-time authentication token 13x in units of users (for each terminal) or in units of rooms (treating terminals for one family as one group). Therefore, while the user ID and password can be authenticated only in units of users, a common authentication token 13x is used for a plurality of terminals 5 that have been previously authenticated and set with push notification IDs (device token information) 13b. Is included in the push notification P1, it is possible to call even a group unit such as a room and display a visitor image.

  Various requests to the interphone 21 can be sent from the mobile terminal 5 to the relay server (relay system) 10, and the relay system 10 determines that the request is valid when the authentication token 13x is normal. be able to. The authentication token 13x is important and concealed information necessary for using the intercom service, but is distributed only to the specific terminal 5 registered in advance by the push notification P1. For this reason, it cannot be easily obtained by a third party. Furthermore, since the authentication token 13x is exchanged between the relay system 10 and the terminal 5 via the network (cloud) 3, it is not possible to guarantee the concealment of the information. However, since the authentication token 13x is a one-time password, even if it is leaked, the influence can be minimized.

  This will be described in more detail with reference to FIG. The intercom system 20 installed in the condominium 2 includes a plurality of interphone master units (interphones) 21 corresponding to each door (each room, each family), a local LAN 28 for connecting devices in the condominium 2, a local LAN 28 and a cloud ( And a router 29 that connects to the Internet 3. Each interphone 21 is connected to the relay system 10 of the cloud 3 by a router 29 via a secure route, for example, VPN.

  Each interphone 21 is connected to the electric lock / unlock (locking) device 24, the microphone / speaker 25 a, the camera 25 b, and the input / output control device 22. Furthermore, the interphone 21 is also connected to a lobby interphone system 23 installed in the lobby of the apartment 2, and is also connected to a microphone / speaker 26 a and a camera 26 b in the lobby. Therefore, the interphone 21 detects a visit as an event (first event) when a visitor who has arrived at the lobby and a visitor who has arrived at the door of each door announces the visit by the interphone 21, and the visitor's image or Voice can be acquired and transmitted to the relay system 10.

  The relay system (relay server) 10 placed in the cloud 3 includes a gateway server 11 serving as a gateway to the interphone (first terminal) 21 and an authentication server 12 that performs user authentication of the mobile terminal 5 by access from the user of the interphone 21. An authentication DB 13 that stores authentication information, a SIP server 14 that establishes a session between the interphone 21 and the mobile terminal 5, a push server 15 that distributes a push notification P 1 to the mobile terminal 5, and the mobile terminal 5. Web server 16 that supplies content such as video upon request, and server 17 that provides other services.

When the interphone (first terminal) 21 is called, the gateway server 11 relays it to the SIP server 14 as a first event, and a connection relay / conversion function 11b that relays voice and the like. including. The connection relay / conversion function 11b converts the voice from the interphone 21 into a predetermined data format or codec and relays it to the SIP server 14 or images related to the call (first event) and other states of the interphone 21. Is supplied to the web server 16 as content, and an operation from the mobile terminal 5 is supplied to the interphone 21 via the web server 16.

  The authentication server 12 sets user authentication information (user ID 13a and password) from the mobile terminal (second terminal) 5 according to the user ID 13a and password (initial password) 13p of each interphone 21 set from the external master control terminal 6. 13p), the authentication function 12a for registering the push notification ID (device token information) 13b for the mobile terminal 5 (the application 50 installed in the mobile terminal 5) and the login to the mobile terminal 5 And a function 12b for issuing a terminal registration code 13c which is a one-time password updated each time.

  The push server (push-type information distribution server) 15 generates a one-time password (authentication token) 13x corresponding to each call via the network 3 to the mobile terminal 5 when a call (first event) occurs in the intercom 21. A function 15a for delivering a push notification P1 including

  The web server 16 registers the authentication information of the mobile terminal 5 including the authentication token 13x supplied from the mobile terminal 5 via the network 3 (in this example, further includes the SIP ID of the mobile terminal 5) in the authentication DB 13. A function / video relay unit 16a that authenticates the user based on the received information and distributes the visitor's image (first content) related to the call (first event) to the mobile terminal 5, and the operation from the mobile terminal 5. An operation relay function 16b for relaying to the interphone 21 and a function 16c for accumulating the history 16p of visitors and the like for a certain period and disclosing them to the user are included.

The SIP server 14 receives and registers the network address on the network 3 from the mobile terminal 5 and the function 14a for registering the authentication token 13x in the authentication DB as a one-time password when a call (first event) occurs in the intercom 21. A session necessary for performing communication via the network 3 between the function 14b, the interphone (first terminal) 21 and the mobile terminal (second terminal) 5 is SIP (Session Initiation).
A session control function 14c for performing call control established according to (Protocol).

  A typical example of the mobile terminal 5 connected to the interphone 21 via the relay system 10 is a smart phone on which the interphone application 50 is mounted. The interphone application 50 activates the application 50 by the login function 51 for accessing the authentication server 12 of the relay system 10 and registering the mobile terminal 5 and the push notification P1 from the push server 15, and calls from the interphone 21 (first An initial response function 52 that displays the visitor image (first content) acquired from the web server 16, a function 53 that makes a call with the interphone 21 through a session established in the SIP server 14, and a SIP And a function 54 for performing an operation of relaying the interphone 21 or the interphone 21 via the server 14 or the web server 16.

  2 and 3, using this communication system 1, an interphone (intercom) 21 as a first terminal and a smart phone 5 as a second terminal, actually an interphone application installed in the smart phone 5. Communication methods for calling and exchanging information (data) with 50 are shown in order.

  Steps S1 to S8 are a login process (initial registration process) in which the authentication server 12 registers the smart phone 5. A login screen is displayed on the intercom application 50 of the smart phone 5, and the user accesses the authentication server 12 from the login screen.

When the user authentication information related to the interphone 21 is supplied from the smart phone 5 via the network 3, the authentication server 12 registers the push notification ID 13 b for the smart phone 5 in the authentication DB 13. Specifically, login information (ID, password, push device token) is transmitted from the smart phone 5 to the authentication server 12 in step S1, and the authentication server 12 sends user information (ID 13a, password 13p) in the authentication DB 13 in step S2. The smart phone 5 is registered in the push server 15 and the SIP server 14 in steps S3 and S5, respectively. When the registration results are returned from the respective servers in steps S4 and S6 and correctly registered, the authentication server 12 registers an authentication code including user identification information in the authentication DB 13 in step S7. Further, in step S8, the authentication server 12 transmits the authentication information and the one-time terminal registration code 13c to the smart phone 5 as a login response.

  Steps S10 to S18 are processes in which the push server 15 delivers a push notification including an authentication token that is a one-time password when the interphone 21 is called (occurrence of a first event). Specifically, when there is an interphone call in step S10, a call event is transmitted to the intercom server (gateway server) 11 in step S11, and a registration request (inbyte) is sent from the gateway server 11 to the SIP server 14 in step S12. ) Is notified. In step S <b> 13, the SIP server 14 registers terminal authentication information related to this call event in the authentication DB 13. The terminal authentication information (authentication token number) includes a one-time authentication token 13x, a caller SIP number, and a callee SIP number. The caller SIP number is the SIP number assigned to each interphone 21, the callee SIP number is the SIP number of the smartphone 5 assigned at the time of login, and a plurality of smartphones 5 are assigned to one interphone 21. If assigned, preparations are made for simultaneous calling to the plurality of smart phones 5.

  In step S14, the intercom incoming call is notified from the SIP server 14 to the push server 15. In step S15, a push notification including an authentication token is distributed from the push server 15 to each registered smart phone 5. Thereby, in the smart phone 5, the smart phone application 50 is activated and an incoming call screen is displayed. In step S16, the call result is returned from the SIP server 14 to the gateway server 11. In each called smart phone 5, the address is registered in the SIP server 14 in step S17, and the result is notified from the SIP server 14 in step S18.

  In steps S20 to S36, the web server 16 uses the first content related to the call to the smartphone 5 based on the terminal authentication information including the one-time password supplied from the smartphone 5 via the network 3 by HTTP. In the example, an interphone state and an image are distributed, and a process in which the interphone application 50 displays the intercom state and the image on the incoming call screen is shown.

  Specifically, in step S20, the smart phone 5, specifically the interphone application 50, as a client, sends an interphone status acquisition request to the web server 16 using HTTP, together with terminal authentication information including the authentication token 13x. Notice. The intercom state includes the interphone of the lobby and the door of each door, the locked state, and the like. In step S21, the web server 16 confirms (authenticates) the terminal authentication information including the notified authentication token 13x with the SIP server 14. The web server 16 may authenticate the incoming terminal authentication information based on the information registered in the authentication DB 13 or the authentication server 12. In steps S22 to S25, the web server 16 acquires the interphone state from the interphone 21 via the gateway server 11, and distributes the interphone state to the smart phone 5 in step S26. In the smart phone 5, the intercom status is displayed in real time on the incoming call screen.

  When the web server 16 acquires the intercom status, the web server 16 can autonomously set by receiving the interphone call from the gateway server 11, and the status can be set regardless of whether there is a request from the smart phone 5. It is also possible to obtain. Further, while the smart phone 5 is displaying an incoming image, it is possible to intermittently acquire the state from the interphone 21 at an appropriate timing and update the interphone state supplied from the web server 16 to the smart phone 5. The same applies to the following images.

  In step S30, the smartphone 5 first notifies the web server 16 of a video intercom status acquisition request together with terminal authentication information including the authentication token 13x. In step S31, the web server 16 authenticates the terminal authentication information including the notified authentication token 13x in the same manner as described above. In steps S32 to S35, the web server 16 acquires a video from the interphone 21 via the gateway server 11. In step S36, the intercom status is distributed to the smart phone 5. In the smart phone 5, the image of the visitor is displayed on the incoming call screen in real time. While the incoming call image is displayed on the smart phone 5, the web server 16 intermittently or continuously acquires video from the interphone 21 at an appropriate timing and supplies the video to the smart phone 5. Thereby, a real-time video can be displayed on the smart phone 5.

  Steps S41 to S79 show a process of starting and ending a session using the SIP server 14 which is a communication control server. In step S41, when the response button is pressed down by one of the called smart phones 5, a call start request is transmitted to the web server 16 together with the terminal authentication information including the authentication token 13x in step S42. The In step S43, the web server 16 authenticates the terminal authentication information including the notified authentication token 13x in the same manner as described above, and notifies the gateway server 11 of the interphone call in step S44. As a result, in step S45, the gateway server 11 stops the simultaneous call to the SIP server 14, and in step S46, designates the smart phone 5 whose response button is pressed, and sends an invite request to the SIP server 14. Notify and call the smart phone 5. In response, the SIP server 14 notifies the smart phone 5 of an invite request in step S47. When an acknowledgment is obtained from the smart phone 5, the SIP server 14 returns a call result to the gateway server 11 in step S48.

  As a result, in step S <b> 51, the interphone 21 starts a call using the SIP session with the smart phone 5 via the gateway server 11. At this time, in step S49, the interphone call result is returned from the gateway server 11 to the web server 16, and in step S50, the start of the call via the web server 16 is displayed on the smart phone 5. The interphone 21 is connected to the gateway server 11 of the relay system 10 on the cloud via VPN, and the gateway server 11 whose network address is specified relays the interphone 21 and the SIP server 14. For this reason, the smart phone 5 performs a call by the SIP session in a state where the address is resolved by the gateway server 11, that is, without going through the NAT on the interphone 21 side. Therefore, NAT does not enter at least on the interphone 21 side, and it is possible to prevent a situation in which a call cannot be made (NAT problem) when address conversion by NAT is performed on the transmission / reception side in the SIP session. Furthermore, the gateway server 11 can set the codec to an optimum one for making a call with the smart phone 5, so that a call that is economical and ensures voice quality can be performed.

When the unlock button is depressed in the smart phone 5 (interphone application) 50 in step S61 during a call, an unlock request is transmitted to the web server 16 together with terminal authentication information including the authentication token 13x in step S62. In step S63, the web server 16 authenticates the terminal authentication information including the notified authentication token 13x in the same manner as described above, and notifies the interphone 21 of the unlock request via the gateway server 11 in steps S64 and S65. In step S66, the interphone 21 further outputs an unlock signal to the unlocking device 24, confirms the result, and returns the unlock result to the web server 16 via the gateway server 11 in steps S67 and S68. The web server 16 returns the unlocking result to the smart phone 5 in step S69. Thereby, the user can cancel using the interphone application 50 of the smart phone 5 and confirm the result.

  In step S70, when the call end button is pressed down on the smart phone 5, the connection cancellation is notified from the smart phone 5 to the SIP server 14 in step S71, and the call using the SIP session is ended in step S72. The result is transmitted to the intercom 21 via the gateway server 11 in steps S78 and S79. As a result, the process of the example started by calling the interphone 21 (first event) is completed, and the authentication token that is the low-time password is reset.

  FIG. 4 shows an outline of the operation of the intercom application 50 installed in the smart phone 5. When the push notification is received in step 81, the intercom application 50 is automatically activated, and in step 82, the terminal authentication information including the one-time password authentication token 13x is sent to the web server 16 of the relay system 10 whose address is already known. Thus, the state of the intercom 21 and the image of the visitor are acquired. Next, in step 83, the intercom status and video acquired from the web server 16 are displayed together with the call from the intercom 21. Therefore, the interphone application 50 can output (display) content such as the state of the interphone 21 that is the communication partner and the video acquired by the interphone 21 before starting the SIP session.

  Based on the displayed information, the user presses a response button in step 84, starts a SIP session in step 85, and can communicate (call) with the interphone 21. Further, when the unlock button is pressed in step 86, the unlock can be performed via the intercom 21 in step 87. When the call end button is pressed in step 88, the call by the SIP session is ended in step 89, and the process started by calling the interphone 21 (first event) is ended.

  As described above, in the communication system 1, the authentication server 12 of the relay system 10 receives the authentication server 12 of the relay system 10 at the initial registration of the application 50 of the smartphone 5 that is a user terminal or by normal activation. When logging in, the device token information 13b of the mobile terminal 5 is registered (activated) in the authentication server 12 (authentication DB 13) simultaneously with the user ID 13a and the password 13p. If the registration is successful, a registration code 13c is issued. Although one user and one terminal are basically used, a plurality of users can be managed for one room by registering the device token 13b of each terminal 5 and performing push notification.

Thereafter, each time the smart phone 5 logs in to the relay system 10, the authentication server 12 is notified of the registration code 13 c and the device token information 13 b for authentication. If the authentication is successful, the authentication server 12 issues a new registration code 13c and notifies the smartphone 5 of it. By doing this, even when the device token 13b becomes inconsistent due to a change in OS platform or model change, if the regular registration code 13c can be notified, the authentication information including the notified new device token 13b is updated, The push notification P1 can be stably sent to the user's smart phone 5. It also prevents spoofing during login.

  Further, in this relay system 10, the SIP server 14 automatically generates an authentication token 13x having a value (one time) different from the previous call every time the interphone is called (every first event occurs). At the same time as the interphone 21 is called, the interphone call is notified to the mobile terminals 5 (all mobile terminals in the corresponding room) by push, and the information of the authentication token 13x is included in the message of this push notification P1. By limiting the route for obtaining the authentication token 13x to only the push notification, it becomes difficult for a third party to obtain the authentication token 13x that is information for authentication. Although it is not possible to guarantee the concealment of the authentication token 13x included in the push notification by means such as packet capture, even if the authentication token 13x passes to a third party, the one-time information for each call Therefore, security in the next room call is secured.

  By obtaining the authentication token 13x, the smart phone 5 can access the web server 16 by HTTP using the one-time authentication token 13x as a client, and can download and display content from the web server 16. Therefore, before the start of a call, an image of a visitor of the interphone 21 can be displayed on the smart phone 5, and the state of the interphone 21 can be displayed.

  In the above, the present invention has been described using an example in which an interphone and a smart phone are connected via the cloud. However, the event to be notified (first event) is not limited to the interphone call, and the first terminal Is not limited to intercom. The event may be a mobile terminal call and the first terminal may be a mobile terminal such as a smart phone. Before starting a call, an image of the calling party can be displayed. In addition, the first terminal may be a surveillance camera, a security camera, or the like, and when an event is caught by these devices, the event image is combined with the occurrence of the event and a mobile terminal such as a smartphone. Can be displayed. These examples are only some examples to which the communication system and method of the present invention can be applied, and the present invention is not limited thereto.

5 Mobile terminal (smartphone, second terminal),
10 Relay system (relay server)
20 intercom system, 21 intercom (first terminal)

Claims (16)

An application that is activated by a push notification in response to the occurrence of a first event that includes a call to the interphone in a first terminal that includes an interphone that includes a camera function, and includes a function that displays the occurrence of the first event When a session including communication between the first terminal and the second terminal is completed, which is a one-time password related to the occurrence of the first event via a network to a second terminal including an application A push type information distribution server that distributes push notifications including a one-time password to be cleared ;
A web server whose address is known in advance in the second terminal, including the one-time password automatically supplied from the second terminal via the network in response to the push notification; Based on the authentication information of the second terminal, the first content related to the first event including the image acquired by calling the intercom supplied from the first terminal to the second terminal And a web server that is distributed before the start of the session and causes the second terminal to display the interphone call together with the display of the image . In claim 1,
A system further comprising an authentication server including a function of registering a push notification ID for the second terminal when user authentication information related to the first terminal is supplied from the second terminal via the network; . In claim 2,
The authentication server further includes a function of issuing a one-time registration code that is updated at each login to the second terminal. In any of claims 1 to 3,
A function of receiving and registering the network address of the second terminal on the network from the second terminal, and communicating via the network between the first terminal and the second terminal And a communication control server including a function of performing call control to establish a session necessary for the communication. In any of claims 1 to 4,
The system further comprising a gateway server connected to the first terminal via the network and including a function of supplying content related to the first event to the web server. In claim 4,
A system further comprising a gateway server connected to the first terminal via the network and including a function of relaying between the first terminal and the communication control server. In any one of Claims 1 thru | or 6.
The second further comprising a terminal, said second terminal includes the application system. In any one of Claims 1 thru | or 7,
The push type information distribution server includes a function of distributing the push notification to the plurality of second terminals via the network. In claim 8,
The web server includes a function of receiving a signal permitting establishment of communication with the first terminal from any of the plurality of second terminals. In claim 1 ,
The first terminal is an interphone including an unlocking function;
The web server, the second viewing including the function of relaying operations to perform unlocking from the terminal, the session including that perform unlocking system. An application that activates the occurrence of a first event including a call of the intercom in a first terminal having an intercom including a camera function via a network by a push notification, the occurrence of the first event A method comprising displaying on a second terminal including an application including a display function, wherein the displaying includes
The push-type information distribution server is a one-time password related to the occurrence of the first event, and is cleared when a session including communication between the first terminal and the second terminal ends. Delivering push notifications containing,
The one-time web server is automatically supplied from the second terminal in response to the push notification to the address of the web server whose address is known in advance in the second terminal via the network Based on the authentication information of the second terminal including the password, the second event related to the first event including the image acquired by calling the intercom supplied from the first terminal to the second terminal. Delivering one content before the start of the session ;
The application of the second terminal, and displaying the call of the intercom with display of the image, method. In claim 11 ,
Before the display, when an authentication server is supplied with user authentication information related to the first terminal from the second terminal via the network, an ID for push notification to the second terminal is provided. The method further comprising registering. In claim 11 or 12 ,
After the display, the communication control server uses the network address of the second terminal registered from the second terminal by the push notification, between the first terminal and the second terminal. The method further comprising: establishing a session necessary for performing communication via the network. In claim 12 ,
Distributing the push notification includes the push-type information distribution server distributing the push notification to a plurality of the second terminals via the network,
further,
The method, wherein the web server receives a signal permitting establishment of communication with the first terminal from any of the plurality of second terminals. An application implemented in a terminal having a function of connecting to a network,
15. An application, comprising: a terminal on which the application is mounted displaying the occurrence of the first event in the first terminal by the method according to claim 11 . A method for controlling a terminal having a function of connecting to a network,
A control method, comprising: the terminal displaying the occurrence of the first event in the first terminal by the method according to claim 11 .

Images