JP2007041851A - Communication system, its control method, program and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication system capable of establishing communication by video and voice without performing troublesome operation by a user. <P>SOLUTION: A communication server apparatus 11 of the communication system is connected to IP telephone apparatuses 14A to 14E allocated to users 17A to 17E, respectively, network cameras 16A, 16B and terminal apparatuses 15A to 15E via a communication line. The communication server apparatus 11, in response to a telephone call request from a telephone call request source, performs media session establishing processing for permitting transmission and reception of voice data between the IP telephone apparatus of the telephone call request source and the IP telephone apparatus of a telephone call request destination, transmission of video data from the network camera of the telephone call request source to the terminal apparatus of the telephone call request destination, and transmission of video data from the network camera of the telephone call request destination to the terminal apparatus of the telephone call request source. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a communication system that realizes video and audio communication between users via a communication line using a telephone device, a network camera, and a terminal device having a display function assigned to each user, The present invention relates to a control method, a program, and a storage medium.

  In general, a media conference system is a terminal device such as a personal computer of each user connected via a communication line or a server device, respectively, and predetermined information transmitted from each terminal device, such as character information or audio and video. It is a system that performs a conference by sharing media information such as.

For example, there is a video conference system in which a plurality of users can communicate with each other using video and audio using a video phone device. There has been proposed a method for realizing a system in which such a videophone device can be used to confirm each other's video before the other party picks up the phone when making a call (for example, Patent Document 1). See). In this method, a videophone device as a caller transmits a video from the time of calling and receiving, and the video is received and displayed by the videophone device as a partner.
JP 2004-074241 A

  In a conference system that implements video and audio communication using a videophone device, all users participating in the conference need to use the videophone device. However, since the videophone device is expensive, it is very expensive to realize a conference in which a large number of users participate. Therefore, when performing communication by video and audio, it is necessary to prepare a special place such as a video conference room, and it is necessary to determine a time for a conference in advance.

  In addition, in order to perform voice and video communication using a telephone device, a network camera, and a terminal device that displays video from the network camera, the user needs to perform complicated operations on the terminal device.

  An object of the present invention is to provide a communication system, a control method thereof, a program, and a storage medium capable of establishing video and audio communication without a user performing complicated operations.

  In order to achieve the above object, the present invention includes a telephone device, a network camera, and a terminal device having a display function assigned to each user, and communication between users via video and audio via a communication line. A server device connected to the plurality of telephone devices, the plurality of network cameras, and the plurality of terminal devices via the communication line, the server device from a call request source In response to the call request, audio data is transmitted and received between the call request source telephone device and the call request destination telephone device, and video data is transmitted from the call request source network camera to the call request destination terminal device. And transmission of video data from the network camera requesting the call to the terminal device requesting the call Possible to perform a media session establishment process for providing a communication system characterized.

  In order to achieve the above object, the present invention provides a telephone device, a network camera, and a terminal device having a display function assigned to each user, the plurality of telephone devices, the plurality of network cameras, and the plurality of devices. A communication system control method for realizing communication by video and audio between users via a communication line, comprising a server device connected to a terminal device via a communication line, A receiving step for receiving a call request from the call request source, and a call request source telephone device and a call request destination phone according to the call request from the call request source received in the receiving step by the server device Send and receive audio data to and from the device, and from the network camera that is the call request source to the end of the call request destination And a processing step of performing media session establishment processing for enabling transmission of video data to a device and transmission of video data from a network camera of a call request destination to a terminal device of a call requester. A communication system control method is provided.

  In order to achieve the above object, the present invention provides the communication line by the information processing apparatus connected via a communication line to a telephone device, a network camera, and a terminal device having a display function assigned to each user. A program executed to realize video and audio communication between users via a reception module that receives a call request from a call request source, and a call request source received by the reception module In response to the call request, audio data is transmitted and received between the call request source telephone device and the call request destination telephone device, and video data is transmitted from the call request source network camera to the call request destination terminal device. And transmission of video data from the network camera that is the call request destination to the terminal device that is the call request source. It provides a program characterized by having a process module for a media session establishing process for.

  In order to achieve the above object, the present invention provides a storage medium in which the above program is stored so as to be readable by a computer.

  According to the present invention, communication by video and audio can be established without a user performing complicated operations. Further, even if the camera is shared, the user does not need to perform complicated operations.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of a communication system according to an embodiment of the present invention.

  As shown in FIG. 1, the communication system according to the present embodiment includes a plurality of IP telephone terminal devices 14A, 14B, 14D, and 14E, a telephone device 14C, a plurality of network cameras 16A and 16B, a PTZ network camera 18, and a plurality of terminals. It consists of devices 15A-15E. Each IP telephone terminal device 14A, 14B, 14D, 14E, each network camera 16A, 16B, PTZ network camera 18, and each terminal device 15A-15E are comprised by LAN (Local Area Network) and WAN (Wide Area Network). The communication server device 11 is connected via an IP network. The telephone device 14C is connected to the gateway device 13 via a circuit switching network. The gateway device 13 mediates an IP network and a circuit switching network. As a result, the IP telephone devices 14A, 14B, 14D, and 14E and the telephone device 14C can communicate with each other. The PTZ network camera 18 is a network camera having a pan / tilt mechanism and a zoom function.

  Each IP telephone terminal device 14A, 14B, 14D, 14E, each network camera 16A, 16B, PTZ network camera 18, each terminal device 15A-15E, and the communication server device 11 are formulated by the IETF (The Internet Engineering Task Force). A media session in video and audio communication is established using SIP (Session Initiation Protocol, RFC3261).

  Each IP telephone terminal device 14A, 14B, 14D, 14E, telephone device 14C, each network camera 16A, 16B, PTZ network camera 18, and each terminal device 15A-15E are assigned to each user 17A-17E, respectively. . However, the PTZ network camera 18 is a camera shared by the users 17C to 17E.

  Here, since the IP telephone devices 14A, 14B, 14D, and 14E and the telephone device 14C can communicate with each other by the gateway device 14, for the sake of simplicity, the telephone device 14C will be described below as an IP telephone device. This will be explained as one.

  The communication server device 11 is a SIP server and has a SIP proxy server function and a SIP registrar server function. The communication server device 11 manages device information of each of the IP telephone devices 14A to 14E, each of the terminal devices 15A to 15E, each of the network cameras 16A and 16B, and the PTZ network camera 18, and the terminal according to the call status of the IP telephone devices 14A to 14E The video sessions of the devices 15A to 15E, the network cameras 16A and 16B, and the PTZ network camera 18 are controlled. The control by the communication server device 11 will be described later.

  Next, the configuration of the network cameras 16A and 16B and the PTZ network camera 18 will be described with reference to FIG. 2 is a block diagram showing a configuration of the PTZ network camera 18 of FIG. 1, and FIG. 3 is a diagram showing an example of a PTZ setting information storage table stored in the storage unit 402 of FIG. Here, the network cameras 16A and 16B and the PTZ network camera 18 basically have the same configuration. Here, the configuration of the PTZ network camera 18 will be described.

  As shown in FIG. 2, the PTZ network camera 18 includes an imaging unit 401, a storage unit 402, a control unit 403, a reception unit 404, and a transmission unit 405. The imaging unit 401 includes a camera unit capable of panning, tilting, and zooming, and an encoding unit (not shown). The imaging unit 401 performs imaging based on an instruction from the control unit 403, encodes the captured video in a predetermined format, and sends the encoded video data to the control unit 403.

  The control unit 403 refers to the PTZ setting information storage table stored in the storage unit 402 and controls pan, tilt, and zoom operations. In this PTZ setting information storage table, for example, as shown in FIG. 3, setting data related to panning, tilting and zooming corresponding to the imaging direction for imaging each user to which the PTZ network camera 18 is assigned is described. Yes. In addition, a SIP-URI indicating an image captured by the PTZ network camera 18 is described. The setting data regarding the pan, tilt and zoom, and the SIP-URI are written to and read from the storage unit 402 by the control unit 403.

  In the case of the PTZ setting information storage table shown in FIG. 3, the setting data related to pan, tilt, and zoom of the PTZ network camera 18 for imaging the user “UserD (user 17D)” is 10, -10 in the first row. 1 is described. Also, “sip: PTZ-Camera-ConfigD@sipdomain.jp” is described as a SIP-URI for accessing the video of the user “UserD”. The setting data related to pan, tilt, and zoom of the PTZ network camera 18 for imaging the user 17D of “UserD” may be set by the user himself or the administrator.

  The control unit 403 sets processing data related to panning, tilting, and zooming for imaging the user based on an instruction from the user or the administrator, and performs processing for receiving a video session start request from the communication server device 11. Do. Specifically, the control unit 403 controls pan, tilt, and zoom operations of the imaging unit 401 according to the SIP-URI requested from the communication server device 11 and transmits video data sent from the imaging unit 401. Instructs the transmission unit 405. The video session start request from the communication server device 11 will be described later in the processing of the communication server device 11.

  The receiving unit 404 receives setting data related to panning, tilting, and zooming for imaging the user based on an instruction from the user or the administrator, and receives a SIP message that is a video session control signal from the communication server device 11. . The received setting data and SIP message are sent to the control unit 403.

  The transmission unit 405 transmits video data to the designated terminal device and also transmits a SIP message that is a video session control signal.

  Next, the operation of the PTZ network camera 18 will be described with reference to FIG. FIG. 4 is a flowchart showing an operation procedure of the PTZ network camera 18 of FIG. The procedure shown in the flowchart of FIG. 4 is executed by the control unit 403.

  When the power is turned on, the control unit 403 of the PTZ network camera 18 starts operation control of the PTZ network camera 18. As shown in FIG. 4, the control unit 403 first initializes the imaging function and the network function (step S51). Next, the control unit 403 refers to the PTZ setting information storage table stored in the storage unit 402 and registers the contact destination information (SIP-URI) in the communication server device 11 via the transmission unit 405. The SIP REGISTER method is transmitted (step S52). Upon receiving the SIP REGISTER method, the communication server device 11 registers the contact destination information (SIP-URI) and the user name requested to be registered by the SIP REGISTER method. Thereby, the communication server apparatus 11 can uniquely determine the SIP-URI for acquiring the video of the user of the PTZ network camera 18.

  For example, in the case of the PTZ setting information storage table shown in FIG. 3, “sip: PTZ-Camera-ConfigD@sipdomain.jp” is used as the contact destination information (SIP-URI) indicating the video of the user “UserD”, and the user “UserE” is also displayed. “Sip: PTZ-Camera-ConfigE@sipdomain.jp” is registered in the communication server device 11 as the contact information (SIP-URI) indicating the video.

  Next, the control unit 403 determines whether or not setting data related to panning, tilting, and zooming for capturing an image of the user according to an instruction from the user or the administrator is received via the receiving unit 404 (step S53). ). Here, when setting data regarding pan, tilt, and zoom is received, the control unit 403 writes the received setting data in the PTZ setting information storage table of the storage unit 402 and also transmits the setting data via the transmission unit 405. SIP REGISTER method for registering to the communication server device 11 is transmitted to the communication server device 11.

  If it is determined in step S53 that the setting data regarding the pan, tilt, and zoom has not been received, the control unit 403 transmits the PTZ setting information storage table of the storage unit 402 from the communication server device 11 via the receiving unit 404. It is determined whether or not the SIP INVITE method for requesting the start of the video session to the contact information (SIP-URI) described in (1) is received (step S55). Here, when the SIP INVITE method for requesting the start of the video session is received, the control unit 403 starts the video session (step S56). First, setting data related to pan, tilt, and zoom of contact destination information (SIP-URI) required by the SIP INVITE method is acquired from the PTZ setting information storage table of the storage unit 402. The panning, tilting, and zooming operations of the imaging unit 401 are controlled based on the acquired setting data, and the video data captured by the imaging unit 401 is transmitted to the transmission destination included in the SIP INVITE method via the transmission unit 405. Sent. The start of this video session will be described in detail in the description of the communication server device 11.

  If it is determined in step S55 that the SIP INVITE method for requesting the start of the video session has not been received, the control unit 403 transmits the established video session from the communication server device 11 via the reception unit 404. It is determined whether or not the SIP BYE method for ending is received (step S57). When the SIP BYE method for ending the video session is received, the control unit 403 stops the imaging process of the imaging unit 401 and ends transmission of the video data to end the video session.

  If it is determined in step S57 that the SIP BYE method for ending the established video session has not been received, the control unit 403 returns to step S53.

  Next, the configuration of the communication server device 11 will be described with reference to FIGS. 5 and 6. FIG. 5 is a block diagram showing a hardware configuration of the communication server apparatus 11 of FIG. 1, and FIG. 6 is a block diagram showing a functional configuration of the communication server apparatus 11 of FIG.

  The communication server device 11 has the configuration shown in FIG. The CPU 71 performs overall control of the communication server device 11 and control of the communication system while using the RAM 72 as a work area in accordance with a program stored in the ROM 73 or the HDD 74. The HDD 74 stores a program for realizing control in the communication system, and data such as user database information and terminal information necessary for the operation of the program.

  The network I / F 75 performs communication control for connecting to the network 89. Various communication interfaces are applied to the network I / F 75 according to the environment. For example, when connecting directly to the access network, the network I / F 75 is configured by various modems, terminal adapters, and the like. Further, when connecting to an ADSL modem or cable modem of an external device, the network I / F 75 includes an Ethernet interface or the like.

  The input device I / F 76 processes input from an input device such as a keyboard 81, a mouse 82, or a pen input device (not shown) used for operating the communication server device 11. The input device I / F 76 and the input device are optional devices provided as necessary.

  The display I / F 77 controls display on the display 83. The display 83 is composed of, for example, a CRT or a liquid crystal display. On the display 83, for example, the operation status of the media conference server apparatus 12 is displayed. The display I / F 77 and the display 83 are optional devices provided as necessary.

  The imaging device I / F 78 is for inputting a captured image obtained by the imaging device 84. The imaging device 84 is used for imaging the surrounding situation of the communication server device 11. The imaging device I / F 78 and the imaging device 84 are optional devices provided as necessary.

  The external media drive device I / F 79 inputs / outputs data to / from the external media drive device 85. The external media drive device 85 is a device that reads / writes data from / to an external storage medium such as a floppy (registered trademark) disk drive, CD-ROM drive, MO drive, DVD-ROM drive or the like.

  The voice input / output device I / F 80 performs input / output from a voice input device 86 such as a microphone and a voice output device 87 such as a speaker.

  Communication server device 11 accepts requests from IP telephone devices 14A to 14E, terminal devices 15A to 15E, network cameras 16A and B, and PTZ network camera 18 connected to the network, and requests for calls from IP telephone devices 14A to 14E. Accordingly, a video session is started by the terminal devices 15A to 15E, the network cameras 16A and 16B, and the PTZ network camera 18. Thereby, communication by video and audio is realized.

  In the functional configuration of the communication server device 11, as shown in FIG. 6, an information storage unit 801, an information management unit 802, a control unit 803, a reception unit 804, and a transmission unit 805 are provided.

  In the information storage unit 801, device information related to the terminal device such as contact destination information (SIP-URI), user name, device type, registration expiration date, and IP address of the terminal device is written in a readable manner. The device information is written in accordance with a request from the information management unit 802 by a registration request by the SIP REGISTER method from the IP telephone devices 14A to 14E, the terminal devices 15A to 15E, the network cameras 16A and 16B, and the PTZ network camera 18. Executed.

  The information management unit 802 operates and manages the information storage unit 801. Specifically, the information management unit 802 writes device information to the information storage unit 801, deletes device information, or reads device information from the information storage unit 801 in accordance with a request from the control unit 803.

  The control unit 803 accepts registration requests by the SIP REGISTER method from the IP telephone devices 14A to 14E, the terminal devices 15A to 15E, the network cameras 16A and 16B, and the PTZ network camera 18 connected to the network. Saving is instructed to the information management unit 802. The control unit 803 controls the video sessions of the terminal devices 15A to 15E, the network cameras 16A and 16B, and the PTZ network camera 18 in response to a call request by the SIP INVITE method from the IP telephone devices 14A to 14E. Details of the control by the communication server device 11 will be described later.

  The reception unit 804 receives SIP messages from the IP telephone devices 14A to 14E, the terminal devices 15A to 15E, the network cameras 16A and 16B, and the PTZ network camera 18 connected to the network, and the control unit 803 receives the received SIP messages. Send to.

  The transmission unit 805 transmits the SIP message to the designated terminal device in accordance with the transmission command from the control unit 803.

  Next, connection control by the communication server device 11 will be described with reference to FIG. FIG. 7 is a flowchart showing a connection control procedure by the communication server apparatus 11 of FIG. The procedure shown in the flowchart of FIG. 7 is executed by the control unit 803 (CPU 71) of the communication server device 11.

  The communication server device 11 activates a server process and starts control in the communication system. Then, the control unit 803 first performs an initialization process. Then, reception monitoring of the SIP message reception unit 804 from the IP telephone devices 14A to 14E, the terminal devices 15A to 15E, the network cameras 16A and 16B, and the PTZ network camera 18 is started (step S91). Here, upon receiving SIP messages from IP telephone devices 14A to 14E, terminal devices 15A to 15E, network cameras 16A and 16B, and PTZ network camera 18, receiving unit 804 sends the received SIP message to control unit 803. .

  Next, the control unit 803 determines whether or not the SIP message received by the receiving unit 804 is a SIP REGISTER method meaning a registration request (step S92). Here, if the received SIP message is a SIP REGISTER method meaning a registration request, the control unit 803 has contact information (SIP-URI) of each terminal device, a user name, a device type, and an expiration date of registration. The information management unit 802 is instructed to register the device information related to the terminal device, such as the IP address of the terminal device, in the information storage unit 801 (step S93). Details of the registration request and processing for the registration request will be described later. Then, the control unit 803 returns to step S92.

  When it is determined that the SIP message received in step S92 is not a SIP REGISTER method indicating a registration request, the control unit 803 transmits a session start request in which the received SIP message is transmitted from the IP telephone devices 14A to 14E. It is determined whether or not the SIP INVITE method means (step S94). Here, if the received SIP message is a SIP INVITE method indicating a session start request transmitted from the IP telephone devices 14A to 14E, the IP telephone device of the call destination is stored in the information storage table of the information storage unit 801. It is confirmed whether it is registered (step S95). If the call destination IP telephone apparatus is not registered in the information storage table of the information storage unit 801, the control unit 803 returns “404 Not Found” as the response to the requested SIP INVITE method. Return to the phone. As a result, the session start request ends with an error, and the control unit 803 returns to step S92.

  When it is determined in step S95 that the call destination IP telephone apparatus is registered in the information storage table of the information storage unit 801, the control unit 803 changes the SIP INVITE method indicating the transmitted session start request. This is transmitted to the IP telephone device of the call destination (step S96). Details of the SIP call flow regarding the session start request from the IP telephone apparatus will be described later.

  Next, the control unit 803 determines whether or not the call source network camera is registered in the information storage table (step S97). Here, if the calling network camera is not registered in the information storage table, the control unit 803 proceeds to step S100 described later, and if the calling network camera is registered in the information storage table. Then, it is determined whether or not the call destination terminal device is registered (step S98). If the call destination terminal device is not registered, the control unit 803 proceeds to step S100 described later. If the call destination terminal device is registered, the control unit 803 calls the call destination from the call source network camera. An INVITE method for requesting the start of a session for transmitting video to the terminal device is transmitted to the network camera that is the calling source (step S99).

  Next, the control unit 803 determines whether or not the call destination network camera is registered in the information storage table (step S100). If the call destination network camera is not registered in the information storage table, the control unit 803 proceeds to step S103 to be described later, and if the call destination network camera is registered in the information storage table. Then, it is determined whether or not the caller terminal device is registered (step S101). If the call source terminal device is not registered, the control unit 803 proceeds to step S103 to be described later. If the call source terminal device is registered, the control unit 803 transmits the call source from the call destination network camera. An INVITE method for requesting the start of a session for transmitting video to the terminal device is transmitted to the caller network (step S102).

  When it is determined that the SIP message received in step S94 is not an SIP INVITE method that means a session start request transmitted from the IP telephone devices 14A to 14E, the control unit 803 determines that the received SIP message is an IP telephone. It is determined whether or not the SIP BYE method means a session end request transmitted from the devices 14A to 14E (step S103). If the received SIP message is the BYE method, the control unit 803 performs a session end process and returns to step S92. On the other hand, if the received SIP message is not the BYE method, the control unit 803 returns to step S92.

  Next, the registration process in step S93 will be described with reference to FIGS. FIG. 8 is a sequence diagram showing a procedure for making a registration request from the IP telephone device 14A, FIG. 9 is a diagram showing an example of a SIP REGISTER method meaning a registration request from the IP telephone device 14A, and FIG. It is a figure which shows an example of the information storage table currently hold | maintained at the information storage part 801.

  When the IP telephone device 14A makes a registration request to the communication server device 11, as shown in FIG. 8, the IP telephone device 14A makes an SIP REGISTER method meaning a registration request to the communication server device 11. Transmit (S1001). Here, the SIP REGISTER method, which means a registration request, includes apparatus information as shown in FIG. Upon receiving the SIP REGISTER method from IP telephone apparatus 14A, communication server apparatus 11 returns “OK 200” to IP telephone apparatus 14A as a response to the REGISTER method (step S1002). Then, as shown in FIG. 10, "sip: UserA-Phone@sipdomain.jp" as contact information (SIP-URI) of the IP telephone device 14A, user name, device type, registration expiration date, terminal device Each information of the IP address is written in the information storage table of the information storage unit 801 as device information.

  In the case of registration requests from the terminal devices 15A to 15E, the network cameras 16A and 16B, and the PTZ network camera 18, the device information is similarly registered.

  Next, a procedure until a call is established between IP telephone apparatus 14A and IP telephone apparatus 14D by call control of communication server apparatus 11 will be described with reference to FIGS. FIG. 11 is a sequence diagram showing a procedure until a call is established between IP telephone apparatus 14A and IP telephone apparatus 14D by call control of communication server apparatus 11, and FIG. 12 is a diagram showing contents of SDP Offer and SDP Answer of FIG. It is.

  When the IP telephone apparatus 14A calls the IP telephone apparatus 14D, as shown in FIG. 11, the IP telephone apparatus 14A transmits a SIP INVITE method to the communication server apparatus 11 as a call request to the IP telephone apparatus 14D ( S1301). This INVITE method includes SDP (Session Description Protocol), which is information necessary for establishing a session, such as the IP address of the IP telephone device 14A, the port number used for the call, and the usable codec. This SDP is an SDPOffer as shown in FIG.

  The communication server device 11 that has received the INVITE method (S1301) from the IP telephone device 14A recognizes that the received INVITE method is a call to the IP telephone device 14D. Then, the communication server device 11 transmits the INVITE method, which is a call request, to the IP telephone device 14D (S1302), and sends a provisional response indicating that the call request is being processed to the IP phone device that is the caller. Return to 14A (S1303). This provisional response is a response to the INVITE method (S1301), and its response code is 100.

  The IP telephone device 14D that has received the INVITE method from the communication server device 11 emits a ringing tone and returns a provisional response indicating that the call request is being processed (calling) to the communication server device 11 (S1304). This provisional response is a response to the INVITE method (S1302), and its response code is 180.

  The communication server device 11 that has received the provisional response (S1304) recognizes that this provisional response is a response to the call from the IP telephone device 14A, and returns a provisional response that is a call response to the IP phone device 14A ( S1305).

  When the user picks up the handset of IP telephone apparatus 14D that is ringing, IP telephone apparatus 14D transmits a success response indicating that the call request has been understood and accepted to communication server apparatus 11 (S1306). This success response is a response to the INVITE method (S1302), and the response code is 200. This successful response includes SDP, which is information necessary for establishing a session, such as the IP address of IP telephone device 14D, the port number used for the call, and the usable codec. This SDP is an SDP Answer as shown in FIG.

  Receiving the success response (S1306), the communication server device 11 recognizes that this success response is a response to the call from the IP telephone device 14A, and transmits the success response as the call response to the IP phone device 14A. (S1307).

  The IP telephone apparatus 14A that has received the success response (S1307) confirms that the call request to the IP telephone apparatus 14D has been accepted, and sends an ACK method to the communication server apparatus 11 indicating that the response to the call request has been received. Transmit (S1308). Upon receiving this ACK method, the communication server device 11 recognizes that the received ACK method is a response confirmation to the IP telephone device 14D, and transmits this ACK method to the IP telephone device 14D (S1309).

  With the above processing, a voice session is established. Then, media data (voice data in this example) is transmitted and received between the IP telephone device 14A and the IP telephone device 14D by RTP (Real-time Transport Protocol), and a voice call is performed between the two.

  When the handset is placed in IP telephone apparatus 14D, IP telephone apparatus 14D transmits a BYE method, which is a call termination request, to communication server apparatus 11 (S1310).

  The communication server device 11 that has received the BYE method (S1310) recognizes that this BYE method is a call termination request to the IP telephone device 14A, and transmits the BYE method that is the call termination request to the IP phone device 14A. (S1311).

  The IP telephone device 14A that has received the call termination request (S1311) understands the call termination request and transmits a success response indicating that the call termination has been accepted to the communication server device 11 (S1312). This success response is a response to the BYE method (S1311), and its response code is 200.

  Receiving the success response (S1312), the communication server device 11 recognizes that the success response is a response to the call termination request from the IP telephone device 14D, and transmits this success response to the IP telephone device 14D (S1313). ). This ends the media session.

  Here, an example has been described in which the user 17A operates the IP telephone device 14A to request a call to the IP telephone device 14D. However, as shown in FIG. 13, the IP telephone device 14A and the IP telephone device are instructed by an instruction from the terminal device 15A. It is also possible to make a call with the device 14D. In this case, a user list is displayed like an instant messenger on the display unit of the terminal device 15A of the user 17A, and a desired user, that is, the user 17A is selected from the user list.

  A procedure when the IP telephone apparatus 14A and the IP telephone apparatus 14D make a call according to the instruction from the terminal apparatus 15A will be described with reference to FIG. FIG. 13 is a sequence diagram showing a procedure when the IP telephone device 14A and the IP telephone device 14D make a telephone call according to an instruction from the terminal device 15A. Here, in order to simplify the explanation and clarify the processing, in FIG. 13, the communication server device 11 that relays the SIP message is omitted, and some provisional responses are omitted.

  The terminal apparatus 15A transmits the SIP INVITE method to the IP telephone apparatus 14D as a call request to the IP telephone apparatus 14D (S1501). Here, this INVITE method does not include an SDP describing a session.

  Upon receiving the INVITE method (S1501), the communication server apparatus 11 recognizes that the INVITE method is a call to the IP telephone apparatus 14D, and transmits the INVITE method as a call request to the IP telephone apparatus 14D. Then, a provisional response indicating that the call request is being processed is returned to the terminal device 15A that is the calling source (S1502). This provisional response is a response to the INVITE method, and its response code is 100.

  The IP telephone apparatus 14D that has received the INVITE method (S1501) sounds a ringing tone and sends a temporary response indicating that the call request is being processed (calling) via the communication server apparatus 11 to the terminal apparatus 15A. (S1503). This provisional response is a response to the INVITE method (S1501), and its response code is 180.

  When the handset of IP telephone apparatus 14D that is ringing is picked up, IP telephone apparatus 14D transmits a success response indicating that the call request is understood and accepted to terminal apparatus 15A via communication server apparatus 11. (S1504). This success response is a response to the INVITE (S1501) method, and its response code is 200. This success response (S1504) includes SDP, which is information necessary for establishing a session, such as the IP address of IP telephone device 14D, the port number used for the call, and the codec that can be used. This SDP is an SDPOffer as shown in FIG.

  Upon receiving the success response (S1504), the terminal device 15A immediately transmits the SIP INVITE method, which means a call request, to the IP telephone device 14A of the user 17A via the communication server device 11 (S1505). The SIP INVITE method includes the SDPOffer included in the success response in the message body. That is, this INVITE method includes SDP, which is information necessary for establishing a session, such as the IP address of IP telephone device 14D, the port number used for the call, and the codec that can be used.

  The communication server device 11 that has received the INVITE method (S1505) recognizes that this INVITE method is a call to the IP telephone device 14A. Then, the communication server apparatus 11 transmits the INVITE method, which is a call request, to the IP telephone apparatus 14A (S1505), and sends a provisional response indicating that the call request is being processed to the terminal apparatus 15A that is the caller. (S1506). This provisional response is a response to the INVITE method (S1505), and its response code is 100.

  The IP telephone device 14A that has received the INVITE method (S1505), which is a call request, emits a ringing tone and sends a temporary response indicating that the call request is being processed (calling) via the communication server device 11. To the terminal device 15A (S1507). This provisional response is a response to the INVITE method (S1505), and its response code is 180.

  When the handset of IP telephone apparatus 14A that is ringing is picked up, IP telephone apparatus 14A transmits a success response indicating that the call request has been understood and accepted to terminal apparatus 15A via communication server apparatus 11. (S1508). This success response is a response to the INVITE method (S1505), and the response code is 200. This successful response includes SDP, which is information necessary for establishing a session, such as the IP address of IP telephone device 14A, the port number used for the call, and the codec that can be used. This SDP is an SDP Answer as shown in FIG.

  The terminal device 15A that has received the success response (S1508) confirms that the call request to the IP telephone device 14A has been accepted, and transmits an ACK method indicating that the response to the call request has been received to the IP phone device 14D. (S1509). This ACK method is a response confirmation to the success response (S1508), and establishes a session such as the IP address of the IP telephone device 14A received by the success response (S1508), the port number used for the call, and the usable codec. SDP, which is information necessary for the operation, is included. Thereby, information necessary for establishing a voice session with IP telephone apparatus 14A can be transmitted to IP telephone apparatus 14D.

  Similarly, the terminal device 15A transmits an ACK method, which is a response confirmation to the success response (S1508), to the IP telephone device 14A (S1510).

  A voice session is established by the above processing. Then, voice data is transmitted and received between the IP telephone apparatus 14A and the IP telephone apparatus 14D by RTP (Real-time Transport Protocol), and a voice call is performed.

  Thereafter, in order to end the voice session between the IP telephone device 14A and the IP telephone device 14D, the BYE method, which is a call termination request, is transmitted from the IP telephone device 14A to the terminal device 15A via the communication server device 11. Then, the voice call is finished (S1511 to S1514).

  Next, specific examples of the processing in steps S97 to S99 and steps S100 to 102 in FIG. 7 will be described with reference to FIGS. FIG. 14 shows a procedure for establishing a session for transmitting video from the network camera 16A of “User A (user 17A)” to the terminal device 15D of “User D (user 17D)” under the control of the control unit 803 of the communication server device 11. FIG. FIG. 15 shows the contents of SDPOffer and SDPAnswer in FIG. FIG. 16 is a sequence diagram illustrating a control procedure performed by the control unit 803 in order to transmit a video from the “UserD” PTZ network camera 18 to the “UserA” terminal device 15A. FIG. 17 is a diagram schematically showing a state where communication is established between the user 17A and the user 17D.

  First, a specific example of the processing in steps S97 to S99 in FIG. 7 will be described.

  For example, it is assumed that the SIP INVITE method meaning a session start request is transmitted from IP telephone apparatus 14A to IP telephone apparatus 14D. Then, the caller is the IP telephone device 14A whose contact destination information (SIP-URI) is “sip: UserA-Phone@sipdomain.jp”, and the device information storage table (shown in FIG. 10) of the information storage unit 801. ) Is identified as “User A (user 17A)”. Then, the network camera 16A whose contact destination information (SIP-URI) is “sip: UserA-Camera@sipdomain.jp” is searched from the device information storage table as the network camera of “UserA” (step S97).

  The IP telephone device 14D as the call destination has contact information (SIP-URI) of “sip: UserD-Phone@sipdomain.jp”, and the user of the IP telephone device 14D reads “UserD from the device information storage table. (User 17D) ”. Then, the terminal device 15D whose contact destination information (SIP-URI) is “sip: UserD-Display@sipdomain.jp” is retrieved from the device information storage table as the terminal device of the calling destination “UserD” ( Step S98).

  In this manner, the network camera “sip: UserA-Camera@sipdomain.jp” of “UserA” and the terminal device “sip: UserD-Display@sipdomain.jp” of “UserD” are identified. The control unit 803 establishes a session for transmitting a video from the “UserA” network camera “sip: UserA-Camera@sipdomain.jp” to the “UserD” terminal device “sip: UserD-Display@sipdomain.jp”. Is performed (step S99).

  In step S99, processing is performed according to the sequence shown in FIG. Here, in FIG. 14, provisional responses are omitted for the sake of simplicity of explanation and clarification of processing.

  As shown in FIG. 14, the communication server device 11 transmits a SIP INVITE method to the terminal device 15D as a call request to the terminal device 15D. Here, the SDP describing the session is not included in this INVITE method (S2001).

  Receiving the INVITE method (S2001), the terminal device 15D emits a ringing tone and returns a provisional response indicating that the call request is being processed (calling) to the communication server device 11 (S2002). This provisional response is a response to the INVITE method, and its response code is 180. At this time, the terminal device 15D may actually notify the incoming call by sounding a ringing tone and may ask the user to select whether or not to accept the call request. You may make it accept.

  When the terminal device 15D accepts the call request, the terminal device 15D transmits a success response indicating that the call request is understood and accepted to the communication server device 11 (S2003). This success response is a response to the INVITE method (S2001), and the response code is 200. This successful response includes SDP, which is information necessary for establishing a session, such as the IP address of the terminal device 15D, the port number for receiving video, and the usable codec. This SDP is an SDPOffer as shown in FIG.

  Here, since the terminal device 15D only receives video, the SDPOffer describes “a = recvonly” indicating only video reception. The video formats that can be processed are JPEG, MPEG4, H.264, and so on. H.264 is described.

  When the communication server apparatus 11 receives the success response (S2003), the communication server apparatus 11 changes the SIP INVITE method, which means a call request, to “UserA-Camera@sipdomain.jp” whose contact information (SIP: URI) is “sip: UserA-Camera@sipdomain.jp”. Is transmitted to the network camera 16A (S2004). The message body of this INVITE method includes the SDPOffer included in the success response. Thereby, information necessary for establishing a video session with the terminal device 15D can be transmitted to the network camera 16A.

  The network camera 16A that has received the call request INVITE method (S2004) returns a provisional response indicating that the call request is being processed (calling) to the communication server device 11 (S2005). This provisional response is a response to the INVITE method, and its response code is 180.

  When the network camera 16A accepts the call request, the network camera 16A transmits a success response indicating that the call request is understood and accepted to the communication server apparatus 11 (S2006). This success response is a response to the INVITE method (S2004), and its response code is 200. This success response includes SDP, which is information necessary for establishing a session, such as the IP address of the network camera 16A, the port number to be used, and the codec that can be used. This SDP is an SDP Answer as shown in FIG.

  The communication server device 11 that has received the success response confirms that the call request to the network camera 16A has been accepted, and transmits an ACK method indicating that the response to the call request has been received to the terminal device 15D (S2007). This ACK method is a response confirmation with respect to the success response, and the success response includes information necessary for establishing a session, such as the IP address of the received network camera 16A, the port number to be used, and the codec that can be used. A certain SDP is included. Thereby, information necessary for establishing a video session with the network camera 16A can be transmitted to the terminal device 15D.

  Similarly, the communication server device 11 transmits an ACK method, which is a response confirmation to the success response (S2006), to the network camera 16A (S2008).

  Through the above processing, a one-way video session is established, and the network camera 16A of “UserA” whose contact destination information (SIP-URI) is “sip: UserA-Camera@sipdomain.jp” is connected to the contact destination information (SIP The video data is transmitted by RTP (Real-time Transport Protocol) to the terminal device 15D of “UserD” whose “URI” is “sip: UserD-Display@sipdomain.jp”.

  Next, a specific example of the processing in steps S100 to S102 in FIG. 7 will be described.

  For example, when the SIP INVITE method indicating a session start request is transmitted from the IP telephone apparatus 14A to the IP telephone apparatus 14D, the IP telephone apparatus 14D that is the call destination is stored in the apparatus information storage table (shown in FIG. 10). The contact information (SIP-URI) is “sip: UserD-Phone@sipdomain.jp”, and the user is identified as “UserD (user 17D)”. Then, the PTZ network camera 18 whose contact destination information (SIP-URI) is “sip: PTZ-Camera-ConfigD@sipdomain.jp” is searched from the device information storage table as the “UserD” network camera (Step S1). S100).

  Next, the contact destination information (SIP-URI) of the caller IP telephone device 14A is “sip: UserA-Phone@sipdomain.jp”, and the user is identified as “UserA”. Then, the terminal device 15A whose contact destination information (SIP-URI) is “sip: UserA-Display@sipdomain.jp” is searched from the device information storage table as the terminal device of “UserA” (step S101).

  In this way, since the “UserD” PTZ network camera 18 and the “UserA” terminal device 15A are identified, the control unit 803 transfers the video from the “UserD” PTZ network camera 18 to the “UserA” terminal device 15A. Is performed to establish a session for transmitting (step S102).

  In step S102, processing is performed according to the sequence shown in FIG. Here, the procedure shown in FIG. 16 is the same as the procedure shown in FIG. Therefore, the description is omitted here. However, since the “UserD” PTZ network camera 18 is a network camera having pan, tilt, and zoom functions, if the SIP INVITE method is received and the call request is accepted in S2204 of FIG. Setting information related to pan, tilt, and zoom is acquired, and pan, tilt, and zoom operations of the imaging unit 401 are controlled based on the acquired setting information.

  As a result of the control by the control unit 803, as shown in FIG. 17, a media session is performed by voice between the IP telephone devices 14A and 14D, and the video of the network camera 16A capturing the user 17A is transmitted to the terminal device 15D. A session is performed, and a media session is also performed in which an image of the PTZ network camera 18 that images the user 17D is sent to the terminal device 15A. As a result, communication by video and audio is performed between the user 17A and the user 17D.

  In addition, when the user 17E is absent, when a call is made from the IP telephone device 14A of the user 17A to the IP telephone device 14E of the user 17E, the user 17E does not take the IP telephone device 14E under the control of the communication server device 11. However, since the video of the seat of the user 17E captured by the PTZ network camera 18 is displayed on the terminal device 15A of the user 17A, the user 17A understands that the user 17E cannot answer the call because the user 17E is out of the seat. can do.

  Thereafter, the control unit 803 performs a session end process to end the video and audio communication between the user 17A and the user 17D (step S104 in FIG. 7). Here, control unit 803 terminates the voice session with IP telephone apparatus 14A and IP telephone apparatus 14D (S1310 to S1313 in FIG. 11 or S1511 to S1514 in FIG. 13). Further, the control unit 803 ends the video session from the network camera 16A of the user 17A to the terminal device 15D of the user 17D (S2009 to S2012 in FIG. 14), and similarly, from the PTZ network camera 18 of the user 17D to the terminal of the user 17A. The video session to the device 15A is terminated (S2209 to S2212 in FIG. 16).

  In this embodiment, different contact destinations (SIP-URI) are used for IP telephone devices, network cameras, and terminal devices used by the same user. The same contact (SIP-URI) may be used for each.

  In addition, for the same PTZ network camera 18, different contact destinations (SIP-URI) are set for each user who takes an image, but the same contact destination (SIP-URI) is used and Pan, tilt, and zoom setting information may be described in SIP in the header or message body of the SIP message, or may be described in XML format.

  As described above, according to the present embodiment, in a communication system that performs communication using an IP telephone device, a network camera, and a terminal device, the network camera device and the terminal device are automatically used by the communication server device in response to a call request from the IP telephone device. By establishing a media session for transmitting and receiving video media information to and from the user, it is possible to establish video and audio communication without a complicated operation by the user.

  In the present embodiment, the case where the communication network is a LAN and SIP is used for call control has been described. However, instead of this, a circuit switching network may be used and other than SIP may be used for call control. Is possible.

  In addition, an object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the embodiments to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus as a storage medium. This can also be achieved by reading and executing the stored program code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the program code and the storage medium storing the program code constitute the present invention.

  Examples of the storage medium for supplying the program code include a floppy (registered trademark) disk, a hard disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a DVD-ROM, a DVD-RAM, and a DVD. -RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM, etc. can be used. Alternatively, the program code may be downloaded via a network.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code. A case where part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

  Further, after the program code read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. This includes the case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

It is a block diagram which shows the structure of the communication system which concerns on one embodiment of this invention. It is a block diagram which shows the structure of the PTZ network camera 18 of FIG. FIG. 3 is a diagram illustrating an example of a PTZ setting information storage table stored in a storage unit 402 in FIG. 2. It is a flowchart which shows the procedure of operation | movement of the PTZ network camera 18 of FIG. It is a block diagram which shows the hardware constitutions of the communication server apparatus 11 of FIG. It is a block diagram which shows the function structure of the communication server apparatus 11 of FIG. It is a flowchart which shows the procedure of the connection control by the communication server apparatus 11 of FIG. It is a sequence diagram showing a procedure when a registration request is made from IP telephone apparatus 14A. It is a figure which shows an example of the REGISTER method of SIP which means the registration request | requirement from IP telephone apparatus 14A. It is a figure which shows an example of the information storage table hold | maintained at the information storage part 801 of the communication server apparatus 11. FIG. 7 is a sequence diagram showing a procedure until a call is established between IP telephone apparatus 14A and IP telephone apparatus 14D by call control of communication server apparatus 11. FIG. It is a figure which shows the content of SDPOffer and SDPAnswer of FIG. FIG. 11 is a sequence diagram showing a procedure when IP telephone apparatus 14A and IP telephone apparatus 14D make a telephone call according to an instruction from terminal apparatus 15A. A sequence showing a procedure for establishing a session for transmitting a video from the network camera 16A of “User A (user 17A)” to the terminal device 15D of “User D (user 17D)” under the control of the control unit 803 of the communication server device 11. FIG. It is a figure which shows the content of SDPOffer and SDPAnswer of FIG. FIG. 10 is a sequence diagram illustrating a control procedure performed by a control unit 803 in order to transmit a video from a “UserD” PTZ network camera 18 to a “UserA” terminal device 15A. It is a figure showing typically the state where communication was established between user 17A and user 17D.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Communication server apparatus 13 Gateway apparatus 14A, 14B, 14D, 14E IP telephone apparatus 14C Telephone apparatus 15A-15E Terminal apparatus 16A, 16B Network camera 17A-17E User 18 PTZ network camera 71 CPU
72 ROM
73 RAM

Claims (9)

A communication system including a telephone device, a network camera, and a terminal device having a display function respectively assigned to each user, and realizing video and audio communication between users via a communication line,
A server device connected to the plurality of telephone devices, the plurality of network cameras, and the plurality of terminal devices via the communication line;
In response to a call request from the call request source, the server device transmits and receives voice data between the call request source telephone device and the call request destination telephone device, and transmits the call request destination from the call request source network camera. System for performing media session establishment processing for enabling transmission of video data to a terminal device of a mobile phone and transmission of video data from a network camera of a call request destination to a terminal device of a caller request source .   The communication system according to claim 1, wherein the call request from the call request source is a request issued by a telephone device or a terminal device of the call request source.   The server device has registration means for registering device information related to the plurality of telephone devices, the plurality of network cameras, and the plurality of terminal devices for each user, and refers to the device information registered in the registration device. The communication system according to claim 1, wherein a media session establishment process is performed in response to a call request from the call request source.   The communication system according to claim 1, wherein the registration unit registers device information transmitted from the plurality of telephone devices, the plurality of network cameras, and the plurality of terminal devices.   4. The communication system according to claim 3, wherein the device information includes an address, a user, and a device type for each of the telephone device, the network camera, and the terminal device. The device information includes shooting condition setting information for setting shooting conditions of the network camera,
The communication system according to claim 5, wherein the server device sets shooting conditions of a corresponding network camera with reference to shooting condition setting information included in the device information. A telephone device, a network camera, and a terminal device having a display function assigned to each user are connected to the plurality of telephone devices, the plurality of network cameras, and the plurality of terminal devices via a communication line. A communication system control method for realizing communication by video and audio between users via the communication line, comprising a server device,
A receiving step of receiving a call request from a call request source by the server device;
In response to the call request from the call request source received in the reception step, the server device transmits and receives voice data between the call request source telephone device and the call request destination telephone device, and the call request source Performs media session establishment processing to enable transmission of video data from the network camera to the terminal device requesting the caller and transmission of video data from the network camera requesting the call to the terminal device requesting the caller A communication system control method comprising: a processing step. By video and audio between users via the communication line by an information processing apparatus connected via a communication line to a telephone device, a network camera and a terminal device having a display function assigned to each user A program executed to realize communication,
A receiving module for receiving a call request from a call request source;
In response to a call request from the call request source received by the receiving module, voice data is transmitted and received between the call request source telephone device and the call request destination telephone device, and the call request source network camera receives a call from the call request source network camera. A processing module for performing media session establishment processing for enabling transmission of video data to a request destination terminal device and transmission of video data from a call request destination network camera to a call request source terminal device A program characterized by that.   A storage medium storing the program according to claim 8 in a computer-readable manner.

Images