WO2012022266A1

WO2012022266A1 - Method and system for voice intercom in video surveillance

Info

Publication number: WO2012022266A1
Application number: PCT/CN2011/078608
Authority: WO
Inventors: 叶小阳; 陈洁
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-08-20
Filing date: 2011-08-18
Publication date: 2012-02-23
Also published as: CN102377760B; CN102377760A

Abstract

Disclosed is a method for voice intercom in video surveillance. The method mainly comprises: in an IMS-based video surveillance system, a CU and a PU respectively establishing a media channel with an AS via a Core lMS; when conducting a voice intercom, by means of the media channel established respectively between the CU and the AS and between the PU and the AS, exchanging between the CU and the PU voice media data. Also disclosed is a system for voice intercom in video surveillance. In the present invention, the voice intercom function is implemented in the IMS-based video surveillance system, and the voice intercom is achieved in a Core IMS signaling transfer mode, without requiring the addition of any additional device to a video surveillance system, security control is therefore convenient. As the Core IMS is deployed on a public network, the issue of private network tranversing is effectively overcome, and the promotion of application is easy.

Description

Method and system for realizing voice intercom in video surveillance

The present invention relates to video surveillance technology in mobile communication, and in particular to a method and system for implementing voice intercom in video surveillance. Background technique

In recent years, with the rapid development of computers, networks, and image processing and transmission technologies, video surveillance technology has also made considerable progress. A new generation of video surveillance systems enables media transmission over the network for remote video surveillance. No matter where you are, you can use the client to log on to the Internet, such as a computer, and connect to the network video surveillance system to obtain images and sounds. Video surveillance is widely used in many places, such as banks, schools, hospitals, residential areas and road traffic, because of its intuitive and convenient information.

On the other hand, the current development of all-IP has accelerated the convergence of telecommunications and the Internet. End-to-end IP is the trend of network development. IP Multimedia Subsystem (IMS, IP Multimedia Subsystem) has been proposed. IMS has the following characteristics: Independence, it is theoretically possible to use the home service regardless of the device used by the user and where to access the IMS network. The unified service trigger mechanism, the IMS core control part does not implement specific services, all services include traditional The conceptual supplementary service is implemented by the business application platform; the unified routing mechanism, and the user-related data information is only stored in the user's home place, and all the services related to the user must also pass through the user's attribution; the unified user database, It shields the difference between the fixed and mobile users in the service attributes; fully considers the actual operation requirements of the operators, and has established relevant specifications in terms of network framework, QoS, security, billing, and interworking with other networks. The technical features and advantages of IMS unified access control, convergence of various multimedia services, and multimedia service quality reliability are being recognized by telecom operators. Currently, telecom operators are stepping up deployment of IMS core networks, and gradually Various services are migrated to the IMS core network.

IMS is defined by the 3GPP, 3rd Generation Partnership Project (3GPP), and is a general term for the network core layer logical functional entities that control IP multimedia services. The IMS uses the IP packet domain as its control signaling and media transmission bearer channel, and uses the Session Initiation Protocol (SIP) as the call control signaling to implement the separation of service management, session control and bearer access. Its advantages in network convergence are receiving increasing attention.

IMS supports fixed network access and mobile network access at the same time, making network convergence possible. IMS-based video surveillance services can meet the requirements of video surveillance service operations in terms of unified access authentication and security, not just isolated private networks. The demand, while the current IMS video surveillance, has not yet achieved the voice intercom function. Summary of the invention

In view of this, under the network architecture of the IMS, the main purpose of the present invention is to provide a method and system for implementing voice intercom in video surveillance, which can implement a voice intercom function based on IMS video surveillance.

In order to achieve the above object, the technical solution of the present invention is achieved as follows:

The present invention provides a method for implementing voice intercom in video surveillance, the method comprising: monitoring a client terminal system (CU) and a monitoring front end subsystem (PU), respectively, through an IP Multimedia Subsystem Core Unit (Core IMS), Establishing a media channel with the application server subsystem (AS); when performing voice intercom, the voice media data is exchanged between the CU and the PU through the established media channel between the CU and the AS, and between the PU and the AS.

In the above solution, the CU and the PU respectively establish a media channel between the Core IMS and the AS, and the CU sends a voice intercom request to the AS through the Core IMS; the AS sends the CU through the Core IMS. The voice intercom request is forwarded to the PU; the PU receives the voice intercom request, returns a voice intercom response to the AS through the Core IMS, and the AS passes The core IMS forwards the voice intercom response to the CU; the CU receives the voice intercom response, sends a voice intercom confirmation to the AS through the Core IMS, and establishes a media channel between itself and the AS; the AS passes the Core The IMS forwards the voice intercom confirmation to the PU, and establishes a media channel between itself and the PU.

In the above solution, the voice intercom of the CU forwarded to the AS confirms that the information of the media channel between the CU and the AS is carried; the voice intercom forwarded by the AS to the PU confirms that the information of the media channel between the AS and the PU is carried. .

In the foregoing solution, after the AS receives the voice intercom request sent by the CU, and forwards the voice intercom request to the PU through the Core IMS, the method further includes: the AS receiving the After the voice intercom request sent by the CU is performed, the service authentication and the rights check are performed, the service authentication and the verification are successful, and the voice intercom request is forwarded to the PU through the Core IMS.

In the above solution, the AS performs the service authentication and the privilege check, the method includes: the AS querying the user registration information corresponding to the CU according to the voice intercom request, and determining whether the user registration information is queried according to the queried user registration information. The voice intercom request can be forwarded to the PU; and/or, the AS determines, according to the current working state of the PU, whether the voice intercom request can be forwarded to the PU; if yes, the AS Forwarding the voice intercom request to the PU; otherwise, the AS returns information that the voice intercom request fails to the CU, and does not forward the voice intercom request.

In the foregoing solution, the voice media data is exchanged between the CU and the PU, and the media between the CU and the PU is used by the CU and the AS. Channel, sending the voice media data of the client to the AS, and the AS forwards the voice media data of the client to the PU through a media channel between the UE and the PU; and/or, the PU passes the media channel between the UE and the AS Sending the voice media data of the monitoring terminal to the AS, and the AS forwards the voice media data of the monitoring terminal to the CU through the media channel between itself and the CU. In the above solution, the method further includes: when the voice intercom needs to be stopped, the CU disconnects the media channel between itself and the AS, and sends a stop voice intercom request to the AS through the Core IMS, and the AS passes the Core IMS. Transmitting the stop voice intercom request to the PU; after receiving the stop voice intercom request, the PU disconnects the media channel between itself and the AS, and forwards the voice intercom response to the AS through the Core IMS forwarding; The AS then forwards the stop voice intercom response to the CU through the Core IMS, and the voice intercom stops.

In the above solution, the stop voice intercom request is a request disconnection message, and the stop speech intercom response is a disconnection response message.

The present invention also provides a system for implementing voice intercom in video surveillance, the system comprising: an establishing unit and a transmitting unit, wherein the establishing unit is configured to establish a relationship between the CU and the AS, and the PU and the AS through the Core IMS a media channel between the CU and the PU, and a transmission unit, configured to perform a voice intercom, a media channel between the CU and the AS established by the establishing unit, and between the PU and the AS, and transmitting a voice between the CU and the PU Media data.

In the above solution, the system further includes: a disconnecting unit, configured to disconnect the media channel between the CU and the AS established by the establishing unit, and between the PU and the AS, and stop the voice intercom.

The method and system for implementing voice intercom in video surveillance, the CU and the PU respectively establish a media channel between the Core IMS and the AS, and when the voice intercom needs to be performed, the CU and the PU interact with the voice media through the established media channel. Data, so that the voice intercom function of the IMS-based video surveillance system is realized without adding any additional equipment in the video surveillance system, and the voice intercom is completed by the Core IMS relay signaling method, which is convenient for security control. Because Core IMS is deployed on the public network, it can effectively overcome the problem of private network traversal and is easy to apply and promote. DRAWINGS

FIG. 1 is a schematic structural diagram of a structure of an IMS-based video surveillance system;

2 is a schematic diagram of an interaction process of a voice intercom process in video surveillance according to the present invention; FIG. 3 is a schematic diagram of an interaction process according to an embodiment of the present invention. detailed description

The present invention is applicable to an IMS-based video surveillance system. As shown in FIG. 1, the IMS-based video surveillance system mainly includes a monitoring front-end subsystem (PU), an IP multimedia subsystem core unit (Core IMS), and an application server subsystem (AS). ), Media Control and Storage Server Subsystem (MCSU), Monitoring Client Terminal System (CU). The Core IMS is used to complete the forwarding and session establishment of the video surveillance service control signaling, and the AS completes the processing of the service logic. The AS mainly includes the following functional entities: Service Discovery Function Implementation (SDF), Service Selection Function Entity (SSF) And the Service Control Function Entity (SCF), MCSU completes the media forwarding/distribution/transcoding/storage, etc., and provides streaming media services, the PU is responsible for monitoring the collection of information, and the CU provides users with various interfaces for video surveillance services. .

The main idea of the present invention is to provide a method for implementing voice intercom in video surveillance. In the IMS-based video surveillance system, the CU and the PU respectively establish a media channel between the Core IMS and the AS; The established media channel between the CU and the AS and between the PU and the AS, and the voice media data is exchanged between the CU and the PU.

The present invention also provides a system for implementing voice intercom in video surveillance. The system may mainly include: an establishing unit and a transmitting unit, wherein the establishing unit is configured to establish a relationship between the CU and the AS, and the PU and the AS through the Core IMS. a media channel; a transmission unit, configured to transmit voice media data between the CU and the PU, and a media channel between the CU and the AS established by the establishing unit and between the PU and the AS.

The system may further include: a disconnecting unit, configured to disconnect the media channel between the CU and the AS established by the establishing unit, and between the PU and the AS, and stop the voice intercom.

In practical applications, the foregoing establishing unit, the transmitting unit, and the disconnecting unit may be respectively set on the CU, Core IMS, AS and PU in the IMS-based video monitoring system, or independently set and passed through with the CU, Core IMS, AS. Interact with the PU to implement voice intercom of the IMS-based video surveillance system. Specifically, as shown in FIG. 2, the CU establishes a media channel between the Core IMS and the AS, and the PU establishes a media channel between the Core IMS and the AS. The process is as follows: The CU sends a voice intercom request and forwards it to the AS through the Core IMS. Afterwards, the AS forwards the voice intercom request to the PU through the Core IMS. The PU receives the voice intercom request, and sends a voice intercom response to the AS through the Core IMS, and the AS forwards the voice intercom response to the AS through the Core IMS. After receiving the voice intercom response, the CU forwards the voice intercom confirmation to the AS through the Core IMS, and establishes a media channel between itself and the AS; the AS forwards the voice intercom to the PU through the Core IMS, and establishes itself. Media channel between the PU and the PU. After the AS receives the voice intercom request sent by the CU, and forwards the voice intercom request to the PU through the Core IMS, the AS performs service authentication and authority verification, service authentication, and calibration. After successful verification, the voice intercom request is forwarded to the PU through Core IMS.

Here, the process of performing the service authentication and the rights check by the AS includes: after receiving the voice intercom request sent by the CU, the AS queries the user registration information corresponding to the CU according to the voice intercom request, according to Querying the user registration information, determining whether the voice intercom request can be forwarded to the PU, and/or, after the AS receives the voice intercom request sent by the CU, according to the current work of the PU a state, determining whether the voice intercom request can be forwarded to the PU; if yes, the AS forwards the voice intercom request to the PU; otherwise, the AS returns a message that the voice intercom request fails to the CU , the voice intercom request is not forwarded.

The user registration information may include: information indicating whether it is legal, and information indicating whether or not there is voice intercom permission with the PU. The current working state of the PU may include: whether the PU is currently performing an exclusive voice intercom with other CUs, and whether the current idle resource of the PU can support the current voice intercom or the like.

Here, the process of establishing a media channel between the CU and the AS and between the AS and the PU can be implemented by the session establishment process of the Core IMS.

The voice intercom confirmation forwarded by the CU to the AS carries the media channel between the CU and the AS. The information, the voice intercom forwarded by the AS to the PU confirms the information carrying the media channel between the AS and the PU.

Specifically, the information of the media channel may include an IP address for receiving the media stream, a TCP/UDP port number, or may also include the suggested session identifier and channel identifier.

Here, the media channel between the CU and the AS, and the media channel between the AS and the PU can both be two-way media channels.

Here, the voice intercom request carries the identification information of the PU. For example, the PU's IP address, etc.

As shown in FIG. 2, during the voice intercom, the voice media data is exchanged between the CU and the PU through the established media channel between the CU and the AS and the PU, and the specific process includes: the CU passes the AS and the AS. The media channel sends the client's voice media data to the AS, and the AS forwards the client's voice media data to the PU through the media channel between itself and the PU; and/or, the PU passes through the media channel between itself and the AS. The AS sends the voice media data of the monitoring terminal, and the AS forwards the voice media data of the monitoring terminal to the CU through the media channel between itself and the CU.

As shown in FIG. 2, when the voice intercom needs to be stopped, the method further includes: the CU disconnects the media channel between itself and the AS, and sends a stop voice intercom request to the AS through the Core IMS, and the AS uses the Core IMS to Stop the voice intercom request and forward it to the PU; after receiving the stop voice intercom request, the PU disconnects the media channel between itself and the AS, and stops the voice intercom response to the AS through the Core IMS forwarding; the AS passes the Core IMS The stop voice intercom response is forwarded to the CU, and the voice intercom stops.

Here, the process of stopping the voice intercom can be implemented by the session demolition process of the Core IMS in the video monitoring based on the IMS. The stopping the voice intercom request may be the request disconnection message during the session demolition process, and stopping the voice intercom response. The corresponding can be a disconnection response message.

The specific implementation of the present invention will be further described in detail below with reference to the accompanying drawings. Referring to FIG. 3, the process of implementing the voice intercom function of the IMS-based video surveillance system according to the method provided by the present invention specifically includes the following processes:

Steps 301-305: The CU searches for the identifier of the PU that needs to perform voice intercom, such as the IP address of the PU, and sends a voice intercom request carrying the discovered PU identifier (SIP protocol) from the list of monitored front ends saved by the CU. In the request message (INVITE), the CU first routes the INVITE to the Core IMS, and the Core IMS forwards the INVITE to the assigned AS. The AS performs service authentication and permission verification as needed, and then the AS forwards the INVITE. Go to Core IMS, Core IMS forwards the INVITE to the PU;

Steps 306-309: After receiving the INVITE, the PU returns a voice intercom response message (response (200 OK) message in the SIP protocol), and the PU first routes the 200 OK message to the Core IMS, which is 200 OK by the Core IMS. The message is forwarded to the AS, and the AS forwards the 200 OK message to the CU through the Core IMS.

Steps 310-313: After receiving the 200 OK message, the CU sends a voice intercom response confirmation message (an acknowledgement (ACK) message in the SIP protocol) to the AS through the Core IMS, and carries the media between itself and the AS in the ACK message. Channel information, establishing a bidirectional media channel between the AS and the CU; the AS forwards the ACK message to the PU through the Core IMS, and carries the information of the media channel between itself and the PU in the ACK message, establishing a relationship between the UE and the PU. The two-way media channel; Steps 314-315: The CU sends the client's voice media data packet (RTP, User Datagram Protocol) through the media channel between itself and the AS. Real-time Transport Protocol), the AS forwards the RTP data packet of the client to the PU through the media channel between the UE and the PU, and the PU receives the RTP data packet of the client and decodes and plays the packet;

Steps 316-317: The PU sends the voice media data packet (the UDP bearer RTP data packet) of the monitoring terminal to the AS through the media channel between the AS and the AS, and the AS performs the monitoring through the media channel between itself and the CU. The RTP data packet of the terminal is sent to the CU, and the CU receives the monitoring terminal. RTP packets are decoded and played;

Steps 318-321: When the voice intercom needs to be stopped, the CU sends a request disconnection message to the Core IMS, such as a goodbye message (BYE) in the SIP protocol, and disconnects the media channel between itself and the AS, and the Core IMS then BYE The message is forwarded to the AS by the AS. The AS then forwards the BYE message to the PU through the Core IMS. The PU receives the BYE message and disconnects the media channel between itself and the AS. Steps 322-325: The PU sends a disconnection response message (such as SIP). The 200 OK message in the protocol is forwarded to the AS through the Core IMS; the AS then forwards the 200 OK message to the CU through the Core IMS, and the CU receives the 200 OK message, and the voice intercom stops.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included. Within the scope of protection of the present invention.

Claims

Claim

A method for implementing voice intercom in video surveillance, the method comprising: monitoring a client terminal system (CU) and a monitoring front end subsystem (PU), respectively, through an IP multimedia subsystem core unit (Core IMS) ), establishing a media channel with the application server subsystem (AS);

During the voice intercom, the voice media data is exchanged between the CU and the PU through the established media channel between the CU and the AS and between the PU and the AS.

The method for implementing the voice intercom in video surveillance according to claim 1, wherein the CU and the PU respectively establish a media channel between the Core IMS and the AS, and the method includes: the CU sends a voice intercom request Forwarding to the AS through the Core IMS; the AS forwards the voice intercom request sent by the CU to the PU through the Core IMS;

The PU receives the voice intercom request, returns a voice intercom response to the AS through the Core IMS, and the AS forwards the voice intercom response to the CU through the Core IMS;

The CU receives the voice intercom response, sends a voice intercom confirmation to the AS through the Core IMS, and establishes a media channel between itself and the AS; the AS forwards the voice intercom to the PU through the Core IMS, and establishes itself. Media channel between the PU and the PU.

The method for implementing the voice intercom in video surveillance according to claim 2, wherein the voice intercom forwarded by the CU to the AS confirms that the information of the media channel between the CU and the AS is carried; The voice intercom to the PU confirms the information carrying the media channel between the AS and the PU.

The method for implementing voice intercom in video surveillance according to claim 2, wherein after the AS receives the voice intercom request sent by the CU, and passes the voice intercom request through the Core Before the IMS forwards to the PU, the method further includes:

After receiving the voice intercom request sent by the CU, the AS performs service authentication and permission check, and the service authentication and verification succeeds, and then forwards the voice intercom request to the core IMS through the Core IMS. The PU.

The method for implementing voice intercom in video surveillance according to claim 4, wherein the AS performs service authentication and permission verification, including:

The AS queries the user registration information corresponding to the CU according to the voice intercom request, and determines whether the voice intercom request can be forwarded to the PU according to the queried user registration information; and/or, Determining, according to the current working state of the PU, whether the voice intercom request can be forwarded to the PU;

If yes, the AS forwards the voice intercom request to the PU; otherwise, the AS returns information that the voice intercom request fails to the CU, and does not forward the voice intercom request.

The method for implementing voice intercom in video surveillance according to any one of claims 1 to 5, wherein, by the established media channel between the CU and the AS, and between the PU and the AS, Interacting voice media data between the CU and the PU, including:

The CU sends the voice media data of the client to the AS through the media channel between the AS and the AS, and the AS forwards the voice media data of the client to the PU through the media channel between itself and the PU;

And/or, the PU sends the voice media data of the monitoring terminal to the AS through the media channel between the AS and the AS, and the AS forwards the voice media data of the monitoring terminal to the CU through the media channel between itself and the _CU .

The method for implementing voice intercom in video surveillance according to any one of claims 1 to 5, wherein the method further comprises:

When the voice intercom needs to be stopped, the CU disconnects the media channel between itself and the AS, and sends a stop voice intercom request to the AS through the Core IMS, and the AS forwards the stop voice intercom request to the PU through the Core IMS. ;

After receiving the stop voice intercom request, the PU disconnects the media channel between itself and the AS, and stops the voice intercom response to the AS through the Core IMS forwarding; the AS passes the Core IMS again. The stop voice intercom response is forwarded to the CU, and the voice intercom stops.

The method for implementing voice intercom in video surveillance according to claim 7, wherein the stopping the voice intercom request is a request disconnection message, and the stopping the voice intercom response is a disconnection response message.

A system for implementing voice intercom in video surveillance, characterized in that: the system comprises: an establishing unit and a transmitting unit, wherein

Establishing a unit for establishing a media channel between the CU and the AS and between the PU and the AS through the Core IMS;

And a transmission unit, configured to perform voice intercom, transmit media media data between the CU and the PU, and a media channel between the CU and the AS established by the establishing unit, and between the PU and the AS.

The system for implementing voice intercom in video surveillance according to claim 9, wherein the system further comprises: a disconnecting unit, configured to disconnect between the CU and the AS established by the establishing unit, And the media channel between the PU and the AS, stopping the voice intercom.