Summary of the invention
In view of this, the invention provides a kind of multi-channel video method for supervising, a kind of web-transporting device and a kind of video monitoring system, can save system bandwidth and reduce the processing burden of client.
A kind of multi-channel video method for supervising provided by the invention comprises:
Judge the sign that whether comprises expression fusion multi-path video stream in the monitoring request that receives;
Merge the sign of multi-path video stream if comprise expression in the described monitoring request, then need to merge multi-path video stream, give client according to permeate road and clean culture of mode of unicast the multi-path video stream of correspondence; Otherwise, do not need to merge multi-path video stream, directly the video flowing with correspondence sends to client;
Wherein, described monitoring request is the report Report message based on the 3rd edition IGMP IGMPv3;
Being designated of multi-path video stream merged in described expression: client keeps the preset value in the Reserved territory in the Report message;
Describedly judge whether comprise in the described monitoring request that expression merges being designated of multi-path video stream: whether the numerical value of checking Reserved territory in the Report message is preset value, if then comprise the sign of representing to merge multi-path video stream in the monitoring request, otherwise, do not comprise the sign of representing to merge multi-path video stream in the monitoring request.
The IP address that comprises the client that sends this request in the described monitoring request;
Described multi-path video stream with correspondence comprises to client according to permeate road and clean culture of mode of unicast:
With the multi-path video stream boil down to one tunnel of correspondence, and the source address of the road video flowing that obtains of compression is set to the IP address of map network transmission equipment, the IP address that destination address is set to corresponding client.
Described web-transporting device is a switch;
The IP address of described web-transporting device is: the IP address of the loopback interface of switch.
A kind of web-transporting device provided by the invention, this web-transporting device is as the client convergent point and comprise receiving element and transmitting element, and this web-transporting device further comprises: the video flow processing unit;
Described receiving element, the monitoring request that video flowing that hardware coder in the receiver, video supervisory control system sends and the client in the video monitoring system send, merge the sign of multi-path video stream if comprise default expression in the monitoring request, then described receiving element sends to described video flow processing unit with the multi-path video stream of correspondence;
Described video flow processing unit will be from the multi-path video stream of receiving element according to permeate road and export to transmitting element of mode of unicast;
Described transmitting element is given clients corresponding with the video flowing clean culture that receives;
Wherein, described monitoring request is the report Report message based on the 3rd edition IGMP IGMPv3, and the client that is designated that multi-path video stream is merged in described expression keeps the preset value that is provided with in the Reserved territory in the Report message.
The IP address that comprises the client that sends this monitoring request in the described monitoring request;
Described video flow processing unit comprises: subelement, coding subelement and configuration subelement are extracted in decoding subelement, compression, wherein,
Described decoding subelement with each the road decoding video stream that receives, and is exported to described compression with the picture signal that decoding obtains and is extracted subelement;
Subelement is extracted in described compression, according to default compression factor, the picture signal of each road video flowing correspondence is compressed extraction, the picture signal that obtains is extracted in compression export to described coding subelement;
Described coding subelement, according to position relation corresponding in the default video flowing correspondence image of each road video flowing after fusion, picture signal combination with all the video flowing correspondences after the compression extraction, the picture signal that combination obtains is carried out digital coding compression processing, and digital coding is compressed the output of processed video stream;
Described configuration subelement, the source address of the video flowing of described coding subelement output is set to the IP address of described transmitting element, the IP address that destination address is set to described client, and exports this video flowing.
A kind of video monitoring system provided by the invention, comprise: a plurality of camera heads, a plurality of hardware coder, at least one web-transporting device, at least one client as the client convergent point, described video monitoring system further comprises: equipment for processing video stream;
Described web-transporting device receives the video flowing of hardware coder transmission and the monitoring request that client sends;
Merge the sign of multi-path video stream if comprise expression in the described monitoring request, then need to merge the multi-path video stream that receives, and, described web-transporting device call described equipment for processing video stream with the multi-path video stream of correspondence according to the mode of unicast road that permeates, and clients corresponding is given in clean culture;
Wherein, described monitoring request is the report Report message based on the 3rd edition IGMP IGMPv3; The client that is designated that multi-path video stream is merged in described expression keeps the preset value that is provided with in the Reserved territory in the Report message.
Described equipment for processing video stream is at least one, links to each other with each web-transporting device as the client convergent point respectively;
Perhaps, described equipment for processing video stream is one, links to each other with all web-transporting devices as the client convergent point;
Perhaps, described equipment for processing video stream is at least one, is integrated into a physical entity with each web-transporting device as the client convergent point respectively.
As seen from the above technical solution, by with multi-path video stream according to the mode of unicast road that permeates, and the road video flowing that comprises the multi-path video stream content after will merging according to mode of unicast sends to client, thereby the bandwidth that in the multi-channel video monitoring, only needs one road video flowing, thereby saved system bandwidth, and for client, the multi-channel video monitoring also only need realize by the processing to one road video flowing, do not need to judge the pairing monitoring scene of this road video flowing according to the different identification of every road video flowing, and because one road video flowing has merged the content in the multi-path video stream, do not need periodically to switch the output multi-path video stream yet, therefore will be only need be shown to the user simultaneously and can realize the multi-channel video monitoring, thereby reduce the processing burden of client by the content of the multi-path video stream that will comprise in one road video flowing.
Embodiment
For making purpose of the present invention, technical scheme and advantage clearer, below with reference to the accompanying drawing embodiment that develops simultaneously, the present invention is described in more detail.
In the embodiment of the invention, equipment for processing video stream is set in video monitoring system, merge the sign or the corresponding a plurality of video flowing signs of a client identification in the monitoring request of multi-path video stream if comprise expression in the monitoring request, then by web-transporting device call equipment for processing video stream with multi-path video stream according to the mode of unicast road that permeates, and clients corresponding is given in the road video flowing clean culture that comprises the multi-path video stream content after will merging according to mode of unicast.
Wherein, merge according to mode of unicast and to comprise:, and the source address and the destination address of the road video flowing that compression obtains are set according to mode of unicast multi-path video stream boil down to one tunnel; Each can corresponding equipment for processing video stream as the web-transporting device of client convergent point; Equipment for processing video stream can link to each other with corresponding web-transporting device, can also be incorporated into corresponding web-transporting device inside as a built-in function unit of web-transporting device.
Fig. 2 is the structural representation of video monitoring system in the embodiment of the invention.As shown in Figure 2, the video monitoring system in the present embodiment comprises: a plurality of camera heads 101, a plurality of hardware coder 102, at least one web-transporting device 203, at least one hardware decoder 104, at least one client 205, one or at least one equipment for processing video stream 206.
Each hardware coder 102 carries out the digital coding compression with the picture signal of coupled camera head 101 outputs and handles, and the video flowing after obtaining compressing also sends to coupled web-transporting device 203.
Each for example supports the switch of clean culture and multicast as the web-transporting device 203 of client convergent point, receives the video flowing that hardware coder 102 sends; Receive the monitoring request that client 205 sends, merge the sign or the corresponding a plurality of video flowing signs of a client identification in the monitoring request of multi-path video stream if comprise default expression in the monitoring request, then web-transporting device 203 will be monitored the corresponding multi-path video stream of request and send to corresponding equipment for processing video stream 206, can also simultaneously the client identification of corresponding client 205 be sent to the equipment for processing video stream 206 of correspondence, otherwise web-transporting device 203 directly will be monitored the corresponding video flowing of request and send to clients corresponding 205; According to mode of unicast, be set to self IP address, destination address from the source address of the video flowing of video device for processing streams 205 and be set to the client ip address that carries in the corresponding monitoring request, and clients corresponding 205 is given in clean culture.
Wherein, the IP address that comprises the client 205 that sends this monitoring request in the monitoring request.
Equipment for processing video stream 205, with multi-path video stream boil down to one road video flowing, and road video flowing after will compressing sends to corresponding web-transporting device 203.
Client 205 is to the web-transporting device 203 transmission monitoring requests of correspondence, the pairing video flowing of monitoring scene that the one or more camera heads 101 of acquisition request are taken; Receive the video flowing of web-transporting device 203 and show output.
In the said system, web-transporting device 203 calls equipment for processing video stream 206, unite with equipment for processing video stream 206 and to have realized the fusion of multi-path video stream according to mode of unicast, promptly by equipment for processing video stream 206 realize multi-path video streams compression, realize the source address of the video flowing after the compression and the setting of destination address by web-transporting device 203 according to mode of unicast.Like this,, only take the resource of one road video flowing, saved system resource when client 205 transmissions have comprised the video flowing of multi-path video stream content.And for client 205, the multi-channel video monitoring also only need realize by the processing to one road video flowing, do not need to judge the pairing monitoring scene of this road video flowing according to the different identification of every road video flowing, also do not need periodically to switch the output multi-path video stream, thereby the processing that has reduced client is born.
In the practical application, video monitoring system as shown in Figure 2 can realize that this system can also comprise the memory device 207 that links to each other with web-transporting device 203 based on the IP network of each version, is used for store video stream.
Specifically, in the present embodiment, client 205 can be provided with the sign that multi-path video stream is merged in a default expression in the monitoring request before sending the monitoring request, for example, reservation (Reserved) territory in the Report message of the 3rd edition IGMP agreement (IGMPv3) is provided with a numerical value.If be provided with the sign that multi-path video stream is merged in expression in the monitoring request, web-transporting device 203 can be known need be with the multi-path video stream of correspondence according to the mode of unicast road that permeates.
Fig. 3 is the Report message structure schematic diagram in the embodiment of the invention.As shown in Figure 3, realize that with IP based network video monitoring, web-transporting device serve as to support that the switch of multicast is an example, the monitoring request that client 205 sends can be the Report message of as shown in Figure 3 IGMPv3, and the Reserved territory in the Report message of IGMPv3 is a undefined extension field, client 205 can be provided with the Reserved territory one default numerical value, 0x40 for example, and the pairing video flowing of its each required road video flowing sign, for example multicast group address be set in the Report message; Correspondingly, switch is when receiving the Report message of IGMPv3, initiatively check the numerical value in Reserved territory in the Report message, as be 0x40, then determine to comprise in this monitoring request the sign of expression fusion multi-path video stream, and the video flowing of the multicast identifier correspondence that comprises in the Report message sent to equipment for processing video stream 206, and then the source address of the road video flowing that obtains according to mode of unicast equipment for processing video stream 206 compression is set to the IP address of switch loopback interface or other interfaces, destination address is set to the client ip address in the corresponding Report message, and client 205 is given in clean culture.
Wherein, switch can obtain the IP address of client 205 from the Report message, multi-path video stream being sent to equipment for processing video stream 206 are the IP addresses that can also carry the client of obtaining 205 simultaneously, equipment for processing video stream 206 is finished after the compression of multi-path video stream, can set up point-to-point a connection according to the IP address of client 205 and by switch and clients corresponding 205, transmission control protocol (Transmission Control Protocol for example, TCP) connection, thus realize follow-up video flowing unicast transmission.
As mentioned above, the Report message of IGMPv3 is asked as monitoring, and the default numerical value in the Reserved territory in the Report of IGMP message merges the sign of multi-path video stream as expression, feasible change to existing video monitoring system is less, thereby makes that the practicality of technical solution of the present invention is higher.The monitoring request also can be the various specification protocol or the proprietary protocol message of IP based network or other network, and the sign that multi-path video stream is merged in expression also can be expressed as and corresponding numerical value of other protocol massages or field.
In the present embodiment, client 205 also can send the monitoring request of carrying one or more video flowing signs to web-transporting device 203 and represent to merge multi-path video stream, also comprise client 205 clients corresponding sign in the monitoring request, the IP address of client etc. for example, video flowing sign can be for the multicast group address of every road video flowing correspondence etc.
If client 205 represents to merge multi-path video stream by the monitoring of carrying a plurality of video flowing signs, then web-transporting device 203 is according to all monitoring requests that receives, set up and store the mapping relations of all client identifications and video flowing sign, and judge in its all monitoring requests that receive according to the mapping relations of setting up, the video flowing of each client identification correspondence is designated one or a plurality of, if the corresponding a plurality of video flowings signs of client identification, need then can to determine will above-mentioned a plurality of video flowings sign correspondences multi-path video stream according to permeate road and send to this client identification clients corresponding 205 of mode of unicast.
With the client identification is the IP address of client 205, the multicast group address that video flowing is designated every road video flowing correspondence is an example, client 205 sends the Report message of IGMP as the monitoring request to the web-transporting device 203 as the client convergent point, the IP address and at least one multicast group address sign that comprise client 205 in this message, web-transporting device 203 is according to the Report message of the IGMP that receives, set up the IP address of clients corresponding 205 and the mapping relations of multicast group address, the IP address that also comprises client 205 in the mapping relations, the mapping relations of the outgoing interface of multicast group address and web-transporting device 203 are so that can obtain IP address as the web-transporting device 203 of the correspondence of source video stream address when the fusion of follow-up realization mode of unicast.The mapping relations that web-transporting device 203 is set up can be list item information as shown in table 1.
Table 1
If corresponding a plurality of multicast group address in the IP address of a client 205 then web-transporting device 203 can be judged this client 205 acquisition request multi-path video streams, be that IP address as shown in table 1 is the client of 192.168.2.1 and 192.168.2.10, and by a plurality of multicast group address of equipment for processing video stream 206 with the IP address correspondence of this client 205,226.1.1.2 and the pairing multi-path video stream boil down to one tunnel of 226.1.1.3 that example is as shown in table 1, the source address of road video flowing after web-transporting device 203 compresses according to mode of unicast again is set to its own IP address, destination address is set to clients corresponding IP address, and clients corresponding is given in clean culture then.
Wherein, if the Report message that client 205 sends is the Report message of IGMPv3, then can comprise that the video flowing of a plurality of for example multicast group address identifies in a Report message; If the Report message that client 205 sends is the Report message of IGMPv1 or IGMPv2, then can comprise a for example video flowing sign of multicast group address in a Report message, client 205 need realize the multi-channel video monitoring by repeatedly sending the Report message.In this case, web-transporting device 203 is behind the Report message of whenever receiving an IGMPv1 or IGMPv2, judge whether to set up for the client that sends this Report message the mapping relations of clients corresponding sign and video flowing sign, if set up the mapping relations of client identification and video flowing sign for the client that sends this Report message, then in the mapping relations of having set up, do not comprise and under the situation of the video flowing sign in this Report message this video flowing sign being added in the corresponding mapping relations; If set up the mapping relations of client identification and video flowing sign, then set up the mapping relations that client identification and video flowing identify in this Report message for the client that sends this Report message.
As mentioned above, the Report message of IGMP is asked as monitoring, and by the corresponding mapping relations of web-transporting device 203 foundation, make in the multichannel fusion that realizes according to mode of unicast, less and do not need to change existing message to the change of existing video monitoring system, thus make that the practicality of technical solution of the present invention is higher.
No matter client 205 adopts above-mentioned which kind of mode request to carry out the multi-channel video monitoring, but the fusion that web-transporting device 203 equal joint video device for processing streams 206 are realized the mode of unicast of multi-path video stream, and client 205 is given in clean culture.205 of clients can be shown to the user by the mode of many pictures.
Ask corresponding 4 road video flowings with the monitoring of client 205, the monitoring scene 1~4 of respectively corresponding 4 camera heads 101 of 4 road video flowings is an example, equipment for processing video stream 206 can be according to 1: 4 ratio, the picture signal of 4 road video flowing correspondences is compressed extraction respectively, and then 4 tunnel picture signals that will compress after extracting are combined as one the tunnel, for example, respectively the picture signal of 4 road video flowing correspondences is extracted 1/4 pixel, the pixel of 4 road video flowing correspondences that will extract then is combined as piece image, and the corresponding picture size of each road picture signal before determining the pairing picture size of picture signal that position grouping that the pixel of each road video flowing correspondence is gone out obtains and compression is extracted in image according to default position relation equates, thereby makes the bandwidth that the shared bandwidth of video flowing compressed takies less than 4 road video flowings.The source address of the video flowing after being made up by web-transporting device 203 again is set to himself IP address, destination address is set to the IP address and the clean culture of client 205 and gives client 205, client 205 with corresponding IP address receives after the video flowing after the fusion, directly show this road video flowing that receives, if and pass, above-mentioned default position is: the pixel of 4 road video flowing correspondences of corresponding monitoring scene 1~4 concentrates on the upper left side of the image after the combination respectively, the upper right side, lower left and lower right, then client 205 can show the content of 4 road video flowings simultaneously according to malti-screen as shown in Figure 4, be monitoring scene 1~4, thereby realize multi-path monitoring.
Above-mentioned equipment for processing video stream 206 also can be used as the built-in function unit of web-transporting device 203, can directly realize merging according to the multi-path video stream of mode of unicast as the equipment for processing video stream 206 of web-transporting device 203 built-in function unit.
Fig. 5 is the structural representation of web-transporting device in the embodiment of the invention.As shown in Figure 5, in the present embodiment, internal integration the web-transporting device of equipment for processing video stream comprise: receiving element 501, video flow processing unit 502 and transmitting element 503.
Receiving element 501, the video flowing that hardware coder 102 sends in the receiver, video supervisory control system; The monitoring request that client 205 sends in the receiver, video supervisory control system, merge the sign of multi-path video stream if comprise default expression in the monitoring request, then will monitor the corresponding multi-path video stream of request and send to corresponding video flow processing unit 502, can also simultaneously the client identification of corresponding client 205 be sent to the video flow processing unit 502 of correspondence, otherwise, directly will monitor the corresponding video flowing of request and send to transmitting element.
Receiving element 501 also can be set up the mapping relations of client identification and video flowing sign according to all monitoring requests that receives; Judge that according to the mapping relations of setting up the video flowing of each client identification correspondence is designated one or a plurality of; If the corresponding a plurality of video flowing signs of client identification then send to video flow processing unit 502 with the corresponding multi-path video stream of a plurality of video flowing signs, otherwise directly a corresponding video flowing of video flowing sign is sent to described client 205.Wherein, client identification can be the multicast group address of every road video flowing correspondence for IP address, the video flowing sign of client.
Video flow processing unit 502, the multi-path video stream that will receive from receiving element 501 is according to the mode of unicast road that permeates, and road video flowing after will merging sends to transmitting element 503.
Transmitting element 503 is given clients corresponding 205 with the video flowing clean culture that receives.
In the above-mentioned web-transporting device, video flow processing unit 502 can comprise: subelement 522, coding subelement 523 and configuration subelement 524 are extracted in decoding subelement 521, compression.
Decoding subelement 521 with each the road decoding video stream that receives, and is exported to compression with the picture signal that decoding obtains and is extracted subelement 522.
Subelement 522 is extracted in compression, according to default compression factor, the picture signal of each road video flowing correspondence is compressed extraction, and will compress and extract the picture signal that obtains and export to the subelement 523 of encoding.
Coding subelement 523, the position relation picture signal that 522 compression extractions obtain to compression extraction subelement according to correspondence in the default video flowing correspondence image of each road video flowing after fusion makes up, and the picture signal that combination obtains is carried out the digital coding compression handle, the mode that the digital coding compression is handled can be identical with hardware encoding equipment 102, and digital coding is compressed the output of processed video stream.
Configuration subelement 524, according to mode of unicast, IP address, destination address that the source address of the video flowing of coding subelement 523 outputs is set to transmitting element 503 are set to the IP address of corresponding client 205, and export to transmitting element 503.
Above-mentioned video flow processing is established in the unit 502, can also comprise a buffer memory subelement, and compression is extracted subelement 522 and will compress and extract the picture signal that obtains and output in the buffer memory subelement, and the subelement 523 of encoding reads from buffer unit again.
Above-mentioned web-transporting device 203 can be for supporting the switch of multicast, and at this moment, transmitting element 503 can be the loopback interface of switch.
More than be to video monitoring system in the embodiment of the invention and internal integration the detailed description of the network switching equipment of equipment for processing video stream, below, the multi-channel video method for supervising in the embodiment of the invention is elaborated.
Fig. 6 is the flow chart of multi-channel video method for supervising in the embodiment of the invention.As shown in Figure 6, the multi-channel video method for supervising in the present embodiment may further comprise the steps:
Step 601 receives the monitoring request that client sends.
In this step, the monitoring request can be the report Report message based on IGMP.
Step 602, judging whether needs to merge multi-path video stream, if then execution in step 603, otherwise, execution in step 605.
In this step, can judge whether that needs merge multi-path video stream according to the sign that whether comprises default expression needs fusion multi-path video stream in the monitoring request.For example, if the monitoring request is the report Report message based on IGMPv3, judge then whether the numerical value that keeps in the Reserved territory in the Report message is preset value, if, the sign that then comprises expression fusion multi-path video stream in the monitoring request, if not, then do not comprise the sign of representing to merge multi-path video stream in the monitoring request.
In this step, also can whether corresponding a plurality of video flowing identifies judges whether that needs merge multi-path video stream according to the client identification in the monitoring request.For example, set up and store the mapping relations of client identification and video flowing sign according to all monitoring requests that receive, and judge in its all monitoring requests that receive according to the mapping relations of setting up, the video flowing of each client identification correspondence is designated one or a plurality of, if the corresponding a plurality of video flowings signs of client identification then can determine a plurality of video flowings of a client identification correspondence need be identified the pairing multi-path video stream road that permeates; Otherwise, determine not need to merge multi-path video stream.Wherein, client identification can be the multicast group address of every road video flowing correspondence for IP address, the video flowing sign of client.
Step 603, with multi-path video stream according to the mode of unicast road that permeates.
Specifically, this step can comprise following process:
A, with each road decoding video stream;
B, according to default compression factor, the picture signal of each road video flowing correspondence that decoding is obtained is compressed extraction;
C, according to position relation corresponding in the default video flowing correspondence image of each road video flowing after fusion, the picture signal of all the video flowing correspondences after the compression extraction is combined as one tunnel picture signal, and the picture signal that combination obtains is carried out the digital coding compression handle;
D, according to mode of unicast, IP address, destination address that the source address that the video flowing that obtains is handled in digital coding compression is set to web-transporting device are set to clients corresponding IP address.
Wherein, step a~c is the compression of multi-path video stream, and steps d is for being provided with the process of source video stream address and destination address according to mode of unicast.
Step 604, clients corresponding is given in road video flowing clean culture after will merging according to mode of unicast, and process ends.
Step 605 directly will be monitored the corresponding video flowing of request and send to client, and process ends.
As seen, according to mode of unicast with the multi-path video stream road that permeates, and the road video flowing that comprises the multi-path video stream content after will merging according to mode of unicast sends to client, thereby the bandwidth that in the multi-channel video monitoring, also only needs one road video flowing, thereby saved system bandwidth, and for client, the multi-channel video monitoring also only need realize by one road video flowing, do not need to judge the pairing monitoring scene of this road video flowing according to the different identification of every road video flowing, also do not need periodically to switch the output multi-path video stream, thereby the processing that has reduced client is born.
The above is preferred embodiment of the present invention only, is not to be used to limit protection scope of the present invention.Within the spirit and principles in the present invention all, any modification of being done, be equal to and replace and improvement etc., all should be included within protection scope of the present invention.