Summary of the invention
In view of this, provide a kind of video monitoring conference system on the one hand among the present invention, provide on the other hand the implementation method of meeting in a kind of video monitoring system, in video monitoring system, to realize conferencing function.
Video monitoring conference system provided by the present invention comprises: client, headend equipment, monitoring business server and streaming media server, wherein,
Described monitoring business server is used for creating meeting room according to the request as the client of chairman side, when described chairman side starts meeting, the notification streams media server distributes the audio mixing point, and the notification streams media server will add described audio mixing point as client and/or the headend equipment of conference member;
Described streaming media server is used for distributing the audio mixing point according to the notice of described monitoring business server, and will add described audio mixing point as client and/or the headend equipment of conference member, reception is distributed to corresponding conference member from the audio stream of each conference member after audio mixing point carries out audio mixing to described audio stream.
Preferably, this system further comprises: IAD and common conference terminal, wherein,
Described IAD is used for carrying out protocol conversion between described common conference terminal and monitoring business server and described common conference terminal and streaming media server;
The further notification streams media server of described monitoring business server will add described audio mixing point by IAD as the common conference terminal of conference member;
Described streaming media server is distributed to corresponding conference member further by the audio stream of described IAD reception from the common conference terminal after audio mixing point carries out audio mixing to the audio stream that comprises described common conference terminal audio frequency stream.
Preferably, described monitoring business server further finishes voice according to the request notification of meetings member as the client of chairman side and sends, and the notification streams media server withdraws from the meeting member from and delete the audio mixing point from the audio mixing point;
Described streaming media server further according to the notice of described monitoring business server, withdraws from the meeting member from the audio mixing point, and deletes described audio mixing point.
Preferably, further when the video of selected conference member was watched in the conference member application, the notification streams media server distributes transmitted point to described monitoring business server, and the notification streams media server adds described forwarding point with the conference member of correspondence;
Described streaming media server further distributes according to the notice of described monitoring business server transmits point, and the conference member of correspondence added described forwarding point, reception is from the video flowing of selected conference member, is distributed to corresponding conference member at the forwarding described video flowing of naming a person for a particular job.
Preferably, this system further comprises: IAD and common conference terminal, wherein,
Described IAD is used for carrying out protocol conversion between described common conference terminal and monitoring business server and described common conference terminal and streaming media server;
Described monitoring business server further by described IAD will add as the common conference terminal of conference member described audio mixing point or and transmit point;
Described streaming media server is distributed to corresponding conference member further by the audio stream of described IAD reception from the common conference terminal after audio mixing point carries out audio mixing to the audio stream that comprises described common conference terminal audio frequency stream; When described common conference terminal to apply is watched the video of selected conference member, further receive the video flowing from selected conference member, be distributed to the corresponding conference member that comprises described common conference terminal at the forwarding described video flowing of naming a person for a particular job; When the selected conference member of described common conference terminal conduct, further by the video flowing of described IAD reception from described common conference terminal, described video flowing is distributed to corresponding conference member.
Preferably, described monitoring business server is further according to as the client of chairman side or the request notification streams media server of other conference members corresponding conference member being withdrawed from from transmitting point, after all conference members all withdraw from from the forwarding point, the notification streams media server is deleted described forwarding point, and the selected conference member of notice finishes the video transmission;
Described streaming media server further according to the notice of described monitoring business server, withdraws from corresponding conference member, and deletes described forwarding point from transmitting point.
The implementation method of meeting in the video monitoring system provided by the present invention comprises:
Monitoring business server in the video monitoring system creates meeting room according to the request as the client of chairman side;
When described chairman side started meeting, the streaming media server in the described monitoring business server notice video monitoring system distributed the audio mixing point, and the notification streams media server will add described audio mixing point as client and/or the headend equipment of conference member;
Described streaming media server receives the audio stream from each conference member, is distributed to corresponding conference member after audio mixing point carries out audio mixing to described audio stream.
Preferably, the method further comprises: monitoring business server notification streams media server will add described audio mixing point by IAD as the common conference terminal of conference member.
Preferably, the method further comprises: when the request closing session of described chairman side, monitoring business server finishes the voice transmission according to the request notification of meetings member of described chairman side, and the notification streams media server withdraws from the meeting member from and delete described audio mixing point from the audio mixing point.
Preferably, the method further comprises:
When the video of selected conference member was watched in the conference member application, the notification streams media server distributes transmitted point, and the notification streams media server adds described forwarding point with the conference member of correspondence;
Described streaming media server receives the video flowing from selected conference member, is distributed to corresponding conference member at the forwarding described video flowing of naming a person for a particular job.
Preferably, the method further comprises:
In described chairman side or other conference member requests when finishing to watch video, monitoring business server notification streams media server withdraws from corresponding conference member from transmitting point;
After all conference members all withdrawed from from the forwarding point, monitoring business server notification streams media server was deleted described forwarding point, and the selected conference member of notice finishes the video transmission.
Preferably, described monitoring business server creates after the meeting room according to the request as the client of chairman side, further comprises: the conference member list that comprises client and/or headend equipment that storage chairman side arranges in monitoring business server;
Describedly will add described audio mixing point as the client of conference member and/or headend equipment and comprise: monitoring business server initiates to add the invitation of meeting according to described conference member list to the conference member of correspondence, and the conference member of accepting the invitation is added described audio mixing point.
Preferably, further comprise in the described conference member list: the common conference terminal;
The method further comprises: monitoring business server is passed through IAD initiates to add invitation from meeting to the common conference terminal according to described conference member list, after described common conference terminal is accepted the invitation, described common conference terminal is added described audio mixing point.
Preferably, describedly will add described audio mixing point as the client of conference member and/or headend equipment and comprise: the request of initiating to add meeting to monitoring business server as client and/or the headend equipment of conference member, monitoring business server is carried out the authority judgement to client and/or the headend equipment of described initiation request, will add described audio mixing point by client and/or the headend equipment of authority.
Preferably, the method further comprises: the common conference terminal is passed through IAD initiates to add request from meeting to monitoring business server as conference member, monitoring business server is carried out the authority judgement to the common conference terminal of described initiation request, will add by the objective common conference terminal of authority described audio mixing point.
Can find out from such scheme, the present invention is by making the monitoring business server in the video monitoring system create meeting room according to the request as the client of chairman side, and when the startup meeting of described chairman side, streaming media server in the notice video monitoring system distributes the audio mixing point, and the notification streams media server will add described audio mixing point as client and/or the headend equipment of conference member, then, streaming media server receives the audio stream from each conference member, after carrying out audio mixing to described audio stream, audio mixing point is distributed to corresponding conference member, thereby in video monitoring system, realized conferencing function, allow common video acquisition front end and client can become conference terminal, reduced the system resource investment.And, by realizing the fusion of video monitoring system and conference system, so that when accident occurs, can provide in many ways decision-making, the platform of Real-time Decision.
In addition, pass through traditional common conference terminal is linked in the meeting of video monitoring system, improved the access capability of various conference terminals, guaranteed customer investment.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, below in conjunction with embodiment and accompanying drawing, the present invention is described in more detail.
Fig. 3 is the exemplary block diagram of video monitoring conference system in the embodiment of the invention.Shown in the part of the solid line among Fig. 3, this system comprises: headend equipment, monitoring business server, streaming media server and client.Further, shown in the dotted portion among Fig. 3, this system also can comprise: IAD and common conference terminal.
Wherein, monitoring business server also is responsible for the management of convention business except the management of being responsible for monitoring business.
Streaming media server also is responsible for transmission and the storage of convention business Media Stream except the transmission and storage of being responsible for the monitoring business Media Stream.
Headend equipment also can be used as conference member except the information gathering end as monitoring business.
Client also is responsible for the operation of convention business except the operation of being responsible for monitoring business.For convention business, according to the difference of concrete operations, client can specifically be called as chairman side client (being chairman side's client) and as the client of conference member (be the conference member client, comprise the chairman side's client that adds after the meeting).
Further, the common conference terminal in traditional conference system also can be passed through IAD and is linked in the meeting.Wherein, IAD is used for shielding agreement difference, carries out protocol conversion between common conference terminal and monitoring business server and common conference terminal and streaming media server, finishes the mutual of signaling and Media Stream.
During the specific implementation convention business, monitoring business server is used for creating meeting room according to the request as the client of chairman side, when the client terminal start-up meeting of chairman side, the notification streams media server distributes the audio mixing point, and the notification streams media server will add described audio mixing point as client and/or the headend equipment of conference member.Further, when comprising common conference terminal and IAD in the system, monitoring business server further notification streams media server will add described audio mixing point by IAD as the common conference terminal of conference member.
Streaming media server is used for distributing the audio mixing point according to the notice of monitoring business server, and will add described audio mixing point as client and/or the headend equipment of conference member, reception is distributed to corresponding conference member from the audio stream of each conference member after audio mixing point carries out audio mixing to described audio stream.Further, when comprising common conference terminal and IAD in the system, streaming media server further by the audio stream of described IAD reception from the common conference terminal, is distributed to corresponding conference member after audio mixing point carries out audio mixing to the audio stream that comprises described conference terminal audio stream.
Wherein, when convention business is video conference business, then because the conference member type in the system shown in Figure 3 is varied, comprise headend equipment and client such as conference member, and headend equipment comprises video monitoring camera, IP camera, DVS, DVR and codec etc.Further, conference member also can comprise the common conference terminal.Yet various conference members are different to the transmitting-receiving ability of video, and for example, encoder can only send video can not receiver, video; Decoder can only can not send video by receiver, video; Rig camera, IP camera, DVS and DVR etc. can only send video flowing, when being used with the software decode client, can receiver, video stream and decoding watch; Client then can send video again can receiver, video.Therefore, for video conference business, need selectively transmitting video-frequency flow.During specific implementation, conference member can select to watch the video of which conference member, for example, customer end A selects to watch the video from the IP camera, then customer end A can be watched to the monitoring business server application video of IP camera (being the selected conference member of customer end A), then the further notification streams media server of monitoring business server distributes the forwarding point, and the notification streams media server is with conference member (namely sending the customer end A of IP camera and the receiver, video stream of video flowing) the described forwarding point of adding of correspondence.Correspondingly, streaming media server further distributes according to the notice of monitoring business server transmits point, and the conference member of correspondence added the forwarding point that distributes, reception is from the video flowing of selected conference member (being the IP camera), is distributed to corresponding conference member (being customer end A) at the forwarding described video flowing of naming a person for a particular job.
Further, when comprising IAD and common conference terminal in the system, monitoring business server further will add as the common conference terminal of conference member described audio mixing point or and forwarding point by described IAD.Streaming media server further by the audio stream of described IAD reception from the common conference terminal, is distributed to corresponding conference member after audio mixing point carries out audio mixing to the audio stream that comprises described conference terminal audio stream; When described common conference terminal to apply is watched the video of selected conference member, further receive the video flowing from selected conference member, be distributed to the corresponding conference member that comprises described common conference terminal at the forwarding described video flowing of naming a person for a particular job; When the selected conference member of described common conference terminal conduct, further by the video flowing of described IAD reception from conference terminal, described video flowing is distributed to corresponding conference member.
Wherein, monitoring business server notification streams media server will can have as the method that the client of conference member and/or headend equipment and/or common conference terminal add audio mixing point multiple, and the below enumerates wherein several:
The first is invited addition method.The conference member list that comprises client and/or headend equipment and/or common conference terminal that namely storage chairman side arranges in monitoring business server in advance.Then monitoring business server adds the audio mixing point according to the invitation of this conference member list to the conference member initiation adding meeting of correspondence with the conference member of accepting the invitation.
The second, the request addition method.Namely initiate to add the request of meeting to monitoring business server as the client of conference member and/or headend equipment and/or common conference terminal, monitoring business server is carried out authority to the client of described initiation request and/or headend equipment and/or common conference terminal and is judged, the client by authority and/or headend equipment and/or common conference terminal are added described audio mixing point.
For headend equipment (such as codec), its request that initiate to add meeting can be passed through the mode such as switching value and finish.
When convention business need to finish, can be initiated by chairman side's client the request of closing session, then monitoring business server can finish according to the request notification of meetings member of chairman side's client the voice transmission, and the notification streams media server withdraws from the meeting member from and delete the audio mixing point from the audio mixing point.Further, for video conference business, when monitoring business server finishes to watch video in chairman side's client or other conference member requests, also need the notification streams media server that corresponding conference member is withdrawed from from transmitting point; After all conference members all withdrawed from from the forwarding point, monitoring business server notification streams media server was deleted described forwarding point, and the selected conference member of notice finishes the video transmission.
Correspondingly, streaming media server can withdraw from the meeting member according to the notice of monitoring business server from the audio mixing point, and deletes described audio mixing point.Further, for video conference business, streaming media server also can withdraw from corresponding conference member according to the notice of monitoring business server from transmitting point, after all conference members all withdraw from from the forwarding point, deletes described forwarding point.
Conference creation, member in the embodiment of the invention are added the below and the process of Media Stream distribution is described in detail.Comprise chairman side's client and customer end A with client among Fig. 4, headend equipment comprises that the situation of IPCamera is example, shows a kind of schematic flow sheet of conference creation, member's adding and Media Stream distribution.As shown in Figure 4, this flow process comprises the steps:
Step 401, chairman side's client initiate to create the request of meeting room to monitoring business server.
Step 402, monitoring business server creates conferencing resource, and generates corresponding conference number, and to chairman side's client, meeting room creates successfully with the meeting number notifying.
Step 403, chairman side's client arranges conference member list in monitoring business server.Comprise IPCamera and customer end A in this conference member list.
After meeting room creates successfully, the startup stage that the below at first describing voice conferencing:
Step 404, the application of chairman's direction monitoring business server starts meeting, and carries the media capability of chairman side's client.
Step 405, monitoring business server notification streams media server creates the audio mixing point, and carries the media capability of chairman side's client, and the notification streams media server joins chairman side's client the audio mixing point that creates.
Step 406, streaming media server creates the audio mixing point according to the notice of monitoring business server, and chairman side's client joined the audio mixing point that creates, put successfully to monitoring business server response creation audio mixing afterwards, and return the media capability information of audio mixing point, receive the media formats of voice flow and receiver address etc. such as audio mixing point.
Step 407, monitoring business server invites IPCamera to start voice according to conference member list, and with the media capability information notification IPCamera of audio mixing point, notifies IPCamera that voice flow is mail to the audio mixing point.
Step 408, IPCamera responds to monitoring business server and starts successfully, and carries the media capability information of self, such as the IP address of code/decode format and reception voice flow etc.
Step 409, monitoring business server notifies the media capability information of IPCamera to streaming media server, by streaming media server IPCamera is added the audio mixing point.
Step 410, streaming media server add audio mixing to monitoring business server response IPCamera and put successfully.
Step 411, monitoring business server invites customer end A to start voice according to conference member list, and with the media capability information notification customer end A of audio mixing point, to notify customer end A voice flow is mail to the audio mixing point.
Step 412, customer end A are responded to monitoring business server and are started successfully, and carry the media capability information of self, such as the IP address of code/decode format and reception voice flow etc.
Step 413, monitoring business server notifies the media capability information of customer end A to streaming media server, by streaming media server customer end A is added the audio mixing point.
Step 414, streaming media server add audio mixing to monitoring business server customer in response end A and put successfully.
Step 415, monitoring business server are notified the client terminal start-up meeting success of chairman side, and inform the media capability information of chairman side's client audio mixing point.So that chairman side's client according to the media capability information of audio mixing point, mails to the audio mixing point with voice flow.
Step 416 is carried out the distribution of voice flow audio mixing.
In this step, each conference member, be chairman side's client, IPCamera and customer end A, voice flow is sent to streaming media server, each voice flow that streaming media server will receive is after the audio mixing point carries out audio mixing, media capability information according to each conference member is distributed to each conference member with the voice flow behind the audio mixing.
Video is described below to be selected to watch the stage:
Step 417, chairman side's client is watched the IPCamera video to the monitoring business server request.
Step 418, monitoring business server notification streams media server create transmits point, and carries the media capability of chairman side's client, and the notification streams media server joins chairman side's client the forwarding point that creates.
Step 419, streaming media server creates the forwarding point according to the notice of monitoring business server, and chairman side's client joined the forwarding point that creates, transmit to the monitoring business server response creation afterwards and put successfully, and return the media capability information of transmitting point, as transmitting a media formats of receiver, video stream and receiver address etc.
Step 420, monitoring business server starts the IPCamera video, will transmit the media capability information notification IPCamera of point, and notice IPCamera mails to the forwarding point with video flowing.
Step 421, IPCamera responds and starts the video success.
Step 422, monitoring business server are notified the success of chairman side client terminal start-up IPCamera video.
Step 423, customer end A is watched the IPCamera video to the monitoring business server request.
Step 424, monitoring business server notification streams media server join customer end A the forwarding point that creates.
Step 425, streaming media server joins the forwarding point that creates according to the notice of monitoring business server with customer end A, responds customer end A adding forwarding to monitoring business server afterwards and puts successfully.
Step 426, monitoring business server are responded customer end A and are watched the success of IPCamera video.
Step 427, the distribution of video flowing.
In this step, IPCamera sends to streaming media server with video flowing, and streaming media server is transmitted to respectively chairman side's client and customer end A with the video flowing that receives at the forwarding point.
In the above-mentioned flow process, conference member is to invite the form that adds voice conferencing to add meeting, and the situation that the form that the below adds with application conference member adds meeting is described in detail.Comprise chairman side's client and customer end A with client among Fig. 5, headend equipment comprises that the situation of encoder is example, shows another schematic flow sheet of conference creation, member's adding and Media Stream distribution.As shown in Figure 5, hypothesis has created and has started meeting in this flow process, and creates the audio mixing point at streaming media server, and customer end A and chairman side's client also joined the audio mixing point, then follow-uply also comprises the steps:
Encoder adds the voice conferencing stage:
Step 501, encoder are passed through the switching value alarm and are added meeting to monitoring business server, and carry the media capability information of self, comprise the IP address that receives voice flow and code/decode format etc.
Step 502, monitoring business server are carried out authority to encoder and are judged that when authority was passed through, the response coding device added the meeting success, and the informed code device sends to voice flow the audio mixing point that has created.
Step 503, monitoring business server notification streams media server joins the audio mixing point with encoder.
After step 504, streaming media server added audio mixing point with encoder, notice monitoring business server encoder added audio mixing and puts successfully.
Step 505, the distribution of voice flow audio mixing.
In this step, each conference member that comprises encoder sends to streaming media server with voice flow, each voice flow that streaming media server will receive is after the audio mixing point carries out audio mixing, and the media capability information according to each conference member is distributed to each conference member with the voice flow behind the audio mixing.
Chairman side's client is watched the encoder video:
Step 506, chairman side's client is watched the encoder video to the monitoring business server request.
Step 507, monitoring business server notification streams media server create transmits point, and carries the media capability of chairman side's client, and the notification streams media server joins chairman side's client the forwarding point that creates.
Step 508, streaming media server creates the forwarding point according to the notice of monitoring business server, and chairman side's client joined the forwarding point that creates, transmit to the monitoring business server response creation afterwards and put successfully, and return the media capability information of transmitting point, as transmitting a media formats of receiver, video stream and receiver address etc.
Step 509, monitoring business server starts the encoder video, will transmit the media capability information notification encoder of point, and the informed code device mails to the forwarding point with video flowing.
Step 510, encoder are responded and are started the video success.
Step 511, monitoring business server are notified the client terminal start-up encoder video success of chairman side.
Step 512, video flowing is transmitted.
In this step, encoder sends to streaming media server with video flowing, and streaming media server is transmitted to respectively chairman side's client with the video flowing that receives at the forwarding point.
More than the conference creation in the embodiment of the invention, member are added and the Media Stream distribution flow is described in detail, flow process is described in detail the below to meeting adjourned in the embodiment of the invention again.
Fig. 6 is for the meeting shown in Figure 4 schematic flow sheet that meeting adjourned in the embodiment of the invention.As shown in Figure 6, this flow process comprises the steps:
Finish the voice conference phase:
Step 601, chairman side's client finishes active conference to the monitoring business server request.
Step 602, monitoring business server notice IPCamera finishes voice and sends, and withdraws from the audio mixing point.
Step 603, IPCamera stops voice and sends, and finishes the voice success to the monitoring business server response.
Step 604, monitoring business server notification streams media server withdraws from IPCamera from the audio mixing point.
Step 605, streaming media server withdraws from audio mixing to monitoring business server response IPCamera and puts successfully.
Step 606, monitoring business server notice customer end A finishes voice and sends, and withdraws from the audio mixing point.
Step 607, customer end A stop voice and send, and finish the voice success to the monitoring business server response.
Step 608, monitoring business server notification streams media server withdraws from customer end A from the audio mixing point.
Step 609, streaming media server withdraws from audio mixing to monitoring business server customer in response end A and puts successfully.
Step 610, monitoring business server notification streams media server withdraws from chairman side's client from the audio mixing point, and deletion audio mixing point.
Step 611, streaming media server is put successfully to monitoring business server response deletion audio mixing.
Step 612, monitoring business server notify chairman side's client voice conferencing to finish successfully.
Finish the video-see stage:
Step 613, the customer end A application finishes to watch the IPCamera video.
Step 614, monitoring business server notification streams media server withdraws from customer end A from transmitting point.
Step 615, streaming media server withdraws from customer end A from the forwarding point according to the notice of monitoring business server, withdraws to transmit to monitoring business server response customer end A afterwards and puts successfully.
Step 616, monitoring business server finishes to watch the video success to the customer end A response.
Step 617, the client application of chairman side finishes to watch the IPCamera video.
Step 618, monitoring business server notification streams media server withdraws from chairman side's client from transmitting point.
Step 619, streaming media server withdraws from chairman side's client from the forwarding point according to the notice of monitoring business server, withdraws to transmit to monitoring business server response chairman side client afterwards and puts successfully.
Step 620 do not had the recipient owing to transmit point, so monitoring business server notification streams media server is deleted this forwarding point.
Step 621, after point was transmitted in the streaming media server deletion, the notice monitoring business server was transmitted the point deletion success.
Step 622, monitoring business server notice IPCamera stops video and sends.
Step 623, IPCamera notice monitoring business server video has stopped sending.
Step 624, monitoring business server finishes to watch the video success to chairman side's client end response.
More than the technical scheme in the embodiment of the invention is described in detail.As seen, among the present invention, separate by the control of the signaling of conference system and Media Stream are controlled, take device and streaming media server is achieved at the monitoring business of video monitoring system respectively, thereby in video monitoring system, realized the convention business function.
In addition, means join in the meeting by making different conference terminals adopt targetedly in the embodiment of the invention, thereby can support the conference terminal of various device, the various device in video monitoring system, also comprise the various common conference terminals of conference system.And, can also realize voice flow meeting and video flowing meeting in the embodiment of the invention.
Above-described specific embodiment; purpose of the present invention, technical scheme and beneficial effect are further described; institute is understood that; the above only is preferred embodiment of the present invention; be not for limiting protection scope of the present invention; within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.