CN108933759A - Method, equipment and the storage medium of direct communication between terminals in a kind of multipoint conference - Google Patents
Method, equipment and the storage medium of direct communication between terminals in a kind of multipoint conference Download PDFInfo
- Publication number
- CN108933759A CN108933759A CN201710369272.2A CN201710369272A CN108933759A CN 108933759 A CN108933759 A CN 108933759A CN 201710369272 A CN201710369272 A CN 201710369272A CN 108933759 A CN108933759 A CN 108933759A
- Authority
- CN
- China
- Prior art keywords
- code stream
- straight
- signaling
- stream
- direct communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1827—Network arrangements for conference optimisation or adaptation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1083—In-session procedures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses method, equipment and the storage mediums of direct communication between terminals in a kind of multipoint conference.Wherein, this method includes：Code stream is led directly into demand signalling, receiving end is forwarded to by multipoint control unit；The straight-through confirmation signaling of code stream of the receiving end feedback of the multipoint control unit forwarding is received, and carries out the interaction of straight-through code stream according to the straight-through confirmation signaling of the code stream of the feedback and the receiving end.Forwarding and processing the invention avoids MCU to code stream reduce the audio-video time delay of two terminals, in the case where not influencing MCU performance and bandwidth situation, enrich the usage scenario of multipoint conference terminal.
Description
Technical field
The present invention relates to multimedia communication technology fields, more particularly to direct communication between terminals in a kind of multipoint conference
Method, equipment and storage medium.
Background technique
Usually there are two types of use pattern, respectively point-to-point meeting and multipoint conferences for video conferencing.Point-to-point meeting is two
The participant of a different location carries out the direct communication of point-to-point mode.Multipoint conference refers to permission, and two or more are different
The meeting that the participant in place simultaneously participates in.Since the processing capacity of video conference terminal is limited, multipoint conference is usually by MCU
(Microcontroller Unit, microcontroller) as the core equipment in video conference, be responsible for video conference terminal or
The forwarding or processing of carry out signaling exchange and code stream between other MCU.
Under multipoint conference, when two participant's direct dialogues, code stream reaches opposite end after the forwarding of MCU or processing.
Scene is seen for choosing, optant controls MCU by signaling, sees that the audio-video in meeting-place is transmitted to the choosing person of seeing for selected.Since sound regards
Frequency code stream passes through the forwarding or processing of MCU, increases network delay to a certain extent, influences the effect of session.Also, in multiple spot
Under meeting, if in meeting only there are two participant in a meeting when, the audio-video dialogue effect reached and point-to-point mode
Video conference is similar, but wastes the performance and bandwidth of MCU.Therefore, how under multipoint conference, in the performance for not wasting MCU
While with bandwidth, the effect for improving two participant's direct dialogues becomes particularly important.
Summary of the invention
The present invention provides method, equipment and the storage medium of direct communication between terminals in a kind of multipoint conference, to solve
In the prior art under multipoint conference, when the direct session of two participants, the problem of session result difference.
For achieving the above object, the present invention uses following technical solutions：
According to an aspect of the present invention, a kind of method of direct communication between terminals in multipoint conference is provided, including：
Code stream is led directly to demand signalling and is forwarded to receiving end by multipoint control unit by transmitting terminal；
The straight-through confirmation signaling of code stream of the receiving end feedback of the multipoint control unit forwarding is received, and according to described
The straight-through confirmation signaling of the code stream of feedback and the receiving end carry out the interaction of straight-through code stream.
Optionally, it includes code stream operation class that the code stream, which leads directly to the signaling format of the straight-through confirmation signaling of demand signalling/code stream,
Type, source mark, destination mark, code stream type, code stream transmit-receive position and media configuration information field.
Optionally, when the generation code stream leads directly to demand signalling, including：
It is request type by the code stream action type field configuration；Be arranged the code stream type field be audio and/or
The code stream transmit-receive position field configuration is transmission/reception/transmitting-receiving bidirectional by video；In the media configuration information field
The media address information of codec parameters and the code stream transmitting-receiving of configuration bit stream.
Optionally, the straight-through confirmation signaling of the code stream according to the feedback and the receiving end carry out the friendship of straight-through code stream
Mutually, including：
Code stream type and media configuration information are obtained from the straight-through confirmation signaling of the code stream of the feedback；
Encoding and decoding are carried out according to type of the codec parameters in the media configuration information to the code stream type set；
Straight-through code is carried out to the receiving end according to the media address information of the code stream transmitting-receiving in the media configuration information
The transmitting-receiving process of stream.
Optionally, the method also includes：
The straight-through cancellation signaling of code stream is sent to the receiving end by the multipoint control unit, to stop and the reception
The straight-through code stream interaction at end；Alternatively,
The straight-through cancellation signaling of the receiving end transmitted stream forwarded by the multipoint control unit is received, is stopped
It is interacted with the straight-through code stream of the receiving end.
According to an aspect of the present invention, a kind of method of direct communication between terminals in multipoint conference is provided, including：
Receiving end, which is received, leads directly to demand signalling by the transmitting terminal transmitted stream that multipoint control unit forwards, and according to institute
It states code stream and leads directly to demand signalling and generate code stream and lead directly to and confirm signaling；
The straight-through confirmation signaling of the code stream is forwarded to the transmitting terminal by the multipoint control unit, and with the hair
Sending end carries out the interaction of straight-through code stream.
Optionally, it includes code stream behaviour that the code stream, which leads directly to the signaling format of the straight-through confirmation signaling of demand signalling/code stream,
Make type, source mark, destination mark, code stream type, code stream transmit-receive position and media configuration information field.
Optionally, described that the straight-through confirmation signaling of the demand signalling generation code stream is led directly to according to the code stream, including：
It is grant type by the code stream action type field configuration；
Configuring straight-through code stream type field is the straight-through code stream type that the code stream is led directly in demand signalling；
When the code stream transmit-receive position field that the code stream leads directly to demand signalling is transmission/reception/transmitting-receiving bidirectional, the code
The code stream transmit-receive position field configuration of the straight-through confirmation signaling of stream is reception/transmission/transmitting-receiving bidirectional；
Local media configuring condition choosing is combined according to the media configuration information field that the code stream is led directly in demand signalling
The codec parameters for selecting code stream, the media address information received and dispatched from local acquisition code stream, and the codec parameters and the matchmaker
Body address information configures the media configuration information field into the straight-through confirmation signaling of the code stream.
Optionally, the interaction that straight-through code stream is carried out with the transmitting terminal, including：
The type of the code stream type set is carried out according to the codec parameters in the straight-through confirmation signaling of the code stream
Encoding and decoding；
The media address information and the transmitting terminal led directly in demand signalling according to the code stream carries out the receipts of straight-through code stream
Hair processing.
Optionally, the method also includes：
Forward code stream is straight-through to cancel signaling to the transmitting terminal by the multipoint control unit, to stop and the transmission
The straight-through code stream interaction at end；Alternatively,
The straight-through cancellation signaling of the transmitting terminal transmitted stream forwarded by the multipoint control unit is received, is stopped
It is interacted with the straight-through code stream of the transmitting terminal.
According to an aspect of the present invention, a kind of equipment of terminal room code stream direct communication in multipoint conference is provided, including
Memory and processor：Wherein, the program of direct communication between terminals in multipoint conference is stored in the memory, when the journey
For realizing the method for terminal room code stream direct communication in the multipoint conference of above-mentioned transmitting terminal when sequence is executed by the processor
In step.
According to an aspect of the present invention, a kind of equipment of terminal room code stream direct communication in multipoint conference is provided, including：
Including memory and processor：Wherein, it is stored with the program of direct communication between terminals in multipoint conference in the memory, works as institute
It states when program is executed by the processor for realizing terminal room code stream direct communication in the multipoint conference of above-mentioned receiving end
Step in method.
According to an aspect of the present invention, a kind of computer readable storage medium is provided, including：It is described computer-readable to deposit
Direct communication between terminals program in multipoint conference is stored on storage media, direct communication between terminals program quilt in the multipoint conference
Processor realizes the step in the multipoint conference of above-mentioned transmitting terminal in the method for terminal room code stream direct communication when executing.
According to an aspect of the present invention, a kind of computer readable storage medium is provided, including：It is described computer-readable to deposit
Direct communication between terminals program in multipoint conference is stored on storage media, direct communication between terminals program quilt in the multipoint conference
Processor realizes the step in the multipoint conference of above-mentioned receiving end in the method for terminal room code stream direct communication when executing.
The present invention has the beneficial effect that：
Transmitting terminal and receiving end are by the straight-through signaling of multipoint control unit forwarding code stream in the embodiment of the present invention, according to code stream
Straight-through signaling negotiation directly establishes straight-through code stream, therefore forwarding and processing the invention avoids MCU to code stream, reduces two
The audio-video time delay of terminal enriches the usage scenario of multipoint conference terminal in the case where not influencing MCU performance and bandwidth situation.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
In order to illustrate the embodiments of the present invention more clearly or it is existing in scheme, below will be in embodiment or existing description
Required attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only of the invention some
Embodiment without any creative labor, can also be according to these attached drawings for ordinary people in the field
Obtain other attached drawings.
Fig. 1 is the method flow diagram of direct communication between terminals in multipoint conference in first embodiment of the invention；
Fig. 2 is the method flow diagram of direct communication between terminals in multipoint conference in second embodiment of the invention；
Fig. 3 is the method flow diagram of direct communication between terminals in multipoint conference in third embodiment of the invention；
Fig. 4 is that terminal room cancels the method flow diagram of direct communication in multipoint conference in third embodiment of the invention；
Fig. 5 is the equipment principle block diagram of direct communication between terminals in multipoint conference in fourth embodiment of the invention；
Fig. 6 is the equipment principle block diagram of direct communication between terminals in multipoint conference in fifth embodiment of the invention.
Specific embodiment
Below in conjunction with attached drawing and embodiment, the present invention will be described in further detail.It should be appreciated that described herein
Specific embodiment be only used to explain the present invention, limit the present invention.
The method of direct communication between terminals in multipoint conference provided by the present invention carries out code stream by MCU between terminal
The negotiation of straight-through signaling, according to the interaction that can directly carry out code stream between two terminals of result after negotiation.Here code stream
Straight-through signaling includes that code stream leads directly to the straight-through confirmation signaling of demand signalling and code stream, can be with according to the information carried in two signalings
Realize the straight-through code stream interaction of terminal.
In the embodiment of the present invention, it includes code stream behaviour that code stream, which leads directly to demand signalling and the signaling format of the straight-through confirmation signaling of code stream,
Make the fields such as type, source mark, destination mark, code stream type, code stream transmit-receive position and media configuration information；Wherein,
Code stream action type includes requesting and agreeing to two types, and it is request type that code stream, which leads directly to demand signalling, and the straight-through confirmation of code stream
Signaling is grant type；Code stream type includes audio and/or video；Code stream transmit-receive position includes transmission, receives or receive and dispatch double
To；Media configuration information field then includes media to the corresponding codec parameters of code stream type and the transmitting-receiving of local code stream
Location information.
Embodiment 1
According to embodiments of the present invention, a kind of method of direct communication between terminals in multipoint conference is provided, as shown in Figure 1, with
In transmitting terminal, specifically comprise the following steps：
Step 101, code stream is led directly into demand signalling and receiving end is forwarded to by multipoint control unit.
Specifically, in this step, transmitting terminal when receive need two terminals between interact instruction after, according to
Configuration information generates code stream and leads directly to demand signalling, and the signaling is sent in multipoint control unit.Here configuration information
Can be preset for terminal, it can also be configured according to actual needs for user.Wherein, the straight-through request of code stream is being generated
When signaling, including：
It is request type by code stream action type field configuration；
It is audio and/or video that code stream type field, which is arranged,；
It is transmission/reception/transmitting-receiving bidirectional by code stream transmit-receive position field configuration；
The codec parameters of configuration bit stream and the media address letter of local code stream transmitting-receiving in media configuration information field
Breath.
Here, it when code stream type field is arranged, is determined according to the concrete ability of transmitting terminal.And code stream transmit-receive position
When, it can be configured by user or be determined according to the ability of local terminal.And for codec parameters can there are many, to connect
Receiving end is according to actual needs or selected by ability；The media address information of code stream transmitting-receiving is then obtained from local, here
Media address is generally the port IP of equipment.
Step 102, the straight-through confirmation signaling of code stream of the receiving end feedback of multipoint control unit forwarding is received, and according to feedback
The straight-through confirmation signaling of code stream and receiving end carry out the interaction of straight-through code stream.
It is straight based on code stream after receiving end receives the straight-through demand signalling of transmitting terminal transmitted stream by multipoint control unit
Field in logical demand signalling negotiates to generate the straight-through confirmation signaling of code stream.Transmitting terminal is according to the field in the straight-through confirmation signaling of code stream
The interaction of straight-through code stream is established in information and receiving end.
Here code stream action type field configuration is grant type in the straight-through confirmation signaling of code stream；Code stream type field with
It is consistent to send client information.Code stream transmit-receive position is determined according to the information in the straight-through confirmation signaling of code stream.Media configuration information
Codec parameters are then determined according to code stream type and obtain specific media address information from local terminal, it is subsequent to be introduced, this
In no longer illustrate.
Transmitting terminal carries out the interaction of straight-through code stream, packet in the straight-through confirmation signaling of the code stream fed back according to receiving end and receiving end
It includes：
Code stream type and media configuration information are obtained from the straight-through confirmation signaling of code stream；
Encoding and decoding are carried out according to type of the codec parameters to code stream type set；
The transmitting-receiving process of straight-through code stream is carried out according to the media address information of code stream transmitting-receiving and receiving end.
Here, encoding and decoding are carried out according to codec parameters, to guarantee that two terminals carry out sound with maximum coding/decoding capability
Video communication improves the communication quality of two terminals.Wherein, when carrying out transmitting-receiving process, demand signalling is led directly to according to code stream and is matched
The code stream transmit-receive position set carries out.For example, transmitting terminal is configured to sending direction, then the transmission of straight-through code stream is only carried out；Configuration
For receiving direction, then the reception of straight-through code stream is only carried out；When transmitting terminal is configured to transmitting-receiving bidirectional, then straight-through code stream can be carried out simultaneously
Send and receive.
Further, transmitting terminal and receiving end stopping code stream are straight-through in the embodiment of the present invention, need real as follows
It is existing, it specifically includes：
The straight-through cancellation signaling of code stream is sent to receiving end by multipoint control unit, to stop the straight-through code stream with receiving end
Interaction；Alternatively,
Receive the straight-through cancellation signaling of receiving end transmitted stream forwarded by multipoint control unit, stopping and receiving end
Straight-through code stream interaction.
It is found that transmitting terminal can actively stop leading directly to the straight-through code stream that can also passively stop of the code stream of receiving end.This
In the straight-through cancellation of code stream, also need forwarding of the multipoint control unit as intermediate equipment progress signaling.Here code stream
The straight-through source mark and destination mark cancelled in signaling equally including signaling.
Embodiment 2
According to embodiments of the present invention, a kind of method of direct communication between terminals in multipoint conference is provided, as shown in Fig. 2, with
In receiving end, specifically comprise the following steps：
Step 201, the straight-through demand signalling of transmitting terminal transmitted stream that reception is forwarded by multipoint control unit, and according to
Code stream leads directly to demand signalling and generates the straight-through confirmation signaling of code stream.
In this step, after receiving the straight-through demand signalling of code stream, parsing is carried out to signaling and obtains the word that signaling is included
Segment information, and generate code stream according to the actual conditions of field information combination local terminal and lead directly to and confirm that instruction is anti-by multipoint control unit
It is fed to transmitting terminal.
Specifically, it when leading directly to demand signalling according to code stream and generating the straight-through confirmation signaling of code stream, specifically includes：
It is grant type by code stream action type field configuration；
Configuring straight-through code stream type field is the straight-through code stream type that code stream is led directly in demand signalling；
When the code stream transmit-receive position field that code stream leads directly to demand signalling is transmission/reception/transmitting-receiving bidirectional, code stream is straight-through true
The code stream transmit-receive position field configuration for recognizing signaling is reception/transmission/transmitting-receiving bidirectional；
The media configuration information field in demand signalling, which is led directly to, according to code stream combines local media configuring condition option code
The codec parameters of stream, from the local media address information for obtaining code stream and receiving and dispatching, and codec parameters and media address information are matched
Set the media configuration information field into the straight-through confirmation signaling of code stream.
Wherein, when selecting the transmit-receive position of corresponding straight-through code stream of local terminal, including：If the code stream of transmitting terminal is received and dispatched
Direction is to send, and the code stream transmit-receive position of receiving end is to receive；If the code stream transmit-receive position of transmitting terminal is to receive, receiving end
Code stream transmit-receive position is to send；If the code stream transmit-receive position of transmitting terminal is transmit-receive position, the code stream transmit-receive position of receiving end is
Transmit-receive position.
Here, when determining codec parameters, the volume solution of media configuration information field in demand signalling is led directly to according to code stream
The configuring condition of code parameter and local chooses optimal codec parameters, to guarantee two terminals with maximum encoding and decoding energy
Power carries out audio/video communication, improves the communication quality of two terminals.
Step 202, the straight-through confirmation signaling of code stream is forwarded to transmitting terminal by multipoint control unit, and is carried out with transmitting terminal
The interaction of straight-through code stream.
In this step, code stream is led directly to after confirming signaling, while leads directly to field information and the transmission of signaling according to code stream
End carries out the interaction of straight-through code stream, specifically includes：
Encoding and decoding are carried out to the type of code stream type set according to the codec parameters in the straight-through confirmation signaling of code stream；Root
The media address information and transmitting terminal led directly in demand signalling according to code stream carries out the transmitting-receiving process of straight-through code stream.
Here, when communicating with transmitting terminal foundation, the media of the code stream transmitting-receiving configured in demand signalling are led directly to according to code stream
Address information carries out code stream transmitting-receiving.Wherein, it when carrying out code stream transmitting-receiving, is received and dispatched according to the code stream in the straight-through confirmation signaling of code stream
Direction determines.For example, being sending direction, the transmission of code stream is only carried out；When for transmitting-receiving bidirectional, at the same carry out code stream transmission and
It receives.
Further, receiving end specifically includes as follows when straight-through with transmitting terminal stopping code stream：
Forward code stream is straight-through to cancel signaling to transmitting terminal by multipoint control unit, to stop the straight-through code stream with transmitting terminal
Interaction；Alternatively,
Receive the straight-through cancellation signaling of transmitting terminal transmitted stream forwarded by multipoint control unit, stopping and transmitting terminal
Straight-through code stream interaction.
Based on above-mentioned it is found that transmitting terminal and receiving end are straight-through by multipoint control unit negotiation code stream in the embodiment of the present invention
Signaling, parameter information needed for obtaining straight-through code stream according to each field in signaling；According to two terminals of the parameter information
It is straight-through directly to establish code stream.Therefore, the code stream of two terminal rooms of the invention is straight-through, avoids forwarding and processing of the MCU to code stream,
The audio-video time delay of two terminals is reduced, and audio/video communication can be carried out with two terminal maximum coding/decoding capabilities, is made
Communicating pair can obtain optimal audio/video communication effect.
Embodiment 3
Technology contents of the invention are described in further detail in the following with reference to the drawings and specific embodiments.
The purpose of the present invention is the one-way or bi-directional of terminal room audio, video or audio-video code stream is realized in multipoint conference
Direct communication realizes optimal communication effect, enriches the usage scenario of user.Here, will initiate the straight-through terminal definitions of code stream is hair
Sending end is receiving end by the terminal definitions of the straight-through request of code stream are received.As shown in figure 3, a specific embodiment of the invention specifically wraps
Include following steps：
Step 301, in multipoint conference, the receiving end that transmitting terminal selects code stream straight-through is sent out to MCU (multipoint control unit)
Code stream is sent to lead directly to demand signalling.
Here, it includes code stream direct mode operation type, receiving end mark, transmitting terminal mark, straight-through code in signaling that code stream, which is led directly to,
The type of stream, the transmit-receive position of code stream, local terminal media configuration information.
Code stream leads directly to signaling transmitting terminal and receiving end and can send.Wherein, action type includes request and agrees to, is sent
Holding the type is request, and receiving end the type is to agree to.Straight-through code stream type is divided into audio, video or audio-video；The receipts of code stream
Originating party is to being divided into transmission, reception or transmitting-receiving bidirectional；Media information includes audio, video or audio-video according to straight-through code stream type
The media address information of codec parameters and code stream transmitting-receiving.
Step 302, the code stream that MCU receives transmitting terminal leads directly to demand signalling, leads directly to from code stream and identifies reception in demand signalling
End mark, is transmitted to receiving end for the signaling.
Step 303, it after receiving end receives the straight-through demand signalling of code stream, is led directly to according to code stream and leads directly to code stream class in demand signalling
Type and code stream lead directly to the corresponding straight-through code stream type and transmit-receive position of the code stream transmit-receive position selection local terminal in signaling；According to hair
The media information of sending end and the media information of local terminal select appropriate code/decode format, by the straight-through confirmation signaling of code stream after negotiation
It is sent to MCU (step 3031), the encoding and decoding and code stream for then carrying out audio, video or audio-video receive, at transmission or transmitting-receiving
Manage (step 3032).
Step 304, after the code stream that MCU receives receiving end leads directly to confirmation signaling, identify that transmitting terminal identifies in the signaling, by this
Signaling is sent to the straight-through transmitting terminal of code stream.
Step 305, after the code stream that transmitting terminal receives MCU forwarding leads directly to signaling, the media information of receiving end is determined, according to connecing
The media information of receiving end carries out the encoding and decoding and code stream reception, transmission or transmitting-receiving process of audio, video or audio-video.
Further, when terminal needs to restore non-code stream direct-passing mode, terminal transmission signals other side and cancels code stream
Direct mode operation restores the multi-point mode of original upper MCU.That is, above-mentioned transmitting terminal and receiving end can be carried out
Cancel.For example, two terminals of A and B that code stream is straight-through, are not distinguishing transmitting terminal and receiving end here.Terminal A cancel process into
Row explanation, as shown in figure 4, including：
Step 401, terminal A sends the straight-through signaling of cancelling of code stream to MCU.Wherein the straight-through signaling of cancelling of code stream includes that code stream is straight
The logical source mark and destination mark for cancelling operation.
Step 402, it after the code stream that MCU receives terminal A leads directly to cancellation signaling, is identified according to the destination in signaling content true
Determine purpose terminal, the straight-through signaling of cancelling of code stream is transmitted to terminal B.
Step 403, after terminal B receives the straight-through letter cancellation signaling of code stream, cancel and lead directly to relevant treatment stream with the code stream of terminal A
Journey stops the media encoding and decoding and code stream transmitting-receiving process led directly to the code stream between terminal A.
Based on above-mentioned it is found that the present invention is under multipoint conference, in meeting only there are two participant in a meeting when, reach
Audio-video dialogue effect is similar to the video conference of point-to-point mode, and effectively saves the performance and bandwidth of MCU, improves call
Quality.And under subtended conference scene, since MCU is without carrying out code stream forwarding, two meeting-place can with direct dialogue and
The choosing for carrying out scene is seen, and does not influence the viewing in other meeting-place, effectively improves the usage experience of user.
Embodiment 4
The embodiment of the invention also provides a kind of equipment of direct communication between terminals in multipoint conference, to realize embodiment
1 method, as shown in figure 5, the equipment includes processor 52 and the memory 51 for being stored with 52 executable instruction of processor.Its
In, processor 52 can be general processor, such as central processing unit (central processing unit, CPU), may be used also
To be digital signal processor (digital signal processor, DSP), specific integrated circuit (application
Specific integrated circuit, ASIC), or be arranged to implement the one or more of the embodiment of the present invention
Integrated circuit.Memory 51 is transferred to CPU for storing program code, and by the program code.Memory 51 may include easy
The property lost memory (volatile memory), such as random access memory (random access memory, RAM)；Storage
Device 51 also may include nonvolatile memory (non-volatile memory), such as read-only memory (read-only
Memory, ROM), flash memory (flash memory), hard disk (hard disk drive, HDD) or solid state hard disk
(solid-state drive, SSD)；Memory 51 can also include the combination of the memory of mentioned kind.
According to embodiments of the present invention, a kind of equipment of direct communication between terminals in multipoint conference, including memory are provided
51 and processor 52；Wherein, the program that direct communication between terminals in multipoint conference are stored in memory 51, when the program is processed
When device 52 executes, to realize following steps：
Code stream is led directly into demand signalling, receiving end is forwarded to by multipoint control unit；
The straight-through confirmation signaling of code stream of the receiving end feedback of multipoint control unit forwarding is received, and straight according to the code stream of feedback
Logical confirmation signaling and receiving end carry out the interaction of straight-through code stream.
Further, code stream lead directly to the signaling format of the straight-through confirmation signaling of demand signalling/code stream include code stream action type,
Source mark, destination mark, code stream type, code stream transmit-receive position and media configuration information field.
Further, when the program of direct communication between terminals in multipoint conference is executed by processor 52, to realize such as
Lower step：
It is request type by code stream action type field configuration when generation code stream leads directly to demand signalling；Code stream class is set
Type-word section is audio and/or video, is transmission/reception/transmitting-receiving bidirectional by code stream transmit-receive position field configuration；Match confidence in media
Cease the codec parameters of configuration bit stream and the media address information of code stream transmitting-receiving in field.
Further, when the program of direct communication between terminals in multipoint conference is executed by processor 52, to realize such as
Lower step：
Code stream type and media configuration information are obtained from the straight-through confirmation signaling of the code stream of feedback；According to media configuration information
In codec parameters encoding and decoding are carried out to the type of code stream type set；According to the matchmaker of the code stream transmitting-receiving in media configuration information
Body address information carries out the transmitting-receiving process of straight-through code stream to receiving end.
Further, when the program of direct communication between terminals in multipoint conference is executed by processor 52, also to realize
Following steps：
The straight-through cancellation signaling of code stream is sent to receiving end by multipoint control unit, to stop the straight-through code stream with receiving end
Interaction；Alternatively, receiving, the receiving end transmitted stream forwarded by multipoint control unit is straight-through to cancel signaling, stops and receives
The straight-through code stream interaction at end.
Embodiment 5
The embodiment of the invention also provides a kind of equipment of direct communication between terminals in multipoint conference, to realize embodiment
Method in 2, as shown in fig. 6, the equipment includes processor 62 and the memory 61 for being stored with 62 executable instruction of processor.
Wherein, processor 62 can be general processor, such as central processing unit, can also be digital signal processor, dedicated integrated
Circuit, or be arranged to implement one or more integrated circuits of the embodiment of the present invention.Memory 61, for storing program
Code, and the program code is transferred to CPU.Memory 61 may include volatile memory, such as random access memory；
Memory 61 also may include nonvolatile memory, such as read-only memory, flash memory, hard disk or solid state hard disk；It deposits
Reservoir 61 can also include the combination of the memory of mentioned kind.
According to embodiments of the present invention, a kind of equipment of direct communication between terminals in multipoint conference, including memory are provided
61 and processor 62；Wherein, the program that direct communication between terminals in multipoint conference are stored in memory 61, when the program is processed
When device 62 executes, to realize following steps：
It receives and demand signalling is led directly to by the transmitting terminal transmitted stream that multipoint control unit forwards, and is straight-through according to code stream
Demand signalling generates the straight-through confirmation signaling of code stream；
The straight-through confirmation signaling of code stream is forwarded to transmitting terminal by multipoint control unit, and carries out straight-through code stream with transmitting terminal
Interaction.
Further, code stream lead directly to the signaling format of the straight-through confirmation signaling of demand signalling/code stream include code stream action type,
Source mark, destination mark, code stream type, code stream transmit-receive position and media configuration information field.
Further, when the program of direct communication between terminals in multipoint conference is executed by processor 62, to realize such as
Lower step：
It is grant type by code stream action type field configuration；
Configuring straight-through code stream type field is the straight-through code stream type that code stream is led directly in demand signalling；
When the code stream transmit-receive position field that code stream leads directly to demand signalling is transmission/reception/transmitting-receiving bidirectional, code stream is straight-through true
The code stream transmit-receive position field configuration for recognizing signaling is reception/transmission/transmitting-receiving bidirectional；
The media configuration information field in demand signalling, which is led directly to, according to code stream combines local media configuring condition option code
The codec parameters of stream, from the local media address information for obtaining code stream and receiving and dispatching, and codec parameters and media address information are matched
Set the media configuration information field into the straight-through confirmation signaling of code stream.
Further, when the program of direct communication between terminals in multipoint conference is executed by processor 62, to realize such as
Lower step：
Encoding and decoding are carried out to the type of code stream type set according to the codec parameters in the straight-through confirmation signaling of code stream；Root
The media address information and transmitting terminal led directly in demand signalling according to code stream carries out the transmitting-receiving process of straight-through code stream.
Further, when the program of direct communication between terminals in multipoint conference is executed by processor 62, also to realize
Following steps：
Forward code stream is straight-through to cancel signaling to transmitting terminal by multipoint control unit, to stop the straight-through code stream with transmitting terminal
Interaction；Alternatively, receiving, the transmitting terminal transmitted stream forwarded by multipoint control unit is straight-through to cancel signaling, stops and sends
The straight-through code stream interaction at end.
Embodiment 6
The embodiment of the invention also provides a kind of computer readable storage mediums.Here computer readable storage medium is deposited
It contains and is stored with direct communication between terminals program in multipoint conference.Wherein, computer readable storage medium may include volatibility
Memory, such as random access memory；Memory also may include nonvolatile memory, such as read-only memory, quick flashing
Memory, hard disk or solid state hard disk；Memory can also include the combination of the memory of mentioned kind.When computer-readable storage
Program in medium can be executed by one or more processor, in multipoint conference provided in implementation method embodiment 1
The step of direct communication between terminals method.
Embodiment 7
The embodiment of the invention also provides a kind of computer readable storage mediums.Here computer readable storage medium is deposited
It contains and is stored with direct communication between terminals program in multipoint conference.Wherein, computer readable storage medium may include volatibility
Memory, such as random access memory；Memory also may include nonvolatile memory, such as read-only memory, quick flashing
Memory, hard disk or solid state hard disk；Memory can also include the combination of the memory of mentioned kind.When computer-readable storage
Program in medium can be executed by one or more processor, in multipoint conference provided in implementation method embodiment 2
The step of direct communication between terminals method.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, program can be stored in computer-readable storage medium, the journey
Sequence is when being executed, it may include such as the process of the embodiment of above-mentioned each method.
Although describing the application by embodiment, it will be apparent to one skilled in the art that the application is there are many deformation and becomes
Change without departing from the spirit and scope of the present invention.If being wanted in this way, these modifications and changes of the present invention belongs to right of the present invention
Ask and its equivalent technologies within the scope of, then the present invention is also intended to include these modifications and variations.
Claims (14)
1. a kind of method of direct communication between terminals in multipoint conference, which is characterized in that including：
Code stream is led directly into demand signalling, receiving end is forwarded to by multipoint control unit；
The straight-through confirmation signaling of code stream of the receiving end feedback of the multipoint control unit forwarding is received, and according to the feedback
The straight-through confirmation signaling of code stream and the receiving end carry out the interaction of straight-through code stream.
2. the method as described in claim 1, which is characterized in that the code stream leads directly to the straight-through confirmation signaling of demand signalling/code stream
Signaling format include code stream action type, source mark, destination mark, code stream type, code stream transmit-receive position and media
Configuration information field.
3. method according to claim 2, which is characterized in that when the generation code stream leads directly to demand signalling, including：
It is request type by the code stream action type field configuration；Be arranged the code stream type field be audio and/or video,
It is transmission/reception/transmitting-receiving bidirectional by the code stream transmit-receive position field configuration；The configuration code in the media configuration information field
The media address information of codec parameters and the code stream transmitting-receiving of stream.
4. method according to claim 2, which is characterized in that the straight-through confirmation signaling of the code stream according to the feedback and institute
The interaction that receiving end carries out straight-through code stream is stated, including：
Code stream type and media configuration information are obtained from the straight-through confirmation signaling of the code stream of the feedback；
Encoding and decoding are carried out according to type of the codec parameters in the media configuration information to the code stream type set；
Straight-through code stream is carried out to the receiving end according to the media address information of the code stream transmitting-receiving in the media configuration information
Transmitting-receiving process.
5. the method as described in claim 1, which is characterized in that the method also includes：
The straight-through cancellation signaling of code stream is sent to the receiving end by the multipoint control unit, to stop and the receiving end
Straight-through code stream interaction；Alternatively,
Receive the straight-through cancellation signaling of the receiving end transmitted stream forwarded by the multipoint control unit, stopping and institute
State the straight-through code stream interaction of receiving end.
6. a kind of method of direct communication between terminals in multipoint conference, which is characterized in that including：
It receives and demand signalling is led directly to by the transmitting terminal transmitted stream that multipoint control unit forwards, and is straight-through according to the code stream
Demand signalling generates the straight-through confirmation signaling of code stream；
The straight-through confirmation signaling of the code stream is forwarded to the transmitting terminal by the multipoint control unit, and with the transmitting terminal
Carry out the interaction of straight-through code stream.
7. method as claimed in claim 6, which is characterized in that the code stream leads directly to the straight-through confirmation of demand signalling/code stream
The signaling format of signaling include code stream action type, source mark, destination mark, code stream type, code stream transmit-receive position and
Media configuration information field.
8. the method for claim 7, which is characterized in that described to lead directly to the demand signalling generation code according to the code stream
The straight-through confirmation signaling of stream, including：
It is grant type by the code stream action type field configuration；
Configuring straight-through code stream type field is the straight-through code stream type that the code stream is led directly in demand signalling；
When the code stream transmit-receive position field that the code stream leads directly to demand signalling is transmission/reception/transmitting-receiving bidirectional, the code stream is straight
The code stream transmit-receive position field configuration of logical confirmation signaling is reception/transmission/transmitting-receiving bidirectional；
Local media configuring condition option code is combined according to the media configuration information field that the code stream is led directly in demand signalling
The codec parameters of stream, from the local media address information for obtaining code stream and receiving and dispatching, and the codec parameters and the media
Media configuration information field of the location information configuration into the straight-through confirmation signaling of the code stream.
9. method according to claim 8, which is characterized in that the interaction for carrying out straight-through code stream with the transmitting terminal, packet
It includes：
Volume solution is carried out to the type of the code stream type set according to the codec parameters in the straight-through confirmation signaling of the code stream
Code；
The media address information and the transmitting terminal led directly in demand signalling according to the code stream carries out at the transmitting-receiving of straight-through code stream
Reason.
10. method as claimed in claim 6, which is characterized in that the method also includes：
Forward code stream is straight-through to cancel signaling to the transmitting terminal by the multipoint control unit, to stop and the transmitting terminal
Straight-through code stream interaction；Alternatively,
Receive the straight-through cancellation signaling of the transmitting terminal transmitted stream forwarded by the multipoint control unit, stopping and institute
State the straight-through code stream interaction of transmitting terminal.
11. the equipment of terminal room code stream direct communication in a kind of multipoint conference, which is characterized in that including memory and processor：
Wherein, the program of direct communication between terminals in multipoint conference is stored in the memory, when described program is by the processor
For realizing the step in any one of Claims 1 to 5 the method when execution.
12. the equipment of terminal room code stream direct communication in a kind of multipoint conference, which is characterized in that including：Including memory and place
Manage device：Wherein, the program of direct communication between terminals in multipoint conference is stored in the memory, when described program is by the place
It manages when device executes for realizing the step in any one of claim 6~10 the method.
13. a kind of computer readable storage medium, which is characterized in that including：It is stored on the computer readable storage medium
Direct communication between terminals program in multipoint conference, it is real when direct communication between terminals program is executed by processor in the multipoint conference
The step of any one of existing Claims 1 to 5 the method.
14. a kind of computer readable storage medium, which is characterized in that including：It is stored on the computer readable storage medium
Direct communication between terminals program in multipoint conference, it is real when direct communication between terminals program is executed by processor in the multipoint conference
The step of any one of existing claim 6~10 the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710369272.2A CN108933759B (en) | 2017-05-23 | 2017-05-23 | Method, equipment and storage medium for direct communication between terminals in multipoint conference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710369272.2A CN108933759B (en) | 2017-05-23 | 2017-05-23 | Method, equipment and storage medium for direct communication between terminals in multipoint conference |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108933759A true CN108933759A (en) | 2018-12-04 |
| CN108933759B CN108933759B (en) | 2022-04-22 |
Family
ID=64450982
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710369272.2A Active CN108933759B (en) | 2017-05-23 | 2017-05-23 | Method, equipment and storage medium for direct communication between terminals in multipoint conference |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108933759B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101098244A (en) * | 2006-06-26 | 2008-01-02 | 华为技术有限公司 | Method and system for media process in multi-point conference |
| CN101594512A (en) * | 2009-06-30 | 2009-12-02 | 中兴通讯股份有限公司 | Realize terminal, multipoint control unit, the system and method for high definition multiple images |
| US20100073457A1 (en) * | 2007-03-21 | 2010-03-25 | Huawei Technologies Co., Ltd. | Method and device for realizing private session in multipoint conference |
| US20110279629A1 (en) * | 2010-05-13 | 2011-11-17 | Gautam Khot | Conducting a Direct Private Videoconference Within a Videoconference |
| US20110279628A1 (en) * | 2010-05-13 | 2011-11-17 | Gautam Khot | Conducting a Private Videoconference Within a Videoconference via an MCU |
| US20140368605A1 (en) * | 2012-03-08 | 2014-12-18 | Huawei Technologies Co., Ltd. | Remote Conference Control Method, Terminal Equipment, MCU, and Video Conferencing System |
-
2017
- 2017-05-23 CN CN201710369272.2A patent/CN108933759B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101098244A (en) * | 2006-06-26 | 2008-01-02 | 华为技术有限公司 | Method and system for media process in multi-point conference |
| US20100073457A1 (en) * | 2007-03-21 | 2010-03-25 | Huawei Technologies Co., Ltd. | Method and device for realizing private session in multipoint conference |
| CN101594512A (en) * | 2009-06-30 | 2009-12-02 | 中兴通讯股份有限公司 | Realize terminal, multipoint control unit, the system and method for high definition multiple images |
| US20110279629A1 (en) * | 2010-05-13 | 2011-11-17 | Gautam Khot | Conducting a Direct Private Videoconference Within a Videoconference |
| US20110279628A1 (en) * | 2010-05-13 | 2011-11-17 | Gautam Khot | Conducting a Private Videoconference Within a Videoconference via an MCU |
| US20140368605A1 (en) * | 2012-03-08 | 2014-12-18 | Huawei Technologies Co., Ltd. | Remote Conference Control Method, Terminal Equipment, MCU, and Video Conferencing System |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108933759B (en) | 2022-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5749375B2 (en) | Multi-user real-time transcoding system and method for multimedia sessions | |
| KR100373323B1 (en) | Method of multipoint video conference in video conferencing system | |
| CN104813655B (en) | The method of preview caller in videoconference session | |
| JP5320406B2 (en) | Audio processing method, system, and control server | |
| AU2011305593B2 (en) | System and method for the control and management of multipoint conferences | |
| US9596433B2 (en) | System and method for a hybrid topology media conferencing system | |
| EP3197153B1 (en) | Method and system for conducting video conferences of diverse participating devices | |
| CN104902111B (en) | A kind of method, apparatus and system established based on Web RTC multi-party call | |
| JP2019530996A (en) | Method and apparatus for use of compact parallel codec in multimedia communications | |
| US10021349B2 (en) | Conference migration method, apparatus, and system | |
| US10063609B2 (en) | Methods and apparatus for multimedia conferences using single source multi-unicast | |
| WO2006038336A1 (en) | Tunnel device, relay device, terminal device, call control system, ip telephone system, conference device, and their control method and program | |
| TW201006289A (en) | Method, user equipment and software product for media stream transfer between devices | |
| CN101146208A (en) | Terminal with built-in multiple-point control unit and its communication method | |
| US9369511B2 (en) | Telecommunication network | |
| CN103780403A (en) | Telephone conference processing method, device and system | |
| CN104869106A (en) | Sound recording method, voice switching equipment, sound recording server and sound recording system | |
| CN103636179B (en) | For the method and apparatus of the Media Stream marshalling in multimedia communication network | |
| CN104735034B (en) | Transmission method, the apparatus and system of Media Stream | |
| US9338402B2 (en) | Method and system for using mesh control for video conferencing bridges and cascading conferences | |
| CN111835674A (en) | Communication method, communication device, first network element and communication system | |
| US9936164B2 (en) | Media control method and device | |
| CN108933759A (en) | Method, equipment and the storage medium of direct communication between terminals in a kind of multipoint conference | |
| CN101753571A (en) | Method, device and system for realizing double video flow transmission | |
| ES2795281T3 (en) | Media Stream Management System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |