CN111866580B - H.239-based auxiliary stream negotiation method and terminal equipment - Google Patents
H.239-based auxiliary stream negotiation method and terminal equipment Download PDFInfo
- Publication number
- CN111866580B CN111866580B CN202010520476.3A CN202010520476A CN111866580B CN 111866580 B CN111866580 B CN 111866580B CN 202010520476 A CN202010520476 A CN 202010520476A CN 111866580 B CN111866580 B CN 111866580B
- Authority
- CN
- China
- Prior art keywords
- auxiliary
- signaling
- auxiliary stream
- flow channel
- channel opening
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000011664 signaling Effects 0.000 claims abstract description 186
- 238000012544 monitoring process Methods 0.000 claims abstract description 12
- 108091006146 Channels Proteins 0.000 claims description 337
- 238000004891 communication Methods 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 14
- 230000004913 activation Effects 0.000 claims description 10
- 239000000284 extract Substances 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 2
- 230000009849 deactivation Effects 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 241000136406 Comones Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
- H04N21/4382—Demodulation or channel decoding, e.g. QPSK demodulation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/633—Control signals issued by server directed to the network components or client
- H04N21/6332—Control signals issued by server directed to the network components or client directed to client
- H04N21/6336—Control signals issued by server directed to the network components or client directed to client directed to decoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4347—Demultiplexing of several video streams
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an H.239-based auxiliary stream negotiation method and terminal equipment. The auxiliary stream negotiation method is suitable for terminal equipment provided with a signaling negotiation module and a decoding module; the auxiliary stream negotiation method comprises the following steps: receiving an auxiliary flow channel opening request initiated by a far-end device through the signaling negotiation module, so as to open an auxiliary flow channel according to an auxiliary flow signaling sent by the far-end device, and notifying the decoding module of opening the auxiliary flow channel; and monitoring whether the far-end equipment sends the auxiliary stream data or not in real time after the auxiliary stream channel is opened through the decoding module, and informing the signaling negotiation module to close the auxiliary stream channel when the far-end equipment does not send the auxiliary stream data. The invention can solve the problem of auxiliary stream negotiation compatibility between different terminals or between the terminal and the server, and improve the success rate of auxiliary stream negotiation.
Description
Technical Field
The invention relates to the technical field of multimedia communication, in particular to an auxiliary stream negotiation method and terminal equipment based on H.239.
Background
H.239 is an additional media channel for Dual video streaming (Dual Stream) applications in H.32x and H.245 systems. The double-current technology can be regarded as an application of H.239, namely, high-definition image-text information is transmitted to the opposite side in a band while moving images are transmitted, and encoding and decoding equipment of the opposite side can solve the moving images and the high-resolution image-texts, so that the images can be transmitted to a plurality of meeting points through the same bandwidth, and the opposite side can clearly display files.
With the wide application of the h.239 dual-flow technology, the h.239 dual-flow technology gradually develops some problems. Although h.239 has defined the technical standard of multiple video streams, the compatibility issue needs to be solved in the implementation details of its application. Generally, the current dual-flow technology is mostly used inside a manufacturer system platform, and the intercommunication between different manufacturers is difficult. When devices of different manufacturers are connected in a butt joint mode, due to differences in implementation modes, h.239 negotiation abnormity between different terminals or between a terminal and a server is easy to occur, and compatibility problems such as call interruption and black screen occurrence in auxiliary stream receiving are prone to occur.
Disclosure of Invention
The invention provides an auxiliary stream negotiation method and terminal equipment based on H.239, which are used for overcoming the defects of the prior art.
In order to solve the foregoing technical problem, in a first aspect, an embodiment of the present invention provides an auxiliary stream negotiation method based on h.239, which is applicable to a terminal device provided with a signaling negotiation module and a decoding module;
the auxiliary stream negotiation method comprises the following steps:
receiving an auxiliary flow channel opening request initiated by a far-end device through the signaling negotiation module, so as to open an auxiliary flow channel according to an auxiliary flow signaling sent by the far-end device, and notifying the decoding module of the opening of the auxiliary flow channel;
and monitoring whether the far-end equipment sends the auxiliary stream data or not in real time after the auxiliary stream channel is opened through the decoding module, and informing the signaling negotiation module to close the auxiliary stream channel when the far-end equipment does not send the auxiliary stream data.
Further, the receiving, by the signaling negotiation module, an auxiliary stream channel opening request initiated by a remote device, so as to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and notifying the decoding module of opening the auxiliary stream channel includes:
receiving the auxiliary flow channel opening request, and extracting the equipment name of the remote equipment from the auxiliary flow channel opening request;
matching and obtaining a corresponding auxiliary flow channel opening mode from a pre-stored configuration list according to the equipment name; the pre-stored configuration list represents the corresponding relation between the pre-stored equipment name and the pre-stored auxiliary channel opening mode;
and based on the auxiliary stream channel opening mode, opening the auxiliary stream channel when the auxiliary stream signaling is correct, and informing the decoding module that the auxiliary stream channel is opened.
Further, the receiving, by the signaling negotiation module, an auxiliary stream channel opening request initiated by a remote device, so as to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and notifying the decoding module that the auxiliary stream channel is opened, further includes:
and when the matching of the equipment name and the pre-stored configuration list fails, obtaining a universal auxiliary flow channel opening mode from the pre-stored configuration list.
Further, the monitoring, by the decoding module, whether the far-end device has transmitted the auxiliary stream data in real time after the auxiliary stream channel is opened, and notifying the signaling negotiation module to close the auxiliary stream channel when the far-end device does not transmit the auxiliary stream data, further includes:
and when the far-end equipment sends the auxiliary stream data, decoding the auxiliary stream data to obtain decoded data.
Further, before the receiving, by the signaling negotiation module, a secondary flow channel opening request initiated by a remote device, the method further includes:
and establishing a communication channel between the terminal equipment and the far-end equipment through the signaling negotiation module, so that the far-end equipment initiates the auxiliary channel opening request through the communication channel.
In a second aspect, an embodiment of the present invention provides an h.239-based auxiliary stream negotiation terminal device, including a signaling negotiation module and a decoding module;
the signaling negotiation module is configured to receive an auxiliary stream channel opening request initiated by a remote device, open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and notify the decoding module that the auxiliary stream channel is opened;
the decoding module is configured to monitor whether the far-end device has transmitted the auxiliary stream data in real time after the auxiliary stream channel is opened, and notify the signaling negotiation module to close the auxiliary stream channel when the far-end device does not transmit the auxiliary stream data.
Further, the receiving an auxiliary stream channel opening request initiated by a remote device, to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and to notify the decoding module that the auxiliary stream channel is opened includes:
receiving the auxiliary flow channel opening request, and extracting the equipment name of the remote equipment from the auxiliary flow channel opening request;
matching and obtaining a corresponding auxiliary flow channel opening mode from a pre-stored configuration list according to the equipment name; the pre-stored configuration list represents the corresponding relation between the pre-stored equipment name and the pre-stored auxiliary flow channel opening mode;
and based on the auxiliary stream channel opening mode, opening the auxiliary stream channel when the auxiliary stream signaling is correct, and informing the decoding module that the auxiliary stream channel is opened.
Further, the receiving an auxiliary stream channel opening request initiated by a remote device, so as to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and notifying the decoding module that the auxiliary stream channel is opened, further includes:
and when the matching of the equipment name and the pre-stored configuration list fails, obtaining a universal auxiliary flow channel opening mode from the pre-stored configuration list.
Further, the monitoring whether the far-end device has transmitted the auxiliary stream data in real time after the auxiliary stream channel is opened, and notifying the signaling negotiation module to close the auxiliary stream channel when the far-end device does not transmit the auxiliary stream data, further includes:
and when the remote equipment sends the auxiliary stream data, decoding the auxiliary stream data to obtain decoded data.
Further, the signaling negotiation module is further configured to establish a call channel between the terminal device and the remote device before the receiving of the auxiliary flow channel opening request initiated by the remote device, so that the remote device initiates the auxiliary flow channel opening request through the call channel.
The embodiment of the invention has the following beneficial effects:
the method comprises the steps that a signaling negotiation module arranged on a terminal device receives an auxiliary flow channel opening request initiated by a far-end device, so that an auxiliary flow channel is opened according to an auxiliary flow signaling sent by the far-end device, a decoding module arranged on the terminal device is informed of the opening of the auxiliary flow channel, then the decoding module is used for monitoring whether auxiliary flow data are sent by the far-end device or not in real time after the auxiliary flow channel is opened, and when the auxiliary flow data are not sent by the far-end device, the signaling negotiation module is informed of the closing of the auxiliary flow channel, and therefore H.239-based auxiliary flow negotiation is completed. Compared with the prior art, the embodiment of the invention utilizes the signaling negotiation module to open the auxiliary flow channel according to the auxiliary flow signaling sent by the far-end equipment after receiving the auxiliary flow channel opening request initiated by the far-end equipment, and utilizes the decoding module to timely inform the signaling negotiation module to close the auxiliary flow channel when the far-end equipment is monitored not to send the auxiliary flow data, so that the auxiliary flow negotiation can be more accurately carried out, the problem of auxiliary flow negotiation compatibility between different terminals or between the terminal and the server can be solved, and the success rate of the auxiliary flow negotiation is improved.
Drawings
Fig. 1 is a flowchart illustrating an h.239-based auxiliary stream negotiation method according to a first embodiment of the present invention;
fig. 2 is another flowchart illustrating an h.239-based auxiliary stream negotiation method according to the first embodiment of the present invention;
fig. 3 is a data flow diagram based on a first auxiliary flow channel opening mode in the first embodiment of the present invention;
fig. 4 is a data flow diagram based on a second auxiliary flow channel opening mode in the first embodiment of the present invention;
fig. 5 is a data flow diagram based on a third auxiliary flow channel opening mode in the first embodiment of the present invention;
FIG. 6 is a schematic flow chart of a preferred embodiment of the first embodiment of the present invention;
fig. 7 is a schematic structural diagram of an h.239-based auxiliary stream negotiation terminal device in a second embodiment of the present invention.
Detailed Description
The technical solutions in the present invention will be described clearly and completely with reference to the drawings in the present invention, and it should be apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that, the step numbers in the text are only for convenience of explanation of the specific embodiments, and do not serve to limit the execution sequence of the steps.
Please refer to fig. 1-6.
As shown in fig. 1-2, a first embodiment provides an h.239-based auxiliary stream negotiation method, which is suitable for a terminal device provided with a signaling negotiation module and a decoding module.
The auxiliary stream negotiation method comprises the following steps of S1-S2:
s1, receiving an auxiliary flow channel opening request initiated by a far-end device through a signaling negotiation module, opening an auxiliary flow channel according to an auxiliary flow signaling sent by the far-end device, and informing a decoding module of opening the auxiliary flow channel.
S2, monitoring whether the far-end equipment sends the auxiliary stream data or not in real time after the auxiliary stream channel is opened through the decoding module, and informing the signaling negotiation module to close the auxiliary stream channel when the far-end equipment does not send the auxiliary stream data.
It should be noted that the terminal device includes a VOIP phone.
As an example, in step S1, after receiving an auxiliary stream channel opening request initiated by a remote device, the signaling negotiation module continues to receive an auxiliary stream signaling sent by the remote device, so as to open an auxiliary stream channel according to the auxiliary stream signaling, and notify the decoding module that the auxiliary stream channel is opened, so that the decoding module can monitor an auxiliary stream data sending condition of the remote device in real time after the auxiliary stream channel is opened.
The auxiliary flow channel is opened according to an auxiliary flow signaling sent by the far-end equipment, and the method is realized by adopting any one of the following auxiliary flow channel opening modes:
first auxiliary flow channel open mode: the terminal equipment receives a token request signaling presentationTokenRequest sent by the remote equipment through a signaling negotiation module, extracts information such as an auxiliary stream data coding mode and an auxiliary stream channel serial number from the token request signaling presentationTokenRequest, returns a token response signaling presentationTokenResponse and distributes tokens to the remote equipment; the remote equipment periodically sends token occupation indication signaling presentationtokenlndicateOwner to indicate the owner of the token; the far-end equipment sends a channel activation indication signaling miscellaneousIndication to activate the auxiliary flow channel, so that the auxiliary flow channel is opened through the signaling negotiation module. The data flow diagram based on the first auxiliary flow channel opening mode is shown in fig. 3.
The second auxiliary flow channel opening mode: after the terminal equipment is added into a server, namely a conference created by remote equipment, receiving a token request signaling presentationTokenRequest sent by the server through a signaling negotiation module, extracting information such as an auxiliary stream data coding mode and an auxiliary stream channel serial number from the token request signaling presentationTokenRequest, returning a token response signaling presentationTokenResponse, and distributing a token to the server; the server sends token occupation indication signaling presentationtonenindicateowner to indicate the owner of the token, so that the auxiliary flow channel is opened through the signaling negotiation module. The data flow diagram based on the second auxiliary flow channel opening mode is shown in fig. 4.
The third auxiliary flow channel opening mode: after the terminal device establishes an H.232 communication channel with the remote device, the terminal device receives a token request signaling presentationTokenRequest sent by the remote device through a signaling negotiation module, extracts information such as an auxiliary stream data coding mode and an auxiliary stream channel sequence number requested by the remote device from the token request signaling presentationTokenResponse, returns a token response signaling presentationTokenResponse and distributes tokens to the remote device; the remote device sends token occupation indication signaling presentationTokenIndicateOwner to indicate the owner of the token; the far-end equipment sends a channel activation indication signaling miscellaneousIndication to activate the auxiliary flow channel, so that the auxiliary flow channel is opened through the signaling negotiation module. Thereafter, the auxiliary channel is closed when the remote device sends a channel deactivation indication signaling (inactive), and the auxiliary channel is opened when the remote device sends a channel activation indication signaling (active). The data flow diagram based on the third auxiliary flow channel opening mode is shown in fig. 5.
In step S2, after receiving the auxiliary stream channel opening notification message from the signaling negotiation module, the decoding module monitors in real time whether the remote device has transmitted auxiliary stream data, that is, auxiliary stream media stream data RTP, and when the remote device does not transmit auxiliary stream data, the decoding module notifies the signaling negotiation module to close the auxiliary stream channel, so that the signaling negotiation module closes the auxiliary stream channel.
In this embodiment, a signaling negotiation module provided in a terminal device receives an auxiliary stream channel opening request initiated by a remote device, so as to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and notify a decoding module provided in the terminal device that the auxiliary stream channel is opened, and then, through the decoding module, after the auxiliary stream channel is opened, monitor whether auxiliary stream data is sent by the remote device in real time, and when the auxiliary stream data is not sent by the remote device, notify the signaling negotiation module to close the auxiliary stream channel, thereby completing the auxiliary stream negotiation based on h.239. In this embodiment, the signaling negotiation module is used to open the auxiliary stream channel according to the auxiliary stream signaling sent by the remote device after receiving the auxiliary stream channel opening request initiated by the remote device, and the decoding module is used to notify the signaling negotiation module to close the auxiliary stream channel in time when it is monitored that the remote device does not send auxiliary stream data, so as to perform auxiliary stream negotiation more accurately, thereby solving the problem of auxiliary stream negotiation compatibility between different terminals or between a terminal and a server, and improving the success rate of auxiliary stream negotiation.
In a preferred embodiment, as shown in fig. 6, the step S1 includes: receiving an auxiliary flow channel opening request, and extracting the equipment name of the remote equipment from the auxiliary flow channel opening request; matching the pre-stored configuration list to obtain a corresponding auxiliary flow channel opening mode according to the equipment name; the pre-stored configuration list represents the corresponding relation between the pre-stored equipment name and the pre-stored auxiliary flow channel opening mode; and based on the auxiliary stream channel opening mode, opening the auxiliary stream channel when the auxiliary stream signaling is correct, and informing the decoding module of opening the auxiliary stream channel.
It should be noted that the pre-stored configuration list is predefined according to the remote device and the auxiliary stream channel opening mode that can be supported by the terminal device, and is used to indicate the correspondence between the device name of the remote device and the auxiliary stream channel opening mode. For example, the remote device cisco corresponds to the first auxiliary stream channel opening mode1; the remote device polycom corresponds to the second auxiliary flow channel opening mode2; the remote device common corresponds to the third auxiliary flow channel open mode3.
Illustratively, after receiving an auxiliary stream channel opening request sent by a remote device, extracting a device name of the remote device from the request, when the extracted device name is cisco, matching a corresponding auxiliary stream channel opening pattern, that is, a first auxiliary stream channel opening pattern mode1, from a pre-stored configuration list according to the device name cisco, so as to open an auxiliary stream channel based on the first auxiliary stream channel opening pattern mode1, when the extracted device name is polycom, matching a corresponding auxiliary stream channel opening pattern, that is, a second auxiliary stream channel opening pattern mode2, from the pre-stored configuration list according to the device name polycom, so as to open an auxiliary stream channel based on the second auxiliary stream channel opening pattern mode2, and when the extracted device name is common, matching a corresponding auxiliary stream channel opening pattern, that is, a third auxiliary stream channel opening pattern mode3, from the pre-stored configuration list according to the device name mon, so as to open an auxiliary stream channel based on the third auxiliary stream channel opening pattern 3.
In the embodiment, the pre-stored configuration list is defined in advance, and the auxiliary stream negotiation is performed by adopting a more appropriate auxiliary stream channel opening mode for different remote devices, so that the problem of auxiliary stream negotiation compatibility between different terminals or between a terminal and a server can be solved, and the success rate of the auxiliary stream negotiation is further improved.
In a preferred embodiment, the step S1 further includes: and when the matching of the equipment name and the pre-stored configuration list fails, obtaining a universal auxiliary flow channel opening mode from the pre-stored configuration list.
As an example, when the extracted device name is not any one of cisco, polycom, and common, it is determined that the device name is unsuccessfully matched with the pre-stored configuration list, and at this time, a common auxiliary stream channel opening mode, that is, any one of a first auxiliary stream channel opening mode1, a first auxiliary stream channel opening mode2, and a first auxiliary stream channel opening mode3, is obtained from the pre-stored configuration list, so that the auxiliary stream channel is opened based on the common auxiliary stream channel opening mode. Among them, the first auxiliary stream channel opening mode1 is preferred as the general auxiliary stream channel opening mode.
In the embodiment, when the matching between the device name and the pre-stored configuration list fails, the auxiliary stream negotiation is performed by adopting a general auxiliary stream channel opening mode, so that the problem of auxiliary stream negotiation compatibility between different terminals or between the terminal and the server can be solved, and the success rate of the auxiliary stream negotiation is further improved.
In a preferred embodiment, the step S2 further includes: when the far-end equipment transmits the auxiliary stream data, the auxiliary stream data is decoded to obtain decoded data.
In the embodiment, when it is monitored that the far-end device sends the auxiliary stream data, the decoding module decodes the auxiliary stream data to obtain the decoded data, so as to obtain the moving image and the high-resolution graphics and text.
In a preferred embodiment, before the receiving, by the signaling negotiation module, the auxiliary stream channel opening request initiated by the remote device, the method further includes: and establishing a communication channel between the terminal equipment and the far-end equipment through the signaling negotiation module, so that the far-end equipment initiates an auxiliary channel opening request through the communication channel.
In this embodiment, a call channel between the terminal device and the remote device can be pre-established through the signaling negotiation module, so that the remote device initiates a request for opening the auxiliary channel to the terminal device through the call channel.
Please refer to fig. 7.
As shown in fig. 7, the second embodiment provides a secondary stream negotiation terminal device based on h.239, which includes a signaling negotiation module 21 and a decoding module 22; a signaling negotiation module 21, configured to receive an auxiliary flow channel opening request initiated by a remote device, open an auxiliary flow channel according to an auxiliary flow signaling sent by the remote device, and notify a decoding module 22 of opening the auxiliary flow channel; the decoding module 22 is configured to monitor whether the far-end device has the transmitted auxiliary stream data in real time after the auxiliary stream channel is opened, and notify the signaling negotiation module 21 to close the auxiliary stream channel when the far-end device does not transmit the auxiliary stream data.
It should be noted that the terminal device includes a VOIP phone.
As an example, after receiving the auxiliary stream channel opening request initiated by the far-end device, the signaling negotiation module 21 continues to receive the auxiliary stream signaling sent by the far-end device, so as to open the auxiliary stream channel according to the auxiliary stream signaling, and notify the decoding module 22 that the auxiliary stream channel is opened, so that the decoding module 22 can monitor the auxiliary stream data transmission condition of the far-end device in real time after the auxiliary stream channel is opened.
The auxiliary flow channel is opened according to an auxiliary flow signaling sent by the far-end equipment, and the method is realized by adopting any one of the following auxiliary flow channel opening modes:
first auxiliary flow channel open mode: the terminal equipment receives a token request signaling presentationTokenRequest sent by the remote equipment through the signaling negotiation module 21, extracts information such as an auxiliary flow data coding mode, an auxiliary flow channel sequence number and the like from the token request signaling presentationTokenRequest, returns a token response signaling presentationtoken response and distributes a token to the remote equipment; the remote equipment periodically sends token occupation indication signaling presentationTokenIndicateOwner to indicate the owner of the token; the remote device sends a channel activation indication signaling ciscellaneousindication to activate the auxiliary channel, so that the auxiliary channel is opened through the signaling negotiation module 21.
The second auxiliary flow channel opening mode: after the terminal device joins in a conference created by a server, that is, a remote device, the terminal device receives a token request signaling presentationTokenRequest sent by the server through the signaling negotiation module 21, extracts information such as an auxiliary stream data coding mode and an auxiliary stream channel serial number from the received token request signaling presentationTokenRequest, returns a token response signaling presentationTokenResponse, and distributes a token to the server; the server sends token occupation indication signaling token lndicatedemowner to indicate the owner of the token, so as to open the auxiliary flow channel through the signaling negotiation module 21.
The third auxiliary flow channel opening mode: after establishing an h.232 call channel with a remote device, the terminal device receives a token request signaling presentationTokenRequest sent by the remote device through the signaling negotiation module 21, extracts information such as an auxiliary stream data coding mode and an auxiliary stream channel sequence number requested by the remote device from the token request signaling presentationTokenRequest, and returns a token response signaling presentationtoken response to distribute a token to the remote device; the remote device sends token occupation indication signaling presentationTokenIndicateOwner to indicate the owner of the token; the remote device sends a channel activation indication signaling ciscellaneousindication to activate the auxiliary channel, so that the auxiliary channel is opened through the signaling negotiation module 21. Thereafter, the auxiliary channel is closed when the remote device sends a channel deactivation indication signaling (inactive), and the auxiliary channel is opened when the remote device sends a channel activation indication signaling (active).
Through the decoding module 22, after receiving the auxiliary stream channel opening notification message from the signaling negotiation module 21, monitoring whether the far-end device has auxiliary stream data to send, that is, the auxiliary stream media stream data RTP, in real time, and when the far-end device does not send the auxiliary stream data, notifying the signaling negotiation module 21 to close the auxiliary stream channel, so that the signaling negotiation module 21 closes the auxiliary stream channel.
In this embodiment, a signaling negotiation module 21 arranged in a terminal device receives an auxiliary stream channel opening request initiated by a remote device, so as to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and notify a decoding module 22 arranged in the terminal device that the auxiliary stream channel is opened, and then, through the decoding module 22, after the auxiliary stream channel is opened, whether the remote device has auxiliary stream data to send is monitored in real time, and when the remote device does not send the auxiliary stream data, the signaling negotiation module 21 is notified to close the auxiliary stream channel, thereby completing the auxiliary stream negotiation based on h.239. In this embodiment, the signaling negotiation module 21 is used to open the auxiliary stream channel according to the auxiliary stream signaling sent by the far-end device after receiving the auxiliary stream channel opening request initiated by the far-end device, and the decoding module 22 is used to notify the signaling negotiation module 21 to close the auxiliary stream channel in time when it is monitored that the far-end device does not send auxiliary stream data, so as to perform auxiliary stream negotiation more accurately, thereby solving the problem of auxiliary stream negotiation compatibility between different terminals or between a terminal and a server, and improving the success rate of auxiliary stream negotiation.
In a preferred embodiment, the receiving a secondary stream channel opening request initiated by a remote device, so as to open a secondary stream channel according to a secondary stream signaling sent by the remote device, and notifying the decoding module 22 that the secondary stream channel is opened includes: receiving an auxiliary flow channel opening request, and extracting the equipment name of the remote equipment from the auxiliary flow channel opening request; matching to obtain a corresponding auxiliary flow channel opening mode from a pre-stored configuration list according to the equipment name; the pre-stored configuration list represents the corresponding relation between the pre-stored equipment name and the pre-stored auxiliary channel opening mode; based on the auxiliary stream channel opening mode, the auxiliary stream channel is opened when the auxiliary stream signaling is correct, and the decoding module 22 is notified that the auxiliary stream channel is opened.
It should be noted that the pre-stored configuration list is predefined according to the remote device and the auxiliary stream channel opening mode that can be supported by the terminal device, and is used to indicate the correspondence between the device name of the remote device and the auxiliary stream channel opening mode. For example, the remote device cisco corresponds to the first auxiliary stream channel opening mode1; the remote device polycom corresponds to the second auxiliary flow channel opening mode2; the remote device common corresponds to the third auxiliary flow channel opening mode3.
Illustratively, after receiving a subchannel channel opening request sent by a remote device, a signaling negotiation module 21 extracts a device name of the remote device from the received request, and when the extracted device name is cisco, according to the device name cisco, a corresponding subchannel channel opening pattern, that is, a first type of subchannel channel opening pattern mode1 is obtained by matching from a pre-stored configuration list, so that an subchannel channel is opened based on the first type of subchannel channel opening pattern mode1, when the extracted device name is polycom, a corresponding subchannel channel opening pattern, that is, a second type of subchannel channel opening pattern mode2 is obtained by matching from the pre-stored configuration list according to the device name polycom, so that an subchannel channel is opened based on the second type of subchannel channel opening pattern mode2, and when the extracted device name is comon, a corresponding subchannel channel opening pattern, that is, a third type of subchannel channel opening pattern mode3 is obtained by matching from the pre-stored configuration list according to the device name mon, so that an subchannel channel is opened based on the third type of subchannel channel opening pattern 3.
In the embodiment, the pre-stored configuration list is defined in advance, and the auxiliary stream negotiation is performed by adopting a more appropriate auxiliary stream channel opening mode for different remote devices, so that the problem of auxiliary stream negotiation compatibility between different terminals or between a terminal and a server can be solved, and the success rate of the auxiliary stream negotiation is further improved.
In a preferred embodiment, the receiving an auxiliary stream channel opening request initiated by a remote device, to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and to notify the decoding module 22 that the auxiliary stream channel is opened further includes: and when the matching of the equipment name and the pre-stored configuration list fails, obtaining a universal auxiliary flow channel opening mode from the pre-stored configuration list.
As an example, when the extracted device name is not any one of cisco, polycom, and common, it is determined that the device name is unsuccessfully matched with the pre-stored configuration list, and at this time, a common auxiliary stream channel opening mode, that is, any one of a first auxiliary stream channel opening mode1, a first auxiliary stream channel opening mode2, and a first auxiliary stream channel opening mode3, is obtained from the pre-stored configuration list, so that the auxiliary stream channel is opened based on the common auxiliary stream channel opening mode. Among them, the first auxiliary stream channel opening mode1 is preferred as the general auxiliary stream channel opening mode.
In the embodiment, when the matching between the device name and the pre-stored configuration list fails, the auxiliary stream negotiation is performed by adopting a general auxiliary stream channel opening mode, so that the problem of auxiliary stream negotiation compatibility between different terminals or between the terminal and the server can be solved, and the success rate of the auxiliary stream negotiation is further improved.
In a preferred embodiment, the monitoring whether the far-end device has transmitted the auxiliary stream data in real time after the auxiliary stream channel is opened, and notifying the signaling negotiation module 21 to close the auxiliary stream channel when the far-end device does not transmit the auxiliary stream data, further includes: when the far-end equipment transmits the auxiliary stream data, the auxiliary stream data is decoded to obtain decoded data.
In this embodiment, when it is monitored that the remote device has transmitted the auxiliary stream data, the decoding module 22 decodes the auxiliary stream data to obtain decoded data, so as to obtain a moving image and a high-resolution image-text.
In a preferred embodiment, the signaling negotiation module 21 is further configured to, before the receiving of the auxiliary flow path opening request initiated by the remote device, establish a communication path between the terminal device and the remote device, so that the remote device initiates the auxiliary flow path opening request through the communication path.
In this embodiment, the signaling negotiation module 21 can pre-establish a communication channel between the terminal device and the remote device, so that the remote device initiates a request for opening the auxiliary channel to the terminal device through the communication channel.
In summary, the embodiment of the present invention has the following advantages:
the method comprises the steps that a signaling negotiation module 21 arranged on a terminal device receives an auxiliary flow channel opening request initiated by a far-end device, so that an auxiliary flow channel is opened according to an auxiliary flow signaling sent by the far-end device, a decoding module 22 arranged on the terminal device is informed of opening the auxiliary flow channel, then the decoding module 22 is used for monitoring whether the far-end device sends auxiliary flow data or not in real time after the auxiliary flow channel is opened, and when the far-end device does not send the auxiliary flow data, the signaling negotiation module 21 is informed of closing the auxiliary flow channel, so that H.239-based auxiliary flow negotiation is completed. Compared with the prior art, the embodiment of the invention utilizes the signaling negotiation module 21 to open the auxiliary flow channel according to the auxiliary flow signaling sent by the far-end equipment after receiving the auxiliary flow channel opening request initiated by the far-end equipment, and utilizes the decoding module 22 to timely inform the signaling negotiation module 21 to close the auxiliary flow channel when the far-end equipment is monitored not to send auxiliary flow data, so that the auxiliary flow negotiation can be more accurately carried out, the problem of auxiliary flow negotiation compatibility between different terminals or between the terminal and the server can be solved, and the success rate of the auxiliary flow negotiation is improved.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
It will be understood by those skilled in the art that all or part of the processes of the above embodiments may be implemented by hardware related to instructions of a computer program, and the computer program may be stored in a computer readable storage medium, and when executed, may include the processes of the above embodiments. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Claims (8)
1. An auxiliary stream negotiation method based on H.239 is characterized by being suitable for terminal equipment provided with a signaling negotiation module and a decoding module;
the auxiliary stream negotiation method comprises the following steps:
receiving an auxiliary flow channel opening request initiated by a far-end device through the signaling negotiation module, so as to open an auxiliary flow channel according to an auxiliary flow signaling sent by the far-end device, and notifying the decoding module of the opening of the auxiliary flow channel;
the receiving, by the signaling negotiation module, an auxiliary stream channel opening request initiated by a remote device, so as to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and notifying the decoding module of opening the auxiliary stream channel includes:
receiving the auxiliary flow channel opening request, and extracting the equipment name of the remote equipment from the auxiliary flow channel opening request;
matching and obtaining a corresponding auxiliary flow channel opening mode from a pre-stored configuration list according to the equipment name; the pre-stored configuration list represents the corresponding relation between the pre-stored equipment name and the pre-stored auxiliary flow channel opening mode; the pre-stored auxiliary flow channel opening modes comprise a first auxiliary flow channel opening mode, a second auxiliary flow channel opening mode and a third auxiliary flow channel opening mode; the first auxiliary flow channel opening mode is as follows: the terminal equipment receives a token request signaling sent by the far-end equipment through the signaling negotiation module, extracts an auxiliary stream data coding mode and an auxiliary stream channel serial number from the token request signaling, returns a token response signaling and distributes a token to the far-end equipment; the remote equipment periodically sends token occupation indication signaling to indicate the owner of the token; the remote device sends a channel activation indication signaling to activate the auxiliary flow channel, so that the auxiliary flow channel is opened through the signaling negotiation module; the second auxiliary flow channel opening mode is as follows: after the terminal equipment joins in a conference created by the remote equipment, receiving a token request signaling sent by the remote equipment through the signaling negotiation module, extracting an auxiliary stream data coding mode and an auxiliary stream channel serial number from the token request signaling, returning a token response signaling, and distributing a token to the remote equipment; the remote device sends a token occupation indication signaling to indicate the owner of the token, so that the auxiliary flow channel is opened through the signaling negotiation module; the third auxiliary flow channel opening mode is as follows: after the terminal equipment establishes an H.232 communication channel with the remote equipment, receiving a token request signaling sent by the remote equipment through the signaling negotiation module, extracting an auxiliary stream data coding mode and an auxiliary stream channel serial number from the token request signaling, returning a token response signaling, and distributing a token to the remote equipment; the remote equipment sends token occupation indication signaling to indicate the owner of the token; the remote device sends a channel activation indication signaling to activate the auxiliary flow channel, so that the auxiliary flow channel is opened through the signaling negotiation module;
based on the auxiliary stream channel opening mode, opening the auxiliary stream channel when the auxiliary stream signaling is correct, and informing the decoding module that the auxiliary stream channel is opened;
and monitoring whether the far-end equipment sends the auxiliary stream data or not in real time after the auxiliary stream channel is opened through the decoding module, and informing the signaling negotiation module to close the auxiliary stream channel when the far-end equipment does not send the auxiliary stream data.
2. The h.239-based auxiliary stream negotiation method of claim 1, wherein the receiving, by the signaling negotiation module, an auxiliary stream channel opening request initiated by a remote device, so as to open an auxiliary stream channel according to auxiliary stream signaling sent by the remote device, and notifying the decoding module that the auxiliary stream channel is opened, further comprises:
when the matching of the equipment name and the pre-stored configuration list fails, obtaining a universal auxiliary flow channel opening mode from the pre-stored configuration list; wherein the general auxiliary flow channel opening mode is the first auxiliary flow channel opening mode, the second auxiliary flow channel opening mode or the third auxiliary flow channel opening mode.
3. The h.239-based secondary stream negotiation method of claim 1, wherein said monitoring whether there is secondary stream data to be sent by said far-end device in real time after said secondary stream channel is opened by said decoding module, and notifying said signaling negotiation module to close said secondary stream channel when said far-end device does not send said secondary stream data, further comprises:
and when the remote equipment sends the auxiliary stream data, decoding the auxiliary stream data to obtain decoded data.
4. The h.239-based secondary stream negotiation method of claim 1, wherein before said receiving a remote device-initiated secondary stream channel opening request through said signaling negotiation module, further comprising:
and establishing a call channel between the terminal equipment and the far-end equipment through the signaling negotiation module, so that the far-end equipment initiates the auxiliary flow channel opening request through the call channel.
5. An auxiliary stream negotiation terminal device based on H.239 is characterized by comprising a signaling negotiation module and a decoding module;
the signaling negotiation module is configured to receive an auxiliary stream channel opening request initiated by a remote device, open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device, and notify the decoding module that the auxiliary stream channel is opened; the receiving an auxiliary stream channel opening request initiated by a far-end device, so as to open an auxiliary stream channel according to an auxiliary stream signaling sent by the far-end device, and notify the decoding module that the auxiliary stream channel is opened, includes: receiving the auxiliary flow channel opening request, and extracting the equipment name of the remote equipment from the auxiliary flow channel opening request; matching and obtaining a corresponding auxiliary flow channel opening mode from a pre-stored configuration list according to the equipment name; the pre-stored configuration list represents the corresponding relation between the pre-stored equipment name and the pre-stored auxiliary channel opening mode; the pre-stored auxiliary flow channel opening modes comprise a first auxiliary flow channel opening mode, a second auxiliary flow channel opening mode and a third auxiliary flow channel opening mode; the first auxiliary flow channel opening mode is as follows: the terminal equipment receives a token request signaling sent by the remote equipment through the signaling negotiation module, extracts an auxiliary stream data coding mode and an auxiliary stream channel serial number from the token request signaling, returns a token response signaling and distributes a token to the remote equipment; the remote equipment periodically sends token occupation indication signaling to indicate the owner of the token; the far-end equipment sends a channel activation indication signaling to activate the auxiliary flow channel, so that the auxiliary flow channel is opened through the signaling negotiation module; the second auxiliary flow channel opening mode is as follows: after the terminal equipment joins in a conference created by the far-end equipment, receiving a token request signaling sent by the far-end equipment through the signaling negotiation module, extracting an auxiliary stream data coding mode and an auxiliary stream channel serial number from the token request signaling, returning a token response signaling, and distributing tokens to the far-end equipment; the remote device sends a token occupation indication signaling to indicate the owner of the token, so that the auxiliary flow channel is opened through the signaling negotiation module; the third auxiliary flow channel opening mode is as follows: after the terminal device establishes an H.232 communication channel with the remote device, the token negotiation module receives a token request signaling sent by the remote device, extracts an auxiliary stream data coding mode and an auxiliary stream channel serial number from the token request signaling, returns a token response signaling, and distributes a token to the remote device; the remote equipment sends token occupation indication signaling to indicate the owner of the token; the far-end equipment sends a channel activation indication signaling to activate the auxiliary flow channel, so that the auxiliary flow channel is opened through the signaling negotiation module; based on the auxiliary stream channel opening mode, opening the auxiliary stream channel when the auxiliary stream signaling is correct, and informing the decoding module that the auxiliary stream channel is opened;
the decoding module is configured to monitor whether the far-end device has transmitted the auxiliary stream data in real time after the auxiliary stream channel is opened, and notify the signaling negotiation module to close the auxiliary stream channel when the far-end device does not transmit the auxiliary stream data.
6. The h.239-based auxiliary stream negotiation terminal device, according to claim 5, wherein the receiving a remote device-initiated auxiliary stream channel opening request to open an auxiliary stream channel according to an auxiliary stream signaling sent by the remote device and notify the decoding module that the auxiliary stream channel is opened further comprises:
when the matching of the equipment name and the pre-stored configuration list fails, obtaining a universal auxiliary flow channel opening mode from the pre-stored configuration list; the general auxiliary flow channel opening mode is the first auxiliary flow channel opening mode, the second auxiliary flow channel opening mode or the third auxiliary flow channel opening mode.
7. The h.239-based auxiliary stream negotiation terminal device, according to claim 5, wherein the monitoring whether the far-end device has transmitted auxiliary stream data in real time after the auxiliary stream channel is opened, and notifying the signaling negotiation module to close the auxiliary stream channel when the far-end device does not transmit the auxiliary stream data, further comprises:
and when the remote equipment sends the auxiliary stream data, decoding the auxiliary stream data to obtain decoded data.
8. The h.239-based auxiliary stream negotiation terminal device, according to claim 5, wherein the signaling negotiation module is further configured to establish a communication channel between the terminal device and the remote device before the receiving of the auxiliary stream channel opening request initiated by the remote device, so that the remote device initiates the auxiliary stream channel opening request through the communication channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010520476.3A CN111866580B (en) | 2020-06-09 | 2020-06-09 | H.239-based auxiliary stream negotiation method and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010520476.3A CN111866580B (en) | 2020-06-09 | 2020-06-09 | H.239-based auxiliary stream negotiation method and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111866580A CN111866580A (en) | 2020-10-30 |
| CN111866580B true CN111866580B (en) | 2022-12-20 |
Family
ID=72987315
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010520476.3A Active CN111866580B (en) | 2020-06-09 | 2020-06-09 | H.239-based auxiliary stream negotiation method and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111866580B (en) |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE19811825B4 (en) * | 1998-03-18 | 2004-09-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Communication system with a limited number of communication channels |
| CN1859386B (en) * | 2005-12-31 | 2010-05-12 | 华为技术有限公司 | Method and its device for improving user unloading speed |
| CN101459816B (en) * | 2007-12-14 | 2015-09-09 | 华为终端有限公司 | A kind of method of controlling auxiliary stream token in multi-point bi-stream conference, system and equipment |
| CN101262588B (en) * | 2008-04-01 | 2010-06-02 | 中国联合网络通信集团有限公司 | A method and system for mandatory control over auxiliary stream of video network |
| CN102572367B (en) * | 2010-12-07 | 2014-09-03 | 华为终端有限公司 | Multiple auxiliary stream control method, device and network system |
| CN103312451B (en) * | 2012-03-14 | 2017-04-12 | 华为技术有限公司 | Method for transmitting data and user equipment |
| CN104244457A (en) * | 2013-06-17 | 2014-12-24 | 中兴通讯股份有限公司 | Wireless link resource releasing method and user device |
| EP3051773B1 (en) * | 2013-10-25 | 2020-09-16 | Huawei Technologies Co., Ltd. | Multi-path auxiliary stream control method, control device, node and system |
| CN108770065B (en) * | 2014-07-22 | 2021-10-26 | 华为技术有限公司 | Method, equipment and system for controlling air interface resources |
| CN108322693B (en) * | 2018-03-01 | 2021-03-02 | 上海创视通软件技术有限公司 | Method and system for controlling auxiliary stream of third-party terminal by MCU (microprogrammed control Unit) terminal |
-
2020
- 2020-06-09 CN CN202010520476.3A patent/CN111866580B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111866580A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3013086B1 (en) | Method, apparatus and electronic device for connection management | |
| US8345556B2 (en) | Congestion control system, service edge node, guidance server, congestion control method, program therefor, and recording medium recorded therewith | |
| US7925784B2 (en) | Re-direction of streaming multimedia in wireless communication devices in response to low battery level | |
| CN102480613B (en) | Method, device and system for video monitoring on terminal of videoconferencing system | |
| CN110971922B (en) | Live broadcast and microphone connection state monitoring method, client, server, medium and system | |
| JP2009211343A (en) | Server device and communication system | |
| KR20080014329A (en) | Apparatus for image display and control method thereof | |
| US20150201085A1 (en) | Seamlessly transferring a communication | |
| WO2006131044A1 (en) | Method for processing the defeated videophone call based on mobile communication network | |
| US20050148331A1 (en) | Presence status update system and method in a mobile communication network | |
| CN103595950A (en) | Method for carrying out video communication based on cable digital television set top box | |
| CN108235111B (en) | Information sharing method and intelligent set top box | |
| CN101056384B (en) | Implementation method of remote monitoring service and video terminal device | |
| CN104883344A (en) | Method and device of negotiating media capabilities | |
| EP3451631B1 (en) | Webrtc communication method and user equipment | |
| CN111866580B (en) | H.239-based auxiliary stream negotiation method and terminal equipment | |
| US20120079130A1 (en) | Agent service processing method and internet protocol agent terminal | |
| CN115412597A (en) | Real-time data communication method | |
| CN113163509B (en) | Call establishment method and device, electronic equipment and readable storage medium | |
| WO2017012485A1 (en) | Method for implementing call access and conference television terminal | |
| CN105592285A (en) | ROI video realization method and ROI video realization device | |
| CN107547923B (en) | Video plug-flow system | |
| WO2017215482A1 (en) | Iptv multi-screen interaction implementation method and management interaction system | |
| CN113596380B (en) | Video conference server and communication method | |
| CN114363665B (en) | Multi-service code stream pushing method, system, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |