CN116980394A - Communication method, terminal, media server and intercom server for public network intercom - Google Patents

Communication method, terminal, media server and intercom server for public network intercom Download PDF

Info

Publication number
CN116980394A
CN116980394A CN202211121954.9A CN202211121954A CN116980394A CN 116980394 A CN116980394 A CN 116980394A CN 202211121954 A CN202211121954 A CN 202211121954A CN 116980394 A CN116980394 A CN 116980394A
Authority
CN
China
Prior art keywords
terminal
intercom
server
media server
speaking right
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211121954.9A
Other languages
Chinese (zh)
Inventor
向黎洪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile IoT Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile IoT Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile IoT Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN202211121954.9A priority Critical patent/CN116980394A/en
Publication of CN116980394A publication Critical patent/CN116980394A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/06Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
    • H04W4/10Push-to-Talk [PTT] or Push-On-Call services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/4061Push-to services, e.g. push-to-talk or push-to-video
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS

Abstract

The application provides a communication method, a terminal, a media server and an intercom server for public network intercom, wherein the method applied to a first terminal comprises the following steps: according to the audio input operation of the first terminal, sending an speaking right request to the intercom server, wherein the speaking right request is used for enabling the intercom server to carry out speaking right judgment; after receiving the speaking right determining information sent by the intercom server, collecting audio data; according to a first preset QoS processing mode in the WebRTC technology, the audio data are transmitted to a media server through a pre-built audio transmission channel, and the media server forwards the audio data to a second terminal corresponding to the first terminal. The application processes the audio data and the audio transmission by the QoS processing mode in the WebRTC technology, effectively improves the anti-weak network capacity of the public network intercommunication, and solves the problems of low tone quality and high transmission delay caused by bandwidth limitation and bad voice environment.

Description

Communication method, terminal, media server and intercom server for public network intercom
Technical Field
The present application relates to the field of communications, and in particular, to a communication method, a terminal, a media server, and an intercom server for public network intercom.
Background
Public network intercom is also called PoC (Push To Talk Over Cellular), and is a communication mode for realizing intercom function (PTT for short) by using a mobile terminal wireless network. The mobile terminal may be a smart phone or an intercom device supporting public network intercom. The core of public network intercommunication is real-time voice transmission, and the prior technical scheme mainly comprises the following steps:
(1) Based on a reliability transmission protocol (Reliable Transport Protocol, RTP for short), directly transmitting audio coding data without processing such as packet loss, disorder and the like;
(2) Based on real-time streaming protocol (Real Time Streaming Protocol, RTSP for short), the transmission and control of real-time audio data are realized, and no quality of service (Quality of Service, qoS for short) improvement measures are provided.
The prior art scheme has the following defects: (1) The voice intercom has poor weak network resistance, packet loss and disorder occur in audio transmission, and the voice of the receiving end is distorted, discontinuous and the like. (2) When bandwidth fluctuation is large, no flow control processing and no anti-jitter measures are adopted, and the phenomenon of delay and packet loss of audio transmission can be caused. (3) The method has no noise filtering, noise reduction, gain and other audio processing measures, so that the tone quality of a receiving end is poor. In summary, in the existing technology for implementing public network intercom real-time audio transmission, because audio QoS processing measures are relatively few, it is difficult to achieve the high standard requirements set by the user in terms of time delay (the time delay is basically in seconds) and audio quality.
Disclosure of Invention
The technical aim to be achieved by the embodiment of the application is to provide a communication method, a terminal, a media server and an intercom server for public network intercom, which are used for solving the problem that the current public network intercom technology cannot meet the high standard requirement of users.
In order to solve the above technical problems, an embodiment of the present application provides a communication method for public network intercom, applied to a first terminal, including:
according to the audio input operation of the first terminal, sending an speaking right request to the intercom server, wherein the speaking right request is used for enabling the intercom server to carry out speaking right judgment;
after receiving the speaking right determining information sent by the intercom server, collecting audio data;
according to a first preset QoS processing mode in a network Real-time communication (Web Real-Time Communication, webRTC for short), the audio data is transmitted to a media server through a pre-constructed audio transmission channel, and the audio data is forwarded to a second terminal corresponding to the first terminal by the media server.
Specifically, the communication method for public network intercom, where the first preset QoS processing mode includes:
at least one of echo cancellation (Acoustic Echo Canceller, AEC for short), automatic gain compensation (Automatic Gain Control, AGC for short) and active noise reduction (Active Noise Cancellation, ANC for short) for data quality processing of the audio data;
Negative feedback (Negative Acknowledgement, NACK for short), forward error correction (Forward Error Correction, FEC for short), maximum receiving rate estimation (Receiver Estimated Maximum Bitrate, REMB for short), goog-REMB, goog-TCC and pacier techniques for performing data transmission processing on the audio data.
Specifically, the communication method of public network intercom as described above further includes:
and sending a speaking right release message to the intercom server according to the audio release operation, and stopping the collection and transmission of the audio data.
Preferably, the communication method of public network intercom as described above further includes:
sending a network address translation penetration service address request to the media server, and receiving first address information fed back by the media server;
and according to the first address information, carrying out interaction between a session description protocol (Session Description Protocol, SDP for short) and an interactive connection establishment (Interactive Connectivity Establishment, ICE for short) with the media server, and establishing the audio transmission channel.
Further, in the communication method for public network intercom, the interaction between the session description protocol SDP and the interactive connection establishment ICE according to the first address information and the media server, and the establishment of the audio transmission channel, include:
Sending SDP offer to the media server and receiving corresponding SDP response;
sending a dynamic address request to a corresponding network address translation penetration server according to the first address information, and receiving the dynamic address information fed back by the network address translation penetration server;
transmitting the dynamic address information to the media server, and receiving response information and fixed address information fed back by the media server;
creating a remote description according to the response information, and adding an address according to the fixed address information;
and establishing the audio transmission channel with the media server according to the dynamic address information and the fixed address information.
The application also provides a communication method of public network intercom, which is applied to a media server and comprises the following steps:
after receiving a service request sent by an intercom server, establishing an association relation according to a first terminal and a second terminal in the service request, wherein the service request is sent by the intercom server when the intercom server determines that the first terminal obtains speaking right;
after receiving audio data sent by the first terminal through a pre-constructed audio transmission channel, sending the audio data to the second terminal associated with the first terminal according to a second preset QoS processing mode in the WebRTC technology.
Specifically, the communication method for public network intercom, where the second preset QoS processing mode includes:
at least one of EFC, netEQ, goog-TCC and pacier techniques for data transmission of the audio data.
Specifically, the communication method of public network intercom as described above further includes:
and deleting the association relation when receiving the speaking right release message sent by the intercom server.
Preferably, the communication method of public network intercom as described above further includes:
receiving a network address translation penetrating service address request sent by the first terminal, and feeding back first address information about the network address translation penetrating service address;
and carrying out interaction of SDP and ICE with the first terminal, and establishing the audio transmission channel.
Further, the communication method for public network intercom, which is described above, performs interaction between SDP and ICE with the first terminal, and establishes the audio transmission channel, and includes:
receiving an SDP proposal sent by the first terminal and feeding back an SDP response;
receiving dynamic address information sent by the first terminal, and adding an address according to the dynamic address information;
Transmitting response information and fixed address information to the first terminal;
and establishing the audio transmission channel with the first terminal according to the dynamic address information and the fixed address information.
Still another embodiment of the present application provides a communication method for intercom in public network, applied to an intercom server, including:
when receiving a speaking right request sent by a first terminal, judging the speaking right of the first terminal;
after determining that the first terminal obtains the speaking right, sending a service request to a media server, wherein the service request comprises the following steps: the first terminal and a second terminal corresponding to a listener of the first terminal;
and after receiving the incidence relation establishment message fed back by the media server, feeding back the speaking right determination information to the first terminal.
Specifically, the communication method of public network intercom as described above further includes:
and sending the speaking right determining information to the second terminal.
Another embodiment of the present application also provides a terminal, including:
the first processing module is used for sending an speaking right request to the intercom server according to the audio input operation of the first terminal, and the speaking right request is used for enabling the intercom server to carry out speaking right judgment;
The second processing module is used for collecting audio data after receiving the speaking right determining information sent by the intercom server;
and the third processing module is used for transmitting the audio data to a media server through a pre-constructed audio transmission channel according to a first preset QoS processing mode in the WebRTC technology, and forwarding the audio data to a second terminal corresponding to the first terminal through the media server.
Still another embodiment of the present application provides a media server, including:
the fourth processing module is used for establishing an association relation according to a first terminal and a second terminal in the service request after receiving the service request sent by the intercom server, wherein the service request is sent by the intercom server when the intercom server determines that the first terminal obtains the speaking right;
and a fifth processing module, configured to receive audio data sent by the first terminal through a pre-constructed audio transmission channel, send the audio data to the second terminal associated with the first terminal according to a second preset QoS processing mode in WebRTC technology, and record the audio data.
Another embodiment of the present application also provides an intercom server, including:
The sixth processing module is used for judging the speaking right of the first terminal when receiving the speaking right request sent by the first terminal;
a seventh processing module, configured to send a service request to a media server after determining that the first terminal obtains the speaking right, where the service request includes: the first terminal and a second terminal corresponding to a listener of the first terminal;
and the eighth processing module is used for feeding back the speaking right determining information to the first terminal after receiving the incidence relation establishing message fed back by the media server.
Still another embodiment of the present application provides an electronic device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program when executed by the processor implements the steps of the communication method for public network intercom applied to the first terminal as described above, or implements the steps of the communication method for public network intercom applied to the media server as described above, or implements the steps of the communication method for public network intercom applied to the intercom server as described above.
Another embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, which when executed by a processor, implements the steps of the communication method for public network intercom applied to the first terminal as described above, or implements the steps of the communication method for public network intercom applied to the media server as described above, or implements the steps of the communication method for public network intercom applied to the intercom server as described above.
Compared with the prior art, the communication method, the terminal, the media server and the intercom server for public network intercom provided by the embodiment of the application have the following beneficial effects:
the application establishes the connection relation between the terminal and the media server through the WebRTC framework, and processes the audio data and the audio transmission through the QoS processing mode in the WebRTC technology, thereby ensuring the audio quality and the transmission efficiency, effectively improving the anti-weak network capacity of the public network intercommunication, and solving the problems of low tone quality and high transmission delay caused by bandwidth limitation and bad voice environment.
Drawings
Fig. 1 is a flow chart of a communication method applied to public network intercom of a first terminal;
fig. 2 is a second flow chart of a communication method of public network intercom applied to the first terminal;
fig. 3 is a third flow chart of a communication method of public network intercom applied to the first terminal;
FIG. 4 is a flow chart of a communication method applied to public network talkback of a media server;
FIG. 5 is a second flow chart of a communication method of public network talkback applied to a media server;
FIG. 6 is a third flow chart of a communication method of public network talkback applied to a media server;
FIG. 7 is a flow chart of a communication method applied to public network talkback of a talkback server;
fig. 8 is a schematic structural diagram of a public network intercom network system;
FIG. 9 is a schematic flow chart of a connection establishment between a first terminal and a media server;
fig. 10 is a schematic flow chart of a first terminal talkback through a media server;
FIG. 11 is a schematic block diagram of a first terminal;
FIG. 12 is a schematic block diagram of a media server;
fig. 13 is a schematic block diagram of the intercom server.
Detailed Description
In order to make the technical problems, technical solutions and advantages to be solved more apparent, the following detailed description will be given with reference to the accompanying drawings and specific embodiments. In the following description, specific details such as specific configurations and components are provided merely to facilitate a thorough understanding of embodiments of the application. It will therefore be apparent to those skilled in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the application. In addition, descriptions of well-known functions and constructions are omitted for clarity and conciseness.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
In various embodiments of the present application, it should be understood that the sequence numbers of the following processes do not mean the order of execution, and the order of execution of the processes should be determined by the functions and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
It should be understood that the term "and/or" is merely an association relationship describing the associated object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a from which B may be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may also determine B from a and/or other information.
Referring to fig. 8-10, in an embodiment of the present application, a public network intercom network system implemented based on a terminal, a media server and an intercom server is disclosed, wherein fig. 8 is a schematic structural diagram of the public network intercom network system; FIG. 9 is a schematic flow chart of a connection establishment between a first terminal and a media server; fig. 10 is a schematic flow chart of the intercom performed by the first terminal through the media server. In fig. 8, the terminal may be a web terminal or an app terminal, and is mainly responsible for: establishing webSocket connection with a signaling service (i.e., a signaling server); establishing connection with a media service (i.e. a media server) through a media establishment flow of WebRTC; audio data encoding and decoding and receiving and transmitting processing; invoking a QoS processing method of the WebRTC framework to process the real-time audio data; and other interactive processing with the server.
The signaling service is mainly responsible for: maintaining webSocket connection with the terminal and forwarding uplink and downlink signaling data.
Message queues are mainly responsible for: the messages are received from the signaling service and member service (i.e., member server), intercom service (i.e., intercom server), media service in north-south direction.
The device gateway is mainly responsible for: and receiving an http request from the terminal, carrying out request authentication, forwarding the request to member service, intercom service and media service, and obtaining a corresponding request result and returning the request result to the terminal.
The member service is mainly responsible for: and maintaining signaling or media connection state and basic intercom setting information of the terminal user.
The intercom service is mainly responsible for: conversations, speaking rights, etc.
The media service is mainly responsible for: establishing and maintaining the audio channel connection; request processing related to media resources such as talkback and the like; based on the WebRTC framework, low-latency and high-quality processing of real-time audio data is provided.
STUN/TURN services (i.e., network address translation pass through servers) are primarily responsible for feeding back NAT mapping addresses or relay addresses for terminals.
The modules are mainly in data connection communication through the following protocols:
WebSocket: the method is used for establishing long connection between the terminal and the signaling service, and performing connection keep-alive through a heartbeat keep-alive mechanism; and based on a protobuf custom intercom signaling data interaction protocol, quick low-flow data transmission is realized.
http: the method is mainly used for inquiring list information with larger data quantity and partial non-authentication data by the terminal; and synchronous data interaction among the internal service modules.
RTP/RTCP: and the audio data transmission and control protocol is used for the terminal to interact with the media data of the media service.
MQ: an asynchronous message interaction protocol based on TCP is used for reading and writing message queues.
Note that, the terminal a in fig. 9 and 10 corresponds to a first terminal described in the following text, and the terminal B corresponds to a second terminal described in the following text.
Referring to fig. 1, an embodiment of the present application provides a communication method for public network intercom, applied to a first terminal, including:
step S101, according to the audio input operation of the first terminal, sending an speaking right request to the intercom server, wherein the speaking right request is used for enabling the intercom server to conduct speaking right judgment. As shown in step 1 and step 2 in fig. 10, that is, when a first terminal needs to send audio messages to one or more second terminals, speaking right needs to be acquired first, so that interference between audio messages sent by multiple terminals simultaneously is avoided.
It should be noted that, the first terminal and the second terminal described herein may be a mobile terminal, a network terminal, and the like.
It should also be noted that the audio input operation includes, but is not limited to, a user pressing a physical key or a virtual key on the terminal.
Step S102, after receiving the speaking right determining information sent by the intercom server, collecting audio data. As shown in step 6 in fig. 10, in this step, after receiving the speaking right confirmation information, it may be determined that the current first terminal may speak, and at this time, the audio data of the user is collected and transmitted in real time later, which is beneficial to ensuring the validity of data collection and transmission.
In another embodiment of the present application, after receiving the speaking right determining information, the first terminal prompts the user in acoustic, optical, word, etc. modes, so as to inform the user that the speaking right is currently obtained, and speaking can be performed, which is beneficial to improving user experience.
Step S103, according to a first preset QoS processing mode in the WebRTC technology, the audio data is transmitted to a media server through a pre-built audio transmission channel, and the audio data is forwarded to a second terminal corresponding to the first terminal by the media server. In this step, after the audio data is collected, the audio data and the audio transmission are processed by introducing a first preset QoS processing mode in WebRTC technology instead of being directly sent to the second terminal for answering, so as to ensure the audio quality and the transmission efficiency of the processed audio data, and the processed audio data is transmitted to the media server through a dedicated audio transmission channel (shown as step 7 in fig. 10), and then forwarded to the second terminal by the media server (shown as step 10 in fig. 10), so as to ensure the audio quality of the audio data received by the second terminal.
In summary, the connection relation between the terminal and the media server is established through the WebRTC framework, and the audio data and the audio transmission are processed through the QoS processing mode in the WebRTC technology, so that the audio quality and the transmission efficiency are ensured, the weak network resistance of the public network intercommunication is effectively improved, and the problems of low tone quality and high transmission delay caused by bandwidth limitation and severe voice environment are solved.
Specifically, the communication method for public network intercom, where the first preset QoS processing mode includes:
at least one of AEC, AGC, and ANC for data quality processing of the audio data;
at least one of NACK, EFC, netEQ, goog-REMB, goog-TCC and pacir technologies for data transmission processing of the audio data.
In a specific embodiment of the present application, the first preset QoS processing mode is mainly used in both data quality processing and data transmission processing, where in the data quality processing, echo cancellation is performed by AEC, automatic gain control of an audio signal is performed by AGC, active noise reduction is performed by ANC, so that the audio quality of the audio data can be effectively improved, the processed audio data is encoded according to the audio encoding format after pre-negotiation, and then sent to the media server, so that the audio quality of the received audio data can be ensured; in the data transmission processing, the problem of data packet loss can be solved by negative feedback through NACK and/or forward error correction through EFC, the problem of jitter and disorder of data packets can be solved by NetEQ, bandwidth evaluation can be performed by Goog-REMB and/or Goog-TCC, congestion control can be performed by Pacer, so that the transmission efficiency of audio data in data transmission is improved, and the voice delay is greatly reduced.
It should be noted that the specific processing manner described above is only the processing method adopted in the present embodiment, and in actual use, the processing method is increased or decreased according to the actual situation and the transmission/reception relationship, and the processing method also falls within the protection scope of the present application.
Specifically, the communication method of public network intercom as described above further includes:
and sending a speaking right release message to the intercom server according to the audio release operation, and stopping the collection and transmission of the audio data. As shown in steps 12 through 14 of fig. 10.
In a specific embodiment of the present application, when receiving an audio release operation of a user, it may be determined that the current user has completed inputting audio data, and at this time, an speaking right release message is sent to the intercom server, so that the intercom server releases the speaking right, so that other users can obtain the speaking right, and input audio data, so as to ensure audio interaction between terminals, and at the same time, stop collection and transmission of audio data, thereby being beneficial to avoiding interference to audio data sent by other terminals.
It should also be noted that the audio release operation includes, but is not limited to, the user releasing a physical key or a virtual key on the terminal; or, pressing the physical key or the virtual key on the terminal again; or, clicking the physical key or the virtual key for a plurality of times.
Referring to fig. 2, preferably, the communication method of public network intercom as described above further includes:
step S201, a network address conversion penetrating service address request is sent to the media server, and first address information fed back by the media server is received; as shown in step 1 and step 2 in fig. 9.
Step S202, interaction of SDP and ICE is carried out with the media server according to the first address information, and the audio transmission channel is established. As shown in steps 3 through 26 of fig. 9.
In another embodiment of the present application, an audio transmission channel is pre-established between the first terminal and the media server, where in the process of establishing the audio transmission channel, since the terminal is located on the private network and is provided with a protection wall and/or a network address conversion protection, before establishing the audio transmission channel, an address of a corresponding network address conversion penetration server (for example, STUN/TURN server), that is, first address information, needs to be requested to the media server, so as to obtain a dynamic conversion address corresponding to the first terminal according to the service address, and perform interaction between SDP and ICE with the media server, thereby establishing the audio transmission channel, and ensuring that subsequent audio transmission and forwarding can be performed through the media server, so as to improve audio quality and transmission efficiency.
Referring to fig. 3, further, in the communication method of public network intercom, the interaction between SDP and ICE and the audio transmission channel establishment are performed with the media server according to the first address information, including:
step S301, sending an SDP offer to the media server and receiving a corresponding SDP answer. As shown in step 6 and step 7 in fig. 9. When the interaction is carried out with the media server, SDP interaction is carried out with the media server to complete negotiation of information such as media coding and decoding, and interaction is completed in an asynchronous interaction mode, namely, the first terminal firstly sends an SDP proposal to the signaling server and forwards the SDP proposal to the media server, but before the media server feeds back the SDP response, the signaling server feeds back the SDP response in advance.
It should be noted that, before sending the SDP offer, the first terminal may also create a peer-to-peer connection interface and SDP information, and set a local description.
Step S302, a dynamic address request is sent to a corresponding network address translation penetration server according to the first address information, and the dynamic address information fed back by the network address translation penetration server is received. As shown in step 10 and step 11 in fig. 9. In this step, the first terminal sends a dynamic address request to the corresponding network address translation penetration server according to the obtained first address information, so as to obtain dynamic address information corresponding to the first terminal, so that a transmission channel is established with the media server.
Step S303, the dynamic address information is sent to the media server, and the response information and the fixed address information fed back by the media server are received. As shown in step 12 and step 24 in fig. 9. In this step, the first terminal sends the acquired dynamic address information to the media server, and receives the response information fed back by the media server and the fixed address information of the media server, so as to perform ICE interaction, specifically, asynchronous interaction exists in the interaction process, which may be specifically: firstly, dynamic address information is sent to a signaling server and is forwarded to a media server by the signaling server, but before the signaling server does not receive the response of the media server, the dynamic address information is fed back to the first terminal; and then receiving the response information and the fixed address information forwarded by the media server through the signaling server and/or the message queue. The fixed address information includes the fixed address of the public network of the media server, so that network address conversion penetration is not needed, and the efficiency of establishing connection is improved.
Step S304, creating a remote description according to the response information is shown in step 22 in fig. 9. And address addition is performed according to the fixed address information as shown in step 25 in fig. 9. In this step, preferably, after receiving the response message, a remote description is created first, then fixed address information is received and address addition is performed according to the fixed address information, where the remote description created by the first terminal corresponds to the remote description created by the media server.
Step S305, establishing the audio transmission channel with the media server according to the dynamic address information and the fixed address information. As shown in step 26 of fig. 9. That is, after the fixed address information of the media server is obtained, the audio transmission channel can be established according to the addresses of the media server and the fixed address information, so that the safety and the high efficiency of the audio data transmission between the media server and the audio transmission channel are ensured.
Referring to fig. 4, another embodiment of the present application further provides a communication method for public network intercom, applied to a media server, including:
step S401, after receiving a service request sent by an intercom server, establishing an association relation according to a first terminal and a second terminal in the service request, wherein the service request is sent by the intercom server when determining that the first terminal obtains speaking right. That is, before providing the public network intercom service, the media server needs to first receive a service request sent by the intercom server (as shown in step 4 in fig. 10), where the service request is sent by the intercom server when determining that the first terminal obtains the speaking right, and the service request includes related information of the first terminal with the speaking right and the second terminal as the listener, so that after the media server receives the service request again, an association relationship can be established between the first terminal and the second terminal (as shown in step 5 in fig. 10), so that after receiving the audio data sent by the first terminal, the audio data is forwarded to the corresponding second terminal, and accuracy of forwarding of the audio data is ensured.
It should be noted that the association relationship may be a terminal group including the first terminal and the second terminal, or an audio pipe connecting the first terminal and the second terminal, where in the audio pipe, an interface (for example, a peer-to-peer connection interface) of the first terminal is a data transmission source, and an interface (for example, a peer-to-peer connection interface) of the second terminal is a data reception source.
Step S402, after receiving the audio data sent by the first terminal through the pre-constructed audio transmission channel, sending the audio data to the second terminal associated with the first terminal according to a second preset QoS processing manner in WebRTC technology (as shown in steps 7 to 10 in fig. 10). In this step, after the audio data transmitted by the first terminal through the dedicated audio transmission channel is received, the audio data is not directly sent to the second terminal for answering, but is processed by introducing a second preset QoS processing mode in WebRTC technology, so that the audio quality and transmission efficiency of the processed audio data are ensured, and then the audio data are forwarded to the second terminal, so that the audio quality of the audio data received by the second terminal and the transmission efficiency in the forwarding process are ensured.
In summary, the connection relation between the terminal and the media server is established through the WebRTC framework, and the audio data and the audio transmission are processed through the QoS processing mode in the WebRTC technology, so that the audio quality and the transmission efficiency are ensured, the weak network resistance of the public network intercommunication is effectively improved, and the problems of low tone quality and high transmission delay caused by bandwidth limitation and severe voice environment are solved.
Specifically, the communication method for public network intercom, where the second preset QoS processing mode includes:
at least one of EFC, netEQ, goog-TCC and pacier techniques for data transmission processing of the audio data.
In a specific embodiment of the present application, the second preset QoS processing mode mainly includes data transmission processing, in which the problem of packet loss of data can be solved by performing forward error correction through EFC, the problem of jitter and disorder of data packets can be solved by NetEQ, the bandwidth evaluation can be performed by Goog-TCC, and the congestion control can be performed by Pacer, thereby improving the transmission efficiency of audio data in data transmission and greatly reducing the voice delay. It should be noted that the specific processing manner described above is only the processing method adopted in the present embodiment, and in actual use, the processing method is increased or decreased according to the actual situation and the transmission/reception relationship, and the processing method also falls within the protection scope of the present application.
Specifically, the communication method of public network intercom as described above further includes:
when receiving the speaking right release message sent by the intercom server, deleting the association relationship (as shown in step 15 and step 16 in fig. 10).
In a specific embodiment of the present application, when receiving the speaking right release message sent by the intercom server, it may be determined that the current user has completed inputting the audio data, and at this time, the association relationship between the first terminal and the second terminal is deleted, which is favorable for avoiding interference to the audio data sent by other terminals and reducing the overhead of the media server.
Referring to fig. 5, preferably, the communication method of public network intercom as described above further includes:
step S501, receiving a network address translation pass through service address request sent by the first terminal, and feeding back first address information about the network address translation pass through service address (as shown in step 1 and step 2 in fig. 9);
step S502, performing interaction between SDP and ICE with the first terminal, and establishing the audio transmission channel (as shown in steps 6 to 26 in fig. 9).
In another embodiment of the present application, an audio transmission channel is pre-established between the media server and the first terminal, where, during the process of establishing the audio transmission channel, since the terminal is located on the private network and is provided with a protection wall and/or a network address translation protection, before the audio transmission channel is established, the media server receives a network address translation penetration service address request sent by the first terminal, for requesting an address of a corresponding network address translation penetration server (e.g. STUN/TURN server), that is, first address information; at this time, the media server feeds back the corresponding service address to the first terminal according to the network address translation penetration service address request, so that the first terminal obtains the corresponding dynamic translation address, and further interacts with the first terminal through SDP and ICE, thereby establishing an audio transmission channel, ensuring that the subsequent media server can receive and forward the audio data sent by the first terminal, and improving the audio quality and transmission efficiency of the public network intercom.
Referring to fig. 6, further, the communication method of public network intercom, where the interaction with the first terminal between SDP and ICE and the establishment of the audio transmission channel includes:
step S601, receiving the SDP offer sent by the first terminal, and feeding back an SDP answer (as shown in step 6 and step 7 in fig. 9). When the first terminal is interacted with, the first terminal is interacted with SDP, namely SDP proposal sent by the first terminal is received, SDP response is given to the first terminal, and negotiation of information such as media encoding and decoding is completed.
It should be noted that, after receiving the SDP offer, the media server also creates a peer-to-peer connection interface and sets a remote description.
Step S602, receiving the dynamic address information sent by the first terminal, and adding an address according to the dynamic address information (as shown in steps 12 to 14 in fig. 9). In this step, after receiving the dynamic address information sent by the first terminal, address addition is performed according to the dynamic address information, and the current public network dynamic address of the first terminal can be recorded at the media server, so that the audio transmission channel can be established later.
Step S603, transmitting response information and fixed address information to the first terminal (as shown in steps 16 to 24 in fig. 9). That is, when the address is added, the media server sends response information and fixed address information corresponding to the media server to the first terminal, where the response information may carry remote description of the media server, so that the first terminal creates corresponding remote description, and the fixed address information carries a public network fixed address corresponding to the media server.
It should be noted that, when the media server sends the response information and the fixed address information to the first terminal, the response information and the fixed address information will be sent sequentially, and in the sending process, asynchronous interaction between the media server and the first terminal is implemented through the message queue and/or the signaling server, in a specific embodiment, after the information sent by the media server arrives at the message queue, the message queue feeds back to the media server in advance before the feedback of the first terminal is not obtained, and the efficiency of establishing the audio transmission channel is beneficial to be improved through the asynchronous interaction.
Step S604 establishes the audio transmission channel with the first terminal according to the dynamic address information and the fixed address information (as shown in step 26 in fig. 9). That is, after the media server obtains the dynamic address information of the first terminal, the media server can establish an audio transmission channel according to the addresses of the first terminal and the second terminal, so that the security and the high efficiency of audio data transmission between the first terminal and the second terminal are ensured.
Referring to fig. 7, still another embodiment of the present application further provides a communication method for intercom of public network, applied to an intercom server, including:
step 701, when receiving the speaking right request sent by the first terminal, making speaking right judgment on the first terminal (as shown in steps 1 to 3 in fig. 10). In this step, the intercom server can receive the speaking right request sent by the terminal, and determine whether the terminal can obtain speaking right or not, that is, whether audio data can be sent or not, based on the speaking right request, so as to avoid that a plurality of terminals send audio data simultaneously, interference is caused between the terminals, and the audio playing effect of the terminal corresponding to the listener is affected.
In a specific embodiment, when the intercom server determines the speaking right, the intercom server determines according to at least one of the time sequence of sending the speaking right request, whether a terminal with the speaking right exists currently, whether a terminal waiting for the speaking right exists currently and the priority of the terminal (for example, the priority of the manager in the same chat room is higher than the priority of the common member). In another embodiment, the determination may also be made based on other determination factors.
Step S702, after determining that the first terminal obtains the speaking right, a service request is sent to a media server, where the service request includes: the first terminal and a second terminal corresponding to the listener of the first terminal (as shown in step 4 of fig. 10). That is, when the first terminal acquires the speaking right, the first terminal is used as a data transmitting source of the audio data, and the second terminal corresponding to the listener is used as a data receiving source, so that a service request carrying the receiving-transmitting relationship between the first terminal and the second terminal is sent to the media server, so that the media server establishes the association relationship between the first terminal and the second terminal, and the subsequent forwarding of the audio data is facilitated.
Step S703, after receiving the association relationship establishment message fed back by the media server, feeding back the speaking right determination information to the first terminal (as shown in the content after step 5 in fig. 9). In this step, after the intercom server receives the association relation establishment message fed back by the media server, it can determine that an association relation (audio pipeline) is established between the first terminal and the second terminal, and at this time, the speaking right determination information is fed back to the first terminal, so that the first terminal can collect audio data, and the media server forwards the audio data according to the established association relation.
In summary, the application sends the information of the first terminal and the second terminal related to the threshold to the media server through the communication between the intercom server and the first terminal and the media server, so as to establish the audio transmission based on the media server, and solve the problems of packet loss, jitter, disorder, noise and the like of audio data in the existing public network intercom application according to the QoS processing mode in the application of the WebRTC technology by the terminal and the media server, thereby improving the quality of audio received in the public network intercom, reducing the voice delay in the public network intercom, and improving the transmission efficiency.
Specifically, the communication method of public network intercom as described above further includes:
the right-to-speak determination information is transmitted to the second terminal (as shown in steps 5-1 to 5-3 in fig. 9).
In this step, after determining that the first terminal obtains the speaking right, the intercom server further transmits the speaking right determining information to the second terminal, so that the second terminal receives and plays the audio data. Specifically, in a specific embodiment, when the intercom server sends the speaking right determining information to the second terminal, the speaking right determining information needs to be forwarded through the message queue and the signaling server in sequence.
Referring to fig. 11, another embodiment of the present application further provides a terminal, including:
a first processing module 1101, configured to send an speaking right request to an intercom server according to an audio input operation of a first terminal, where the speaking right request is used to make the intercom server perform speaking right determination;
the second processing module 1102 is configured to collect audio data after receiving the speaking right determination information sent by the intercom server;
the third processing module 1103 is configured to transmit the audio data to a media server through a pre-constructed audio transmission channel according to a first preset QoS processing manner in WebRTC technology, and forward the audio data to a second terminal corresponding to the first terminal by the media server.
Specifically, the terminal as described above, the first preset QoS processing manner includes:
at least one of AEC, AGC, and ANC for data quality processing of the audio data;
at least one of NACK, EFC, netEQ, goog-REMB, goog-TCC and pacir technologies for data transmission processing of the audio data.
Specifically, the terminal as described above further includes:
and the ninth processing module is used for sending the speaking right release message to the intercom server according to the audio release operation and stopping the acquisition and transmission of the audio data.
Preferably, the terminal as described above further comprises:
a tenth processing module, configured to send a network address translation penetration service address request to the media server, and receive first address information fed back by the media server;
and the eleventh processing module is used for carrying out interaction between SDP and ICE with the media server according to the first address information and establishing the audio transmission channel.
Further, as described above, the eleventh processing module includes:
a first processing unit, configured to send an SDP offer to the media server and receive a corresponding SDP answer;
The second processing unit is used for sending a dynamic address request to the corresponding network address translation penetrating server according to the first address information and receiving the dynamic address information fed back by the network address translation penetrating server;
the third processing unit is used for sending the dynamic address information to the media server and receiving the response information and the fixed address information fed back by the media server;
the fourth processing unit is used for creating a remote description according to the response information and adding an address according to the fixed address information;
and the fifth processing unit is used for establishing the audio transmission channel with the media server according to the dynamic address information and the fixed address information.
The embodiment of the terminal of the application is a terminal corresponding to the embodiment of the communication method applied to the public network intercommunication of the terminal, and all implementation means in the embodiment of the method are applicable to the embodiment of the terminal, so that the same technical effects can be achieved.
Referring to fig. 12, still another embodiment of the present application provides a media server, including:
a fourth processing module 1201, configured to establish an association relationship according to a first terminal and a second terminal in a service request after receiving the service request sent by an intercom server, where the service request is sent by the intercom server when determining that the first terminal obtains an speaking right;
A fifth processing module 1202, configured to receive audio data sent by the first terminal through a pre-constructed audio transmission channel, send the audio data to the second terminal associated with the first terminal according to a second preset QoS processing manner in WebRTC technology, and record the audio data.
Specifically, the media server as described above, the second preset QoS processing manner includes:
at least one of EFC, netEQ, goog-TCC and pacier techniques for data transmission processing of the audio data.
Specifically, the media server as described above further includes:
and the twelfth processing module is used for deleting the association relation when receiving the speaking right release message sent by the intercom server.
Preferably, the media server as described above further comprises:
a thirteenth processing module, configured to receive a network address translation pass through service address request sent by the first terminal, and feed back first address information about the network address translation pass through service address;
and a fourteenth processing module, configured to perform interaction between SDP and ICE with the first terminal, and establish the audio transmission channel.
Further, as described above, the fourteenth processing module includes:
a sixth processing unit, configured to receive an SDP offer sent by the first terminal, and feed back an SDP answer;
a seventh processing unit, configured to receive dynamic address information sent by the first terminal, and perform address addition according to the dynamic address information;
an eighth processing unit, configured to send response information and fixed address information to the first terminal;
and the ninth processing unit is used for establishing the audio transmission channel with the first terminal according to the dynamic address information and the fixed address information.
Specifically, the intercom server as described above further includes:
and a fifteenth processing module, configured to send the speaking right determination information to the second terminal.
The embodiment of the media server of the application is a media server corresponding to the embodiment of the communication method applied to the public network intercommunication of the media server, and all the implementation means in the embodiment of the method are applicable to the embodiment of the media server, so that the same technical effect can be achieved.
Referring to fig. 13, another embodiment of the present application further provides an intercom server, including:
A sixth processing module 1301, configured to perform speaking right determination on a first terminal when receiving a speaking right request sent by the first terminal;
a seventh processing module 1302, configured to send a service request to a media server after determining that the first terminal obtains the right to speak, where the service request includes: the first terminal and a second terminal corresponding to a listener of the first terminal;
the eighth processing module 1303 is configured to, after receiving the association relationship establishment message fed back by the media server, feed back speaking right determination information to the first terminal.
The embodiment of the intercom server of the application is the intercom server corresponding to the embodiment of the communication method applied to the public network intercom of the intercom server, and all the implementation means in the embodiment of the method are applicable to the embodiment of the intercom server, so that the same technical effect can be achieved.
Still another embodiment of the present application provides an electronic device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program when executed by the processor implements the steps of the communication method for public network intercom applied to the first terminal as described above, or implements the steps of the communication method for public network intercom applied to the media server as described above, or implements the steps of the communication method for public network intercom applied to the intercom server as described above.
Another embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, which when executed by a processor, implements the steps of the communication method for public network intercom applied to the first terminal as described above, or implements the steps of the communication method for public network intercom applied to the media server as described above, or implements the steps of the communication method for public network intercom applied to the intercom server as described above.
Furthermore, the present application may repeat reference numerals and/or letters in the various examples. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed.
It is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprise," "include," or any other variation thereof, are intended to cover a non-exclusive inclusion.
While the foregoing is directed to the preferred embodiments of the present application, it will be appreciated by those skilled in the art that various modifications and adaptations can be made without departing from the principles of the present application, and such modifications and adaptations are intended to be comprehended within the scope of the present application.

Claims (17)

1. The communication method of public network intercom is applied to a first terminal and is characterized by comprising the following steps:
according to the audio input operation of the first terminal, sending an speaking right request to the intercom server, wherein the speaking right request is used for enabling the intercom server to carry out speaking right judgment;
after receiving the speaking right determining information sent by the intercom server, collecting audio data;
according to a first preset QoS processing mode in the webRTC technology, the audio data are transmitted to a media server through a pre-built audio transmission channel, and the media server forwards the audio data to a second terminal corresponding to the first terminal.
2. The public network intercom communication method according to claim 1, wherein the first preset QoS processing mode comprises:
at least one of echo cancellation AEC, automatic gain compensation AGC, and active noise reduction ANC for performing data quality processing on the audio data;
At least one of negative feedback NACK, forward error correction EFC, maximum received code rate estimation NetEQ, goog-REMB, goog-TCC and Pacer technology for data transmission processing of the audio data.
3. The communication method of public network intercom according to claim 1, further comprising:
and sending a speaking right release message to the intercom server according to the audio release operation, and stopping the collection and transmission of the audio data.
4. The communication method of public network intercom according to claim 1, further comprising:
sending a network address translation penetration service address request to the media server, and receiving first address information fed back by the media server;
and according to the first address information, performing interaction between a session description protocol SDP and an interactive connection establishment ICE with the media server, and establishing the audio transmission channel.
5. The method for public network intercom as in claim 4 wherein said interacting with said media server according to said first address information session description protocol SDP with an interactive connection establishment ICE and establishing said audio transmission path comprises:
Sending SDP offer to the media server and receiving corresponding SDP response;
sending a dynamic address request to a corresponding network address translation penetration server according to the first address information, and receiving the dynamic address information fed back by the network address translation penetration server;
transmitting the dynamic address information to the media server, and receiving response information and fixed address information fed back by the media server;
creating a remote description according to the response information, and adding an address according to the fixed address information;
and establishing the audio transmission channel with the media server according to the dynamic address information and the fixed address information.
6. A communication method of public network intercommunication is applied to a media server and is characterized by comprising the following steps:
after receiving a service request sent by an intercom server, establishing an association relation according to a first terminal and a second terminal in the service request, wherein the service request is sent by the intercom server when the intercom server determines that the first terminal obtains speaking right;
after receiving audio data sent by the first terminal through a pre-constructed audio transmission channel, sending the audio data to the second terminal associated with the first terminal according to a second preset QoS processing mode in the WebRTC technology.
7. The public network intercom communication method according to claim 6, wherein the second preset QoS processing mode comprises:
at least one of EFC, netEQ, goog-TCC and pacier techniques for data transmission processing of the audio data.
8. The communication method of public network intercom according to claim 6, further comprising:
and deleting the association relation when receiving the speaking right release message sent by the intercom server.
9. The communication method of public network intercom according to claim 6, further comprising:
receiving a network address translation penetrating service address request sent by the first terminal, and feeding back first address information about the network address translation penetrating service address;
and carrying out interaction of SDP and ICE with the first terminal, and establishing the audio transmission channel.
10. The public network intercom communication method according to claim 9, wherein the interaction between SDP and ICE with the first terminal and the establishment of the audio transmission channel are performed, comprises:
receiving an SDP proposal sent by the first terminal and feeding back an SDP response;
receiving dynamic address information sent by the first terminal, and adding an address according to the dynamic address information;
Transmitting response information and fixed address information to the first terminal;
and establishing the audio transmission channel with the first terminal according to the dynamic address information and the fixed address information.
11. A communication method of public network talkback is applied to a talkback server and is characterized by comprising the following steps:
when receiving a speaking right request sent by a first terminal, judging the speaking right of the first terminal;
after determining that the first terminal obtains the speaking right, sending a service request to a media server, wherein the service request comprises the following steps: the first terminal and a second terminal corresponding to a listener of the first terminal;
and after receiving the incidence relation establishment message fed back by the media server, feeding back the speaking right determination information to the first terminal.
12. The communication method of public network intercom according to claim 11, further comprising:
and sending the speaking right determining information to the second terminal.
13. A terminal, comprising:
the first processing module is used for sending an speaking right request to the intercom server according to the audio input operation of the first terminal, and the speaking right request is used for enabling the intercom server to carry out speaking right judgment;
The second processing module is used for collecting audio data after receiving the speaking right determining information sent by the intercom server;
and the third processing module is used for transmitting the audio data to a media server through a pre-constructed audio transmission channel according to a first preset QoS processing mode in the WebRTC technology, and forwarding the audio data to a second terminal corresponding to the first terminal through the media server.
14. A media server, comprising:
the fourth processing module is used for establishing an association relation according to a first terminal and a second terminal in the service request after receiving the service request sent by the intercom server, wherein the service request is sent by the intercom server when the intercom server determines that the first terminal obtains the speaking right;
and a fifth processing module, configured to receive audio data sent by the first terminal through a pre-constructed audio transmission channel, send the audio data to the second terminal associated with the first terminal according to a second preset QoS processing mode in WebRTC technology, and record the audio data.
15. An intercom server, comprising:
the sixth processing module is used for judging the speaking right of the first terminal when receiving the speaking right request sent by the first terminal;
A seventh processing module, configured to send a service request to a media server after determining that the first terminal obtains the speaking right, where the service request includes: the first terminal and a second terminal corresponding to a listener of the first terminal;
and the eighth processing module is used for feeding back the speaking right determining information to the first terminal after receiving the incidence relation establishing message fed back by the media server.
16. An electronic device comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program when executed by the processor implementing the steps of the communication method of any one of claims 1 to 5 applied to public network intercom of a first terminal, or the steps of the communication method of any one of claims 6 to 10 applied to public network intercom of a media server, or the steps of the communication method of any one of claims 11 to 12 applied to public network intercom of an intercom server.
17. A computer-readable storage medium, on which a computer program is stored, which when being executed by a processor implements the steps of the communication method for public network intercom applied to a first terminal as claimed in any one of claims 1 to 5, or implements the steps of the communication method for public network intercom applied to a media server as claimed in any one of claims 6 to 10, or implements the steps of the communication method for public network intercom applied to an intercom server as claimed in any one of claims 11 to 12.
CN202211121954.9A 2022-09-15 2022-09-15 Communication method, terminal, media server and intercom server for public network intercom Pending CN116980394A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211121954.9A CN116980394A (en) 2022-09-15 2022-09-15 Communication method, terminal, media server and intercom server for public network intercom

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211121954.9A CN116980394A (en) 2022-09-15 2022-09-15 Communication method, terminal, media server and intercom server for public network intercom

Publications (1)

Publication Number Publication Date
CN116980394A true CN116980394A (en) 2023-10-31

Family

ID=88471944

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211121954.9A Pending CN116980394A (en) 2022-09-15 2022-09-15 Communication method, terminal, media server and intercom server for public network intercom

Country Status (1)

Country Link
CN (1) CN116980394A (en)

Similar Documents

Publication Publication Date Title
US7620413B2 (en) Method for implementing push-to-talk over SIP and multicast RTP related system
JP4691100B2 (en) PT service system and method
US8126493B2 (en) Method and PoC gateway for implementing PoC service
US20080076362A1 (en) PTT system, method for implementing PTT communication, PTT management server and terminal device thereof
WO2011150815A1 (en) Method and device for realizing group session
EP2515534A1 (en) Method and system for session processing
WO2011088656A1 (en) Method and system for implementing three-party call of videophone by mobile terminals
CN104902111B (en) A kind of method, apparatus and system established based on Web RTC multi-party call
MX2007009133A (en) Method and apparatus for implicit floor control in push-to-talk over cellular systems.
JP2007142786A (en) Handover server, and mobile communication terminal communcable thereof
WO2009071005A1 (en) Method, system, server and client for transmitting media stream data
JP4808786B2 (en) Media data processing for SIP-based session service
US9509734B2 (en) Data group paging service
US9686334B2 (en) Transmission method for media data stream and thin client
CN109889405B (en) Communication method of network telephone, related device and system
CN116980394A (en) Communication method, terminal, media server and intercom server for public network intercom
CN110943910A (en) WebSocket-based interphone implementation method
TW200931878A (en) Method and system for establishing VoIP communication by means of digital video broadcasting network
CN104703152B (en) A kind of SMS processing and device
CN108683820B (en) Mobile internet voice platform system fusing public switched telephone network PSTN and application method thereof
WO2010043144A1 (en) Push-to-talk over cellular (poc) callback request processing method, transmitting/receiving device, and mobile terminal
JP3146714U (en) Apparatus for performing push-to-talk through session initiation protocol SIP and multicast RTP
US20180227342A1 (en) Media stream management system
CN116896546B (en) Visual intercom method, system and storage medium based on SRT communication protocol
CN106559753B (en) Method and system for granting speaking right

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination