WO2021155702A1 - 通信处理方法、装置、终端、服务器及存储介质 - Google Patents

通信处理方法、装置、终端、服务器及存储介质 Download PDF

Info

Publication number
WO2021155702A1
WO2021155702A1 PCT/CN2020/132443 CN2020132443W WO2021155702A1 WO 2021155702 A1 WO2021155702 A1 WO 2021155702A1 CN 2020132443 W CN2020132443 W CN 2020132443W WO 2021155702 A1 WO2021155702 A1 WO 2021155702A1
Authority
WO
WIPO (PCT)
Prior art keywords
configuration file
microphone
request
server
client
Prior art date
Application number
PCT/CN2020/132443
Other languages
English (en)
French (fr)
Inventor
魏春祥
Original Assignee
北京达佳互联信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京达佳互联信息技术有限公司 filed Critical 北京达佳互联信息技术有限公司
Priority to EP20918029.8A priority Critical patent/EP4102798A4/en
Publication of WO2021155702A1 publication Critical patent/WO2021155702A1/zh
Priority to US17/412,844 priority patent/US11444992B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H04L65/4038—Arrangements for multi-party communication, e.g. for conferences with floor control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827—Network arrangements for conference optimisation or adaptation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/2866—Architectures; Arrangements
    • H04L67/30—Profiles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Definitions

  • This application relates to computer communication technology, and in particular to a communication processing method, device, terminal, server and storage medium.
  • Multi-person chat rooms based on live broadcast have been favored by more and more users in recent years.
  • the chat room provides a way of multi-person online chat, which is easy and convenient, and has a variety of playing methods. It meets the needs of different groups of social and entertainment, and the penetration rate is constantly increasing.
  • the server In related technologies, most chat rooms use long-connection signaling for communication. However, limited by the carrying capacity of the persistent connection server, the server generally sets the signaling transmission interval of the long connection to several seconds, which greatly affects the instantaneous arrival of the signaling. The delay or loss of the signaling makes it dependent on the signaling to the microphone. If the time is longer, the success rate of microphone loading will decrease, and the user experience will decrease.
  • the present application provides a communication processing method, device, terminal, server, and storage medium, so as to at least solve the problem of a long time for wheat transmission in related technologies.
  • the technical solution of this application is as follows:
  • a communication processing method applied to a client including: obtaining a microphone uploading operation request, which is used to request to turn on the microphone and collecting audio; sending a microphone uploading HTTP request to the server ,
  • the upload HTTP request is used to request the configuration file needed for the mic push, the configuration file is used to provide the setting items needed for the mic push; receive the configuration file returned by the server; parse the configuration file, and according to the configuration file
  • the setting item turns on the microphone, collects audio and pushes the stream.
  • a communication processing method which is applied to a server, and includes: receiving an HTTP request for uploading a microphone sent by a client, and the HTTP request for uploading a microphone is used to request a configuration file required for continuous microphone streaming; According to the HTTP request of uploading, obtain the configuration file required by the client to connect to the microphone.
  • the configuration file is used to provide the setting items required by the client to connect to the microphone; the configuration file is sent to the client as the response to the HTTP request of uploading. .
  • a communication processing device applied to a client, including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute the instructions,
  • obtain the microphone operation request the microphone operation request is used to request to turn on the microphone and collect audio
  • send the microphone HTTP request to the server the microphone HTTP request is used to request what is needed for the microphone to push streaming
  • a configuration file the configuration file is used to provide the setting items needed to connect with the microphone
  • receive the configuration file returned by the server parse the configuration file, and turn on the microphone according to the setting items in the configuration file to collect audio And push the stream.
  • a communication processing device which is applied to a server, and includes: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute all instructions.
  • the instructions are described in order to implement the following steps: receiving an HTTP uploading request sent by a client, the HTTP uploading request is used to request a configuration file required for connecting the microphone to push streaming; obtaining the client according to the HTTP uploading request The configuration file required by the microphone streaming, the configuration file is used to provide the setting items required by the client for the microphone streaming; sending the configuration file to the client as a response to the HTTP request for uploading the microphone end.
  • a terminal including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute instructions to implement the communication processing as in the first aspect method.
  • a server including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute instructions to implement communication processing as in the second aspect method.
  • a storage medium when an instruction in the storage medium is executed by a processor of a terminal, enables the terminal to execute the communication processing method as in the first aspect, or when the instruction in the storage medium When executed by the processor of the server, the server can execute the communication processing method as in the second aspect.
  • a computer program product includes readable program code, and when the readable program code is executed by a processor of a terminal, the terminal can execute the same as in the first aspect.
  • the server can execute the communication processing method of the second aspect.
  • Fig. 1 is a flowchart showing a communication processing method according to an exemplary embodiment.
  • Fig. 2 is a flowchart showing a communication processing method according to an exemplary embodiment
  • FIG. 3 is an interaction flowchart showing a communication processing method according to an exemplary embodiment
  • Fig. 4 is a block diagram showing a communication processing device according to an exemplary embodiment
  • Fig. 5 is a block diagram showing a communication processing device according to an exemplary embodiment
  • Fig. 6 is a block diagram showing a terminal according to an exemplary embodiment
  • Fig. 7 is a block diagram showing a server according to an exemplary embodiment.
  • Fig. 8 is a block diagram showing a terminal according to an exemplary embodiment
  • Fig. 9 is a block diagram showing a server according to an exemplary embodiment.
  • this application provides the following technical solutions.
  • Fig. 1 is a flowchart showing a communication processing method according to an exemplary embodiment. As shown in Fig. 1, the communication processing method is used in a client and includes the following steps.
  • a microphone loading operation request is obtained, and the microphone loading operation request is used to request to turn on the microphone and collect audio.
  • the host user After the host user opens a live broadcast-based chat room, the user as the audience can enter the chat room. If the audience user wants to speak, he can apply for the microphone to request to turn on the microphone and collect audio. The client can obtain it based on the user's operation Go to the microphone operation request.
  • an HTTP upload request is sent to the server, and the HTTP upload request is used to request the configuration file required for connecting the microphone, and the configuration file is used to provide the setting items required for the connecting microphone.
  • the client After receiving the mic upload operation request, the client sends a mai HTTP (Hypertext Transfer Protocol, Hypertext Transfer Protocol) request to the server, so that the mai HTTP request can request the server for the configuration file required for mic push streaming.
  • a mai HTTP Hypertext Transfer Protocol, Hypertext Transfer Protocol
  • TCP Transmission Control Protocol
  • the client can send an HTTP request to the server via the TCP connection.
  • the server After the server receives the HTTP upload request, it will obtain the corresponding configuration file according to the HTTP upload request, and return the configuration file to the client as a response to the HTTP upload request.
  • the client receives the configuration file returned by the server, and can subsequently perform the microphone upload operation according to the configuration file. After the client receives the configuration file returned by the server, it can close the TCP connection with the server to release resources in time.
  • the configuration file is parsed, the microphone is turned on according to the setting items in the configuration file, the audio is collected and the stream is pushed.
  • the setting items in the configuration file can optionally include: the IP address of the stream to be pushed, audio sampling rate, encoding format and bit rate, etc.
  • the IP address of the stream to be pushed can be the chat room identifier
  • the audio sampling rate is the sampling rate that needs to be used when collecting audio
  • the encoding format is the format used to encode the collected audio
  • the bit rate is the code used when pushing the stream. Rate.
  • the client After receiving the configuration file returned by the server, the client parses the configuration file to obtain various setting items in the configuration file, turns on the microphone according to the setting items in the configuration file, collects audio according to the audio sampling rate in the configuration file, and according to the configuration file
  • the audio is encoded in the encoding format of, and the stream is pushed according to the bit rate in the configuration file when the stream is pushed after encoding.
  • the communication processing method of the present disclosure by obtaining a microphone loading operation request, sending a microphone loading HTTP request to the server, receiving a configuration file returned by the server in the form of a response of the HTTP request, parsing the configuration file and performing the microphone loading operation.
  • the communication processing method provided by the present disclosure solves the problem of signaling delay and loss when the long-connection signaling is used for mic-up communication, reduces the mic-up time, and can improve the success rate of the mic-up.
  • the communication processing method further includes:
  • an HTTP request for successful uploading is sent to the server, and the successful HTTP request for uploading is used to notify the server of the successful uploading.
  • the server does not receive the push data within a period of time, it means that the server has also completed receiving the push data, and can send instructions to the client, and the client can send the instructions to the server after receiving the instructions A successful HTTP request to the microphone.
  • the client does not obtain the data that needs to be streamed within a period of time, it can directly send an HTTP request for successful upload to the server.
  • the client After the client determines that the push is successful, it establishes a TCP connection with the server again, and sends a successful HTTP request to the server through the TCP connection to notify the server of the successful upload, so that the server can change the interactive state of the client.
  • the operation of uploading the microphone can be performed by the Lianmai SDK (Software Development Kit) in the client.
  • the Lianmai SDK is a part of the client. It is a software package used to perform the operation of connecting the microphone. It is packaged separately for Realize the underlying functions, independent of the business level.
  • the client transparently transmits the configuration file to Lianmai SDK.
  • Lianmai SDK parses the configuration file to obtain various setting items in the configuration file, turns on the microphone according to each setting item in the configuration file, and collects audio according to the audio sampling rate in the configuration file.
  • the encoding format encodes the collected audio. After encoding, the stream is pushed according to the bit rate in the configuration file.
  • the successful push message is called back to the client.
  • the client obtains the successful push message callback from the Lianmai SDK, it establishes a TCP connection with the server again, and sends a successful HTTP request to the server through the TCP connection to notify the server of the successful upload, so that the server can change the interaction of the client. state.
  • Fig. 2 is a flowchart showing a communication processing method according to an exemplary embodiment. As shown in Fig. 2, the communication processing method is used in a server.
  • an HTTP upload request sent by the client is received, and the HTTP upload request is used to request the configuration file required for the streaming of the microphone.
  • the HTTP request for the microphone is a request initiated by the audience user in the chat room, that is, after the anchor user creates the chat room, the audience user can join the chat room. If the audience user wants to speak, he can send the HTTP request for the microphone through the client .
  • TCP connection establishment process is the same as above, so I won't repeat it here.
  • data can be transmitted through the TCP connection, that is, the HTTP request for wheat upload sent by the client is received through the TCP connection.
  • step S22 according to the HTTP request for uploading the microphone, a configuration file required by the client for connecting the microphone is obtained, and the configuration file is used to provide the setting items required by the client for connecting the microphone.
  • the configuration file may optionally include: the IP address of the stream to be pushed, audio sampling rate, encoding format, and bit rate.
  • the IP address of the stream to be pushed can be the chat room identifier
  • the audio sampling rate is the sampling rate that needs to be used when collecting audio
  • the encoding format is the format used to encode the collected audio
  • the bit rate is the code used when pushing the stream. Rate.
  • the configuration file required for the client to connect to the microphone is obtained. All clients in a chat room can use the same configuration file, that is, they can use the same audio sampling rate, encoding format, and bit rate, and the IP addresses to be pushed are the same, which are the chat room identifiers.
  • step S23 the configuration file is sent to the client as a response to the HTTP request for uploading.
  • the configuration file After obtaining the configuration file required by the client to connect to the microphone, the configuration file is sent to the client through the TCP connection as a response to the HTTP request for uploading the microphone, and the subsequent client can perform the uploading operation according to the configuration file.
  • the communication processing method of the present disclosure by receiving the HTTP request for uploading the microphone sent by the client, according to the HTTP request for uploading, obtaining the configuration file required by the client to connect the microphone for streaming, and sending the configuration file to the client as the response to the HTTP request for uploading. It solves the problem of signal delay and loss when the long-connection signaling is used for mic-up communication, reduces the mic-up time, and can improve the success rate of mic-up.
  • the step of obtaining the configuration file required by the client to connect to the microphone according to the HTTP request for uploading the microphone may optionally include:
  • the upload HTTP request send a configuration file acquisition request to the streaming media data center, and the configuration file acquisition request is used to request the streaming media data center for the configuration file required by the client to connect to the microphone;
  • the streaming media data center is used to provide services related to streaming media data.
  • the server After the server receives the HTTP upload request sent by the client, it sends a configuration file acquisition request to the streaming media data center.
  • the streaming media data center assigns the client to the client according to the chat room identifier in the configuration file acquisition request. For the required resources, generate the configuration file required by the client to connect with the microphone, and return the generated configuration file to the server, and the server receives the configuration file returned by the streaming media data center. Through the interaction between the server and the streaming media data center, the configuration file required by the client to connect to the microphone is obtained.
  • the services provided by the server and the streaming media data center are relatively independent and do not affect each other, which can ensure the good operation of the service.
  • the streaming media data center generates a configuration file required for the client to connect the microphone to push streaming according to the current system load.
  • the streaming media data center allocates resources for the client's continuous microphone streaming according to the current system load, and generates the configuration files required for the client's continuous microphone streaming. For example, when the current system load is low, a higher bit rate can be allocated to ensure a higher transmission speed; when the current system load is heavy, a lower bit rate can be allocated to ensure the normal operation of each client .
  • Fig. 3 is an interaction flowchart of a communication processing method according to an exemplary embodiment. As shown in Fig. 3, the communication processing method includes the following steps.
  • the client obtains the mic upload operation request, and sends the mic upload HTTP request to the server.
  • the mic upload HTTP request is used to request the configuration file required for the mic push streaming, and the configuration file is used to provide the settings required for the mic push streaming. item.
  • the host user After the host user opens a live broadcast-based chat room, the user as the audience can enter the chat room. If the audience user wants to speak, he can apply for the microphone.
  • the client obtains the microphone operation request based on the user's operation and sends it to the server Send an HTTP request to the microphone.
  • the server sends a configuration file acquisition request to the streaming media data center according to the HTTP request for uploading the microphone.
  • the streaming media data center generates the configuration file required by the client to connect the microphone to the stream according to the current system load.
  • the streaming media data center returns the configuration file to the server.
  • the server returns the configuration file to the client through the HTTP interface for uploading the microphone request.
  • the client transparently transmits the configuration file to Lianmai SDK.
  • Lianmai SDK parses the configuration file, turns on the microphone according to the settings in the configuration file, collects audio and pushes the stream.
  • Lianmai SDK collects the audio, it pushes it to the streaming media data center, so that other clients in the chat room can pull streams from the streaming media data center.
  • the client sends a successful HTTP request to the server.
  • the client After the successful uploading, the client sends an HTTP request again to notify the server that the uploading is successful. Based on the HTTP request, the server will receive a response to the HTTP request, indicating that the server has received the notification of the successful uploading of the client.
  • the communication processing method provided by the present disclosure communicates through HTTP requests when the client and the server communicate with the microphone, abandons the communication method of long-connection signaling, and solves the problems of signaling delay and loss. It shortens the waiting time for the audience to enter the microphone, improves the success rate of the microphone, and enhances the user experience.
  • Fig. 4 is a block diagram showing a communication processing device according to an exemplary embodiment.
  • the device is applied to the client.
  • the device includes an operation request obtaining module 41, an HTTP request sending module 42, a configuration file receiving module 43, and a microphone loading operation module 44.
  • the operation request obtaining module 41 is configured to obtain a microphone loading operation request, which is used to request to turn on the microphone and collect audio;
  • the HTTP request sending module 42 is configured to send an HTTP upload request to the server, the HTTP upload request is used to request a configuration file required for the microphone push, and the configuration file is used to provide setting items required for the microphone push;
  • the configuration file receiving module 43 is configured to receive the configuration file returned by the server
  • the microphone loading operation module 44 is configured to parse the configuration file, turn on the microphone according to the setting items in the configuration file, collect audio and push the stream.
  • the communication processing device further includes:
  • the successful notification module of the mic upload is configured to send a successful HTTP request to the server based on the success of the push stream, and the successful HTTP request for the mic upload is used to notify the server of the success of the mic upload.
  • the HTTP request sending module is further configured as:
  • the successful notification module of the microphone is configured to re-establish a TCP connection with the server, and send a successful HTTP request to the server through the re-established TCP connection.
  • the communication processing device of the present disclosure obtains the microphone loading operation request through the operation request obtaining module, the HTTP request sending module sends the microphone loading HTTP request to the server, the response receiving module receives the configuration file returned by the server in the form of the response of the HTTP request, the microphone loading operation module Analyze the configuration file and perform the microphone upload operation, which solves the problem of signal delay and loss when the long connection signaling is used for the microphone communication, reduces the microphone upload time, and can improve the success rate of the microphone.
  • Fig. 5 is a block diagram showing a communication processing device according to an exemplary embodiment.
  • the device is applied to a server.
  • the device includes an HTTP request receiving module 51, a configuration file obtaining module 52, and a response sending module 53.
  • the HTTP request receiving module 51 is configured to receive an HTTP uploading request sent by a client, and the HTTP uploading request is used to request a configuration file required for connecting the microphone to push streaming;
  • the configuration file obtaining module 52 is configured to obtain the configuration file required by the client to connect the microphone to push streaming according to the HTTP request of uploading the microphone, and the configuration file is used to provide the setting items required by the client to connect the microphone to push streaming;
  • the response sending module 53 is configured to send the configuration file as a response to the HTTP request for uploading to the client.
  • the configuration file acquisition module includes:
  • the configuration file requesting unit is configured to send a configuration file acquisition request to the streaming media data center according to the HTTP request for uploading the microphone, and the configuration file acquisition request is used to request the streaming media data center for the configuration file required by the client to connect to the microphone;
  • the configuration file receiving unit is configured to receive the configuration file returned by the streaming media data center.
  • the streaming media data center generates a configuration file required by the client to connect the microphone to the stream based on the current system load.
  • the configuration file includes: the IP address, audio sampling rate, encoding format, and bit rate of the stream to be pushed.
  • the communication processing device of the present disclosure receives the HTTP request for uploading the microphone sent by the client through the HTTP request receiving module, and the configuration file obtaining module obtains the configuration file required by the client for connecting the microphone to push streaming according to the HTTP request for uploading the microphone, and the response sending module configures The file is returned to the client as a response to the HTTP request for uploading the microphone, which solves the problem of signaling delay and loss when the long-connection signaling is used for uploading communication, reduces the duration of the uploading, and can improve the success rate of the uploading.
  • Fig. 6 is a block diagram showing a communication processing device according to an exemplary embodiment.
  • the device is applied to a client.
  • the device includes a processor 60 and a memory 61, where the memory 61 is used to store instructions executable by the processor 60.
  • processor 60 is configured to execute instructions to implement the following steps:
  • Get the microphone operation request which is used to request to turn on the microphone and collect audio
  • the HTTP upload request is used to request the configuration file required for the mic push, and the configuration file is used to provide the setting items required for the mic push;
  • Parse the configuration file turn on the microphone according to the setting items in the configuration file, collect audio and push the stream.
  • processor 60 is further configured to execute:
  • an HTTP request for successful uploading is sent to the server, and the successful HTTP request for uploading is used to notify the server of the successful uploading.
  • processor 60 is further configured to execute:
  • processor 60 is further configured to execute:
  • the configuration file includes: the IP address, audio sampling rate, encoding format, and bit rate of the stream to be pushed.
  • the communication processing device of the present disclosure obtains the microphone loading operation request through the operation request obtaining module, the HTTP request sending module sends the microphone loading HTTP request to the server, the response receiving module receives the configuration file returned by the server in the form of the response of the HTTP request, the microphone loading operation module Analyze the configuration file and perform the microphone upload operation, which solves the problem of signal delay and loss when the long connection signaling is used for the microphone communication, reduces the microphone upload time, and can improve the success rate of the microphone.
  • Fig. 7 is a block diagram showing a communication processing device according to an exemplary embodiment.
  • the device is applied to a client.
  • the device includes a processor 70 and a memory 71, where the memory 71 is used to store instructions executable by the processor 70.
  • processor 70 is configured to execute instructions to implement the following steps:
  • the configuration file required by the client to connect the microphone
  • the configuration file is used to provide the setting items required by the client to connect the microphone
  • the configuration file is sent to the client as a response to the HTTP request for uploading.
  • processor 70 is further configured to execute:
  • the upload HTTP request send a configuration file acquisition request to the streaming media data center, and the configuration file acquisition request is used to request the streaming media data center for the configuration file required by the client to connect to the microphone;
  • the configuration file is generated by the streaming media data center according to the current system load.
  • the configuration file includes: the IP address, audio sampling rate, encoding format, and bit rate of the stream to be pushed.
  • the communication processing device of the present disclosure receives the HTTP request for uploading the microphone sent by the client through the HTTP request receiving module, and the configuration file obtaining module obtains the configuration file required by the client for connecting the microphone to push streaming according to the HTTP request for uploading the microphone, and the response sending module configures The file is returned to the client as a response to the HTTP request for uploading the microphone, which solves the problem of signaling delay and loss when the long-connection signaling is used for uploading communication, reduces the duration of the uploading, and can improve the success rate of the uploading.
  • Fig. 8 is a block diagram showing a terminal according to an exemplary embodiment.
  • the terminal 800 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
  • the terminal 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, And the communication component 816.
  • a processing component 802 a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, And the communication component 816.
  • the processing component 802 generally controls the overall operations of the terminal 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing communication processing method.
  • the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components.
  • the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
  • the memory 804 is configured to store various types of data to support operations in the terminal 800. Examples of these data include instructions for any application or method operated on the terminal 800, contact data, phone book data, messages, pictures, videos, etc.
  • the memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable and Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic Disk Magnetic Disk or Optical Disk.
  • the power supply component 806 provides power for various components of the terminal 800.
  • the power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the terminal 800.
  • the multimedia component 808 includes a screen that provides an output interface between the terminal 800 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
  • the multimedia component 808 includes a front camera and/or a rear camera. When the terminal 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 810 is configured to output and/or input audio signals.
  • the audio component 810 includes a microphone (MIC), and when the terminal 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive external audio signals.
  • the received audio signal may be further stored in the memory 804 or transmitted via the communication component 816.
  • the audio component 810 further includes a speaker for outputting audio signals.
  • the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module.
  • the above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: home button, volume button, start button, and lock button.
  • the sensor component 814 includes one or more sensors for providing the terminal 800 with various status assessments.
  • the sensor component 814 can detect the open/close state of the terminal 800 and the relative positioning of components.
  • the component is the display and the keypad of the terminal 800.
  • the sensor component 814 can also detect the position change of the terminal 800 or a component of the terminal 800. , The presence or absence of contact between the user and the terminal 800, the orientation or acceleration/deceleration of the terminal 800, and the temperature change of the terminal 800.
  • the sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact.
  • the sensor component 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 816 is configured to facilitate wired or wireless communication between the terminal 800 and other devices.
  • the terminal 800 can access a wireless network based on a communication standard, such as WiFi, an operator network (such as 2G, 3G, 4G, or 5G), or a combination thereof.
  • the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • the terminal 800 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable Implemented by a gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components, and used to execute the above-mentioned communication processing method.
  • ASIC application specific integrated circuits
  • DSP digital signal processors
  • DSPD digital signal processing devices
  • PLD programmable logic devices
  • FPGA field programmable Implemented by a gate array
  • controller microcontroller, microprocessor, or other electronic components, and used to execute the above-mentioned communication processing method.
  • a storage medium including instructions is also provided, such as a memory 804 including instructions, and the foregoing instructions may be executed by the processor 820 of the terminal 800 to complete the foregoing communication processing method.
  • the storage medium may be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage Equipment, etc.
  • a computer program product includes readable program code, and the readable program code can be executed by the processor 820 of the terminal 800 to complete the aforementioned communication processing method.
  • the program code may be stored in a storage medium of the terminal 800.
  • the storage medium may be a non-transitory computer-readable storage medium.
  • the non-transitory computer-readable storage medium may be a ROM or a random access memory. (RAM), CD-ROM, magnetic tape, floppy disk and optical data storage device, etc.
  • Fig. 9 is a block diagram showing a server according to an exemplary embodiment.
  • the server 900 includes a processing component 922, which further includes one or more processors, and a memory resource represented by a memory 932, for storing instructions that can be executed by the processing component 922, such as application programs.
  • the application program stored in the memory 932 may include one or more modules each corresponding to a set of instructions.
  • the processing component 922 is configured to execute instructions to execute the communication processing method described above.
  • the server 900 may also include a power supply component 926 configured to perform power management of the server 900, a wired or wireless network interface 950 configured to connect the server 900 to the network, and an input output (I/O) interface 958.
  • the server 900 can operate based on an operating system stored in the storage 932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.
  • a storage medium including instructions such as a memory 932 including instructions, and the foregoing instructions may be executed by the processing component 922 of the server 900 to complete the foregoing communication processing method.
  • the storage medium may be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage Equipment, etc.
  • a computer program product includes readable program code, and the readable program code can be executed by the processing component 922 of the server 900 to complete the aforementioned communication processing method.
  • the program code may be stored in a storage medium of the server 900, and the storage medium may be a non-transitory computer-readable storage medium.
  • the non-transitory computer-readable storage medium may be a ROM or a random access memory. (RAM), CD-ROM, magnetic tape, floppy disk and optical data storage device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • Telephonic Communication Services (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请关于一种通信处理方法、装置、终端、服务器及存储介质，该方法包括：根据获取上麦操作请求，所述上麦操作请求用于请求开启麦克风并采集音频；向服务器发送上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件，所述配置文件用于提供连麦推流所需要的设置项；接收所述服务器返回的配置文件；解析所述配置文件，并根据所述配置文件中的设置项开启麦克风，采集音频并推流。本申请由于客户端与服务器进行上麦通信时采用的是HTTP请求及响应的形式，耗时在几十毫秒级别，解决了长连接信令进行上麦通信时信令延迟及丢失的问题，减少了上麦时长，而且可以提高上麦成功率。

Description

通信处理方法、装置、终端、服务器及存储介质 技术领域
本申请涉及计算机通信技术，尤其涉及一种通信处理方法、装置、终端、服务器及存储介质。
背景技术
基于直播的多人聊天室，近年来受到越来越多用户的青睐。聊天室提供了一种多人在线聊天的方式，轻松便捷、玩法多样，满足了不同群体社交、娱乐等需求，渗透率在不断提升。
相关技术中，聊天室大多采用长连接信令的方式进行通信。但受限于长连接服务器的承载能力，服务器一般会将长连接的信令发送间隔设置为若干秒，极大影响信令的到达即时性，信令的延迟或丢失使得依赖信令上麦的时间较长，上麦成功率降低，用户体验下降。
发明内容
本申请提供一种通信处理方法、装置、终端、服务器及存储介质，以至少解决相关技术中上麦时间较长的问题。本申请的技术方案如下：
根据本申请实施例的第一方面，提供一种通信处理方法，应用于客户端，包括：获取上麦操作请求，上麦操作请求用于请求开启麦克风并采集音频；向服务器发送上麦HTTP请求，上麦HTTP请求用于请求连麦推流所需要的配置文件，配置文件用于提供连麦推流所需要的设置项；接收服务器返回的配置文件；解析配置文件，并根据配置文件中的设置项开启麦克风，采集音频并推流。
根据本申请实施例的第二方面，提供一种通信处理方法，应用于服务器，包括：接收客户端发送的上麦HTTP请求，上麦HTTP请求用于请求连麦推流 所需要的配置文件；根据上麦HTTP请求，获取客户端连麦推流所需要的配置文件，配置文件用于提供客户端连麦推流所需要的设置项；将配置文件作为上麦HTTP请求的响应发送至客户端。
根据本申请实施例的第三方面，提供一种通信处理装置，应用于客户端，包括：处理器；用于存储处理器可执行指令的存储器；其中，处理器被配置为执行所述指令，以实现如下步骤：获取上麦操作请求，所述上麦操作请求用于请求开启麦克风并采集音频；向服务器发送上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件，所述配置文件用于提供连麦推流所需要的设置项；接收所述服务器返回的配置文件；解析所述配置文件，并根据所述配置文件中的设置项开启麦克风，采集音频并推流。
根据本申请实施例的第四方面，提供一种通信处理装置，应用于服务器，包括：处理器；用于存储所述处理器可执行指令的存储器；其中，所述处理器被配置为执行所述指令，以实现如下步骤：接收客户端发送的上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件；根据所述上麦HTTP请求，获取所述客户端连麦推流所需要的配置文件，所述配置文件用于提供所述客户端连麦推流所需要的设置项；将所述配置文件作为所述上麦HTTP请求的响应发送至所述客户端。
根据本申请实施例的第五方面，提供一种终端，包括：处理器；用于存储处理器可执行指令的存储器；其中，处理器被配置为执行指令，以实现如第一方面的通信处理方法。
根据本申请实施例的第六方面，提供一种服务器，包括：处理器；用于存储处理器可执行指令的存储器；其中，处理器被配置为执行指令，以实现如第二方面的通信处理方法。
根据本申请实施例的第七方面，一种存储介质，当存储介质中的指令由终端的处理器执行时，使得终端能够执行如第一方面的通信处理方法，或者，当存储介质中的指令由服务器的处理器执行时，使得服务器能够执行如第二方面的通信处理方法。
根据本申请实施例的第八方面，提供一种计算机程序产品，该计算机程序产品包括可读性程序代码，该可读性程序代码由终端的处理器执行时，使得终端能够执行如第一方面的通信处理方法，或者，该可读性程序代码由服务器的 处理器执行时，使得服务器能够执行如第二方面的通信处理方法。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本申请。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本申请的实施例，并与说明书一起用于解释本申请的原理，并不构成对本申请的不当限定。
图1是根据一示例性实施例示出的一种通信处理方法的流程图。
图2是根据一示例性实施例示出的一种通信处理方法的流程图；
图3是根据一示例性实施例示出的一种通信处理方法的交互流程图；
图4是根据一示例性实施例示出的一种通信处理装置的框图；
图5是根据一示例性实施例示出的一种通信处理装置的框图；
图6是根据一示例性实施例示出的一种终端的框图；
图7是根据一示例性实施例示出的一种服务器的框图。
[根据细则91更正 20.01.2021]　
图8是根据一示例性实施例示出的一种用于终端的框图；
[根据细则91更正 20.01.2021]　
图9是根据一示例性实施例示出的一种用于服务器的框图。
具体实施方式
为了使本领域普通人员更好地理解本申请的技术方案，下面将结合附图，对本申请实施例中的技术方案进行清楚、完整地描述。
需要说明的是，本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。
在用户进入一个聊天室后，申请上麦时，往往因为信令延迟较大，导致用户上麦较慢，而且信令可能因为网络抖动而丢失，导致上麦失败。本申请为了解决这个问题，提供了如下的技术方案。
图1是根据一示例性实施例示出的一种通信处理方法的流程图，如图1所示，该通信处理方法用于客户端中，包括以下步骤。
在S11中，获取上麦操作请求，上麦操作请求用于请求开启麦克风并采集音频。
在主播用户开启一个基于直播的聊天室后，作为观众的用户可以进入该聊天室，如果观众用户想要发言，可以申请上麦，从而请求开启麦克风并采集音频，客户端可以基于用户的操作获取到上麦操作请求。
在S12中，向服务器发送上麦HTTP请求，上麦HTTP请求用于请求连麦推流所需要的配置文件，配置文件用于提供连麦推流所需要的设置项。
客户端获取到上麦操作请求后，向服务器发送上麦HTTP(Hypertext Transfer Protocol，超文本传输协议)请求，从而通过上麦HTTP请求可以向服务器请求连麦推流所需要的配置文件。
在向服务器发送上麦HTTP请求时，首先需要建立客户端与服务器之间的TCP(Transmission Control Protocol，传输控制协议)连接，使用三次握手协议建立TCP连接。使用三次握手协议建立TCP连接的过程包括：客户端发送SYN(SEQ＝x)报文给服务器，进入SYN_SEND状态；服务器收到SYN报文，回应一个SYN(SEQ＝y)ACK(ACK＝x+1)报文，进入SYN_RECV状态；客户端收到服务器的SYN报文，回应一个ACK(ACK＝y+1)报文，进入建立(Established)状态。TCP连接建立完成后，客户端可以通过TCP连接向服务器发送上麦HTTP请求。
在S13中，接收服务器返回的配置文件。
服务器接收到上麦HTTP请求后，会根据该上麦HTTP请求获取对应的配置文件，并将该配置文件作为对上麦HTTP请求的响应，返回给客户端。客户端接收服务器返回的配置文件，后续可以根据该配置文件进行上麦操作。客户端接收到服务器返回的配置文件后，可以关闭与服务器之间的TCP连接，及时释放资源。
在S14中，解析配置文件，并根据配置文件中的设置项开启麦克风，采集音频并推流。
其中，配置文件中的设置项可选包括：待推流的IP地址、音频采样率、编码格式和码率等。待推流的IP地址可以是聊天室标识，音频采样率是采集 音频时所需要使用的采样率，编码格式是对采集到的音频进行编码所使用的格式，码率是推流时使用的码率。
客户端接收到服务器返回的配置文件后，解析配置文件，得到配置文件中的各个设置项，根据配置文件中的设置项开启麦克风，根据配置文件中的音频采样率采集音频，并根据配置文件中的编码格式对音频进行编码，编码后推流时按照配置文件中的码率进行推流。
本公开的通信处理方法，通过获取上麦操作请求，向服务器发送上麦HTTP请求，接收服务器以HTTP请求的响应形式返回的配置文件，解析配置文件并进行上麦操作。
本公开所提供的通信处理方法解决了长连接信令进行上麦通信时信令延迟及丢失的问题，减少了上麦时长，而且可以提高上麦成功率。
在一些实施例中，所述通信处理方法还包括：
在推流成功后，向服务器发送上麦成功的HTTP请求，上麦成功的HTTP请求用于通知服务器上麦成功。可选地，若服务器在一段时间内接收不到推流数据，说明服务器侧也已经完成推流数据的接收，可以向客户端发送指示信息，客户端在收到该指示信息后可以向服务器发送上麦成功的HTTP请求。可选地，客户端在一段时间内未获取到需要推流的数据，就可以直接向服务器发送上麦成功的HTTP请求。
客户端在确定推流成功后，再次建立与服务器的TCP连接，并通过TCP连接向服务器发送上麦成功的HTTP请求，以通知服务器上麦成功，便于服务器更改客户端的互动状态。
上麦操作可以由客户端中的连麦SDK(Software Development Kit，软件开发工具包)来执行，连麦SDK是客户端的一部分，是用于进行连麦操作的一个软件包，单独封装的用于实现底层的功能，独立于业务层面。客户端在接收到服务器返回的配置文件后，将配置文件透传给连麦SDK。连麦SDK接收到配置文件后，解析配置文件，得到配置文件中的各个设置项，根据配置文件中的各个设置项开启麦克风，并根据配置文件中的音频采样率采集音频，根据配置文件中的编码格式对采集到的音频进行编码，编码后推流时按照配置文件中的码率进行推流，确定推流成功后，将推流成功信息回调给客户端。客户端获取到连麦SDK回调的推流成功信息后，再次建立与服务器的TCP连接，并通 过TCP连接向服务器发送上麦成功的HTTP请求，以通知服务器上麦成功，便于服务器更改客户端的互动状态。
图2是根据一示例性实施例示出的一种通信处理方法的流程图，如图2所示，该通信处理方法用于服务器中。
在S21中，接收客户端发送的上麦HTTP请求，上麦HTTP请求用于请求连麦推流所需要的配置文件。
其中，上麦HTTP请求是一个聊天室内的观众用户发起的请求，即在主播用户创建聊天室后，观众用户可以加入该聊天室，如果观众用户想发言，则可以通过客户端发送上麦HTTP请求。
在接收上麦HTTP请求之前，先通过三次握手协议建立与客户端的TCP连接，TCP连接建立过程同上，这里不再赘述。在建立与客户端的TCP连接后，便可以通过该TCP连接传输数据，即通过该TCP连接接收客户端发送的上麦HTTP请求。
在步骤S22中，根据上麦HTTP请求，获取客户端连麦推流所需要的配置文件，配置文件用于提供客户端连麦推流所需要的设置项。
其中，配置文件可选包括：待推流的IP地址、音频采样率、编码格式和码率。待推流的IP地址可以是聊天室标识，音频采样率是采集音频时所需要使用的采样率，编码格式是对采集到的音频进行编码所使用的格式，码率是推流时使用的码率。
在接收到客户端发送的上麦HTTP请求后，根据上麦HTTP请求中的聊天室标识，获取客户端连麦推流所需要的配置文件。一个聊天室内的所有客户端可以使用相同的配置文件，即可以使用相同的音频采样率、编码格式和码率，而待推流的IP地址均相同，均是该聊天室标识。
在步骤S23中，将配置文件作为上麦HTTP请求的响应发送至客户端。
在获取到客户端连麦推流所需要的配置文件后，将配置文件作为上麦HTTP请求的响应，通过TCP连接发送给客户端，后续客户端可以根据该配置文件执行上麦操作。
本公开的通信处理方法，通过接收客户端发送的上麦HTTP请求，根据上麦HTTP请求，获取客户端连麦推流所需要的配置文件，将配置文件作为上麦HTTP请求的响应发送至客户端，解决了长连接信令进行上麦通信时信令延迟 及丢失的问题，减少了上麦时长，而且可以提高上麦成功率。
在一些实施例中，根据上麦HTTP请求，获取客户端连麦推流所需要的配置文件的步骤，可选包括：
根据上麦HTTP请求，向流媒体数据中心发送配置文件获取请求，配置文件获取请求用于向流媒体数据中心请求客户端连麦推流所需要的配置文件；
接收流媒体数据中心返回的配置文件。
其中，流媒体数据中心用于提供流媒体数据相关的服务。
服务器在接收到客户端发送的上麦HTTP请求后，向流媒体数据中心发送配置文件获取请求，由流媒体数据中心根据配置文件获取请求中的聊天室标识，为客户端分配连麦推流所需要的资源，生成客户端连麦推流所需要的配置文件，并将生成的配置文件返回给服务器，服务器接收流媒体数据中心返回的配置文件。通过服务器与流媒体数据中心的交互，获取到客户端连麦推流所需要的配置文件，服务器与流媒体数据中心提供的服务相对独立，相互不影响，可以保证服务的良好运行。
在一些实施例中流媒体数据中心根据当前系统负载，生成客户端连麦推流所需要的配置文件。流媒体数据中心在接收到服务器发送的配置文件获取请求后，根据当前系统负载，为客户端连麦推流分配资源，生成客户端连麦推流所需要的配置文件。例如，在当前系统负载少的情况下，可以分配较高的码率，保证较高的传输速度；在当前系统负载较多的情况下，可以分配稍低的码率，保证各个客户端的正常运行。
图3是根据一示例性实施例示出的一种通信处理方法的交互流程图，如图3所示，该通信处理方法包括以下步骤。
在S31中，客户端获取上麦操作请求，向服务器发送上麦HTTP请求，上麦HTTP请求用于请求连麦推流所需要的配置文件，配置文件用于提供连麦推流所需要的设置项。
在主播用户开启一个基于直播的聊天室后，作为观众的用户可以进入该聊天室，如果观众用户想要发言，可以申请上麦，客户端基于用户的操作获取到上麦操作请求，并向服务器发送上麦HTTP请求。
在S32中，服务器根据上麦HTTP请求，向流媒体数据中心发送配置文件获取请求。
在S33中，流媒体数据中心根据当前系统负载，生成客户端连麦推流所需要的配置文件。
在S34中，流媒体数据中心将配置文件返回给服务器。
在S35中，服务器将配置文件通过上麦请求HTTP接口返回给客户端。
在S36中，客户端将配置文件透传给连麦SDK。
在S37中，连麦SDK解析配置文件，并根据配置文件中的设置项开启麦克风，采集音频并推流。
连麦SDK采集音频后，推流到流媒体数据中心，从而聊天室内的其他客户端可以从流媒体数据中心进行拉流。
在S38中，连麦SDK推流成功后，将上麦成功信息回调给客户端。
在S39中，客户端向服务器发送上麦成功的HTTP请求。
在上麦成功后，客户端再次发送HTTP请求，以通知服务器上麦成功，基于该HTTP请求，会接收到服务器对该HTTP请求的响应，表明服务器已接收到客户端上麦成功的通知。
本公开提供的通信处理方法，通过在客户端和服务器进行上麦通信时，通过HTTP请求的方式进行通信，摒弃了长连接信令的通信方式，解决了信令延迟、丢失的问题，极大缩短了观众上麦等待时间，并提高了上麦成功率，提升用户体验。
图4是根据一示例性实施例示出的一种通信处理装置的框图。该装置应用于客户端中，参照图4，该装置包括操作请求获取模块41、HTTP请求发送模块42，配置文件接收模块43和上麦操作模块44。
该操作请求获取模块41被配置为获取上麦操作请求，上麦操作请求用于请求开启麦克风并采集音频；
该HTTP请求发送模块42被配置为向服务器发送上麦HTTP请求，上麦HTTP请求用于请求连麦推流所需要的配置文件，配置文件用于提供连麦推流所需要的设置项；
该配置文件接收模块43被配置为接收服务器返回的配置文件；
该上麦操作模块44被配置为解析配置文件，并根据配置文件中的设置项开启麦克风，采集音频并推流。
可选的，所述通信处理装置还包括：
上麦成功通知模块，被配置为基于推流成功，向服务器发送上麦成功的HTTP请求，上麦成功的HTTP请求用于通知服务器上麦成功。
其中的HTTP请求发送模块，进一步被配置为：
建立与服务器之间的传输控制协议TCP连接；
通过TCP连接向服务器发送上麦HTTP请求；
接收配置文件之后，关闭TCP连接。
上麦成功通知模块，被配置为重新建立与服务器之间的TCP连接，通过重新建立的TCP连接向服务器发送上麦成功的HTTP请求。
本公开的通信处理装置，通过操作请求获取模块获取上麦操作请求，HTTP请求发送模块向服务器发送上麦HTTP请求，响应接收模块接收服务器以HTTP请求的响应形式返回的配置文件，上麦操作模块解析配置文件并进行上麦操作，解决了长连接信令进行上麦通信时信令延迟及丢失的问题，减少了上麦时长，而且可以提高上麦成功率。
图5是根据一示例性实施例示出的一种通信处理装置的框图。该装置应用于服务器中，参照图5，该装置包括HTTP请求接收模块51，配置文件获取模块52和响应发送模块53。
该HTTP请求接收模块51被配置为接收客户端发送的上麦HTTP请求，上麦HTTP请求用于请求连麦推流所需要的配置文件；
该配置文件获取模块52被配置为根据上麦HTTP请求，获取客户端连麦推流所需要的配置文件，配置文件用于提供客户端连麦推流所需要的设置项；
该响应发送模块53被配置为将配置文件作为上麦HTTP请求的响应发送至客户端。
可选的，配置文件获取模块包括：
配置文件请求单元，被配置为根据上麦HTTP请求，向流媒体数据中心发送配置文件获取请求，配置文件获取请求用于向流媒体数据中心请求客户端连麦推流所需要的配置文件；
配置文件接收单元，被配置为接收流媒体数据中心返回的配置文件。
可选的，流媒体数据中心根据当前系统负载，生成客户端连麦推流所需要的配置文件。
可选的，配置文件包括：待推流的IP地址、音频采样率、编码格式和码 率。
本公开的通信处理装置，通过HTTP请求接收模块接收客户端发送的上麦HTTP请求，配置文件获取模块根据上麦HTTP请求，获取客户端连麦推流所需要的配置文件，响应发送模块将配置文件作为上麦HTTP请求的响应返回给客户端，解决了长连接信令进行上麦通信时信令延迟及丢失的问题，减少了上麦时长，而且可以提高上麦成功率。
图6是根据一示例性实施例示出的一种通信处理装置的框图。该装置应用于客户端中，参照图6，该装置包括处理器60和存储器61，其中，存储器61用于存储处理器60可执行指令。
其中，处理器60被配置为执行指令，以实现如下步骤：
获取上麦操作请求，上麦操作请求用于请求开启麦克风并采集音频；
向服务器发送上麦HTTP请求，上麦HTTP请求用于请求连麦推流所需要的配置文件，配置文件用于提供连麦推流所需要的设置项；
接收服务器返回的配置文件；
解析配置文件，并根据配置文件中的设置项开启麦克风，采集音频并推流。
可选地，处理器60还被配置为执行：
基于推流成功，向服务器发送上麦成功的HTTP请求，上麦成功的HTTP请求用于通知服务器上麦成功。
可选地，处理器60还被配置为执行：
建立与服务器之间的传输控制协议TCP连接；
通过TCP连接向服务器发送上麦HTTP请求；
接收配置文件之后，关闭TCP连接。
可选地，处理器60还被配置为执行：
重新建立与服务器之间的TCP连接，通过重新建立的TCP连接向服务器发送上麦成功的HTTP请求。
可选地，配置文件包括：待推流的IP地址、音频采样率、编码格式和码率。
本公开的通信处理装置，通过操作请求获取模块获取上麦操作请求，HTTP请求发送模块向服务器发送上麦HTTP请求，响应接收模块接收服务器以HTTP请求的响应形式返回的配置文件，上麦操作模块解析配置文件并进行上 麦操作，解决了长连接信令进行上麦通信时信令延迟及丢失的问题，减少了上麦时长，而且可以提高上麦成功率。
图7是根据一示例性实施例示出的一种通信处理装置的框图。该装置应用于客户端中，参照图7，该装置包括处理器70和存储器71，其中，存储器71用于存储处理器70可执行指令。
其中，处理器70被配置为执行指令，以实现如下步骤：
接收客户端发送的上麦HTTP请求，上麦HTTP请求用于请求连麦推流所需要的配置文件；
根据上麦HTTP请求，获取客户端连麦推流所需要的配置文件，配置文件用于提供客户端连麦推流所需要的设置项；
将配置文件作为上麦HTTP请求的响应发送至客户端。
可选地，处理器70还被配置为执行：
根据上麦HTTP请求，向流媒体数据中心发送配置文件获取请求，配置文件获取请求用于向流媒体数据中心请求客户端连麦推流所需要的配置文件；
接收流媒体数据中心返回的配置文件。
可选地，配置文件是由流媒体数据中心根据当前系统负载生成的。
可选地，配置文件包括：待推流的IP地址、音频采样率、编码格式和码率。
本公开的通信处理装置，通过HTTP请求接收模块接收客户端发送的上麦HTTP请求，配置文件获取模块根据上麦HTTP请求，获取客户端连麦推流所需要的配置文件，响应发送模块将配置文件作为上麦HTTP请求的响应返回给客户端，解决了长连接信令进行上麦通信时信令延迟及丢失的问题，减少了上麦时长，而且可以提高上麦成功率。
关于上述实施例中的装置，其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述，此处将不做详细阐述说明。
图8是根据一示例性实施例示出的一种用于终端的框图。例如，终端800可以是移动电话，计算机，数字广播终端，消息收发设备，游戏控制台，平板设备，医疗设备，健身设备，个人数字助理等。
参照图8，终端800可以包括以下一个或多个组件：处理组件802，存储器804，电力组件806，多媒体组件808，音频组件810，输入/输出(I/O)的 接口812，传感器组件814，以及通信组件816。
处理组件802通常控制终端800的整体操作，诸如与显示，电话呼叫，数据通信，相机操作和记录操作相关联的操作。处理组件802可以包括一个或多个处理器820来执行指令，以完成上述通信处理方法的全部或部分步骤。此外，处理组件802可以包括一个或多个模块，便于处理组件802和其他组件之间的交互。例如，处理组件802可以包括多媒体模块，以方便多媒体组件808和处理组件802之间的交互。
存储器804被配置为存储各种类型的数据以支持在终端800的操作。这些数据的示例包括用于在终端800上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。存储器804可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
电源组件806为终端800的各种组件提供电力。电源组件806可以包括电源管理系统，一个或多个电源，及其他与为终端800生成、管理和分配电力相关联的组件。
多媒体组件808包括在所述终端800和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中，多媒体组件808包括一个前置摄像头和/或后置摄像头。当终端800处于操作模式，如拍摄模式或视频模式时，前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件810被配置为输出和/或输入音频信号。例如，音频组件810包括一个麦克风(MIC)，当终端800处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以 被进一步存储在存储器804或经由通信组件816发送。在一些实施例中，音频组件810还包括一个扬声器，用于输出音频信号。
I/O接口812为处理组件802和外围接口模块之间提供接口，上述外围接口模块可以是键盘，点击轮，按钮等。这些按钮可包括但不限于：主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件814包括一个或多个传感器，用于为终端800提供各个方面的状态评估。例如，传感器组件814可以检测到终端800的打开/关闭状态，组件的相对定位，例如所述组件为终端800的显示器和小键盘，传感器组件814还可以检测终端800或终端800一个组件的位置改变，用户与终端800接触的存在或不存在，终端800方位或加速/减速和终端800的温度变化。传感器组件814可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件814还可以包括光传感器，如CMOS或CCD图像传感器，用于在成像应用中使用。在一些实施例中，该传感器组件814还可以包括加速度传感器，陀螺仪传感器，磁传感器，压力传感器或温度传感器。
通信组件816被配置为便于终端800和其他设备之间有线或无线方式的通信。终端800可以接入基于通信标准的无线网络，如WiFi，运营商网络(如2G、3G、4G或5G)，或它们的组合。在一个示例性实施例中，通信组件816经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，所述通信组件816还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。
在示例性实施例中，终端800可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，用于执行上述通信处理方法。
在示例性实施例中，还提供了一种包括指令的存储介质，例如包括指令的存储器804，上述指令可由终端800的处理器820执行以完成上述通信处理方法。可选地，存储介质可以是非临时性计算机可读存储介质，例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
在示例性实施例中，还提供了一种计算机程序产品，该计算机程序产品包括可读性程序代码，该可读性程序代码可由终端800的处理器820执行以完成上述通信处理方法。可选地，该程序代码可以存储在终端800的存储介质中，该存储介质可以是非临时性计算机可读存储介质，例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
图9是根据一示例性实施例示出的一种服务器的框图。参照图9，服务器900包括处理组件922，其进一步包括一个或多个处理器，以及由存储器932所代表的存储器资源，用于存储可由处理组件922的执行的指令，例如应用程序。存储器932中存储的应用程序可以包括一个或一个以上的每一个对应于一组指令的模块。此外，处理组件922被配置为执行指令，以执行上述通信处理方法。
服务器900还可以包括一个电源组件926被配置为执行服务器900的电源管理，一个有线或无线网络接口950被配置为将服务器900连接到网络，和一个输入输出(I/O)接口958。服务器900可以操作基于存储在存储器932的操作系统，例如Windows ServerTM，Mac OS XTM，UnixTM,LinuxTM，FreeBSDTM或类似。
在示例性实施例中，还提供了一种包括指令的存储介质，例如包括指令的存储器932，上述指令可由服务器900的处理组件922执行以完成上述通信处理方法。可选地，存储介质可以是非临时性计算机可读存储介质，例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
在示例性实施例中，还提供了一种计算机程序产品，该计算机程序产品包括可读性程序代码，该可读性程序代码可由服务器900的处理组件922执行以完成上述通信处理方法。可选地，该程序代码可以存储在服务器900的存储介质中，该存储介质可以是非临时性计算机可读存储介质，例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
本领域技术人员在考虑说明书及实践这里申请的发明后，将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性变化， 这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本申请未申请的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本申请的真正范围和精神由下面的权利要求指出。
以上所揭露的仅为本申请较佳实施例而已，当然不能以此来限定本申请之权利范围，因此依本申请权利要求所作的等同变化，仍属本申请所涵盖的范围。

Claims (22)

  1. 一种通信处理方法，应用于客户端，包括：
    获取上麦操作请求，所述上麦操作请求用于请求开启麦克风并采集音频；
    向服务器发送上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件，所述配置文件用于提供连麦推流所需要的设置项；
    接收所述服务器返回的配置文件；
    解析所述配置文件，并根据所述配置文件中的设置项开启麦克风，采集音频并推流。
  2. 根据权利要求1所述的通信处理方法，还包括：
    基于推流成功，向所述服务器发送上麦成功的HTTP请求，所述上麦成功的HTTP请求用于通知服务器上麦成功。
  3. 根据权利要求1所述的通信处理方法，所述向服务器发送上麦HTTP请求，包括：
    建立与所述服务器之间的传输控制协议TCP连接；
    通过所述TCP连接向所述服务器发送所述上麦HTTP请求；
    接收所述配置文件之后，关闭所述TCP连接。
  4. 根据权利要求3所述的通信处理方法，，还包括：
    重新建立与所述服务器之间的TCP连接，通过重新建立的所述TCP连接向所述服务器发送所述上麦成功的HTTP请求。
  5. 根据权利要求1所述的通信处理方法，所述配置文件包括：待推流的IP地址、音频采样率、编码格式和码率。
  6. 一种通信处理方法，应用于服务器，包括：
    接收客户端发送的上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件；
    根据所述上麦HTTP请求，获取所述客户端连麦推流所需要的配置文件，所述配置文件用于提供所述客户端连麦推流所需要的设置项；
    将所述配置文件作为所述上麦HTTP请求的响应发送至所述客户端。
  7. 根据权利要求6所述的通信处理方法，所述根据所述上麦HTTP请求， 获取所述客户端连麦推流所需要的配置文件包括：
    根据所述上麦HTTP请求，向流媒体数据中心发送配置文件获取请求，所述配置文件获取请求用于向所述流媒体数据中心请求所述客户端连麦推流所需要的配置文件；
    接收所述流媒体数据中心返回的所述配置文件。
  8. 根据权利要求7所述的通信处理方法，所述配置文件是由所述流媒体数据中心根据当前系统负载生成的。
  9. 根据权利要求6所述的通信处理方法，所述配置文件包括：待推流的IP地址、音频采样率、编码格式和码率。
  10. 一种通信处理装置，应用于客户端，包括：处理器；
    用于存储所述处理器可执行指令的存储器；
    其中，所述处理器被配置为执行所述指令，以实现如下步骤：
    获取上麦操作请求，所述上麦操作请求用于请求开启麦克风并采集音频；
    向服务器发送上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件，所述配置文件用于提供连麦推流所需要的设置项；
    接收所述服务器返回的配置文件；
    解析所述配置文件，并根据所述配置文件中的设置项开启麦克风，采集音频并推流。
  11. 根据权利要求10所述的通信处理装置，所述处理器还被配置为执行：
    基于推流成功，向所述服务器发送上麦成功的HTTP请求，所述上麦成功的HTTP请求用于通知服务器上麦成功。
  12. 根据权利要求11所述的通信处理装置，所述处理器还被配置为执行：
    建立与所述服务器之间的传输控制协议TCP连接；
    通过所述TCP连接向所述服务器发送所述上麦HTTP请求；
    接收所述配置文件之后，关闭所述TCP连接。
  13. 根据权利要求12所述的通信处理装置，所述处理器还被配置为执行：
    重新建立与所述服务器之间的TCP连接，通过重新建立的所述TCP连接向所述服务器发送所述上麦成功的HTTP请求。
  14. 根据权利要求10所述的通信处理装置，所述配置文件包括：待推流的IP地址、音频采样率、编码格式和码率。
  15. 一种通信处理装置，应用于服务器，包括：处理器；
    用于存储所述处理器可执行指令的存储器；
    其中，所述处理器被配置为执行所述指令，以实现如下步骤：接收客户端发送的上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件；
    根据所述上麦HTTP请求，获取所述客户端连麦推流所需要的配置文件，所述配置文件用于提供所述客户端连麦推流所需要的设置项；
    将所述配置文件作为所述上麦HTTP请求的响应发送至所述客户端。
  16. 根据权利要求15所述的通信处理装置，所述处理器还被配置为执行：
    根据所述上麦HTTP请求，向流媒体数据中心发送配置文件获取请求，所述配置文件获取请求用于向所述流媒体数据中心请求所述客户端连麦推流所需要的配置文件；
    接收所述流媒体数据中心返回的所述配置文件。
  17. 根据权利要求16所述的通信处理装置，所述配置文件是由所述流媒体数据中心根据当前系统负载生成的。
  18. 根据权利要求15所述的通信处理装置，所述配置文件包括：待推流的IP地址、音频采样率、编码格式和码率。
  19. 一种终端，包括：
    处理器；
    用于存储所述处理器可执行指令的存储器；
    其中，所述处理器被配置为执行所述指令，以实现如下步骤：
    获取上麦操作请求，所述上麦操作请求用于请求开启麦克风并采集音频；
    向服务器发送上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件，所述配置文件用于提供连麦推流所需要的设置项；
    接收所述服务器返回的配置文件；
    解析所述配置文件，并根据所述配置文件中的设置项开启麦克风，采集音频并推流。
  20. 一种服务器，包括：
    处理器；
    用于存储所述处理器可执行指令的存储器；
    其中，所述处理器被配置为执行所述指令，以实现如下步骤：
    接收客户端发送的上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件；
    根据所述上麦HTTP请求，获取所述客户端连麦推流所需要的配置文件，所述配置文件用于提供所述客户端连麦推流所需要的设置项；
    将所述配置文件作为所述上麦HTTP请求的响应发送至所述客户端。
  21. 一种存储介质，当所述存储介质中的指令由终端的处理器执行时，使得终端能够执行如下步骤：
    获取上麦操作请求，所述上麦操作请求用于请求开启麦克风并采集音频；
    向服务器发送上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件，所述配置文件用于提供连麦推流所需要的设置项；
    接收所述服务器返回的配置文件；
    解析所述配置文件，并根据所述配置文件中的设置项开启麦克风，采集音频并推流。
  22. 一种存储介质，当所述存储介质中的指令由终端的处理器执行时，使得终端能够执行如下步骤：
    接收客户端发送的上麦HTTP请求，所述上麦HTTP请求用于请求连麦推流所需要的配置文件；
    根据所述上麦HTTP请求，获取所述客户端连麦推流所需要的配置文件，所述配置文件用于提供所述客户端连麦推流所需要的设置项；
    将所述配置文件作为所述上麦HTTP请求的响应发送至所述客户端。
PCT/CN2020/132443 2020-02-07 2020-11-27 通信处理方法、装置、终端、服务器及存储介质 WO2021155702A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20918029.8A EP4102798A4 (en) 2020-02-07 2020-11-27 COMMUNICATION PROCESSING METHOD AND DEVICE, TERMINAL, SERVER AND STORAGE MEDIA
US17/412,844 US11444992B2 (en) 2020-02-07 2021-08-26 Method and apparatus for communication processing

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010082986.7A CN111385349B (zh) 2020-02-07 2020-02-07 通信处理方法、装置、终端、服务器及存储介质
CN202010082986.7 2020-02-07

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/412,844 Continuation US11444992B2 (en) 2020-02-07 2021-08-26 Method and apparatus for communication processing

Publications (1)

Publication Number Publication Date
WO2021155702A1 true WO2021155702A1 (zh) 2021-08-12

Family

ID=71218570

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/132443 WO2021155702A1 (zh) 2020-02-07 2020-11-27 通信处理方法、装置、终端、服务器及存储介质

Country Status (4)

Country Link
US (1) US11444992B2 (zh)
EP (1) EP4102798A4 (zh)
CN (1) CN111385349B (zh)
WO (1) WO2021155702A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111385349B (zh) 2020-02-07 2021-07-16 北京达佳互联信息技术有限公司 通信处理方法、装置、终端、服务器及存储介质
CN112312226B (zh) 2020-10-28 2023-06-27 北京达佳互联信息技术有限公司 连麦方法、系统、装置、电子设备及存储介质
CN114826803B (zh) * 2022-04-26 2023-10-31 北京字跳网络技术有限公司 会议状态处理方法、装置、电子设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106803969A (zh) * 2017-02-25 2017-06-06 杭州领娱科技有限公司 一种根据订阅的主播推送商品的方法及系统
WO2018121015A1 (zh) * 2016-12-30 2018-07-05 广州华多网络科技有限公司 客户端连麦直播处理方法和装置
CN109995741A (zh) * 2018-01-02 2019-07-09 武汉斗鱼网络科技有限公司 一种网络直播中连麦实现方法及系统
CN110602519A (zh) * 2019-09-20 2019-12-20 网易（杭州）网络有限公司 连麦视频处理方法及装置、存储介质、电子设备
CN111385349A (zh) * 2020-02-07 2020-07-07 北京达佳互联信息技术有限公司 通信处理方法、装置、终端、服务器及存储介质

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9639553B2 (en) * 2000-11-02 2017-05-02 Oracle International Corporation TCP/UDP acceleration
US6567502B2 (en) * 2000-12-19 2003-05-20 Bellsouth Intellectual Property Corporation Multimedia emergency services
WO2002098075A1 (fr) * 2001-05-25 2002-12-05 Mitsubishi Denki Kabushiki Kaisha Systeme de communication par internet, procede de communication par internet, serveur de commande de session, adaptateur de communication, serveur de relais de communication et programme
AU2003210624A1 (en) * 2002-01-18 2003-07-30 Polycom, Inc. Digital linking of multiple microphone systems
JP3698698B2 (ja) * 2002-02-26 2005-09-21 富士通株式会社 Ｄｍｚを介したイントラネットおよび外部ネットワーク上の呼の確立
US7760721B2 (en) * 2004-09-01 2010-07-20 Scott Stogel Method and system for computer based intercom control and management
TWI385932B (zh) * 2008-03-26 2013-02-11 Asustek Comp Inc 遙控器以及其系統
US8411829B2 (en) * 2008-12-16 2013-04-02 James D. Logan System, method and device for managing messages
KR101813889B1 (ko) * 2010-11-11 2018-01-04 삼성전자 주식회사 휴대단말기의 경보 제어 장치 및 방법
US9628542B2 (en) * 2012-08-24 2017-04-18 Akamai Technologies, Inc. Hybrid HTTP and UDP content delivery
US20140163971A1 (en) * 2012-12-11 2014-06-12 Tencent Technology (Shenzhen) Company Limited Method of using a mobile device as a microphone, method of audio playback, and related device and system
US9614918B2 (en) * 2013-03-14 2017-04-04 International Business Machines Corporation Migration of network connection under mobility
US20140321664A1 (en) * 2013-04-25 2014-10-30 Fortemedia, Inc. Methods for dynamically programming a microphone
US20170078452A1 (en) * 2014-05-07 2017-03-16 Optum, Inc. Web native bridge
US9766702B2 (en) * 2014-06-19 2017-09-19 Apple Inc. User detection by a computing device
US10880357B2 (en) * 2014-12-23 2020-12-29 Adobe Inc. Reducing requests for media segments in streaming of multimedia content
CN106598633B (zh) * 2015-10-19 2019-12-31 北京国双科技有限公司 配置文件的更新方法、客户端及服务器
US20170163792A1 (en) * 2015-12-08 2017-06-08 Le Holdings (Beijing) Co., Ltd. METHOD, ELECTRONIC DEVICE and SYSTEM FOR DATA BACK TRANSMISSION AFTER LOSS OF MOBILE TERMINAL
CN107018446B (zh) * 2017-04-07 2019-11-22 无锡职业技术学院 一种网络视频点播以及直播的推流方法
CN107295354A (zh) * 2017-05-15 2017-10-24 武汉斗鱼网络科技有限公司 一种网络直播中连麦直播建立方法及装置
CN110809879B (zh) * 2017-06-28 2021-04-27 株式会社OPTiM 一种Web会议声音辅助系统、方法及程序
CN107707533B (zh) * 2017-09-18 2019-01-29 深圳市迅雷网文化有限公司 基于Web的连麦方法、系统及存储介质
CN108718467B (zh) * 2018-06-06 2020-03-13 歌尔科技有限公司 一种语音数据的传输方法、无线耳机及tws耳机
CN109756504B (zh) * 2019-01-16 2021-11-09 武汉斗鱼鱼乐网络科技有限公司 一种基于直播平台的通信方法及相关装置
CN109756757B (zh) * 2019-03-21 2021-07-13 北京数码视讯软件技术发展有限公司 直播数据处理方法及装置、直播方法及装置和直播服务器
US20200341625A1 (en) * 2019-04-26 2020-10-29 Microsoft Technology Licensing, Llc Automated conference modality setting application
US11132172B1 (en) * 2020-09-30 2021-09-28 Amazon Technologies, Inc. Low latency audio data pipeline

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018121015A1 (zh) * 2016-12-30 2018-07-05 广州华多网络科技有限公司 客户端连麦直播处理方法和装置
CN106803969A (zh) * 2017-02-25 2017-06-06 杭州领娱科技有限公司 一种根据订阅的主播推送商品的方法及系统
CN109995741A (zh) * 2018-01-02 2019-07-09 武汉斗鱼网络科技有限公司 一种网络直播中连麦实现方法及系统
CN110602519A (zh) * 2019-09-20 2019-12-20 网易（杭州）网络有限公司 连麦视频处理方法及装置、存储介质、电子设备
CN111385349A (zh) * 2020-02-07 2020-07-07 北京达佳互联信息技术有限公司 通信处理方法、装置、终端、服务器及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4102798A4 *

Also Published As

Publication number Publication date
US11444992B2 (en) 2022-09-13
EP4102798A1 (en) 2022-12-14
US20220038513A1 (en) 2022-02-03
CN111385349B (zh) 2021-07-16
CN111385349A (zh) 2020-07-07
EP4102798A4 (en) 2023-08-09

Similar Documents

Publication Publication Date Title
US11388453B2 (en) Method for processing live-streaming interaction video and server
US20200333924A1 (en) Reduced latency server-mediated audio-video communication
WO2021155702A1 (zh) 通信处理方法、装置、终端、服务器及存储介质
WO2016192326A1 (zh) 云名片的发送方法和装置
KR101808773B1 (ko) 목표 기능의 시작 방법, 장치, 시스템, 프로그램 및 기록매체
WO2017107470A1 (zh) 建立无线连接的方法及装置
CN111092898B (zh) 报文传输方法及相关设备
WO2015117513A1 (zh) 视频会议控制方法和系统
WO2023019930A1 (zh) 一种信息同步系统、方法、及设备
EP3059945A1 (en) Method and system for video surveillance content adaptation, and central server and device
US8274545B2 (en) Apparatus and method for casting video data and audio data to web during video telephony in mobile communication terminal
CN108667871B (zh) 基于p2p的传输方法和装置
WO2016050020A1 (zh) 消息传输方法及装置、电子设备
WO2018076358A1 (zh) 多媒体信息播放方法及系统、标准化服务器、直播终端
CN105141880B (zh) 呼叫应答方法及装置
US20220286731A1 (en) Multimedia apparatus and cast method
CN109729438B (zh) 一种发送视频包、接收视频包的方法及装置
CN113691790A (zh) 多媒体数据处理方法及装置、电子设备及存储介质
KR102051828B1 (ko) 영상 통화 방법 및 영상 통화 중개 장치
CN110213531B (zh) 监控录像处理方法及装置
CN110290224B (zh) 资源上传、转发方法及装置、移动终端、网关和存储介质
WO2024017296A1 (zh) 共享方法、电子设备及系统
CN116761212B (zh) 图像传输控制方法、装置、终端设备及存储介质
EP4287586A1 (en) Media playback method and apparatus and electronic device
WO2020063462A1 (zh) 一种媒体展示的控制方法及相关产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20918029

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020918029

Country of ref document: EP

Effective date: 20220907