WO2024109249A1 - 远程在线会议切换方法、装置、设备及存储介质 - Google Patents

远程在线会议切换方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2024109249A1
WO2024109249A1 PCT/CN2023/116852 CN2023116852W WO2024109249A1 WO 2024109249 A1 WO2024109249 A1 WO 2024109249A1 CN 2023116852 W CN2023116852 W CN 2023116852W WO 2024109249 A1 WO2024109249 A1 WO 2024109249A1
Authority
WO
WIPO (PCT)
Prior art keywords
conference
participating terminal
bandwidth
online
terminal
Prior art date
Application number
PCT/CN2023/116852
Other languages
English (en)
French (fr)
Inventor
刘柳
Original Assignee
中移(成都)信息通信科技有限公司
中国移动通信集团有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中移(成都)信息通信科技有限公司, 中国移动通信集团有限公司 filed Critical 中移(成都)信息通信科技有限公司
Publication of WO2024109249A1 publication Critical patent/WO2024109249A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827—Network arrangements for conference optimisation or adaptation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876—Network utilisation, e.g. volume of load or congestion level
    • H04L43/0894—Packet rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Definitions

  • the present application relates to the field of communication technology, and in particular to a remote online conference switching method, device, equipment and storage medium.
  • the embodiment of the present application provides a remote online conference switching method, which aims to enable a client in a low-bandwidth environment to participate in an online conference, and automatically Keep records of the meeting.
  • the present application embodiment provides a remote online conference switching method, including:
  • connection state includes: online state and offline state
  • the conference participant terminal is in an offline state, after the conference participant terminal resumes an online state, the conference content during the period when the conference participant terminal is in the offline state is sent to the conference participant terminal.
  • the method further comprises:
  • the second set threshold is greater than the first set threshold.
  • the method further comprises:
  • the bandwidth of the delay estimation is a bandwidth obtained by evaluation based on a congestion control algorithm
  • the bandwidth of the feedback calculation is a bandwidth obtained by calculation based on information in a feedback packet from the participating terminal.
  • the method further comprises:
  • a trend value is obtained; wherein the trend value represents the network delay state of the participating terminal;
  • a network status identification value is obtained; wherein, The network status identification value indicates the network status of the participating terminal;
  • the network bandwidth of the participating terminal is adjusted to obtain the bandwidth of the delay estimation.
  • the method further comprises:
  • the sending rate of the media stream is adjusted based on the change direction of the estimated bandwidth.
  • the method further comprises:
  • the media stream state of the participating terminal is switched.
  • the method further comprises:
  • semantic recognition is performed, and the recognized voice content is stored based on keywords.
  • the embodiment of the present application provides a remote online conference switching method, which is applied to a participating terminal, including:
  • the access to the remote online conference is restored, and the conference content corresponding to the remote online conference during the offline state is received.
  • the method further comprises:
  • the meeting content is a text stream
  • the meeting content is displayed in text form
  • the meeting content is an audio stream
  • the meeting content is displayed in audio form
  • the meeting content is a video stream
  • the meeting content is displayed in video form.
  • the embodiment of the present application also provides a remote online conference switching device, including:
  • the detection module is configured to determine that the estimated bandwidth of the participating terminal is less than a set threshold, and detect the connection status of the participating terminal; wherein the connection status includes: online status and offline status;
  • the sending module is configured to send the conference content during the period when the participating terminal is in the offline state to the corresponding participating terminal after the corresponding participating terminal resumes the online state if the participating terminal is in the offline state.
  • An embodiment of the present application further provides a remote conference device, comprising: a processor and a memory for storing a computer program that can be run on the processor, wherein the processor is configured to execute the steps of the method described in the embodiment of the present application when running the computer program.
  • the embodiment of the present application further provides a computer storage medium, on which a computer program is stored.
  • a computer program is stored on which a computer program is stored.
  • the technical solution provided by the embodiment of the present application is as follows: if it is determined that the estimated bandwidth of the participating terminal is less than a first set threshold, the connection status of the participating terminal is detected; wherein the connection status includes: an online status and an offline status; if the participating terminal is in an offline status, then after the participating terminal resumes the online status, the conference content during the period when the participating terminal is in the offline state is sent to the participating terminal, so as to achieve real-time participation in online conferences even in a weak network environment. Even if the receiving end is offline, after the receiving end resumes the online status, it can also assist the user of the receiving end to obtain important information of the online conference during the offline period, thereby avoiding omissions and improving the user experience.
  • FIG1 is a flow chart of a remote online conference switching method according to an embodiment of the present application.
  • FIG2 is a flow chart of a remote online conference switching method according to an example of an embodiment of the present application.
  • FIG. 3 is a schematic diagram of the principle of evaluating the estimated bandwidth of a participating terminal in a remote online conference switching method in an application example of an embodiment of the present application;
  • FIG4 is a schematic diagram showing the principle of sending a media stream to a participating terminal in a remote online conference switching method in an application example of an embodiment of the present application;
  • FIG5 is a schematic diagram of the structure of a remote online conference switching device according to an embodiment of the present application.
  • FIG6 is a schematic diagram of the structure of a remote conference device according to an embodiment of the present application.
  • the real-time network transmission rate of the receiving end is monitored by the server, and the traffic information collection technology based on SNMP (Simple Network Management Protocol) is adopted.
  • SNMP Simple Network Management Protocol
  • the server initiates a soft phone request to the receiving end, so as to achieve reconnection and enter the meeting, reducing the impact of meeting interruptions.
  • the related technology does not have a mechanism based on switching of multiple media streams such as video, audio and text to solve the problem of low quality of online meetings in low bandwidth and weak network environments.
  • a terminal in a weak network environment participates in an online meeting, it cannot receive continuous media packets, resulting in abnormal sound, video mosaics, screen distortion, black screens, or even disconnection, which directly leads to missing important content of the meeting and a very poor user experience.
  • the server initiates a softphone request for the receiving end, which can achieve reconnection and entry into the meeting, reducing the impact of meeting interruptions.
  • a strategy of supplementing the transmission of conference content is adopted for the conference terminal in a weak network environment, the conference content during the period when the conference terminal is offline is saved, and the conference content is sent to the conference terminal after the offline conference terminal is back online, so as to help the conference user find the lost information in time, so as to achieve real-time participation in online conferences even in a weak network environment.
  • the embodiment of the present application provides a remote online conference switching method, which can be applied to a server providing online conference services.
  • the remote online conference switching method includes:
  • Step 101 If it is determined that the estimated bandwidth of the participating terminal is less than a first set threshold, the connection status of the participating terminal is detected; wherein the connection status includes: an online status and an offline status.
  • the estimated bandwidth of the participating terminal may be that the server evaluates the network status of each participating terminal and estimates the actual network downlink bandwidth of each participating terminal at the current moment.
  • the connection status of the participating terminal can be determined by the heartbeat packet.
  • the heartbeat packet is a self-defined command word between the client and the server to periodically notify each other of their own status. It is sent at a certain time interval, similar to the heartbeat, so it is called a heartbeat packet. If no response is received from the participating terminal within the specified time period, it is determined that the participating terminal has been disconnected.
  • Step 102 If the conference participant terminal is in an offline state, after the conference participant terminal is restored to an online state, the conference content during the period when the conference participant terminal is in the offline state is sent to the conference participant terminal.
  • the server runs an audio and video acquisition program in the background, including but not limited to recording and recording each participating terminal, semantically recognizing and saving the voice content of each participating terminal, and sending the conference content during the offline state of this participating terminal to this participating terminal after the participating terminal resumes online status.
  • the carrying form of the conference content includes text stream, audio, video, etc.
  • the server records the offline time t1 and the online recovery time t2 of the participating terminal, extracts the text record from t1 to t2 and sends it to this participating terminal, and the participating terminal can receive the conference content during the offline period after resuming the line.
  • the participating terminal after receiving the conference content in the form of text stream, the participating terminal summarizes it into the local text record, and highlights the conference content to the user.
  • the remote online conference switching method detects the connection status of the participating terminal if it is determined that the estimated bandwidth of the participating terminal is less than a first set threshold; wherein the connection The connection status includes: online status and offline status; if the participating terminal is in the offline state, then after the participating terminal resumes the online state, the meeting content during the period when the participating terminal is in the offline state is sent to the participating terminal, so that real-time participation in online meetings can be achieved even in a weak network environment. Even if the receiving end is offline, after it resumes online, it can also assist the user of the receiving end to obtain important information of the online meeting during the offline period, avoid omissions, and improve the user experience.
  • the method also includes: if it is determined that the estimated bandwidth of the participating terminal is less than a first set threshold and the participating terminal is online, sending the conference text stream to the participating terminal; if it is determined that the estimated bandwidth of the participating terminal is greater than or equal to the first set threshold and less than a second set threshold, sending the conference audio stream to the participating terminal; if it is determined that the estimated bandwidth of the participating terminal is greater than or equal to the second set threshold, sending the conference video stream to the participating terminal; wherein the second set threshold is greater than the first set threshold.
  • the first set threshold and the second set threshold of the estimated bandwidth of the participating terminal are first compared, and the corresponding media stream execution plan is issued according to the estimated bandwidth of the participating terminal. If the estimated bandwidth of the participating terminal is less than the first set threshold and the participating terminal is online, the conference text stream is sent to the participating terminal; if the estimated bandwidth of the participating terminal is greater than or equal to the first set threshold and less than the second set threshold, the conference audio stream is sent to the participating terminal; if the estimated bandwidth of the participating terminal is greater than or equal to the second set threshold, the conference video stream is sent to the participating terminal, realizing a media stream transmission plan that supports automatic switching of multiple channels such as video, audio and text, greatly improving the quality of online meetings.
  • the method further includes: obtaining an estimated bandwidth based on the bandwidth estimated by delay, the bandwidth calculated by feedback and the packet loss rate; wherein the bandwidth estimated by delay is the bandwidth obtained by evaluation based on a congestion control algorithm, and the bandwidth calculated by feedback is the bandwidth calculated based on information in a feedback packet from a participating terminal.
  • the bandwidth calculated based on the information in the feedback packet from the participating terminal can be the bandwidth calculated based on the information in the feedback packet from the participating terminal in the bit rate estimator (Acknowledged Bitrate Estimator).
  • the current throughput is calculated based on the number of ack (Acknowledge character) packets.
  • the estimated bandwidth can be the bandwidth estimator deployed on the server side to evaluate the downlink bandwidth of the participating terminal at the current moment.
  • the bandwidth estimator contains 5 main modules: adaptive packet group delay evaluation module, custom filter, packet loss type judge, overload detector and rate regulator.
  • adaptive packet group delay module based on the received feedback packet, the packet sending time, arrival time and packet loss rate are collected, and the feedback packets are grouped; in the custom filter, the delay growth trend is evaluated based on the received packet group information; in the packet loss type judge, it is determined whether an overload has occurred based on the received packet group information; in the overload detector, the network status is determined based on the results output by the custom filter and the packet loss type judge; in the rate regulator, based on the network status determined in the overload detector, the congestion control algorithm is used to adjust the bandwidth to obtain an estimated bandwidth based on the delay.
  • the method further includes: obtaining a trend value based on the sending time and arrival time of the feedback packet; wherein the trend value represents the network delay status of the participating terminal; determining whether the network of the participating terminal is overloaded based on the queuing delay and the packet loss rate; if so, obtaining a network status identification value based on the trend value and a mathematical model; wherein the network status identification value represents the network status of the participating terminal; adjusting the network bandwidth of the participating terminal based on the network status identification value and a congestion control algorithm to obtain a bandwidth for delay estimation.
  • the receiving module receives the feedback packet sent by the participating terminal, collects the sending time and arrival time of the packet, and groups the packet according to a certain period, and uses the corresponding filtering rules to calculate the link arrangement trend to obtain the trend value, where the larger the trend value, the more serious the network delay is.
  • whether the network of the participating terminal is overloaded can be determined by judging whether the queuing delay of the network queue increases with the increase of the packet loss rate. If so, it is determined that the network is overloaded.
  • the mathematical model may include a finite-state machine (FSM), which is a mathematical model that represents a finite number of states and the transitions and actions between these states. Based on the obtained trend value and the finite state machine, the network status is judged to obtain the network status identification value, wherein the network status identification value includes: unsatisfactory, qualified and good, which represents the network status of the participating terminal.
  • FSM finite-state machine
  • the congestion control algorithm may include an Additive Increase Multiplicative Decrease (AIMD) algorithm, which linearly increases the sending speed when the Transmission Control Protocol (TCP) sender feels that the end-to-end path is not congested, and multiplicatively reduces its sending speed when the path is congested, wherein the received network status identification value serves as a trigger event for AIMD bandwidth adjustment.
  • AIMD Additive Increase Multiplicative Decrease
  • the method further includes: if it is determined that the estimated bandwidth changes within the current interval, adjusting the sending rate of the media stream based on the change direction of the estimated bandwidth.
  • the sending rate of the media stream will be adjusted upward, and the audio and video encoder will increase the weights of resolution, frame rate, and encoding quality to improve the quality of audio and video transmission; when the estimated bandwidth becomes smaller and the interval does not change, the sending rate of the media stream will be adjusted downward, and the audio and video encoder will reduce the weights of resolution, frame rate, and encoding quality to reduce the quality of audio and video transmission.
  • the method further includes: determining the target time for the participating terminal to arrive at the designated area based on the movement speed, historical movement trajectory and coordinates of the designated area of the participating terminal; switching the media stream state of the participating terminal based on the mapping relationship between the target time and the designated area and the corresponding network bandwidth.
  • the server can locate the position of the participating terminal, and determine the target time for the participating terminal to arrive at the designated area based on the movement speed, historical movement trajectory and coordinates of the designated area of the participating terminal; based on the mapping relationship between the target time and the designated area and the corresponding network bandwidth, switch the media stream state of the participating terminal. For example, when the user of the participating terminal is taking a train or other means of transportation, the server can predict the movement trajectory of the participating terminal based on the historical movement trajectory of the participating terminal, and calculate the time it takes for the user to arrive at the designated area (such as a cave or other area where the network environment will change significantly) based on the movement speed of the participating terminal. When the target time is reached, the server will switch the media stream state of the participating terminal based on the mapping relationship between the target time and the designated area and the corresponding network bandwidth, so that the participating terminal can adapt to the changes in the network status in advance.
  • the server can predict the movement trajectory of the participating terminal based on the historical movement trajectory of the participating terminal, and calculate the time it takes
  • the method further includes: collecting audio information of target participating terminals participating in the meeting; performing semantic recognition based on the collected audio information, and storing the recognized voice content based on keywords.
  • collecting audio information of target participating terminals participating in the meeting can be collecting audio information of all participating terminals, or can be collecting audio information of specified participating terminals, such as the speaker of the meeting, that is, the target participating terminals can be all participating terminals participating in the meeting, or can be some participating terminals participating in the meeting, and the embodiment of the present application does not limit this.
  • the server background runs an audio and video acquisition program, including but not limited to recording all participating terminals, collecting audio information of all participating terminals, performing semantic recognition based on the collected audio information, and storing the recognized voice content based on keywords.
  • the recognized voice content can be extracted based on keywords and sent to this participating terminal, so as to assist participants in timely understanding of meeting information and avoid omissions.
  • the embodiment of the present application also provides a remote online conference switching method, which can be applied to a participating terminal.
  • the remote online conference switching method includes:
  • the access to the remote online conference is restored, and the conference content corresponding to the remote online conference during the offline state is received.
  • the method further comprises:
  • the meeting content is a text stream
  • the meeting content is displayed in text form
  • the meeting content is an audio stream
  • the meeting content is output in audio form
  • the meeting content is a video stream
  • the meeting content is output in video form.
  • the participating terminal displays the conference content based on the media stream form of the received conference content, which can adapt to both the situation where the network status improves and the situation where the network status deteriorates, ensures that communication information is conveyed in a timely manner, and enables real-time participation in online conferences even in a weak network environment.
  • the participating terminal when the participating terminal is conducting a conference in the form of video, it is found that the video bit rate is reduced and the image quality is deteriorated.
  • the participating terminal After participating in the conference in the form of low-bitrate video for a period of time, such as participating in the conference in the form of low-bitrate video for 15 seconds, the participating terminal automatically switches to audio mode for the conference.
  • the user can see a prompt message on the user interface, prompting the user that the conference mode has been automatically switched due to changes in the network status.
  • a remote online conference switching method includes:
  • Step 201 Obtain the estimated bandwidth based on the bandwidth estimated by the delay, the bandwidth calculated by the feedback, and the packet loss rate.
  • the bandwidth of delay estimation is the bandwidth evaluated based on the congestion control algorithm
  • the bandwidth of feedback calculation is the current throughput calculated in the Acknowledged Bitrate Estimator based on the number of ack packets in the feedback packet of the participating terminal.
  • the estimated bandwidth is evaluated by the bandwidth estimator deployed on the server side. It can be understood that this is a dynamic detection process.
  • the network status of the participating terminal may be in a changing process. The network status may get better or worse. Therefore, the server evaluates the actual downlink bandwidth network environment of the participating terminal in real time.
  • FIG3 is a schematic diagram of the principle of evaluating the estimated bandwidth of the participating terminals.
  • the adaptive packet group delay evaluation module 31 collects the sending time, arrival time and packet loss rate of the packet, and groups the packets according to a certain period, and sends them to the custom filter 33 (the trend filter trendpredictor is one of the implementation forms), and also sends the obtained packets
  • the group information is sent to the receiving bandwidth estimator 32.
  • the custom filter 33 receives the arrival time and feedback time of the packet, calculates the link arrangement trend using the corresponding filtering rules, and obtains the final trend value, and sends the trend value to the packet loss type detector 34. In the packet loss type detector 34, it is determined whether the network state is overloaded.
  • the overload detector 35 If overloaded, it enters the overload detector module 35, otherwise it enters the random packet loss bandwidth processor module 36.
  • the overload detector 35 the state of the network is determined according to the obtained trend value and the internal finite state machine, and the network state identification value is obtained, and it enters the code rate regulator 37. After receiving the network identification value, the code rate regulator 37 performs additive increase and multiplicative decrease to obtain the bandwidth based on the delay estimation.
  • the random packet loss bandwidth processor 36 bandwidth preemption is performed to increase the bandwidth, and the degree of increase is proportional to the obtained trend value, and the bandwidth based on the delay estimation is obtained.
  • the receiving bandwidth estimator 32 the current throughput is calculated based on the number of ack packets in the feedback packet, that is, the bandwidth of the feedback calculation is obtained.
  • the packet loss rate adapter 38 receives the bandwidth estimated based on the delay, the bandwidth calculated by feedback, and the packet loss rate, and obtains an estimated bandwidth by integrating them.
  • Step 202 determine whether the estimated bandwidth is greater than or equal to a second set threshold, if so, execute step 203, if not, execute step 204.
  • the first set threshold and the second set threshold are referenced to divide the interval in which the estimated bandwidth is located.
  • Step 203 Determine that the sent media stream is a video stream, and switch the audio and video acquisition program to the foreground.
  • the sent media stream is a video stream
  • the conference content received by the participating terminal is a video stream
  • the conference content is output in the form of video.
  • the server runs an audio and video acquisition program in the background, including but not limited to recording and recording each participating terminal, and semantically identifying the voice content of each participating terminal, and saving the semantically recognized conference content based on keywords. Therefore, when it is determined that the sent media stream is a video stream, both the audio and video acquisition programs are switched to the foreground.
  • Step 204 determining whether the estimated bandwidth is greater than or equal to a first set threshold, if so, executing step 205 , if not, executing step 206 .
  • Step 205 determine that the sent media stream is an audio stream, and switch the audio acquisition program to the foreground.
  • the sent media stream is determined to be an audio stream
  • the conference content received by the participating terminal is an audio stream
  • the conference content is output in the form of audio.
  • the audio acquisition program switches to the foreground
  • the video acquisition program switches to the background
  • the sending is suspended, but the recording is kept.
  • Step 206 detect whether the participating terminal is online, if so, execute step 207, if not, execute step 208.
  • the heartbeat packet can be used to detect whether the participating terminal is online. If no response is received from the participating terminal within the specified time period, it is determined that the participating terminal has been offline. In addition, before the online meeting starts, the device clocks of all participating terminals need to be aligned to ensure that the offline meeting completion mechanism is enabled (the server and at least one participating terminal need to be enabled), and the offline time of the participating terminal is recorded at this time.
  • Step 207 determine that the sent media stream is a text stream, and switch the text translation module to the foreground.
  • the text transfer module is switched to the foreground, the participating terminal receives the meeting content as a text stream, and displays the meeting content in text form, while the audio and video acquisition programs are switched to the background and sending is suspended, but recording and video recording are maintained, and the server records and saves the meeting content according to the timeline.
  • the text stream is generated by synchronously generating a text translation stream at the collection end, and forwarding it through the intermediate router in the mesh architecture without a central translation server.
  • Step 208 waiting for the network status of the participating terminal to recover and go online again.
  • Step 209 determine whether the estimated bandwidth of the participating terminal changes.
  • Step 210 Evaluate the bandwidth interval where the new estimated bandwidth is located, and determine the media stream format that should be sent at this time.
  • the changed estimated bandwidth is compared with the first set threshold and the second set threshold again to determine the interval in which the changed estimated bandwidth is located, thereby determining the form of the media stream that should be sent at this time.
  • the form of the media stream that should be sent at this time is determined based on the interval in which the changed estimated bandwidth is located; if the estimated bandwidth of the participating terminal after the change is greater than or equal to the second set threshold, the media stream form is maintained as a video stream; if the estimated bandwidth of the participating terminal after the change is greater than or equal to the first set threshold and less than the second set threshold, the media stream form that should be sent at this time is determined to be an audio stream; if the estimated bandwidth of the participating terminal after the change is less than the first set threshold and the participating terminal is online, the media stream form that should be sent at this time is determined to be a text stream.
  • the first set threshold and the second set threshold are not necessarily absolute conditions for switching the media stream.
  • network fluctuation is a dynamically changing process
  • the media stream format can be switched from text stream to audio stream.
  • the estimated bandwidth fluctuates between the set threshold and the floating factor, the corresponding media stream is sent according to the current media stream format, and the media stream format is not switched.
  • Step 211 Switch the media stream to the media stream format that should be sent at this time.
  • the sending rate of the media stream is adjusted based on the direction of the bandwidth change.
  • Figure 4 is a schematic diagram of the structure of sending the media stream to the participating terminal.
  • the bandwidth adjustment controller 42 adjusts the network sending rate in the operating system network speed adjustment module based on the estimated bandwidth obtained in the packet loss rate adapter 41, and adjusts the sending rate of the network in the audio and video encoder 43 based on the sending rate
  • the weights of resolution, frame rate, and encoding quality are adjusted to change the quality of audio and video transmission.
  • the media stream adjusted in the audio and video encoder 43 is sent to the conference participant terminal 44.
  • Step 212 determining whether the network transmission of the participating terminal is restored.
  • the time of restoration is recorded to facilitate the server to extract relevant text records.
  • Step 213 Send the conference content during the offline period to the reconnected participant.
  • the server extracts the text conference content from the offline time to the online time, and finally highlights it to the user, which can assist the user at the receiving end to obtain important information of the online conference during the offline period, avoid omissions, and improve the user experience.
  • the embodiment of the present application also provides a remote online conference switching device, which corresponds to the above-mentioned remote online conference switching method, and each step in the above-mentioned remote online conference switching method embodiment is also fully applicable to the embodiment of the remote online conference switching device.
  • the remote online conference switching device includes: a detection module 501 and a sending module 502.
  • the detection module 501 is configured to determine that the estimated bandwidth of the participating terminal is less than a set threshold, and detect the connection state of the participating terminal; wherein the connection state includes: online state and offline state; the sending module 502 is configured to send the conference content during the period when the participating terminal is in the offline state to the corresponding participating terminal after the corresponding participating terminal resumes the online state if the participating terminal is in the offline state.
  • the sending module 502 is configured as follows: if it is determined that the estimated bandwidth of the participating terminal is less than a first set threshold and the participating terminal is online, a text stream is sent to the participating terminal; if it is determined that the estimated bandwidth of the participating terminal is greater than or equal to the first set threshold and less than a second set threshold, an audio stream is sent to the participating terminal; if it is determined that the estimated bandwidth of the participating terminal is greater than or equal to the second set threshold, a video stream is sent to the participating terminal; wherein the second set threshold is greater than the first set threshold.
  • the remote online conference switching device further includes: a bandwidth evaluation module 503, the bandwidth evaluation module 503 is configured to: based on the bandwidth estimated by the delay, the bandwidth calculated by the feedback, and the packet loss rate, and obtain the estimated bandwidth; wherein, the bandwidth of delay estimation is the bandwidth obtained by evaluating based on the congestion control algorithm, and the bandwidth calculated by feedback is the bandwidth calculated based on the information in the feedback packet from the participating terminals.
  • the bandwidth assessment module 503 is specifically configured as follows: based on the sending time and arrival time of the feedback packet, a trend value is obtained; wherein the trend value represents the network delay status of the participating terminal; based on the queuing delay and the packet loss rate, whether the network of the participating terminal is overloaded is determined; if so, based on the trend value and the mathematical model, a network status identification value is obtained; wherein the network status identification value represents the network status of the participating terminal; based on the network status identification value and the congestion control algorithm, the network bandwidth of the participating terminal is adjusted to obtain the bandwidth of the delay estimation.
  • the remote online conference switching device further includes: an adjustment module 504, and the adjustment module 504 is configured to: if it is determined that the estimated bandwidth changes within the current interval, adjust the sending rate of the media stream based on the change direction of the estimated bandwidth.
  • the remote online conference switching device also includes: a switching module 505, and the switching module 505 is configured to: determine the target time for the participating terminal to arrive at the designated area based on the movement speed, historical movement trajectory and coordinates of the designated area of the participating terminal; based on the mapping relationship between the target time and the designated area and the corresponding network bandwidth, switch the media stream state of the participating terminal.
  • the remote online conference switching device also includes: a semantic recognition module 506, and the semantic recognition module 506 is configured to: collect audio information from all participating terminals; perform semantic recognition based on the collected audio information, and store the recognized voice content based on keywords.
  • the detection module 501, the sending module 502, the bandwidth evaluation module 503, the adjustment module 504, the switching module 505 and the semantic recognition module 506 can be implemented by a processor in the remote online conference switching device.
  • the processor needs to run the computer program in the memory to realize its function.
  • the remote online conference switching device provided in the above embodiment only uses the division of the above program modules as an example when performing remote online conference switching.
  • the above-mentioned processing can be distributed to different program modules as needed, that is, the internal structure of the device is divided into different program modules to complete all or part of the above-mentioned processing.
  • the remote online conference switching device and the remote online conference switching method embodiment provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.
  • the embodiment of the present application also provides a remote conference device.
  • Figure 6 only shows an exemplary structure of the remote conference device rather than the entire structure. Part or all of the structure shown in Figure 6 can be implemented as needed.
  • the teleconference device 600 provided in the embodiment of the present application includes: at least one processor 601, a memory 602, a user interface 603, and at least one network interface 604.
  • the various components in the teleconference device 600 are coupled together through a bus system 605.
  • the bus system 605 is used to realize the connection and communication between these components.
  • the bus system 605 also includes a power bus, a control bus, and a status signal bus.
  • various buses are marked as bus systems 605 in FIG6 .
  • the user interface 603 may include a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch pad or a touch screen.
  • the memory 602 in the embodiment of the present application is used to store various types of data to support the operation of the remote conference switching device. Examples of such data include: any computer program used to operate on the remote conference device.
  • the decoding processor In combination with the steps of the method disclosed in the embodiments of the present application, it can be directly embodied as a hardware decoding processor to be executed, or a combination of hardware and software modules in the decoding processor to be executed.
  • the software module can be located in a storage medium, which is located in the memory 602.
  • the processor 601 reads the information in the memory 602 and completes the steps of the remote online conference switching method provided in the embodiments of the present application in combination with its hardware.
  • the remote conferencing device can be implemented by one or more application specific integrated circuits (ASIC), DSP, programmable logic device (PLD), complex programmable logic device (CPLD), field programmable gate array (FPGA), general processor, controller, microcontroller (MCU), microprocessor, or other electronic components to execute the aforementioned method.
  • ASIC application specific integrated circuits
  • DSP digital signal processor
  • PLD programmable logic device
  • CPLD complex programmable logic device
  • FPGA field programmable gate array
  • general processor controller, microcontroller (MCU), microprocessor, or other electronic components to execute the aforementioned method.
  • MCU microcontroller
  • the memory 602 can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories.
  • the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disk, or a compact disc read-only memory (CD-ROM); the magnetic surface memory can be a disk memory or a tape memory.
  • the volatile memory can be a random access memory (RAM), which is used as an external high-speed cache.
  • RAM static random access memory
  • SRAM synchronous static random access memory
  • SRAM synchronous static random access memory
  • the memory described in the embodiments of the present application is intended to include, but is not limited to, these and any other suitable types of memory.
  • the present application also provides a storage medium, namely a computer storage medium, which may be a computer-readable storage medium, for example, a memory 602 storing a computer program, and the computer program may be executed by a processor 601 of a teleconferencing device to complete the steps of the method of the present application.
  • the computer-readable storage medium may be a memory such as a ROM, a PROM, an EPROM, an EEPROM, a Flash Memory, a magnetic surface memory, an optical disk, or a CD-ROM.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Environmental & Geological Engineering (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

本申请公开了一种远程在线会议切换方法、装置、设备及存储介质，该方法包括：若确定参会终端的估计带宽小于第一设定阈值，则检测参会终端的连接状态；其中，连接状态包括：在线状态和掉线状态；若参会终端为掉线状态，则在参会终端恢复在线状态之后，将参会终端处于掉线状态期间的会议内容发送至参会终端，实现弱网环境下也能够实时参与在线会议，即使出现接收端掉线的情况，当恢复上线后，能够辅助接收端的的用户获取掉线期间的在线会议的重要信息，避免遗漏，提高了用户的使用体验。

Description

远程在线会议切换方法、装置、设备及存储介质
相关申请的交叉引用
本申请基于申请号为202211466375.8、申请日为2022年11月22日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本申请涉及通信技术领域，尤其涉及一种远程在线会议切换方法、装置、设备及存储介质。
背景技术
随着互联网的发展，在线会议频繁地参与到人们工作日常生活中，能够有效地提高全球各地的客户、合作伙伴以及同事在线协同合作的效率，并降低会议成本，实现远程产品演示、共享应用程序以及开展专案协作等。
目前的在线会议，大多只支持单种类型的会议模式，如视频会议模式，而用户场景复杂多变，处于不同的地理环境的用户其网络环境都是不一样的，在弱网环境往往无法提供高质量的网络传输。通过对网络传输内容进行优化，如对视频的质量进行压缩裁剪，降低视频码率，可以提高视频传输的流畅性，然而这种方法会造成会议内容的丢失，且无法适应极端弱网环境下的网络传输，无法解决低带宽、弱网环境下的音视频切换问题。
发明内容
有鉴于此，本申请实施例提供了一种远程在线会议切换方法，旨在实现处于低带宽环境下的客户端能参加在线会议，针对掉线的参会者能自动 保存记录会议内容。
本申请实施例的技术方案是这样实现的：
本申请实施例提供了一种远程在线会议切换方法，包括：
若确定参会终端的估计带宽小于第一设定阈值，则检测所述参会终端的连接状态；其中，所述连接状态包括：在线状态和掉线状态；
若所述参会终端为掉线状态，则在所述参会终端恢复在线状态之后，将所述参会终端处于掉线状态期间的会议内容发送至所述参会终端。
上述方案中，所述方法还包括：
若确定所述参会终端的估计带宽小于所述第一设定阈值且所述参会终端为在线状态，则发送会议文字流至所述参会终端；
若确定所述参会终端的估计带宽大于或等于所述第一设定阈值且小于第二设定阈值，则发送会议音频流至所述参会终端；
若确定所述参会终端的估计带宽大于或等于所述第二设定阈值，则发送会议视频流至所述参会终端；
其中，所述第二设定阈值大于所述第一设定阈值。
上述方案中，所述方法还包括：
基于时延估计的带宽、反馈计算的带宽和丢包率，得到所述估计带宽；
其中，所述时延估计的带宽为基于拥塞控制算法评估得到的带宽，所述反馈计算的带宽为基于来自所述参会终端的反馈包中的信息计算得到的带宽。
上述方案中，所述方法还包括：
基于所述反馈包的发送时间和到达时间，得到趋势值；其中，趋势值表示所述参会终端的网络延迟状态；
基于排队时延和所述丢包率，确定所述参会终端的网络是否发生过载；
若是，则基于所述趋势值和数学模型，得到网络状态标识值；其中， 所述网络状态标识值表示所述参会终端的网络状态；
基于所述网络状态标识值和拥塞控制算法，调节所述参会终端的网络带宽，得到所述时延估计的带宽。
上述方案中，所述方法还包括：
若确定所述估计带宽在当前区间内变化，基于所述估计带宽的变化方向，调整媒体流的发送速率。
上述方案中，所述方法还包括：
基于所述参会终端的运动速度、历史运动轨迹及指定区域的坐标，确定所述参会终端到达指定区域的目标时刻；
基于所述目标时刻及指定区域和对应的网络带宽的映射关系，切换所述参会终端的媒体流状态。
上述方案中，所述方法还包括：
采集所有参会终端的音频信息；
基于所述采集的音频信息，进行语义识别，并将识别的语音内容基于关键词进行存储。
本申请实施例提供了一种远程在线会议切换方法，应用于参会终端，包括：
若确定由掉线状态转为在线状态，则恢复接入远程在线会议，并接收掉线状态期间的所述远程在线会议对应的会议内容。
上述方案中，所述方法还包括：
基于接收的会议内容的媒体流形式，显示所述会议内容；
其中，若所述会议内容为文字流，以文字形式显示所述会议内容；若所述会议内容为音频流，以音频形式显示所述会议内容；若所述会议内容为视频流，以视频形式显示所述会议内容。
本申请实施例还提供了一种远程在线会议切换装置，包括：
检测模块，配置为确定参会终端的估计带宽小于设定阈值，检测所述参会终端的连接状态；其中，所述连接状态包括：在线状态和掉线状态；
发送模块，配置为若所述参会终端为掉线状态，则在相应的所述参会终端恢复在线状态之后，将所述参会终端处于掉线状态期间的会议内容发送给至相应的所述参会终端。
本申请实施例又提供了一种远程会议设备，包括：处理器和用于存储能够在处理器上运行的计算机程序的存储器，其中，所述处理器配置为运行计算机程序时，执行本申请实施例所述方法的步骤。
本申请实施例还提供一种计算机存储介质，所述计算机存储介质上存储有计算机程序，所述计算机程序被处理器执行时，实现本申请实施例所述方法的步骤。
本申请实施例提供的技术方案，若确定参会终端的估计带宽小于第一设定阈值，则检测所述参会终端的连接状态；其中，所述连接状态包括：在线状态和掉线状态；若所述参会终端为掉线状态，则在所述参会终端恢复在线状态之后，将所述参会终端处于掉线状态期间的会议内容发送至所述参会终端，实现弱网环境下也能够实时参与在线会议，即使出现接收端掉线的情况，当恢复上线后，也能够辅助接收端的的用户获取掉线期间的在线会议的重要信息，避免遗漏，提高了用户的使用体验。
附图说明
图1为本申请实施例远程在线会议切换方法的流程示意图；
图2为本申请实施例应用示例远程在线会议切换方法的流程示意图；
图3为本申请实施例应用示例远程在线会议切换方法中的评估参会终端的估计带宽的原理示意图；
图4为本申请实施例应用示例远程在线会议切换方法中发送媒体流至参会终端的原理示意图；
图5为本申请实施例远程在线会议切换装置的结构示意图；
图6为本申请实施例远程会议设备的结构示意图。
具体实施方式
下面结合附图及实施例对本申请再作进一步详细的描述。
除非另有定义，本文所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本文中在本申请的说明书中所使用的术语只是为了描述具体的实施例的目的，不是旨在于限制本申请。
相关技术中，通过服务器监测接收端的网络实时传输速率，采用基于SNMP(Simple Network Management Protocol，简单网络管理协议)的流量信息采集技术，当监测到网络实时传输速率落入预设的传输速率范围时，服务器针对该接收端发起软电话请求，可实现再次连通进入会议，减少会议中断产生的影响，相关技术中并无基于视频、音频及文字等多种媒体流切换的机制，解决低带宽、弱网环境下的在线会议质量低的问题。
举例来说，当处于弱网环境下的终端参与在线会议时，无法接收到连续的媒体包，造成声音异常、视频马赛克、花屏、黑屏甚至掉线的现象，直接导致错过会议重要内容，用户体验极差。当监测到终端的网络实时传输速率落入预设的传输速率范围时，服务器针对该接收端发起软电话请求，可实现再次连通进入会议，减少会议中断产生的影响。
相关技术中，还存在根据预先设定好的程序或方法，针对不同用户单独进行音视频的切换，但并没有解决低带宽，弱网环境下的音视频切换问题，应用效果较差。
基于此，在本申请的各种实施例中，针对处于弱网环境下的参会终端采取了会议内容补传的策略，将参会终端掉线期间的会议内容保存下来，等待掉线的参会终端重新上线后，将会议内容发送至此参会终端，及时帮助参会用户找到丢失的信息，实现处于弱网环境下也能够实时参与在线会 议。
本申请实施例提供一种远程在线会议切换方法，可以应用于提供在线会议服务的服务器，如图1所示，该远程在线会议切换方法包括：
步骤101，若确定参会终端的估计带宽小于第一设定阈值，则检测参会终端的连接状态；其中，连接状态包括：在线状态和掉线状态。
这里，参会终端的估计带宽可以为，服务器评估各个参会终端的网络状态，估算得到各个参会终端当前时刻的实际网络下行带宽。
检测参会终端的连接状态可以通过心跳包来判断，心跳包是客户端和服务器之间定时通知对方自己状态的一个自己定义的命令字，按照一定的时间间隔发送，类似心跳，所以叫心跳包。若在指定时间段内未收到参会终端的响应，则判断参会终端中已经掉线。
步骤102，若参会终端为掉线状态，则在参会终端恢复在线状态之后，将参会终端处于掉线状态期间的会议内容发送至参会终端。
这里，当在线会议开始时，服务器后台运行音视频采集程序，包括但不限于对每个参会终端进行录音和录像，对每个参会终端的语音内容进行语义识别并保存，当参会终端恢复在线状态后，将此参会终端掉线状态期间的会议内容发送至此参会终端。其中，会议内容的承载形式包括文字流、音频、视频等，以发送文字流形式的会议内容至由掉线状态转为在线状态的参会终端为例，服务器记录参会终端的掉线时间t1和恢复在线时间t2，提取t1到t2时间段的文字记录并发送至此参会终端，而参会终端在恢复上线后，能接收到掉线期间的会议内容。在一些实施例中，参会终端接收到文字流形式的会议内容后，汇总到本地的文字记录中，并将此会议内容高亮展现给用户。
本申请实施例提供的远程在线会议切换方法，若确定参会终端的估计带宽小于第一设定阈值，则检测所述参会终端的连接状态；其中，所述连 接状态包括：在线状态和掉线状态；若所述参会终端为掉线状态，则在所述参会终端恢复在线状态之后，将所述参会终端处于掉线状态期间的会议内容发送至所述参会终端，实现弱网环境下也能够实时参与在线会议，即使出现接收端掉线的情况，当恢复上线后，也能够辅助接收端的的用户获取掉线期间的在线会议的重要信息，避免遗漏，提高了用户的使用体验。
在一实施例中，该方法还包括：若确定参会终端的估计带宽小于第一设定阈值且参会终端为在线状态，则发送会议文字流至参会终端；若确定参会终端的估计带宽大于或等于第一设定阈值且小于第二设定阈值，则发送会议音频流至参会终端；若确定参会终端的估计带宽大于或等于第二设定阈值，则发送会议视频流至参会终端；其中，第二设定阈值大于第一设定阈值。
具体地，在本实施例中，首先比较参会终端的估计带宽的第一设定阈值和第二设定阈值的大小，根据参会终端的估计带宽，下发对应的媒体流执行方案。若参会终端的估计带宽小于第一设定阈值且参会终端为在线状态，则发送会议文字流至参会终端；若参会终端的估计带宽大于或等于第一设定阈值且小于第二设定阈值，则发送会议音频流至参会终端；若参会终端的估计带宽大于或等于第二设定阈值，则发送会议视频流至参会终端，实现支持视频、音频和文字等多渠道自动切换的媒体流传输方案，极大地改善在线会议质量。
在一实施例中，该方法还包括：基于时延估计的带宽、反馈计算的带宽和丢包率，得到估计带宽；其中，时延估计的带宽为基于拥塞控制算法评估得到的带宽，反馈计算的带宽为基于来自参会终端的反馈包中的信息计算得到的带宽。
这里，基于来自参会终端的反馈包中的信息计算得到的带宽可以为在码率估计器(Acknowledged Bitrate Estimator)中基于参会终端的反馈包中 的ack(Acknowledge character，确认字符)包数来计算得到的当前吞吐量。
这里，估计带宽可以为由部署在服务器端的带宽估计器来评估参会终端当前时刻的下行带宽，带宽估计器含有5个主要模块：分别为自适应包组延迟评估模块、自定义滤波器、丢包类型判断器、过载检测器和码率调节器。在自适应包组延迟模块中，基于接收到的反馈包，收集包的发送时间、到达时间和丢包率，并对反馈包进行分组；在自定义滤波器中，基于收到的包组信息进行延迟增长趋势的评估；在丢包类型判断器中，基于收到的包组信息判断是否发生了过载；在过载检测器中，基于自定义滤波器和丢包类型判断器输出的结果判断网络的状态；在码率调节器中，基于过载检测器中判断的网络状态，采用拥塞控制算法调节带宽，得到基于时延的估计带宽。
在一实施例中，该方法还包括：基于反馈包的发送时间和到达时间，得到趋势值；其中，趋势值表示参会终端的网络延迟状态；基于排队时延和丢包率，确定参会终端的网络是否发生过载；若是，则基于趋势值和数学模型，得到网络状态标识值；其中，网络状态标识值表示参会终端的网络状态；基于网络状态标识值和拥塞控制算法，调节参会终端的网络带宽，得到时延估计的带宽。
这里，基于反馈包的发送时间和到达时间，得到趋势值可以为，接收模块收到参会终端发出的反馈包，收集包的发送时间和到达时间，并对包按照一定周期进行分组，利用对应的滤波规则计算链路排列趋势，得到趋势值，其中，趋势值越大表示网络延迟越来越严重。
这里，确定参会终端的网络是否发生过载可以通过判断网络队列排队时延是否随着丢包率的升高而增加，若是，则确定网络发生过载。
这里，数学模型可以包括有限状态机(finite-state machine，FSM)，有限状态机是表示有限个状态以及在这些状态之间的转移和动作等行为的数 学计算模型。基于得到的趋势值和有限状态机判断网络的状态，得到网络状态标识值，其中，网络状态标识值包括：不及格、及格和良好，表征参会终端的网络状态。
这里，拥塞控制算法可以包括加性增加乘性减少(Additive Increase Multiplicative Decrease，AIMD)算法，当传输控制协议(Transmission Control Protocol，TCP)发送方感受到端到端路径无拥塞时就线性地增加其发送速度，当察觉到路径拥塞时就乘性减小其发送速度，其中，接收到网络状态标识值作为AIMD带宽调节的触发事件。
在一实施例中，该方法还包括：若确定估计带宽在当前区间内变化，基于估计带宽的变化方向，调整媒体流的发送速率。
这里，当估计带宽变大且并未改变区间时，媒体流的发送速率会向上调节，音视频编码器会提高分辨率、帧率、编码质量的权重，提高音视频传输的质量；当估计带宽变小且并未改变区间时，媒体流的发送速率会向下调节，音视频编码器会降低分辨率、帧率、编码质量的权重，降低音视频传输的质量。
在一实施例中，该方法还包括：基于参会终端的运动速度、历史运动轨迹及指定区域的坐标，确定参会终端到达指定区域的目标时刻；基于目标时刻及指定区域和对应的网络带宽的映射关系，切换参会终端的媒体流状态。
这里，服务器可以定位参会终端的位置，基于参会终端的运动速度、历史运动轨迹及指定区域的坐标，确定参会终端到达指定区域的目标时刻；基于目标时刻及指定区域和对应的网络带宽的映射关系，切换参会终端的媒体流状态。比如，参会终端的用户在乘坐火车等交通工具，服务器根据参会终端的历史运动轨迹，可以预测此参会终端的运动轨迹，根据参会终端的运动速度计算用户到达指定区域(如山洞等网络环境将明显变化的区 域)的目标时刻，服务器将提前发送媒体流状态切换的指示信息给参会终端，以提示用户将在何时切换媒体流状态，当达到目标时刻时，基于目标时刻及指定区域和对应的网络带宽的映射关系切换参会终端的媒体流状态，使参会终端能提前适应网络状态的变化。
在一实施例中，该方法还包括：采集参与会议的目标参会终端的音频信息；基于所述采集的音频信息，进行语义识别，并将识别的语音内容基于关键词进行存储。优选地，采集参与会议的目标参会终端的音频信息可以为采集所有参会终端的音频信息，也可以为采集指定的参会终端，如会议的主讲人，即，目标参会终端可以是参与会议的所有参会终端，也可以是参与会议的部分参会终端，本申请实施例对此不做限定。
这里，当在线会议开始时，服务器后台运行音视频采集程序，包括但不限于对所有参会终端进行录音，采集所有参会终端的音频信息，基于所述采集的音频信息，进行语义识别，并将识别的语音内容基于关键词进行存储，当出现参会终端掉线又重新上线的情况时，基于关键词能够提取识别的语音内容下发给此参会终端，辅助参会人员及时了解会议信息，避免遗漏。
本申请实施例还提供一种远程在线会议切换方法，可以应用于参会终端，该远程在线会议切换方法包括：
若确定由掉线状态转为在线状态，则恢复接入远程在线会议，并接收掉线状态期间的所述远程在线会议对应的会议内容。
这里，若确定参会终端由掉线状态转为在线状态，则恢复接入远程在线会议，并能接收掉线状态期间的会议内容，辅助用户获取掉线期间在线会议的重要信息，避免遗漏，提高了用户的使用体验。
在一实施例中，该方法还包括：
基于接收的会议内容的媒体流形式，显示所述会议内容；
其中，若所述会议内容为文字流，以文字形式显示所述会议内容；若所述会议内容为音频流，以音频形式输出所述会议内容；若所述会议内容为视频流，以视频形式输出所述会议内容。
这里，参会终端基于接收的会议内容的媒体流形式，显示所述会议内容，既能适应网络状态变好的情况也能适应网络状态变差的情况，保证沟通信息及时传达，实现在弱网环境下也能够实时参与在线会议。在一些实施例中，参会终端在以视频形式进行会议时，发现视频码率降低，画质变差，在持续一段时间以低码率的视频形式参与会议，比如持续15s以低码率的视频形式参与会议，参会终端自动切换为音频形式进行会议，优选地，在切换参与在线会议的媒体形式后，用户可在使用界面看到一个提示信息，提示用户由于网络状态的变化已自动切换会议形式。
下面结合应用示例对本申请实施例再作进一步详细的描述。
在本应用示例中，如图2所示，一种远程在线会议切换方法，包括：
步骤201，基于时延估计的带宽、反馈计算的带宽和丢包率，得到所述估计带宽。
这里，时延估计的带宽为基于拥塞控制算法评估得到的带宽，反馈计算的带宽为在码率估计器(Acknowledged Bitrate Estimator)中基于参会终端的反馈包中的ack包数来计算得到的当前吞吐量。而估计带宽是由部署在服务器端的带宽估计器来评估得到。可以理解的是，这是一个动态检测过程，参会终端的网络状态可能处于一个变化的过程，网络状态可能变好，也可能变坏，服务器因此实时评估参会终端的真实下行带宽网络环境。
具体地，请参阅图3，图3为评估参会终端的估计带宽的原理示意图。如图3所示，自适应包组延迟评估模块31收到反馈包后，收集包的发送时间、到达时间和丢包率，并对包按照一定的周期进行分组，送至自定义滤波器33(趋势滤波器trendpredictor是实现形式之一)，同时也将得到的包 组信息发送至收端带宽估计器32。自定义滤波器33收到包的到达时间和反馈时间，利用对应的滤波规则计算链路排列趋势，并得到最终的趋势值，将趋势值送至丢包类型检测器34。在丢包类型检测器34中，判断网络状态是否发生过载，若过载，则进入过载检测器模块35，否则进入随机丢包带宽处理器模块36。在过载检测器35中根据得到的趋势值和内部的有限状态机判断网络的状态，得到网络状态标识值，进入到码率调节器37中。码率调节器37收到网络标识值后，进行加性增加乘性减少，得到基于时延估计的带宽。在随机丢包带宽处理器36中，进行带宽抢占，增加带宽，而增加的程度正比于得到的趋势值，得到基于时延估计的带宽。在收端带宽估计器32中，基于反馈包中的ack包数来计算得到的当前吞吐量，即得到反馈计算的带宽。丢包率适配器38收到基于时延估计的带宽和反馈计算的带宽以及丢包率，综合得到一个估计带宽。
步骤202，判断估计带宽大于或等于第二设定阈值，若是，则执行步骤203，若否，则执行步骤204。
这里，得到参会终端的估计带宽后，需要确定此估计带宽处在的区间，从来确定此时应当下发的媒体流形式。基于此，引用第一设定阈值和第二设定阈值来划分估计带宽所在的区间。
步骤203，确定发送的媒体流为视频流，音频和视频采集程序切换到前台。
这里，当确定估计带宽大于或等于第二设定阈值时，发送的媒体流为视频流，参会终端接收的会议内容为视频流，以视频形式输出会议内容。需要注意的是，当在线会议开始时，服务器在后台运行音视频采集程序，包括但不限于对每个参会终端进行录音和录像，同时对每个参会终端的语音内容进行语义识别，将语义识别的会议内容基于关键词进行保存。因此，确定发送的媒体流为视频流时，音频和视频采集程序都切换到前台。
步骤204，判断估计带宽是否大于或等于第一设定阈值，若是，则执行步骤205，若否，则执行步骤206。
步骤205，确定发送的媒体流为音频流，音频采集程序切换到前台。
这里，当确定估计带宽大于或等于第一设定阈值且小于第二设定阈值时，确定发送的媒体流为音频流，参会终端接收会议内容为音频流，以音频形式输出会议内容。此时，音频采集程序切换到前台，视频采集程序切换到后台，暂停发送，但是录像一直保持。
步骤206，检测参会终端是否在线，若是，则执行步骤207，若否，则执行步骤208。
这里，检测参会终端是否在线可以通过心跳包来判断，若在指定时间段内未收到参会终端的响应，则确定参会终端中已经掉线。此外，在线会议开始前，所有参会终端的设备时钟需要对齐，确保会议离线补齐机制开启(服务器端和至少一个参会终端需要开启)，此时记录参会终端的掉线时间。
步骤207，确定发送的媒体流为文字流，文字转译模块切换到前台。
这里，当确定估计带宽小于第一设定阈值且参会终端在线时，将文字转移模块切换到前台，参会终端接收会议内容为文字流，以文字形式显示会议内容，而音频和视频采集程序都切换到后台，暂停发送，但一直保持录音和录像，服务器按照时间轴记录并保存会议内容。
这里，文字流的产生是通过采集端同步生成一路文字转译流，并通过无中心转流服务器的mesh架构中的中间路由转发。
步骤208，等待参会终端的网络状态恢复，重新上线。
步骤209，判断参会终端的估计带宽是否变化。
这里，基于估计带宽确定应当下发的媒体流形式后，在发送窗口已经准备，还未发送媒体流时，再次判断参会终端的估计带宽是否发生变化， 从而来确定是否需要切换媒体流形式。
步骤210，评估新的估计带宽所在的带宽区间，确定此时应当下发的媒体流形式。
这里，确定参会终端的估计带宽发生变化后，再次通过变化后的估计带宽与第一设定阈值和第二设定阈值去比较，确定变化后的估计带宽所处的区间，从而确定此时应当下发的媒体流形式。比如，在当前媒体流形式为视频流时，在确定参会终端的估计带宽发生变化后，基于变化后的估计带宽所处的区间确定此时应当下发的媒体流形式；若此参会终端变化后的估计带宽大于或等于第二设定阈值，则保持此媒体流形式为视频流；若此参会终端变化后的估计带宽大于或等于所述第一设定阈值且小于第二设定阈值，则确定此时应当下发的媒体流形式为音频流；若此参会终端变化后的估计带宽小于所述第一设定阈值且此参会终端为在线状态，则确定此时应当下发的媒体流形式为文字流。
示例性地，第一设定阈值和第二设定阈值不一定作为切换媒体流的绝对条件，考虑到网络波动是一个动态变化的过程，还可以考虑设置浮动因子。例如，32kbps为第一设定阈值，设置5kbps的浮动因子，当估计带宽大于等于37kbps时，媒体流形式才能从文字流切换为音频流，当估计带宽在设定阈值和浮动因子之间的区间波动时，按照当前的媒体流形式下发对应的媒体流，不切换媒体流形式。
步骤211，将媒体流切换至此时应当下发的媒体流形式。
这里，若确定应当下发的媒体流形式并未发生改变，即估计带宽是在当前区间内变化，则基于带宽的变化方向，调整媒体流的发送速率。具体地，请参阅图4，图4为发送媒体流至参会终端的结构示意图，如图4所示，带宽调节控制器42基于丢包率适配器41中得到的估计带宽，在操作系统网络调速模块中调节网络的发送速率，在音视频编码器43中基于发送速率 调节分辨率、帧率、编码质量的权重，改变音视频传输的质量，最后，将在音视频编码器43中调节过的媒体流下发至参会终端44。
步骤212，判断参会终端的网络传输是否恢复。
这里，若参会终端的网络传输恢复，即参会终端重新连上此在线会议，记录恢复上线时间，方便服务器提取相关的文字记录。
步骤213，下发掉线期间的会议内容至重连的参会端。
这里，服务器提取掉线时间至恢复上线时间期间的文字会议内容，最终并高亮给用户，能够辅助接收端的的用户获取掉线期间的在线会议的重要信息，避免遗漏，提高了用户的使用体验。为了实现本申请实施例的方法，本申请实施例还提供一种远程在线会议切换装置，该远程在线会议切换装置与上述远程在线会议切换方法对应，上述远程在线会议切换方法实施例中的各步骤也完全适用于本远程在线会议切换装置实施例。
如图5所示，该远程在线会议切换装置包括：检测模块501和发送模块502。检测模块501配置为确定参会终端的估计带宽小于设定阈值，检测参会终端的连接状态；其中，连接状态包括：在线状态和掉线状态；发送模块502配置为若参会终端为掉线状态，则在相应的参会终端恢复在线状态之后，将参会终端处于掉线状态期间的会议内容发送给至相应的参会终端。
在一实施例中，发送模块502配置为：若确定参会终端的估计带宽小于第一设定阈值且参会终端为在线状态，则发送文字流至参会终端；若确定参会终端的估计带宽大于或等于第一设定阈值且小于第二设定阈值，则发送音频流至参会终端；若确定参会终端的估计带宽大于或等于第二设定阈值，则发送视频流至参会终端；其中，第二设定阈值大于第一设定阈值。
在一实施例中，该远程在线会议切换装置还包括：带宽评估模块503，带宽评估模块503配置为：基于时延估计的带宽、反馈计算的带宽和丢包 率，得到估计带宽；其中，时延估计的带宽为基于拥塞控制算法评估得到的带宽，反馈计算的带宽为基于来自参会终端的反馈包中的信息计算得到的带宽。
在一实施例中，带宽评估模块503具体配置为：基于反馈包的发送时间和到达时间，得到趋势值；其中，趋势值表示参会终端的网络延迟状态；基于排队时延和丢包率，确定参会终端的网络是否发生过载；若是，则基于趋势值和数学模型，得到网络状态标识值；其中，网络状态标识值表示参会终端的网络状态；基于网络状态标识值和拥塞控制算法，调节参会终端的网络带宽，得到时延估计的带宽。
在一实施例中，该远程在线会议切换装置还包括：调整模块504，调整模块504配置为：若确定估计带宽在当前区间内变化，基于估计带宽的变化方向，调整媒体流的发送速率。
在一实施例中，该远程在线会议切换装置还包括：切换模块505，切换模块505配置为：基于参会终端的运动速度、历史运动轨迹及指定区域的坐标，确定参会终端到达指定区域的目标时刻；基于目标时刻及指定区域和对应的网络带宽的映射关系，切换参会终端的媒体流状态。
在一实施例中，该远程在线会议切换装置还包括：语义识别模块506，语义识别模块506配置为：采集所有参会终端的音频信息；基于采集的音频信息，进行语义识别，并将识别的语音内容基于关键词进行存储。
实际应用时，检测模块501、发送模块502、带宽评估模块503、调整模块504、切换模块505和语义识别模块506可以由远程在线会议切换装置中的处理器来实现。当然，处理器需要运行存储器中的计算机程序来实现它的功能。
需要说明的是：上述实施例提供的远程在线会议切换装置在进行远程在线会议切换时，仅以上述各程序模块的划分进行举例说明，实际应用中， 可以根据需要而将上述处理分配由不同的程序模块完成，即将装置的内部结构划分成不同的程序模块，以完成以上描述的全部或者部分处理。另外，上述实施例提供的远程在线会议切换装置与远程在线会议切换方法实施例属于同一构思，其具体实现过程详见方法实施例，这里不再赘述。
基于上述程序模块的硬件实现，且为了实现本申请实施例的方法，本申请实施例还提供一种远程会议设备。图6仅仅示出了该远程会议设备的示例性结构而非全部结构，根据需要可以实施图6示出的部分结构或全部结构。
如图6所示，本申请实施例提供的远程会议设备600包括：至少一个处理器601、存储器602、用户接口603和至少一个网络接口604。远程会议设备600中的各个组件通过总线系统605耦合在一起。可以理解，总线系统605用于实现这些组件之间的连接通信。总线系统605除包括数据总线之外，还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见，在图6中将各种总线都标为总线系统605。
其中，用户接口603可以包括显示器、键盘、鼠标、轨迹球、点击轮、按键、按钮、触感板或者触摸屏等。
本申请实施例中的存储器602用于存储各种类型的数据以支持远程会议切换设备的操作。这些数据的示例包括：用于在远程会议设备上操作的任何计算机程序。
本申请实施例揭示的远程在线会议切换方法可以应用于处理器601中，或者由处理器601实现。处理器601可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，远程在线会议切换方法的各步骤可以通过处理器601中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器601可以是通用处理器、数字信号处理器(DSP，Digital Signal Processor)，或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。 处理器601可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者任何常规的处理器等。结合本申请实施例所公开的方法的步骤，可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于存储介质中，该存储介质位于存储器602，处理器601读取存储器602中的信息，结合其硬件完成本申请实施例提供的远程在线会议切换方法的步骤。
在示例性实施例中，远程会议设备可以被一个或多个应用专用集成电路(ASIC，Application Specific Integrated Circuit)、DSP、可编程逻辑器件(PLD，Programmable Logic Device)、复杂可编程逻辑器件(CPLD，Complex Programmable Logic Device)、现场可编程逻辑门阵列(FPGA，Field Programmable Gate Array)、通用处理器、控制器、微控制器(MCU，Micro Controller Unit)、微处理器(Microprocessor)、或者其他电子元件实现，用于执行前述方法。
可以理解，存储器602可以是易失性存储器或非易失性存储器，也可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(ROM，Read Only Memory)、可编程只读存储器(PROM，Programmable Read-Only Memory)、可擦除可编程只读存储器(EPROM，Erasable Programmable Read-Only Memory)、电可擦除可编程只读存储器(EEPROM，Electrically Erasable Programmable Read-Only Memory)、磁性随机存取存储器(FRAM，ferromagnetic random access memory)、快闪存储器(Flash Memory)、磁表面存储器、光盘、或只读光盘(CD-ROM，Compact Disc Read-Only Memory)；磁表面存储器可以是磁盘存储器或磁带存储器。易失性存储器可以是随机存取存储器(RAM，Random Access Memory)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(SRAM，Static Random Access Memory)、同步静 态随机存取存储器(SSRAM，Synchronous Static Random Access Memory)、动态随机存取存储器(DRAM，Dynamic Random Access Memory)、同步动态随机存取存储器(SDRAM，Synchronous Dynamic Random Access Memory)、双倍数据速率同步动态随机存取存储器(DDRSDRAM，Double Data Rate Synchronous Dynamic Random Access Memory)、增强型同步动态随机存取存储器(ESDRAM，Enhanced Synchronous Dynamic Random Access Memory)、同步连接动态随机存取存储器(SLDRAM，SyncLink Dynamic Random Access Memory)、直接内存总线随机存取存储器(DRRAM，Direct Rambus Random Access Memory)。本申请实施例描述的存储器旨在包括但不限于这些和任意其它适合类型的存储器。
在示例性实施例中，本申请实施例还提供了一种存储介质，即计算机存储介质，具体可以是计算机可读存储介质，例如包括存储计算机程序的存储器602，上述计算机程序可由远程会议设备的处理器601执行，以完成本申请实施例方法的步骤。计算机可读存储介质可以是ROM、PROM、EPROM、EEPROM、Flash Memory、磁表面存储器、光盘、或CD-ROM等存储器。
需要说明的是：“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。
另外，本申请实施例所记载的技术方案之间，在不冲突的情况下，可以任意组合。
以上，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请披露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以权利要求的保护范围为准。

Claims (12)

  1. 一种远程在线会议切换方法，包括：
    若确定参会终端的估计带宽小于第一设定阈值，则检测所述参会终端的连接状态；其中，所述连接状态包括：在线状态和掉线状态；
    若所述参会终端为掉线状态，则在所述参会终端恢复在线状态之后，将所述参会终端处于掉线状态期间的会议内容发送至所述参会终端。
  2. 根据权利要求1所述的方法，其中，所述方法还包括：
    若确定所述参会终端的估计带宽小于所述第一设定阈值且所述参会终端为在线状态，则发送会议文字流至所述参会终端；
    若确定所述参会终端的估计带宽大于或等于所述第一设定阈值且小于第二设定阈值，则发送会议音频流至所述参会终端；
    若确定所述参会终端的估计带宽大于或等于所述第二设定阈值，则发送会议视频流至所述参会终端；
    其中，所述第二设定阈值大于所述第一设定阈值。
  3. 根据权利要求1所述的方法，其中，所述方法还包括：
    基于时延估计的带宽、反馈计算的带宽和丢包率，得到所述估计带宽；
    其中，所述时延估计的带宽为基于拥塞控制算法评估得到的带宽，所述反馈计算的带宽为基于来自所述参会终端的反馈包中的信息计算得到的带宽。
  4. 根据权利要求3所述的方法，其中，所述方法还包括：
    基于所述反馈包的发送时间和到达时间，得到趋势值；其中，趋势值表示所述参会终端的网络延迟状态；
    基于排队时延和所述丢包率，确定所述参会终端的网络是否发生过载；
    若是，则基于所述趋势值和数学模型，得到网络状态标识值；其中， 所述网络状态标识值表示所述参会终端的网络状态；
    基于所述网络状态标识值和拥塞控制算法，调节所述参会终端的网络带宽，得到所述时延估计的带宽。
  5. 根据权利要求2所述的方法，其中，所述还包括：
    若确定所述估计带宽在当前带宽区间内变化，基于所述估计带宽的变化方向，调整媒体流的发送速率。
  6. 根据权利要求1所述的方法，其中，所述方法还包括：
    基于所述参会终端的运动速度、历史运动轨迹及指定区域的坐标，确定所述参会终端到达所述指定区域的目标时刻；
    基于所述目标时刻及指定区域和对应的网络带宽的映射关系，切换所述参会终端的媒体流状态。
  7. 根据权利要求1所述的方法，其中，所述方法还包括：
    采集参与会议的目标参会终端的音频信息；
    基于采集的音频信息进行语义识别，并将识别的语音内容基于关键词进行存储。
  8. 一种远程在线会议切换方法，应用于参会终端，包括：
    若确定由掉线状态转为在线状态，则恢复接入远程在线会议，并接收掉线状态期间的所述远程在线会议对应的会议内容。
  9. 根据权利要求8所述的方法，其中，所述方法还包括：
    基于接收的会议内容的媒体流形式，显示所述会议内容；
    其中，若所述会议内容为文字流，以文字形式显示所述会议内容；若所述会议内容为音频流，以音频形式输出所述会议内容；若所述会议内容为视频流，以视频形式输出所述会议内容。
  10. 一种远程在线会议切换装置，包括：
    检测模块，配置为确定参会终端的估计带宽小于设定阈值，检测所述 参会终端的连接状态；其中，所述连接状态包括：在线状态和掉线状态；
    发送模块，配置为若所述参会终端为掉线状态，则在相应的所述参会终端恢复在线状态之后，将所述参会终端处于掉线状态期间的会议内容发送给至相应的所述参会终端。
  11. 一种远程会议设备，包括：处理器和用于存储能够在处理器上运行的计算机程序的存储器，其中，
    所述处理器，配置为运行计算机程序时，执行权利要求1至7任一项所述方法的步骤。
  12. 一种计算机存储介质，所述计算机存储介质上存储有计算机程序，所述计算机程序被处理器执行时，实现权利要求1至7任一项所述方法的步骤。
PCT/CN2023/116852 2022-11-22 2023-09-04 远程在线会议切换方法、装置、设备及存储介质 WO2024109249A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211466375.8 2022-11-22
CN202211466375.8A CN116962101A (zh) 2022-11-22 2022-11-22 远程在线会议切换方法、装置、设备及存储介质

Publications (1)

Publication Number Publication Date
WO2024109249A1 true WO2024109249A1 (zh) 2024-05-30

Family

ID=88455366

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/116852 WO2024109249A1 (zh) 2022-11-22 2023-09-04 远程在线会议切换方法、装置、设备及存储介质

Country Status (2)

Country Link
CN (1) CN116962101A (zh)
WO (1) WO2024109249A1 (zh)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103297629A (zh) * 2013-06-21 2013-09-11 上海金牌软件开发有限公司 一种用于音频电话会议的掉线重连系统
CN105340255A (zh) * 2013-06-10 2016-02-17 微软技术许可有限责任公司 赶上进行中的会议通话
US20170154030A1 (en) * 2015-11-30 2017-06-01 Citrix Systems, Inc. Providing electronic text recommendations to a user based on what is discussed during a meeting
CN110324564A (zh) * 2018-03-30 2019-10-11 北京视联动力国际信息技术有限公司 一种视频会议数据同步方法及装置
CN111818389A (zh) * 2020-07-27 2020-10-23 联想(北京)有限公司 一种数据处理方法、设备及计算机可读存储介质
CN113691762A (zh) * 2021-08-16 2021-11-23 咪咕文化科技有限公司 视频会议的数据传输方法、装置及计算机可读存储介质
CN113963452A (zh) * 2020-07-02 2022-01-21 Oppo广东移动通信有限公司 一种会议签到方法、装置及计算机可读存储介质
CN115022576A (zh) * 2022-06-17 2022-09-06 云知声智能科技股份有限公司 一种极端网络环境下网络会议优化方法及装置
CN115150366A (zh) * 2022-06-30 2022-10-04 中国电信股份有限公司 远程会议控制方法、装置、存储介质和电子设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105340255A (zh) * 2013-06-10 2016-02-17 微软技术许可有限责任公司 赶上进行中的会议通话
CN103297629A (zh) * 2013-06-21 2013-09-11 上海金牌软件开发有限公司 一种用于音频电话会议的掉线重连系统
US20170154030A1 (en) * 2015-11-30 2017-06-01 Citrix Systems, Inc. Providing electronic text recommendations to a user based on what is discussed during a meeting
CN110324564A (zh) * 2018-03-30 2019-10-11 北京视联动力国际信息技术有限公司 一种视频会议数据同步方法及装置
CN113963452A (zh) * 2020-07-02 2022-01-21 Oppo广东移动通信有限公司 一种会议签到方法、装置及计算机可读存储介质
CN111818389A (zh) * 2020-07-27 2020-10-23 联想(北京)有限公司 一种数据处理方法、设备及计算机可读存储介质
CN113691762A (zh) * 2021-08-16 2021-11-23 咪咕文化科技有限公司 视频会议的数据传输方法、装置及计算机可读存储介质
CN115022576A (zh) * 2022-06-17 2022-09-06 云知声智能科技股份有限公司 一种极端网络环境下网络会议优化方法及装置
CN115150366A (zh) * 2022-06-30 2022-10-04 中国电信股份有限公司 远程会议控制方法、装置、存储介质和电子设备

Also Published As

Publication number Publication date
CN116962101A (zh) 2023-10-27

Similar Documents

Publication Publication Date Title
US10091258B2 (en) Methods and systems for electronic communications feedback
US9876986B2 (en) Mechanisms to conceal real time video artifacts caused by frame loss
US9154395B2 (en) Method and system for optimizing a jitter buffer
US20010009014A1 (en) Facilitating real-time, multi-point communications over the internet
US8587634B1 (en) System and method for intelligent mode switching in a communications environment
CN110113662B (zh) 一种适应多种网络状况的视频监控客户端系统
US20220286312A1 (en) Content capture during virtual meeting disconnect
WO2020248649A1 (zh) 音视频数据同步播放方法、装置、系统、电子设备及介质
CN110572607A (zh) 一种视频会议方法、系统及装置和存储介质
CN109495660B (zh) 一种音频数据的编码方法、装置、设备和存储介质
CN112702557A (zh) 一种基于通话的屏幕共享方法、装置、设备及存储介质
US20080008096A1 (en) System and method for managing playout time in packet communication network
CN110913162A (zh) 一种音视频流数据处理方法和系统
US20070271335A1 (en) Electronic Conferencing System Latency Feedback
WO2024109249A1 (zh) 远程在线会议切换方法、装置、设备及存储介质
US7907594B2 (en) Marking keyframes for a communication session
US9325853B1 (en) Equalization of silence audio levels in packet media conferencing systems
CN111131788B (zh) 监控资源状态检测方法、装置及计算机可读存储介质
CN111131840A (zh) 一种视频业务系统切换网络的方法及装置
CN110852692A (zh) 会议评分方法、装置、电子设备及存储介质
CN108924465B (zh) 视频会议发言人终端的确定方法、装置、设备和存储介质
WO2020164457A1 (zh) 处理异常的方法、装置与设备
US9912910B2 (en) Media content updating method, apparatus, and system
US20230421701A1 (en) Receiver side noise reduction and speech enhancement for pstn callers
CN110636132A (zh) 数据同步方法、客户端、电子设备及计算机可读存储介质