CN115665362A

CN115665362A - Video conference processing method and device, electronic equipment and storage medium

Info

Publication number: CN115665362A
Application number: CN202211173398.XA
Authority: CN
Inventors: 姚九; 赵广石; 安君超; 王艳辉
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2022-09-26
Filing date: 2022-09-26
Publication date: 2023-01-31

Abstract

The embodiment of the invention provides a video conference processing method, a video conference processing device, electronic equipment and a storage medium, wherein the method comprises the following steps: acquiring a first network environment parameter sent by a network analyzer through a network analysis process, wherein the first network environment parameter is a parameter corresponding to a network environment when video data interaction is carried out with a remote terminal; selecting a first display parameter matched with a corresponding network environment when video data interaction is carried out between the first display parameter and the remote terminal according to the first network environment parameter through the network analysis process, and sending the first display parameter to the remote terminal; and receiving video data corresponding to the first display parameter sent by the remote terminal through a service process, and sending the video data to the remote terminal according to the first display parameter, so that the terminal can fully utilize the current network environment to carry out data transmission, and the stability of data transmission and the fluency of video data playing are effectively ensured.

Description

Video conference processing method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for processing a video conference, an electronic device, and a computer-readable storage medium.

Background

With the development of network technology and communication technology, video conferencing has become an important way for people to work, study and communicate in daily life. In the process that users of two parties participating in the video conference participate in the video conference, the video conference is easy to be blocked due to various different reasons, such as network environment problems, equipment hardware performance problems and the like, and if the video conference is blocked in the process, users of the two parties are easy to bring relatively poor communication experience. For example, for a network environment problem, the bandwidth is often insufficient or the network shakes, so that the data transmission rate is reduced and the requirement for smooth playing cannot be met, thereby affecting the normal participation of the user in the video conference.

Disclosure of Invention

The embodiment of the invention provides a processing method and device for a video conference, electronic equipment and a computer readable storage medium, which are used for solving or partially solving the problems that video data transmission is unstable and video data playing is not smooth easily due to abnormal network environment.

The embodiment of the invention discloses a processing method of a video conference, which comprises the following steps:

acquiring a first network environment parameter sent by a network analyzer through a network analysis process, wherein the first network environment parameter is a parameter corresponding to a network environment when video data interaction is carried out with a remote terminal;

selecting a first display parameter matched with a corresponding network environment when video data interaction is carried out between the first display parameter and the remote terminal according to the first network environment parameter through the network analysis process, and sending the first display parameter to the remote terminal;

and receiving video data corresponding to the first display parameter sent by the remote terminal through a service process, and sending the video data to the remote terminal according to the first display parameter.

Optionally, the method further comprises:

receiving a second display parameter sent by the remote terminal through the network analysis process, wherein the second display parameter is a display parameter matched with a corresponding network environment when the remote terminal performs video data interaction with a local terminal according to a second network environment parameter corresponding to the video data interaction with the local terminal;

if the first network environment parameter is compatible with the second display parameter, adjusting the first display parameter to the second display parameter through the network analysis process;

and sending video data to the remote terminal by the service process according to the second display parameter, and receiving the video data which is sent by the remote terminal and corresponds to the second display parameter.

Optionally, the method further comprises:

if the first network environment parameter is not compatible with the second display parameter, the first display parameter is maintained through the network analysis process, and a response message aiming at the second display parameter is sent to the far-end terminal, so that the far-end terminal transmits video data according to the first display parameter.

Optionally, the selecting, by the network analysis process according to the network environment parameter, a first display parameter matched with a network environment corresponding to the video data interaction between the remote terminal and the remote terminal includes:

acquiring a display parameter policy table corresponding to a network environment through the network analysis process, wherein the display parameter policy table comprises mapping relations between different network bandwidth values and different display parameters;

and selecting a first display parameter corresponding to the first network bandwidth value from the display parameter policy table through the network analysis process.

Optionally, the display parameter at least includes one of a resolution, a frame rate, and a code rate corresponding to the video data.

Optionally, the acquiring, by the network analysis process, the first network environment parameter sent by the network analyzer includes:

and acquiring a first network environment parameter sent by the network analyzer according to the preset interval duration through the network analysis process.

Optionally, before the obtaining, by the network analysis process, the first network environment parameter sent by the network analyzer, the method further includes:

creating a data processing process, wherein the data processing process comprises a business process and a network analysis process;

and responding to the fact that the service process receives a video conference instruction, starting a conference entering service, receiving video data sent by a far-end terminal through the service process, and sending the video data to the far-end terminal.

The embodiment of the invention also discloses a processing device of the video conference, which comprises:

the network parameter acquisition module is used for acquiring a first network environment parameter sent by a network analyzer through a network analysis process, wherein the first network environment parameter is a parameter corresponding to a network environment when video data interaction is carried out with a remote terminal;

the display parameter determining module is used for selecting a first display parameter matched with a corresponding network environment when video data interaction is carried out between the display parameter determining module and the remote terminal according to the first network environment parameter through the network analysis process, and sending the first display parameter to the remote terminal;

and the video data transmission module is used for receiving the video data which is sent by the remote terminal and corresponds to the first display parameter through a service process, and sending the video data to the remote terminal according to the first display parameter.

Optionally, the method further comprises:

the display parameter receiving module is used for receiving a second display parameter sent by the remote terminal through the network analysis process, wherein the second display parameter is a display parameter which is selected by the remote terminal and matched with a corresponding network environment when video data interaction is carried out between local terminals according to a second network environment parameter corresponding to the video data interaction between the remote terminal and the local terminals;

a display parameter adjusting module, configured to adjust the first display parameter to the second display parameter through the network analysis process if the first network environment parameter is compatible with the second display parameter;

and the video data receiving module is used for sending video data to the remote terminal through the service process according to the second display parameter and receiving the video data which is sent by the remote terminal and corresponds to the second display parameter.

Optionally, the method further comprises:

and the response message sending module is used for keeping the first display parameter through the network analysis process and sending a response message aiming at the second display parameter to the remote terminal if the first network environment parameter is not compatible with the second display parameter, so that the remote terminal transmits video data according to the first display parameter.

Optionally, the first network environment parameter includes a first network bandwidth value, and the display parameter determining module is specifically configured to:

Optionally, the network parameter obtaining module is specifically configured to:

Optionally, the apparatus further comprises:

the data process creating module is used for creating a data processing process, and the data processing process comprises a service process and a network analysis process;

and the video data sending module is used for responding to the video conference instruction received by the service process, starting the conference-entering service, receiving the video data sent by the far-end terminal through the service process, and sending the video data to the far-end terminal.

The embodiment of the invention also discloses electronic equipment which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory finish mutual communication through the communication bus;

the memory is used for storing a computer program;

the processor is configured to implement the method according to the embodiment of the present invention when executing the program stored in the memory.

Also disclosed is a computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform a method according to an embodiment of the invention.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, in the video conference process, for any terminal participating in the video conference, a corresponding data processing process can be created, including a network analysis process, a service process and the like, so that a first network environment parameter sent by a network analyzer can be obtained through the network analysis process, the first network environment parameter can be a parameter corresponding to a network environment when video data interaction is performed with a remote terminal, then a first display parameter matched with the network environment corresponding to the remote terminal when video data interaction is performed between the remote terminal and the remote terminal can be selected through the network analysis process according to the first network environment parameter, the first display parameter is sent to the remote terminal, then video data corresponding to the first display parameter sent by the remote terminal can be received through the service process, the video data is sent to the remote terminal by the first display parameter, therefore, in the video conference process, the network environment during video interaction between the terminals can be detected through the network analyzer, the display parameter corresponding to the video data can be dynamically adjusted based on the detected network environment parameter, the efficiency of video data transmission can be fully utilized, and the efficiency of video data transmission can be effectively improved.

Drawings

Fig. 1 is a flowchart illustrating steps of a method for processing a video conference according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of device communications provided in an embodiment of the present invention;

FIG. 3 is a schematic diagram of data interaction provided in an embodiment of the invention;

FIG. 4 is a schematic diagram of data interaction provided in an embodiment of the invention;

fig. 5 is a block diagram of a processing apparatus for video conference provided in an embodiment of the present invention;

fig. 6 is a block diagram of an electronic device provided in an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

As an example, in a video conference process, the quality of a network environment is an important factor influencing video output, and if an abnormality occurs in the network environment, a video playing problem in the video conference process is easily caused, which brings a poor conference participating experience to a user. The network environment, which refers to a network environment between the receiving terminal and the service terminal, is suitable for a change of the network environment at any end, and may be represented by network jitter, for example, when a data packet is sent too fast or too slow within a certain time range. For example, different video network terminals located in the video network may participate in a corresponding video conference, and transmit video data acquired by the acquisition sensor to an opposite video network terminal participating in the video conference, and in the data transmission process, on the basis of limited bandwidth resources of the video network, video data playing is easily blocked, so a method capable of ensuring stable data transmission and smooth playing in the video conference process is required.

To solve the problems of unstable data transmission and unsmooth video data playing in the video conference process, one of the core invention points in that for any terminal participating in the video conference, a corresponding data processing process can be created, including a network analysis process, a service process and the like, and a first network environment parameter sent by a network analyzer can be obtained through the network analysis process, the first network environment parameter can be a parameter corresponding to a network environment when video data interaction is performed with a remote terminal, then a first display parameter matched with the corresponding network environment when video data interaction is performed between the terminal and the remote terminal can be selected according to the first network environment parameter through the network analysis process, the first display parameter is sent to the remote terminal, then video data sent corresponding to the first display parameter from the remote terminal can be received through the service process, the video data is sent to the remote terminal according to the first display parameter, so that in the video conference process, the network environment when video interaction is performed between the terminals is detected through the network analyzer, the video data corresponding to the first display parameter is adjusted based on the detected network environment parameter, and the video data can be effectively transmitted, and the efficiency of the video data transmission can be effectively improved, and the efficiency of the video data transmission can be effectively utilized.

Referring to fig. 1, a flowchart illustrating steps of a processing method for a video conference provided in an embodiment of the present invention is shown, which may specifically include the following steps:

step 101, acquiring a first network environment parameter sent by a network analyzer through a network analysis process, wherein the first network environment parameter is a parameter corresponding to a network environment when video data interaction is carried out with a remote terminal;

in an example, referring to fig. 2, a schematic diagram of device communication provided in the embodiment of the present invention is shown, taking a video conference as an example, in the video conference, for a local terminal, it may collect corresponding data, such as video data, through a sensor, and then transmit the corresponding data to a remote terminal participating in the same video conference, where the remote terminal may also transmit the collected data to the local terminal, and after receiving the corresponding video data, each terminal may output the video data through a corresponding content output device. Meanwhile, in the process of data interaction between the local terminal and the far-end terminal, the network analyzer can detect the corresponding network environment when the data interaction is carried out between the local terminal and the far-end terminal, and sends the corresponding network parameters to the terminal according to the detection result, so that the terminal can adjust the display parameters according to the network parameters, the terminal can fully utilize the current network environment to carry out data transmission, and the stability of data transmission and the smoothness of video data playing are effectively ensured. It should be noted that, in the embodiment of the present invention, a local terminal is taken as an example for description, and it is understood that, for a remote terminal, the remote terminal may perform the same data processing procedure as the local terminal, and the present invention is not limited thereto.

In the embodiment of the invention, after the local terminal and the remote terminal establish corresponding data communication connection to perform a video conference, the local terminal can acquire the first network environment parameter corresponding to the video data interaction with the remote terminal, that is, the local terminal can acquire the network environment parameter corresponding to the video data sent to the remote terminal and/or the network environment parameter corresponding to the video data sent by the remote terminal, so as to detect the current network environment through the network environment parameter, and further select a proper display parameter to transmit the video data, so as to ensure the stability of data transmission and the smoothness of video data output.

In a specific implementation, the local terminal may create a corresponding data processing procedure, and execute corresponding data processing through the data processing procedure. The data processing process may include a service process and a network analysis process, for the service process, the data processing process may be used to detect a video conference joining instruction, and the network analysis process may be used to analyze a network environment corresponding to the local terminal, specifically, the local terminal may receive the video conference instruction in response to the service process, start the joining service, receive video data sent by the remote terminal through the service process, acquire corresponding video data through the sensor, and then send the acquired video data to the remote terminal through the service process, so as to implement a video conference with the remote terminal.

In the process of carrying out a video conference with a remote terminal, the current network environment can be detected in real time through a network analyzer, then the detection result is sent to the terminal, and the terminal can receive the network environment parameters sent by the network analyzer through a network analysis process, so that in the process of the video conference, the current network environment can be fully utilized to transmit video data, and the stability of video data transmission and the smoothness of video data output are ensured. Specifically, the local terminal may obtain, through the network analysis process, a first network environment parameter corresponding to the video data interaction with the remote terminal, which is sent by the network analyzer, so as to analyze the network environment based on the first network environment parameter. The network environment parameter may be used to represent a bandwidth condition of a network environment, for example, the network environment parameter may be a network bandwidth value, and the larger the network bandwidth value is, the richer the current bandwidth resource is represented, and the larger data volume data may be transmitted; the smaller the network bandwidth value is, the more tense the current bandwidth resource is, and the data with large data volume cannot be transmitted.

In an example, for analysis of a network environment, a local terminal may obtain, by a network analysis process, a first network environment parameter sent by a network analyzer according to a preset interval duration, for example, the preset interval duration may be 10 seconds, and in a process of data transmission between the local terminal and a remote terminal, the local terminal may receive, from the network analyzer, a current network bandwidth value or request the current network bandwidth value from the network analyzer every 10 seconds through the network analysis process, so as to analyze a current network environment through the current network bandwidth value, thereby selecting an appropriate display parameter to transmit video data, so as to ensure stability of data transmission and smoothness of video data output.

102, selecting a first display parameter matched with a corresponding network environment when video data interaction is carried out between the first display parameter and the remote terminal according to the first network environment parameter through the network analysis process, and sending the first display parameter to the remote terminal;

after the local terminal acquires the corresponding first network environment parameter, a first display parameter which is matched with the corresponding network environment and is used for video interaction with the remote terminal can be selected through a network analysis process according to the first network environment parameter, the first display parameter can be used as a display parameter corresponding to the local terminal when the local terminal sends video data to the remote terminal, and can also be used as a display parameter corresponding to the remote terminal when the remote terminal sends the video data to the local terminal, so that after the local terminal determines the first display parameter, on one hand, the current display parameter corresponding to the current video data transmission to the remote terminal can be adjusted to be the first display parameter through the network analysis process, then the video data is transmitted to the remote terminal through a service process based on the adjusted first display parameter, on the other hand, the first display parameter can be sent to the remote terminal through the network analysis process, so that the remote terminal sends the video data to the local terminal based on the first display parameter, the bidirectional adjustment of the display parameter in the data transmission process is realized, so that the local terminal can carry out data transmission according to the mode matched with the current network environment, the stability of the video data transmission is ensured, the video data transmission is not satisfied, and the video data transmission is easy to be displayed, and the video data transmission is not stable, otherwise, the video data transmission is not easy to be displayed, the other data transmission, the streaming is caused by the network environment.

In a specific implementation, the local terminal may select, according to the first network environment parameter, a first display parameter matched with a corresponding network environment when performing video data interaction with the remote terminal through the network analysis process. Specifically, the first network environment parameter may include a first network bandwidth value, and the local terminal may first obtain a display parameter policy table corresponding to the network environment, where the display parameter policy table may include mapping relationships between different network bandwidth values and different display parameters, and then may select the first display parameter corresponding to the first network bandwidth value from the display parameter policy table. The display parameter may include one of a resolution, a frame rate, and a code rate corresponding to the video data.

In one example, assuming that the display parameter is the resolution corresponding to the video data, the display parameter policy table may be as follows:

network bandwidth value	Resolution ratio
		0～200k	320*240
200～500k	640*480
		500～700k	720*576
700～1000k	1280*720
		1000～2000k	1920*1080
…	…

After the local terminal acquires the current network bandwidth value, the local terminal selects a matched resolution from the display parameter policy table to transmit video data based on the current network bandwidth value through a network analysis process, and simultaneously transmits the selected resolution to the remote terminal, so that when the remote terminal transmits the video data to the local terminal, the video data is also transmitted according to the resolution, for example, assuming that the current network bandwidth value is 800k, the local terminal can acquire the current resolution, if the current resolution is not 1280 × 720, the current resolution can be adjusted to 1280 × 720, then the acquired first video data is transcoded to 1280 × 720, the transcoded first video data is transmitted to the remote terminal, and the resolution is transmitted to the remote terminal at the same time, so that the remote terminal informs that the current network environment is compatible with the video data of 1280 × 720, the remote terminal can transcode the second video data which needs to be transmitted to the local terminal to 1280 × 720, and transmit the transcoded second video data to the local terminal, so that the video data can be transmitted through the network analysis process, the remote terminal can effectively detect the video data transmitted based on the resolution and the environment stability of the video data transmitted by the network, and the remote terminal can be effectively adjusted by the network analysis process, so that the resolution can be transmitted according to the environment, the stability of the environment of the current network analysis process of the video data transmitted by the remote terminal, and the remote terminal, so that the resolution is effectively, the stability of the environment is guaranteed.

After the local terminal completes the adjustment of the resolution ratio for one time, the detection of the next period can be started, and then whether the resolution ratio needs to be adjusted or not can be judged based on the network environment parameters detected again, so that the dynamic adjustment of the resolution ratio is realized by detecting the network environment, the terminal can transmit data in a mode matched with the current network environment, the stability of data transmission can be ensured, and the fluency of video data playing can be ensured.

And 103, receiving the video data corresponding to the first display parameter, which is sent by the remote terminal, through a service process, and sending the video data to the remote terminal according to the first display parameter.

When a local terminal sends a first display parameter (such as a first resolution) to a remote terminal, the remote terminal can acquire a current display parameter corresponding to video data currently sent to the local terminal, if the current display parameter is different from the first display parameter, the current display parameter can be adjusted to be the first display parameter, then the video data is sent to the local terminal by using the first display parameter, and correspondingly, the local terminal sends corresponding video data to the remote terminal by using the first display parameter, so that in the process of a video conference, a network environment during video interaction between terminals is detected by a network analyzer, and the display parameter corresponding to the video data is dynamically adjusted based on the detected network environment parameter, so that each terminal with video data interaction can transmit the video data according to the adjusted display parameter, the terminal can fully utilize the current network environment to transmit the data, the stability of data transmission and the smoothness of video data playing are effectively ensured, and meanwhile, based on a dual-process data transmission mode, the data distribution processing is realized, and the efficiency of data processing is improved.

After the video data is dynamically adjusted based on the display parameters, the local terminal may output the video data according to the first display parameter after receiving the adjusted video data sent by the remote terminal, for example, the adjusted resolution is 1280 × 720, then the resolution corresponding to the video data sent by the remote terminal is 1280 × 720, and after receiving the video data, the local terminal may play the video data with the resolution, so that in the process of the video conference, the network environment during video interaction between the terminals is detected by the network analyzer, and the display parameters corresponding to the video data are dynamically adjusted based on the detected network environment parameters, so that each terminal having video data interaction may transmit the video data according to the adjusted display parameters, so that the terminal can fully utilize the current network environment for data transmission, thereby effectively ensuring the stability of data transmission and the smoothness of video data playing, and meanwhile, based on a data transmission mode of a dual process, implementing data distribution processing of the data, and improving the efficiency of data processing.

In an optional embodiment, no matter which terminal is the local terminal or the remote terminal, the network environment where the terminal is located is not necessarily the same, after receiving the display parameter sent by the opposite terminal, it may be determined whether the display parameter matches the network environment where the terminal is located, if not, the video data is not transmitted according to the received display parameter, and if so, the video data may be transmitted according to the received display parameter.

In specific implementation, taking a local terminal as an example, when the local terminal receives, through a network analysis process, a second display parameter sent by a remote terminal, where the second display parameter may be a second network environment parameter corresponding to video data interaction with the local terminal, and the second display parameter is selected to be matched with a network environment corresponding to video data interaction between the local terminals, and then the local terminal may compare a first network environment parameter corresponding to a current display parameter (e.g., a first display parameter) with a second network environment parameter corresponding to a second display parameter, to determine whether the current network environment of the local terminal is compatible with the display parameter, and if the first network environment parameter is compatible with the second display parameter, the local terminal may adjust the first display parameter to the second display parameter through the network analysis process, then send video data to the remote terminal with the second display parameter, receive video data sent by the remote terminal and corresponding to the second display parameter, and output the video data according to the second display parameter; if the first network environment parameter is not compatible with the second display parameter, the local terminal can keep the first display parameter through the network analysis process and send a response message aiming at the second display parameter to the remote terminal, so that the remote terminal transmits the video data according to the first display parameter.

For example, assuming that the local terminal currently receives and transmits video data at a resolution of 1280 × 720, and the network environment is stable at 800k, at this time, the remote terminal adjusts the resolution from 1280 × 720 to 1920 × 1080 according to the current network bandwidth value, and then transmits the resolution to the local terminal, and after receiving the resolution, the local terminal may obtain a network bandwidth value corresponding to 1920 × 1080, which is 1000 to 2000k and is greater than the current 800k, and may determine that the current network environment is incompatible with the resolution of 1920 × 1080, and transmit a corresponding response message to the remote terminal to inform that the remote terminal is currently compatible with only the resolution of 1280 × 720, so that the remote terminal and the local terminal continue to transmit video data at 1280 × 720; in another case, if the resolution adjusted by the remote terminal is 640 × 480, the local terminal obtains a corresponding network bandwidth value of 200 to 500k based on the same processing procedure, and the current network bandwidth value 800k of the local terminal is greater than the range and is compatible with the resolution of 640 × 480, and then the local terminal may transmit video data with the remote terminal according to the resolution of 640 × 480, so that any terminal participating in the video conference may perform real-time detection on the network environment and dynamically adjust display parameters corresponding to the video data based on the network environment parameters during the video conference, and then may send the adjusted display parameters to the remote terminal, so that the remote terminal may transmit the video data according to the display parameters, so that the current network environment may be fully utilized between terminals to perform data transmission, and the stability of data transmission and the smoothness of video data playing are effectively ensured.

It should be noted that, in the embodiment of the present invention, a local terminal is taken as an example for illustration, and it is understood that, for any terminal participating in a video conference, the display parameter dynamic adjustment process related in the embodiment of the present invention may be executed, and the present invention is not limited to this.

In an example, referring to fig. 3, a schematic diagram of data interaction provided in the embodiment of the present invention is shown, which may be introduced in a video conference process of a video network, specifically, a remote terminal may transmit corresponding video network data to a local terminal through the video network, and the local terminal may output the corresponding video network data through a corresponding content output device after receiving the corresponding video network data. Meanwhile, in the process of data interaction between the remote terminal and the local terminal, the traffic analyzer (i.e., the network analyzer) may acquire corresponding video network data (e.g., a network bandwidth value of a network environment), and then send an adaptive parameter instruction to perform display parameter adjustment on the data interacted between the remote terminal and the local terminal based on the acquired network bandwidth value, so that the remote terminal and the local terminal may update the display data based on the adjusted display parameter. For example, a remote terminal sends video data to a local terminal for a conference service according to a received video networking command, the local terminal receives the video data from a network environment, and the data is intercepted by a traffic analyzer according to a corresponding time interval, after the analysis of the traffic analyzer, display parameters such as image resolution, frame rate and code rate suitable for the current network environment can be found, and the traffic analyzer feeds back the video data to the remote terminal through the network environment and prepares for image decoding and playing according to new display parameters with the local terminal. Optionally, for the network analyzer, it may be a device independent from any terminal, or may be a data processing process located on any terminal, which is not limited in the present invention.

In another example, referring to fig. 4, which shows a schematic diagram of data interaction provided in the embodiment of the present invention, taking a local terminal as an example, first, the local terminal may start a dual process, initialize a traffic analyzer through process 2 (a network analysis process), load an image lookup table, start a service process, and then wait for a video conference instruction. When the local terminal receives the video network conference entering instruction through the process 1 (service process), the local terminal can start the conference entering service and simultaneously receive video network video data through the process 1. At this time, after initializing the traffic analyzer, the process 2 may intercept a part of network data at a corresponding time interval for analyzing a current network environment, and then find a video optimal resolution (image information, etc.) corresponding to the network data from the image lookup table based on an analysis result, the local terminal may use the resolution as a current real-time decoding resolution, decode the received video data through a video decoder, and simultaneously send the video data to the remote terminal through the process 2, the remote terminal receives real-time display parameters, updates the video data based on the display parameters, and after receiving new display parameters, the remote terminal may perform image encoding based on the new parameters.

It should be noted that, in the foregoing embodiment of the present invention, the display parameter is taken as a resolution for exemplary illustration, and it is understood that the terminal may determine at least one display parameter of the resolution, the frame rate and the code rate based on the network environment parameter, and then transmit the video data based on the determined display parameter, which is not limited by the present invention.

It should be noted that for simplicity of description, the method embodiments are shown as a series of combinations of acts, but those skilled in the art will recognize that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 5, a block diagram of a processing apparatus for a video conference provided in the embodiment of the present invention is shown, and specifically, the processing apparatus may include the following modules:

a network parameter obtaining module 501, configured to obtain, through a network analysis process, a first network environment parameter sent by a network analyzer, where the first network environment parameter is a parameter corresponding to a network environment when performing video data interaction with a remote terminal;

a display parameter determining module 502, configured to select, by the network analysis process according to the first network environment parameter, a first display parameter that matches a network environment corresponding to the video data interaction between the remote terminal and the remote terminal, and send the first display parameter to the remote terminal;

a video data transmission module 503, configured to receive, through a service process, video data corresponding to the first display parameter and sent by the remote terminal, and send the video data to the remote terminal according to the first display parameter.

In an alternative embodiment, further comprising:

In an optional embodiment, the first network environment parameter includes a first network bandwidth value, and the display parameter determining module 502 is specifically configured to:

In an optional embodiment, the display parameter includes at least one of a resolution, a frame rate, and a code rate corresponding to the video data.

In an optional embodiment, the network parameter obtaining module 501 is specifically configured to:

In an alternative embodiment, the apparatus further comprises:

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

In addition, an embodiment of the present invention further provides an electronic device, including: the processor, the memory, and the computer program stored in the memory and capable of running on the processor, when being executed by the processor, implement each process of the processing method embodiment of the video conference, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the embodiment of the processing method for a video conference, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

Fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention.

The electronic device 600 includes, but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, a processor 610, and a power supply 611. It will be understood by those skilled in the art that the electronic device configurations involved in the embodiments of the present invention are not intended to be limiting, and that an electronic device may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 601 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 610; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 601 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio frequency unit 601 may also communicate with a network and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 602, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 603 may convert audio data received by the radio frequency unit 601 or the network module 602 or stored in the memory 609 into an audio signal and output as sound. Also, the audio output unit 603 may also provide audio output related to a specific function performed by the electronic apparatus 600 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 603 includes a speaker, a buzzer, a receiver, and the like.

The input unit 604 is used to receive audio or video signals. The input Unit 604 may include a Graphics Processing Unit (GPU) 6041 and a microphone 6042, and the Graphics processor 6041 processes image data of a still picture or video obtained by an image capturing apparatus (such as a camera) in a video capture mode or an image capture mode. The processed image frames may be displayed on the display unit 606. The image frames processed by the graphic processor 6041 may be stored in the memory 609 (or other storage medium) or transmitted via the radio frequency unit 601 or the network module 602. The microphone 6042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 601 in case of the phone call mode.

The electronic device 600 also includes at least one sensor 605, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 6061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 6061 and/or the backlight when the electronic apparatus 600 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 605 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 606 is used to display information input by the user or information provided to the user. The Display unit 606 may include a Display panel 6061, and the Display panel 6061 may be configured by a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 607 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 607 includes a touch panel 6071 and other input devices 6072. Touch panel 6071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 6071 using a finger, stylus, or any suitable object or accessory). The touch panel 6071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 610, receives a command from the processor 610, and executes the command. In addition, the touch panel 6071 can be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The user input unit 607 may include other input devices 6072 in addition to the touch panel 6071. Specifically, the other input devices 6072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a track ball, a mouse, and a joystick, which are not described herein again.

Further, the touch panel 6071 can be overlaid on the display panel 6061, and when the touch panel 6071 detects a touch operation thereon or nearby, the touch operation can be transmitted to the processor 610 to determine the type of the touch event, and then the processor 610 can provide a corresponding visual output on the display panel 6061 according to the type of the touch event. It is understood that in one embodiment, the touch panel 6071 and the display panel 6061 are two independent components to realize the input and output functions of the electronic device, but in some embodiments, the touch panel 6071 and the display panel 6061 may be integrated to realize the input and output functions of the electronic device, and are not limited herein.

The interface unit 608 is an interface for connecting an external device to the electronic apparatus 600. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 608 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic device 600 or may be used to transmit data between the electronic device 600 and external devices.

The memory 609 may be used to store software programs as well as various data. The memory 609 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 609 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 610 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 609, and calling data stored in the memory 609, thereby performing overall monitoring of the electronic device. Processor 610 may include one or more processing units; preferably, the processor 610 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 610.

The electronic device 600 may further include a power supply 611 (e.g., a battery) for supplying power to the various components, and preferably, the power supply 611 may be logically connected to the processor 610 via a power management system, such that the power management system may be used to manage charging, discharging, and power consumption.

In addition, the electronic device 600 includes some functional modules that are not shown, and are not described in detail here.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part thereof which substantially contributes to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A method for processing a video conference, comprising:

and receiving video data which is sent by the far-end terminal and corresponds to the first display parameter through a service process, and sending the video data to the far-end terminal according to the first display parameter.

2. The method of claim 1, further comprising:

receiving a second display parameter sent by the remote terminal through the network analysis process, wherein the second display parameter is a display parameter which is selected by the remote terminal according to a second network environment parameter corresponding to the video data interaction with a local terminal and is matched with a corresponding network environment when the video data interaction is carried out with the local terminal;

3. The method of claim 2, further comprising:

4. The method according to claim 1, 2 or 3, wherein the first network environment parameter includes a first network bandwidth value, and the selecting, by the network analysis process according to the network environment parameter, a first display parameter that matches a corresponding network environment when video data interaction is performed between the remote terminals includes:

5. The method of claim 4, wherein the display parameter comprises at least one of a resolution, a frame rate, and a code rate corresponding to the video data.

6. The method of claim 1, wherein the obtaining, by the network analysis process, the first network environment parameter sent by the network analyzer comprises:

7. The method of claim 1, wherein before the obtaining, by the network analysis process, the first network environment parameter sent by the network analyzer, the method further comprises:

and responding to the service process to receive the video conference instruction, starting the conference entering service, receiving the video data sent by the far-end terminal through the service process, and sending the video data to the far-end terminal.

8. A video conference processing apparatus, comprising:

the system comprises a network parameter acquisition module, a network analysis module and a remote terminal, wherein the network parameter acquisition module is used for acquiring a first network environment parameter sent by a network analyzer through a network analysis process, and the first network environment parameter is a parameter corresponding to a network environment when video data interaction is carried out with the remote terminal;

9. An electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

the memory is used for storing a computer program;

the processor, when executing a program stored on the memory, implementing the method of any of claims 1-7.

10. A computer-readable storage medium having stored thereon instructions, which when executed by one or more processors, cause the processors to perform the method of any one of claims 1-7.