CN108347580B - Method for processing video frame data and electronic equipment - Google Patents
Method for processing video frame data and electronic equipment Download PDFInfo
- Publication number
- CN108347580B CN108347580B CN201810260406.1A CN201810260406A CN108347580B CN 108347580 B CN108347580 B CN 108347580B CN 201810260406 A CN201810260406 A CN 201810260406A CN 108347580 B CN108347580 B CN 108347580B
- Authority
- CN
- China
- Prior art keywords
- data
- video frame
- electronic device
- time
- frame data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method for processing video frame data and electronic equipment, which are used for solving the technical problem of picture blockage caused by time delay during conversation among video conversation equipment with different video frame data processing capabilities in the prior art. The method comprises the following steps: acquiring current video frame data according to the rate of a target frame frequency, and acquiring first acquisition time for starting to acquire the current video frame data; the target frame frequency is a frame frequency supported by the lowest rate of processing video frame data in the first electronic equipment and the at least one second electronic equipment, and the data are processed according to the processing speed of the target frame frequency; calculating a first time difference based on the first acquisition time and a start time for starting encoding of previous video frame data; judging whether the first time difference is greater than the processing time length corresponding to the target frame frequency; and if so, encoding the current video frame data and transmitting the encoded current video frame data to at least one second electronic device.
Description
Technical Field
The present invention relates to the field of video calls, and in particular, to a method and an electronic device for processing video frame data.
Background
As video calls are increasingly used in people's lives, some of the drawbacks of video calls are gradually revealed.
For example, when hardware performance of communication devices used by both video communication parties is greatly different, a large delay exists, and thus user experience is reduced. For example, when a mobile phone user and a television user perform a video call, the video call is delayed due to different processing capabilities of the mobile phone user and the television user on video frame data, and this appears to the user as a video picture having a pause phenomenon.
At present, a common solution for solving such problems in the industry is to increase the hardware performance of the telephony device, for example, by adding a peripheral device to improve the video frame data processing capability of the telephony device, so as to solve the aforementioned latency problem, but increase the hardware cost, and this approach still requires that the telephony devices of both parties of the call have the same or similar video frame data processing capability.
However, for those call devices of both parties with large difference in video frame data processing capability, the above technical problems still exist when one party adopts a hardware encoding and decoding mode and the other party adopts a software encoding and decoding mode to perform video call.
Therefore, how to effectively reduce the phenomenon of picture blockage caused by more delay in the call between video call devices with different video frame data processing capabilities without increasing the hardware cost becomes a technical problem to be solved urgently.
Disclosure of Invention
The invention provides a method for processing video frame data and electronic equipment, which are used for solving the technical problem of picture blockage caused by time delay when a call is carried out between video call equipment with different video frame data processing capabilities in the prior art.
In a first aspect, to solve the above technical problem, an embodiment of the present invention provides a method for processing video frame data, which is applied to a first electronic device, and adopts the following technical solutions:
acquiring current video frame data according to the rate of a target frame frequency, and acquiring first acquisition time for starting to acquire the current video frame data; the target frame frequency is a frame frequency supported by the lowest rate of processing video frame data in the first electronic equipment and the at least one second electronic equipment; the first electronic equipment and the at least one second electronic equipment process data according to the processing speed of the target frame frequency;
calculating a first time difference based on the first acquisition time and a start time for starting encoding of previous video frame data;
judging whether the first time difference is greater than the processing time length corresponding to the target frame frequency; and if so, encoding the current video frame data through the encoder, and sending the encoded data to the at least one second electronic device.
The processing speed of the video frame data is kept consistent by the first electronic device and the at least one second electronic device in the process of video call, namely, the minimum frame rate (namely, the target frame rate) of the frame rates of the image collector, the encoder and the decoder in the first electronic device and the at least one second electronic device is kept consistent, so that the electronic device with higher data processing capacity is adapted to the electronic device with lower data processing capacity, data accumulation is avoided in the processing process, the time delay of each party of the video call can be effectively reduced, and the generation of a pause phenomenon is avoided.
Optionally, the calculation method of the target frame rate includes:
performing the following operations for each video frame data in the preset number of video frame data:
acquiring a first frame frequency of an image acquirer of the first electronic device based on the acquisition time of each video frame data; wherein the first frame frequency is inversely proportional to a difference between the acquisition time of each video frame data and the acquisition time of the previous video frame adjacent to the video frame data;
calculating the coding duration of each video frame data based on the starting time and the ending time of each video frame data to obtain a second frame frequency; wherein the end time is a time at which encoding of the each video frame data by the encoder is completed; the second frame frequency is inversely proportional to the encoding duration;
obtaining at least one third frame rate from the at least one second electronic device; wherein the third frame frequency is inversely proportional to a time length used by a decoder of the second electronic device to decode the encoded data corresponding to each video frame data;
calculating the frame rates of the image collector, the encoder and the at least one decoder through a preset algorithm based on the first frame rate, the second frame rate and the at least one third frame rate of each video frame data in the preset number of video frame data;
selecting a minimum frame rate from frame rates of the image collector, the encoder and a decoder of the at least one second electronic device as the target frame rate.
Optionally, the preset algorithm specifically includes:
an averaging algorithm, or a low-pass filtering algorithm, is used.
Optionally, the method further includes:
repeatedly calculating the target frame frequency according to a preset time interval in the process of carrying out video call between the first electronic equipment and the at least one second electronic equipment to obtain a new target frame frequency;
updating the target frame rate being used based on the new target frame rate.
In the process of video call, the electronic equipment of each party of call repeatedly calculates and updates the target frame frequency in use according to the preset time interval, so that the first electronic equipment and each second electronic equipment can automatically adapt to the actual processing capacity of the electronic equipment with relatively low data processing capacity to the video frame data, and the possible time delay is further reduced.
In a second aspect, an embodiment of the present invention provides a method for processing video frame data, which is applied to a second electronic device, and includes:
receiving encoded data sent by first electronic equipment;
the decoder of the second electronic device decodes the encoded data according to the processing speed of the target frame frequency to obtain decoded current video front frame data; the target frame frequency is received by the second electronic device from the first electronic device, and is a frame frequency supported by the first electronic device from the first electronic device and at least one second electronic device, wherein the lowest rate of processing video frame data is selected by the first electronic device;
and displaying the current video frame data on a display unit of the second electronic equipment.
Because the second electronic device processes data according to the processing speed corresponding to the frame frequency (namely the target frame frequency) supported by the selected lowest rate for processing the video frame data in the first electronic device and the second electronic device, the delay can be effectively reduced and the pause phenomenon can be avoided in the process of carrying out video call between the first electronic device and the second electronic device.
Optionally, before the second electronic device receives the target frame data, the method further includes:
performing the following operations on each encoded data of the received preset number of encoded data:
calculating the decoding duration of each coded data based on the starting time and the ending time of each coded data to obtain a third frame frequency; wherein the end time is the time for completing the encoding of each encoded data by the decoder of the two electronic devices;
and sending the third frame frequency to the first electronic equipment.
In a third aspect, an embodiment of the present invention further provides a first electronic device for processing video frame data, including:
the acquisition unit is used for acquiring current video frame data according to the rate of a target frame frequency and acquiring first acquisition time for starting to acquire the current video frame data; the target frame frequency is a frame frequency supported by the lowest rate of processing video frame data in the first electronic equipment and the at least one second electronic equipment; the first electronic equipment and the at least one second electronic equipment process data according to the processing speed of the target frame frequency;
a calculating unit, configured to calculate a first time difference based on the first acquisition time and a start time for starting encoding of previous video frame data;
the judging unit is used for judging whether the first time difference is larger than the processing time length corresponding to the target frame frequency;
and the processing unit is used for encoding the current video frame data through the encoder and sending the encoded data to at least one second electronic device when the first time difference is larger than the processing time duration corresponding to the target frame frequency.
Optionally, when calculating the target frame rate, the calculating unit is further configured to:
performing the following operations for each video frame data in the preset number of video frame data:
acquiring a first frame frequency of an image acquirer of the first electronic device based on the acquisition time of each video frame data; wherein the first frame frequency is inversely proportional to a difference between the acquisition time of each video frame data and the acquisition time of the previous video frame adjacent to the video frame data;
calculating the coding duration of each video frame data based on the starting time and the ending time of each video frame data to obtain a second frame frequency; wherein the end time is a time at which encoding of the each video frame data by the encoder is completed; the second frame frequency is inversely proportional to the encoding duration;
obtaining at least one third frame rate from the at least one second electronic device; wherein the third frame frequency is inversely proportional to a time length used by a decoder of the second electronic device to decode the encoded data corresponding to each video frame data;
calculating frame rates of the image collector, the encoder and the decoder of the at least one second electronic device through a preset algorithm based on the first frame rate, the second frame rate and the at least one third frame rate of each video frame data in the preset number of video frame data;
selecting a minimum frame rate from frame rates of the image collector, the encoder and a decoder of the at least one second electronic device as the target frame rate.
Optionally, the computing unit is further configured to:
repeatedly calculating the target frame frequency according to a preset time interval in the process of carrying out video call between the first electronic equipment and the at least one second electronic equipment to obtain a new target frame frequency;
updating a target frame rate being used by the first electronic device based on the new target frame rate.
In a fourth aspect, an embodiment of the present invention further provides a second electronic device for processing video frame data, including:
the receiving unit is used for receiving the coded data sent by the first electronic equipment;
the decoding unit is used for decoding the coded data according to the processing speed of the target frame frequency to obtain the decoded current video frame data; wherein the target frame rate is received from the first electronic device and is a frame rate supported by the first electronic device from the first electronic device and at least one second electronic device at the lowest rate of processing video frame data;
and the display unit is used for displaying the current video frame data.
Optionally, before receiving the target frame data, the second electronic device further includes:
a processing unit, configured to perform the following operations on each encoded data of the received preset number of encoded data:
calculating the decoding duration of each coded data based on the starting time and the ending time of each coded data to obtain a third frame frequency; wherein the end time is the time for completing the encoding of each encoded data by the decoder of the two electronic devices;
and transmitting the third frame frequency to the first electronic equipment through a transmitting unit.
Through the technical solutions in one or more of the above embodiments of the present invention, the embodiments of the present invention have at least the following technical effects:
in the embodiment provided by the invention, the processing speeds of the video frame data are kept consistent by the first electronic device and the at least one second electronic device in the process of video call, that is, the minimum frame rate (that is, the target frame rate) of the frame rates of the image collector, the encoder and the decoder in the first electronic device and each second electronic device is kept consistent, and the speed of the image collector collecting the video frame data, the encoding speed of the encoder and the decoding speed of the decoder are respectively reflected by the frame rates, the encoder and the decoder, so that the electronic device with higher data processing capability is adapted to the electronic device with lower data processing capability, data is not accumulated in the processing process, the time delay of each party of the video call can be effectively reduced, and the occurrence of the pause phenomenon is avoided.
Furthermore, in the process of video call, each electronic device performing video call repeatedly calculates and updates the target frame frequency being used according to a preset time interval, so that the electronic device performing video call can automatically adapt to the actual processing capacity of each electronic device on video frame data, further reduce the possible time delay, ensure the fluency of both parties of call, and avoid the occurrence of pause phenomenon.
Drawings
Fig. 1 is a flowchart illustrating a method for processing video frame data according to an embodiment of the present invention;
FIG. 2 is a flow chart of another embodiment of the present invention for processing video frame data;
fig. 3 is a schematic structural diagram of a first electronic device according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a second electronic device according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a method for processing video frame data and electronic equipment, and aims to solve the technical problem that in the prior art, when conversation is carried out between video conversation equipment with different video frame data processing capabilities, time delay exists, and therefore a picture is blocked.
In order to solve the technical problems, the general idea of the embodiment of the present application is as follows:
there is provided a method of processing video frame data, comprising: acquiring current video frame data according to the rate of the target frame frequency, and acquiring first acquisition time for starting to acquire the current video frame data; the target frame frequency is a frame frequency supported by the lowest rate of processing video frame data in the first electronic equipment and the at least one second electronic equipment; the first electronic equipment and the at least one second electronic equipment process data according to the processing speed of the target frame frequency; calculating a first time difference based on the first acquisition time and the starting time for starting encoding of the previous video frame data; judging whether the first time difference is greater than the processing time length corresponding to the target frame frequency; and if so, encoding the current video frame data through the encoder, and transmitting the encoded data to all the second electronic equipment.
In the above scheme, the first electronic device and the at least one second electronic device determine a target frame frequency according to a frame frequency supported by the lowest processing rate of video frame data among the first electronic device and the at least one second electronic device, and control the processing speed of data according to the target frame frequency, so that when the first electronic device acquires current video frame data, the first electronic device acquires first acquisition time for starting to acquire the current video frame data, and then calculates a first time difference based on the first acquisition time and starting time for starting encoding of the previous video frame data, and determines whether the first time difference is greater than a processing duration corresponding to the target frame frequency; (ii) a And if so, encoding the current video frame data through the encoder, and transmitting the encoded data to each second electronic device. By the method, the processing rates of the first electronic equipment and all the second electronic equipment to the video frame data can be kept consistent, data accumulation can not be caused, the time delay of the video frame data can be effectively reduced, and the video picture can be prevented from being blocked.
In order to better understand the technical solutions of the present invention, the following detailed descriptions of the technical solutions of the present invention are provided with the accompanying drawings and the specific embodiments, and it should be understood that the specific features in the embodiments and the examples of the present invention are the detailed descriptions of the technical solutions of the present invention, and are not limitations of the technical solutions of the present invention, and the technical features in the embodiments and the examples of the present invention may be combined with each other without conflict.
Referring to fig. 1, an embodiment of the invention provides a method for processing video frame data, which comprises the following processing procedures.
When user a can make a video call with one or more users, such as: in the embodiment provided by the present invention, a video call device used by an inviter initiating a video call is defined as a first electronic device, and a video call device used by an invitee accepting an invitation is defined as a second electronic device. When there are a plurality of invitees, the electronic devices used by the invitees may be electronic devices of the same type and the same performance, or electronic devices of different types and different performances.
In the process of carrying out video call between the inviter and the invitee, the first electronic equipment and the at least one second electronic equipment process video frame data according to the rate of the target frame frequency. And the target frame rate is a frame rate supported by the lowest rate of processing the video frame data in the first electronic device and the at least one second electronic device, and the processing the video frame data at least comprises acquiring the video frame data, encoding the video frame data, and decoding the encoded video frame data.
It should be understood that the frame rate supported by the lowest rate described herein may be a frame rate range that does not affect the normal video call after combining the lowest processing rate of the electronic device on the video frame data and the picture definition. When the at least one second electronic device is more than 2 second electronic devices, the plurality of second electronic devices may be the same or different. For example, there are 2 second electronic devices, which may all be mobile phones, one may be a mobile phone, one may be a smart tv capable of performing a video call, or two different mobile phones, smart tvs, or IPADs.
For example, taking a first electronic device communicating with a second electronic device as an example, a user a uses a mobile phone as the first electronic device to conduct a video call with a user B who uses a television (supporting a video call) as the second electronic device. The hardware performance of the mobile phone is higher than that of the television, for example, the mobile phone integrates a camera and adopts hard coding and hard decoding for coding and decoding, the television adopts an external camera, and the coding and decoding adopt soft coding and soft decoding.
Assume that both the handset and the television are processing video frame data at the rate of the target frame rate 50 during the call. Then, in the process of performing a video call with the user B, taking the case that the mobile phone acquires video data and displays the video data on the screen of the television as an example, the camera of the mobile phone acquires current video frame data at a frame rate of 50, and records the acquisition time of the current video frame data, that is, the first acquisition time is 9: 22.
Taking the example of a first electronic device communicating with a plurality (e.g., 2) of second electronic devices, user a uses a cell phone as the first electronic device to conduct a video call with user B, C as the second electronic device. The hardware performance of the mobile phone is higher than that of the television, the second electronic device used by the user B is the television capable of carrying out video call, and the second electronic device used by the user C is the mobile phone with the performance higher than that of the user A.
Assume that both the handset and the television are processing video frame data at the rate of the target frame rate 60 during the call. Then, during the video call with the user B, C, taking the example that the mobile phone captures video data and displays the video data on the screen of the television, the camera of the mobile phone captures current video frame data at a frame rate of 60, and records the capture time of the current video frame data, i.e. the first capture time is 10: 15.
When the first electronic device initiates a call, it is further required to calculate a value of the target frame frequency first, and the specific calculation method is as follows:
performing the following operations for each video frame data in the preset number of video frame data:
firstly, acquiring a first frame frequency of an image collector of first electronic equipment based on the acquisition time of each video frame data; the first frame frequency is inversely proportional to the difference between the acquisition time of each video frame data and the acquisition time of the adjacent previous video frame.
Secondly, calculating the coding duration of each video frame data based on the starting time and the finishing time of each video frame data to obtain a second frame frequency; wherein, the completion time is the time for completing the coding of each video frame data through the coder; the second frame frequency is inversely proportional to the coding duration;
finally, obtaining at least one third frame rate from at least one second electronic device; the third frame frequency is inversely proportional to a time length used by a decoder of the second electronic device to decode the encoded data corresponding to each video frame data.
After the first frame frequency, the second frame frequency and the at least one third frame frequency of all the video frame data in the preset number of video frame data are obtained, calculating the frame frequencies of an image collector, an encoder and a decoder of at least one second electronic device through a preset algorithm; and selecting the minimum frame frequency from the frame frequencies of the image collector, the encoder and the decoder of the at least one second electronic device as a target frame frequency.
It should be understood that the number of the third frame rate and the number of the decoders correspond to the number of the second electronic devices, for example, if the first electronic device and 3 second electronic devices are in a video call, the first electronic device obtains the corresponding third frame rate from the 3 electronic devices, that is, the first electronic device obtains 3 third frame rates; since each second electronic device has a decoder, when calculating the frame rate of the decoder, the frame rates of the decoders of the 3 second electronic devices are correspondingly calculated, that is, the first electronic device obtains the frame rates of the 3 decoders in total.
Still taking the foregoing example as an example, when the first electronic device mobile phone initiates a call to a second electronic device television, the collected preset number of video frame data is used as the sampling data for calculating the target frame rate. Still take the example that the mobile phone collects the video frame to display on the screen of the television.
Assuming that the preset number is 10, the mobile phone and the television set use the first 10 frames of video frame data as sampling data, and the acquisition time of the 10 frames of video frame data acquired by the camera of the mobile phone is 9:22:01:000, 9:22:01:001, 9:22:01:002, 9:22:01:003, 9:22:01:004, 9:22:01:005, 9:22:01:006, 9:22:01:007, 9:22:01:008, and 9:22:01:009 in sequence.
The difference of the acquisition time of two adjacent frames of video frame data can be calculated to be 1 ms. Since the frame rate is inversely proportional to the difference between the acquisition times, it can be calculated that the first frame rates are both 100. The performance of the camera (i.e. the image collector) can be reflected by the first frame frequency.
If the first electronic equipment mobile phone is in video call with a plurality of second electronic equipment, the process of calculating the first frame frequency is the same as the process.
After each frame of video frame data is collected by the camera, the video frame data is sent to an encoder of the mobile phone for encoding, the video frame data is converted from a first data format into a second data format, and then the video frame data is converted from the second data format into a third data format (such as a UDP data message) through a communication application in the mobile phone so as to be sent to the second electronic equipment television through the network (if the first electronic equipment is in conversation with a plurality of second electronic equipment, the video data with the third data format is sent to the plurality of second electronic equipment).
In the encoding process, the mobile phone records the start time of encoding start and the end time of encoding end of each video frame data, calculates the difference between the end time and the start time, and further obtains the encoding duration of each video frame data, and then calculates the second frame frequency of each corresponding video frame data according to the encoding duration, assuming that the second frame frequency is 60. Thus, the performance of the encoder of the handset (i.e., the first electronic device) is reflected by the second frame frequency of the 10 frames of video frame data.
After the mobile phone (first electronic device) transmits the corresponding video frame data to the television (second electronic device), the second electronic device performs format conversion on the received video frame data with the third data format, and converts the video frame data into the second data format.
For example, each video frame data in the third data format is encapsulated into 3 data packets according to the communication protocol used, and after the television (second electronic device) receives the 3 data packets, the 3 data packets are assembled into one data, that is, each video frame data in the second data format is correspondingly formed.
Then, the television (second electronic device) decodes each video frame data with the second data format into corresponding each video frame data with the first data format through the software decoder, and sends each decoded video frame data to the display of the television for displaying.
In the process of decoding each video frame data by a decoder of the television, the start time of starting decoding and the end time of ending decoding of each video frame data are recorded, the difference value between the end time and the start time is calculated, the decoding time length of each video frame data is further obtained, then the third frame frequency of each corresponding video frame data is calculated through the decoding time length, and the third frame frequency is assumed to be 50, and then the third frame frequency is sent to the first electronic equipment mobile phone. Thus, the performance of the decoder of the television (i.e., the second electronic device) can be reflected by the third frequency of the 10 frames of video frame data.
Due to the adoption of the mode, the first frame frequency, the second frame frequency and the third frame frequency of 10 video frame data, which are all 100, 60 and 50, can be obtained by the first electronic equipment mobile phone. Then calculating the frame rate of the image collector, the encoder and the decoder by a preset algorithm (such as an average value algorithm or a low-pass filtering algorithm); and selecting the minimum frame frequency from the frame frequencies of the image collector, the encoder and the decoder as a target frame frequency.
Assuming that the preset algorithm is an average algorithm, the frame rates of the collector, the encoder and the decoder can be calculated to be 100, 60 and 50 in sequence, and then the minimum frame rate (i.e. the frame rate 50 of the decoder) is selected from the frame rates as the target frame rate.
Then, the first electronic device handset and the second electronic device television both adopt the target frame rate 50 to acquire, encode, and decode the current video frame data.
It should be understood that, a process of acquiring video data by the second electronic device and sending the video data to the first electronic device for displaying is also similar to the above-mentioned process of acquiring video data by the first electronic device and sending the video data to the second electronic device for displaying, and is not described herein again.
For the case where a first electronic device communicates with a plurality of second electronic devices, the process is similar to the above process except that: the target frame rate is determined by comparing the first electronic device with the supported frame rates of all the second electronic devices, taking the smallest frame rate as the target frame rate, and transmitting the video data to the plurality of second electronic devices when the first electronic device transmits the video data to the second electronic devices. For economy of disclosure, further description of such a case is omitted.
Since the actual processing capacities of the first electronic device and the at least one second electronic device for the video frame data are different, step 102 and step 104 are required to be executed in order for the first electronic device and the at least one second electronic device to process the current video frame data at the processing speed of the target frame rate.
Step 102: the first time difference is calculated based on the first acquisition time and a start time at which encoding of previous video frame data is started.
Still taking the foregoing example as an example, assume that the first electronic device starts capturing the current video frame data at 9:23:10:008, and records that the first capturing time of the current video frame is 9:23:10:008, and the starting time of the encoding start of the previous video frame adjacent to the current video frame is 9:23:10:006, 9:23:10:008-9:23:10:006 is 2ms, that is, the first time difference is 2 ms.
After the first time difference is calculated, step 103 and step 104 may be performed.
Step 103: and judging whether the first time difference is greater than the processing time length corresponding to the target frame frequency.
Step 104: if so, encoding the current video frame data through the encoder, and sending the encoded data to at least one second electronic device.
Still taking the previous example as an example, since the target frame frequency is 25, the corresponding processing time duration is 1/25 ═ 4ms, and it is determined whether the first time difference 2ms is greater than the processing time duration 4ms, and the obtained first time difference is less than the time duration corresponding to the target frame frequency, at this time, the first electronic device mobile phone discards the current video frame data and waits for the next video frame.
And if the first time difference is greater than the duration corresponding to the target frame frequency, encoding the current video frame data through an encoder of the first electronic equipment, and sending the encoded data to at least one second electronic equipment for processing.
By the method, the processing speed of the video frame data can be kept consistent with that of the video frame data in the process of carrying out the video call by the first electronic equipment and the at least one second electronic equipment, namely the processing speed of the video frame data is kept consistent with that of the minimum frame rate of the image collector, the frame rate of the encoder and the frame rate of the decoder (namely the target frame rate).
Further, because the processor of the electronic device fluctuates during the video call, for example, at least one second electronic device that encodes and decodes the video frame data by using soft encoding and soft decoding, since the encoding and decoding are actually performed by the processor, the processor needs to process other services, such as playing a television program, recording a television program, and the like, which will cause different usage rates of the processor at different times, thereby affecting the encoding and decoding speeds, if the target frame rate cannot be adjusted in time when the processing capability of the processor on the video frame data is reduced, the video call will also be stuck.
Therefore, in the process of carrying out video call between the first electronic equipment and at least one second electronic equipment, the target frame frequency is required to be repeatedly calculated according to a preset time interval to obtain a new target frame frequency; and updates the target frame rate being used based on the new target frame rate. The calculation method of the repeated and timely target frame frequency is the same as the previous calculation method, and is not described herein again.
Still taking the previous example as an example, assuming that the target frame rate currently being used at 9:25:15 is 50 and the preset time interval is 30s, it is assumed that the next timing period starts from 9:25: 15. The time 9:25:25 of the reserved program recording in the second electronic equipment television also arrives at this time, so that the second electronic equipment television needs to keep communicating with the first electronic equipment mobile phone and also needs to record the reserved television program, the occupation rate of a CPU of the second electronic equipment television is increased, and the processing capacity of the second electronic equipment television on video frame data is reduced.
When the timing time is reached in a ratio of 9:25:55, the first electronic device recalculates the target frame rate according to the method for calculating the target frame rate to obtain a new target frame rate of 30, then updates the target frame rate being used according to the new target frame rate 30, and enables the first electronic device and the second electronic device to process the video frame data at the speed of the updated target frame rate 30.
By the method, the electronic equipment of the two parties carrying out the video call can automatically adapt to the actual processing capacity of the electronic equipment of each party on the video frame data, the possible time delay is further reduced, the fluency of each party of the call is ensured, and the phenomenon of pause is avoided.
It should be understood that, the update target frame rate not only needs to update the target frame rate used by the first electronic device, but also needs to update the target frame rate used by at least one second electronic device at the same time, and the update method may be that the first electronic device sends a new target frame rate to at least one second electronic device for updating, or each second electronic device calculates itself according to the method for calculating the target frame rate and then updates, so that the update method is not limited herein. And when the second electronic device is used as a video frame data collector and sends the collected video frame data to the first electronic device for display, the processing mode is the same as the processing mode, and details are not repeated here.
By the method, the processing mode of the current video frame data in the first electronic equipment when the first electronic equipment is used as a video frame data acquisition party (also an inviting party of video call) can be known; however, after the first electronic device transmits the current video frame data with the third data format to the at least one second electronic device, please refer to the following embodiments.
Referring to fig. 2, another method for processing video frame data is provided, which is applied to a second electronic device and processes the following steps.
Step 201: receiving encoded data sent by first electronic equipment;
step 202: a decoder of the second electronic device decodes the encoded data according to the processing speed of the target frame frequency to obtain decoded current video frame data; the target frame frequency is received by the second electronic equipment from the first electronic equipment and is the frame frequency supported by the lowest rate of processing video frame data selected by the first electronic equipment from the first electronic equipment and at least one second electronic equipment;
step 203: and displaying the current video frame data on a display unit of the second electronic equipment.
As described above, after the first electronic device acquires the video frame data, the first electronic device needs to encode the video frame data to obtain video frame data with a second data format, and then convert the video frame data into video frame data with a third data format to send to at least one second electronic device.
Therefore, after receiving the video frame data with the third data format, the second electronic device needs to convert the video frame data into video frame data with the second data format, so as to obtain the data encoded by the first electronic device.
Then, the decoder of the second electronic device decodes the encoded data according to the processing speed of the target frame frequency to obtain decoded current video frame data (having the first data format), and finally displays the front video frame data on the display unit of the second electronic device.
For example, still taking the previous example as an example, the second electronic device television receives current video frame data having 3 packets from the first electronic device, converts the current video frame data into encoded data (i.e. the current video frame data having the second data format) according to the third data format, decodes the encoded data by the software decoder of the second electronic device to obtain the current video frame data (having the first data format), and displays the current video frame data on the display of the second electronic device television. Therefore, the video frame data collected by the mobile phone of the first electronic equipment can be displayed on the display of the television of the second electronic equipment.
It should be understood that, when the second electronic device serves as a video frame data capturing party and displays the captured video frame data on the first electronic device, the process of processing the video frame data encoded by the second electronic device on the first electronic device is similar to the above method, and is not described herein again.
Since the first electronic device needs to calculate the target frame rate before the second electronic device receives the target frame data, when the second electronic device needs to calculate the target frame rate, the decoder processes a preset number of video frame data, specifically:
performing the following operations on each encoded data of the received preset number of encoded data:
calculating the decoding duration of each coded data based on the starting time and the ending time of each coded data to obtain a third frame frequency; wherein, the end time is the time for completing the coding of each coded data by the decoders of the two electronic devices; and sending the third frame frequency to the first electronic equipment.
Still taking the foregoing example as an example, when the first electronic device needs to calculate the target frame rate at a conversation place or during a conversation with the second electronic device, the second electronic device records a start time (for example, 9:23:05:10) for starting decoding and an end time (for example, 9:23:05:14) for ending decoding when decoding each encoded data, and further calculates a decoding duration to be 4ms according to the end time and the start time to obtain a third frame rate 1/4 to be 25, and then sends the third frame rate 25 to the first electronic device, so that the first electronic device performs statistics and calculation on a preset number of third frame rates to obtain a frame rate of a decoder in the second electronic device, and further calculates the target frame rate.
After the first electronic device calculates the target frame rate, it sends it to at least one second electronic device, and the second electronic device can adjust the target frame rate it is using according to the received target frame rate.
It should be understood that the two methods for processing video frame data described above can be applied to the same electronic device at the same time, i.e. the first electronic device and the second electronic device can use the two methods at the same time. Therefore, when the user uses the electronic equipment to carry out video call, the user not only needs to collect the video data of the user and send the video data to the other party, but also needs to display the video data sent by the other party on the electronic equipment of the user.
Based on the same inventive concept, an embodiment of the present invention provides a first electronic device for processing video frame data, where a specific implementation manner of a method for processing video frame data by the first electronic device may refer to the description in the method embodiment section, and repeated details are not repeated, referring to fig. 3, where the first electronic device includes:
the acquisition unit 301 is configured to acquire current video frame data at a rate of a target frame frequency and acquire a first acquisition time for starting acquisition of the current video frame data; the target frame frequency is a frame frequency supported by the lowest rate of processing video frame data in the first electronic equipment and the at least one second electronic equipment; the first electronic equipment and the at least one second electronic equipment process data according to the processing speed of the target frame frequency;
a calculating unit 302, configured to calculate a first time difference based on the first acquisition time and a start time for starting encoding of previous video frame data;
a judging unit 303, configured to judge whether the first time difference is greater than a processing time corresponding to a target frame frequency;
a processing unit 304, configured to encode, by the encoder, the current video frame data when the first time difference is greater than a processing time duration corresponding to a target frame rate, and send the encoded data to the at least one second electronic device.
Optionally, when calculating the target frame rate, the calculating unit 302 is further configured to:
performing the following operations for each video frame data in the preset number of video frame data:
acquiring a first frame frequency of an image acquirer of the first electronic device based on the acquisition time of each video frame data; wherein the first frame frequency is inversely proportional to a difference between the acquisition time of each video frame data and the acquisition time of the previous video frame adjacent to the video frame data;
calculating the coding duration of each video frame data based on the starting time and the ending time of each video frame data to obtain a second frame frequency; wherein the end time is a time at which encoding of the each video frame data by the encoder is completed; the second frame frequency is inversely proportional to the encoding duration;
obtaining at least one third frame rate from the at least one second electronic device; wherein the third frame frequency is inversely proportional to a time length used by a decoder of the second electronic device to decode the encoded data corresponding to each video frame data;
calculating frame frequencies of the image collector, the encoder and a decoder of the at least one second electronic device through a preset algorithm based on a first frame frequency, a second frame frequency and at least one third frame frequency of all the video frame data in the preset number of video frame data;
selecting a minimum frame rate from frame rates of the image collector, the encoder and a decoder of the at least one second electronic device as the target frame rate.
Optionally, the computing unit 302 is further configured to:
repeatedly calculating the target frame frequency according to a preset time interval in the process of carrying out video call between the first electronic equipment and the at least one second electronic equipment to obtain a new target frame frequency;
updating a target frame rate being used by the first electronic device based on the new target frame rate.
Based on the same inventive concept, an embodiment of the present invention provides a second electronic device for processing video frame data, where a specific implementation manner of a method for processing video frame data by the second electronic device may refer to the description of the corresponding method embodiment section, and repeated details are not repeated, referring to fig. 4, where the second electronic device includes:
a receiving unit 401, configured to receive encoded data sent by a first electronic device;
a decoding unit 402, configured to decode the encoded data according to a processing speed of a target frame frequency, to obtain decoded current video frame data; wherein the target frame rate is received from the first electronic device and is a frame rate supported by the first electronic device from the first electronic device and at least one second electronic device at the lowest rate of processing video frame data;
a display unit 403, configured to display the current video frame data.
Optionally, before receiving the target frame data, the second electronic device further includes:
a processing unit 404, configured to perform the following operations on each encoded data in the received preset number of encoded data:
calculating the decoding duration of each coded data based on the starting time and the ending time of each coded data to obtain a third frame frequency; wherein the end time is the time for completing the encoding of each encoded data by the decoder of the two electronic devices;
the third frame rate is transmitted to the first electronic device through the transmitting unit 405.
In the embodiment provided by the invention, the processing speeds of the video frame data are kept consistent by the first electronic device and the at least one second electronic device in the process of carrying out the video call, that is, the minimum frame rate (that is, the target frame rate) of the frame rates of the image collectors, the encoder and the decoder in the first electronic device and the at least one second electronic device is kept consistent, and the electronic device with higher data processing capability is adapted to the electronic device with lower data processing capability because the minimum frame rate reflects the speed of the video frame data acquired by the image collectors, the encoding speed of the encoder and the decoding speed of the decoder, so that the data is not accumulated in the processing process, the time delay of both video calls can be effectively reduced, and the phenomenon of blocking and pause is avoided.
Furthermore, in the process of video call, the electronic equipment of each party of call repeatedly calculates and updates the target frame frequency in use according to the preset time interval, so that the electronic equipment of each party of video call can automatically adapt to the actual processing capacity of the electronic equipment of each party of call on the video frame data, the possible time delay is further reduced, the fluency of both parties of call is ensured, and the phenomenon of pause is avoided.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (11)
1. A method for processing video frame data, applied to a first electronic device, includes:
acquiring current video frame data according to the rate of a target frame frequency, and acquiring first acquisition time for starting to acquire the current video frame data; the target frame frequency is a frame frequency supported by the lowest rate of processing video frame data in the first electronic equipment and the at least one second electronic equipment; the first electronic equipment and the at least one second electronic equipment process data according to the processing speed of the target frame frequency;
calculating a first time difference based on the first acquisition time and a start time for starting encoding of previous video frame data;
judging whether the first time difference is greater than the processing time length corresponding to the target frame frequency;
when the first time difference is larger than the processing time duration corresponding to the target frame frequency, encoding the current video frame data through an encoder, and sending the encoded data to the at least one second electronic device;
and when the first time difference is smaller than the processing time duration corresponding to the target frame frequency, discarding the current video frame data.
2. The method of claim 1, wherein the target frame rate is calculated by a method comprising:
performing the following operations for each video frame data in the preset number of video frame data:
acquiring a first frame frequency of an image acquirer of the first electronic device based on the acquisition time of each video frame data; wherein the first frame frequency is inversely proportional to a difference between the acquisition time of each video frame data and the acquisition time of the previous video frame adjacent to the video frame data;
calculating the coding duration of each video frame data based on the starting time and the ending time of each video frame data to obtain a second frame frequency; wherein the end time is a time at which encoding of the each video frame data by the encoder is completed; the second frame frequency is inversely proportional to the encoding duration;
obtaining at least one third frame rate from the at least one second electronic device; wherein the third frame frequency is inversely proportional to a time length used by a decoder of the second electronic device to decode the encoded data corresponding to each video frame data;
calculating frame rates of the image collector, the encoder and the decoder of the at least one second electronic device through a preset algorithm based on the first frame rate, the second frame rate and the at least one third frame rate of each video frame data in the preset number of video frame data;
selecting a minimum frame rate from frame rates of the image collector, the encoder and a decoder of the at least one second electronic device as the target frame rate.
3. The method according to claim 2, wherein the predetermined algorithm is specifically:
an averaging algorithm, or a low-pass filtering algorithm, is used.
4. The method of any one of claims 1-3, wherein the method further comprises:
repeatedly calculating the target frame frequency according to a preset time interval in the process of carrying out video call between the first electronic equipment and the at least one second electronic equipment to obtain a new target frame frequency;
updating the target frame rate being used based on the new target frame rate.
5. A method for processing video frame data, applied to a second electronic device, includes:
receiving encoded data sent by first electronic equipment; the encoded data is obtained by encoding through an encoder of the first electronic device when a first time difference between a first acquisition time when the first electronic device starts to acquire current video frame data and a start time when the previous video frame data starts to be encoded is longer than a processing time corresponding to a target frame frequency, and the current video frame data is discarded when the first time difference is shorter than the processing time corresponding to the target frame frequency;
the decoder of the second electronic device decodes the encoded data according to the processing speed of the target frame frequency to obtain decoded current video front frame data; the target frame frequency is received by the second electronic device from the first electronic device, and is a frame frequency supported by the first electronic device from the first electronic device and at least one second electronic device, wherein the lowest rate of processing video frame data is selected by the first electronic device;
and displaying the current video frame data on a display unit of the second electronic equipment.
6. The method of claim 5, before the second electronic device receives the target frame rate, further comprising:
performing the following operations on each encoded data of the received preset number of encoded data:
calculating the decoding duration of each coded data based on the starting time and the ending time of each coded data to obtain a third frame frequency; wherein the end time is the time for completing the encoding of each encoded data by the decoder of the two electronic devices;
and sending the third frame frequency to the first electronic equipment.
7. A first electronic device for processing video frame data, comprising:
the acquisition unit is used for acquiring current video frame data according to the rate of a target frame frequency and acquiring first acquisition time for starting to acquire the current video frame data; the target frame frequency is a frame frequency supported by the lowest rate of processing video frame data in the first electronic equipment and the at least one second electronic equipment; the first electronic equipment and the at least one second electronic equipment process data according to the processing speed of the target frame frequency;
a calculating unit, configured to calculate a first time difference based on the first acquisition time and a start time for starting encoding of previous video frame data;
the judging unit is used for judging whether the first time difference is larger than the processing time length corresponding to the target frame frequency;
the processing unit is used for encoding the current video frame data through an encoder when the first time difference is larger than the processing time duration corresponding to the target frame frequency, and sending the encoded data to the at least one second electronic device; and when the first time difference is smaller than the processing time duration corresponding to the target frame frequency, discarding the current video frame data.
8. The first electronic device of claim 7, wherein in calculating the target frame rate, the calculation unit is further to:
performing the following operations for each video frame data in the preset number of video frame data:
acquiring a first frame frequency of an image acquirer of the first electronic device based on the acquisition time of each video frame data; wherein the first frame frequency is inversely proportional to a difference between the acquisition time of each video frame data and the acquisition time of the previous video frame adjacent to the video frame data;
calculating the coding duration of each video frame data based on the starting time and the ending time of each video frame data to obtain a second frame frequency; wherein the end time is a time at which encoding of the each video frame data by the encoder is completed; the second frame frequency is inversely proportional to the encoding duration;
obtaining at least one third frame rate from the at least one second electronic device; wherein the third frame frequency is inversely proportional to a time length used by a decoder of the second electronic device to decode the encoded data corresponding to each video frame data;
calculating frame rates of the image collector, the encoder and the decoder of the at least one second electronic device through a preset algorithm based on the first frame rate, the second frame rate and the at least one third frame rate of each video frame data in the preset number of video frame data;
selecting a minimum frame rate from frame rates of the image collector, the encoder and a decoder of the at least one second electronic device as the target frame rate.
9. The first electronic device of any of claims 7 or 8, wherein the computing unit is further to:
repeatedly calculating the target frame frequency according to a preset time interval in the process of carrying out video call between the first electronic equipment and the at least one second electronic equipment to obtain a new target frame frequency;
updating a target frame rate being used by the first electronic device based on the new target frame rate.
10. A second electronic device for processing video frame data, comprising:
the receiving unit is used for receiving the coded data sent by the first electronic equipment; the encoded data is obtained by encoding through an encoder of the first electronic device when a first time difference between a first acquisition time when the first electronic device starts to acquire current video frame data and a start time when the previous video frame data starts to be encoded is longer than a processing time corresponding to a target frame frequency, and the current video frame data is discarded when the first time difference is shorter than the processing time corresponding to the target frame frequency;
the decoding unit is used for decoding the coded data according to the processing speed of the target frame frequency to obtain decoded current video frame data; wherein the target frame rate is received from the first electronic device and is a frame rate supported by the first electronic device from the first electronic device and at least one second electronic device at the lowest rate of processing video frame data;
and the display unit is used for displaying the current video frame data.
11. The second electronic device of claim 10, wherein prior to receiving the target frame rate, the second electronic device further comprises:
a processing unit, configured to perform the following operations on each encoded data of the received preset number of encoded data:
calculating the decoding duration of each coded data based on the starting time and the ending time of each coded data to obtain a third frame frequency; wherein the end time is the time for completing the encoding of each encoded data by the decoder of the two electronic devices;
and transmitting the third frame frequency to the first electronic equipment through a transmitting unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810260406.1A CN108347580B (en) | 2018-03-27 | 2018-03-27 | Method for processing video frame data and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810260406.1A CN108347580B (en) | 2018-03-27 | 2018-03-27 | Method for processing video frame data and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108347580A CN108347580A (en) | 2018-07-31 |
| CN108347580B true CN108347580B (en) | 2020-09-25 |
Family
ID=62958285
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810260406.1A Active CN108347580B (en) | 2018-03-27 | 2018-03-27 | Method for processing video frame data and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108347580B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109379624B (en) * | 2018-11-27 | 2021-03-02 | Oppo广东移动通信有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN110278453A (en) * | 2019-07-05 | 2019-09-24 | 浙江开奇科技有限公司 | Panoramic video image display method, mobile terminal and system based on 5G network |
| CN111385637B (en) * | 2020-03-18 | 2022-05-20 | Oppo广东移动通信有限公司 | Media data encoding method and device and electronic equipment |
| CN112068771A (en) * | 2020-08-17 | 2020-12-11 | Oppo广东移动通信有限公司 | Video processing method, video processing device, terminal device and storage medium |
| CN112866745B (en) * | 2020-12-31 | 2023-04-25 | 南方电网大数据服务有限公司 | Streaming video data processing method, device, computer equipment and storage medium |
| CN113596320B (en) * | 2021-06-16 | 2022-07-01 | 荣耀终端有限公司 | Video shooting variable speed recording method, device and storage medium |
| CN115297291A (en) * | 2022-08-04 | 2022-11-04 | 阿波罗智联(北京)科技有限公司 | Data processing method, data processing device, electronic equipment and medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105262950A (en) * | 2015-10-15 | 2016-01-20 | 广州市百果园网络科技有限公司 | Method and device for generating video information |
| CN105681816A (en) * | 2015-12-31 | 2016-06-15 | 深圳市瑞彩电子技术有限公司 | Video data transmission apparatus and method |
| CN107451066A (en) * | 2017-08-22 | 2017-12-08 | 网易（杭州）网络有限公司 | Interim card treating method and apparatus, storage medium, terminal |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100755789B1 (en) * | 2006-07-31 | 2007-09-05 | 삼성전자주식회사 | Method and apparatus for video telephony in portable terminal |
| CN100566401C (en) * | 2006-09-12 | 2009-12-02 | 腾讯科技（深圳）有限公司 | Instant communication video quality regulating method and device |
| CN102957891B (en) * | 2011-08-24 | 2016-05-18 | 中国电信股份有限公司 | Video content rendering method, system, radio phone terminal and present terminal |
| CN103037195A (en) * | 2012-12-05 | 2013-04-10 | 北京小米科技有限责任公司 | Method and device used for setting video call parameters and transmission capacity parameters |
| US20150181393A1 (en) * | 2013-12-20 | 2015-06-25 | Plannet Associate Co., Ltd. | Distribution device for transmission packets |
| CN105100675B (en) * | 2015-09-11 | 2019-07-09 | Tcl集团股份有限公司 | A kind of quality adjustment method and system of terminal video communication |
| CN106941597A (en) * | 2016-01-04 | 2017-07-11 | 中国移动通信集团公司 | A kind of video call method and device |
| CN105933800A (en) * | 2016-04-29 | 2016-09-07 | 联发科技（新加坡）私人有限公司 | Video play method and control terminal |
| KR101797870B1 (en) * | 2016-08-12 | 2017-11-14 | 라인 가부시키가이샤 | Method and system for measuring quality of video call |
-
2018
- 2018-03-27 CN CN201810260406.1A patent/CN108347580B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105262950A (en) * | 2015-10-15 | 2016-01-20 | 广州市百果园网络科技有限公司 | Method and device for generating video information |
| CN105681816A (en) * | 2015-12-31 | 2016-06-15 | 深圳市瑞彩电子技术有限公司 | Video data transmission apparatus and method |
| CN107451066A (en) * | 2017-08-22 | 2017-12-08 | 网易（杭州）网络有限公司 | Interim card treating method and apparatus, storage medium, terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108347580A (en) | 2018-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108347580B (en) | Method for processing video frame data and electronic equipment | |
| CN110381316B (en) | Video transmission control method, device, equipment and storage medium | |
| CN110430441B (en) | Cloud mobile phone video acquisition method, system, device and storage medium | |
| CN113992967B (en) | Screen projection data transmission method and device, electronic equipment and storage medium | |
| CN113747194B (en) | Remote video transmission method, transmission device, storage medium and electronic equipment | |
| CN110996103A (en) | Method for adjusting video coding rate according to network condition | |
| CN108989832B (en) | Image data processing method and equipment, storage medium and terminal thereof | |
| EP3185480A1 (en) | Method and apparatus for processing network jitter, and terminal device | |
| CN104270649A (en) | Image encoding device and image encoding method | |
| CN111263153B (en) | Video encoding method, device, equipment and storage medium | |
| WO2016023358A1 (en) | Method and apparatus for adjusting image quality of video according to network environment | |
| CN113891175B (en) | Live broadcast push flow method, device and system | |
| CN101931799A (en) | Method and device for smoothing video bit stream | |
| CN113490055A (en) | Data processing method and device | |
| CN110996122B (en) | Video frame transmission method, device, computer equipment and storage medium | |
| CN113099272A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN100459695C (en) | Method of transmitting video data, and transmission system | |
| CN106941597A (en) | A kind of video call method and device | |
| US8320449B2 (en) | Method for controlling video frame stream | |
| CN109413371A (en) | Video frame rate calculation method and device | |
| CN107493478B (en) | Method and device for setting coding frame rate | |
| CN103929682A (en) | Method and device for setting key frames in video live broadcast system | |
| CN112203126B (en) | Screen projection method, screen projection device and storage medium | |
| CN112423074B (en) | Audio and video synchronization processing method and device, electronic equipment and storage medium | |
| CN111385576A (en) | Video coding method and device, mobile terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |