CN108989832B - Image data processing method and equipment, storage medium and terminal thereof - Google Patents

Image data processing method and equipment, storage medium and terminal thereof Download PDF

Info

Publication number
CN108989832B
CN108989832B CN201710401614.4A CN201710401614A CN108989832B CN 108989832 B CN108989832 B CN 108989832B CN 201710401614 A CN201710401614 A CN 201710401614A CN 108989832 B CN108989832 B CN 108989832B
Authority
CN
China
Prior art keywords
detection time
image data
data
image
frame rate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710401614.4A
Other languages
Chinese (zh)
Other versions
CN108989832A (en
Inventor
罗巧龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201710401614.4A priority Critical patent/CN108989832B/en
Publication of CN108989832A publication Critical patent/CN108989832A/en
Application granted granted Critical
Publication of CN108989832B publication Critical patent/CN108989832B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23106Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/23805Controlling the feeding rate to the network, e.g. by controlling the video pump
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2407Monitoring of transmitted content, e.g. distribution time, number of downloads

Abstract

The embodiment of the invention discloses an image data processing method and equipment, a storage medium and a terminal thereof, wherein the method comprises the following steps: acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache; uploading the image data in the network uploading cache to a network server based on the current network state; and when the second detection time is reached, acquiring data quantity change information in the network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information. By adopting the invention, the current network state can be obtained in time to update the image screening frame rate, and the image screening frame rate is ensured to be adaptive to the network state, thereby ensuring the effect of network live broadcast.

Description

Image data processing method and equipment, storage medium and terminal thereof
Technical Field
The present invention relates to the field of computer technologies, and in particular, to an image data processing method, an apparatus, a storage medium, and a terminal.
Background
With the rapid development of internet technology, various live webcasts such as news information, entertainment live webcasts, education live webcasts and the like have become one of the mainstream means of current multimedia information dissemination, and terminal devices such as smart phones, computers, web televisions and the like are used as main platforms of live webcasts and directly reflect the advantages and disadvantages of live webcasts, for example, when the network state is good, images acquired through the camera or the camera shooting function of the terminal devices can be live webcasts to audiences without losing frames rapidly, but when the network state is not good, a pause phenomenon may occur during live webcasts. In the prior art, the live broadcast pause phenomenon when the network state is not good enough can be reduced by manually adjusting the image acquisition frame rate of the camera or the camera shooting function of the terminal device, however, when the network state fluctuates frequently, the problems of untimely adjustment or error in subjective judgment and the like can occur by manually adjusting the image acquisition frame rate, the accuracy of image acquisition frame rate adjustment is reduced, the influence of the network state on uploading of image data cannot be timely acquired, and the live broadcast effect of the network is further influenced.
Disclosure of Invention
Embodiments of the present invention provide an image data processing method, an apparatus, a storage medium, and a terminal thereof, which can obtain a current network state in time to update an image screening frame rate, and ensure that the image screening frame rate is adapted to a network state, thereby ensuring a live network broadcast effect.
A first aspect of an embodiment of the present invention provides an image data processing method, which may include:
acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache;
uploading the image data in the network uploading cache to a network server based on the current network state;
when a second detection time is reached, acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information;
the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
A second aspect of an embodiment of the present invention provides an image data processing apparatus, which may include:
the data processing module is used for acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the image data after screening into a network uploading cache;
the data uploading module is used for uploading the image data in the network uploading cache to a network server based on the current network state;
the frame rate updating module is used for acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time when the second detection time is reached, and updating the image screening frame rate based on the data quantity change information;
the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
A third aspect of embodiments of the present invention provides a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the following steps:
acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache;
uploading the image data in the network uploading cache to a network server based on the current network state;
when a second detection time is reached, acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information;
the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
A fourth aspect of an embodiment of the present invention provides a terminal, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the steps of:
acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache;
uploading the image data in the network uploading cache to a network server based on the current network state;
when a second detection time is reached, acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information;
the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
In the embodiment of the invention, the image data collected from the first detection time is acquired, the image data is screened by adopting a preconfigured image screening frame rate, the image data after screening is added into a network uploading cache, the image data in the network uploading cache is uploaded to a network server based on the current network state, when the second detection time is reached, the data quantity change information in the network uploading cache between the first detection time and the second detection time is acquired, and the image screening frame rate is updated based on the data quantity change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is the preconfigured detection time length. The change of the buffer storage amount of the image data in the detection duration in the terminal equipment is analyzed, the screening frame rate of the image data is changed, the current network state can be timely obtained to update the image screening frame rate, the image screening frame rate is ensured to be adaptive to the network state, and the network live broadcast effect is further ensured.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an image data processing apparatus according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method for processing image data according to an embodiment of the present invention;
FIG. 3 is a flow chart of another image data processing method according to an embodiment of the present invention;
FIG. 4 is a flow chart illustrating another image data processing method according to an embodiment of the present invention;
FIG. 5 is a flow chart illustrating another image data processing method according to an embodiment of the present invention;
FIG. 6 is a flow chart illustrating another image data processing method according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an image data processing apparatus according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of another image data processing apparatus provided by an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a frame rate update module according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a frame rate update unit according to an embodiment of the present invention;
fig. 11 is a schematic structural diagram of a duration update module according to an embodiment of the present invention;
fig. 12 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The image data processing method provided by the embodiment of the invention can be applied to determining the corresponding image screening frame rate aiming at different network states in the network live broadcast, and further optimizing the scene of the network live broadcast, such as: the image data processing device acquires image data acquired from a first detection time, performs screening processing on the image data by adopting a preconfigured image screening frame rate, adds the image data after the screening processing to a network uploading cache, uploads the image data in the network uploading cache to a network server based on the current network state, and when a second detection time is reached, the image data processing device acquires data volume change information in the network uploading cache between the first detection time and the second detection time and updates the image screening frame rate based on the data volume change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is the preconfigured detection time length. The change of the buffer storage amount of the image data in the detection duration in the terminal equipment is analyzed, the screening frame rate of the image data is changed, the current network state can be timely obtained to update the image screening frame rate, the image screening frame rate is ensured to be adaptive to the network state, and the network live broadcast effect is further ensured.
The image data processing device related to the embodiment of the invention can be a terminal device with networking function and shooting function such as a tablet computer, a smart phone, a palm computer, a network television, a Mobile Internet Device (MID) and the like or a terminal device capable of establishing communication connection with a camera. For example, the image data processing device may be a computer as shown in fig. 1, and the computer acquires the image data acquired by the camera through the acquisition card, or the camera and the acquisition card in fig. 1 may be integrated into the computer to form a terminal device with integrated image acquisition and screening functions.
The following describes the image data processing method according to an embodiment of the present invention in detail with reference to fig. 2 to 5.
Referring to fig. 2, a flow chart of an image data processing method according to an embodiment of the invention is shown. As shown in fig. 2, the method of the embodiment of the present invention may include the following steps S101 to S103.
S101, acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache;
specifically, the image data processing device may acquire image data acquired from the first detection time, and it is understood that the image data processing device may acquire image data using its own camera function, or may acquire image data captured by the camera through a communication connection with the camera. The first detection time may be any artificially determined start time, for example, the start time of network live broadcast by using a terminal device, or the detection time reached by a last detection time of the first detection time after a detection time length.
Further, the image data processing device may perform the filtering processing on the image data by using a preset image filtering frame rate, and it is understood that the image filtering frame rate may be a frame rate for filtering the image data before uploading the image data, for example, when the frame rate of image data acquisition is 60FPS, and the preset image filtering frame rate is 20FPS, 2/3 of the acquired image data needs to be dropped, that is, only 1 frame is reserved for every 3 frames of image data.
Further, the image data processing device may add the image data after the filtering process to a network upload cache, and it is understood that the network upload cache may be an area where the image data processing device stores the image data before uploading the image data after the filtering process to a network server, for example, a memory in the image data processing device.
S102, uploading image data in a network uploading cache to a network server based on the current network state;
specifically, the image data processing device may upload the image data in the network upload buffer to the network server based on the current network state, and it may be understood that the quality of the current network state may be judged by using the most direct network speed, for example, an upload network speed of 25 frames/S may indicate that the current network state is better, and an upload network speed of 5 frames/S may indicate that the current network state is not good enough.
It can be understood that the image data in the network upload buffer is not always uploaded to the network server, and when the current network state is not good enough, a buffer memory of the image data is left in the network upload buffer.
S103, when a second detection time is reached, acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information;
specifically, when the second detection time is reached, the image data processing device may obtain data amount change information in the network upload cache between the first detection time and the second detection time, and it may be understood that the second detection time may be a time when a preset detection time arrives, for example, the preset detection time is 1min, and if the first detection time is a start time of the network live broadcast by the terminal device, the second detection time is a time after 1 min. Optionally, the image data processing device may obtain the data amount change information by comparing a difference between buffer amounts in a network upload buffer at the first detection time and the second detection time. It is to be understood that the data amount change information may be information that the amount of buffering of the image data increases or information that the amount of buffering decreases.
Further, the image data processing device may update the image screening frame rate based on the data amount change information, and optionally, when the data amount change information is information that a buffer storage amount of the image data increases, it indicates that a speed of uploading image data within a detection period is slower than an acquisition speed, and the image buffer storage amount increases, at this time, the image screening frame rate needs to be decreased, for example, the initial image screening frame rate is 60FPS, and 20FPS after updating, and after the image screening frame rate is decreased, 2 frames of images per 3 frames may be discarded, and only 1 frame is reserved, so that the quality of video data composed of uploaded images is ensured while network resources are fully utilized. Optionally, when the data amount change information is information that the amount of buffering of the image data is reduced, it indicates that the uploading speed of the image data is faster than the acquisition speed during the detection period, and the amount of buffering of the image is reduced, at this time, the image number screening frame rate needs to be increased, for example, the original image screening frame rate is 20FPS, and is 40FPS after updating, and after the image screening frame rate is increased, 2 frames of discarded images per 3 frames can be changed into 1 frame of discarded images per 3 frames, so that the image quality of the video is further improved.
In the embodiment of the invention, the image data collected from the first detection time is acquired, the image data is screened by adopting a preconfigured image screening frame rate, the image data after screening is added into a network uploading cache, the image data in the network uploading cache is uploaded to a network server based on the current network state, when the second detection time is reached, the data quantity change information in the network uploading cache between the first detection time and the second detection time is acquired, and the image screening frame rate is updated based on the data quantity change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is the preconfigured detection time length. The change of the buffer storage amount of the image data in the detection duration in the terminal equipment is analyzed, the screening frame rate of the image data is changed, the current network state can be timely obtained to update the image screening frame rate, the image screening frame rate is ensured to be adaptive to the network state, and the network live broadcast effect is further ensured.
Referring to fig. 3, a flow chart of another image data processing method according to an embodiment of the invention is shown. As shown in fig. 3, the method of the embodiment of the present invention may include the following steps S201 to S208.
S201, acquiring preset image acquisition configuration information, wherein the image acquisition configuration information comprises a default screening frame rate and a default time length;
specifically, the image data processing device may obtain preset image acquisition configuration information, and it may be understood that the image acquisition configuration information may include a default filtering frame rate and a default duration, where the default filtering frame rate may be an acquisition frame rate when the image data processing device acquires image data, for example, may be a camera physical acquisition frame rate 60FPS, and the default duration may be a detection duration when the image data processing device performs filtering processing on image data for the first time, for example, may be 1min or another reasonable time period.
S202, determining the default screening frame rate as an image screening frame rate, and determining the default duration as a detection duration;
specifically, the image data processing device may determine the default filtering frame rate as an image filtering frame rate, and determine the default duration as a detection duration, where it is understood that the default filtering frame rate and the default duration may be initialization values of the image filtering frame rate and the detection duration when image data is first filtered.
S203, acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache;
specifically, the image data processing device may acquire image data acquired from the first detection time, and it is understood that the image data processing device may acquire image data using its own camera function, or may acquire image data captured by a camera through a communication connection with the camera. The first detection time may be any artificially determined start time, for example, the start time of network live broadcast by using a terminal device, or the detection time reached by a last detection time of the first detection time after a detection time length.
Further, the image data processing device may perform the filtering processing on the image data by using a preset image filtering frame rate, and it is understood that the image filtering frame rate may be a frame rate for filtering the image data before uploading the image data, for example, when the frame rate of image data acquisition is 60FPS, and the preset image filtering frame rate is 20FPS, 2/3 of the acquired image data needs to be dropped, that is, only 1 frame is reserved for every 3 frames of image data.
Further, the image data processing device may add the image data after the filtering process to a network upload cache, and it is understood that the network upload cache may be an area where the image data processing device stores the image data before uploading the image data after the filtering process to a network server, for example, a memory in the image data processing device.
S204, uploading the image data in the network uploading cache to a network server based on the current network state;
specifically, the image data processing device may upload the image data in the network upload buffer to the network server based on the current network state, and it may be understood that the quality of the current network state may be judged by using the most direct network speed, for example, an upload network speed of 25 frames/S may indicate that the current network state is better, and an upload network speed of 5 frames/S may indicate that the current network state is not good enough.
It can be understood that the image data in the network upload buffer is not always uploaded to the network server, and when the current network state is not good enough, a buffer memory of the image data is left in the network upload buffer.
S205, when a second detection time is reached, acquiring a first buffer amount of the network upload buffer at the first detection time, and acquiring a second buffer amount of the network upload buffer at the second detection time;
specifically, when the second detection time is reached, the image data processing device may obtain the first buffer amount uploaded and cached by the network at the first detection time, and it may be understood that the second detection time may be a time when a preset detection time arrives, for example, the preset detection time is 1min, and if the first detection time is a start time of the network live broadcast by the terminal device, the second detection time is a time after 1 min. The first buffer amount may be a buffer amount of image data stored in the network upload buffer at the first detection time, and may be 10 frames, for example. Alternatively, the first buffer amount may be acquired and stored by the image data processing apparatus at the first detection time, and may be directly acquired when the second detection time is reached.
Further, the image data processing apparatus may obtain a second buffer amount of the network upload buffer at a second detection time, and it is understood that the second buffer amount may be a buffer amount of the image data stored in the network upload buffer at the second detection time, and may be 15 frames or 9 frames, for example.
S206, acquiring a data volume change state and a data volume change value in a network uploading cache between the first detection time and the second detection time according to the first buffer quantity and the second buffer quantity, and updating the image screening frame rate based on the data volume change state and the data volume change value;
specifically, the image data processing apparatus may obtain a data amount change state and a data amount change value in the network upload buffer between the first detection time and the second detection time according to the first buffer amount and the second buffer amount, and it is understood that the data amount change state may be a difference state between the buffer amounts in the network upload buffer between the first detection time and the second detection time, for example, when the difference is positive, it represents that the data amount change state is a data amount increase state, and when the difference is negative, it represents that the data amount change state is a data amount decrease state. The data amount change value may be a specific value of the above difference value, and may be, for example, 5 frames or-1 frame or the like.
Further, the image data processing apparatus may update the image screening frame rate based on the data amount change state and the data amount change value, and optionally, when the data amount change state is a data amount increase state, update the image screening frame rate by obtaining a data amount increase value, for example, reduce the image screening frame rate according to the data amount increase value. Optionally, when the data amount change state is a data amount decrease state, the image filtering frame rate is updated by obtaining a data amount decrease value, for example, the image filtering frame rate is increased according to the data amount increase value.
S207, calculating the data volume change rate in the network uploading cache between the first detection time and the second detection time according to the data volume change value;
specifically, the image data processing device may calculate a data amount change rate in the network upload buffer between the first detection time and the second detection time based on the data amount change value, and may calculate an increase rate, which is a data amount change rate in the network upload buffer between the first detection time and the second detection time, to be (5/10) × 100% > -50% by setting the data amount change rate to be 5 frames when the buffer amount at the first detection time is 10 frames and the buffer amount at the second detection time is 15 frames, and may calculate a data amount change rate to be-1 frame when the buffer amount at the first detection time is 10 frames and the buffer amount at the second detection time is 9 frames, and set a data amount change rate, which is a data amount change rate to be (1/10) × 100% > -10%.
S208, updating the detection duration based on the data volume change rate;
specifically, the image data processing apparatus may update the detection duration based on the data amount change rate. Optionally, the image data processing device may preset a change rate threshold according to practical experience as a reference value of the data volume change rate, for example, when the data volume change rate is greater than or equal to a first preset change rate threshold, it may be considered that a problem that a detection duration may have a larger value when a buffer amount changes faster, and at this time, the detection duration may be reduced; when the data volume change rate is smaller than or equal to a second preset change rate threshold, it can be considered that the detection duration is possibly small in value when the buffer storage volume changes slowly, and at this time, the detection duration can be increased; when the data volume change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold, it may be considered that the comparison of the buffer amount change is moderate, at this time, the detection duration may be kept unchanged, it may be understood that the data volume change rate may be an increase rate or a decrease rate, the first preset change rate threshold is larger than the second preset change rate threshold, for example, the first preset change rate threshold may be 20%, and the second preset change rate threshold may be 10%.
In a specific implementation manner of the embodiment of the present invention, the obtaining, according to the first buffer amount and the second buffer amount, a data amount change state and a data amount change value in a network upload buffer between the first detection time and the second detection time, and updating the image filtering frame rate based on the data amount change state and the data amount change value may include the following steps, as shown in fig. 4:
s301, when the second buffer amount is larger than the first buffer amount, determining that a data amount change state in a network uploading cache between the first detection time and the second detection time is a data amount increase state, acquiring a data amount increase value between the first buffer amount and the second buffer amount, and reducing the image screening frame rate according to the data amount increase value;
specifically, when the second buffer amount is greater than the first buffer amount, the image data processing apparatus may determine that a data amount change state in the network upload buffer between the first detection time and the second detection time is a data amount increase state, for example, when the first buffer amount is 10 frames and the second buffer amount is 12 frames, the data amount change state is a data amount increase state, and further, the image data processing apparatus may obtain a data amount increase value between the first buffer amount and the second buffer amount, for example, the data amount increase value is 2 frames.
Further, the image data processing device may decrease the image screening frame rate according to the data amount increase value, for example, the initial image screening frame rate is 60FPS, and the data amount increase value within the detection time (which may be set to 1min) is 2 frames, that is, the buffer of the image data is increased by 2 frames within 1min, which indicates that the current network state is not good enough, and the image screening frame rate needs to be decreased, so as to improve the utilization rate of the network as much as possible while ensuring the picture quality of the video data composed of the image data, for example, the image screening frame rate may be decreased to 20 FPS.
S302, when the second buffer amount is smaller than the first buffer amount, determining that a data amount change state in a network uploading buffer between the first detection time and the second detection time is a data amount reduction state, acquiring a data amount reduction value between the first buffer amount and the second buffer amount, and increasing the image screening frame rate according to the data amount reduction value;
specifically, when the second buffer amount is smaller than the first buffer amount, the image data processing apparatus may determine that a data amount change state in the network upload buffer between the first detection time and the second detection time is a data amount decrease state, for example, when the first buffer amount is 10 frames and the second buffer amount is 7 frames, the data amount change state is a data amount decrease state, and further, the image data processing apparatus may acquire a data amount decrease value between the first buffer amount and the second buffer amount, for example, an increase value of the data amount is 3 frames.
Further, the image data processing device may increase the image filtering frame rate according to the data amount reduction value, for example, the initial image filtering frame rate is 40FPS, the data amount reduction value within the detection time (which may be set to 1min) is 3 frames, that is, the buffering of the image data within 1min is reduced by 3 frames, which indicates that the image filtering frame rate needs to be increased when the current network state is better, and may further improve the picture quality of the video data composed of the image data, for example, the image filtering frame rate may be increased to 50 FPS.
In the embodiment of the invention, the updating of the image screening frame rate is realized through the increased or decreased data volume, and the rationality of the updating of the image screening frame rate is improved.
In a specific implementation manner of the embodiment of the present invention, the updating the detection duration based on the data volume change rate may include the following steps, as shown in fig. 5:
s401, when the data volume change rate is larger than or equal to a first preset change rate threshold value, reducing the detection duration;
specifically, when the data amount change rate is greater than or equal to a first preset change rate threshold, the image data processing device may reduce the detection duration, for example, the data amount change rate is 30%, which indicates that the buffer amount of the image data is increased or decreased by 30% within 1min of the detection duration, the change is fast, and the detection duration needs to be reduced, so as to ensure that the change condition of the data amount in the network upload buffer can be obtained faster, and the image screening frame rate is updated in time, so that the change of the data amount in the network upload buffer tends to be within a suitable range (which may be obtained from long-term practical experience), for example, the detection duration 1min may be changed to 0.5 min.
S402, when the data volume change rate is smaller than or equal to a second preset change rate threshold value, increasing the detection duration;
specifically, when the data amount change rate is less than or equal to a second preset change rate threshold, the image data processing apparatus may increase the detection duration, for example, the data amount change rate is 8%, which indicates that the buffer amount of the image data is increased or decreased by 8% within 1min of the detection duration, the change is slow, the detection duration may be increased, and the image screening frame rate does not need to be updated too frequently, for example, the detection duration 1min may be changed to 1.5 min.
S403, when the data volume change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold, keeping the detection duration;
specifically, when the data amount change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold, the image data processing apparatus may keep the detection duration, for example, the data amount change rate is 15%, which indicates that the buffer amount of the image data is increased or decreased by 15% within 1min of the detection duration, and the buffer amount change range of the image data is within an empirical range, so that the original detection duration may be kept unchanged.
In the embodiment of the invention, the detection duration is updated by analyzing the data volume change rate, so that the adaptability of the detection duration along with the change of the network state is ensured, and the rationality of updating the image screening frame rate based on the detection duration is improved.
In the embodiment of the invention, the image data collected from the first detection time is acquired, the image data is screened by adopting a preconfigured image screening frame rate, the image data after screening is added into a network uploading cache, the image data in the network uploading cache is uploaded to a network server based on the current network state, when the second detection time is reached, the data quantity change information in the network uploading cache between the first detection time and the second detection time is acquired, and the image screening frame rate is updated based on the data quantity change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is the preconfigured detection time length. The filtering frame rate of the image data is changed by analyzing the change of the buffer storage amount of the image data in the detection duration in the terminal equipment, so that the current network state can be obtained in time to update the image filtering frame rate, the image filtering frame rate is ensured to be adaptive to the network state, and the network live broadcast effect is further ensured; the updating of the image screening frame rate is realized through the increased or decreased data volume, and the rationality of the updating of the image screening frame rate is improved; the detection duration is updated by analyzing the data volume change rate, so that the adaptability of the detection duration along with the change of the network state is ensured, and the rationality of updating the image screening frame rate based on the detection duration is improved.
The following describes the image data processing method provided in the embodiment of the present invention in detail with reference to a specific implementation process, and the steps shown in the embodiment of the present invention are specifically described in terms of one piece of acquired image data, and the specific implementation manner is shown in fig. 6:
s501, configuring a default screening frame rate and a default duration, determining the default screening frame rate as an image screening frame rate, and determining the default duration as a detection duration;
specifically, the image data processing device may obtain preset image acquisition configuration information, and it may be understood that the image acquisition configuration information may include a default filtering frame rate and a default duration, where the default filtering frame rate may be an acquisition frame rate when the image data processing device acquires image data, for example, may be a camera physical acquisition frame rate 60FPS, and the default duration may be a detection duration when the image data processing device performs filtering processing on image data for the first time, for example, may be 1min or another reasonable time period.
Further, the image data processing device may determine the default filtering frame rate as an image filtering frame rate, and determine the default duration as a detection duration, where it is understood that the default filtering frame rate and the default duration may be initialization values of the image filtering frame rate and the detection duration when image data is first filtered.
S502, updating the image screening frame rate and the detection duration;
specifically, the image data processing device may update the image filtering frame rate and the detection duration by using the updating method of the image filtering frame rate and the detection duration described in the embodiments shown in fig. 2 to fig. 5, which is not described herein again.
Further, the image data processing apparatus may determine the number of frames of the acquired image data that need to be discarded through the updated image filtering frame rate, for example, if the frame rate of the image data acquisition is 60FPS, and the preset image filtering frame rate is 20FPS, the acquired image data needs to be discarded 2/3, that is, only 1 frame is reserved for every 3 frames of image data.
S503, judging whether the live broadcast or the shooting is finished;
specifically, after determining the number of frames of the acquired image data that need to be discarded according to the updated image filtering frame rate, the image data processing device may determine whether live broadcast or shooting currently performed is finished, and if the determination result is negative, the process proceeds to step S504.
S504, receiving the collected image data;
specifically, if the determination result in step S503 is no, the image data processing device may receive the acquired image data, and it is understood that the image data may be the image data acquired by the image data processing device through a camera function equipped in the image data processing device, or the image data acquired by the camera may be received by the acquisition card.
S505, judging whether the image data should be discarded according to the updated image screening frame rate;
specifically, when the image data processing apparatus may determine whether the acquired image data should be discarded according to the updated image filtering frame rate, for example, the frame rate when the image data is acquired is 60FPS, if the updated image filtering frame rate is 60FPS, it is not necessary to discard any frame of image, if the updated image filtering frame rate is 40FPS, it is necessary to discard 1/3 the acquired image data, that is, discard 1 frame of every 3 frames of image data, and it may be determined whether the currently acquired image data needs to be discarded after the big data statistics, for example, the acquired first frame is discarded, then the second frame and the third frame are not discarded, and the fourth frame is discarded.
S506, discarding the image data;
specifically, if the determination result in the step S505 is yes, the step S506 is executed to discard the image data, optionally, the image data processing device may directly discard the frame of image data, and then the frame of image data is not restored, and optionally, the image data processing device may further put the frame of image data that needs to be discarded into another buffer, for example, a discarded data storage area set in a manner, so as to restore the recorded video data when the complete video data needs to be processed or stored subsequently, thereby ensuring the integrity and definition of the stored video data.
Further, after discarding the image data, the process may proceed to step S503 to determine whether the live broadcast or the shooting is finished.
S507, encoding the image data, adding the encoded image data into a network uploading cache, and uploading the image data to a network server;
specifically, if the determination result in step S505 is that the image data is not encoded, it is understood that the encoding process may be a process of digitizing the image data and encoding the image data into machine language.
Furthermore, the image data processing device may upload the encoded image data to a network upload cache, and then upload the encoded image data to a network server based on the network upload cache and the current network, and play the encoded image data after decoding by the video playing terminal.
S508, judging whether the detection time length is reached;
specifically, the image data processing device may determine whether the detection time period has elapsed, for example, the image data processing device may determine whether the processes of performing image screening frame rate update, image data discarding determination, and code uploading on the acquired image data are completed within 1min of the detection time period. If the determination result is no, the process proceeds to step S503 to determine whether the live broadcast or the shooting is finished, and if the determination result is yes, the process proceeds to step S509.
S509, detecting network uploading cache, and calculating an updated image screening frame rate and an updated detection duration;
specifically, after the encoding of the acquired image data is uploaded within the detection time period, the image data processing device may calculate the updated image screening frame rate and the updated detection time period by detecting a buffer amount in the current network upload buffer, and the method for calculating the updated image screening frame rate and the updated detection time period may specifically refer to the detailed description in the image data processing method described in the embodiments shown in fig. 2 to 5, which is not described herein again.
In the embodiment of the invention, the image data collected from the first detection time is acquired, the image data is screened by adopting a preconfigured image screening frame rate, the image data after screening is added into a network uploading cache, the image data in the network uploading cache is uploaded to a network server based on the current network state, when the second detection time is reached, the data quantity change information in the network uploading cache between the first detection time and the second detection time is acquired, and the image screening frame rate is updated based on the data quantity change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is the preconfigured detection time length. The filtering frame rate of the image data is changed by analyzing the change of the buffer storage amount of the image data in the detection duration in the terminal equipment, so that the current network state can be obtained in time to update the image filtering frame rate, the image filtering frame rate is ensured to be adaptive to the network state, and the network live broadcast effect is further ensured; the updating of the image screening frame rate is realized through the increased or decreased data volume, and the rationality of the updating of the image screening frame rate is improved; the detection duration is updated by analyzing the data volume change rate, so that the adaptability of the detection duration along with the change of the network state is ensured, and the rationality of updating the image screening frame rate based on the detection duration is improved.
An image data processing apparatus according to an embodiment of the present invention will be described in detail with reference to fig. 7 to 11. It should be noted that the apparatuses shown in fig. 7-11 are used for executing the method according to the embodiments of the present invention shown in fig. 1-6, and for convenience of description, only the parts related to the embodiments of the present invention are shown, and details of the technology are not disclosed, please refer to the embodiments of the present invention shown in fig. 1-6.
Fig. 7 is a schematic structural diagram of an image data processing apparatus according to an embodiment of the present invention. As shown in fig. 7, the image data processing apparatus 1 of the embodiment of the present invention may include: a data processing module 11, a data uploading module 12 and a frame rate updating module 13.
The data processing module 11 is configured to acquire image data acquired from a first detection time, perform screening processing on the image data by using a preconfigured image screening frame rate, and add the image data after the screening processing to a network upload cache;
in a specific implementation, the data processing module 11 may acquire image data acquired from a first detection time, and it is understood that the data processing module 11 may acquire the image data by using its own camera function, or may acquire the image data captured by the camera through a communication connection with the camera. The first detection time may be any artificially determined start time, for example, the start time of network live broadcast by using a terminal device, or the detection time reached by a last detection time of the first detection time after a detection time length.
Further, the data processing module 11 may perform the filtering processing on the image data by using a preset image filtering frame rate, and it is understood that the image filtering frame rate may be a frame rate for filtering the image data before uploading the image data, for example, when the frame rate of the image data is 60FPS, and the preset image filtering frame rate is 20FPS, 2/3 of the acquired image data needs to be dropped, that is, only 1 frame is reserved for every 3 frames of image data.
Further, the data processing module 11 may add the image data after the filtering process to a network upload cache, and it is understood that the network upload cache may be an area where the image data processing apparatus 1 stores the image data before uploading the image data after the filtering process to a network server, for example, a memory in the image data processing apparatus 1.
The data uploading module 12 is configured to upload image data in the network uploading cache to a network server based on a current network state;
in a specific implementation, the data uploading module 12 may upload the image data in the network uploading cache to the network server based on the current network state, and it may be understood that the quality of the current network state may be judged by using the most direct network speed, for example, an uploading network speed of 25 frames/S may indicate that the current network state is better, and an uploading network speed of 5 frames/S may indicate that the current network state is not good enough.
It can be understood that the image data in the network upload buffer is not always uploaded to the network server, and when the current network state is not good enough, a buffer memory of the image data is left in the network upload buffer.
A frame rate updating module 13, configured to, when a second detection time is reached, obtain data amount change information in a network upload cache between the first detection time and the second detection time, and update the image screening frame rate based on the data amount change information;
in a specific implementation, when a second detection time is reached, the frame rate updating module 13 may obtain data amount change information in the network upload buffer between the first detection time and the second detection time, and it may be understood that the second detection time may be a time when a preset detection time arrives, for example, the preset detection time is 1min, and if the first detection time is a start time of network live broadcast by the terminal device, the second detection time is a time after 1 min. Optionally, the frame rate updating module 13 may obtain the data amount change information by comparing a difference between buffer amounts in a network upload buffer at the first detection time and the second detection time. It is to be understood that the data amount change information may be information that the amount of buffering of the image data increases or information that the amount of buffering decreases.
Further, the frame rate updating module 13 may update the image screening frame rate based on the data amount change information, and optionally, when the data amount change information is information that the buffer storage amount of the image data increases, it indicates that the uploading speed of the image data is slower than the acquisition speed during the detection, the buffer storage amount of the image increases, and at this time, the image screening frame rate needs to be decreased, for example, the initial image screening frame rate is 60FPS, and 20FPS after the update, and after the image screening frame rate is decreased, 2 frames of images per 3 frames may be discarded, and only 1 frame is reserved, so that the quality of the video data composed of the uploaded images is ensured while the network resources are fully utilized. Optionally, when the data amount change information is information that the amount of buffering of the image data is reduced, it indicates that the uploading speed of the image data is faster than the acquisition speed during the detection period, and the amount of buffering of the image is reduced, at this time, the image number screening frame rate needs to be increased, for example, the original image screening frame rate is 20FPS, and is 40FPS after updating, and after the image screening frame rate is increased, 2 frames of discarded images per 3 frames can be changed into 1 frame of discarded images per 3 frames, so that the image quality of the video is further improved.
In the embodiment of the invention, the image data collected from the first detection time is acquired, the image data is screened by adopting a preconfigured image screening frame rate, the image data after screening is added into a network uploading cache, the image data in the network uploading cache is uploaded to a network server based on the current network state, when the second detection time is reached, the data quantity change information in the network uploading cache between the first detection time and the second detection time is acquired, and the image screening frame rate is updated based on the data quantity change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is the preconfigured detection time length. The change of the buffer storage amount of the image data in the detection duration in the terminal equipment is analyzed, the screening frame rate of the image data is changed, the current network state can be timely obtained to update the image screening frame rate, the image screening frame rate is ensured to be adaptive to the network state, and the network live broadcast effect is further ensured.
Referring to fig. 8, a schematic structural diagram of another image data processing apparatus according to an embodiment of the present invention is provided. As shown in fig. 8, the image data processing apparatus 1 of the embodiment of the present invention may include: the device comprises a data processing module 11, a data uploading module 12, a frame rate updating module 13, an information obtaining module 14, an information confirming module 15, a change rate calculating module 16 and a duration updating module 17.
An information obtaining module 14, configured to obtain preset image acquisition configuration information, where the image acquisition configuration information includes a default screening frame rate and a default duration;
in a specific implementation, the information obtaining module 14 may obtain preset image collecting configuration information, and it is understood that the image collecting configuration information may include a default filtering frame rate and a default duration, where the default filtering frame rate may be a collecting frame rate when the image data processing device 1 collects image data, for example, may be a camera physical collecting frame rate 60FPS, and the default duration may be a detection duration when the image data processing device first filters image data, for example, may be 1min or another reasonable time period.
An information confirmation module 15, configured to determine the default filtering frame rate as an image filtering frame rate, and determine the default duration as a detection duration;
in a specific implementation, the information confirmation module 15 may determine the default filtering frame rate as an image filtering frame rate, and determine the default duration as a detection duration, where it is understood that the default filtering frame rate and the default duration may be initialization values of the image filtering frame rate and the detection duration when image data is first filtered.
The data processing module 11 is configured to acquire image data acquired from a first detection time, perform screening processing on the image data by using a preconfigured image screening frame rate, and add the image data after the screening processing to a network upload cache;
in a specific implementation, the data processing module 11 may acquire image data acquired from a first detection time, and it is understood that the data processing module 11 may acquire the image data by using its own camera function, or may acquire the image data captured by the camera through a communication connection with the camera. The first detection time may be any artificially determined start time, for example, the start time of network live broadcast by using a terminal device, or the detection time reached by a last detection time of the first detection time after a detection time length.
Further, the data processing module 11 may perform the filtering processing on the image data by using a preset image filtering frame rate, and it is understood that the image filtering frame rate may be a frame rate for filtering the image data before uploading the image data, for example, when the frame rate of the image data is 60FPS, and the preset image filtering frame rate is 20FPS, 2/3 of the acquired image data needs to be dropped, that is, only 1 frame is reserved for every 3 frames of image data.
Further, the data processing module 11 may add the image data after the filtering process to a network upload cache, and it is understood that the network upload cache may be an area where the image data processing apparatus stores the image data before uploading the image data after the filtering process to a network server, for example, a memory in the image data processing apparatus.
The data uploading module 12 is configured to upload image data in the network uploading cache to a network server based on a current network state;
in a specific implementation, the data uploading module 12 may upload the image data in the network uploading cache to the network server based on the current network state, and it may be understood that the quality of the current network state may be judged by using the most direct network speed, for example, an uploading network speed of 25 frames/S may indicate that the current network state is better, and an uploading network speed of 5 frames/S may indicate that the current network state is not good enough.
It can be understood that the image data in the network upload buffer is not always uploaded to the network server, and when the current network state is not good enough, a buffer memory of the image data is left in the network upload buffer.
A frame rate updating module 13, configured to, when a second detection time is reached, obtain data amount change information in a network upload cache between the first detection time and the second detection time, and update the image screening frame rate based on the data amount change information;
in a specific implementation, when the second detection time is reached, the frame rate updating module 13 may obtain data amount variation information in the network upload buffer between the first detection time and the second detection time, and update the image screening frame rate based on the data amount variation information.
Please refer to fig. 9, which is a schematic structural diagram of a frame rate update module according to an embodiment of the present invention. As shown in fig. 9, the frame rate updating module 13 may include:
a buffer amount obtaining unit 131, configured to obtain a first buffer amount of the network upload buffer at the first detection time when a second detection time is reached, and obtain a second buffer amount of the network upload buffer at the second detection time;
in specific implementation, when the second detection time is reached, the buffer amount obtaining unit 131 may obtain the first buffer amount uploaded by the network at the first detection time, and it can be understood that the second detection time may be a time when a preset detection time arrives, for example, the preset detection time is 1min, and if the first detection time is a start time of the network live broadcast by the terminal device, the second detection time is a time after 1 min. The first buffer amount may be a buffer amount of image data stored in the network upload buffer at the first detection time, and may be 10 frames, for example. Alternatively, the first buffer amount may be acquired and stored by the image data processing apparatus 1 at the first detection time, and may be directly acquired when the second detection time is reached.
Further, the buffer amount obtaining unit 131 may obtain a second buffer amount of the network upload buffer at a second detection time, and it is understood that the second buffer amount may be a buffer amount of the image data stored in the network upload buffer at the second detection time, and may be 15 frames or 9 frames, for example.
A frame rate updating unit 132, configured to obtain a data amount change state and a data amount change value in a network upload buffer between the first detection time and the second detection time according to the first buffer amount and the second buffer amount, and update the image screening frame rate based on the data amount change state and the data amount change value;
in a specific implementation, the frame rate updating unit 132 may obtain a data amount change state and a data amount change value in the network upload buffer between the first detection time and the second detection time according to the first buffer amount and the second buffer amount, and it is understood that the data amount change state may be a difference state between the buffer amounts in the network upload buffer between the first detection time and the second detection time, for example, when the difference is positive, the data amount change state is a data amount increase state, and when the difference is negative, the data amount change state is a data amount decrease state. The data amount change value may be a specific value of the above difference value, and may be, for example, 5 frames or-1 frame or the like.
Further, the frame rate updating unit 132 may update the image screening frame rate based on the data amount change state and the data amount change value, and optionally, when the data amount change state is a data amount increase state, update the image screening frame rate by obtaining a data amount increase value, for example, reduce the image screening frame rate according to the data amount increase value. Optionally, when the data amount change state is a data amount decrease state, the image filtering frame rate is updated by obtaining a data amount decrease value, for example, the image filtering frame rate is increased according to the data amount increase value.
The change rate calculation module 16 is configured to calculate a data volume change rate in the network upload cache between the first detection time and the second detection time according to the data volume change value;
in a specific implementation, the change rate calculation module 16 may calculate the data volume change rate in the network upload buffer between the first detection time and the second detection time based on the data volume change value, for example, when the buffer amount at the first detection time is 10 frames and the buffer amount at the second detection time is 15 frames, the data volume change value is 5 frames, so that the increase rate, which is the data volume change rate in the network upload buffer between the first detection time and the second detection time, may be calculated to be (5/10) × 100% × 50%, and when the buffer amount at the first detection time is 10 frames and the buffer amount at the second detection time is 9 frames, the data volume change value is-1 frame and the data volume change rate, which is the decrease rate, is (1/10) × 100% × 10%.
A duration updating module 17, configured to update the detection duration based on the data volume change rate;
in a specific implementation, the duration updating module 17 may update the detection duration based on the data volume change rate. Optionally, the duration updating module 17 may preset a change rate threshold according to practical experience as a reference value of the data volume change rate, for example, when the data volume change rate is greater than or equal to a first preset change rate threshold, it may be considered that a problem that a detection duration is likely to have a larger value when the buffer amount changes faster, and at this time, the detection duration may be reduced; when the data volume change rate is smaller than or equal to a second preset change rate threshold, it can be considered that the detection duration is possibly small in value when the buffer storage volume changes slowly, and at this time, the detection duration can be increased; when the data volume change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold, it may be considered that the comparison of the buffer amount change is moderate, at this time, the detection duration may be kept unchanged, it may be understood that the data volume change rate may be an increase rate or a decrease rate, the first preset change rate threshold is larger than the second preset change rate threshold, for example, the first preset change rate threshold may be 20%, and the second preset change rate threshold may be 10%.
In a specific implementation manner of the embodiment of the present invention, as shown in fig. 10, the frame rate updating unit 132 may include:
a frame rate reduction subunit 1321, configured to, when the second buffer amount is greater than the first buffer amount, determine that a data amount change state in the network upload buffer between the first detection time and the second detection time is a data amount increase state, obtain a data amount increase value between the first buffer amount and the second buffer amount, and reduce the image screening frame rate according to the data amount increase value;
in a specific implementation, when the second buffer amount is greater than the first buffer amount, the frame rate reduction subunit 1321 may determine that a data amount change state in the network upload buffer between the first detection time and the second detection time is a data amount increase state, for example, when the first buffer amount is 10 frames and the second buffer amount is 12 frames, the data amount change state is a data amount increase state, and further, the frame rate reduction subunit 1321 may obtain a data amount increase value between the first buffer amount and the second buffer amount, for example, the data amount increase value is 2 frames.
Further, the frame rate reduction sub-unit 1321 may reduce the image screening frame rate according to the data amount increase value, for example, the starting image screening frame rate is 60FPS, the data amount increase value within the detection time (which may be set to 1min) is 2 frames, that is, the buffer of the image data within 1min is increased by 2 frames, which indicates that the current network state is not good enough, and the image screening frame rate needs to be reduced, so that the use rate of the network is improved as much as possible while the picture quality of the video data composed of the image data is ensured, for example, the image screening frame rate may be reduced to 20 FPS.
A frame rate increasing subunit 1322, configured to determine, when the second buffer amount is smaller than the first buffer amount, that a data amount change state in the network upload buffer between the first detection time and the second detection time is a data amount decrease state, obtain a data amount decrease value between the first buffer amount and the second buffer amount, and increase the image screening frame rate according to the data amount decrease value;
in a specific implementation, when the second buffer amount is smaller than the first buffer amount, the frame rate increasing subunit 1322 may determine that the data amount change state in the network upload buffer between the first detection time and the second detection time is a data amount decrease state, for example, when the first buffer amount is 10 frames and the second buffer amount is 7 frames, the data amount change state is a data amount decrease state, and further, the frame rate increasing subunit 1322 may obtain a data amount decrease value between the first buffer amount and the second buffer amount, for example, an increase value of the data amount is 3 frames.
Further, the frame rate increasing subunit 1322 may increase the image filtering frame rate according to the data amount reduction value, for example, the initial image filtering frame rate is 40FPS, and the data amount reduction value within the detection time (which may be set to 1min) is 3 frames, that is, the buffering of the image data within 1min is reduced by 3 frames, which indicates that the image filtering frame rate needs to be increased when the current network state is better, and may further improve the picture quality of the video data composed of the image data, for example, the image filtering frame rate may be increased to 50 FPS.
In the embodiment of the invention, the updating of the image screening frame rate is realized through the increased or decreased data volume, and the rationality of the updating of the image screening frame rate is improved.
In a specific implementation manner of the embodiment of the present invention, as shown in fig. 10, the duration updating module 17 may include:
a duration reduction unit 171 configured to reduce the detection duration when the data amount change rate is greater than or equal to a first preset change rate threshold;
in a specific implementation, when the data amount change rate is greater than or equal to a first preset change rate threshold, the duration reduction unit 171 may reduce the detection duration, for example, the data amount change rate is 30%, which indicates that the buffer amount of the image data is increased or decreased by 30% within 1min of the detection duration, the change is fast, and the detection duration needs to be reduced to ensure that the change condition of the data amount in the network upload buffer can be obtained faster, so as to facilitate timely updating the image screening frame rate, so that the change of the data amount in the network upload buffer tends to be within a suitable range (the range may be obtained by long-term practical experience), for example, the detection duration 1min may be changed to 0.5 min.
A duration increasing unit 172, configured to increase the detection duration when the data amount change rate is less than or equal to a second preset change rate threshold;
in a specific implementation, when the data amount change rate is less than or equal to the second preset change rate threshold, the duration increasing unit 172 may increase the detection duration, for example, the data amount change rate is 8%, which indicates that the buffer amount of the image data is increased or decreased by 8% within 1min of the detection duration, the change is slow, the detection duration may be increased, the image screening frame rate does not need to be updated too frequently, and for example, the detection duration 1min may be changed to 1.5 min.
A duration holding unit 173 configured to hold the detection duration when the data amount change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold;
in a specific implementation, when the data amount change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold, the duration holding unit 173 may hold the detection duration, for example, the data amount change rate is 15%, which indicates that the buffer amount of the image data is increased or decreased by 15% within 1min of the detection duration, and the buffer amount change range of the image data is within the empirical range, so that the original detection duration may be maintained unchanged.
In the embodiment of the invention, the detection duration is updated by analyzing the data volume change rate, so that the adaptability of the detection duration along with the change of the network state is ensured, and the rationality of updating the image screening frame rate based on the detection duration is improved.
In the embodiment of the invention, the image data collected from the first detection time is acquired, the image data is screened by adopting a preconfigured image screening frame rate, the image data after screening is added into a network uploading cache, the image data in the network uploading cache is uploaded to a network server based on the current network state, when the second detection time is reached, the data quantity change information in the network uploading cache between the first detection time and the second detection time is acquired, and the image screening frame rate is updated based on the data quantity change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is the preconfigured detection time length. The filtering frame rate of the image data is changed by analyzing the change of the buffer storage amount of the image data in the detection duration in the terminal equipment, so that the current network state can be obtained in time to update the image filtering frame rate, the image filtering frame rate is ensured to be adaptive to the network state, and the network live broadcast effect is further ensured; the updating of the image screening frame rate is realized through the increased or decreased data volume, and the rationality of the updating of the image screening frame rate is improved; the detection duration is updated by analyzing the data volume change rate, so that the adaptability of the detection duration along with the change of the network state is ensured, and the rationality of updating the image screening frame rate based on the detection duration is improved.
An embodiment of the present invention further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the method steps in the embodiments shown in fig. 1 to 6, and a specific execution process may refer to specific descriptions of the embodiments shown in fig. 1 to 6, which are not described herein again.
Fig. 12 is a schematic structural diagram of a terminal according to an embodiment of the present invention. As shown in fig. 12, the terminal 1000 can include: at least one processor 1001, such as a CPU, at least one network interface 1004, a user interface 1003, memory 1005, at least one communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display) and a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a standard wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 1005 may optionally be at least one memory device located remotely from the processor 1001. As shown in fig. 12, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an image data processing application program.
In the server 1000 shown in fig. 12, the user interface 1003 is mainly used as an interface for providing input for a user, and acquiring data input by the user; the network interface 1004 is used for data communication with the user terminal; and the processor 1001 may be configured to invoke an image data processing application stored in the memory 1005 and specifically perform the following operations:
acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache;
uploading the image data in the network uploading cache to a network server based on the current network state;
when a second detection time is reached, acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information;
the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
In one embodiment, the processor 1001 further performs the following operations before performing the acquisition of the image data acquired from the first detection time:
acquiring preset image acquisition configuration information, wherein the image acquisition configuration information comprises a default screening frame rate and a default duration;
and determining the default screening frame rate as an image screening frame rate, and determining the default duration as a detection duration.
In one embodiment, when the processor 1001 acquires data amount change information in a network upload buffer between the first detection time and the second detection time when the second detection time is reached, and updates the image filtering frame rate based on the data amount change information, the following operations are specifically performed:
when a second detection time is reached, acquiring a first buffer amount of the network uploading cache at the first detection time, and acquiring a second buffer amount of the network uploading cache at the second detection time;
and acquiring a data volume change state and a data volume change value in a network uploading cache between the first detection time and the second detection time according to the first buffer amount and the second buffer amount, and updating the image screening frame rate based on the data volume change state and the data volume change value.
In one embodiment, when the processor 1001 obtains a data amount change state and a data amount change value in a network upload buffer between the first detection time and the second detection time according to the first buffer amount and the second buffer amount, and updates the image filtering frame rate based on the data amount change state and the data amount change value, specifically:
when the second buffer amount is larger than the first buffer amount, determining that a data volume change state in a network uploading buffer between the first detection time and the second detection time is a data volume increase state, acquiring a data volume increase value between the first buffer amount and the second buffer amount, and reducing the image screening frame rate according to the data volume increase value;
when the second buffer amount is smaller than the first buffer amount, determining that a data amount change state in a network uploading buffer between the first detection time and the second detection time is a data amount reduction state, acquiring a data amount reduction value between the first buffer amount and the second buffer amount, and increasing the image screening frame rate according to the data amount reduction value.
In one embodiment, the processor 1001 is further configured to:
calculating the data volume change rate in the network uploading cache between the first detection time and the second detection time according to the data volume change value;
and updating the detection duration based on the data volume change rate.
In one embodiment, when the processor 1001 updates the detection duration based on the data volume change rate, the following operations are specifically performed:
when the data volume change rate is greater than or equal to a first preset change rate threshold value, reducing the detection duration;
when the data volume change rate is smaller than or equal to a second preset change rate threshold value, increasing the detection duration;
when the data volume change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold, keeping the detection duration;
wherein the first preset rate of change threshold is greater than the second preset rate of change threshold.
In the embodiment of the invention, the image data collected from the first detection time is acquired, the image data is screened by adopting a preconfigured image screening frame rate, the image data after screening is added into a network uploading cache, the image data in the network uploading cache is uploaded to a network server based on the current network state, when the second detection time is reached, the data quantity change information in the network uploading cache between the first detection time and the second detection time is acquired, and the image screening frame rate is updated based on the data quantity change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is the preconfigured detection time length. The filtering frame rate of the image data is changed by analyzing the change of the buffer storage amount of the image data in the detection duration in the terminal equipment, so that the current network state can be obtained in time to update the image filtering frame rate, the image filtering frame rate is ensured to be adaptive to the network state, and the network live broadcast effect is further ensured; the updating of the image screening frame rate is realized through the increased or decreased data volume, and the rationality of the updating of the image screening frame rate is improved; the detection duration is updated by analyzing the data volume change rate, so that the adaptability of the detection duration along with the change of the network state is ensured, and the rationality of updating the image screening frame rate based on the detection duration is improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims (14)

1. An image data processing method characterized by comprising:
acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, adding the screened image data into a network uploading cache, and adding discarded image data into a discarded data storage area; the discarded image data is used for recovering the image data, and both the discarded image data and the image data after screening processing belong to the image data;
uploading the image data in the network uploading cache to a network server based on the current network state;
and when a second detection time is reached, acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information, wherein the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
2. The method of claim 1, wherein prior to acquiring the image data acquired from the first detection time, further comprising:
acquiring preset image acquisition configuration information, wherein the image acquisition configuration information comprises a default screening frame rate and a default duration;
and determining the default screening frame rate as an image screening frame rate, and determining the default duration as a detection duration.
3. The method of claim 1, wherein the obtaining data amount variation information in a network upload buffer between the first detection time and the second detection time when the second detection time is reached, and updating the image filtering frame rate based on the data amount variation information comprises:
when a second detection time is reached, acquiring a first buffer amount of the network uploading cache at the first detection time, and acquiring a second buffer amount of the network uploading cache at the second detection time;
and acquiring a data volume change state and a data volume change value in a network uploading cache between the first detection time and the second detection time according to the first buffer amount and the second buffer amount, and updating the image screening frame rate based on the data volume change state and the data volume change value.
4. The method of claim 3, wherein the obtaining a data volume change state and a data volume change value in a network upload buffer between the first detection time and the second detection time according to the first buffer amount and the second buffer amount, and updating the image filtering frame rate based on the data volume change state and the data volume change value comprises:
when the second buffer amount is larger than the first buffer amount, determining that a data volume change state in a network uploading buffer between the first detection time and the second detection time is a data volume increase state, acquiring a data volume increase value between the first buffer amount and the second buffer amount, and reducing the image screening frame rate according to the data volume increase value;
when the second buffer amount is smaller than the first buffer amount, determining that a data amount change state in a network uploading buffer between the first detection time and the second detection time is a data amount reduction state, acquiring a data amount reduction value between the first buffer amount and the second buffer amount, and increasing the image screening frame rate according to the data amount reduction value.
5. The method of claim 3, further comprising:
calculating the data volume change rate in the network uploading cache between the first detection time and the second detection time according to the data volume change value;
and updating the detection duration based on the data volume change rate.
6. The method of claim 5, wherein the updating the detection duration based on the data volume change rate comprises:
when the data volume change rate is greater than or equal to a first preset change rate threshold value, reducing the detection duration;
when the data volume change rate is smaller than or equal to a second preset change rate threshold value, increasing the detection duration;
when the data volume change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold, keeping the detection duration;
wherein the first preset rate of change threshold is greater than the second preset rate of change threshold.
7. An image data processing apparatus characterized by comprising:
the data processing module is used for acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, adding the image data subjected to screening processing into a network uploading cache, and adding discarded image data into a discarded data storage area; the discarded image data is used for recovering the image data, and both the discarded image data and the image data after screening processing belong to the image data;
the data uploading module is used for uploading the image data in the network uploading cache to a network server based on the current network state;
the frame rate updating module is used for acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time when the second detection time is reached, and updating the image screening frame rate based on the data quantity change information;
the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
8. The apparatus of claim 7, further comprising:
the information acquisition module is used for acquiring preset image acquisition configuration information, wherein the image acquisition configuration information comprises a default screening frame rate and a default time length;
and the information confirmation module is used for determining the default screening frame rate as the image screening frame rate and determining the default duration as the detection duration.
9. The device of claim 7, wherein the frame rate update module comprises:
the buffer amount obtaining unit is used for obtaining a first buffer amount uploaded and cached by the network at a first detection time when a second detection time is reached, and obtaining a second buffer amount uploaded and cached by the network at the second detection time;
and the frame rate updating unit is used for acquiring a data volume change state and a data volume change value in a network uploading cache between the first detection time and the second detection time according to the first buffer amount and the second buffer amount, and updating the image screening frame rate based on the data volume change state and the data volume change value.
10. The device of claim 9, wherein the frame rate update unit comprises:
a frame rate reduction subunit, configured to, when the second buffer amount is greater than the first buffer amount, determine that a data amount change state in a network upload buffer between the first detection time and the second detection time is a data amount increase state, obtain a data amount increase value between the first buffer amount and the second buffer amount, and reduce the image screening frame rate according to the data amount increase value;
and the frame rate increasing subunit is configured to, when the second buffer amount is smaller than the first buffer amount, determine that a data amount change state in the network upload buffer between the first detection time and the second detection time is a data amount decrease state, obtain a data amount decrease value between the first buffer amount and the second buffer amount, and increase the image screening frame rate according to the data amount decrease value.
11. The apparatus of claim 9, further comprising:
the change rate calculation module is used for calculating the data volume change rate in the network uploading cache between the first detection time and the second detection time according to the data volume change value;
and the duration updating module is used for updating the detection duration based on the data volume change rate.
12. The apparatus of claim 11, the duration update module comprising:
a duration reduction unit configured to reduce the detection duration when the data amount change rate is greater than or equal to a first preset change rate threshold;
a duration increasing unit configured to increase the detection duration when the data amount change rate is less than or equal to a second preset change rate threshold;
a duration holding unit, configured to hold the detection duration when the data amount change rate is smaller than the first preset change rate threshold and larger than the second preset change rate threshold;
wherein the first preset rate of change threshold is greater than the second preset rate of change threshold.
13. A computer storage medium having stored thereon a plurality of instructions adapted to be loaded by a processor and to perform the steps of:
acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache; adding the discarded image data to a discarded-data storage area; the discarded image data is used for recovering the image data, and both the discarded image data and the image data after screening processing belong to the image data;
uploading the image data in the network uploading cache to a network server based on the current network state;
when a second detection time is reached, acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information;
the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
14. A terminal, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the steps of:
acquiring image data collected from a first detection moment, screening the image data by adopting a preset image screening frame rate, and adding the screened image data into a network uploading cache; adding the discarded image data to a discarded-data storage area; the discarded image data is used for recovering the image data, and both the discarded image data and the image data after screening processing belong to the image data;
uploading the image data in the network uploading cache to a network server based on the current network state;
when a second detection time is reached, acquiring data quantity change information in a network uploading cache between the first detection time and the second detection time, and updating the image screening frame rate based on the data quantity change information;
the second detection time is the next detection time of the first detection time, and the time length between the first detection time and the second detection time is a preset detection time length.
CN201710401614.4A 2017-05-31 2017-05-31 Image data processing method and equipment, storage medium and terminal thereof Active CN108989832B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710401614.4A CN108989832B (en) 2017-05-31 2017-05-31 Image data processing method and equipment, storage medium and terminal thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710401614.4A CN108989832B (en) 2017-05-31 2017-05-31 Image data processing method and equipment, storage medium and terminal thereof

Publications (2)

Publication Number Publication Date
CN108989832A CN108989832A (en) 2018-12-11
CN108989832B true CN108989832B (en) 2021-12-10

Family

ID=64501102

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710401614.4A Active CN108989832B (en) 2017-05-31 2017-05-31 Image data processing method and equipment, storage medium and terminal thereof

Country Status (1)

Country Link
CN (1) CN108989832B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110324654A (en) * 2019-08-02 2019-10-11 广州虎牙科技有限公司 Main broadcaster end live video frame processing method, device, equipment, system and medium
CN112788265B (en) * 2019-11-11 2024-02-02 浙江宇视科技有限公司 Video data storage method and device, image acquisition equipment and readable storage medium
CN111511002B (en) * 2020-04-23 2023-12-05 Oppo广东移动通信有限公司 Method and device for adjusting detection frame rate, terminal and readable storage medium
CN111682980A (en) * 2020-05-28 2020-09-18 西安万像电子科技有限公司 Image coding method and device
CN113824992B (en) * 2020-06-19 2023-04-14 京东方科技集团股份有限公司 Terminal and uploading method, server and monitoring method, medium, equipment and system
CN112350958B (en) * 2020-10-30 2024-01-23 深圳Tcl新技术有限公司 Voice data dynamic uploading method, internet of things equipment and storage medium
CN113132637B (en) * 2021-04-19 2023-04-07 Oppo广东移动通信有限公司 Image processing method, image processing chip, application processing chip and electronic equipment

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1956508A (en) * 2005-10-27 2007-05-02 夏普株式会社 Receiver, transmitting/receiving system, and communication method
CN101228748A (en) * 2005-06-28 2008-07-23 诺基亚公司 Optimizing playback startup time of bursty real-time streams
CN101552909A (en) * 2009-04-28 2009-10-07 山东大学 Frame rate controlling method based on wireless video monitoring
CN101583025A (en) * 2009-06-11 2009-11-18 中兴通讯股份有限公司 Streaming media playing method and device
CN102945583A (en) * 2012-12-07 2013-02-27 南京大学 Anti-theft detecting method for mobile equipment based on Bluetooth communication
CN103702119A (en) * 2013-12-20 2014-04-02 电子科技大学 Code rate control method based on variable frame rate in low delay video coding
CN104683762A (en) * 2015-01-29 2015-06-03 中国人民解放军理工大学 Unmanned aerial vehicle video wireless self-adapted transmission method and system based on buffering occupation ratio
CN105812902A (en) * 2016-03-17 2016-07-27 联发科技(新加坡)私人有限公司 Data play method, device and system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008311831A (en) * 2007-06-13 2008-12-25 Panasonic Corp Moving image communication equipment, moving image communication system, and semiconductor integrated circuit for moving image communication
JP4561851B2 (en) * 2008-03-18 2010-10-13 カシオ計算機株式会社 Imaging apparatus, imaging method, and imaging program
US20090268097A1 (en) * 2008-04-28 2009-10-29 Siou-Shen Lin Scene change detection method and related apparatus according to summation results of block matching costs associated with at least two frames
JP2013110572A (en) * 2011-11-21 2013-06-06 Sony Corp Reproduction apparatus, reproduction method, and program
CN108174224B (en) * 2012-07-03 2020-10-27 三星电子株式会社 Video encoding method and apparatus, and video decoding method and apparatus
US10224055B2 (en) * 2015-02-10 2019-03-05 Sony Semiconductor Solutions Corporation Image processing apparatus, image pickup device, image processing method, and program

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101228748A (en) * 2005-06-28 2008-07-23 诺基亚公司 Optimizing playback startup time of bursty real-time streams
CN1956508A (en) * 2005-10-27 2007-05-02 夏普株式会社 Receiver, transmitting/receiving system, and communication method
CN101552909A (en) * 2009-04-28 2009-10-07 山东大学 Frame rate controlling method based on wireless video monitoring
CN101583025A (en) * 2009-06-11 2009-11-18 中兴通讯股份有限公司 Streaming media playing method and device
CN102945583A (en) * 2012-12-07 2013-02-27 南京大学 Anti-theft detecting method for mobile equipment based on Bluetooth communication
CN103702119A (en) * 2013-12-20 2014-04-02 电子科技大学 Code rate control method based on variable frame rate in low delay video coding
CN104683762A (en) * 2015-01-29 2015-06-03 中国人民解放军理工大学 Unmanned aerial vehicle video wireless self-adapted transmission method and system based on buffering occupation ratio
CN105812902A (en) * 2016-03-17 2016-07-27 联发科技(新加坡)私人有限公司 Data play method, device and system

Also Published As

Publication number Publication date
CN108989832A (en) 2018-12-11

Similar Documents

Publication Publication Date Title
CN108989832B (en) Image data processing method and equipment, storage medium and terminal thereof
CN108495142B (en) Video coding method and device
CN108124194B (en) Video live broadcast method and device and electronic equipment
CN110557670B (en) Method, device, terminal and storage medium for playing video in webpage
CN106303157B (en) Video noise reduction processing method and video noise reduction processing device
EP3253064A1 (en) Frame loss method for video frame and video sending apparatus
CN109089131B (en) Screen recording live broadcast method, device, equipment and storage medium based on IOS system
CN107483401B (en) Multimedia data transmission method and equipment, storage medium and server thereof
JP2015115947A (en) Robust automatic exposure control using embedded data
JP7295950B2 (en) Video enhancement control method, device, electronic device and storage medium
CN108235120B (en) Live video stream pushing method and device and electronic equipment
CN108347580B (en) Method for processing video frame data and electronic equipment
KR20150040872A (en) System and method for encoding video content using virtual intra-frames
CN104580907A (en) Anti-shake photographing method and device
US10389785B2 (en) Method for adaptively streaming an audio/visual material
CN103327252A (en) Shooting device and shooting method thereof
CN112399123B (en) Video definition adjusting method and device, electronic equipment and storage medium
CN104244101A (en) Method and device for commenting multimedia content
KR20160095058A (en) Handling video frames compromised by camera motion
CN105306830B (en) A kind of camera control method and device
CN114245196B (en) Screen recording and stream pushing method and device, electronic equipment and storage medium
CN113691859A (en) Video caching method, device, equipment and medium
CN107333147B (en) Video buffer control method, terminal and storage device
CN105391940A (en) Image recommendation method and apparatus
CN110913118B (en) Video processing method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant