CN115914228A - Data processing method, device, storage medium and computer program product - Google Patents

Data processing method, device, storage medium and computer program product Download PDF

Info

Publication number
CN115914228A
CN115914228A CN202211445107.8A CN202211445107A CN115914228A CN 115914228 A CN115914228 A CN 115914228A CN 202211445107 A CN202211445107 A CN 202211445107A CN 115914228 A CN115914228 A CN 115914228A
Authority
CN
China
Prior art keywords
data
reference frame
long
test
decoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202211445107.8A
Other languages
Chinese (zh)
Other versions
CN115914228B (en
Inventor
张佳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202211445107.8A priority Critical patent/CN115914228B/en
Publication of CN115914228A publication Critical patent/CN115914228A/en
Application granted granted Critical
Publication of CN115914228B publication Critical patent/CN115914228B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Mobile Radio Communication Systems (AREA)

Abstract

The embodiment of the application discloses a data processing method, a data processing device, a storage medium and a computer program product, and related embodiments of the data processing method and the storage medium can be applied to the scenes of cloud technology, artificial intelligence, the Internet of things, medical treatment and the like. The method comprises the following steps: the terminal equipment responds to the detection request from the server, and decodes the test coded data based on the long-acting reference frame to obtain a decoding result indicating whether the terminal equipment successfully decodes the test coded data; sending detection information indicating whether the terminal equipment has the capacity of successfully decoding the data configured with the long-acting reference frame to the server based on the decoding result, so that the server encodes the target data to obtain encoded target data comprising the long-acting reference frame under the condition that the detection information indicates that the terminal equipment has the capacity of successfully decoding the data configured with the long-acting reference frame; and receiving the encoded target data, and decoding the encoded target data to obtain the target data based on the long-acting reference frame in the encoded target data, so that the decoding efficiency can be improved.

Description

Data processing method, device, storage medium and computer program product
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data processing method, apparatus, storage medium, and computer program product.
Background
Currently, in the data transmission process between different devices (such as a terminal device and a server), it is necessary to determine the data transmission mode according to the network state. Taking the example of the server transmitting data to the terminal device, in the case of a poor network state (such as unstable wireless network signal or network congestion), the server may selectively discard some encoded frames to reduce the network load, so as to synchronize the data received by the terminal device with the data sent by the server. However, in the decoding process of the terminal device, if the subsequent frames still need to use the discarded frames as reference frames, the decoding may fail. In this case, the server may perform data retransmission, and the terminal device may still fail to decode, resulting in low decoding efficiency.
Disclosure of Invention
Embodiments of the present invention provide a data processing method, an apparatus, a storage medium, and a computer program product, which can improve decoding efficiency.
An embodiment of the present application provides a data processing method, including:
the terminal equipment receives a detection request of long-acting reference frame capability from a server;
the terminal equipment responds to the detection request to obtain the test coding data configured with the long-acting reference frame, and decodes the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a frame reference coding frame of which the number of the coded data to be tested is larger than a preset number threshold value in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data;
the terminal device sends detection information to the server based on the decoding result, wherein the detection information is used for indicating whether the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame or not, so that the server encodes the target data to obtain the encoded target data under the condition that the detection information indicates that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame; the encoded target data comprises a long-term reference frame;
and the terminal equipment receives the encoded target data from the server and decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
In one aspect, an embodiment of the present application provides a data processing method, where the method includes:
the server sends a detection request of the long-acting reference frame capability to the terminal equipment so that the terminal equipment responds to the detection request to obtain the test coding data configured with the long-acting reference frame, and the test coding data are decoded based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a frame reference coding frame of which the number is greater than a preset number threshold in the coded data to be tested in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data;
the server receives detection information sent by the terminal equipment based on the decoding result; the detection information is used for indicating whether the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame;
under the condition that the detection information indicates that the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame, the server encodes the target data to obtain encoded target data; the encoded target data comprises a long-acting reference frame;
and the server sends the encoded target data to the terminal equipment so that the terminal equipment decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
An embodiment of the present application provides a data processing apparatus, including:
a communication module for receiving a probe request for long-term reference frame capability from a server;
the acquisition module is used for responding to the detection request to acquire the test coding data configured with the long-acting reference frame and decoding the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a frame reference coding frame of which the number is greater than a preset number threshold in the coded data to be tested in the decoding process; the decoding result is used for indicating whether the data processing device successfully decodes the test coded data;
the communication module is further used for sending detection information to the server based on the decoding result, wherein the detection information is used for indicating whether the data processing device has the capability of successfully decoding the data configured with the long-acting reference frame or not, so that the server encodes the target data to obtain the encoded target data under the condition that the detection information indicates that the data processing device has the capability of successfully decoding the data configured with the long-acting reference frame; the encoded target data comprises a long-term reference frame;
the communication module is also used for receiving the encoded target data from the server;
and the processing module is used for decoding the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
An embodiment of the present application provides a data processing apparatus, including:
the communication module is used for sending a detection request of the long-acting reference frame capability to the terminal equipment so that the terminal equipment responds to the detection request to obtain the test coding data configured with the long-acting reference frame, and decoding the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a frame reference coding frame of which the number is greater than a preset number threshold in the coded data to be tested in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data;
the communication module is also used for receiving detection information sent by the terminal equipment based on the decoding result; the detection information is used for indicating whether the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame;
the processing module is used for coding the target data under the condition that the detection information indicates that the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame to obtain the coded target data; the encoded target data comprises a long-acting reference frame;
the communication module is further configured to send the encoded target data to the terminal device, so that the terminal device decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
In an aspect, an embodiment of the present application provides a computer device, which includes a memory and a processor, where the memory stores a computer program, and when the computer program is executed by the processor, the processor is caused to execute a data processing method provided in an embodiment of the present application.
In one aspect, the present invention provides a computer storage medium, in which a computer program is stored, where the computer program includes program instructions, and when the program instructions are executed by a processor, the computer program executes a data processing method provided in the present invention.
An aspect of the embodiments of the present application provides a computer program product or a computer program, where the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium, and when the computer instructions are executed by a processor of a computer device, the computer instructions execute the data processing method provided by the embodiments of the present application.
In the embodiment of the application, before acquiring the encoded target data sent by the server, the terminal device can detect whether the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, and send the detection information indicating the detection result to the server, so that the server can encode the target data by adopting an encoding mode including the long-acting reference frame under the condition that the server receives the data configured with the long-acting reference frame successfully decoded by the terminal device, and the terminal device can successfully decode the encoded target data based on the long-acting reference frame in the encoded target data after receiving the encoded target data returned by the server, thereby being beneficial to improving the decoding efficiency.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is an architecture diagram of a data processing system provided by an embodiment of the present application;
fig. 2 is a schematic flowchart of a data processing method according to an embodiment of the present application;
FIG. 3 is a schematic flow chart diagram of another data processing method provided in the embodiments of the present application;
FIG. 4 is a schematic flow chart diagram illustrating a further data processing method provided in an embodiment of the present application;
fig. 5 is a schematic flowchart of a further data processing method provided in an embodiment of the present application;
fig. 6 is a schematic flowchart of a further data processing method provided in an embodiment of the present application;
fig. 7 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application;
FIG. 8 is a schematic structural diagram of another data processing apparatus according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
The data processing method provided by the embodiment of the application can be applied to a data transmission scene, and specifically can be applied to one or more of the following scenes: cloud technology, artificial intelligence, smart traffic, vehicle navigation, and the like, and the cloud technology may specifically include one or more of medical cloud, cloud internet of things, cloud games, cloud education, cloud conference, cloud social, and the like.
The cloud technology (cloud technology) is a hosting technology for unifying series resources such as hardware, software, network and the like in a wide area network or a local area network to realize calculation, storage, processing and sharing of data.
The cloud technology is based on the general names of network technology, information technology, integration technology, management platform technology, application technology and the like applied in the cloud computing business model, can form a resource pool, is used as required, and is flexible and convenient. Cloud computing technology will become an important support. Background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture-like websites and more web portals. With the high development and application of the internet industry, each article may have an own identification mark and needs to be transmitted to a background system for logic processing, data of different levels can be processed separately, and various industry data need strong system background support and can be realized only through cloud computing.
The medical cloud (medical cloud) is a medical health service cloud platform created by using cloud computing on the basis of new technologies such as cloud computing, mobile technology, multimedia, 4G communication, big data and the Internet of things and combining with medical technology, and medical resource sharing and medical range expansion are achieved. Due to the combination of the cloud computing technology, the medical cloud improves the efficiency of medical institutions and brings convenience to residents to see medical advice. Like the appointment register, the medical insurance and the like of the existing hospital, the cloud computing and medical field are combined products, and the medical cloud also has the advantages of data security, information sharing, dynamic expansion and overall layout.
The cloud internet of things (cloud IOT) aims to connect information sensed by sensing equipment in the traditional Internet of things and received instructions into the Internet, really realizes networking, and realizes mass data storage and operation through a cloud computing technology.
Cloud gaming (cloud gaming) may also be called gaming on demand (gaming), which is an online gaming technology based on cloud computing technology. Cloud game technology enables light-end devices (thin clients) with relatively limited graphics processing and data computing capabilities to run high-quality games. In a cloud game scene, a game is not executed at a game terminal of a player, but is executed in a cloud server, the cloud server renders the game scene into a video and audio stream, and the video and audio stream is transmitted to the game terminal of the player through a network. The game terminal of the player does not need to have strong graphic operation and data processing capacity, and only needs to have basic streaming media playing capacity and capacity of acquiring input instructions of the player and sending the input instructions to the cloud server.
Cloud Computing Education (CCEDU) refers to an education platform service based on cloud computing business model application. On the cloud platform, all education institutions, training institutions, enrollment service institutions, propaganda institutions, industry associations, management institutions, industry media, legal structures and the like are integrated into a resource pool in a centralized cloud mode, all resources are mutually displayed and interacted and communicated according to needs to achieve intentions, so that education cost is reduced, and efficiency is improved.
The cloud conference is an efficient, convenient and low-cost conference form based on a cloud computing technology. A user can share voice, data files and videos with teams and clients all over the world quickly and efficiently only by performing simple and easy-to-use operation through an internet interface, and complex technologies such as transmission and processing of data in a conference are assisted by a cloud conference service provider to operate.
Cloud social interaction (cloud social) is a virtual social application mode of internet of things, cloud computing and mobile internet interactive application, aims to establish a famous resource sharing relationship map, and further develops network social interaction, and is mainly characterized in that a large number of social resources are uniformly integrated and evaluated to form a resource effective pool to provide services for users as required. The more users that participate in the sharing, the greater the value of the utility that can be created.
Optionally, the data processing method provided in the embodiment of the present application may specifically relate to one or more of cloud computing, cloud storage, and a cloud database in the cloud technology. For example, the target data can be encoded through cloud computing, or the test encoding data configured with the long-acting reference frame is acquired from a cloud database, or the encoded target data is stored through cloud storage.
Among them, cloud computing (cloud computing) is a computing mode that distributes computing tasks over a resource pool formed by a large number of computers, so that various application systems can acquire computing power, storage space, and information services as needed. The network that provides the resources is referred to as the "cloud". Resources in the "cloud" appear to the user as being infinitely expandable and available at any time, available on demand, expandable at any time, and paid for on-demand.
A distributed cloud storage system (hereinafter, referred to as a storage system) refers to a storage system that integrates a large number of storage devices (storage devices are also referred to as storage nodes) of different types in a network through application software or application interfaces to cooperatively work by using functions such as cluster application, grid technology, and a distributed storage file system, and provides a data storage function and a service access function to the outside.
Database (database), which can be regarded as an electronic file cabinet-a place for storing electronic files in short, a user can add, query, update, delete, etc. to data in files. A "database" is a collection of data that is stored together in a manner that can be shared by multiple users, has as little redundancy as possible, and is independent of the application.
Fig. 1 is a block diagram of a data processing system according to an embodiment of the present disclosure. The data processing system may comprise a terminal device 101 and a server 102. The terminal device 101 may be configured to receive and respond to a probe request of long-acting reference frame capability from the server 102 to obtain test encoding data configured with a long-acting reference frame, and decode the test encoding data based on the long-acting reference frame to obtain a decoding result, so as to send probe information to the server 102 based on the decoding result to indicate whether the terminal device 101 has a capability of successfully decoding data configured with the long-acting reference frame.
The long-acting reference frame refers to a coded frame which is referred by frames with the quantity larger than a preset quantity threshold value in the coded data to be tested in the decoding process. By the above method, under the condition that the terminal device 101 has the capability of successfully decoding the data configured with the long-acting reference frame, the terminal device 101 may receive the encoded target data including the long-acting reference frame from the server 102, and decode the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data, so that the terminal device 101 may use the long-acting reference frame as the reference frame in the decoding process to improve the decoding efficiency, and may also avoid decoding errors caused by the terminal device 101 using the short-acting reference frame as the reference frame, thereby improving the accuracy of decoding.
The server 102 may be configured to send a probe request of long-acting reference frame capability to the terminal device 101, and receive probe information sent by the terminal device 101 in response to the probe request, so that the server 102 obtains whether the terminal device 101 has a capability of successfully decoding data configured with a long-acting reference frame, and thus determines whether to encode using an encoding manner including the long-acting reference frame according to the capability of the terminal device 101. The server 102 may be further configured to, under the condition that the detection information indicates that the terminal device 101 has the capability of successfully decoding the data configured with the long-acting reference frame, encode target data to obtain encoded target data including the long-acting reference frame, and send the encoded target data to the terminal device 101, so that the terminal device 101 may use the long-acting reference frame as the reference frame in a process of decoding the encoded target data to improve decoding efficiency, and may also avoid a decoding error caused by the terminal device 101 using the short-acting reference frame as the reference frame, thereby improving decoding accuracy.
The Terminal 101 may also be referred to as a Terminal (Terminal), a User Equipment (UE), a client, an access Terminal, a subscriber unit, a mobile device, a user Terminal, a wireless communication device, a user agent, or a user equipment. The terminal device may be, but is not limited to, a smart home appliance, a handheld device (e.g., a smart phone, a tablet computer) with a wireless communication function, a computing device (e.g., a Personal Computer (PC), a vehicle-mounted terminal, a smart voice interaction device, a wearable device, or other smart devices, etc.).
The server 102 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, a cloud server providing basic cloud computing services such as cloud service, a cloud database, cloud computing, cloud function, cloud storage, web service, cloud communication, middleware service, domain name service, security service, CDN, and big data and artificial intelligence platform, and the like, but is not limited thereto. The terminal device 101 and the server 102 may be directly or indirectly connected through wired or wireless communication, and the present application is not limited thereto.
It has been found that some current terminal devices do not have the capability to successfully decode data configured with long-term reference frames. If the server directly uses the coding mode comprising the long-acting reference frame for coding, and sends the coded data containing the long-acting reference frame to the terminal equipment. Assuming that the terminal device does not have the capability to successfully decode the data configured with the long-acting reference frame, the terminal device decodes the encoded data in the manner of the short-acting reference frame, resulting in a decoding failure. Based on this, the technical solution of the embodiment of the present application is provided, and specifically, a server sends a probe request of a long-acting reference frame capability to a terminal device, and receives probe information sent by the terminal device in response to the probe request, so that the server obtains whether the terminal device has a capability of successfully decoding data configured with a long-acting reference frame, and determines whether to encode using an encoding method including the long-acting reference frame according to the capability of the terminal device.
Specifically, the terminal device is configured with a hardware decoder, and the terminal device decodes the encoded data through the hardware decoder, but the functions of the hardware decoders provided by different manufacturers are inconsistent, for example, part of the hardware decoder does not provide support for the long-term reference frame characteristics, that is, the hardware decoder cannot identify the long-term reference frame, and only decodes the encoded data in the manner of the short-term reference frame. For a terminal device configured with such a hardware decoder, the terminal device may be considered to be incapable of successfully decoding data configured with a long-term reference frame.
Referring to fig. 2, fig. 2 is a schematic flow chart of a data processing method according to an embodiment of the present disclosure. The data processing method can be applied to the data processing system shown in fig. 1, and is executed by the terminal device and the server, and specifically can be executed by a processor of the terminal device and a processor of the server. The data processing method comprises the following steps:
s201, a server sends a detection request of long-acting reference frame capability to terminal equipment; accordingly, the terminal device receives a probe request for long term reference frame capability from the server.
Wherein the long-term reference frame capability probe request can be used for detecting whether the terminal device has the capability of successfully decoding the data configured with the long-term reference frame. That is, the server may determine whether the terminal device can successfully decode the data configured with the long-acting reference frame by transmitting the probe request to the terminal device.
Note that the "probe request" is only a name used in the embodiment of the present application, and the name does not limit the embodiment of the present application. Alternatively, the "probe request" may also be referred to as a "detection request", a "test request", or an "acknowledgement request", and the present application is not limited thereto.
S202, the terminal equipment responds to the detection request to acquire the test coding data configured with the long-acting reference frame, and decodes the test coding data based on the long-acting reference frame.
It should be noted that, after the terminal device receives the probe request of the long-acting reference frame capability from the server, the terminal device may start the probe process of the long-acting reference frame capability in response to the probe request to determine whether itself can successfully decode the data configured with the long-acting reference frame.
Specifically, the terminal device may obtain the test coding data configured with the long-acting reference frame, and decode the test coding data based on the long-acting reference frame, so as to determine whether the terminal device can successfully decode the data configured with the long-acting reference frame according to the decoding result. The test encoding data may be sent to the terminal device by the server, for example, the test encoding data may be carried in a probe request sent by the server. Optionally, the test encoding data may also be pre-stored in the terminal device, which is not limited in this application.
The long-acting reference frame refers to a coded frame which is referred by frames with the quantity larger than a preset quantity threshold value in the coded data to be tested in the decoding process. The preset number threshold may be a value preset by the terminal device or the server, or may be a default value, which is not limited in this application. For example, assuming that the test encoding data has 15 frames and the preset number threshold is 10 frames, the encoding frame referred to by the 12 frames of test encoding data in the decoding process can be determined as the long-acting reference frame. That is, in the decoding process, the long-term reference frame may be decoded by a frame greater than a preset number threshold as a reference frame. The preset number threshold is 10 frames, which is only used for example and does not limit the present application.
Optionally, the coded frames referred to by the frames in the coded data under test whose number is less than or equal to the preset number threshold in the decoding process may be regarded as short-term reference frames. For example, assuming that the test coded data has 15 frames and the preset number threshold is 10 frames, the coded frame referred to by 8 frames of test coded data in the decoding process can be determined as a short reference frame. That is, in the decoding process, the short-lived reference frame may be decoded as a reference frame by a frame less than or equal to a preset number threshold.
In one implementation, the storage duration of the long-acting reference frame in the reference frame buffer may be longer than a preset storage duration. Optionally, the storage duration of the short-lived reference frame in the reference frame buffer may be less than or equal to the preset storage duration. The preset storage duration may be preset by the terminal device or the server, or may be set by default by the system, which is not limited in this application.
It can be understood that, since the long-term reference frame can be used as a reference frame by a number of frames greater than a preset number threshold, that is, the long-term reference frame can be referred to by a larger number of encoded frames, the long-term reference frame cannot be easily deleted, so as to avoid causing decoding errors of the encoded frames that need to refer to the long-term reference frame. Therefore, in the reference frame buffer, the storage duration of the long-acting reference frame may be longer than the preset storage duration. That is, long-term reference frames may remain in the reference frame buffer for long periods of time.
Optionally, since the short-lived reference frames may be used as reference frames by frames whose number is less than or equal to the preset number threshold, that is, the short-lived reference frames may be referred to by a smaller number of encoded frames, some short-lived reference frames may be selectively deleted in case of network congestion or unstable network signals, so as to reduce the pressure of data transmission, thereby enabling data transmission between the terminal device and the server to be consistent.
For example, assuming that the preset storage duration is 24h, in the reference buffer, the storage duration of the long-term reference frame may be greater than 24h, and the storage duration of the short-term reference frame may be less than or equal to 24h. The preset storage time period of 24h is only for example and is not limited to the application.
S203, if the terminal equipment successfully decodes the test coding data configured with the long-acting reference frame, the terminal equipment generates a decoding result used for indicating the terminal equipment to successfully decode the test coding data.
The decoding result can be used for indicating whether the terminal equipment successfully decodes the test coded data. That is, the decoding result may indicate that the terminal device successfully decoded the test encoded data, or may indicate that the terminal device unsuccessfully decoded the test encoded data. Specifically, the terminal device decodes the test coded data based on the long-acting reference frame, and may obtain the following decoding results:
decoding result one:
and if the terminal equipment acquires the error code in the decoding process, generating a decoding result for indicating that the terminal equipment does not successfully decode the test coded data. The error code may be returned to the terminal device through an Application Programming Interface (API). It should be noted that, if the terminal device acquires the error code in the decoding process, it may be indicated that the terminal device fails to successfully decode the test coded data configured with the long-acting reference frame, that is, the terminal device does not support the long-acting reference frame setting. Further, if the terminal device obtains the correct code in the decoding process, it cannot be said that the terminal device can successfully decode the test coded data configured with the long-acting reference frame, and further judgment needs to be performed on the decoding result. Optionally, specific content of the error code or the correct code may be preset by the terminal device or the server, or may be set by default by the system, which is not limited in this application.
And a second decoding result:
and if the terminal equipment does not acquire the feedback data after the preset time length from the beginning of decoding, generating a decoding result for indicating that the terminal equipment does not successfully decode the test coded data. Wherein, the feedback data can comprise error codes, correct codes, test decoding data and other data; the test decoding data may be data obtained by decoding the test encoding data based on the long-acting reference frame by the terminal device. The preset duration may be preset for the terminal device or the server, or may be default set for the system, which is not limited in this application.
That is, after the preset duration elapses from the start of decoding, if the terminal device does not acquire any feedback data, it may be stated that the terminal device fails to decode the test coded data configured with the long-acting reference frame, that is, the terminal device does not support the long-acting reference frame setting. For example, assuming that the preset time duration is 15ms, if the terminal device does not acquire any feedback data after 15ms elapses from the start of decoding, it can also be understood that the terminal device is in a stuck state, and a decoding result indicating that the terminal device has not successfully decoded the test coded data is generated. Further, if the terminal device acquires the feedback data after the preset time period elapses from the start of decoding, it cannot be said that the terminal device can successfully decode the test coded data configured with the long-acting reference frame, and further determination of the decoding result is required.
In one embodiment, if the terminal device does not acquire the test decoding data after a preset time period elapses from the start of decoding, a decoding result indicating that the terminal device has not successfully decoded the test encoding data is generated. That is, after the preset time period has elapsed since the start of decoding, even if the terminal device acquires the correct code or other data, if the test decoding data is not acquired, the terminal device still generates a decoding result indicating that the terminal device has not successfully decoded the test encoded data. Further, if the terminal device acquires the test decoding data after a preset time period from the beginning of decoding, it can only indicate that the decoding process is normally completed, and it cannot indicate that the terminal device can successfully decode the test coding data configured with the long-acting reference frame, and further determination needs to be performed on the decoding result.
And a third decoding result:
under the condition that the terminal equipment acquires the test decoding data, the terminal equipment can compare the test decoding data with the test data, and if the test decoding data is matched with the test data, a decoding result for indicating the terminal equipment to successfully decode the test encoding data is generated; and if the test decoding data is not matched with the test data, generating a decoding result for indicating that the terminal equipment does not successfully decode the test encoding data. The test coding data is obtained by coding the test data. That is, if the terminal device acquires the test decoding data, the data obtained by decoding the test encoding data (i.e., the test decoding data) may be compared with the original data (i.e., the test data) to determine whether the test encoding data is successfully decoded, so as to obtain the decoding result.
In one implementation, the terminal device may calculate an MD5Message-Digest Algorithm (MD 5) value of the test decoded data, compare the MD5 value with a reference value, and if the MD5 value is the same as the reference value, the terminal device determines that the test decoded data matches the test data, that is, generates a decoding result indicating that the terminal device successfully decodes the test encoded data; and if the md5 value is not the same as the reference value, the terminal device determines that the test decoding data does not match the test data, i.e. generates a decoding result indicating that the terminal device has not successfully decoded the test encoded data. The reference value refers to an md5 value of the test data, where the md5 value may be a character string pre-stored in the terminal device, and the application is not limited thereto. Since the md5 value corresponding to each data is unique, that is, if the md5 value of the test decoding data is the same as the md5 value (i.e. the reference value) of the test data, it can be said that the test decoding data matches the test data, that is, the terminal device successfully decodes the test encoding data.
Optionally, if a decoding result indicating that the terminal device has not successfully decoded the test coded data is generated, which indicates that the terminal device cannot decode the coded frame including the long-acting reference frame, the terminal device may empty buffered data (for example, the test coded data, the feedback data, and the like) involved in the detection process of the long-acting reference frame capability, so as to prepare for subsequent decoding of the coded frame not including the long-acting reference frame.
It should be noted that, in the embodiment corresponding to fig. 2, the terminal device successfully decodes the test coded data configured with the long-acting reference frame, and generates a decoding result (i.e., the decoding result three) for instructing the terminal device to successfully decode the test coded data, which is not limited in this application.
In one implementation, a terminal device may be configured with a hardware decoder; the terminal equipment can call a hardware decoder, and the test coding data are decoded based on the long-acting reference frame to obtain a decoding result. Wherein the decoding result can be used to indicate whether the hardware decoder successfully decoded the test coded data.
It should be noted that, in the case that the terminal device is configured with a hardware decoder, the terminal device may invoke the hardware decoder to perform the above-mentioned detection procedure of the long-acting reference frame capability, so as to confirm whether the hardware decoder has the capability of successfully decoding the data configured with the long-acting reference frame. That is, the terminal device may invoke the hardware decoder to obtain the test coding data configured with the long-acting reference frame, and invoke the hardware decoder to decode the test coding data based on the long-acting reference frame to obtain a decoding result.
Specifically, if the hardware decoder obtains the error code in the decoding process, a decoding result indicating that the hardware decoder has not successfully decoded the test coded data may be generated; if the hardware decoder does not acquire the feedback data after the preset duration from the beginning of decoding, a decoding result for indicating that the hardware decoder does not successfully decode the test coded data can be generated; under the condition of acquiring the test decoding data, the hardware decoder can compare the test decoding data with the test data, and if the test decoding data is matched with the test data, a decoding result for indicating the hardware decoder to successfully decode the test encoding data is generated; if the test decoded data and the test data do not match, a decoding result indicating that the hardware decoder did not successfully decode the test encoded data is generated.
Optionally, if a decoding result indicating that the hardware decoder did not successfully decode the test coded data is generated, which indicates that the hardware decoder cannot decode the coded frame including the long-acting reference frame, the terminal device may reset the hardware decoder, that is, clear buffer data (e.g., the test coded data, the feedback data, and the like) of the hardware decoder, so that the reset hardware decoder may decode the coded frame not including the long-acting reference frame in a subsequent decoding process.
S204, the terminal equipment sends detection information indicating that the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame to a server; accordingly, the server receives the probe information indicating that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame.
Wherein the sounding information may be used to indicate whether the terminal device has the capability to successfully decode data configured with long-term reference frames. That is, the terminal device may transmit, to the server, probe information indicating that the terminal device has a capability of successfully decoding data configured with the long-term reference frame, based on a decoding result of successfully decoding the test encoded data; alternatively, the terminal device may transmit, to the server, probe information indicating that the terminal device does not have the capability of successfully decoding the data configured with the long-term reference frame, based on a decoding result of unsuccessfully decoding the test-coded data.
S205, the server adopts a coding mode comprising the long-acting reference frame to code the target data, and coded target data comprising the long-acting reference frame is obtained.
It should be noted that, in a case that the probe information acquired by the server indicates that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, the server may encode the target data in an encoding manner including the long-acting reference frame to obtain encoded target data including the long-acting reference frame.
Optionally, when the detection information acquired by the server indicates that the terminal device does not have the capability of successfully decoding the data configured with the long-acting reference frame, the server may encode the target data in an encoding manner including the short-acting reference frame to obtain encoded target data including the short-acting reference frame.
S206, the server sends the encoded target data to the terminal equipment; correspondingly, the terminal equipment receives the coded target data from the server.
After the server codes the coded target data including the long-acting reference frame, the coded target data including the long-acting reference frame can be sent to the terminal device, so that the terminal device can decode the coded target data based on the long-acting reference frame in the coded target data in the decoding process to obtain the target data, and the decoding efficiency is improved.
In one implementation, in a case that the detection information indicates that the terminal device does not have the capability of successfully decoding the data configured with the long-acting reference frame, the server may encode the target data to obtain encoded target data including the short-acting reference frame; and the server sends the encoded target data comprising the short-term reference frame to the terminal equipment, so that the terminal equipment decodes the encoded target data comprising the short-term reference frame based on the short-term reference frame to obtain the target data. The short-term reference frame refers to a coded frame which is referred to by frames with the number smaller than or equal to a preset number threshold in the coded data to be tested in the decoding process.
It can be understood that, if the terminal device does not have the capability of successfully decoding the data configured with the long-term reference frame, the server may encode the target data in an encoding manner that includes the short-term reference frame, so as to obtain encoded target data that includes the short-term reference frame, so that the terminal device may decode the encoded target data that includes the short-term reference frame, and further obtain the target data.
And S207, the terminal equipment decodes the coded target data based on the long-acting reference frame in the coded target data to obtain the target data.
It should be noted that, in a case where the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, the encoded target data including the long-acting reference frame from the server may be received, and the encoded target data may be decoded based on the long-acting reference frame in the encoded target data, so as to obtain the target data.
Optionally, under the condition that the terminal device does not have the capability of successfully decoding the data configured with the long-acting reference frame, the encoded target data including the short-acting reference frame from the server may be received, and the encoded target data may be decoded based on the short-acting reference frame in the encoded target data, so as to obtain the target data.
In the embodiment of the application, the server sends the detection request of the long-acting reference frame capability to the terminal device, so that the terminal device can respond to the detection request to obtain the test coding data configured with the long-acting reference frame, and decode the test coding data based on the long-acting reference frame to obtain the decoding result, so that the server sends the detection information indicating whether the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame or not based on the decoding result, so that the server codes the target data to obtain the coded target data comprising the long-acting reference frame under the condition that the server receives the capability indicating that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, and the decoding efficiency is further improved.
Referring to fig. 3, fig. 3 is a schematic flow chart of a data processing method according to an embodiment of the present disclosure. The data processing method can be applied to the data processing system shown in fig. 1, and is executed by the terminal device, and specifically can be executed by a processor of the terminal device. The data processing method comprises the following steps:
s301, the terminal equipment receives a detection request of the long-acting reference frame capability from the server.
Wherein the long-term reference frame capability probe request can be used for detecting whether the terminal device has the capability of successfully decoding the data configured with the long-term reference frame.
S302, the terminal equipment responds to the detection request to obtain the test coding data configured with the long-acting reference frame, and decodes the test coding data based on the long-acting reference frame to obtain a decoding result.
The long-acting reference frame refers to a coded frame which is referred by frames with the quantity larger than a preset quantity threshold value in the coded data to be tested in the decoding process. Optionally, the coded frames referred to by the frames in the coded data under test whose number is less than or equal to the preset number threshold in the decoding process may be regarded as short-term reference frames.
In one implementation, the storage duration of the long-acting reference frame in the reference frame buffer may be longer than a preset storage duration. Optionally, the storage duration of the short-lived reference frame in the reference frame buffer may be less than or equal to the preset storage duration. The preset storage duration may be preset by the terminal device or the server, or may be set by default by the system, which is not limited in this application.
The decoding result can be used for indicating whether the terminal equipment successfully decodes the test coded data. Specifically, the terminal device decodes the test coded data based on the long-acting reference frame, and may obtain three decoding results, specifically please refer to the detailed description in the corresponding embodiment of fig. 2.
In one implementation, a terminal device may be configured with a hardware decoder; the terminal equipment can call a hardware decoder, and the test coding data are decoded based on the long-acting reference frame to obtain a decoding result. Wherein the decoding result can be used to indicate whether the hardware decoder successfully decoded the test coded data.
S303, the terminal device sends the detection information to the server based on the decoding result.
Wherein the sounding information may be used to indicate whether the terminal device has the capability to successfully decode data configured with long-term reference frames.
S304, the terminal equipment receives the encoded target data from the server, and decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
It should be noted that, the relevant contents of the above S301 to S304 can refer to the detailed description in the corresponding embodiment of fig. 2, and are not repeated herein.
In the embodiment of the application, the terminal device receives and responds to the detection request of the long-acting reference frame capability from the server to obtain the test coded data configured with the long-acting reference frame, and decodes the test coded data based on the long-acting reference frame to obtain the decoding result, so that the terminal device sends the detection information to the server based on the decoding result to indicate whether the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, so that the terminal device can receive the encoded target data including the long-acting reference frame from the server under the condition of having the capability of successfully decoding the data configured with the long-acting reference frame, and decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data, so that the terminal device utilizes the long-acting reference frame which can be stored for a long time as the reference frame in the decoding process, thereby improving the decoding efficiency, and avoiding the terminal device from causing decoding errors due to the use of the short-acting reference frame which cannot be stored for a long time as the reference frame, thereby being beneficial to improving the decoding accuracy.
Referring to fig. 4, fig. 4 is a schematic flowchart of a data processing method according to an embodiment of the present disclosure. The data processing method can be applied to the data processing system shown in fig. 1, and is executed by the terminal device, and specifically can be executed by a processor of the terminal device. The data processing method comprises the following steps:
s401, the terminal equipment receives a probe request of long-acting reference frame capability from a server. Wherein the long-term reference frame capability probe request can be used for detecting whether the terminal device has the capability of successfully decoding the data configured with the long-term reference frame.
S402, the terminal equipment responds to the detection request to acquire the test coding data configured with the long-acting reference frame, and decodes the test coding data based on the long-acting reference frame. The long-acting reference frame refers to a coded frame which is referred by frames with the quantity larger than a preset quantity threshold value in the coded data to be tested in the decoding process.
And S403, whether the terminal equipment acquires the error code in the decoding process. If the terminal device obtains the error code in the decoding process, executing S407; if the error code is not obtained by the terminal device in the decoding process, S406 is performed.
And S404, after the preset time length is passed from the beginning of decoding, whether the terminal equipment acquires the feedback data or not is judged. Wherein, the feedback data can comprise error codes, correct codes, test decoding data and other data; the test decoding data may be data obtained by decoding the test encoding data based on the long-acting reference frame by the terminal device. If the terminal device does not acquire the feedback data after the preset duration from the beginning of decoding, executing S407; if the terminal device acquires the feedback data after the preset time period elapses from the start of decoding, S406 is executed.
S405, the terminal device compares the test decoding data with the test data and judges whether the test decoding data are matched with the test data. The test encoding data is obtained by encoding the test data. If the test decoded data is matched with the test data, executing S406; if the test decoded data and the test data do not match, S407 is performed.
S406, the terminal device generates a decoding result used for indicating the terminal device to successfully decode the test coding data, and sends detection information indicating that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame to the server.
S407, the terminal device generates a decoding result for indicating that the terminal device has not successfully decoded the test coded data, and sends probe information indicating that the terminal device does not have the capability of successfully decoding the data configured with the long-acting reference frame to the server.
It should be noted that, the relevant contents of the above S401 to S407 can refer to the detailed description in the corresponding embodiment of fig. 2, and are not repeated herein.
In the embodiment of the application, after receiving a probe request of long-acting reference frame capability from a server, a terminal device responds to the probe request, obtains test coded data configured with a long-acting reference frame, and decodes the test coded data based on the long-acting reference frame to obtain a decoding result, so that probe information indicating whether the terminal device has the capability of successfully decoding data configured with the long-acting reference frame is sent to the server based on the decoding result, so that the server encodes target data to obtain encoded target data including the long-acting reference frame under the condition that the server receives the capability indicating that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, and the efficiency of decoding is further improved.
Referring to fig. 5, fig. 5 is a schematic flowchart of a data processing method according to an embodiment of the present disclosure. The data processing method can be applied to the data processing system shown in fig. 1, and is executed by a server, and particularly can be executed by a processor of the server. The data processing method comprises the following steps:
s501, the server sends a detection request of the long-acting reference frame capability to the terminal equipment.
The long-acting reference frame capability detection request can be used for detecting whether the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame. The long-acting reference frame refers to a frame reference coding frame of which the number of the coded data to be tested is larger than a preset number threshold in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data.
In the embodiment of the application, before the server sends the encoded target data to the terminal device, the server may send a probe request of the long-acting reference frame capability to the terminal device, and correspondingly, the terminal device may receive and respond to the probe request to obtain the test encoding data configured with the long-acting reference frame, and decode the test encoding data based on the long-acting reference frame to obtain a decoding result.
S502, the server receives the detection information sent by the terminal device based on the decoding result. Wherein the sounding information may be used to indicate whether the terminal device has the capability to successfully decode data configured with long-term reference frames.
Specifically, if the terminal device successfully decodes the test coded data, the terminal device may send, to the server, probe information indicating that the terminal device has a capability of successfully decoding the data configured with the long-acting reference frame based on a decoding result of successfully decoding the test coded data; accordingly, the server may receive probe information indicating that the terminal device has the capability to successfully decode data configured with long-term reference frames. If the terminal device does not successfully decode the test coded data, the terminal device may send, to the server, probe information indicating that the terminal device does not have the capability of successfully decoding the data configured with the long-acting reference frame based on a decoding result of the unsuccessfully decoded test coded data; accordingly, the server may receive probe information indicating that the terminal device does not have the capability to successfully decode data configured with long-term reference frames.
S503, under the condition that the detection information indicates that the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame, the server encodes the target data to obtain encoded target data; the encoded target data includes a long-term reference frame.
It should be noted that, in the case that the probe information received by the server indicates that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, the server may encode the target data in an encoding manner including the long-acting reference frame, so as to obtain the encoded target data including the long-acting reference frame. For example, the server may encode the target data in an encoding manner in which a long-term reference frame is set every 1000 frames, so as to obtain encoded target data including the long-term reference frame.
S504, the server sends the encoded target data to the terminal device, so that the terminal device decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
After the server obtains the encoded target data including the long-acting reference frame, the server may send the encoded target data including the long-acting reference frame to the terminal device, so that the terminal device may decode the encoded target data based on the long-acting reference frame in the encoded target data in a decoding process to obtain the target data, thereby improving the accuracy of decoding.
In one implementation, in a case that the detection information indicates that the terminal device does not have the capability of successfully decoding the data configured with the long-acting reference frame, the server may encode the target data to obtain encoded target data including the short-acting reference frame; and the server sends the encoded target data comprising the short-term reference frame to the terminal equipment, so that the terminal equipment decodes the encoded target data comprising the short-term reference frame based on the short-term reference frame to obtain the target data. The short-term reference frame refers to a coded frame which is referred to by frames with the number smaller than or equal to a preset number threshold in the coded data to be tested in the decoding process.
It can be understood that, if the terminal device does not have the capability of successfully decoding the data configured with the long-term reference frame, the server may encode the target data in an encoding manner that includes the short-term reference frame, so as to obtain encoded target data that includes the short-term reference frame, so that the terminal device may decode the encoded target data that includes the short-term reference frame, and further obtain the target data.
It should be noted that, for the relevant contents of the above-mentioned S501-S504, reference may be made to the detailed description in the corresponding embodiment of fig. 2, and details are not repeated herein.
In the embodiment of the application, the server may send a probe request of a long-acting reference frame capability to the terminal device, and receive probe information sent by the terminal device in response to the probe request to acquire whether the terminal device has a capability of successfully decoding data configured with the long-acting reference frame, so that when the probe information indicates that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, it may be determined to encode target data in a coding mode including the long-acting reference frame to obtain encoded target data including the long-acting reference frame, and send the encoded target data to the terminal device, so that the terminal device may use the long-acting reference frame as a reference frame in a process of decoding the encoded target data to improve decoding efficiency, and may also avoid decoding errors caused by the terminal device using the short-acting reference frame as a reference frame, thereby improving decoding accuracy.
Referring to fig. 6, fig. 6 is a schematic flowchart of a data processing method according to an embodiment of the present disclosure. The data processing method can be applied to the data processing system shown in fig. 1, and is executed by a server, and particularly can be executed by a processor of the server. The data processing method comprises the following steps:
s601, the server sends a detection request of the long-acting reference frame capability to the terminal equipment. Wherein the long-term reference frame capability probe request can be used for detecting whether the terminal device has the capability of successfully decoding the data configured with the long-term reference frame. The long-acting reference frame refers to a coded frame which is referred by a frame with the quantity larger than a preset quantity threshold value in the coded data to be tested in the decoding process.
S602, whether the server receives the detection information indicating that the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame is judged. If the server receives the detection information indicating that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, S603 is executed; if the server receives probe information indicating that the terminal device does not have the capability to successfully decode the data configured with the long-acting reference frame, S604 is performed.
S603, the server adopts a coding mode comprising the long-acting reference frame to code the target data, and coded target data comprising the long-acting reference frame is obtained.
S604, the server encodes the target data by adopting an encoding mode comprising the short-term reference frame to obtain encoded target data comprising the short-term reference frame. The short-term reference frame refers to a coded frame which is referred to by frames with the number smaller than or equal to a preset number threshold in the coded data to be tested in the decoding process.
It should be noted that, for the relevant contents of the above S601-S604, reference may be made to the detailed description in the corresponding embodiment of fig. 5, and details of this application are not repeated herein.
In the embodiment of the application, the server sends the detection request of the long-acting reference frame capability to the terminal device, and can acquire the detection information of whether the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, so that under the condition that the detection information indicates that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame, the target data is determined to be encoded by adopting the encoding mode including the long-acting reference frame, the encoded target data including the long-acting reference frame is obtained, and the encoded target data is sent to the terminal device, so that the terminal device can utilize the long-acting reference frame as the reference frame in the process of decoding the encoded target data, and the decoding efficiency is further improved.
In addition, in the embodiments of the present application, the probe request, the test coded data, the decoding result, the probe information, the target data, and the relevant data in the coded target data are all referred to, and the data used in the reference are all authorized by the user. When the above embodiments of the present application are applied to specific products or technologies, the data involved in the use needs to be approved or approved by users, and the collection, use and processing of the relevant data need to comply with relevant laws and regulations and standards of relevant countries and regions.
Further, please refer to fig. 7, wherein fig. 7 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application. As shown in fig. 7, the data processing apparatus 700 can be applied to the terminal device in the embodiments corresponding to fig. 2 to fig. 4. Specifically, the data processing apparatus 700 may be a computer program (including program code) running in the terminal device, for example, the data processing apparatus 700 is an application software; the data processing apparatus 700 may be used to perform the corresponding steps in the methods provided by the corresponding embodiments of fig. 2-4.
The data processing apparatus 700 may include: a communication unit 701, an acquisition unit 702, and a processing unit 703.
A communication unit 701, configured to receive a probe request for long-term reference frame capability from a server;
an obtaining unit 702, configured to obtain, in response to the probe request, test coding data configured with the long-acting reference frame; the long-acting reference frame refers to a frame reference coding frame of which the number is greater than a preset number threshold in the coded data to be tested in the decoding process;
the processing unit 703 is configured to decode the test coded data based on the long-acting reference frame to obtain a decoding result; the decoding result is used for indicating whether the data processing device successfully decodes the test coded data;
the communication unit 701 is further configured to send, to the server, probe information based on the decoding result, where the probe information is used to indicate whether the data processing apparatus has the capability of successfully decoding the data configured with the long-term reference frame, so that the server encodes the target data to obtain encoded target data when the probe information indicates that the data processing apparatus has the capability of successfully decoding the data configured with the long-term reference frame; the encoded target data comprises a long-term reference frame;
the communication unit 701 is further configured to receive encoded target data from a server;
the processing unit 703 is further configured to decode the encoded target data based on the long-acting reference frame in the encoded target data to obtain target data;
in an implementation manner, the processing unit 703 is further configured to decode the test coded data based on the long-acting reference frame to obtain test decoded data; comparing the test decoding data with the test data, and if the test decoding data is matched with the test data, generating a decoding result for indicating the data processing device to successfully decode the test encoding data; the test coding data is obtained by coding the test data; and if the test decoding data and the test data do not match, generating a decoding result for indicating that the data processing device does not successfully decode the test coding data.
In an implementation manner, the processing unit 703 is further configured to decode the test coded data based on the long-acting reference frame, and if an error code is obtained in the decoding process, generate a decoding result used for indicating that the data processing apparatus has not successfully decoded the test coded data.
In an implementation manner, the processing unit 703 is further configured to decode the test coded data based on the long-acting reference frame, and if the feedback data is not obtained after a preset time period elapses from the start of decoding, generate a decoding result indicating that the data processing apparatus has not successfully decoded the test coded data.
In an implementation manner, the processing unit 703 is further configured to calculate an information digest algorithm value of the test decoding data; comparing the message digest algorithm value with a reference value; wherein, the reference value refers to the message abstract algorithm value of the test data; and if the information abstract algorithm value is the same as the reference value, determining that the test decoding data is matched with the test data.
In one implementation, the data processing apparatus is configured with a hardware decoder. The processing unit 703 is further configured to invoke a hardware decoder, and decode the test coded data based on the long-acting reference frame to obtain a decoding result, where the decoding result is used to indicate whether the hardware decoder successfully decodes the test coded data.
Further, please refer to fig. 8, wherein fig. 8 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application. As shown in fig. 8, the data processing apparatus 800 may be applied to the server in the corresponding embodiments of fig. 2, 5, and 6 described above. Specifically, the data processing apparatus 800 may be a computer program (including program code) running in a server, for example, the data processing apparatus 800 is an application software; the data processing device 800 may be configured to perform the corresponding steps in the methods provided by the corresponding embodiments of fig. 2, 5, and 6.
The data processing apparatus 800 may include: a communication unit 801 and a processing unit 802.
A communication unit 801, configured to send a probe request of long-acting reference frame capability to a terminal device, so that the terminal device obtains test coding data configured with a long-acting reference frame in response to the probe request, and decodes the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a frame reference coding frame of which the number is greater than a preset number threshold in the coded data to be tested in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data;
the communication unit 801 is further configured to receive probe information sent by the terminal device based on the decoding result; the detection information is used for indicating whether the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame;
a processing unit 802, configured to encode target data to obtain encoded target data when the detection information indicates that the terminal device has a capability of successfully decoding data configured with a long-acting reference frame; the encoded target data comprises a long-term reference frame;
the communication unit 801 is further configured to send the encoded target data to the terminal device, so that the terminal device decodes the encoded target data based on the long-term reference frame in the encoded target data to obtain the target data.
In an implementation manner, the processing unit 802 is further configured to, in a case that the probe information indicates that the terminal device does not have a capability of successfully decoding the data configured with the long-acting reference frame, encode the target data to obtain encoded target data including the short-acting reference frame; the short-term reference frame refers to a coding frame which is referred by frames with the quantity less than or equal to a preset quantity threshold value in the coded data to be tested in the decoding process; the communication unit 801 is further configured to send the encoded target data including the short-term reference frame to the terminal device, so that the terminal device decodes the encoded target data including the short-term reference frame based on the short-term reference frame to obtain the target data.
According to the embodiment of the present application, the units in the data processing apparatuses shown in fig. 7 and fig. 8 may be respectively or completely combined into one or several other units to form the data processing apparatus, or some unit(s) may be further split into multiple functionally smaller units to form the data processing apparatus, which may implement the same operation without affecting implementation of technical effects of the embodiment of the present application. The units are divided based on logic functions, and in practical application, the functions of one unit can be realized by a plurality of units, or the functions of a plurality of units can be realized by one unit. In other embodiments of the present application, the data processing apparatus may also include other units, and in practical applications, these functions may also be implemented by assistance of other units, and may be implemented by cooperation of multiple units.
According to the embodiments of the present application, the data processing apparatuses as shown in fig. 7 and fig. 8 may be constructed by running a computer program (including program codes) capable of executing the steps involved in the respective methods as shown in fig. 2 to fig. 6 on a general-purpose computing device such as a computer including a Central Processing Unit (CPU), a random access storage medium (RAM), a read-only storage medium (ROM), and the like, and a storage element, and implementing the data processing method of the embodiments of the present application. The computer program may be recorded on a computer storage medium, for example, and loaded into and executed by the computing apparatus via the computer storage medium.
Further, please refer to fig. 9, where fig. 9 is a schematic structural diagram of a computer device according to an embodiment of the present application. The computer device 900 may also be configured to implement the functions of the terminal device in the above method embodiments. As shown in fig. 9, the computer device 900 may include at least: a processor 901, a communication interface 902, and a computer storage medium 903. The processor 901, the communication interface 902, and the computer storage medium 903 may be connected by a bus or other means.
A computer storage medium 903 may be stored in the memory 904 of the computer device 900, the computer storage medium 903 being used to store a computer program, the computer program comprising program instructions, the processor 901 being used to execute the program instructions stored by the computer storage medium 903. Processor 901 (or Central Processing Unit, CPU)) is the computational core and control core of computer device 900, and is adapted to implement one or more instructions, and is specifically adapted to load and execute:
receiving a probe request for long-term reference frame capability from a server;
responding to the detection request to obtain the test coding data configured with the long-acting reference frame, and decoding the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a frame reference coding frame of which the number of the coded data to be tested is larger than a preset number threshold value in the decoding process; the decoding result is used for indicating whether the data processing device successfully decodes the test coded data;
sending detection information to the server based on the decoding result, wherein the detection information is used for indicating whether the data processing device has the capability of successfully decoding the data configured with the long-acting reference frame or not, so that the server encodes the target data to obtain the encoded target data under the condition that the detection information indicates that the data processing device has the capability of successfully decoding the data configured with the long-acting reference frame; the encoded target data comprises a long-term reference frame;
receiving encoded target data from a server, and decoding the encoded target data based on a long-acting reference frame in the encoded target data to obtain target data;
in an implementation manner, the processor 901 is further configured to decode the test coded data based on the long-acting reference frame to obtain test decoded data; comparing the test decoding data with the test data, and if the test decoding data is matched with the test data, generating a decoding result for indicating the data processing device to successfully decode the test encoding data; the test coding data is obtained by coding the test data; and if the test decoding data and the test data do not match, generating a decoding result for indicating that the data processing device does not successfully decode the test encoding data.
In one implementation, the processor 901 is further configured to decode the test coded data based on the long-acting reference frame, and if an error code is obtained in the decoding process, generate a decoding result indicating that the data processing apparatus has not successfully decoded the test coded data.
In one implementation, the processor 901 is further configured to decode the test coded data based on the long-acting reference frame, and if no feedback data is obtained after a preset time period elapses from the start of decoding, generate a decoding result indicating that the data processing apparatus has not successfully decoded the test coded data.
In one implementation, the processor 901 is further configured to calculate an information digest algorithm value of the test decoding data; comparing the message digest algorithm value with a reference value; wherein, the reference value refers to the message abstract algorithm value of the test data; and if the information abstract algorithm value is the same as the reference value, determining that the test decoding data is matched with the test data.
In one implementation, the data processing apparatus is configured with a hardware decoder. The processor 901 is further configured to invoke a hardware decoder, and decode the test coded data based on the long-acting reference frame to obtain a decoding result, where the decoding result is used to indicate whether the hardware decoder successfully decodes the test coded data.
It should be understood that the computer device 900 described in this embodiment of the present application may perform the description of the data processing method in the embodiments corresponding to fig. 2 to fig. 4, and may also perform the description of the data processing apparatus 700 in the embodiment of fig. 7, which is not described herein again. In addition, the beneficial effects of the same method are not described in detail.
Further, the computer device 900 shown in fig. 9 can also be used to implement the functions of the server in the above method embodiments. As shown in fig. 9, the computer device 900 may include at least: a processor 901, a communications interface 902, and a computer storage medium 903. The processor 901, the communication interface 902, and the computer storage medium 903 may be connected by a bus or other means.
A computer storage medium 903 may be stored in the memory 904 of the computer device 900, the computer storage medium 903 being used to store a computer program, the computer program comprising program instructions, the processor 901 being used to execute the program instructions stored by the computer storage medium 903. Processor 901 (or Central Processing Unit, CPU)) is the computational core and control core of computer device 900, and is adapted to implement one or more instructions, and is specifically adapted to load and execute:
sending a detection request of the long-acting reference frame capability to the terminal equipment so that the terminal equipment responds to the detection request to obtain the test coding data configured with the long-acting reference frame, and decoding the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a frame reference coding frame of which the number is greater than a preset number threshold in the coded data to be tested in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data;
receiving detection information sent by the terminal equipment based on a decoding result; the detection information is used for indicating whether the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame;
under the condition that the detection information indicates that the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame, encoding the target data to obtain encoded target data; the encoded target data comprises a long-term reference frame;
and sending the encoded target data to the terminal equipment so that the terminal equipment decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
In one implementation, the processor 901 is further configured to, in a case that the detection information indicates that the terminal device does not have the capability of successfully decoding the data configured with the long-acting reference frame, encode the target data to obtain encoded target data including the short-acting reference frame; the short-term reference frame refers to a coding frame which is referred by frames with the quantity less than or equal to a preset quantity threshold value in the coded data to be tested in the decoding process; and sending the encoded target data comprising the short-term reference frame to the terminal equipment so that the terminal equipment decodes the encoded target data comprising the short-term reference frame based on the short-term reference frame to obtain the target data.
It should be understood that the computer device 900 described in this embodiment of the present application may perform the description of the data processing method in the embodiment corresponding to fig. 2, fig. 5, and fig. 6, and may also perform the description of the data processing apparatus 800 in the embodiment of fig. 8, which is not described herein again. In addition, the beneficial effects of the same method are not described in detail.
Further, here, it is to be noted that: the present embodiment further provides a computer storage medium, and the computer storage medium stores the aforementioned computer programs executed by the data processing apparatus 700 and the data processing apparatus 800, and the computer programs include program instructions, and when the processor executes the program instructions, the data processing method in the embodiments corresponding to fig. 2 to fig. 6 can be executed, and therefore, the description thereof will not be repeated here. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in the embodiments of the computer storage medium referred to in the present application, reference is made to the description of the embodiments of the method of the present application. By way of example, program instructions may be deployed to be executed on one computer device or on multiple computer devices at one site or distributed across multiple sites and interconnected by a communication network, and the multiple computer devices distributed across the multiple sites and interconnected by the communication network may be combined into a blockchain network.
According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and executes the computer instruction, so that the computer device can perform the method in the embodiment corresponding to fig. 2 to fig. 6, and therefore, the detailed description thereof will not be repeated here.
Those of ordinary skill in the art will appreciate that the various illustrative elements and steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the invention are all or partially effected when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on or transmitted over a computer storage medium. The computer instructions may be transmitted from one website site, computer, server, or data center to another website site, computer, server, or data center by wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. A computer storage medium may be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid State Disks (SSDs)), among others.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present disclosure, and shall cover the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (13)

1. A method of data processing, the method comprising:
the terminal equipment receives a detection request of long-acting reference frame capability from a server;
the terminal equipment responds to the detection request to obtain the test coding data configured with the long-acting reference frame, and decodes the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a coding frame which is referred to by frames with the quantity larger than a preset quantity threshold value in the test coding data in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data;
the terminal device sends detection information to the server based on the decoding result, wherein the detection information is used for indicating whether the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame or not, so that the server encodes target data to obtain encoded target data under the condition that the detection information indicates that the terminal device has the capability of successfully decoding the data configured with the long-acting reference frame; the encoded target data comprises a long-term reference frame;
and the terminal equipment receives the encoded target data from the server and decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
2. The method of claim 1, wherein decoding the test coded data based on the long-acting reference frame results in a decoding result, comprising:
the terminal equipment decodes the test coded data based on the long-acting reference frame to obtain test decoded data;
the terminal equipment compares the test decoding data with the test data, and if the test decoding data is matched with the test data, the terminal equipment generates a decoding result for indicating the terminal equipment to successfully decode the test encoding data; the test encoding data is obtained by encoding the test data;
and if the test decoding data is not matched with the test data, the terminal equipment generates a decoding result for indicating that the terminal equipment does not successfully decode the test encoding data.
3. The method of claim 2, wherein decoding the test coded data based on the long-acting reference frame results in a decoding result, further comprising:
and the terminal equipment decodes the test coding data based on the long-acting reference frame, and if an error code is acquired in the decoding process, a decoding result used for indicating that the terminal equipment does not successfully decode the test coding data is generated.
4. The method of claim 2, wherein decoding the test coded data based on the long-acting reference frame results in a decoding result, further comprising:
and the terminal equipment decodes the test coding data based on the long-acting reference frame, and if feedback data is not acquired after a preset time period from the beginning of decoding, a decoding result used for indicating that the terminal equipment does not successfully decode the test coding data is generated.
5. The method of claim 2, wherein the terminal device compares the test decoded data with test data, and comprises:
the terminal equipment calculates the information abstract algorithm value of the test decoding data;
the terminal equipment compares the information abstract algorithm value with a reference value; wherein the reference value refers to an information summary algorithm value of the test data;
and if the information abstract algorithm value is the same as the reference value, the terminal equipment determines that the test decoding data is matched with the test data.
6. The method according to any of claims 1-5, wherein the terminal device is configured with a hardware decoder;
the decoding the test coded data based on the long-acting reference frame to obtain a decoding result includes:
and the terminal equipment calls the hardware decoder, decodes the test coded data based on the long-acting reference frame to obtain a decoding result, and the decoding result is used for indicating whether the hardware decoder successfully decodes the test coded data.
7. A method of data processing, the method comprising:
the method comprises the steps that a server sends a detection request of long-acting reference frame capacity to terminal equipment, so that the terminal equipment responds to the detection request to obtain test coding data configured with long-acting reference frames, and the test coding data are decoded on the basis of the long-acting reference frames to obtain decoding results; the long-acting reference frame refers to a coding frame which is referred to by frames with the quantity larger than a preset quantity threshold value in the test coding data in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data;
the server receives detection information sent by the terminal equipment based on the decoding result; the detection information is used for indicating whether the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame;
under the condition that the detection information indicates that the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame, the server encodes target data to obtain encoded target data; the encoded target data comprises a long-term reference frame;
and the server sends the encoded target data to the terminal equipment, so that the terminal equipment decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
8. The method of claim 7, further comprising:
under the condition that the detection information indicates that the terminal equipment does not have the capability of successfully decoding the data configured with the long-acting reference frame, the server encodes the target data to obtain encoded target data comprising the short-acting reference frame; the short-term reference frame refers to a coded frame which is referred to by frames with the number smaller than or equal to a preset number threshold in the test coded data in the decoding process;
and the server sends the encoded target data comprising the short-term reference frame to the terminal equipment, so that the terminal equipment decodes the encoded target data comprising the short-term reference frame based on the short-term reference frame to obtain the target data.
9. A data processing apparatus, characterized by comprising:
a communication module for receiving a probe request for long-term reference frame capability from a server;
the acquisition module is used for responding to the detection request to acquire the test coding data configured with the long-acting reference frame and decoding the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a coding frame which is referred to by frames with the quantity larger than a preset quantity threshold value in the test coding data in the decoding process; the decoding result is used for indicating whether the data processing device successfully decodes the test coded data;
the communication module is further configured to send probe information to the server based on the decoding result, where the probe information is used to indicate whether the data processing apparatus has the capability of successfully decoding the data configured with the long-acting reference frame, so that the server encodes target data to obtain encoded target data when the probe information indicates that the data processing apparatus has the capability of successfully decoding the data configured with the long-acting reference frame; the encoded target data comprises a long-acting reference frame;
the communication module is further used for receiving the encoded target data from the server;
and the processing module is used for decoding the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
10. A data processing apparatus, comprising:
the communication module is used for sending a detection request of long-acting reference frame capability to terminal equipment so that the terminal equipment responds to the detection request to obtain test coding data configured with a long-acting reference frame, and decoding the test coding data based on the long-acting reference frame to obtain a decoding result; the long-acting reference frame refers to a coding frame which is referred to by frames with the quantity larger than a preset quantity threshold value in the test coding data in the decoding process; the decoding result is used for indicating whether the terminal equipment successfully decodes the test coded data;
the communication module is further configured to receive probe information sent by the terminal device based on the decoding result; the detection information is used for indicating whether the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame;
the processing module is used for coding target data under the condition that the detection information indicates that the terminal equipment has the capability of successfully decoding the data configured with the long-acting reference frame, so as to obtain coded target data; the encoded target data comprises a long-term reference frame;
the communication module is further configured to send the encoded target data to the terminal device, so that the terminal device decodes the encoded target data based on the long-acting reference frame in the encoded target data to obtain the target data.
11. A computer arrangement comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to carry out the steps of the method according to any one of claims 1-6; or cause the processor to perform the steps of the method of claim 7 or 8.
12. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program comprising program instructions which, when executed by a processor, cause a computer device having the processor to perform the steps of the method of any one of claims 1-6; or causing a computer device having said processor to perform the steps of the method of claim 7 or 8.
13. A computer program product, characterized in that the computer program product comprises a computer program which, when being executed by a processor, is adapted to load and carry out the method according to any one of claims 1-6; or to load and execute the method according to claim 7 or 8.
CN202211445107.8A 2022-11-18 2022-11-18 Data processing method, device, storage medium and computer program product Active CN115914228B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211445107.8A CN115914228B (en) 2022-11-18 2022-11-18 Data processing method, device, storage medium and computer program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211445107.8A CN115914228B (en) 2022-11-18 2022-11-18 Data processing method, device, storage medium and computer program product

Publications (2)

Publication Number Publication Date
CN115914228A true CN115914228A (en) 2023-04-04
CN115914228B CN115914228B (en) 2024-02-23

Family

ID=86487435

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211445107.8A Active CN115914228B (en) 2022-11-18 2022-11-18 Data processing method, device, storage medium and computer program product

Country Status (1)

Country Link
CN (1) CN115914228B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1596547A (en) * 2001-11-30 2005-03-16 株式会社Ntt都科摩 Moving picture coding apparatus, moving picture decoding apparatus, moving picture coding method, moving picture decoding method, program, and computer-readable recording medium containing the program
CN106817585A (en) * 2015-12-02 2017-06-09 掌赢信息科技(上海)有限公司 A kind of method for video coding of utilization long term reference frame, electronic equipment and system
CN108600769A (en) * 2018-04-16 2018-09-28 西安万像电子科技有限公司 Image transfer method, apparatus and system
US11109068B1 (en) * 2019-10-07 2021-08-31 Electronic Arts Inc. Enhancement of error resilience in low-latency live video streaming applications by using non-immediate previous temporal referencing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1596547A (en) * 2001-11-30 2005-03-16 株式会社Ntt都科摩 Moving picture coding apparatus, moving picture decoding apparatus, moving picture coding method, moving picture decoding method, program, and computer-readable recording medium containing the program
CN106817585A (en) * 2015-12-02 2017-06-09 掌赢信息科技(上海)有限公司 A kind of method for video coding of utilization long term reference frame, electronic equipment and system
CN108600769A (en) * 2018-04-16 2018-09-28 西安万像电子科技有限公司 Image transfer method, apparatus and system
US11109068B1 (en) * 2019-10-07 2021-08-31 Electronic Arts Inc. Enhancement of error resilience in low-latency live video streaming applications by using non-immediate previous temporal referencing

Also Published As

Publication number Publication date
CN115914228B (en) 2024-02-23

Similar Documents

Publication Publication Date Title
WO2019001006A1 (en) Method and device for encoding and decoding image data
CN112653700B (en) Website video communication method based on WEBRTC
CN113230660B (en) Application program updating method, device and equipment
CN112843676B (en) Data processing method, device, terminal, server and storage medium
CN112312222A (en) Video sending method and device and electronic equipment
CN110662017B (en) Video playing quality detection method and device
CN113489805B (en) Butt joint method, device, equipment and storage medium of cloud desktop system
US20230285854A1 (en) Live video-based interaction method and apparatus, device and storage medium
CN113117326B (en) Frame rate control method and device
WO2017140235A1 (en) Audio data processing method, server, client and system, and storage medium
CN108235075B (en) Video quality grade matching method, computer readable storage medium and terminal
CN113965751A (en) Screen content coding method, device, equipment and storage medium
US20170155712A1 (en) Method and device for updating cache data
CN108632667B (en) A kind of coding/decoding method and terminal of multimedia file
CN111385576B (en) Video coding method and device, mobile terminal and storage medium
CN109788251B (en) Video processing method, device and storage medium
CN113761097A (en) Map tile loading method, device, equipment and medium for browser end
CN115914228B (en) Data processing method, device, storage medium and computer program product
CN114844870B (en) Media stream acquisition method and device, electronic equipment and storage medium
CN112203103B (en) Message processing method, device, electronic equipment and computer readable storage medium
CN113066139A (en) Picture processing method and device, storage medium and electronic equipment
CN107888951A (en) Piece menu manager method, apparatus and server
US20170169483A1 (en) Method for pushing and displaying information and electronic device
CN111490885B (en) Method for processing equipment error information, electronic equipment and storage medium
CN115550690B (en) Frame rate adjusting method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40084275

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant