CN111787329A

CN111787329A - Data processing method, system, device, electronic equipment and storage medium

Info

Publication number: CN111787329A
Application number: CN202010486675.7A
Authority: CN
Inventors: 彭宇龙; 韩杰; 靳玉琼; 王艳辉
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2020-06-01
Filing date: 2020-06-01
Publication date: 2020-10-16
Anticipated expiration: 2040-06-01
Also published as: CN111787329B

Abstract

The application provides a data processing method, a system, a device, an electronic device and a storage medium. The method is applied to a coding and decoding chip and comprises the following steps: obtaining audio and video data to be processed; determining audio and video data which cannot be processed by a coding and decoding chip in the audio and video data to be processed; determining encoding and decoding parameters of the audio and video data which cannot be processed; acquiring a programming file matched with the encoding and decoding parameters; programming the programming file into a programmable chip matched with the coding and decoding chip; and sending the audio and video data which cannot be processed to the programmable chip so that the programmable chip processes the audio and video data which cannot be processed. By the data processing method, the coding and decoding chip can process audio and video data according to any coding and decoding parameters, the problem that an old coding and decoding chip cannot be upwards compatible is solved, meanwhile, a new coding and decoding chip does not need to be purchased, the deployment cost of coding and decoding equipment is reduced, and the use experience of a user is enhanced.

Description

Data processing method, system, device, electronic equipment and storage medium

Technical Field

The present application relates to the field of data processing technologies, and in particular, to a data processing method, system, apparatus, electronic device, and storage medium.

Background

In a video conference, in order to realize transmission and playing of audio and video data, the audio and video data needs to be encoded and transmitted or decoded and played by using a video conference terminal, so that normal operation of the video conference is ensured. The core function of the video conference terminal is to perform encoding and decoding operations on the audio and video data, i.e., to compress or decompress the audio and video data.

In the related art, the traditional video conference terminal realizes the encoding and decoding of audio and video data through an encoding and decoding chip, encoding and decoding parameters (including encoding and decoding formats, resolution ratios and the like) of the encoding and decoding chip are fixed and cannot be flexibly adjusted according to actual service requirements, and as time goes by, the problem that an old encoding and decoding chip cannot be upwards compatible occurs, a new encoding and decoding chip needs to be purchased again, so that the deployment cost is increased.

Disclosure of Invention

In view of the above, embodiments of the present invention are proposed in order to provide a data processing method, system, apparatus, electronic device and storage medium that overcome or at least partially solve the above-mentioned problems.

A first aspect of the embodiments of the present application provides a data processing method, which is applied to a coding/decoding chip, and the method includes:

obtaining audio and video data to be processed;

determining audio and video data which cannot be processed by the encoding and decoding chip in the audio and video data to be processed;

determining the encoding and decoding parameters of the audio and video data which cannot be processed;

acquiring a programming file matched with the encoding and decoding parameters;

programming the programming file into a programmable chip matched with the coding and decoding chip;

and sending the audio and video data which cannot be processed to the programmable chip so that the programmable chip processes the audio and video data which cannot be processed.

Optionally, the types of the encoding and decoding parameters of the audio and video data which cannot be processed are multiple, one encoding and decoding parameter corresponds to one programming file, the number of the programming files is multiple, the number of the programmable chips is one, and the programming file is programmed into the programmable chips, including:

when the storage capacity of the programmable chip supports the programming of all programming files, programming all the programming files into the programmable chip;

when the storage capacity of the programmable chip does not support the programming of all programming files, dividing the programming files into a plurality of batches;

and sequentially programming the programming files of each batch into the programmable chip, programming the programming files of the next batch into the programmable chip after one batch of programming files is successfully programmed and an audio and video processing success message returned by the programmable chip is received each time until all the programming files of all the batches are programmed into the programmable chip, wherein the audio and video processing success message is generated after the programmable chip successfully processes the audio and video data corresponding to the programming files of the current batch.

Optionally, the types of the encoding and decoding parameters of the audio and video data which cannot be processed are multiple, one encoding and decoding parameter corresponds to one programming file, and the number of the programming files and the number of the programmable chips are multiple; programming the programming file into the programmable chip, including:

when the storage capacity of the programmable chip supports the programming of all programming files, a first programmable chip is determined in the programmable chip;

programming all programming files into the first programmable chip;

when the storage capacity of the programmable chip does not support the programming of all programming files, dividing the programming files into a plurality of batches, and randomly determining a plurality of second programmable chips in accordance with the number of the batches in the programmable chips;

and respectively programming the programming files of each batch into each second programmable chip according to the principle that one batch corresponds to one second programmable chip.

Optionally, sending the audio/video data that cannot be processed to the programmable chip includes:

when the storage capacity of the programmable chip supports the programming of all programming files, the audio and video data which cannot be processed are sent to the first programmable chip;

when the storage capacity of the programmable chip does not support the programming of all programming files, dividing the audio and video data which cannot be processed into a plurality of groups of audio and video data to be processed according to the encoding and decoding parameters of each programmed second programmable chip;

and respectively sending each group of audio and video data to be processed to the corresponding second programmable chips according to the coding and decoding parameters required by each group of audio and video data to be processed.

Optionally, programming the programming file into the programmable chip includes:

sending a programming instruction to the programmable chip to control the programmable chip to enter a programming mode;

and programming the programming file into the programmable chip through a JTAG interface.

Optionally, the codec chip is communicatively connected to a server, and the method further includes:

sending an update request to the server;

receiving an update file sent by the server in response to the update request;

and updating the programming file stored by the self according to the updating file.

Optionally, after the programming file is programmed into the programmable chip, the method further includes:

when a programming failure instruction returned by the programmable chip is received, requesting a programming file matched with the coding and decoding parameters from the server;

and programming the programming file matched with the encoding and decoding parameters into the programmable chip.

Optionally, the codec chip is configured with a first memory, and the programmable chip is configured with a second memory;

obtaining a programming file matched with the encoding and decoding parameters, wherein the programming file comprises:

reading a programming file matched with the coding and decoding parameters from the first memory;

sending a programming instruction to the programmable chip to control the programmable chip to enter a programming mode, wherein the programming instruction comprises:

and sending a programming instruction to the programmable chip to control the programmable chip to read the starting configuration file from the second memory, and operating the starting configuration file to enter a programming mode.

A second aspect of an embodiment of the present application provides a data processing system, including:

the encoding and decoding chip is used for processing the audio and video data to be processed;

the programmable chip is used for processing the audio and video data which cannot be processed by the encoding and decoding chip;

the first memory is used for storing the audio and video data processed by the coding and decoding chip and a programming file for programming the programmable chip;

the second memory is used for storing the starting configuration file of the programmable chip;

the encoding and decoding chip is provided with a PCIE interface and is in communication connection with the programmable chip through the PCIE interface; the first memory is electrically connected with the coding and decoding chip, and the second memory is electrically connected with the programmable chip.

A third aspect of the embodiments of the present application provides a data processing apparatus, where the apparatus is applied to a coding/decoding chip, and the apparatus includes:

the first obtaining module is used for obtaining audio and video data to be processed;

the first determining module is used for determining the audio and video data which cannot be processed by the encoding and decoding chip in the audio and video data to be processed;

the second determining module is used for determining the encoding and decoding parameters of the audio and video data which cannot be processed;

the second obtaining module is used for obtaining a programming file matched with the coding and decoding parameters;

the programming module is used for programming the programming file into a programmable chip matched with the coding and decoding chip;

and the first sending module is used for sending the audio and video data which cannot be processed to the programmable chip so that the programmable chip processes the audio and video data which cannot be processed.

Optionally, the types of the codec parameters of the audio and video data that cannot be processed are multiple, one codec parameter corresponds to one programming file, the number of the programming files is multiple, the number of the programmable chips is one, and the programming module includes:

the first programming submodule is used for programming all programming files into the programmable chip when the storage capacity of the programmable chip supports the programming of all programming files;

the first programming module is used for dividing the programming files into a plurality of batches when the memory capacity of the programmable chip does not support the programming of all the programming files;

and the second programming submodule is used for sequentially programming the programming files of each batch into the programmable chip, programming the programming files of the next batch into the programmable chip after one batch of programming files is successfully programmed and the audio and video processing success message returned by the programmable chip is received each time, and writing the programming files of the next batch into the programmable chip until all the programming files of all the batches are programmed into the programmable chip, wherein the audio and video processing success message is generated after the programmable chip successfully processes the audio and video data corresponding to the programming files of the current batch.

Optionally, the types of the encoding and decoding parameters of the audio and video data which cannot be processed are multiple, one encoding and decoding parameter corresponds to one programming file, and the number of the programming files and the number of the programmable chips are multiple; the programming module comprises:

the determining submodule is used for arbitrarily determining a first programmable chip in the programmable chips when the storage capacity of the programmable chips supports the programming of all programming files;

the third programming submodule is used for programming all programming files into the first programmable chip;

the second division submodule is used for dividing the programming files into a plurality of batches when the storage capacity of the programmable chips does not support the programming of all the programming files, and randomly determining a plurality of second programmable chips in accordance with the number of the batches in the programmable chips;

and the fourth programming submodule is used for programming the programming files of each batch into each second programmable chip according to the principle that one batch corresponds to one second programmable chip.

Optionally, the first sending module comprises:

the first sending submodule is used for sending the audio and video data which cannot be processed to the first programmable chip when the storage capacity of the programmable chip supports the programming of all programming files;

the third division submodule is used for dividing the audio and video data which cannot be processed into a plurality of groups of audio and video data to be processed according to the coding and decoding parameters of each second programmable chip after programming when the storage capacity of the programmable chip does not support the programming of all programming files;

and the second sending submodule is used for sending each group of audio and video data to be processed to the corresponding second programmable chip according to the coding and decoding parameters required by each group of audio and video data to be processed.

Optionally, the programming module includes:

the third sending submodule is used for sending a programming instruction to the programmable chip so as to control the programmable chip to enter a programming mode;

and the fifth programming submodule is used for programming the programming file into the programmable chip through a JTAG interface.

Optionally, the codec chip is communicatively connected to a server, and the apparatus further includes:

the second sending module is used for sending an updating request to the server;

a receiving module, configured to receive an update file sent by the server in response to the update request;

and the updating module is used for updating the programming file stored by the updating module according to the updating file.

Optionally, the apparatus further comprises:

the request module is used for requesting the programming file matched with the coding and decoding parameters from the server when receiving a programming failure instruction returned by the programmable chip;

and the programming module is also used for programming the programming file matched with the coding and decoding parameters into the programmable chip.

the second obtaining module includes:

the obtaining submodule is used for reading the programming file matched with the coding and decoding parameters from the first memory;

the third transmitting sub-module includes:

and the reading module is used for sending a programming instruction to the programmable chip so as to control the programmable chip to read the starting configuration file from the second memory and run the starting configuration file to enter a programming mode.

A fourth aspect of the embodiments of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the data processing method according to the first aspect of the present application when executing the computer program.

A fifth aspect of the embodiments of the present application provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps in the data processing method according to the first aspect of the present application.

The embodiment provides a data processing method, which is applied to an encoding and decoding chip, wherein after the encoding and decoding chip obtains audio and video data to be processed, the encoding and decoding chip determines the audio and video data which cannot be processed by the encoding and decoding chip and corresponding encoding and decoding parameters in the audio and video data to be processed, and then obtains a programming file matched with the encoding and decoding parameters; then the programming file is programmed into a programmable chip matched with the coding and decoding chip; and finally, sending the audio and video data which cannot be processed into the programmable chip so that the programmable chip processes the audio and video data which cannot be processed. By the data processing method, the coding and decoding chip can process audio and video data according to any coding and decoding parameters, the problem that an old coding and decoding chip cannot be upwards compatible is solved, meanwhile, a new coding and decoding chip does not need to be purchased, the deployment cost of coding and decoding equipment is reduced, and the use experience of a user is enhanced.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments of the present application will be briefly described below.

FIG. 1 is a flow chart illustrating a method of data processing according to an embodiment of the present application;

fig. 2 is a schematic diagram of a coding/decoding process according to an embodiment of the present application;

FIG. 3 is a flow chart illustrating a method for writing a file according to an embodiment of the present application;

FIG. 4 is a flow chart illustrating another method for writing a file according to an embodiment of the present application;

FIG. 5 is a block diagram of a data processing system according to an embodiment of the present application;

fig. 6 is a block diagram illustrating a data processing apparatus according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In order to solve the problem that the coding and decoding chips cannot be compatible upwards in the related technology, the application provides a data processing method which is applied to the coding and decoding chips. Fig. 1 is a flowchart illustrating a data processing method according to an embodiment of the present application, and referring to fig. 1, the data processing method of the present application may include the following steps:

step S11: and audio and video data to be processed are obtained.

In this embodiment, the codec chip may obtain the audio/video data to be processed through a network, for example, receive the audio/video data to be processed sent by other terminal devices, or obtain the audio/video data to be processed according to the locally uploaded audio/video data, where the locally uploaded audio/video data may be the audio/video data acquired by the audio/video acquisition component of the terminal device where the codec chip is located.

The audio and video data to be processed comprises: audio and video data to be encoded and audio and video data to be decoded. The audio and video data includes audio data and video data, and it can be understood that the encoding and decoding chip can support both encoding operation and decoding operation, and during the encoding operation, it can support both encoding operation of the audio data and encoding operation of the video data, and during the decoding operation, it can support both decoding operation of the audio data and decoding operation of the video data.

Step S12: and determining the audio and video data which cannot be processed by the encoding and decoding chip in the audio and video data to be processed.

In this embodiment, the types of the codec parameters are multiple, each type of the codec parameter corresponds to a codec program (i.e., a programming file), and the capacity of the codec chip is fixed after the codec chip leaves the factory, so that the codec program that the codec chip can write in is limited, which results in limited capability of the codec chip to process the audio/video data.

In this embodiment, the codec parameters may include: coding format and resolution. Wherein, the encoding format may include: the MPEG (Moving Picture Experts Group) series, the h.26x series, and so on, wherein in the MPEG series, video coding formats are mainly MPEG 1(VCD), MPEG2(DVD), MPEG 4 (including some variants, such as DIVX, XVID, and so on), MPEG 4AVC, and Audio coding formats are MPEG Audio Layer 1, MPEG Audio Layer2, MPEG Audio Layer 3, MPEG-2AAC, MPEG-4AAC, and so on. The h.26x family is used for encoding video (mainly applied to the field of real-time video communication, such as video conferencing), and h.26x includes h.261, h.263, h.264, h.265/HEVC, and the like. There are, of course, many other types of encoding formats, and the present application is not limited in this regard. Resolution is a parameter used to measure how much data is in an image, and is usually denoted PPI (Pixel Per Inch Per inc).

In step S12, after obtaining the audio/video data to be processed, the codec chip determines the audio/video data to be encoded and the audio/video data to be decoded, obtains a given encoding parameter for the audio/video data to be encoded, performs encoding processing on the audio/video data according to the encoding parameter if the encoding parameter is supported by the codec chip, and takes the audio/video data corresponding to the encoding parameter as the audio/video data that cannot be processed if the encoding parameter is not supported by the codec chip. And similarly, a given decoding parameter is obtained for the audio and video data needing to be decoded, if the decoding parameter is supported by the decoder, the audio and video data are decoded according to the decoding parameter, and if the decoding parameter is not supported by the decoder, the audio and video data corresponding to the decoding parameter are used as the audio and video data which cannot be processed.

Step S13: determining the encoding and decoding parameters of the audio and video data which cannot be processed;

in this embodiment, determining the codec parameters of the audio/video data that cannot be processed includes: and determining the encoding parameters of the audio and video data which cannot be processed and/or determining the decoding parameters of the audio and video data which cannot be processed.

Step S14: and acquiring a programming file matched with the encoding and decoding parameters.

In this embodiment, each type of codec parameter corresponds to one type of programming file, and the programming file can perform encoding and decoding on the audio and video data according to the corresponding type of codec parameter during operation. Therefore, after the codec chip determines the decoding parameters of the audio/video data which cannot be processed, it needs to obtain the programming file matched with the decoding parameters of the audio/video data which cannot be processed.

Step S15: and programming the programming file into a programmable chip matched with the coding and decoding chip.

In this embodiment, the codec chip may adopt a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (field Programmable Gate Array), a CPLD (Complex Programmable logic device), a DSP (digital signal Processing), and the like, and the present Application does not specifically limit the type of the codec chip. The programmable chip may adopt ASIC, FPGA, CPLD, DSP, etc., which is not specifically limited in this application.

In this embodiment, because the FPGA has multiple advantages such as high real-time performance (fast processing speed, pipeline parallelism, and data parallelism), high flexibility (functions can be changed at any time according to requirements), and low power consumption, considering that the codec chip in this application needs to repeatedly program the programmable chip, the programmable chip may preferably be an FPGA.

In step S15, after obtaining the programming file matched with the codec parameters, the codec chip may program the programming file into the programmable chip, so as to enable the programmable chip to have the function of encoding and decoding the audio and video data according to the codec parameters.

Step S16: and sending the audio and video data which cannot be processed to the programmable chip so that the programmable chip processes the audio and video data which cannot be processed.

In this embodiment, after the programming file is programmed into the programmable chip, the codec chip sends the audio/video data that cannot be processed to the programmable chip, and since the programmable chip has the function of encoding and decoding the audio/video data according to the encoding and decoding parameters at this time, after receiving the audio/video data that cannot be processed and sent by the codec chip, the codec chip can encode and decode the audio/video data that cannot be processed according to the encoding and decoding parameters.

In this embodiment, after the codec chip obtains the audio and video data to be processed, if the audio and video data to be processed includes both the audio and video data that can be processed by itself and the audio and video data that cannot be processed by itself, the codec chip may create two threads, one thread is used to perform codec processing on the audio and video data that can be processed by itself, the other thread is used to burn the programmable chip and control the programmable chip to perform codec processing on the audio and video data that cannot be processed, and the codec speed of the codec chip is ensured by parallel processing of the audio and video data to be processed by the two threads, thereby ensuring the processing efficiency of the audio and video data.

Fig. 2 is a schematic diagram of a coding and decoding process according to an embodiment of the present application. The data processing method of the present application will be described in detail with reference to fig. 2 as a specific embodiment.

In fig. 2, the codec chip is installed in a video conference terminal, and the video conference terminal can be understood as a participant terminal in a video conference, and can receive video data sent by other participant terminals and perform decoding playing, where the video data received by the video conference terminal before decoding includes: the decoding parameters of the received upper-level given video data 1 are first-class decoding parameters, the decoding parameters of the video data 2 are second-class decoding parameters, and the decoding parameters of the video data 3 are third-class decoding parameters. For the video data 3, the encoding and decoding chip can obtain a programming file matched with the third type decoding parameters, the programming file is programmed into the programmable chip, after the programming is successful, the video data 3 is sent to the programmable chip, the programmable chip decodes the video data 3, the decoded video data 3 is returned to the encoding and decoding chip, and then the encoding and decoding chip sends the decoded video data 1-3 to the playing device in the video conference terminal for playing.

When the coding and decoding chip processes the video data 1-video data 3, a first thread can be created, the video data 1 and the video data 2 are decoded through the first thread, a second thread is created at the same time, the programmable chip is programmed through the second thread, and then the decoding processing of the video data 3 is realized, and the parallel processing of the video data 1-video data 2 and the video data 3 is realized through the parallel operation of the first thread and the second thread, so that the coding and decoding speed of the coding and decoding chip is ensured, and the processing efficiency of the video data 1-video data 3 is further ensured.

When the data processing method in the embodiment of the application is applied to video data processing, the effect of enhancing the user experience is particularly outstanding, and after the coding and decoding chip detects video frames with different coding formats and resolutions, the coding and decoding performance of the programmable chip is changed so as to realize self-adaptive coding and decoding processing of the video frames, thereby ensuring that all video data can be normally coded and decoded.

With reference to the foregoing embodiments, in an implementation manner, the types of the codec parameters of the audio and video data that cannot be processed are multiple, one codec parameter corresponds to one programming file, the number of the programming files is multiple, and the number of the programmable chips is one, on this basis, the embodiment of the present application further provides a file programming method, as shown in fig. 3. Fig. 3 is a flowchart illustrating a file writing method according to an embodiment of the present application. Referring to fig. 3, the step S15 may include:

step S151: and when the storage capacity of the programmable chip supports the programming of all programming files, programming all the programming files into the programmable chip.

In this embodiment, the storage capacities of the different types of programmable chips are different, and therefore, when the storage capacity of the programmable chip is small, all the write files may not be written. In addition, the number of the programmable chips which can be supported and accessed by the coding and decoding chips of different models is also different, and in the application, the coding and decoding chips can be accessed to at least one programmable chip. This embodiment provides a method for how to write a programming file on a codec chip when accessing a programmable chip.

Specifically, if the programming file obtained by the codec chip is small and can be written into the programmable chip in its entirety, the codec chip programs all the programming files into the programmable chip. Therefore, after the programming is successful, the programmable chip can perform encoding and decoding operations on the audio and video data to be processed, which cannot be processed and is sent by all the encoding and decoding chips, at one time.

Step S152: and when the storage capacity of the programmable chip does not support the programming of all programming files, dividing the programming files into a plurality of batches.

In this embodiment, if the file of the programming file obtained by the codec chip is large and cannot be written into the programmable chip all at once, the codec chip first divides all the programming files into a plurality of batches, and only one batch of the programming files is programmed each time.

Step S153: and sequentially programming the programming files of each batch into the programmable chip, programming the programming files of the next batch into the programmable chip after one batch of programming files is successfully programmed and an audio and video processing success message returned by the programmable chip is received each time until all the programming files of all the batches are programmed into the programmable chip, wherein the audio and video processing success message is generated after the programmable chip successfully processes the audio and video data corresponding to the programming files of the current batch.

In this embodiment, after the codec chip is divided to obtain a plurality of batches of programming files, a first batch of programming files is obtained first, the batch of programming files is written into the programmable chip, and after the programming is successful, the programmable chip can process the audio and video data sent by the codec chip according to the coding and decoding parameters corresponding to the batch of programming files and return the processed audio and video data to the codec chip, and the processed audio and video data is carried in the audio and video processing success message, so that after the codec chip receives the audio and video processing success message sent by the programmable chip, it can be determined that the audio and video data to be processed corresponding to the batch of programming files is processed completely, and the programming of the next batch of programming files can be performed; then, the coding and decoding chip obtains a second batch of programming files, and writes the batch of programming files into the programmable chip, so that the programmable chip which is successfully programmed can process the audio and video data to be processed corresponding to the batch of programming files; and the coding and decoding chip repeatedly executes the programming process according to the same principle until all the batches of programming files are programmed completely and all the audio and video data to be processed are processed.

Illustratively, the programmable chip to which the codec chip is uniquely connected is the programmable chip 1. The method comprises the steps that files to be programmed obtained by an encoding and decoding chip comprise programming files 1-3, the total file size is M, the storage capacity of a programmable chip is N, and when M is smaller than or equal to N, the encoding and decoding chip directly programs the programming files 1-3 into the programmable chip 1; when M is larger than N, the encoding and decoding chip analyzes the file size of each programming file 1, for example, the obtained file size of each programming file 1 is M1, the file size of each programming file 2 is M2, the file size of each programming file 3 is M3, and the sum of the file sizes of any two programming files is larger than N, then the encoding and decoding chip divides the programming files 1 and 3 into 3 batches, the programming files 1 are the first batch, the programming files 2 are the second batch, and the programming files 3 are the third batch; firstly writing the programming file 1 into the programmable chip 1, and after the writing is successful, sending the audio and video data to be processed corresponding to the programming file 1 to the programmable chip 1; after receiving an audio and video processing success message returned by the programmable chip 1, writing the programming file 2 into the programmable chip 1, and after the writing is successful, sending the audio and video data to be processed corresponding to the programming file 2 to the programmable chip 1; after receiving the audio and video processing success message returned by the programmable chip 1, writing the programming file 3 into the programmable chip 1, and after the writing is successful, sending the audio and video data to be processed corresponding to the programming file 3 to the programmable chip 1.

By the programming method provided by the embodiment, the programming of all programming files can be realized by the coding and decoding chip when only one programmable chip is available, and then the audio and video data can be processed according to any coding and decoding parameters, so that the use experience of a user is enhanced.

With reference to the foregoing embodiments, in an implementation manner, the types of the codec parameters of the audio/video data that cannot be processed are multiple, one codec parameter corresponds to one programming file, and the number of the programming files and the number of the programmable chips are multiple; on the basis, the embodiment of the application also provides another file programming method, as shown in fig. 4. Fig. 4 is a flowchart illustrating another file writing method according to an embodiment of the present application. Referring to fig. 4, the step S15 may include:

on this basis, the step S15 may include:

step S151': and when the storage capacity of the programmable chip supports the programming of all programming files, arbitrarily determining a first programmable chip in the programmable chips.

Step S152': and programming all programming files into the first programmable chip.

In this embodiment, a method for how to write a programming file on a codec chip when a plurality of programmable chips are accessed is provided. Specifically, if the programming file obtained by the codec chip is small and can be completely written into the programmable chip, the codec chip arbitrarily selects one programmable chip, i.e., the first programmable chip, from all the adapted programmable chips, and then writes all the programming files into the first programmable chip. Therefore, after the programming is successful, the selected first programmable chip can perform encoding and decoding operations on the audio and video data to be processed, which cannot be processed and is sent by all the encoding and decoding chips, at one time.

Of course, if the codec chip sets the priority order for all the adapted programmable chips, the codec chip directly selects the programmable chip with the highest priority from all the adapted programmable chips as the first programmable chip, and then writes all the programming files into the first programmable chip.

Step S153': when the storage capacity of the programmable chip does not support the programming of all the programming files, the programming files are divided into a plurality of batches, and a plurality of second programmable chips in accordance with the number of the batches are determined at will in the programmable chips.

In this embodiment, if the file of the programming file obtained by the codec chip is large and cannot be written into the programmable chip all at once, the codec chip first divides all the programming files into a plurality of batches, so that only one batch of the programming file is programmed each time, and then arbitrarily selects the programmable chip that matches the batch number from all the adaptive programmable chips, for example, the batch number is 3, and then selects 3 programmable chips, that is, 3 second programmable chips.

Of course, if the codec chip sets the priority order to all the adapted programmable chips, the codec chip directly selects the second programmable chips from all the adapted programmable chips in the order of priority from high to low.

Step S154': and respectively programming the programming files of each batch into each second programmable chip according to the principle that one batch corresponds to one second programmable chip.

In this embodiment, a batch of programming files is used to write to a second programmable chip. Therefore, when the codec chip selects a plurality of second programmable chips, the programming files of each batch can be written into the second programmable chips respectively. Before writing, the programming files of each batch can be respectively associated with a plurality of second programmable chips, and when writing, the coding and decoding chips directly perform programming according to the association relationship.

Illustratively, the programmable chips connected with the coding and decoding chips are programmable chips 1-4. The method comprises the steps that files to be programmed obtained by an encoding and decoding chip comprise programming files 1-3, the total file size is M, the storage capacity of a programmable chip is N, and when M is smaller than or equal to N, the encoding and decoding chip directly programs the programming files 1-3 into an arbitrarily selected first programmable chip; when M is larger than N, the encoding and decoding chip analyzes the file size of each programming file 1, for example, the obtained file size of each programming file 1 is M1, the file size of each programming file 2 is M2, the file size of each programming file 3 is M3, and the sum of the file sizes of any two programming files is larger than N, then the encoding and decoding chip divides the programming files 1 and 3 into 3 batches, the programming files 1 are the first batch, the programming files 2 are the second batch, and the programming files 3 are the third batch; then, the coding and decoding chip randomly selects 3 second programmable chips from the programmable chips 1 to 4, and establishes the association between the programmable chips 1 to 3 and the programming files 1 to 3 on the assumption that the selected programmable chips 1 to 3 are selected; if the programmable chip 1 is associated with the programming file 1, the programmable chip 2 is associated with the programming file 2, and the programmable chip 3 is associated with the programming file 3, the codec chip writes the programming file 1 into the programmable chip 1, writes the programming file 2 into the programmable chip 2, and writes the programming file 3 into the programmable chip 3.

By the programming method provided by the embodiment, the coding and decoding chip can realize parallel programming of all programming files when a plurality of programmable chips exist, and further improve the programming speed.

On this basis, the step S16 may include:

and when the memory capacity of the programmable chip supports the programming of all programming files, transmitting the audio and video data which cannot be processed to the first programmable chip.

And when the storage capacity of the programmable chip does not support the programming of all the programming files, dividing the audio and video data which cannot be processed into a plurality of groups of audio and video data to be processed according to the coding and decoding parameters of each programmed second programmable chip.

In this embodiment, if one first programmable chip is selected, all audio and video data which cannot be processed are directly sent to the first programmable chip.

In this embodiment, when a batch of programming files runs, the audio and video data can be coded and decoded according to one type of coding and decoding parameters, so that each batch of programming files can correspond to a part of the audio and video data which can be processed, and thus, the coding and decoding chip can divide the audio and video data to be processed, which cannot be processed by itself, into a plurality of batches according to the batch of programming files, that is, divide the audio and video data to be processed into a plurality of groups of audio and video data to be processed.

Exemplarily, a programming file 1 corresponds to a first type of coding and decoding parameters, a programming file 2 corresponds to a second type of coding and decoding parameters, a programming file 3 corresponds to a third type of coding and decoding parameters, the programming file 1 and the programming file 2 are first batch of programming files, the programming file 3 is a second batch of programming files, the video data 1 needs to be processed according to the first type of coding and decoding parameters, the video data 2 needs to be processed according to the second type of coding and decoding parameters, and the video data 3 needs to be processed according to the third type of coding and decoding parameters, so that the video data 1 and the video data 2 should be divided into a first group of audio and video data to be processed, and the video data 3 should be divided into a second group of audio and video data to be processed; and finally, sending the first group of audio and video data to be processed to a programmable chip for programming the programming files of the first batch, and sending the second group of audio and video data to be processed to the programmable chip for programming the programming files of the second batch.

By the programming method provided by the embodiment, the coding and decoding chip can send all the audio and video data to be processed, which cannot be processed by the coding and decoding chip, to the plurality of programmable chips when the plurality of programmable chips are available, so that the plurality of programmable chips can process all the audio and video data to be processed in parallel, and the processing efficiency of the audio and video data is improved.

In combination with the above embodiment, in an implementation manner, the step S15 may include:

In this embodiment, JTAG (Joint Test Action Group) is an international standard Test protocol (IEEE 1149.1 compliant), and is mainly used for chip internal Test. Most advanced devices now support the JTAG protocol, such as DSP, FPGA devices, etc. The standard JTAG interface is 4-wire: TMS, TCK, TDI, TDO, mode select, clock, data input and data output lines, respectively. Therefore, when programming is needed, the coding and decoding chip sends a programming instruction to the programmable chip to control the programmable chip to enter a programming mode, and then the coding and decoding chip realizes programming of the programming file into the programmable chip through the JTAG interface.

The embodiment provides a programming method for programming a file, which can ensure that a programmable chip can realize smooth programming and further ensure the smooth processing of audio and video data to be processed.

With reference to the foregoing embodiment, in an implementation manner, the codec chip is in communication connection with a server, and on this basis, the data processing method of the present application may further include:

sending an update request to the server;

receiving an update file sent by the server in response to the update request;

In this embodiment, the codec chip may periodically initiate an update request to the server, query whether a new codec parameter appears, receive an update file returned by the server if the new codec parameter appears, where the update file includes a programming file corresponding to the new codec parameter, and then update the programming file stored in the codec chip according to the update file.

By the programming file updating method in the embodiment, the coding and decoding chip can ensure that enough types of programming files are stored in the coding and decoding chip, and further can code and decode audio and video data according to any coding and decoding parameters, so that the audio and video data are smoothly processed, diversified requirements of users are met, and the use experience of the users is improved.

With reference to the foregoing embodiment, in an implementation manner, after the programming file is programmed into the programmable chip, the data processing method of the present application may further include:

In this embodiment, when the programming of the programming file matched with a certain codec parameter fails, the codec chip may further initiate a request for obtaining the programming file matched with the codec parameter to the server, and after the request is obtained, the programming file matched with the codec parameter is programmed into the programmable chip, so that the programming file is guaranteed to be programmed smoothly, and the audio and video data is processed smoothly.

With reference to the foregoing embodiments, in one implementation manner, the codec chip is configured with a first memory, and the programmable chip is configured with a second memory;

In this embodiment, the codec chip may store the programming files corresponding to the codec parameters of each type in the first memory. The second memory is used for storing the starting configuration file, so that the programmable chip can read the starting configuration file from the second memory after receiving the programming instruction, run the starting configuration file and enter a programming mode.

The first storage and the second storage may adopt a Flash storage (which belongs to one type of memory devices and is a non-volatile memory). Of course, the first memory and the second memory may be any type of memory according to actual requirements, and the present application is not limited to this.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

The present application further provides a data processing system, as shown in fig. 5. Fig. 5 is a schematic structural diagram of a data processing system according to an embodiment of the present application. Referring to fig. 5, the system includes:

In fig. 5, FLASH _ a is a first memory and FLASH _ B is a second memory.

PCIE is PCI-express (peripheral component interconnect express), which is a high-speed serial computer expansion bus standard, and belongs to high-speed serial point-to-point dual-channel high-bandwidth transmission, and connected devices allocate independent channel bandwidths and do not share bus bandwidths, and mainly support functions such as active power management, error reporting, end-to-end reliable transmission, hot plug, quality of service (QOS), and the like. The coding and decoding chip can be in communication connection with the programmable chip by adopting a PCIE technology.

Based on the same inventive concept, the present application further provides a data processing apparatus 600, as shown in fig. 6. Fig. 6 is a block diagram illustrating a data processing apparatus according to an embodiment of the present application. Referring to fig. 6, a data processing apparatus 600 of the present application may include:

a first obtaining module 601, configured to obtain audio and video data to be processed;

a first determining module 602, configured to determine, in the to-be-processed audio/video data, audio/video data that cannot be processed by the codec chip;

a second determining module 603, configured to determine an encoding and decoding parameter of the audio and video data that cannot be processed;

a second obtaining module 604, configured to obtain a programming file matched with the encoding and decoding parameters;

a programming module 605, configured to program the programming file into a programmable chip adapted to the codec chip;

a first sending module 606, configured to send the audio and video data that cannot be processed to the programmable chip, so that the programmable chip processes the audio and video data that cannot be processed.

Optionally, the types of the encoding and decoding parameters of the audio and video data that cannot be processed are multiple, one encoding and decoding parameter corresponds to one programming file, the number of the programming files is multiple, the number of the programmable chips is one, and the programming module 605 includes:

Optionally, the types of the encoding and decoding parameters of the audio and video data which cannot be processed are multiple, one encoding and decoding parameter corresponds to one programming file, and the number of the programming files and the number of the programmable chips are multiple; the programming module 605 includes:

Optionally, the first sending module 606 includes:

Optionally, the programming module 605 includes:

Optionally, the codec chip is communicatively connected to a server, and the apparatus 600 further includes:

Optionally, the apparatus 600 further comprises:

the second obtaining module includes:

the third transmitting sub-module includes:

Based on the same inventive concept, the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and running on the processor, and when the processor executes the computer program, the electronic device implements the steps in the data processing method according to any of the above embodiments of the present application.

Based on the same inventive concept, the present application provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the steps in the data processing method according to any of the above-mentioned embodiments of the present application.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The data processing method, system, apparatus, electronic device and storage medium provided by the present invention are introduced in detail, and a specific example is applied in the text to explain the principle and the implementation of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A data processing method is applied to a coding and decoding chip, and the method comprises the following steps:

obtaining audio and video data to be processed;

acquiring a programming file matched with the encoding and decoding parameters;

2. The method according to claim 1, wherein the types of the codec parameters of the audio/video data which cannot be processed are multiple, one codec parameter corresponds to one programming file, the number of the programming files is multiple, the number of the programmable chips is one, and programming the programming files into the programmable chips comprises:

3. The method according to claim 1, wherein the types of the codec parameters of the audio/video data which cannot be processed are multiple, one codec parameter corresponds to one programming file, and the number of the programming files and the number of the programmable chips are multiple; programming the programming file into the programmable chip, including:

programming all programming files into the first programmable chip;

4. The method of claim 3, wherein sending the audio and video data that cannot be processed to the programmable chip comprises:

5. The method of claim 1, wherein programming the programming file into the programmable chip comprises:

6. The method of claim 1, wherein the codec chip is communicatively coupled to a server, the method further comprising:

sending an update request to the server;

receiving an update file sent by the server in response to the update request;

7. The method of claim 6, wherein after programming the programming file into the programmable chip, the method further comprises:

8. The method of claim 5, wherein the codec chip is configured with a first memory and the programmable chip is configured with a second memory;

9. A data processing system, characterized in that the system comprises:

10. A data processing apparatus, wherein the apparatus is applied to a coding/decoding chip, the apparatus comprising:

11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 8.

12. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executed implements the steps of the method according to any of claims 1-8.