CN109842797B - Big data encoding method and computer readable storage medium - Google Patents
Big data encoding method and computer readable storage medium Download PDFInfo
- Publication number
- CN109842797B CN109842797B CN201811625236.9A CN201811625236A CN109842797B CN 109842797 B CN109842797 B CN 109842797B CN 201811625236 A CN201811625236 A CN 201811625236A CN 109842797 B CN109842797 B CN 109842797B
- Authority
- CN
- China
- Prior art keywords
- avc
- entropy coding
- configurable
- interface
- arithmetic coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention relates to a big data coding method, which comprises the use of a configurable entropy coding platform to realize configurable entropy coding under the condition of big data server video frame supply, wherein the configurable entropy coding platform comprises a big data server and the like. The invention also relates to a computer-readable storage medium having stored thereon a computer program which, when being executed, carries out the steps of the method of the invention. By the invention, a big data server can be introduced for realizing quick reading operation.
Description
Technical Field
The present invention relates to the field of big data, and in particular, to a big data encoding method and a computer-readable storage medium.
Background
Technically, the relation between big data and cloud computing is as inseparable as the front and back of a coin.
The big data cannot be processed by a single computer necessarily, and a distributed computing architecture must be adopted. He features the mining of massive data, but he must rely on distributed processing of cloud computing, distributed databases, cloud storage and virtualization technologies.
Disclosure of Invention
The invention provides a big data coding method and a computer readable storage medium, aiming at solving the technical problem that the existing AVC entropy coding storage mode is lagged behind.
The invention has the following important invention points:
(1) a pressure analysis mechanism based on local data measurement and nearby data measurement can be established, a distance configuration strategy is introduced into the pressure analysis mechanism, and the estimation precision of relevant pressure values is improved;
(2) according to the terminal use condition of an output interface of the associated equipment, the working mode of the macro block line memory and the operation complexity of the read control equipment are adjusted in a self-adaptive mode, so that the internal performance of the system is further optimized;
(3) and introducing a big data server for storing each video frame to be coded, connecting the big data server with an AVC entropy coding structure through a network, and facilitating the reading control equipment of the AVC entropy coding structure to control the reading operation of each video frame.
According to an aspect of the invention, there is provided a method of AVC configurable entropy coding, the method comprising using an AVC configurable entropy coding platform to enable configurable entropy coding of AVC with large data server video frame provisioning, the AVC configurable entropy coding platform comprising:
the big data server is used for storing each video frame to be coded, is connected with the AVC entropy coding structure through a network and is used for facilitating the reading control equipment of the AVC entropy coding structure to control the reading operation of each video frame;
an AVC entropy coding structure comprising a readout control device, a macroblock line memory, a context calculation device and an arithmetic coding device, said context calculation device and said arithmetic coding device being connected.
More specifically, in the AVC configurable entropy coding platform:
the readout control device, the macroblock line memory, the context calculation device, and the arithmetic coding device are respectively implemented using different models of programmable logic devices.
More specifically, in the AVC configurable entropy coding platform, the platform further comprises:
a parameter configuration device for setting the amount of data provided to the arithmetic coding device for processing per unit time based on the real-time data processing rate of the context calculation device;
in the parameter configuration device, the smaller the real-time data processing rate of the context calculation device is, the smaller the amount of data provided to the arithmetic coding device for processing in a set unit time is;
the first terminal analysis device is connected with the output interface of the context calculation device and used for detecting the number of the currently used terminals of the output interface of the context calculation device to be output as the total number of the first interface terminals;
the second terminal analysis device is connected with the output interface of the arithmetic coding device and used for detecting the number of the currently used terminals of the output interface of the arithmetic coding device to output as the total number of the terminals of the second interface;
an SOC control chip connected to the first terminal analyzing device and the second terminal analyzing device, respectively, provided at an intermediate position between the context calculating device and the arithmetic coding device, for receiving the first interface terminal total number and the second interface terminal total number, multiplying the first interface terminal total number and a first coefficient to obtain a first product, multiplying the second interface terminal total number and a second coefficient to obtain a second product, and outputting a reference terminal number obtained by adding the first product and the second product;
the power-saving processing equipment is respectively connected with the SOC control chip and the macro block line memory, and is used for controlling the macro block line memory to be charged into a non-power-saving mode from a power-saving mode when the number of the received reference terminals exceeds the limit, and is also used for controlling the macro block line memory to be charged into the power-saving mode from the non-power-saving mode when the number of the received reference terminals does not exceed the limit;
the complexity adjusting device is respectively connected with the SOC control chip and the reading control device and is used for controlling the reading control device to improve the operation complexity of the reading control device to obtain result data with higher precision when the number of the received reference terminals exceeds the limit;
wherein, in the SOC control chip, the first coefficient and the second coefficient are different in size, and a sum of the first coefficient and the second coefficient is 1.
More specifically, in the AVC configurable entropy coding platform, the platform further comprises: and the GPRS communication interface is connected with the data setting equipment and used for requesting a configuration strategy from a configuration server through a GPRS communication network so as to obtain the encrypted configuration strategy.
More specifically, in the AVC configurable entropy coding platform: and the GPRS communication interface is also used for carrying out decryption operation on the encrypted configuration strategy.
More specifically, in the AVC configurable entropy coding platform: the complexity adjustment device is further configured to control the readout control device to maintain its current computational complexity when the number of received reference terminals is not exceeded.
More specifically, in the AVC configurable entropy coding platform: in the GPRS communication interface, the configuration policy is configured to determine an impact factor for a shell pressure value of the shell detection device and an impact factor for a side pressure value of the side detection device based on the device separation.
According to yet another aspect of the present invention, there is also provided a computer-readable storage medium having stored thereon a computer program which, when executed, implements the steps of the AVC configurable entropy coding method as described above.
Detailed Description
Embodiments of the present invention will be described in detail below.
Big data (big data), which refers to a data set that cannot be captured, managed and processed by a conventional software tool within a certain time range, is a massive, high-growth-rate and diversified information asset that needs a new processing mode to have stronger decision-making power, insight discovery power and process optimization capability.
The big data in the big data era written by vikto meier-schenberg and kenius couk jeer means that analysis is performed using all data without such shortcut as random analysis (sampling survey). 5V characteristics of big data (proposed by IBM): volume (bulk), Velocity (high speed), Variety (multiple), Value (low Value density), Veracity (authenticity).
In the prior art, because AVC video frame data has the characteristics of complex data and large data volume, the setting of a reading mode is difficult to select when an AVC video frame input/output interface is designed, and a data processing mode of large data is favorable for overcoming the defect; meanwhile, each device in the video reading system is of a chip structure, and a high-precision pressure estimation mechanism is lacked, so that the subsequent device monitoring lacks necessary and accurate reference data.
To overcome the above deficiencies, the present invention builds an AVC configurable entropy coding method that includes using an AVC configurable entropy coding platform to enable configurable entropy coding of AVC with large data server video frame provisioning. The AVC configurable entropy coding platform can effectively solve the corresponding technical problem.
An AVC configurable entropy coding platform shown in accordance with an embodiment of the present invention comprises:
the big data server is used for storing each video frame to be coded, is connected with the AVC entropy coding structure through a network and is used for facilitating the reading control equipment of the AVC entropy coding structure to control the reading operation of each video frame;
an AVC entropy coding structure comprising a readout control device, a macroblock line memory, a context calculation device and an arithmetic coding device, said context calculation device and said arithmetic coding device being connected.
Next, the detailed structure of the AVC configurable entropy coding platform of the present invention will be further described.
In the AVC configurable entropy coding platform:
the readout control device, the macroblock line memory, the context calculation device, and the arithmetic coding device are respectively implemented using different models of programmable logic devices.
The AVC configurable entropy coding platform further comprises:
a parameter configuration device for setting the amount of data provided to the arithmetic coding device for processing per unit time based on the real-time data processing rate of the context calculation device;
in the parameter configuration device, the smaller the real-time data processing rate of the context calculation device is, the smaller the amount of data provided to the arithmetic coding device for processing in a set unit time is;
the first terminal analysis device is connected with the output interface of the context calculation device and used for detecting the number of the currently used terminals of the output interface of the context calculation device to be output as the total number of the first interface terminals;
the second terminal analysis device is connected with the output interface of the arithmetic coding device and used for detecting the number of the currently used terminals of the output interface of the arithmetic coding device to output as the total number of the terminals of the second interface;
an SOC control chip connected to the first terminal analyzing device and the second terminal analyzing device, respectively, provided at an intermediate position between the context calculating device and the arithmetic coding device, for receiving the first interface terminal total number and the second interface terminal total number, multiplying the first interface terminal total number and a first coefficient to obtain a first product, multiplying the second interface terminal total number and a second coefficient to obtain a second product, and outputting a reference terminal number obtained by adding the first product and the second product;
the power-saving processing equipment is respectively connected with the SOC control chip and the macro block line memory, and is used for controlling the macro block line memory to be charged into a non-power-saving mode from a power-saving mode when the number of the received reference terminals exceeds the limit, and is also used for controlling the macro block line memory to be charged into the power-saving mode from the non-power-saving mode when the number of the received reference terminals does not exceed the limit;
the complexity adjusting device is respectively connected with the SOC control chip and the reading control device and is used for controlling the reading control device to improve the operation complexity of the reading control device to obtain result data with higher precision when the number of the received reference terminals exceeds the limit;
wherein, in the SOC control chip, the first coefficient and the second coefficient are different in size, and a sum of the first coefficient and the second coefficient is 1.
The AVC configurable entropy coding platform further comprises:
and the GPRS communication interface is connected with the data setting equipment and used for requesting a configuration strategy from a configuration server through a GPRS communication network so as to obtain the encrypted configuration strategy.
In the AVC configurable entropy coding platform:
and the GPRS communication interface is also used for carrying out decryption operation on the encrypted configuration strategy.
In the AVC configurable entropy coding platform:
the complexity adjustment device is further configured to control the readout control device to maintain its current computational complexity when the number of received reference terminals is not exceeded.
In the AVC configurable entropy coding platform:
in the GPRS communication interface, the configuration policy is configured to determine an impact factor for a shell pressure value of the shell detection device and an impact factor for a side pressure value of the side detection device based on the device separation.
Meanwhile, in order to overcome the above-mentioned disadvantages, the present invention also builds a computer readable storage medium, on which a computer program is stored, which when executed implements the steps of the AVC configurable entropy coding method as described above.
In addition, the System on Chip is called SOC for short, i.e. System on Chip. From a narrow sense, the system is the chip integration of the core of an information system, and key components of the system are integrated on one chip; in a broad sense, an SOC is a micro-miniature system, and if a Central Processing Unit (CPU) is the brain, the SOC is a system including the brain, heart, eyes, and hands. The academia at home and abroad generally tends to define the SOC as integrating a microprocessor, an analog IP core, a digital IP core and a memory (or off-chip memory control interface) on a single chip, which is usually custom-made or standard product oriented to a specific application.
The basic content of the SOC definition is mainly two-fold: one is his composition and the other is his forming process. The system-level chip can be composed of a system-level chip control logic module, a microprocessor/microcontroller CPU core module, a digital signal processor DSP module, an embedded memory module, an interface module for communicating with the outside, an analog front-end module containing ADC/DAC, a power supply and power consumption management module, a radio frequency front-end module, user defined logic (which can be realized by FPGA or ASIC) and a micro-electro-mechanical module for a wireless SOC, and more importantly, a SOC chip is embedded with a basic software (RDOS or COS and other application software) module or loadable user software and the like.
By adopting the AVC configurable entropy coding platform, the method and the storage medium, aiming at the technical problem that the AVC entropy coding storage mode in the prior art is laggard, a distance configuration strategy is introduced into a pressure analysis mechanism by establishing the pressure analysis mechanism based on local data measurement and nearby data measurement, so that the estimation precision of related pressure values is improved; the working mode of the macro block line memory and the operation complexity of the read control device are adjusted in a self-adaptive mode according to the terminal use condition of the output interface of the associated device, so that the internal performance of the system is further optimized; and introducing a big data server for storing each video frame to be coded, connecting with the AVC entropy coding structure through a network, and facilitating the reading control equipment of the AVC entropy coding structure to control the reading operation of each video frame.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: Read-Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (3)
1. A method of AVC configurable entropy coding, said method comprising using an AVC configurable entropy coding platform to enable configurable entropy coding of AVC with large data server video frame provisioning, said AVC configurable entropy coding platform comprising:
the big data server is used for storing each video frame to be coded, is connected with the AVC entropy coding structure through a network and is used for facilitating the reading control equipment of the AVC entropy coding structure to control the reading operation of each video frame;
an AVC entropy coding structure comprising a readout control device, a macroblock line memory, a context calculation device, and an arithmetic coding device, said context calculation device and said arithmetic coding device being connected;
the readout control device, the macroblock line memory, the context calculation device, and the arithmetic coding device are respectively implemented by using programmable logic devices of different models;
a parameter configuration device for setting the amount of data provided to the arithmetic coding device for processing per unit time based on the real-time data processing rate of the context calculation device;
in the parameter configuration device, the smaller the real-time data processing rate of the context calculation device is, the smaller the amount of data provided to the arithmetic coding device for processing in a set unit time is;
the first terminal analysis device is connected with the output interface of the context calculation device and used for detecting the number of the currently used terminals of the output interface of the context calculation device to be output as the total number of the first interface terminals;
the second terminal analysis device is connected with the output interface of the arithmetic coding device and used for detecting the number of the currently used terminals of the output interface of the arithmetic coding device to output as the total number of the terminals of the second interface;
an SOC control chip connected to the first terminal analyzing device and the second terminal analyzing device, respectively, provided at an intermediate position between the context calculating device and the arithmetic coding device, for receiving the first interface terminal total number and the second interface terminal total number, multiplying the first interface terminal total number and a first coefficient to obtain a first product, multiplying the second interface terminal total number and a second coefficient to obtain a second product, and outputting a reference terminal number obtained by adding the first product and the second product;
the power-saving processing equipment is respectively connected with the SOC control chip and the macro block line memory, and is used for controlling the macro block line memory to be charged into a non-power-saving mode from a power-saving mode when the number of the received reference terminals exceeds the limit, and is also used for controlling the macro block line memory to be charged into the power-saving mode from the non-power-saving mode when the number of the received reference terminals does not exceed the limit;
the complexity adjusting device is respectively connected with the SOC control chip and the reading control device and is used for controlling the reading control device to improve the operation complexity of the reading control device to obtain result data with higher precision when the number of the received reference terminals exceeds the limit;
wherein, in the SOC control chip, the first coefficient and the second coefficient are different in size, and a sum of the first coefficient and the second coefficient is 1.
2. The method of claim 1, wherein:
the complexity adjustment device is further configured to control the readout control device to maintain its current computational complexity when the number of received reference terminals is not exceeded.
3. A computer-readable storage medium, having stored thereon a computer program which, when executed, performs the steps of the method of claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811625236.9A CN109842797B (en) | 2018-12-28 | 2018-12-28 | Big data encoding method and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811625236.9A CN109842797B (en) | 2018-12-28 | 2018-12-28 | Big data encoding method and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109842797A CN109842797A (en) | 2019-06-04 |
| CN109842797B true CN109842797B (en) | 2020-04-24 |
Family
ID=66883506
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811625236.9A Active CN109842797B (en) | 2018-12-28 | 2018-12-28 | Big data encoding method and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109842797B (en) |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2879387B1 (en) * | 2004-12-15 | 2007-04-27 | Tdf Sa | METHOD FOR TRANSMITTING A VARIABLE BINARY RATE THROUGH A TRANSMISSION CHANNEL. |
| US8345767B2 (en) * | 2006-12-14 | 2013-01-01 | Nec Corporation | Video encoding method, video encoding device, and video encoding program |
| CN107770528B (en) * | 2016-08-19 | 2023-08-25 | 中兴通讯股份有限公司 | Video playing method and device |
-
2018
- 2018-12-28 CN CN201811625236.9A patent/CN109842797B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109842797A (en) | 2019-06-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104025669A (en) | Opportunistic resource sharing between devices | |
| CN104703163A (en) | Real-time monitoring method for remaining Internet surfing flow of terminal and flow monitoring server | |
| US11727419B2 (en) | Realtime busyness for places | |
| WO2016131348A1 (en) | Method for achieving traffic control and terminal | |
| CN111683273A (en) | Method and device for determining video blockage information | |
| CN109714266A (en) | A kind of data processing method and the network equipment | |
| CN114842424B (en) | Intelligent security image identification method and device based on motion compensation | |
| Kim et al. | Signal strength-aware adaptive offloading with local image preprocessing for energy efficient mobile devices | |
| CN115348213B (en) | Metering device, metering method and chip of TSN (traffic channel network) | |
| CN107426736A (en) | The frequency spectrum sensing method and system of a kind of cognitive radio | |
| CN109842797B (en) | Big data encoding method and computer readable storage medium | |
| CN109870172A (en) | Step counting detection method, device, equipment and storage medium | |
| CN107729860B (en) | Recognition of face calculation method and Related product | |
| CN110111545A (en) | Disinfection room warning system and method based on signal detection | |
| KR102209992B1 (en) | Method for controlling beacon reception time and station using the same | |
| CN111652486A (en) | Method and device for calculating service index | |
| CN108765503B (en) | Skin color detection method, device and terminal | |
| CN114070791B (en) | Speed limiting processing method and device for data traffic | |
| CN108400888A (en) | A kind of log processing method, storage medium and terminal device | |
| CN109618158A (en) | Big data encoding platform | |
| CN115175174A (en) | Method for realizing probe equipment management and control system based on Internet of things platform | |
| CN103996273A (en) | RFID watt hour meter electric energy information collection system and collection method | |
| WO2020020358A1 (en) | Method and apparatus for determining residence time duration, device, and storage medium | |
| CN109615728A (en) | Driving recording platform and method based on big data analysis | |
| CN204667397U (en) | A kind of movement circuit being applicable to the flow collection equipment of networks congestion control information audit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200402 Address after: Hangzhou City, Zhejiang province 310052 Binjiang District River Street South Road No. 588 building, 17 storey main building, Hengxin 18 Applicant after: CCI (CHINA) Co.,Ltd. Address before: 211162 No. 70 Yinian Road, Binjiang Development Zone, Jiangning District, Nanjing City, Jiangsu Province Applicant before: Jin Aicong |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |