CN112102150B - Adaptive short video content enhancement system - Google Patents

Adaptive short video content enhancement system Download PDF

Info

Publication number
CN112102150B
CN112102150B CN202010013623.8A CN202010013623A CN112102150B CN 112102150 B CN112102150 B CN 112102150B CN 202010013623 A CN202010013623 A CN 202010013623A CN 112102150 B CN112102150 B CN 112102150B
Authority
CN
China
Prior art keywords
image
video
short video
adaptive
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010013623.8A
Other languages
Chinese (zh)
Other versions
CN112102150A (en
Inventor
胡景鲁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Yali Interactive Network Technology Co.,Ltd.
Original Assignee
Hangzhou Yali Interactive Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Yali Interactive Network Technology Co ltd filed Critical Hangzhou Yali Interactive Network Technology Co ltd
Priority to CN202010013623.8A priority Critical patent/CN112102150B/en
Publication of CN112102150A publication Critical patent/CN112102150A/en
Application granted granted Critical
Publication of CN112102150B publication Critical patent/CN112102150B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration using histogram techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/02Affine transformations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention relates to a self-adaptive short video content enhancement system, which comprises: the signal video recording equipment is used for executing video recording action of a short video on a current video recording scene so as to obtain a section of short video from video recording starting time to video recording ending time, wherein the short video comprises each field video image; the data updating device is used for receiving each content enhanced image corresponding to each field video image respectively and sending each content enhanced image serving as an updated short video to the short video big data server; and the histogram processing device is used for executing histogram equalization processing on each live video image to obtain a corresponding equalization processing image. The self-adaptive short video content enhancement system is convenient to operate and reliable in logic. Because different self-adaptive enhancement strategies are executed on each frame of short video picture in the short video production, the flexibility of the short video production is improved, and the effect of the short video production is ensured.

Description

Adaptive short video content enhancement system
Technical Field
The invention relates to the field of short video production, in particular to a self-adaptive short video content enhancement system.
Background
The short video is a video in short film, is an internet content transmission mode, and is generally a video transmitted on a new internet media within 5 minutes; with the popularization of mobile terminals and the increasing speed of networks, short and fast mass-flow transmission contents are gradually favored by various large systems, fans and capital.
With the advent of the net red economy, the video industry gradually rises up a batch of high-quality UGC content producers, and microblogs, second-time shots, fast hands and tonight-headed bars enter the short video industry, so that a batch of excellent content production teams are recruited to live in. By 2019, the short video industry competed to enter the stage of blandness, and content producers also tended to operate in the PGC profession.
The content of the short video integrates the topics of skill sharing, humorous work, fashion trend, social hotspots, street interview, public education, advertising creativity, business customization and the like. Because the content is short, the content can be individually sliced or can be a series of columns.
Disclosure of Invention
In order to solve the related problems in the prior art, the invention provides a self-adaptive short video content enhancement system which can execute different edge enhancement processing strategies based on the richness degree of a picture on each frame of picture of a short video, thereby improving the process and level of short video production.
For this reason, the present invention needs to have several important points:
(1) performing targeted processing on each frame of picture of the short video, and determining the frequency of performing subsequent edge enhancement processing according to the content richness degree in the image subjected to the targeted processing, thereby realizing the self-adaptive enhancement processing on the short video content;
(2) the richness of the contents in the image is determined based on the number of the imaging targets, and the edge enhancement times of the subsequent determination is in direct proportion to the number of the imaging targets.
According to an aspect of the present invention, there is provided an adaptive short video content enhancement system, the system comprising:
the signal video recording equipment is used for executing video recording action of a short video on a current video recording scene so as to obtain a section of short video from video recording starting time to video recording ending time, wherein the short video comprises each field video image;
the data updating device is connected with the short video big data server through a network and is used for receiving each content enhanced image corresponding to each field video image respectively and sending each content enhanced image as an updated short video to the short video big data server;
the histogram processing equipment is connected with the signal recording equipment and is used for executing histogram equalization processing on each field video image to obtain a corresponding equalization processing image;
the signal correction device is connected with the histogram processing device and used for receiving the equalization processing image and executing white balance processing on the equalization processing image to obtain a corresponding signal correction image;
an affine transformation device connected to the signal correction device for performing affine transformation processing on the received signal correction image to obtain and output a corresponding affine transformation image;
the object detection device is connected with the affine transformation device and used for acquiring the affine transformation image, detecting the number of imaging objects in the affine transformation image and determining the corresponding edge enhancement times based on the number of the imaging objects;
the dynamic enhancement device is respectively connected with the data updating device and the target detection device and is used for executing multiple times of edge enhancement processing consistent with the edge enhancement times on the affine transformation image so as to obtain a corresponding content enhanced image;
wherein determining the corresponding edge enhancement times based on the number of imaged targets comprises: the determined edge enhancement times are proportional to the number of imaging targets;
the dynamic enhancement equipment, the data updating equipment and the target detection equipment are all arranged at the rear end of the signal video recording equipment, and the front end of the signal video recording equipment is a video recording opening.
According to another aspect of the present invention, there is also provided an adaptive short video content enhancement method, the method comprising using an adaptive short video content enhancement system as described above for deciding a corresponding image content enhancement policy based on a target richness level in a short video picture.
The self-adaptive short video content enhancement system is convenient to operate and reliable in logic. Because different self-adaptive enhancement strategies are executed on each frame of short video picture in the short video production, the flexibility of the short video production is improved, and the effect of the short video production is ensured.
Detailed Description
Embodiments of the adaptive short video content enhancement system of the present invention will be described in detail below.
Signal processing is employed in a number of important fields of application with great osmotic power. The engineering and construction department is used for simulating the earthquake resistance and the earthquake resistance of a large-scale building structure; machine manufacturing to analyze models of mechanical structure vibrations to improve vibration performance and structure; in the aircraft industry for checking the transmission characteristics and wear of engines; the space remote sensing is used for classifying ground vegetation conditions and distributing meteorological cloud layers, and is used for B ultrasonic and X-ray pictures and analyzing and diagnosing physiological electric signals in the medical field; in the fields of telecommunications and electronics, digital signal processing is the most straightforward application.
In the field of telecommunications, the most typical uses of digital signal processing are:
(1) speech coding and compression. The digitized voice occupies a wide frequency band, and needs to be compressed for narrow-band transmission and efficient storage. Typically a 64kbit/s code rate is required for a speech. Medium-speed coding requires that the code rate is compressed to 32kbit/s, 16kbit/s or even 8kbit/s, and still good voice quality is maintained. With digital signal processing techniques, many adaptive coding schemes have been proposed to meet the specifications recommended by the international telegraph telephone counseling committee. The code rate required by low-speed coding is reduced to 4.8kbit/s and 2.4kbit/s to 800bit/s, and the method is realized by a good algorithm and hardware.
(2) And (5) image coding and compression. The amount of data after digital encoding is very large, whether it is still images or moving images, or even television images. The high-quality transmission of the materials is generally carried out by compressing the materials to 1/10-1/100. Various coding methods, so-called wavelet transform methods and fractal signal analysis methods, all provide feasible schemes for high compression ratio television coding.
(3) And designing a shunt filter bank and a combiner filter bank. The core of the technical realization of the time division/frequency division multiplexing equipment is a shunt filter bank. The design and implementation of the shunt filter bank completely depend on the digital filter bank in the digital signal processing, and the digital filter bank has uniform, stable and reliable performance and high cost performance.
(4) Adaptive equalization and echo cancellation. Equalization and echo cancellation are essential in long-distance data communication. The adoption of analog devices has failed to achieve equalization suitable for various channel requirements, and the performance of the analog devices can only be guaranteed by a digital method.
The application of signal processing techniques has evolved to a wide extent not inferior to electronic computer applications. With the continuous discovery of algorithms and the continuous generation of devices, signal processing becomes a basic subject that all telecom engineers need to be familiar with.
Currently, in the production of short video, the same image processing strategy is performed for each frame picture without considering the difference in the content of the different pictures. For example, rich-content pictures require clearer target boundaries, while poor-content pictures do not require the expenditure of significant enhancement processing to obtain clear target boundaries. The short video with poor manufacturing effect can not reach the due powder absorption effect naturally after being uploaded.
In order to overcome the defects, the invention builds a self-adaptive short video content enhancement system, and can effectively solve the corresponding technical problem.
An adaptive short video content enhancement system shown according to an embodiment of the present invention includes:
the signal video recording equipment is used for executing video recording action of a short video on a current video recording scene so as to obtain a section of short video from video recording starting time to video recording ending time, wherein the short video comprises each field video image;
the data updating device is connected with the short video big data server through a network and is used for receiving each content enhanced image corresponding to each field video image respectively and sending each content enhanced image as an updated short video to the short video big data server;
the histogram processing equipment is connected with the signal recording equipment and is used for executing histogram equalization processing on each field video image to obtain a corresponding equalization processing image;
the signal correction device is connected with the histogram processing device and used for receiving the equalization processing image and executing white balance processing on the equalization processing image to obtain a corresponding signal correction image;
an affine transformation device connected to the signal correction device for performing affine transformation processing on the received signal correction image to obtain and output a corresponding affine transformation image;
the object detection device is connected with the affine transformation device and used for acquiring the affine transformation image, detecting the number of imaging objects in the affine transformation image and determining the corresponding edge enhancement times based on the number of the imaging objects;
the dynamic enhancement device is respectively connected with the data updating device and the target detection device and is used for executing multiple times of edge enhancement processing consistent with the edge enhancement times on the affine transformation image so as to obtain a corresponding content enhanced image;
wherein determining the corresponding edge enhancement times based on the number of imaged targets comprises: the determined edge enhancement times are proportional to the number of imaging targets;
the dynamic enhancement equipment, the data updating equipment and the target detection equipment are all arranged at the rear end of the signal video recording equipment, and the front end of the signal video recording equipment is a video recording opening.
Next, the detailed structure of the adaptive short video content enhancement system of the present invention will be further described.
The adaptive short video content enhancement system may further include:
and the touch screen is used for receiving input information of the user according to the operation of the user.
The adaptive short video content enhancement system may further include:
and the video communication equipment is used for wirelessly sending the field image obtained by image acquisition of the environment where the target detection equipment is located.
In the adaptive short video content enhancement system:
the video communication apparatus includes a compression encoding device for performing MPEG-4 standard compression on a live image to obtain a compressed image.
In the adaptive short video content enhancement system:
the video communication equipment comprises a multi-index coding device which is connected with the compression coding device and is used for carrying out multi-index coding on the compressed image to obtain channel coding data.
In the adaptive short video content enhancement system:
the video communication device comprises a wireless communication interface connected with the multi-index coding device and used for wirelessly transmitting channel coding data.
In the adaptive short video content enhancement system:
the wireless communication interface is a time division duplex communication interface or a frequency division duplex communication interface.
In the adaptive short video content enhancement system:
the wireless communication interface is a 4G communication interface or a GPRS communication interface.
The adaptive short video content enhancement system may further include:
and the hard disk device is used for storing various configuration parameters of the target detection device.
Meanwhile, in order to overcome the defects, the invention also builds a self-adaptive short video content enhancement method, which comprises the step of using the self-adaptive short video content enhancement system for determining the corresponding image content enhancement strategy based on the target richness degree in the short video picture.
In addition, frequency division duplex means that uplink and downlink transmissions are performed on different frequencies. In the first and second generation cellular systems, FDD technology is basically used for duplex transmission. In particular, in the first generation cellular systems, since continuous baseband signals are transmitted, duplex uplink and downlink channels must be provided using different frequencies. In the first generation cellular systems, in which FDD is used for continuous information transmission, frequency synthesizers for generating different carrier frequencies are required at both the transmitting and receiving ends, and a duplex filter for preventing the transmission signal from leaking to the receiver is required at the receiving end. In addition, in order to facilitate the fabrication of the duplexer, a certain frequency interval is required between the transmission and reception carrier frequencies. In the second generation of systems such as GSM, IS-136 and IS-95, FDD technology IS also used. In these systems, since the information is transmitted in time slots, the transmission and reception can be performed in different time slots, and the transmission signal of the mobile station or the base station does not interfere with the receiver. So, despite the FDD technique employed, no expensive duplex filters are required.
The FDD mode is characterized by receiving and transmitting in two symmetric frequency channels separated (190 MHz between uplink and downlink frequencies), and separating the receiving and transmitting channels by guard bands. By adopting the technologies of packet switching and the like, the bottleneck of the second generation development can be broken through, the high-speed data service can be realized, the frequency spectrum utilization rate can be improved, and the system capacity can be increased. FDD must provide third generation services using paired frequencies, i.e., within a bandwidth of every 2x5 MHz. The mode can fully utilize the uplink and downlink frequency spectrums when supporting the symmetric service, but the frequency spectrum utilization rate is greatly reduced (about 40 percent of the frequency spectrum utilization rate is reduced due to low uplink load) when the asymmetric packet switching (Internet) works, and in this regard, the TDD mode has incomparable advantages compared with the FDD mode.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature.
Although the present invention has been described with reference to the above embodiments, it should be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the spirit and scope of the invention. Therefore, the protection scope of the present invention should be subject to the scope defined by the claims of the present application.

Claims (10)

1. An adaptive short video content enhancement system, the system comprising:
the signal video recording equipment is used for executing video recording action of a short video on a current video recording scene so as to obtain a section of short video from video recording starting time to video recording ending time, wherein the short video comprises each field video image;
the data updating device is connected with the short video big data server through a network and is used for receiving each content enhanced image corresponding to each field video image respectively and sending each content enhanced image as an updated short video to the short video big data server;
the histogram processing equipment is connected with the signal recording equipment and is used for executing histogram equalization processing on each field video image to obtain a corresponding equalization processing image;
the signal correction device is connected with the histogram processing device and used for receiving the equalization processing image and executing white balance processing on the equalization processing image to obtain a corresponding signal correction image;
an affine transformation device connected to the signal correction device for performing affine transformation processing on the received signal correction image to obtain and output a corresponding affine transformation image;
the object detection device is connected with the affine transformation device and used for acquiring the affine transformation image, detecting the number of imaging objects in the affine transformation image and determining the corresponding edge enhancement times based on the number of the imaging objects;
the dynamic enhancement device is respectively connected with the data updating device and the target detection device and is used for executing multiple times of edge enhancement processing consistent with the edge enhancement times on the affine transformation image so as to obtain a corresponding content enhanced image;
wherein determining the corresponding edge enhancement times based on the number of imaged targets comprises: the determined edge enhancement times are proportional to the number of imaging targets;
the dynamic enhancement equipment, the data updating equipment and the target detection equipment are all arranged at the rear end of the signal video recording equipment, and the front end of the signal video recording equipment is a video recording opening.
2. The adaptive short video content enhancement system of claim 1, wherein the system further comprises:
and the touch screen is used for receiving input information of the user according to the operation of the user.
3. The adaptive short video content enhancement system of claim 2, wherein the system further comprises:
and the video communication equipment is used for wirelessly sending the field image obtained by image acquisition of the environment where the target detection equipment is located.
4. The adaptive short video content enhancement system of claim 3, wherein:
the video communication apparatus includes a compression encoding device for performing MPEG-4 standard compression on a live image to obtain a compressed image.
5. The adaptive short video content enhancement system of claim 4, wherein:
the video communication equipment comprises a multi-index coding device which is connected with the compression coding device and is used for carrying out multi-index coding on the compressed image to obtain channel coding data.
6. The adaptive short video content enhancement system of claim 5, wherein:
the video communication device comprises a wireless communication interface connected with the multi-index coding device and used for wirelessly transmitting channel coding data.
7. The adaptive short video content enhancement system of claim 6, wherein:
the wireless communication interface is a time division duplex communication interface or a frequency division duplex communication interface.
8. The adaptive short video content enhancement system of claim 6, wherein:
the wireless communication interface is a 4G communication interface or a GPRS communication interface.
9. The adaptive short video content enhancement system of claim 2, wherein the system further comprises:
and the hard disk device is used for storing various configuration parameters of the target detection device.
10. An adaptive short video content enhancement method, the method comprising providing an adaptive short video content enhancement system according to any one of claims 1-9 for deciding a corresponding image content enhancement strategy based on a target richness level in a short video picture.
CN202010013623.8A 2020-01-07 2020-01-07 Adaptive short video content enhancement system Active CN112102150B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010013623.8A CN112102150B (en) 2020-01-07 2020-01-07 Adaptive short video content enhancement system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010013623.8A CN112102150B (en) 2020-01-07 2020-01-07 Adaptive short video content enhancement system

Publications (2)

Publication Number Publication Date
CN112102150A CN112102150A (en) 2020-12-18
CN112102150B true CN112102150B (en) 2022-03-18

Family

ID=73749420

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010013623.8A Active CN112102150B (en) 2020-01-07 2020-01-07 Adaptive short video content enhancement system

Country Status (1)

Country Link
CN (1) CN112102150B (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102360421B (en) * 2011-10-19 2014-05-28 苏州大学 Face identification method and system based on video streaming
US9445713B2 (en) * 2013-09-05 2016-09-20 Cellscope, Inc. Apparatuses and methods for mobile imaging and analysis
CN108062746A (en) * 2016-11-09 2018-05-22 深圳市优朋普乐传媒发展有限公司 A kind of method of video image processing and device, video coding system
CN110610463A (en) * 2019-08-07 2019-12-24 深圳大学 Image enhancement method and device

Also Published As

Publication number Publication date
CN112102150A (en) 2020-12-18

Similar Documents

Publication Publication Date Title
Rane et al. Structure and texture filling-in of missing image blocks in wireless transmission and compression applications
RU2533444C2 (en) Image processing device and method
CN102857751A (en) Video encoding and decoding methods and device
US9825740B2 (en) Method for carrier aggregation transmission and apparatus for realizing carrier aggregation transmission
US20210058925A1 (en) Method and apparatus for performing function split in wireless communication system
WO2013185274A1 (en) Bandwidth in wireless communications
WO2013064112A1 (en) Method and device of video image filtering process
CN107071333A (en) Method of video image processing and video image processing device
CN112102150B (en) Adaptive short video content enhancement system
CN105656732A (en) Method, device and terminal for supporting multiple network data access
Almazroi Performance analysis of 4G broadband cellular networks
Chaoub et al. Reliable rate-adaptive video transmission over cognitive cellular networks using multiple description scalable coding
CN102857749A (en) Pixel classification method and device for video image
Zhang et al. Fine granularity resource allocation algorithm for video transmission in orthogonal frequency division multiple access system
Dike 5G Emancipation: A review of the panacea for an efficient communication growth in the evolution of cellular networks
JP3955508B2 (en) Image attached mail relay device, image attached mail relay method, and image attached mail relay program
Ploysongsang et al. DCT/DPCM processing of NTSC composite video signal
CN110169005A (en) Oval directional filter for condensating synthesizering circuit
JP4824026B2 (en) Distance division multiplexing
JP2021168447A (en) Transmission device, reception device, and program
EP4138477A1 (en) Physical downlink control channel configuration method, apparatus, device, and storage medium
CN111491130A (en) Adaptive display picture driving apparatus
CN107438181A (en) A kind of audio/video processing method and device
Lee et al. Cross-layer optimization for downlink wavelet video transmission
EP3709272A1 (en) Processing a point cloud

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20211224

Address after: 225300 s area, No.18 factory building, co construction area, hailing Industrial Park, Hailing District, Taizhou City, Jiangsu Province

Applicant after: Taizhou Corduro Semiconductor Technology Co., Ltd

Address before: 215413 No. 2, Beijing West Road, Taicang Economic Development Zone, Suzhou, Jiangsu

Applicant before: Hu Jinglu

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220225

Address after: 311101 room 812-1, 8th floor, building 1, 239 Sansheng street, Qiaosi street, Linping District, Hangzhou, Zhejiang

Applicant after: Hangzhou Yali Interactive Network Technology Co.,Ltd.

Address before: 225300 s area, No.18 factory building, co construction area, hailing Industrial Park, Hailing District, Taizhou City, Jiangsu Province

Applicant before: Taizhou Corduro Semiconductor Technology Co.,Ltd.

GR01 Patent grant
GR01 Patent grant