CN112437325A - 8KSDI signal generator implementation method - Google Patents

8KSDI signal generator implementation method Download PDF

Info

Publication number
CN112437325A
CN112437325A CN202011320627.7A CN202011320627A CN112437325A CN 112437325 A CN112437325 A CN 112437325A CN 202011320627 A CN202011320627 A CN 202011320627A CN 112437325 A CN112437325 A CN 112437325A
Authority
CN
China
Prior art keywords
data
video
audio
compressed data
8ksdi
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011320627.7A
Other languages
Chinese (zh)
Inventor
许国忠
孙伟涛
石小明
吴奕刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Arcvideo Technology Co ltd
Original Assignee
Hangzhou Arcvideo Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Arcvideo Technology Co ltd filed Critical Hangzhou Arcvideo Technology Co ltd
Priority to CN202011320627.7A priority Critical patent/CN112437325A/en
Publication of CN112437325A publication Critical patent/CN112437325A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/92Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/926Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback by pulse code modulation
    • H04N5/9261Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback by pulse code modulation involving data reduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention discloses an implementation method of an 8KSDI signal generator. The method specifically comprises the following steps: (1) for a compressed data source: after a compressed data source stored in a memory is decoded by a decoder, the compressed data source is output by an SDI card after chrominance space conversion, and therefore 8KSDI signal output is achieved; (2) for uncompressed data sources: and directly outputting the uncompressed data source stored in the memory by the SDI board card, thereby realizing the output of the 8KSDI signal. The invention has the beneficial effects that: the 8KSDI signal output can be simply and quickly realized; the compressed data source 8KSDI generator has smaller storage space and lower requirement on storage read-write speed; the uncompressed data source 8KSDI generator has low requirement on the machine processing performance and can restore the video with high quality.

Description

8KSDI signal generator implementation method
Technical Field
The invention relates to the technical field of signal processing, in particular to an 8KSDI signal generator implementation method.
Background
SDI signals in the radio and television industry are typically generated from live cameras, from the original Standard Definition (SD) resolution of 720x480, 720x576, to the High Definition (HD) resolution of 1920x1080, to the 4K resolution of 3840x2160, to the now emerging 8K resolution of 7680x 4320. With the continuous improvement of the resolution, the visual sense of the user is also continuously improved, and the explosion-type increase of the processing data and the update of the back-end system follow. The few SDI cameras for the television are hundreds of thousands, and the 8K cameras are millions, and some application scenes such as exhibition of 8K visual effects and test, implementation and debugging of an 8K data processing system all need an 8KSDI information source, but do not have 8KSDI camera equipment.
Disclosure of Invention
The present invention provides a method for implementing an 8KSDI signal generator, which can simply implement 8KSDI signal output, in order to overcome the above-mentioned disadvantages in the prior art.
In order to achieve the purpose, the invention adopts the following technical scheme:
an implementation method of an 8KSDI signal generator specifically comprises the following steps:
(1) for a compressed data source: after a compressed data source stored in a memory is decoded by a decoder, the compressed data source is output by an SDI card after chrominance space conversion, and therefore 8KSDI signal output is achieved;
(2) for uncompressed data sources: and directly outputting the uncompressed data source stored in the memory by the SDI board card, thereby realizing the output of the 8KSDI signal.
The signal generator can be a PC or a server, and the architecture mainly includes two components: the memory is used for storing compressed data sources (HEVC, AVS2, AVS3) or non-compressed data (UYVY, V210); the SDI board card is used for outputting SDI signals. By the design of the method, the 8KSDI signal output can be simply and quickly realized.
Preferably, in the step (1), specifically: the method comprises the steps of putting compressed data into a storage, enabling the code rate to be 100-200M bit rate, decoding the compressed data into non-compressed data in real time through a decoder, carrying out one-time chrominance space conversion on the decoded non-compressed data, converting the non-compressed data into UYVY/V210 data, and directly outputting the UYVY/V210 data through an SDI board card.
Preferably, in the step (2), specifically: directly storing non-compressed data of UYVY/V210 in a memory, reading the UYVY/V210 data on the memory in real time, directly outputting the data through an SDI board card, and solving the read-write bottleneck of the non-compressed data by selecting an Intel persistent memory.
Preferably, the compressed data source starts to send the audio and video to be aligned according to the time stamp of the audio and video, and processes the audio non-compressed data according to the time stamp of the video, specifically: when a file is started, if the initial video time stamp is larger than the audio time stamp, cutting off redundant audio data; if the initial video time stamp is smaller than the audio time stamp, complementing the mute data; when the file is at the end, if the video time stamp at the end is larger than the audio time stamp, complementing mute data; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
Preferably, the data volume of the non-compressed data is large, so that the reading of the video data is finished by adopting a multi-thread parallel reading mode, namely, the non-compressed video is divided into a plurality of queues according to the size of each frame to be read in parallel, the initial alignment of non-compressed data sources needs to ensure the audio/video non-compressed file, and when the file is processed at the tail, if the video time stamp at the tail is larger than the audio time stamp, the mute data is supplemented; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
Preferably, as the compressed data source file has the problem of discontinuous audio and video timestamps, corresponding frame supplementing is required, and according to the frame rate of the source video, the video is supplemented with the previous frame, and the audio is supplemented with silence.
The invention has the beneficial effects that: the 8KSDI signal output can be simply and quickly realized; the compressed data source 8KSDI generator has smaller storage space and lower requirement on storage read-write speed; the uncompressed data source 8KSDI generator has low requirement on the machine processing performance and can restore the video with high quality.
Detailed Description
The invention is further described with reference to specific embodiments.
An implementation method of an 8KSDI signal generator specifically comprises the following steps:
(1) for a compressed data source: after a compressed data source stored in a memory is decoded by a decoder, the compressed data source is output by an SDI card after chrominance space conversion, and therefore 8KSDI signal output is achieved; the 8K uncompressed data, calculated as 60 frames per second, is calculated in V210 format as follows:
7680x4320 x 16/6x 60-5308416000 bytes
About 5 multi-gigabytes of data need to be transferred per second, and the general storage cannot achieve the speed, so the following method is adopted, specifically: the compressed data is put into a memory, the code rate is 100-200M bit rate (1 byte is 8 bits), the compressed data is decoded into uncompressed data in real time through a decoder, and the decoded uncompressed data (YUV420/YUV422) needs to be subjected to one-time chrominance space conversion and is converted into UYVY/V210 data to be directly output through an SDI board card. At present, the 8K real-time transcoding requirement is higher, so that a server with higher performance needs to be configured to realize the real-time decoding of the uncompressed data.
The 8KSDI signal generator needs to implement automatic loop output of the file. The compressed data source starts to send the audio and video to be aligned according to the time stamp of the audio and video, and processes the audio non-compressed data (PCM) according to the time stamp of the video, which specifically comprises the following steps: when a file is started, if the initial video time stamp is larger than the audio time stamp, cutting off redundant audio data; if the initial video time stamp is smaller than the audio time stamp, complementing the mute data; when the file is at the end, if the video time stamp at the end is larger than the audio time stamp, complementing mute data; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
Because the compressed data source file has the problem of discontinuous audio and video timestamps, corresponding frame supplementing is needed, and according to the frame rate of the source video, the previous frame is supplemented by the video, and the audio is supplemented with silence.
The compressed data source 8KSDI generator has the advantages of smaller storage space, lower requirement on storage read-write speed, higher requirement on machine processing performance and output video quality depending on decoder quality.
The TS/MP4/MOV file format is generally selected, video coding is H.264/H.265/AVS2, audio coding is MP3/AAC/AC3, corresponding video YUV420 or YUV422 data is decoded through a video decoder and an audio decoder, and audio is PCM data.
The SDI transmitting board generally supports video UYVY/V210 data and audio PCM (sampling rate 48000, 16 channel, 32bit depth), so it is necessary to convert the decoded YUV420/YUV422 data into UYVY/V210 data, and the decoded PCM data is stored according to 48000, 16 channel, 32 bit.
Storing and processing the PCM format: SDI audio is typically 48000, 16 channel, 32 bit; each sample is specifically, 16 channels, 32 bits per channel, 4 bytes.
1 channel 0 1 2 3
2 channel 0 1 2 3
3 channel 0 1 2 3
4 channel 0 1 2 3
5 channel 0 1 2 3
6 channel 0 1 2 3
7 channel 0 1 2 3
8 channel 0 1 2 3
9 channel 0 1 2 3
10 channel 0 1 2 3
11 channel 0 1 2 3
12 channels 0 1 2 3
13 channel 0 1 2 3
14 channels 0 1 2 3
15 channel 0 1 2 3
16 channels 0 1 2 3
The decoded PCM is generally required to be converted into 48000 sample rate, 32bit, the number of channels is not required to be processed, and finally, the data is sequentially put into 16 channels, and generally, several channels are decoded, and then, data of several channels are put into the channels.
(2) For uncompressed data sources: directly outputting the uncompressed data source stored in the memory by the SDI board card, thereby realizing the output of the 8KSDI signal; the method specifically comprises the following steps: directly storing non-compressed data of UYVY/V210 in a memory, reading the data of UYVY/V210 on the memory in real time, and directly outputting the data through an SDI board card, wherein the stored reading and writing speed is generally not kept up with 5G per second, so that the bottleneck of reading and writing the non-compressed data is solved by selecting an Intel persistent memory (persistent memory).
The 8KSDI signal generator needs to implement automatic loop output of the file. Because the data volume of the non-compressed data is large, the reading of the video data is finished by adopting a multithread parallel reading mode, namely, the non-compressed video is divided into a plurality of queues according to the size of each frame to be read in parallel,
queue 1 2 3 N
Intra-queue frame ID MxN+1 MxN+2 MxN+3 MxN+N
M=0,1,2,3……
When the non-compressed data source is aligned initially, audio and video non-compressed files are required to be guaranteed, and when files are processed at the tail, if a tail video time stamp is larger than an audio time stamp, mute data are supplemented; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
The uncompressed data source 8KSDI generator has the advantages that the requirement on the processing performance of a machine is not high, the video can be restored with high quality, and the defects that the requirements on storage space and reading and writing speed are very high.
The key technology for processing the uncompressed data is how to read the stored data, the data is calculated by 8K V210, 7680x4320 x 16/6 bytes are 88473600 bytes, the data is calculated according to 60P, 60x 88473600 bytes are 5308416000 bytes, so if real-time input is needed, the reading speed per second needs at least more than 5.3G, the current common SSD hard disk cannot reach the speed, the mechanical hard disk cannot reach the speed, the Intel of our partner recommends that we use a persistent memory according to the requirement, the persistent memory is installed on a memory slot, system calls can be used according to the common storage space, we place the uncompressed data in the persistent memory space, in use, if serial single-thread reading is found, the reading speed per second is about 1.8G, we need multi-thread parallel reading, currently 10-thread parallel reading is used, the reading speed per second is about 17G, far beyond 5.3G, future 120P reads are fully satisfied.
The parallel file reading method comprises the following steps: the uncompressed data respectively stores video (UYVY/V210) and audio (PCM) into two source files, the video files need to be read in parallel, the video files are read according to video frame units, taking 8KV210 data as an example, one frame of data is 88473600 bytes, the data is read in parallel by 10 threads, and each thread sequentially comprises:
thread 1 reads frame: 1,11,21,31 … …
Thread 2 reads frame: 2,12,22,32 … …
……
Read frame by thread 10: 10,20,30,40 … …
Each thread maintains its own frame sequence queue, and when the SDI card is sent, one frame of data in each thread frame sequence queue is sequentially acquired, wherein the sequence is 1,2,3 … 8,9,10,1,2,3.
The audio PCM data is read according to the sample number of each frame, for example, 50P, the sampling rate is 48000, each millisecond is 48 samples, one frame is 20 milliseconds, that is, one frame is 48 × 20 or 960 samples, and after reading the corresponding sample number PCM, the processing is the same as that of the PCM decoded from the compressed data.
The compressed 8KSDI stream generator can output 8K 25P HDR in real time, and two modes of SQD/2SI output are realized; the non-compression 8K SDI flow generator can output 8K 60P HDR in real time, and two modes of SQD/2SI output are achieved. The 8K SDI does not define the 2SI mode therein, and we can perform the 2SI output process according to the following example, correspondingly combine the data of 4 quadrants into 2SI data, thus outputting 12G x4 data, each 12G signal being a finished image.
SQD-2SI conversion method:
SQD(Square Division)
0 7680
12G SDI A 12G SDI B
12G SDI C 12G SDI D
2SI(2-Sample Interleave)
0 7680
Figure BDA0002792772750000081
images of four quadrants A, B, C, D
The odd rows are quadrant A, B data, two pixels A, two pixels B ordered sequentially
The even rows are quadrant C, D data, two pixels C, two pixels D ordered in sequence.

Claims (6)

1. An implementation method of an 8KSDI signal generator is characterized by comprising the following steps:
(1) for a compressed data source: after a compressed data source stored in a memory is decoded by a decoder, the compressed data source is output by an SDI card after chrominance space conversion, and therefore 8KSDI signal output is achieved;
(2) for uncompressed data sources: and directly outputting the uncompressed data source stored in the memory by the SDI board card, thereby realizing the output of the 8KSDI signal.
2. An 8KSDI signal generator implementation method according to claim 1, wherein in step (1), specifically: the method comprises the steps of putting compressed data into a storage, enabling the code rate to be 100-200M bit rate, decoding the compressed data into non-compressed data in real time through a decoder, carrying out one-time chrominance space conversion on the decoded non-compressed data, converting the non-compressed data into UYVY/V210 data, and directly outputting the UYVY/V210 data through an SDI board card.
3. An 8KSDI signal generator implementation method according to claim 1, wherein in step (2), specifically: directly storing non-compressed data of UYVY/V210 in a memory, reading the UYVY/V210 data on the memory in real time, directly outputting the data through an SDI board card, and solving the read-write bottleneck of the non-compressed data by selecting an Intel persistent memory.
4. The method as claimed in claim 2, wherein the compressed data source starts to send the audio and video alignment processing according to the time stamp of the audio and video, and processes the audio non-compressed data according to the time stamp of the video, specifically: when a file is started, if the initial video time stamp is larger than the audio time stamp, cutting off redundant audio data; if the initial video time stamp is smaller than the audio time stamp, complementing the mute data; when the file is at the end, if the video time stamp at the end is larger than the audio time stamp, complementing mute data; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
5. An 8KSDI signal generator implementation method as claimed in claim 3, wherein the reading of the video data is accomplished by multi-thread parallel reading because of the large data amount of the non-compressed data, i.e. the non-compressed video is divided into several queues according to the size of each frame to be read in parallel, and the non-compressed data source is aligned at the beginning and needs to be guaranteed by the audio and video non-compressed file, and when the file is processed at the end, if the end video timestamp is greater than the audio timestamp, the mute data is supplemented; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
6. The method as claimed in claim 2 or 4, wherein if the audio/video timestamp of the compressed data source file is not continuous, the corresponding frame complementing is required, and the audio complementing mute processing is performed according to the frame rate of the source video, the video complementing previous frame.
CN202011320627.7A 2020-11-23 2020-11-23 8KSDI signal generator implementation method Pending CN112437325A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011320627.7A CN112437325A (en) 2020-11-23 2020-11-23 8KSDI signal generator implementation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011320627.7A CN112437325A (en) 2020-11-23 2020-11-23 8KSDI signal generator implementation method

Publications (1)

Publication Number Publication Date
CN112437325A true CN112437325A (en) 2021-03-02

Family

ID=74694560

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011320627.7A Pending CN112437325A (en) 2020-11-23 2020-11-23 8KSDI signal generator implementation method

Country Status (1)

Country Link
CN (1) CN112437325A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113079387A (en) * 2021-03-26 2021-07-06 平安银行股份有限公司 Remote video recording method, device, equipment and storage medium
CN114383667A (en) * 2022-01-29 2022-04-22 重庆长安汽车股份有限公司 Multi-sensor simulation data synchronous injection method and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101771869A (en) * 2008-12-30 2010-07-07 深圳市万兴软件有限公司 AV (audio/video) encoding and decoding device and method
CN101996662A (en) * 2010-10-22 2011-03-30 深圳市万兴软件有限公司 Method and device for connecting and outputting video files
US20150139614A1 (en) * 2012-02-29 2015-05-21 Korea Electronics Technology Institute Input/output system for editing and playing ultra-high definition image
US20190251999A1 (en) * 2016-07-05 2019-08-15 Sakura Eiki Co., Ltd. Real-time editing system
JP2020042125A (en) * 2018-09-10 2020-03-19 日本放送協会 Real-time editing system
CN111465984A (en) * 2017-11-09 2020-07-28 吕晓政 XDI system, apparatus, connector and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101771869A (en) * 2008-12-30 2010-07-07 深圳市万兴软件有限公司 AV (audio/video) encoding and decoding device and method
CN101996662A (en) * 2010-10-22 2011-03-30 深圳市万兴软件有限公司 Method and device for connecting and outputting video files
US20150139614A1 (en) * 2012-02-29 2015-05-21 Korea Electronics Technology Institute Input/output system for editing and playing ultra-high definition image
US20190251999A1 (en) * 2016-07-05 2019-08-15 Sakura Eiki Co., Ltd. Real-time editing system
CN111465984A (en) * 2017-11-09 2020-07-28 吕晓政 XDI system, apparatus, connector and method
JP2020042125A (en) * 2018-09-10 2020-03-19 日本放送協会 Real-time editing system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113079387A (en) * 2021-03-26 2021-07-06 平安银行股份有限公司 Remote video recording method, device, equipment and storage medium
CN113079387B (en) * 2021-03-26 2023-06-16 平安银行股份有限公司 Remote video recording method, device, equipment and storage medium
CN114383667A (en) * 2022-01-29 2022-04-22 重庆长安汽车股份有限公司 Multi-sensor simulation data synchronous injection method and system

Similar Documents

Publication Publication Date Title
US9601156B2 (en) Input/output system for editing and playing ultra-high definition image
JP2005175997A (en) Decoding apparatus, electronic apparatus, computer, decoding method, program, and recording medium
US10187648B2 (en) Information processing device and method
CN112437325A (en) 8KSDI signal generator implementation method
US8340506B2 (en) System and method for signal processing
CN111885346B (en) Picture code stream synthesis method, terminal, electronic device and storage medium
US20100098161A1 (en) Video encoding apparatus and video encoding method
CN109040818B (en) Audio and video synchronization method, storage medium, electronic equipment and system during live broadcasting
CN113271467B (en) Ultra-high-definition video layered coding and decoding method supporting efficient editing
CN114222156A (en) Video editing method, video editing device, computer equipment and storage medium
CN112468763A (en) Video transmission and display method, device, equipment and storage medium of conference television
CN117014673A (en) Core board for guiding and broadcasting machine and guiding and broadcasting system
US9706201B2 (en) Region-based processing of predicted pixels
KR100395396B1 (en) Method and apparatus for data compression of multi-channel moving pictures
CN112672166B (en) Multi-code stream decoding acceleration system and method for video decoder
CN112954396B (en) Video playing method and device, electronic equipment and computer readable storage medium
CN110996172B (en) Method for quickly synthesizing 4K MXF file
CN109246377B (en) Video data storage method, video data reading method and video data storage equipment
CN112532991A (en) Hardware decoding method for RMFF format file
KR102633455B1 (en) Encoding device for multi-channel video
CN113055680B (en) Distributed transcoding method
US7423652B2 (en) Apparatus and method for digital video decoding
TWI565303B (en) Image processing system and image processing method
Kikuchi et al. Development of full-featured 8K recorder
CN114025162B (en) Entropy decoding method, medium, program product, and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210302