CN112437325A - 8KSDI signal generator implementation method - Google Patents
8KSDI signal generator implementation method Download PDFInfo
- Publication number
- CN112437325A CN112437325A CN202011320627.7A CN202011320627A CN112437325A CN 112437325 A CN112437325 A CN 112437325A CN 202011320627 A CN202011320627 A CN 202011320627A CN 112437325 A CN112437325 A CN 112437325A
- Authority
- CN
- China
- Prior art keywords
- data
- video
- audio
- compressed data
- 8ksdi
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000006243 chemical reaction Methods 0.000 claims abstract description 8
- 230000002085 persistent effect Effects 0.000 claims description 7
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000001502 supplementing effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N5/926—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback by pulse code modulation
- H04N5/9261—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback by pulse code modulation involving data reduction
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses an implementation method of an 8KSDI signal generator. The method specifically comprises the following steps: (1) for a compressed data source: after a compressed data source stored in a memory is decoded by a decoder, the compressed data source is output by an SDI card after chrominance space conversion, and therefore 8KSDI signal output is achieved; (2) for uncompressed data sources: and directly outputting the uncompressed data source stored in the memory by the SDI board card, thereby realizing the output of the 8KSDI signal. The invention has the beneficial effects that: the 8KSDI signal output can be simply and quickly realized; the compressed data source 8KSDI generator has smaller storage space and lower requirement on storage read-write speed; the uncompressed data source 8KSDI generator has low requirement on the machine processing performance and can restore the video with high quality.
Description
Technical Field
The invention relates to the technical field of signal processing, in particular to an 8KSDI signal generator implementation method.
Background
SDI signals in the radio and television industry are typically generated from live cameras, from the original Standard Definition (SD) resolution of 720x480, 720x576, to the High Definition (HD) resolution of 1920x1080, to the 4K resolution of 3840x2160, to the now emerging 8K resolution of 7680x 4320. With the continuous improvement of the resolution, the visual sense of the user is also continuously improved, and the explosion-type increase of the processing data and the update of the back-end system follow. The few SDI cameras for the television are hundreds of thousands, and the 8K cameras are millions, and some application scenes such as exhibition of 8K visual effects and test, implementation and debugging of an 8K data processing system all need an 8KSDI information source, but do not have 8KSDI camera equipment.
Disclosure of Invention
The present invention provides a method for implementing an 8KSDI signal generator, which can simply implement 8KSDI signal output, in order to overcome the above-mentioned disadvantages in the prior art.
In order to achieve the purpose, the invention adopts the following technical scheme:
an implementation method of an 8KSDI signal generator specifically comprises the following steps:
(1) for a compressed data source: after a compressed data source stored in a memory is decoded by a decoder, the compressed data source is output by an SDI card after chrominance space conversion, and therefore 8KSDI signal output is achieved;
(2) for uncompressed data sources: and directly outputting the uncompressed data source stored in the memory by the SDI board card, thereby realizing the output of the 8KSDI signal.
The signal generator can be a PC or a server, and the architecture mainly includes two components: the memory is used for storing compressed data sources (HEVC, AVS2, AVS3) or non-compressed data (UYVY, V210); the SDI board card is used for outputting SDI signals. By the design of the method, the 8KSDI signal output can be simply and quickly realized.
Preferably, in the step (1), specifically: the method comprises the steps of putting compressed data into a storage, enabling the code rate to be 100-200M bit rate, decoding the compressed data into non-compressed data in real time through a decoder, carrying out one-time chrominance space conversion on the decoded non-compressed data, converting the non-compressed data into UYVY/V210 data, and directly outputting the UYVY/V210 data through an SDI board card.
Preferably, in the step (2), specifically: directly storing non-compressed data of UYVY/V210 in a memory, reading the UYVY/V210 data on the memory in real time, directly outputting the data through an SDI board card, and solving the read-write bottleneck of the non-compressed data by selecting an Intel persistent memory.
Preferably, the compressed data source starts to send the audio and video to be aligned according to the time stamp of the audio and video, and processes the audio non-compressed data according to the time stamp of the video, specifically: when a file is started, if the initial video time stamp is larger than the audio time stamp, cutting off redundant audio data; if the initial video time stamp is smaller than the audio time stamp, complementing the mute data; when the file is at the end, if the video time stamp at the end is larger than the audio time stamp, complementing mute data; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
Preferably, the data volume of the non-compressed data is large, so that the reading of the video data is finished by adopting a multi-thread parallel reading mode, namely, the non-compressed video is divided into a plurality of queues according to the size of each frame to be read in parallel, the initial alignment of non-compressed data sources needs to ensure the audio/video non-compressed file, and when the file is processed at the tail, if the video time stamp at the tail is larger than the audio time stamp, the mute data is supplemented; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
Preferably, as the compressed data source file has the problem of discontinuous audio and video timestamps, corresponding frame supplementing is required, and according to the frame rate of the source video, the video is supplemented with the previous frame, and the audio is supplemented with silence.
The invention has the beneficial effects that: the 8KSDI signal output can be simply and quickly realized; the compressed data source 8KSDI generator has smaller storage space and lower requirement on storage read-write speed; the uncompressed data source 8KSDI generator has low requirement on the machine processing performance and can restore the video with high quality.
Detailed Description
The invention is further described with reference to specific embodiments.
An implementation method of an 8KSDI signal generator specifically comprises the following steps:
(1) for a compressed data source: after a compressed data source stored in a memory is decoded by a decoder, the compressed data source is output by an SDI card after chrominance space conversion, and therefore 8KSDI signal output is achieved; the 8K uncompressed data, calculated as 60 frames per second, is calculated in V210 format as follows:
7680x4320 x 16/6x 60-5308416000 bytes
About 5 multi-gigabytes of data need to be transferred per second, and the general storage cannot achieve the speed, so the following method is adopted, specifically: the compressed data is put into a memory, the code rate is 100-200M bit rate (1 byte is 8 bits), the compressed data is decoded into uncompressed data in real time through a decoder, and the decoded uncompressed data (YUV420/YUV422) needs to be subjected to one-time chrominance space conversion and is converted into UYVY/V210 data to be directly output through an SDI board card. At present, the 8K real-time transcoding requirement is higher, so that a server with higher performance needs to be configured to realize the real-time decoding of the uncompressed data.
The 8KSDI signal generator needs to implement automatic loop output of the file. The compressed data source starts to send the audio and video to be aligned according to the time stamp of the audio and video, and processes the audio non-compressed data (PCM) according to the time stamp of the video, which specifically comprises the following steps: when a file is started, if the initial video time stamp is larger than the audio time stamp, cutting off redundant audio data; if the initial video time stamp is smaller than the audio time stamp, complementing the mute data; when the file is at the end, if the video time stamp at the end is larger than the audio time stamp, complementing mute data; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
Because the compressed data source file has the problem of discontinuous audio and video timestamps, corresponding frame supplementing is needed, and according to the frame rate of the source video, the previous frame is supplemented by the video, and the audio is supplemented with silence.
The compressed data source 8KSDI generator has the advantages of smaller storage space, lower requirement on storage read-write speed, higher requirement on machine processing performance and output video quality depending on decoder quality.
The TS/MP4/MOV file format is generally selected, video coding is H.264/H.265/AVS2, audio coding is MP3/AAC/AC3, corresponding video YUV420 or YUV422 data is decoded through a video decoder and an audio decoder, and audio is PCM data.
The SDI transmitting board generally supports video UYVY/V210 data and audio PCM (sampling rate 48000, 16 channel, 32bit depth), so it is necessary to convert the decoded YUV420/YUV422 data into UYVY/V210 data, and the decoded PCM data is stored according to 48000, 16 channel, 32 bit.
Storing and processing the PCM format: SDI audio is typically 48000, 16 channel, 32 bit; each sample is specifically, 16 channels, 32 bits per channel, 4 bytes.
1 channel | 0 | 1 | 2 | 3 |
2 channel | 0 | 1 | 2 | 3 |
3 channel | 0 | 1 | 2 | 3 |
4 channel | 0 | 1 | 2 | 3 |
5 channel | 0 | 1 | 2 | 3 |
6 channel | 0 | 1 | 2 | 3 |
7 channel | 0 | 1 | 2 | 3 |
8 channel | 0 | 1 | 2 | 3 |
9 channel | 0 | 1 | 2 | 3 |
10 channel | 0 | 1 | 2 | 3 |
11 channel | 0 | 1 | 2 | 3 |
12 channels | 0 | 1 | 2 | 3 |
13 channel | 0 | 1 | 2 | 3 |
14 channels | 0 | 1 | 2 | 3 |
15 channel | 0 | 1 | 2 | 3 |
16 channels | 0 | 1 | 2 | 3 |
The decoded PCM is generally required to be converted into 48000 sample rate, 32bit, the number of channels is not required to be processed, and finally, the data is sequentially put into 16 channels, and generally, several channels are decoded, and then, data of several channels are put into the channels.
(2) For uncompressed data sources: directly outputting the uncompressed data source stored in the memory by the SDI board card, thereby realizing the output of the 8KSDI signal; the method specifically comprises the following steps: directly storing non-compressed data of UYVY/V210 in a memory, reading the data of UYVY/V210 on the memory in real time, and directly outputting the data through an SDI board card, wherein the stored reading and writing speed is generally not kept up with 5G per second, so that the bottleneck of reading and writing the non-compressed data is solved by selecting an Intel persistent memory (persistent memory).
The 8KSDI signal generator needs to implement automatic loop output of the file. Because the data volume of the non-compressed data is large, the reading of the video data is finished by adopting a multithread parallel reading mode, namely, the non-compressed video is divided into a plurality of queues according to the size of each frame to be read in parallel,
queue | 1 | 2 | 3 | N |
Intra-queue frame ID | MxN+1 | MxN+2 | MxN+3 | MxN+N |
M=0,1,2,3……
When the non-compressed data source is aligned initially, audio and video non-compressed files are required to be guaranteed, and when files are processed at the tail, if a tail video time stamp is larger than an audio time stamp, mute data are supplemented; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
The uncompressed data source 8KSDI generator has the advantages that the requirement on the processing performance of a machine is not high, the video can be restored with high quality, and the defects that the requirements on storage space and reading and writing speed are very high.
The key technology for processing the uncompressed data is how to read the stored data, the data is calculated by 8K V210, 7680x4320 x 16/6 bytes are 88473600 bytes, the data is calculated according to 60P, 60x 88473600 bytes are 5308416000 bytes, so if real-time input is needed, the reading speed per second needs at least more than 5.3G, the current common SSD hard disk cannot reach the speed, the mechanical hard disk cannot reach the speed, the Intel of our partner recommends that we use a persistent memory according to the requirement, the persistent memory is installed on a memory slot, system calls can be used according to the common storage space, we place the uncompressed data in the persistent memory space, in use, if serial single-thread reading is found, the reading speed per second is about 1.8G, we need multi-thread parallel reading, currently 10-thread parallel reading is used, the reading speed per second is about 17G, far beyond 5.3G, future 120P reads are fully satisfied.
The parallel file reading method comprises the following steps: the uncompressed data respectively stores video (UYVY/V210) and audio (PCM) into two source files, the video files need to be read in parallel, the video files are read according to video frame units, taking 8KV210 data as an example, one frame of data is 88473600 bytes, the data is read in parallel by 10 threads, and each thread sequentially comprises:
thread 1 reads frame: 1,11,21,31 … …
Thread 2 reads frame: 2,12,22,32 … …
……
Read frame by thread 10: 10,20,30,40 … …
Each thread maintains its own frame sequence queue, and when the SDI card is sent, one frame of data in each thread frame sequence queue is sequentially acquired, wherein the sequence is 1,2,3 … 8,9,10,1,2,3.
The audio PCM data is read according to the sample number of each frame, for example, 50P, the sampling rate is 48000, each millisecond is 48 samples, one frame is 20 milliseconds, that is, one frame is 48 × 20 or 960 samples, and after reading the corresponding sample number PCM, the processing is the same as that of the PCM decoded from the compressed data.
The compressed 8KSDI stream generator can output 8K 25P HDR in real time, and two modes of SQD/2SI output are realized; the non-compression 8K SDI flow generator can output 8K 60P HDR in real time, and two modes of SQD/2SI output are achieved. The 8K SDI does not define the 2SI mode therein, and we can perform the 2SI output process according to the following example, correspondingly combine the data of 4 quadrants into 2SI data, thus outputting 12G x4 data, each 12G signal being a finished image.
SQD-2SI conversion method:
SQD(Square Division)
0 7680
12G SDI A | 12G SDI B |
12G SDI C | 12G SDI D |
2SI(2-Sample Interleave)
0 7680
images of four quadrants A, B, C, D
The odd rows are quadrant A, B data, two pixels A, two pixels B ordered sequentially
The even rows are quadrant C, D data, two pixels C, two pixels D ordered in sequence.
Claims (6)
1. An implementation method of an 8KSDI signal generator is characterized by comprising the following steps:
(1) for a compressed data source: after a compressed data source stored in a memory is decoded by a decoder, the compressed data source is output by an SDI card after chrominance space conversion, and therefore 8KSDI signal output is achieved;
(2) for uncompressed data sources: and directly outputting the uncompressed data source stored in the memory by the SDI board card, thereby realizing the output of the 8KSDI signal.
2. An 8KSDI signal generator implementation method according to claim 1, wherein in step (1), specifically: the method comprises the steps of putting compressed data into a storage, enabling the code rate to be 100-200M bit rate, decoding the compressed data into non-compressed data in real time through a decoder, carrying out one-time chrominance space conversion on the decoded non-compressed data, converting the non-compressed data into UYVY/V210 data, and directly outputting the UYVY/V210 data through an SDI board card.
3. An 8KSDI signal generator implementation method according to claim 1, wherein in step (2), specifically: directly storing non-compressed data of UYVY/V210 in a memory, reading the UYVY/V210 data on the memory in real time, directly outputting the data through an SDI board card, and solving the read-write bottleneck of the non-compressed data by selecting an Intel persistent memory.
4. The method as claimed in claim 2, wherein the compressed data source starts to send the audio and video alignment processing according to the time stamp of the audio and video, and processes the audio non-compressed data according to the time stamp of the video, specifically: when a file is started, if the initial video time stamp is larger than the audio time stamp, cutting off redundant audio data; if the initial video time stamp is smaller than the audio time stamp, complementing the mute data; when the file is at the end, if the video time stamp at the end is larger than the audio time stamp, complementing mute data; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
5. An 8KSDI signal generator implementation method as claimed in claim 3, wherein the reading of the video data is accomplished by multi-thread parallel reading because of the large data amount of the non-compressed data, i.e. the non-compressed video is divided into several queues according to the size of each frame to be read in parallel, and the non-compressed data source is aligned at the beginning and needs to be guaranteed by the audio and video non-compressed file, and when the file is processed at the end, if the end video timestamp is greater than the audio timestamp, the mute data is supplemented; if the last video timestamp is less than the audio timestamp, the excess audio data is cut off.
6. The method as claimed in claim 2 or 4, wherein if the audio/video timestamp of the compressed data source file is not continuous, the corresponding frame complementing is required, and the audio complementing mute processing is performed according to the frame rate of the source video, the video complementing previous frame.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011320627.7A CN112437325A (en) | 2020-11-23 | 2020-11-23 | 8KSDI signal generator implementation method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011320627.7A CN112437325A (en) | 2020-11-23 | 2020-11-23 | 8KSDI signal generator implementation method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN112437325A true CN112437325A (en) | 2021-03-02 |
Family
ID=74694560
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011320627.7A Pending CN112437325A (en) | 2020-11-23 | 2020-11-23 | 8KSDI signal generator implementation method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112437325A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113079387A (en) * | 2021-03-26 | 2021-07-06 | 平安银行股份有限公司 | Remote video recording method, device, equipment and storage medium |
CN114383667A (en) * | 2022-01-29 | 2022-04-22 | 重庆长安汽车股份有限公司 | Multi-sensor simulation data synchronous injection method and system |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101771869A (en) * | 2008-12-30 | 2010-07-07 | 深圳市万兴软件有限公司 | AV (audio/video) encoding and decoding device and method |
CN101996662A (en) * | 2010-10-22 | 2011-03-30 | 深圳市万兴软件有限公司 | Method and device for connecting and outputting video files |
US20150139614A1 (en) * | 2012-02-29 | 2015-05-21 | Korea Electronics Technology Institute | Input/output system for editing and playing ultra-high definition image |
US20190251999A1 (en) * | 2016-07-05 | 2019-08-15 | Sakura Eiki Co., Ltd. | Real-time editing system |
JP2020042125A (en) * | 2018-09-10 | 2020-03-19 | 日本放送協会 | Real-time editing system |
CN111465984A (en) * | 2017-11-09 | 2020-07-28 | 吕晓政 | XDI system, apparatus, connector and method |
-
2020
- 2020-11-23 CN CN202011320627.7A patent/CN112437325A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101771869A (en) * | 2008-12-30 | 2010-07-07 | 深圳市万兴软件有限公司 | AV (audio/video) encoding and decoding device and method |
CN101996662A (en) * | 2010-10-22 | 2011-03-30 | 深圳市万兴软件有限公司 | Method and device for connecting and outputting video files |
US20150139614A1 (en) * | 2012-02-29 | 2015-05-21 | Korea Electronics Technology Institute | Input/output system for editing and playing ultra-high definition image |
US20190251999A1 (en) * | 2016-07-05 | 2019-08-15 | Sakura Eiki Co., Ltd. | Real-time editing system |
CN111465984A (en) * | 2017-11-09 | 2020-07-28 | 吕晓政 | XDI system, apparatus, connector and method |
JP2020042125A (en) * | 2018-09-10 | 2020-03-19 | 日本放送協会 | Real-time editing system |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113079387A (en) * | 2021-03-26 | 2021-07-06 | 平安银行股份有限公司 | Remote video recording method, device, equipment and storage medium |
CN113079387B (en) * | 2021-03-26 | 2023-06-16 | 平安银行股份有限公司 | Remote video recording method, device, equipment and storage medium |
CN114383667A (en) * | 2022-01-29 | 2022-04-22 | 重庆长安汽车股份有限公司 | Multi-sensor simulation data synchronous injection method and system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9601156B2 (en) | Input/output system for editing and playing ultra-high definition image | |
JP2005175997A (en) | Decoding apparatus, electronic apparatus, computer, decoding method, program, and recording medium | |
US10187648B2 (en) | Information processing device and method | |
CN112437325A (en) | 8KSDI signal generator implementation method | |
US8340506B2 (en) | System and method for signal processing | |
CN111885346B (en) | Picture code stream synthesis method, terminal, electronic device and storage medium | |
US20100098161A1 (en) | Video encoding apparatus and video encoding method | |
CN109040818B (en) | Audio and video synchronization method, storage medium, electronic equipment and system during live broadcasting | |
CN113271467B (en) | Ultra-high-definition video layered coding and decoding method supporting efficient editing | |
CN112468763A (en) | Video transmission and display method, device, equipment and storage medium of conference television | |
CN117014673A (en) | Core board for guiding and broadcasting machine and guiding and broadcasting system | |
US9706201B2 (en) | Region-based processing of predicted pixels | |
KR100395396B1 (en) | Method and apparatus for data compression of multi-channel moving pictures | |
CN114710629B (en) | Device for realizing ultrahigh-definition video format conversion and image-text superposition | |
CN112672166B (en) | Multi-code stream decoding acceleration system and method for video decoder | |
CN112954396B (en) | Video playing method and device, electronic equipment and computer readable storage medium | |
CN115665440A (en) | Method and system for quickly synthesizing special effects of streaming audio and video based on 4K live broadcast | |
CN110996172B (en) | Method for quickly synthesizing 4K MXF file | |
TWI565303B (en) | Image processing system and image processing method | |
CN109246377B (en) | Video data storage method, video data reading method and video data storage equipment | |
CN112532991A (en) | Hardware decoding method for RMFF format file | |
KR102633455B1 (en) | Encoding device for multi-channel video | |
US7423652B2 (en) | Apparatus and method for digital video decoding | |
Kikuchi et al. | Development of full-featured 8K recorder | |
CN114025162B (en) | Entropy decoding method, medium, program product, and electronic device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210302 |