CN104469228A - 2D or multi-viewpoint naked eye 3D video data storing and reading-writing method - Google Patents

Abstract

The invention discloses a 2D or multi-viewpoint naked eye 3D video data storing and reading-writing method. The method comprises the steps that data are stored into an SDRAM or read from the SDRAM in a burst mode; (1), in the writing process, the video data are written into a writing-end asynchronous FIFO line by line through a writing-end module, and the writing-end asynchronous FIFO receives the video data, stores the video data and then stores the video data into the SDRAM, wherein the video data comprise N viewpoints, each viewpoint comprises M lines, each line comprises K burst data, the SDRAM comprises H banks, and in the storing process, every two adjacent burst data in each same line are stored in different banks; (2), in the reading process, N reading-end asynchronous FIFOs read the video data from the SDRAM, secondary view fields read the data line by line, adjacent burst data are operated in different banks, and synchronism of data of the secondary view fields is guaranteed. By means of the method, the resource and bandwidth utilization ratio of the SDRAM can be effectively increased, and consumption of hardware resources can be lowered.

Description

The video data of a kind of compatible 2D and multiple views bore hole 3D stores reading/writing method

Technical field

The invention belongs to image processing field, the video data relating to a kind of compatible 2D and multiple views bore hole 3D stores reading/writing method.

Background technology

Stereo display technique can the depth of field sense of displaying chart picture, stereovision and the sense of reality, application widely, has become the development trend of following Display Technique.Bore hole stereo display, without the need to watching good stereoeffect by glasses, has broad application prospects in business markets such as advertisement machine.

Human vision system produces the origin cause of formation of stereoscopic vision to object and mainly contains 5 kinds: the adjustment of crystalline, the spoke corner of eyes, binocular parallax, simple eye motion parallax and gather effect, and wherein, the binocular stereo vision based on binocular parallax is principal element.Current nearly all 3D TV is all on the basis based on binocular stereo vision principle, allow spectators produce third dimension and depth of field sense.Wherein eyeglass stereoscopic display utilizes the dichroism of glasses to allow the left and right fields of vision of image be separated and to enter right and left eyes respectively.Bore hole 3D display does not have point light action of glasses, image can be allowed to carry out the medium of " directivity " visual occlusion or refraction by increasing on screen, utilization is blocked or refraction action sees different view field image respectively by right and left eyes, thus produces three-dimensional depth of field sense.

Current bore hole stereo display broadcast mode can be divided into following four steps:

1, video image decoding;

2, obtain each sub-view field image respectively and zoom to display terminal physical resolution;

3, require to carry out display pixel synthesis to multiple views bore hole 3D rendering according to the pixel array format of display terminal;

4, composograph shows screen display at bore hole 3D.

In order to meet the real-time broadcast request of video flowing, need to use frame in Video processing to deposit, and for the real-time display system of multiple views bore hole 3D, each sub-visual field all needs the physical resolution (high definition 1920*1080, ultra high-definition 4K*2K, 8K*4K etc.) zooming to terminal display screen, and this proposes very high requirement to the arithmetic speed of system and SDRAM storage efficiency, memory bandwidth efficiency.In existing bore hole 3D scheme, rarely mention storage scheme between the view data in hardware implementing process and SDRAM and SDRAM storage controlling method.In actual applications: on the one hand, tradition 2D video is in storing process, owing to strictly not determining the address mapping relation between view data and SDRAM, when may cause SDRAM (comprising DDR2SDRAM, DDR3SDRAM) access data in same bank frequent switch line address, produce extra data delay, significantly reduce the bandwidth availability ratio of SDRAM; On the other hand, during the synthesis of multiple views bore hole 3D rendering display pixel, the scaled results of each sub-visual field need be used simultaneously, so the while of each visual field zoom operations palpus or close to completing simultaneously, otherwise the extra row of needs is deposited or frame is deposited as synchronization caching, and need to design corresponding synchronization mechanism logic, so not only expend hardware resource but also waste memory bandwidth.

Summary of the invention

The object of the invention is to the shortcoming overcoming above-mentioned prior art, the video data providing a kind of compatible 2D and multiple views bore hole 3D stores reading/writing method, and the method effectively can improve resource and the broadband utilance of SDRAM.

For achieving the above object, the video data of the compatible 2D and multiple views bore hole 3D of the present invention stores reading/writing method, comprises the following steps:

1) video data is written in end asynchronous FIFO through write end module according to form line by line, write end asynchronous FIFO and receive described video data, and video data described in buffer memory, then described video data is stored in SDRAM, described video data comprises N number of viewpoint, it is capable that each viewpoint comprises M, every a line comprises K burst data, SDRAM comprises H bank, in storing process, video data is stored in the different bank of SDRAM with two burst data adjacent in a line, wherein, N is more than or equal to 1, M is more than or equal to 1, K is more than or equal to 2, H is more than or equal to 4,

2) N number of end asynchronous FIFO of reading reads described video data from SDRAM, and export described video data, in each reading process, N number of end asynchronous FIFO of reading sequentially reads burst data respectively, and each burst data are positioned at the same position of each sub-visual field, the process of adjacent twi-read is not carried out in same bank, when SDRAM write and read data operation intersect carry out time, the storage/reading process of adjacent twice video data is not carried out in same bank.

When storing read-write 2D video data, N is 1;

When storing read-write 3D video data, N is more than or equal to 2;

H equals 8.

The present invention has following beneficial effect:

The video data of compatible 2D of the present invention and multiple views bore hole 3D stores reading/writing method when being write in SDRAM by video data, in same a line of video data, adjacent two burst data are stored in the different bank of SDRAM, thus the storing process of adjacent two burst data is carried out in different bank, in addition, video data is in the process read, N number of end asynchronous FIFO of reading sequentially reads burst data respectively, and each burst data are positioned at the same position of each sub-visual field, the process of adjacent twi-read is not at same bank, simultaneously, the storage of adjacent twice video data and the process of reading are not carried out in same bank, thus avoid the excessive data that SDRAM causes due to the precharge operation of necessity when entering a new line in same bank when addressing and postpone, effectively make use of SDRAM memory space, significantly improve SDRAM bandwidth availability ratio, in addition, N number of end asynchronous FIFO of reading sequentially reads burst data respectively, ensure that the synchronism of each sub-visual field, each sub-visual field does not need additional synchronization mechanism.

Further, when storing read-write 2D video data, N is 1, and when storing read-write bore hole 3D video data, N is more than or equal to 2, thus can the storage read-write operation of effective compatible 2D video data and 3D video data.

Accompanying drawing explanation

Fig. 1 is system control process figure of the present invention;

Fig. 2 is the flow chart of video data write process in the present invention;

Fig. 3 is the flow chart of video data readout in the present invention;

Fig. 4 is picture position and the SDRAM address maps schematic diagram of the video data of the first embodiment in the present invention.

Embodiment

Below in conjunction with accompanying drawing, the present invention is described in further detail:

The video data of compatible 2D of the present invention and multiple views bore hole 3D stores reading/writing method and comprises the following steps:

1) video data is written in end asynchronous FIFO through write end module according to form line by line, write end asynchronous FIFO and receive described video data, and video data described in buffer memory, then described video data is stored in SDRAM, described video data comprises N number of viewpoint, it is capable that each viewpoint comprises M, every a line comprises K burst data, SDRAM comprises H bank, in storing process, video data is stored in the different bank of SDRAM with two burst data adjacent in a line, wherein, N is more than or equal to 1, M is more than or equal to 1, K is more than or equal to 2, H is more than or equal to 4,

2) N number of end asynchronous FIFO of reading reads described video data from SDRAM, and export described video data, in each reading process, N number of end asynchronous FIFO of reading sequentially reads burst data respectively, and each burst data are positioned at the same position of each sub-visual field, the process of adjacent twi-read is not carried out in same bank, when SDRAM write and read data operation intersect carry out time, the storage/reading process of adjacent twice video data is not carried out in same bank.

When storing read-write 2D video data, N is 1;

When storing read-write 3D video data, N is more than or equal to 2;

H equals 8.

With reference to figure 1, Fig. 2 and Fig. 3, video data is written in end asynchronous FIFO through write end module continuous print according to form line by line, described end asynchronous FIFO of writing is provided with the pre-set threshold value of four different depths, described four pre-set threshold value are respectively W_REQ_L, W_REQ_H, W_PRIO_L, W_PRIO_H, wherein, W_REQ_L < W_REQ_H < W_PRIO_L < W_PRIO_H, video data is input to through write end module to be write in end asynchronous FIFO;

Writing in end asynchronous FIFO in the process that increases progressively of institute's buffer data size, when write end asynchronous FIFO data depth higher than W_REQ_H time, produce SDRAM write request operational order, then described SDRAM write request operational order is input in Read-write Catrol arbitration modules, when now not having SDRAM to read priority signal, Read-write Catrol arbitration modules can not change current SDRAM read write priority, still according to current SDRAM read/write operation order perform read/write operation; When write end asynchronous FIFO data depth higher than W_PRIO_H time, then produce the instruction of SDRAM prefer write operations, then the instruction of described SDRAM prefer write operations is input in Read-write Catrol arbitration modules, Read-write Catrol arbitration modules receives the instruction of described SDRAM prefer write operations, interrupt existing read/write order, preferentially carry out SDRAM write operation;

Writing in end asynchronous FIFO in institute's buffer data size process of successively decreasing, when write end asynchronous FIFO data depth lower than W_PRIO_L time, then produce SDRAM and cancel prefer write operations instruction, then described SDRAM being cancelled prefer write operations instruction is input in Read-write Catrol arbitration modules, Read-write Catrol arbitration modules receives described SDRAM and cancels prefer write operations instruction, cancel SDRAM and write priority, SDRAM no longer carries out writing priority service; When write end asynchronous FIFO data depth lower than W_REQ_L time, then produce SDRAM and stop write operation instruction, then the instruction of described stopping write operation being input in Read-write Catrol arbitration modules, Read-write Catrol arbitration modules receives described SDRAM and stops write operation instruction, stops the video data writing in end asynchronous FIFO to write in SDRAM.

The sluggishness of passing threshold setting, avoids writing data in end asynchronous FIFO and writes full or read to hold asynchronous FIFO to read sky, also ensure the real-time true(-)running of data flow.

Step 2) concrete operations for: described in read to hold asynchronous FIFO to be provided with four pre-set threshold value of different depth, described four pre-set threshold value are respectively R_PRIO_L, R_PRIO_H, R_REQ_L, R_REQ_H, wherein R_PRIO_L < R_PRIO_H < R_REQ_L < R_REQ_H, comprises N number of reading and holds asynchronous FIFO synchronous working in reading process;

Reading to hold in the process that institute's buffer data size successively decreases in asynchronous FIFO, when reading to hold the data depth of asynchronous FIFO lower than R_REQ_L, then produce SDRAM read request operational order, then described SDRAM read request operational order is input in Read-write Catrol arbitration modules, if now do not write priority signal, Read-write Catrol arbitration modules can not change current SDRAM read write priority; When reading to hold the data depth of asynchronous FIFO lower than R_PRIO_L, then produce the preferential read operation instruction of SDRAM, and preferential for described SDRAM read operation instruction is input in Read-write Catrol arbitration modules, Read-write Catrol arbitration modules receives the preferential read operation instruction of described SDRAM, if now there is no SDRAM write operation priority signal, then the video data in SDRAM is read in end asynchronous FIFO;

Reading to hold in the process that institute's buffer data size increases progressively in asynchronous FIFO, when reading to hold the data depth of asynchronous FIFO higher than R_PRIO_H, then produce SDRAM and cancel preferential read operation instruction, then described SDRAM being cancelled preferential read operation instruction is input in Read-write Catrol arbitration modules, Read-write Catrol arbitration modules receives described SDRAM and cancels preferential read operation instruction, cancel SDRAM and read priority, SDRAM stops reading preferentially; When reading to hold the data depth of asynchronous FIFO higher than R_REQ_H, then produce SDRAM and stop read operation instruction, then read operation instruction is stopped to be input in Read-write Catrol arbitration modules described SDRAM, Read-write Catrol arbitration modules receives described SDRAM and stops read operation instruction, stops the video data in SDRAM to be read in end asynchronous FIFO;

Described N number of reading holds the video data in asynchronous FIFO to export to subsequent module through reading the reading of module continuous print, and the output data of N number of output module can think continuous print line by line, and have concurrency and synchronism between the output data of N number of output module.This N number of reading holds the control of asynchronous FIFO passing threshold and the control of state machine to guarantee respectively to read to hold data volume in asynchronous FIFO to be consistent, and namely the process of N number of viewpoint data keeps synchronous, this ensure that follow-up without the need to increasing extra synchronization mechanism.

Embodiment one

With reference to figure 4, be shown as routine analysis diagram as access procedure with compatible 4 viewpoint bore hole 3D 1080P, the present invention is not limited to 4 viewpoints and 1080P, applies to N viewpoint 4K or the display of 8K ultra high-definition resolution equally:

The sub-visual field of video four is four palace case form arrangements, and namely the front hemistich of front 540 row writes the later half row of the first visual field data and writes the second visual field data, the later half row write of front hemistich write the 3rd visual field data the 4th visual field data of rear 540 row.Adjacent 4 the data burst data blocks in first visual field are a unit, and A1, A2, A3, A4 are respectively stored in bank000, bank001, bank010, bank011, and in this visual field, the cycle repeats subsequent data blocks by that analogy; Adjacent 4 the data burst blocks in second visual field be a unit B 1, B2, B3, B4 respectively stored in bank010, bank011, bank000, bank001, in this visual field subsequent data blocks by that analogy the cycle repeat; Adjacent 4 the data burst blocks in 3rd visual field be unit C1, C2, C3, a C4 respectively stored in bank001, bank010, bank011, bank000, in this visual field subsequent data blocks by that analogy the cycle repeat; Adjacent 4 the data burst blocks in 4th visual field be a cells D 1, D2, D3, D4 respectively stored in bank011, bank000, bank001, bank010, in this visual field subsequent data blocks by that analogy the cycle repeat.

During stored video data, video flowing is with form write line by line, by above-mentioned described control method and address assignment, store successively line by line by video data when depositing video data, i.e. A1, A2, A3, A4 ... (the first viewpoint the first row remaining data) ... B1, B2, B3, B4 ... (the second viewpoint the first row remaining data), repeat 1080 row successively, whole frame data are written with SDRAM, and any twice continuous print deposit data operation, memory address all can switch bank.

When reading stored data, each sub-visual field video flowing with form output line by line, and ensures the synchronism between each sub-visual field.When reading data under 3D pattern, the present invention respectively gets a burst data write successively according to first, second, third and fourth viewpoint order and reads accordingly to hold the mode of asynchronous FIFO to read from each visual field, namely first A1, B1, C1, D1 is read, then A2, B2, C2, D2 is read, until whole frame data read SDRAM.When reading data, SDRAM address switchover order is bank000, bank001, bank010, bank011, circulates successively, until a frame end, and every twice continuous print read data operation, address all can switch bank; When reading data under 2D pattern, reading order is identical with write sequence, continuous print read operation switches between different bank, because read data frame and write data frame are distributed in different bank, even if so there is read-write competition arbitration, any twice continuous print internal memory operation Du writes and is all distributed in different bank.

In the present invention, memory read/write control method is corresponding with storage policy, by writing end asynchronous FIFO and the threshold value control SDRAM read-write state reading to hold asynchronous FIFO, use two frame frames to deposit the requirement namely completing compatible 2D and the real-time processes and displays of multiple views bore hole 3D video data, significantly improve SDRAM bandwidth availability ratio.

Claims (3)

1. the video data of compatible 2D and multiple views bore hole 3D stores a reading/writing method, it is characterized in that, comprises the following steps:

1) video data is written in end asynchronous FIFO through write end module according to form line by line, write end asynchronous FIFO and receive described video data, and video data described in buffer memory, then described video data is stored in SDRAM, described video data comprises N number of viewpoint, it is capable that each viewpoint comprises M, every a line comprises K burst data, SDRAM comprises H bank, in storing process, video data is stored in the different bank of SDRAM with two burst data adjacent in a line, wherein, N is more than or equal to 1, M is more than or equal to 1, K is more than or equal to 2, H is more than or equal to 4,

2) N number of end asynchronous FIFO of reading reads described video data from SDRAM, and export described video data, in each reading process, N number of end asynchronous FIFO of reading sequentially reads burst data respectively, and each burst data are positioned at the same position of each sub-visual field, the process of adjacent twi-read is not carried out in same bank, when SDRAM write and read data operation intersect carry out time, the storage/reading process of adjacent twice video data is not carried out in same bank.

2. the video data of compatible 2D according to claim 1 and multiple views bore hole 3D stores reading/writing method, it is characterized in that,

When storing read-write 2D video data, N is 1;

When storing read-write 3D video data, N is more than or equal to 2.

3. the video data of compatible 2D according to claim 1 and multiple views bore hole 3D stores reading/writing method, and it is characterized in that, H equals 8.