CN114422769B - Transmitting card, receiving card, display control method and storage medium for display system - Google Patents
Transmitting card, receiving card, display control method and storage medium for display system Download PDFInfo
- Publication number
- CN114422769B CN114422769B CN202210053922.3A CN202210053922A CN114422769B CN 114422769 B CN114422769 B CN 114422769B CN 202210053922 A CN202210053922 A CN 202210053922A CN 114422769 B CN114422769 B CN 114422769B
- Authority
- CN
- China
- Prior art keywords
- data
- video
- frame
- eye
- eye image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 230000001360 synchronised effect Effects 0.000 claims abstract description 37
- 230000005540 biological transmission Effects 0.000 claims abstract description 34
- 238000009432 framing Methods 0.000 claims abstract description 15
- 238000004458 analytical method Methods 0.000 claims abstract description 8
- 230000011218 segmentation Effects 0.000 claims abstract description 5
- 238000004891 communication Methods 0.000 claims description 32
- 239000002131 composite material Substances 0.000 claims description 30
- 239000000203 mixture Substances 0.000 claims description 14
- 238000000926 separation method Methods 0.000 claims description 12
- 238000005516 engineering process Methods 0.000 claims description 5
- 230000010287 polarization Effects 0.000 claims description 3
- 230000015572 biosynthetic process Effects 0.000 claims 4
- 238000003786 synthesis reaction Methods 0.000 claims 4
- 238000012545 processing Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 16
- 238000013500 data storage Methods 0.000 description 8
- 238000004364 calculation method Methods 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000009295 sperm incapacitation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/385—Image reproducers alternating rapidly the location of the left-right image components on the display screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses a transmitting card, a receiving card, a display control method and a storage medium of a display system, and belongs to the technical field of display system control. Wherein, this display system's transmission card includes: the 3D video input analysis module, the field synchronous signal capturing module, the first field synchronous framing module, the storage module, the 3D video segmentation reading module and the group data frame transmitting module are used for completing 3D video interleaving on a transmitting card of the display system, so that the data volume of 3D video which is required to be transmitted to a receiving card of the display system is reduced, the storage resource bandwidth utilization rate of the receiving card is reduced, and the stability of the display system is improved; by generating interleaved 3D video frames from the interleaved 3D video data, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved.
Description
Technical Field
The present invention relates to the field of display system control technologies, and in particular, to a transmitting card, a receiving card, a display control method, and a storage medium of a display system.
Background
The current control technology of the LED cinema screen system is gradually shaped and tends to be rich in functions, wherein supporting 3D film playing gradually becomes a popular market demand, and in addition, the good film watching experience of 3D display of the LED display screen also provides a driving force for the development of the technology.
However, the LED 3D display has the special and specific problems to be solved, for example, the frame-up scheme of the 3D display mentioned in patent application number 202011183750.9 is to solve the problem of screen flicker when the LED display screen displays at a low frame rate, but the practical application problem is not considered. The LED screen has a larger size (more than 10 meters in width), so that the pixel pitch is generally larger, and due to the limitation of the box body and the low scanning number, there are a huge number of receiving cards, namely, the frame lifting processing unit is put into the receiving card by adopting the method described in the patent, the number of ports still needs to be increased when the transmitting card is connected with the receiving card end, or more receiving cards need to be connected with a single port, which can bring great challenges to the existing control system, and the frame rate to be displayed is higher, if the frame rate to be displayed is higher, for example, 4k@120fps or 8k@60fps are supported, the bandwidth utilization rate of storage resources of the receiving card is too high, so that the stability of the system is reduced. In addition, the problem of synchronization between a larger number of receiving cards also places higher demands on the frame packet design.
Disclosure of Invention
Accordingly, an object of an embodiment of the present invention is to provide a transmitting card, a receiving card, a display control method and a storage medium of a display system, so as to at least solve the technical problems of reduced stability of the display system and synchronization between a large number of receiving cards caused by an excessively high utilization rate of a storage resource bandwidth of the receiving card.
The technical scheme adopted by the invention for solving the technical problems is as follows:
According to a first aspect of an embodiment of the present invention, there is provided a transmission card of a display system, the transmission card of the display system including:
the 3D video input analysis module is used for analyzing a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source;
The field synchronization signal capturing module is used for generating first field synchronization data according to the frame synchronization signal;
the first field synchronization framing module is used for generating a field synchronization frame according to the first field synchronization data;
a storage module for separately storing left-eye data and right-eye data after receiving the first 3D video data;
The 3D video segmentation reading module is used for alternately reading the left eye data and the right eye data according to rows so as to output interleaved 3D video data;
And the group data frame transmitting module is used for generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and transmitting the video synchronization frame and the interlaced 3D video frame as a communication frame to a receiving card of a display system.
According to a second aspect of an embodiment of the present invention, there is provided a receiving card of a display system, the receiving card of the display system including:
The communication frame input analysis module is used for analyzing and generating a video synchronization frame and an interweaved 3D video frame according to the communication frame received from the sending card of the display system;
The frequency raising module is used for raising the frame rate of the video synchronization frame to a preset frame rate and generating second field synchronization data corresponding to the preset frame rate;
the second field synchronous framing module is used for forming a final displayed target field synchronous signal according to the second field synchronous data;
the 3D video input analysis module is used for analyzing the interleaved 3D video frames to obtain interleaved 3D video data;
The splitting storage module is used for splitting the interweaved 3D video data into left-eye image data and right-eye image data and respectively storing the left-eye image data and the right-eye image data in a left-eye storage area and a right-eye storage area;
The 3D video frame reading module is used for reading left-eye image data and right-eye image data in a whole frame;
the 3D video frame expansion module is used for generating second 3D video data with preset resolution and preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data;
And the 3D video display and transmission module is used for outputting the second 3D video data to a display screen for display according to the target field synchronous signal.
According to a third aspect of the embodiment of the present invention, there is provided a display control method applied to a transmitting card of the above display system, the method including:
analyzing a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source;
Generating first field synchronous data according to the frame synchronous signal;
generating a field synchronization frame according to the first field synchronization data;
Storing left-eye data and right-eye data separately after receiving the first 3D video data;
alternately reading the left-eye data and the right-eye data by rows, thereby outputting interleaved 3D video data;
Generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame as a communication frame to a receiving card of a display system.
According to a fourth aspect of the embodiment of the present invention, there is provided a display control method applied to a receiving card of the above display system, the method including:
According to the communication frame received from the sending card of the display system, analyzing and generating a video synchronization frame and an interweaved 3D video frame;
the frame rate of the video synchronization frame is increased to a preset frame rate, and second field synchronization data corresponding to the preset frame rate is generated;
forming a final displayed target field synchronizing signal according to the second field synchronizing data;
analyzing the interleaved 3D video frames to obtain interleaved 3D video data;
splitting the interleaved 3D video data into left-eye image data and right-eye image data, and respectively storing the left-eye image data and the right-eye image data in a left-eye memory area and a right-eye memory area;
reading left-eye image data and right-eye image data in an entire frame;
Generating second 3D video data with preset resolution and preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data;
and outputting the second 3D video data to a display screen for display according to the target field synchronous signal.
According to a fifth aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a display control program which, when executed by a processor, implements the steps of the display control method of the above third aspect or implements the steps of the display control method of the above fourth aspect.
According to the transmitting card, the receiving card, the display control method and the storage medium of the display system, 3D video interleaving is completed on the transmitting card of the display system, so that the data size of 3D video which is required to be transmitted to the receiving card of the display system is reduced, the utilization rate of the storage resource bandwidth of the receiving card is reduced, and the stability of the display system is improved; by generating interleaved 3D video frames from the interleaved 3D video data, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The 3D video source with various 3D video source formats and various frame rates can complete display data transmission processing and display in a display system based on lower cost.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
FIG. 1 is a suitable scenario involving embodiments of the present invention;
FIG. 2 is a schematic diagram of a display system according to an embodiment of the present invention;
FIG. 3 is a diagram of a data format of a left-right separation type according to an embodiment of the present invention;
Fig. 4 is a schematic diagram of a data format of a left-right combination format according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a data format of an up-down combination format according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a configuration of a transmitting card of a display system according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a memory module according to an embodiment of the present invention storing left-eye data and right-eye data;
FIG. 8 (a) is an effect diagram of interleaved 3D video data output by an embodiment of the present invention;
FIG. 8 (b) is another interleaved 3D video data effect diagram output by an embodiment of the present invention;
FIG. 9 is a diagram of still another interleaved 3D video data effect output by an embodiment of the present invention;
Fig. 10 is a schematic structural diagram of a receiving card of a display system according to an embodiment of the present invention;
FIG. 11 is a diagram showing an effect of an image to be restored obtained by splitting according to an embodiment of the present invention;
FIG. 12 is a graph of interpolation coefficients versus interpolated frame numbers according to an embodiment of the present invention;
FIG. 13 is a schematic diagram of inter-frame interpolation according to an embodiment of the present invention;
FIG. 14 is a flowchart of a display control method according to an embodiment of the present invention;
Fig. 15 is a flowchart of another display control method according to an embodiment of the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present invention, and have no specific meaning per se. Thus, "module," "component," or "unit" may be used in combination.
Example 1
In order to at least partially solve the technical problems of reduced stability of the display system and synchronization between a large number of receiving cards caused by over-high utilization rate of storage resource bandwidth of the receiving cards, the embodiment provides a transmitting card of the display system. The transmitting card of the display system is suitable for a 3D display system, taking the display system as a cinema screen control system as an example, and fig. 1 is a suitable scenario of the 3D display system according to the embodiment of the present invention. In the applicable scene, the film comes from a cinema video server or a PC (personal computer) with playing film, and the server decodes the film and outputs a 12bit X ' Y ' Z ' code stream to the cinema screen control system, the code stream is firstly processed by a display sending processing unit (such as a sending card) of the cinema screen control system, then is processed and packaged and is sent to a display receiving processing unit (such as a receiving card) of the cinema screen control system, and finally is output to a display unit (such as a 3D LED display screen) for video display.
Fig. 2 is a schematic structural diagram of a display system according to an embodiment of the present invention. Continuing with the cinema screen control system as an example, the cinema screen control system includes one or more sending cards having n connectors, each with multiple receiving cards.
The 3D implementation technology type applicable to the embodiment of the present invention includes a polarization type and a time-sharing type (i.e., active shutter type), and the 3D video source format applicable to the embodiment of the present invention includes a split type and a composite type, where the split type includes a left-right split type, and the composite type includes a left-right composite type and an up-down composite type.
The amount of data in various 3D video source formats is analyzed below using a 3D video with a resolution of 4096 x 2160 at 4k@24fps as an example. In the left-right separated 3D video, if the input video is seen as 2D video, the input video is 4k@48fps, the left eye and the right eye are respectively input at 24fps in a time-sharing and cross mode, as shown in fig. 3, the data volume of the 3D video source format is the largest in the current 3D video source format, and the consumption data transmission bandwidth is the highest. In the left-right composite 3D video, if the input video is seen as a 2D video, the frame rate is 4k@24fps, the resolution of the left and right eyes is 2048×2160, and the combination becomes 4096×2160, as shown in fig. 4. In the vertical-combined 3D video, if the input video is seen as a 2D video, the frame rate is 4k@24fps, the resolution of the left and right eyes is 4096×1080, and the combination becomes 4096×2160, as shown in fig. 5.
Referring to fig. 6, fig. 6 is a schematic diagram of a transmitting card of a display system according to an embodiment of the invention. The transmission card of the display system includes:
the 3D video input parsing module 601 is configured to parse the 3D video source format, the first 3D video data and the frame synchronization signal according to the input 3D video source;
A field synchronization signal capturing module 602, configured to generate first field synchronization data according to the frame synchronization signal;
A first field synchronization framing module 603, configured to generate a field synchronization frame according to the first field synchronization data;
A storage module 604 for separately storing left-eye data and right-eye data after receiving the first 3D video data;
A 3D video division reading module 605 for alternately reading the left-eye data and the right-eye data by rows, thereby outputting interleaved 3D video data;
the group data frame transmitting module 606 is configured to generate a video synchronization frame according to the field synchronization frame, generate an interleaved 3D video frame according to the interleaved 3D video data, and transmit the video synchronization frame and the interleaved 3D video frame as a communication frame to a receiving card of a display system.
Specifically, first, the 3D video input parsing module 601 parses the 3D video source format, the first 3D video data and the frame synchronization signal thereof according to the input 3D video source, and outputs the first 3D video data to the storage module 604, and outputs the frame synchronization signal to the field synchronization signal capturing module 602; then, the field sync signal capturing module 602 generates first field sync data according to the frame sync signal and outputs the first field sync data to the first field sync framing module 603; then, the first field synchronization framing module 603 generates a field synchronization frame according to the first field synchronization data, and outputs the field synchronization frame to the framing data frame sending module 606; Then, after receiving the first 3D video data, the storage module 604 separately stores the left eye data and the right eye data according to the parsed 3D video source format, taking a 3D video with a resolution of 4096×2160 at 4k@24fps as an example, and the storage result is shown in fig. 7; then, the 3D video segmentation reading module 605 alternately reads the left-eye data and the right-eye data stored in the storage module 604 by rows, thereby outputting interleaved 3D video data to the group data frame transmitting module 606; finally, the group data frame transmitting module 606 generates a video synchronization frame according to the field synchronization frame, generates an interleaved 3D video frame according to the interleaved 3D video data, and transmits the video synchronization frame and the interleaved 3D video frame as a communication frame to a receiving card of a display system. Therefore, 3D video interleaving is completed on the sending card of the display system, the data volume of the 3D video which needs to be transmitted to the receiving card of the display system is reduced, the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; further, by generating interleaved 3D video frames from the interleaved 3D video data, transmission delay between receiving cards of the display system is reduced, and a technical problem of synchronization between a large number of receiving cards is solved. The 3D video source with various 3D video source formats and various frame rates can complete display data transmission processing and display in a display system based on lower cost. As can be appreciated by those skilled in the art, after the 3D video input parsing module 601 parses the 3D video source format, the first 3D video data and the frame synchronization signal according to the input 3D video source, the field synchronization signal capturing module 602, the first field synchronization framing module 603, the storage module 604 and the 3D video segmentation reading module 605 may work simultaneously or sequentially to generate the field synchronization frame and the interleaved 3D video data respectively, and the working sequence is not limited in this embodiment. The alternately reading the left eye data and the right eye data according to the rows may be alternately reading the left eye data and the right eye data according to the rows, or alternately reading the left eye data and the right eye data according to the interlacing; the specific reading mode is determined according to the analyzed 3D video source format, if the 3D video source format is left-right separated, the left-eye data and the right-eye data are alternately read in an interlaced mode, so that the data quantity of the 3D video which is required to be transmitted to a receiving card of a display system is reduced by 50%; if the 3D video source format is a left-right composite or an up-down composite, the left eye data and the right eye data are read alternately row by row so as to keep the data volume of the 3D video which needs to be transmitted to the receiving card of the display system, thereby making the data volume of the 3D video which needs to be transmitted to the receiving card of the display system in various video formats the same.
In one embodiment, the alternately reading the left eye data and the right eye data in rows includes: if the 3D video source format is left-right separated, alternately reading odd-even lines of the continuous left-eye data and the continuous right-eye data respectively, and alternately setting a line taking mark for recording the odd-numbered lines or even-numbered lines of each frame corresponding to the left-eye data or the right-eye data once every frame; and if the 3D video source format is of a left-right composition formula or an up-down composition formula, respectively reading the continuous left-eye data and the continuous right-eye data alternately.
In this embodiment, taking a 3D video with a resolution of 4096×2160 at 4k@24fps as an example, if the 3D video source format is split left and right, two consecutive left and right eye frames are alternately and respectively taken as odd and even lines, that is, left and right eye data are interlaced and interleaved, and combined into a 3D video with a resolution of 4K, so as to reduce the data volume transmitted to the receiving card, and ensure that the data volume is consistent when each 3D video source format arrives at the receiving card. For example, the current frame reads the odd lines in the left-eye data storage area first, then reads the even lines in the right-eye data storage area, and the next frame reads the odd lines in the right-eye data storage area first, then reads the even lines in the left-eye data storage area, assuming that gray represents left-eye image line data and black represents right-eye image line data, when the frame number is an odd frame, the left-eye image takes the odd lines, and the right-eye image takes the even lines as shown in fig. 8 (a); fig. 8 (b) shows that when the frame number is an even frame, the left eye image takes even lines and the right eye image takes odd lines. At this time, a line fetch flag of 0 may be set to indicate that the left-eye image fetches odd lines, and a line fetch flag of 1 may be set to indicate that the left-eye image fetches even lines. If the 3D video source formats are left-right synthesized, the left-eye data and the right-eye data which are continuous are alternately read respectively, that is, the left-eye data and the right-eye data are interleaved line by line, and are combined into a 3D video with 4K resolution, as shown in fig. 9, so that the data amount is consistent from each 3D video source format to the receiving card. If the 3D video source formats are combined up and down, the continuous left eye data and the continuous right eye data are alternately read respectively, namely the left eye data and the right eye data are interleaved line by line and combined into a 3D video with 4K resolution, so that the data amount is consistent from each 3D video source format to the receiving card.
Optionally, when the 3D video source format is a left-right composition or an up-down composition, the left-eye data is read first, or the right-eye data is read first, so that the receiving card of the display system analyzes and obtains the left-eye data and the right-eye data according to a preset sequence.
For example, the format of the video sync frame is shown in table 1.
Table 1 format of video sync frames
The description of the fields in the video sync frame is shown in table 2.
Table 2 field description of video sync frame
The format of the interleaved 3D video frames is shown in table 3.
Table 3 format of interleaved 3D video frames
An illustration of the fields in the interleaved 3D video frame is shown in table 4.
FH | Frame header | Field synchronous communication frame type identifier with value of 0x0 |
LINE | Fetch mark | Determining data location based on a flag |
WIDTH | Width of (L) | Storage area per line number of image pixels |
COUNT | Quantity of | Total number of pixels |
PN | Pixel arrangement | N+1th pixel data, 36bit |
CRC32 | Check code | 32-Bit CRC check code |
RFU | Reservation | Reserved byte with value 0x0 |
TABLE 4 description of fields in interleaved 3D video frames
The sending card of the display system of the embodiment of the invention comprises: the 3D video input parsing module 601 is configured to parse the 3D video source format, the first 3D video data and the frame synchronization signal according to the input 3D video source; a field synchronization signal capturing module 602, configured to generate first field synchronization data according to the frame synchronization signal; a first field synchronization framing module 603, configured to generate a field synchronization frame according to the first field synchronization data; a storage module 604 for separately storing left-eye data and right-eye data after receiving the first 3D video data; a 3D video division reading module 605 for alternately reading the left-eye data and the right-eye data by rows, thereby outputting interleaved 3D video data; the group data frame transmitting module 606 is configured to generate a video synchronization frame according to the field synchronization frame, generate an interleaved 3D video frame according to the interleaved 3D video data, and transmit the video synchronization frame and the interleaved 3D video frame as a communication frame to a receiving card of a display system. 3D video interleaving is completed by the transmitting card of the display system, so that the data volume of 3D video which is required to be transmitted to the receiving card of the display system is reduced, the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; by generating interleaved 3D video frames from the interleaved 3D video data, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The 3D video source with various 3D video source formats and various frame rates can complete display data transmission processing and display in a display system based on lower cost.
Example two
In order to at least partially solve the technical problems of reduced stability of the display system and synchronization between a large number of receiving cards caused by over-high utilization rate of storage resource bandwidth of the receiving cards, the embodiment provides a receiving card of the display system. The receiving card of the display system is suitable for a 3D display system, and the applicable scenario and related display system structure are the same as those of the first embodiment, please refer to the first embodiment, and the details are not repeated here. Referring to fig. 10, fig. 10 is a schematic diagram of a receiving card of a display system according to an embodiment of the invention. The receiving card of the display system includes:
The communication frame input parsing module 1001 is configured to parse and generate a video synchronization frame and an interleaved 3D video frame according to a communication frame received from a transmission card of the display system;
The frequency raising module 1002 is configured to raise the frame rate of the video synchronization frame to a preset frame rate, and generate second field synchronization data corresponding to the preset frame rate;
A second field synchronization framing module 1003, configured to compose a final displayed target field synchronization signal according to the second field synchronization data;
the 3D video input parsing module 1004 is configured to parse the interleaved 3D video frame to obtain interleaved 3D video data;
A splitting storage module 1005, configured to split the interleaved 3D video data into left eye image data and right eye image data, and store the left eye image data and the right eye image data in a left eye storage area and a right eye storage area, respectively;
A 3D video frame reading module 1006 for reading left eye image data and right eye image data in whole frames;
A 3D video frame expansion module 1007, configured to generate second 3D video data with a preset resolution and the preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data;
and the 3D video display sending module 1008 is configured to output the second 3D video data to a display screen for display according to the target field synchronization signal.
Specifically, first, the communication frame input parsing module 1001 parses and generates a video synchronization frame and an interleaved 3D video frame according to a communication frame received from a transmission card of the display system, and outputs the video synchronization frame to the up-conversion module 1002, and outputs the interleaved 3D video frame to the 3D video input parsing module 1004; then, the up-conversion module 1002 increases the frame rate of the video synchronization frame to a preset frame rate, generates second field synchronization data corresponding to the preset frame rate, and outputs the second field synchronization data to the second field synchronization framing module 1003; then, the second field synchronization framing module 1003 composes a final displayed target field synchronization signal according to the second field synchronization data, and outputs the target field synchronization signal to the 3D video display transmitting module 1008; Then, the 3D video input parsing module 1004 parses the input interleaved 3D video frame to obtain interleaved 3D video data, and outputs the interleaved 3D video data to the splitting storage module 1005; then, the splitting storage module 1005 splits the interleaved 3D video data into left eye image data and right eye image data, and stores the left eye image data and the right eye image data in a left eye storage area and a right eye storage area, respectively; then, the 3D video frame reading module 1006 reads the left eye image data and the right eye image data in whole frames and outputs the read left eye image data and right eye image data to the 3D video frame expansion module 1007; Then, the 3D video frame expansion module 1007 generates second 3D video data of a preset resolution and a preset frame rate according to the second field synchronization data, the left eye image data and the right eye image data, and outputs the second 3D video data to the 3D video display transmission module 1008; finally, the 3D video display transmitting module 1008 outputs the second 3D video data to a display screen for displaying according to the target field synchronizing signal. Therefore, the splitting, frame rate expansion and resolution unification of the interleaved 3D video are completed on the receiving card of the display system, the data volume of the 3D video received from the transmitting card of the display system is reduced, the utilization rate of the storage resource bandwidth of the receiving card is reduced, and the stability of the display system is improved; Further, by receiving the interleaved 3D video frames, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between the receiving cards with a large number is solved. The 3D video source with various 3D video source formats and various frame rates can finish display data transmission processing and high-frame rate display in a display system based on lower cost. As can be appreciated by those skilled in the art, after the communication frame input parsing module 1001 parses and generates a video synchronization frame and an interleaved 3D video frame according to a communication frame received from a transmitting card of the display system, the up-conversion module 1002 and the 3D video input parsing module 1004, the split storage module 1005 may operate simultaneously or sequentially, and the sequence of operation is not limited in this embodiment. Wherein the step of increasing the frame rate of the video synchronization frame to a preset frame rate comprises the steps of: and (3) improving the frame rate of the video synchronization frame to the frame rate of the video data output to the display screen by the receiving card, for example, improving the frame rate of 24fps and the frame rate of 48fps by 6 times and 3 times respectively to achieve the frame rate of 144 fps. Splitting the interleaved 3D video data into left eye image data and right eye image data and storing in a left eye memory area and a right eye memory area, respectively, includes: according to a line fetching flag corresponding to left eye data or right eye data or a preset order of reading left eye image data and right eye image data for recording odd lines or even lines of each frame and a line effective length of each line, the interleaved 3D video data is split into left eye image data and right eye image data, and stored in a left eye storage area and a right eye storage area respectively, and a 3D video with a resolution of 4096×2160 at 4k@24fps is taken as an example, and the storage result is shown in fig. 7. The generating the second 3D video data with the preset resolution and the preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data comprises: if the 3D video source format is left-right separation, firstly expanding the left-eye image data and the right-eye image data into preset resolution, and then expanding the left-eye image data and the right-eye image data which are expanded into the preset resolution into the preset frame rate; if the 3D video source format is a left-right composite or an up-down composite, the left-eye image data and the right-eye image data are directly expanded to the preset frame rate. The preset resolution may be 4096×2160, or other resolutions, and the specific value of the preset resolution is not limited in this embodiment. The preset frame rate may be 144fps, or other frame rates, and the specific value of the preset frame rate is not limited in this embodiment.
In one embodiment, the splitting the interleaved 3D video data into left eye image data and right eye image data includes: if the format of the interleaved 3D video frame is left-right separation, splitting the interleaved 3D video data into left-eye image data and right-eye image data according to a line fetching flag corresponding to left-eye data or right-eye data for recording odd lines or even lines of each frame.
In this embodiment, split storage is performed according to the line-taking flag and the line effective length, for example, when the line-taking flag is 0, which indicates that the left-eye image takes the odd-eye line, the interleaved 3D video data is firstly cut according to the line effective length, the odd-eye line is stored in the left-eye memory area, and the even-eye line is stored in the right-eye memory area; when the line taking mark is 1, indicating that the left eye image takes even lines, firstly cutting the interweaved 3D video data according to the effective length of the lines, storing the odd lines into a right eye storage area, and storing the even lines into a left eye storage area; taking a 3D video with a resolution of 4096×2160 at 4k@24fps as an example, the stored result is shown in fig. 7.
In one embodiment, the splitting the interleaved 3D video data into left eye image data and right eye image data includes: if the format of the interleaved 3D video frame is a left-right composite or a top-bottom composite, splitting the interleaved 3D video data into left-eye image data and right-eye image data according to a preset sequence of reading left-eye data or reading right-eye data.
In one embodiment, the generating the second 3D video data of the preset resolution and the preset frame rate according to the second field sync data, the left eye image data, and the right eye image data includes: and if the format of the interleaved 3D video frame is left-right separation, the resolution of the left-eye image data and the right-eye image data is expanded to a preset resolution.
In this embodiment, since the left-right separated 3D video source is subjected to interlace value processing on the transmitting card side and half of the data is discarded, the left-eye image and the right-eye image before resolution expansion are shown in fig. 11, where blank lines in FL1 to FL4 and FR1 to FR4 represent pixels to be expanded, and resolution expansion is required on the receiving card side so that the resolution of the 3D video source format is the same as that of the other 3D video source formats.
In one embodiment, the expanding the resolution of the left eye image data and the right eye image data to a preset resolution includes: and expanding the resolution of the left-eye image data and the right-eye image data to a preset resolution through an intra-frame interpolation method.
In the present embodiment, in order to improve the image quality, the resolution expansion is performed by the intra interpolation method. Specifically, the intra interpolation method is to use pixels at corresponding column positions of the images of the previous and next rows in the current row space to calculate an average value, for example, the position of the expansion target pixel point P is (i, j), where i is a horizontal coordinate value and j is a vertical coordinate value, and then the intra interpolation method can be written as the following formula:
wherein PIcur (i, j) represents the result of the intra interpolation of the ith column and jth row of pixels of the current frame, pcur (i, j-1) represents the pixel value of the jth-1 row of pixels of the ith column of the current frame, and Pcur (i, j+1) represents the pixel value of the jth+1 row of pixels of the ith column of the current frame.
Alternatively, pixels beyond the boundary take significant boundary values during the intra interpolation calculation. Taking the odd-numbered line example of the left-eye image from the first frame, the left-eye image is discarded as the even-numbered line when the first frame is taken, the right-eye image is discarded as the odd-numbered line when the right-eye image is taken, and when the right-eye image is recovered to the first line data, pcur (i, j-1) is not present, at this time, pcur (i, j-1) =pcur (i, j+1), because Pcur (i, j) is the pixel to be recovered as an invalid boundary, the bottom boundary processing is the same, pcur (i, j+1) is not present, and Pcur (i, j+1) =pcur (i, j-1).
In one embodiment, the generating the second 3D video data of the preset resolution and the preset frame rate according to the second field sync data, the left eye image data, and the right eye image data includes: and expanding the left-eye image data and the right-eye image data to the preset frame rate through an inter-frame interpolation method.
In the present embodiment, in order to improve image quality, the left-eye image data and the right-eye image data are extended to the preset frame rate by an inter-frame interpolation method. Specifically, the interframe interpolation formula is:
Wherein PI (i, j) represents an inter-frame interpolation result of an ith column and a jth row of pixels, pprev (i, j) represents an ith column and a jth row of pixel values of a previous frame, pnext (i, j) represents an ith column and a jth row of pixel values of a next frame, n is 2 times of a frame number of a current inserted frame calculated from 0 to a frame rate expansion multiple k, namely n e [0,2 x k ], m= 2*k-n, taking a preset frame rate as an example, 144fps, and if the frame rate of the video synchronization frame is 24fps or 48fps, the value of k (144/24 or 144/48) is 6 or 3, and the value of k is calculated by the up-conversion module 1002 through the preset frame rate.
Optionally, during the inter-frame interpolation computation, image pixels outside the video range take significant boundary values. For example, pprev (i, j) is absent at the first frame, pprev (i, j) =pnext (i, j), and Pnext (i, j) = Pprev (i, j) at the last frame.
In one embodiment, if the 3D video source format is left-right separation, the final interpolation result through the inter-frame interpolation and the intra-frame interpolation may be written as:
The final interpolation result includes frame rate expansion processing, wherein n1=k- |k-n|, m1= 2*k-n1, as shown in fig. 12, the interpolation coefficient is biased to inter-frame interpolation, the head and tail of the inserted frame completely adopt inter-frame interpolation, and the interpolation coefficients of the intermediate frames of the inserted frame are equal; in the resolution expansion processing, a special case where n=k is taken, and when n is another value, the pixel value of the inserted frame of the nth frame is calculated. Fig. 13 is a schematic diagram of interpolation between frames with a frame rate expansion multiple k of 3, where gray circles represent one line of data existing in one frame of image, white circles represent one line of data to be restored in one frame of image, and each line of data in one frame of image is represented from top to bottom, and from left to right represents a video frame condition. Taking the point P to be recovered as an example, the interpolation value of the point P frames uses the data of the column positions with the same row data of the L1 and the L3 to be substituted into the formula 1 for operation, namely, l1=pcur (i, j-1) is substituted into the formula for calculation; the number of P-point inter-frame interpolation results is 7, and in fig. 13, L2, IL1, IL2, IL3 (P), IL4, IL5, and L4 are respectively, where the actual pixel values are directly obtained without calculation of L2 and L4, and the actual pixel values can also be obtained by substituting n=0 and n=6 into formula 3.
In one embodiment, if the 3D video source format is a left-right composite or an up-down composite, the extended frame rate process directly uses equation 2, where Pprev (i, j) and Pnext (i, j) represent the ith column and jth line pixel values of two adjacent frames, and the calculation result is the image of the inserted frame.
The receiving card of the display system of the embodiment of the invention comprises: the communication frame input parsing module 1001 is configured to parse and generate a video synchronization frame and an interleaved 3D video frame according to a communication frame received from a transmission card of the display system; the frequency raising module 1002 is configured to raise the frame rate of the video synchronization frame to a preset frame rate, and generate second field synchronization data corresponding to the preset frame rate; a second field synchronization framing module 1003, configured to compose a final displayed target field synchronization signal according to the second field synchronization data; the 3D video input parsing module 1004 is configured to parse the interleaved 3D video frame to obtain interleaved 3D video data; a splitting storage module 1005, configured to split the interleaved 3D video data into left eye image data and right eye image data, and store the left eye image data and the right eye image data in a left eye storage area and a right eye storage area, respectively; a 3D video frame reading module 1006 for reading left eye image data and right eye image data in whole frames; a 3D video frame expansion module 1007, configured to generate second 3D video data with a preset resolution and the preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data; and the 3D video display sending module 1008 is configured to output the second 3D video data to a display screen for display according to the target field synchronization signal. Therefore, the splitting, frame rate expansion and resolution unification of the interleaved 3D video are completed on the receiving card of the display system, the data volume of the 3D video received from the transmitting card of the display system is reduced, the utilization rate of the storage resource bandwidth of the receiving card is reduced, and the stability of the display system is improved; further, by receiving the interleaved 3D video frames, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between the receiving cards with a large number is solved. The 3D video source with various 3D video source formats and various frame rates can finish display data transmission processing and high-frame rate display in a display system based on lower cost.
Example III
Fig. 14 is a flowchart of a display control method according to an embodiment of the present invention. The flow in this embodiment is operated by the transmitting card of the display system in the first embodiment, where each step may be performed sequentially as in the sequence of the flow chart, or may be performed simultaneously according to the actual situation, which is not limited herein. The display control method comprises the following steps:
in step S1401, the 3D video source format, the first 3D video data and the frame synchronization signal are parsed from the input 3D video source.
Step S1402 generates first field synchronous data according to the frame synchronous signal.
Step S1403 generates a field sync frame from the first field sync data.
Step S1404, separately storing left-eye data and right-eye data after receiving the first 3D video data.
In step S1405, the left-eye data and the right-eye data are alternately read by row, thereby outputting interleaved 3D video data.
Step S1406, generating a video synchronization frame according to the field synchronization frame, generating an interleaved 3D video frame according to the interleaved 3D video data, and transmitting the video synchronization frame and the interleaved 3D video frame as a communication frame to a receiving card of a display system.
In this embodiment, it should be firstly explained that the types of 3D implementation techniques applicable to the embodiment of the present invention include a polarization type and a time-sharing type (i.e., active shutter type), and the 3D video source format applicable to the embodiment of the present invention includes a split type and a composite type, where the split type includes a left-right split type, and the composite type includes a left-right composite type and a top-bottom composite type.
Specifically, firstly, a sending card of a display system analyzes a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source; then, generating first field synchronous data according to the frame synchronous signal; then, generating a field synchronous frame according to the first field synchronous data; then, according to the analyzed 3D video source format and the first 3D video data, the left eye data and the right eye data are stored separately, taking a 3D video with a resolution of 4096×2160 at 4k@24fps as an example, and the storage result is shown in fig. 7; then, alternately reading the left-eye data and the right-eye data by rows, thereby outputting interleaved 3D video data; and finally, generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame as a communication frame to a receiving card of a display system. Therefore, 3D video interleaving is completed on the sending card of the display system, the data volume of the 3D video which needs to be transmitted to the receiving card of the display system is reduced, the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; further, by generating interleaved 3D video frames from the interleaved 3D video data, transmission delay between receiving cards of the display system is reduced, and a technical problem of synchronization between a large number of receiving cards is solved. The 3D video source with various 3D video source formats and various frame rates can complete display data transmission processing and display in a display system based on lower cost. It will be appreciated by those skilled in the art that after parsing the 3D video source format, the first 3D video data and the frame synchronization signal according to the input 3D video source, the steps of generating the field synchronization frame and generating the interleaved 3D video data may be performed simultaneously or sequentially, and the generating order is not limited in this embodiment. The alternately reading the left eye data and the right eye data according to the rows may be alternately reading the left eye data and the right eye data according to the rows, or alternately reading the left eye data and the right eye data according to the interlacing; the specific reading mode is determined according to the analyzed 3D video source format, if the 3D video source format is left-right separated, the left-eye data and the right-eye data are alternately read in an interlaced mode, so that the data quantity of the 3D video which is required to be transmitted to a receiving card of a display system is reduced by 50%; if the 3D video source format is a left-right composite or an up-down composite, the left eye data and the right eye data are read alternately row by row so as to keep the data volume of the 3D video which needs to be transmitted to the receiving card of the display system, thereby making the data volume of the 3D video which needs to be transmitted to the receiving card of the display system in various video formats the same.
In one embodiment, the alternately reading the left eye data and the right eye data in rows includes: if the 3D video source format is left-right separated, alternately reading odd-even lines of the continuous left-eye data and the continuous right-eye data respectively, and alternately setting a line taking mark for recording the odd-numbered lines or even-numbered lines of each frame corresponding to the left-eye data or the right-eye data once every frame; and if the 3D video source format is of a left-right composition formula or an up-down composition formula, respectively reading the continuous left-eye data and the continuous right-eye data alternately.
In this embodiment, taking a 3D video with a resolution of 4096×2160 at 4k@24fps as an example, if the 3D video source format is split left and right, two consecutive left and right eye frames are alternately and respectively taken as odd and even lines, that is, left and right eye data are interlaced and interleaved, and then combined into a 3D video with a resolution of 4K, so as to reduce the data volume transmitted to the receiving card, and ensure that the data volume is consistent when each 3D video source format arrives at the receiving card. For example, the current frame reads the odd lines in the left-eye data storage area first, then reads the even lines in the right-eye data storage area, and the next frame reads the odd lines in the right-eye data storage area first, then reads the even lines in the left-eye data storage area, assuming that gray represents left-eye image line data and black represents right-eye image line data, when the frame number is an odd frame, the left-eye image takes the odd lines, and the right-eye image takes the even lines as shown in fig. 8 (a); fig. 8 (b) shows that when the frame number is an even frame, the left eye image takes even lines and the right eye image takes odd lines. At this time, a line fetch flag of 0 may be set to indicate that the left-eye image fetches odd lines, and a line fetch flag of 1 may be set to indicate that the left-eye image fetches even lines. If the 3D video source formats are of a left-right composite type, the continuous left-eye data and right-eye data are alternately read respectively, that is, the left-eye data and the right-eye data are interleaved line by line, as shown in fig. 9, so that the data amount is consistent from each 3D video source format to the receiving card. If the 3D video source formats are combined up and down, the continuous left eye data and the continuous right eye data are alternately read respectively, namely the left eye data and the right eye data are interleaved line by line, so that the data volume is consistent when each 3D video source format is received by a card.
Optionally, if the 3D video source format is a left-right composition or a top-bottom composition, after alternately reading the continuous left-eye data and right-eye data respectively, the method further includes: the order of reading the left-eye data or the right-eye data is preset, so that the receiving card of the display system analyzes and obtains the left-eye data and the right-eye data according to the preset order. Specifically, when the 3D video source format is a left-right composition type or an up-down composition type, the left-eye data is read first, or the right-eye data is read first, so that the receiving card analyzes and obtains the left-eye data and the right-eye data according to a preset sequence.
Optionally, the communication frame includes a line effective length representing a number of line pixels.
For example, the communication frame includes a video synchronization frame with a format shown in table 1 and an interleaved 3D video frame with a description of each field in the video synchronization frame shown in table 2, and the interleaved 3D video frame with a format shown in table 3 and a description of each field in the interleaved 3D video frame shown in table 4. The communication frame includes a line effective length representing a number of line pixels so that a receiving card of the display system splits the interleaved 3D video frame accordingly.
According to the display control method, the 3D video source format, the first 3D video data and the frame synchronization signal are analyzed according to the input 3D video source; generating first field synchronous data according to the frame synchronous signal; generating a field synchronization frame according to the first field synchronization data; storing left-eye data and right-eye data separately after receiving the first 3D video data; alternately reading the left-eye data and the right-eye data by rows, thereby outputting interleaved 3D video data; generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame as a communication frame to a receiving card of a display system. 3D video interleaving is completed on a sending card of the display system, so that the data volume of 3D video which needs to be transmitted to a receiving card of the display system is reduced, the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; further, the interleaved 3D video frames are generated by the interleaved 3D video data, so that the transmission delay between receiving cards of a display system is reduced, and the technical problem of synchronization between receiving cards with a large number is solved. The 3D video source with various 3D video source formats and various frame rates can complete display data transmission processing and display in a display system based on lower cost.
Example IV
Fig. 15 is a flowchart of another display control method according to an embodiment of the present invention. The flow in this embodiment is operated by the receiving card of the display system in the second embodiment, where each step may be performed sequentially as shown in the flow chart, or may be performed simultaneously according to the actual situation, and the present invention is not limited thereto. The display control method comprises the following steps:
Step S1501 parses and generates a video sync frame and an interleaved 3D video frame from a communication frame received from a transmission card of a display system.
Step S1502, the frame rate of the video synchronization frame is increased to a preset frame rate, and second field synchronization data corresponding to the preset frame rate is generated.
In step S1503, a final displayed target field synchronizing signal is formed according to the second field synchronizing data.
Step S1504, parsing the interleaved 3D video frame to obtain interleaved 3D video data.
In step S1505, the interleaved 3D video data is split into left eye image data and right eye image data, and stored in a left eye memory area and a right eye memory area, respectively.
In step S1506, the left-eye image data and the right-eye image data are read in the whole frame.
Step S1507, generating second 3D video data with a preset resolution and a preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data.
Step S1508, outputting the second 3D video data to a display screen for displaying according to the target field synchronization signal.
Specifically, first, a receiving card of a display system analyzes and generates a video synchronization frame and an interlaced 3D video frame according to a communication frame received from a transmitting card of the display system; then, the frame rate of the video synchronization frame is increased to a preset frame rate, and second field synchronization data corresponding to the preset frame rate is generated; then, forming a final displayed target field synchronous signal according to the second field synchronous data; then, analyzing the interleaved 3D video frames to obtain interleaved 3D video data; then, splitting the interleaved 3D video data into left-eye image data and right-eye image data, and respectively storing the left-eye image data and the right-eye image data in a left-eye storage area and a right-eye storage area; Then, reading left-eye image data and right-eye image data in the whole frame; then, generating second 3D video data with preset resolution and preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data; and finally, outputting the second 3D video data to a display screen for display according to the target field synchronizing signal. Therefore, the splitting, frame rate expansion and resolution unification of the interleaved 3D video are completed on the receiving card of the display system, the data volume of the 3D video received from the transmitting card of the display system is reduced, the utilization rate of the storage resource bandwidth of the receiving card is reduced, and the stability of the display system is improved; Further, by receiving the interleaved 3D video frames, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between the receiving cards with a large number is solved. The 3D video source with various 3D video source formats and various frame rates can finish display data transmission processing and high-frame rate display in a display system based on lower cost. As will be appreciated by those skilled in the art, after parsing the generated video synchronization frame and interleaving the 3D video frame according to the communication frame received from the transmitting card of the display system, the step S1502 and the steps S1504-S1506 may be performed simultaneously or sequentially, and the operation sequence is not limited in this embodiment. Wherein the step of increasing the frame rate of the video synchronization frame to a preset frame rate comprises the steps of: the frame rate of the video synchronization frame is increased to the frame rate of the video data output by the receiving card to the display screen, for example, the frame rates of 24fps and 48fps are respectively increased by 6 times and 3 times, and the frame rate reaches 144 fps. Splitting the interleaved 3D video data into left eye image data and right eye image data and storing in a left eye memory area and a right eye memory area, respectively, includes: according to a line fetching flag corresponding to left-eye data or right-eye data or a preset order of reading the left-eye image data and the right-eye image data for recording odd-numbered lines or even-numbered lines of each frame and a line effective length, the interleaved 3D video data is split into the left-eye image data and the right-eye image data, and stored in a left-eye storage area and a right-eye storage area respectively, and a 3D video with a resolution of 4096×2160 at 4k@24fps is taken as an example, and the storage result is shown in fig. 7. The generating the second 3D video data with the preset resolution and the preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data comprises: if the 3D video source format is left-right separation, firstly expanding the left-eye image data and the right-eye image data into preset resolution, and then expanding the left-eye image data and the right-eye image data which are expanded into the preset resolution into the preset frame rate; if the 3D video source format is a left-right composite or an up-down composite, the left-eye image data and the right-eye image data are directly expanded to the preset frame rate.
In one embodiment, the splitting the interleaved 3D video data into left eye image data and right eye image data includes: if the format of the interleaved 3D video frame is left-right separation, splitting the interleaved 3D video data into left-eye image data and right-eye image data according to a line fetching flag corresponding to left-eye data or right-eye data for recording odd lines or even lines of each frame.
In this embodiment, split storage is performed according to the line-taking flag and the line effective length, for example, when the line-taking flag is 0, which indicates that the left-eye image takes the odd-eye line, the interleaved 3D video data is firstly cut according to the line effective length, the odd-eye line is stored in the left-eye memory area, and the even-eye line is stored in the right-eye memory area; when the line taking mark is 1, indicating that the left eye image takes even lines, firstly cutting the interweaved 3D video data according to the effective length of the lines, storing the odd lines into a right eye storage area, and storing the even lines into a left eye storage area; taking a 3D video with a resolution of 4096×2160 at 4k@24fps as an example, the stored result is shown in fig. 7.
In one embodiment, the splitting the interleaved 3D video data into left eye image data and right eye image data includes: if the format of the interleaved 3D video frame is a left-right composite or a top-bottom composite, splitting the interleaved 3D video data into left-eye image data and right-eye image data according to a preset sequence of reading left-eye data or reading right-eye data.
In one embodiment, the generating the second 3D video data of the preset resolution and the preset frame rate according to the second field sync data, the left eye image data, and the right eye image data includes: and if the format of the interleaved 3D video frame is left-right separation, the resolution of the left-eye image data and the right-eye image data is expanded to a preset resolution.
In the present embodiment, since the left-right separated 3D video source is subjected to interlace value processing on the transmitting card side and half of the data is discarded, the left-eye image and the right-eye image before expansion need to be subjected to resolution expansion on the receiving card side as shown in fig. 11 so that the resolution of the 3D video source format is the same as that of the other 3D video source formats.
In one embodiment, the expanding the resolution of the left eye image data and the right eye image data to a preset resolution includes: and expanding the resolution of the left-eye image data and the right-eye image data to a preset resolution through an intra-frame interpolation method.
In the present embodiment, in order to improve the image quality, the resolution expansion is performed by the intra interpolation method. The calculation method of the specific intra interpolation value is the same as that of the embodiment, please refer to the second embodiment, and the details are not repeated here.
Alternatively, pixels that are beyond the boundary during interpolation take significant boundary values. Specifically, the method for obtaining the effective boundary value for the pixels beyond the boundary is the same as that of the embodiment, please refer to the second embodiment, and the description thereof is omitted.
In one embodiment, the generating the second 3D video data of the preset resolution and the preset frame rate according to the second field sync data, the left eye image data, and the right eye image data includes: and expanding the left-eye image data and the right-eye image data to the preset frame rate through an inter-frame interpolation method.
In the present embodiment, in order to improve image quality, the left-eye image data and the right-eye image data are extended to the preset frame rate by an inter-frame interpolation method. The specific calculation method of the inter-frame interpolation is the same as that of the embodiment, please refer to the second embodiment, and the detailed description is omitted herein.
Optionally, during the inter-frame interpolation computation, image pixels outside the video range take significant boundary values. Specifically, the method for taking the effective boundary value of the image pixels beyond the video range is the same as that of the embodiment, and the details of the second embodiment are not described herein.
In one embodiment, if the 3D video source format is left-right split, the final interpolation result is obtained through inter-frame interpolation and intra-frame interpolation. The calculation method of the final interpolation result is the same as that of the embodiment, please refer to the second embodiment, and the details are not repeated here.
In one embodiment, if the 3D video source format is a left-right composite or a top-bottom composite, the image of the inserted frame is directly calculated by using an inter-frame interpolation method.
According to the display control method, the video synchronization frame and the interleaved 3D video frame are generated through analysis according to the communication frame received from the sending card of the display system; the frame rate of the video synchronization frame is increased to a preset frame rate, and second field synchronization data corresponding to the preset frame rate is generated; forming a final displayed target field synchronizing signal according to the second field synchronizing data; analyzing the interleaved 3D video frames to obtain interleaved 3D video data; splitting the interleaved 3D video data into left-eye image data and right-eye image data, and respectively storing the left-eye image data and the right-eye image data in a left-eye memory area and a right-eye memory area; reading left-eye image data and right-eye image data in an entire frame; generating second 3D video data with preset resolution and preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data; and outputting the second 3D video data to a display screen for display according to the target field synchronous signal. Therefore, the splitting, frame rate expansion and resolution unification of the interleaved 3D video are completed on the receiving card of the display system, the data volume of the 3D video received from the transmitting card of the display system is reduced, the utilization rate of the storage resource bandwidth of the receiving card is reduced, and the stability of the display system is improved; further, by receiving the interleaved 3D video frames, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between the receiving cards with a large number is solved. The 3D video source with various 3D video source formats and various frame rates can finish display data transmission processing and high-frame rate display in a display system based on lower cost.
Example five
The embodiment of the present invention also provides a computer readable storage medium, on which a display control program is stored, which when executed by a processor, implements the steps of the display control method described in the third embodiment or the fourth embodiment.
The computer readable storage medium of the embodiment of the present invention belongs to the same concept as the methods of the third embodiment and the fourth embodiment, and the specific implementation process is detailed in the corresponding method embodiment, and the technical features of the method embodiment are correspondingly applicable in the computer readable storage medium embodiment, which is not repeated herein.
The corresponding technical features in the above embodiments can be used mutually without causing contradiction between schemes or incapacitation.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.
Claims (9)
1. A transmission card of a display system, characterized in that the transmission card of the display system comprises:
the 3D video input analysis module is used for analyzing a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source;
The field synchronization signal capturing module is used for generating first field synchronization data according to the frame synchronization signal;
the first field synchronization framing module is used for generating a field synchronization frame according to the first field synchronization data;
a storage module for separately storing left-eye data and right-eye data after receiving the first 3D video data;
The 3D video segmentation reading module is used for alternately reading the left eye data and the right eye data according to rows so as to output interleaved 3D video data;
The group data frame transmitting module is used for generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and transmitting the video synchronization frame and the interlaced 3D video frame as a communication frame to a receiving card of a display system;
Wherein the alternately reading the left-eye data and the right-eye data in rows includes:
If the 3D video source format is left-right separated, alternately reading odd-even lines of the continuous left-eye data and the continuous right-eye data respectively, and alternately setting a line taking mark for recording the odd-numbered lines or even-numbered lines of each frame corresponding to the left-eye data or the right-eye data once every frame;
if the 3D video source format is of a left-right synthesis type or an up-down synthesis type, respectively reading the continuous left-eye data and the continuous right-eye data alternately;
Wherein, the receiving card of the display system includes:
The communication frame input analysis module is used for analyzing and generating a video synchronization frame and an interweaved 3D video frame according to the communication frame received from the sending card of the display system;
The frequency raising module is used for raising the frame rate of the video synchronization frame to a preset frame rate and generating second field synchronization data corresponding to the preset frame rate;
the second field synchronous framing module is used for forming a final displayed target field synchronous signal according to the second field synchronous data;
the 3D video input analysis module is used for analyzing the interleaved 3D video frames to obtain interleaved 3D video data;
The splitting storage module is used for splitting the interweaved 3D video data into left-eye image data and right-eye image data and respectively storing the left-eye image data and the right-eye image data in a left-eye storage area and a right-eye storage area;
The 3D video frame reading module is used for reading left-eye image data and right-eye image data in a whole frame;
the 3D video frame expansion module is used for generating second 3D video data with preset resolution and preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data;
the 3D video display and transmission module is used for outputting the second 3D video data to a display screen for display according to the target field synchronous signal;
Wherein splitting the interleaved 3D video data into left eye image data and right eye image data comprises:
If the format of the interleaved 3D video frame is left-right separation, splitting the interleaved 3D video data into left-eye image data and right-eye image data according to a line taking mark corresponding to left-eye data or right-eye data for recording odd lines or even lines of each frame;
If the format of the interleaved 3D video frame is a left-right composite or a top-bottom composite, splitting the interleaved 3D video data into left-eye image data and right-eye image data according to a preset sequence of reading left-eye data or reading right-eye data.
2. A display control method, characterized by being applied to the transmission card of the display system according to claim 1, the method comprising:
Analyzing a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source, wherein the 3D video source format comprises a left-right separation type, a left-right synthesis type and an up-down synthesis type;
Generating first field synchronous data according to the frame synchronous signal;
generating a field synchronization frame according to the first field synchronization data;
Storing left-eye data and right-eye data separately after receiving the first 3D video data;
alternately reading the left-eye data and the right-eye data by rows, thereby outputting interleaved 3D video data;
Generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame as a communication frame to a receiving card of a display system;
Wherein the alternately reading the left-eye data and the right-eye data in rows includes:
If the 3D video source format is left-right separated, alternately reading odd-even lines of the continuous left-eye data and the continuous right-eye data respectively, and alternately setting a line taking mark for recording the odd-numbered lines or even-numbered lines of each frame corresponding to the left-eye data or the right-eye data once every frame;
And if the 3D video source format is of a left-right composition formula or an up-down composition formula, respectively reading the continuous left-eye data and the continuous right-eye data alternately.
3. The display control method according to claim 2, wherein the technology type of the 3D video source includes a polarization type and a time division type.
4. The display control method according to claim 2, wherein if the 3D video source format is a left-right composition or a top-bottom composition, after alternately reading the continuous left-eye data and right-eye data, respectively, the method further comprises:
The order of reading the left-eye data or the right-eye data is preset, so that the receiving card of the display system analyzes and obtains the left-eye data and the right-eye data according to the preset order.
5. A display control method, characterized by being applied to a receiving card of the display system according to claim 1, the method comprising:
According to the communication frame received from the sending card of the display system, analyzing and generating a video synchronization frame and an interweaved 3D video frame;
the frame rate of the video synchronization frame is increased to a preset frame rate, and second field synchronization data corresponding to the preset frame rate is generated;
forming a final displayed target field synchronizing signal according to the second field synchronizing data;
analyzing the interleaved 3D video frames to obtain interleaved 3D video data;
splitting the interleaved 3D video data into left-eye image data and right-eye image data, and respectively storing the left-eye image data and the right-eye image data in a left-eye memory area and a right-eye memory area;
reading left-eye image data and right-eye image data in an entire frame;
Generating second 3D video data with preset resolution and preset frame rate according to the second field synchronous data, the left eye image data and the right eye image data;
outputting the second 3D video data to a display screen for display according to the target field synchronous signal;
Wherein splitting the interleaved 3D video data into left eye image data and right eye image data comprises:
If the format of the interleaved 3D video frame is left-right separation, splitting the interleaved 3D video data into left-eye image data and right-eye image data according to a line taking mark corresponding to left-eye data or right-eye data for recording odd lines or even lines of each frame;
If the format of the interleaved 3D video frame is a left-right composite or a top-bottom composite, splitting the interleaved 3D video data into left-eye image data and right-eye image data according to a preset sequence of reading left-eye data or reading right-eye data.
6. The display control method according to claim 5, wherein the generating the second 3D video data of the preset resolution, the preset frame rate, from the second field sync data, the left eye image data, and the right eye image data includes:
and if the format of the interleaved 3D video frame is left-right separation, the resolution of the left-eye image data and the right-eye image data is expanded to a preset resolution.
7. The display control method according to claim 6, wherein the expanding the resolutions of the left-eye image data and the right-eye image data to a preset resolution includes:
And expanding the resolution of the left-eye image data and the right-eye image data to a preset resolution through an intra-frame interpolation method.
8. The display control method according to any one of claims 5 to 7, wherein the generating second 3D video data of a preset resolution, the preset frame rate, from the second field sync data, left eye image data, and right eye image data includes:
and expanding the left-eye image data and the right-eye image data to the preset frame rate through an inter-frame interpolation method.
9. A computer-readable storage medium, on which a display control program is stored, which when executed by a processor, implements the steps of the display control method according to any one of claims 2 to 4, or the steps of the display control method according to any one of claims 5 to 8.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210053922.3A CN114422769B (en) | 2022-01-18 | 2022-01-18 | Transmitting card, receiving card, display control method and storage medium for display system |
PCT/CN2022/136061 WO2023138226A1 (en) | 2022-01-18 | 2022-12-02 | Sending card and receiving card for display system, display control method, and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210053922.3A CN114422769B (en) | 2022-01-18 | 2022-01-18 | Transmitting card, receiving card, display control method and storage medium for display system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114422769A CN114422769A (en) | 2022-04-29 |
CN114422769B true CN114422769B (en) | 2024-07-16 |
Family
ID=81272691
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210053922.3A Active CN114422769B (en) | 2022-01-18 | 2022-01-18 | Transmitting card, receiving card, display control method and storage medium for display system |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114422769B (en) |
WO (1) | WO2023138226A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114422769B (en) * | 2022-01-18 | 2024-07-16 | 深圳市洲明科技股份有限公司 | Transmitting card, receiving card, display control method and storage medium for display system |
CN116915965B (en) * | 2023-09-08 | 2023-12-22 | 北京小鸟科技股份有限公司 | System, method and electronic equipment for displaying 3D videos in different formats on same screen |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010133852A2 (en) * | 2009-05-21 | 2010-11-25 | British Broadcasting Corporation | An apparatus and method of transmitting three- dimensional video pictures via a two dimensional monoscopic video channel |
KR20110073212A (en) * | 2009-12-21 | 2011-06-29 | 삼성전자주식회사 | Display apparatus and control method of thereof |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5185819A (en) * | 1991-04-29 | 1993-02-09 | General Electric Company | Video signal compression apparatus for independently compressing odd and even fields |
JPH10174064A (en) * | 1996-12-06 | 1998-06-26 | Sanyo Electric Co Ltd | Digital broadcast system |
CN1480000A (en) * | 2000-10-12 | 2004-03-03 | ���ŷ� | 3D projection system and method with digital micromirror device |
US7034819B2 (en) * | 2002-10-04 | 2006-04-25 | Silicon Integrated Systems Corp. | Apparatus and method for generating an interleaved stereo image |
JP2011055148A (en) * | 2009-08-31 | 2011-03-17 | Toshiba Corp | Video combining device, video display apparatus, and video combining method |
JP5740885B2 (en) * | 2010-09-21 | 2015-07-01 | セイコーエプソン株式会社 | Display device and display method |
US9088777B2 (en) * | 2011-04-07 | 2015-07-21 | Ses Americom, Inc. | Methods and systems for processing stereoscopic video data |
CN203038640U (en) * | 2013-01-14 | 2013-07-03 | 成都博比科技产业发展有限公司 | LED large screen synchronous display system based on FPGA |
US10979689B2 (en) * | 2014-07-16 | 2021-04-13 | Arris Enterprises Llc | Adaptive stereo scaling format switch for 3D video encoding |
CN104243964A (en) * | 2014-09-12 | 2014-12-24 | 西安诺瓦电子科技有限公司 | Stereoscopic LED display control system and method and display control card |
CN104992666A (en) * | 2015-06-30 | 2015-10-21 | 苏州合欣美电子科技有限公司 | LED display screen anti-fault system |
US9747872B2 (en) * | 2015-07-13 | 2017-08-29 | Sct Technology, Ltd. | LED display device and method for operating the same |
US9704430B2 (en) * | 2015-07-13 | 2017-07-11 | Sct Technology, Ltd. | LED display device and method for operating the same |
CN107172368A (en) * | 2017-04-21 | 2017-09-15 | 西安诺瓦电子科技有限公司 | Many video source splicing display methods and processing unit and application, PLD |
US10593256B2 (en) * | 2018-03-22 | 2020-03-17 | Sct Ltd. | LED display device and method for operating the same |
US11048082B1 (en) * | 2018-04-13 | 2021-06-29 | Apple Inc. | Wireless bandwidth reduction with display data interleaving |
CN109151434B (en) * | 2018-10-26 | 2020-10-16 | 深圳市奥拓电子股份有限公司 | 3D display control method, system, storage medium and 3D display system |
CN112188182A (en) * | 2019-07-02 | 2021-01-05 | 西安诺瓦星云科技股份有限公司 | Stereoscopic display control system, stereoscopic display system and stereoscopic display controller |
CN213818022U (en) * | 2020-09-07 | 2021-07-27 | 中影巴可(北京)电子有限公司 | 3D LED film screen |
CN112599083B (en) * | 2020-12-24 | 2022-09-06 | 深圳市洲明科技股份有限公司 | Data transmission method, data receiving method, sending card and receiving card of display screen |
CN114422769B (en) * | 2022-01-18 | 2024-07-16 | 深圳市洲明科技股份有限公司 | Transmitting card, receiving card, display control method and storage medium for display system |
-
2022
- 2022-01-18 CN CN202210053922.3A patent/CN114422769B/en active Active
- 2022-12-02 WO PCT/CN2022/136061 patent/WO2023138226A1/en unknown
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010133852A2 (en) * | 2009-05-21 | 2010-11-25 | British Broadcasting Corporation | An apparatus and method of transmitting three- dimensional video pictures via a two dimensional monoscopic video channel |
KR20110073212A (en) * | 2009-12-21 | 2011-06-29 | 삼성전자주식회사 | Display apparatus and control method of thereof |
Also Published As
Publication number | Publication date |
---|---|
WO2023138226A1 (en) | 2023-07-27 |
CN114422769A (en) | 2022-04-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN114422769B (en) | Transmitting card, receiving card, display control method and storage medium for display system | |
US9961325B2 (en) | 3D caption display method and 3D display apparatus for implementing the same | |
CN1741621B (en) | Method of generating stereoscopic image signal and method of scaling the same | |
JP5230892B2 (en) | Stereo video sequence coding system and method | |
US20150341614A1 (en) | Stereoscopic video encoding device, stereoscopic video decoding device, stereoscopic video encoding method, stereoscopic video decoding method, stereoscopic video encoding program, and stereoscopic video decoding program | |
US20150009305A1 (en) | Method for displaying 3d caption and 3d display apparatus for implementing the same | |
US20110018966A1 (en) | Receiving Device, Communication System, Method of Combining Caption With Stereoscopic Image, Program, and Data Structure | |
KR101318711B1 (en) | Video image processing apparatus and method for controlling video image processing apparatus | |
US20140078248A1 (en) | Transmitting apparatus, transmitting method, receiving apparatus, and receiving method | |
CN102932664B (en) | Playing method of video of naked 3D (three-dimensional) television wall | |
US9088777B2 (en) | Methods and systems for processing stereoscopic video data | |
JP2004343290A (en) | Stereographic picture display device | |
KR20150095765A (en) | Apparatus and method for generating and rebuilding a video stream | |
EP2326096A2 (en) | 3D Image Display Apparatus and Display Method | |
US20120307153A1 (en) | Video processing device and video processing method | |
JP5682149B2 (en) | Stereo image data transmitting apparatus, stereo image data transmitting method, stereo image data receiving apparatus, and stereo image data receiving method | |
US20100165078A1 (en) | Image compression using checkerboard mosaic for luminance and chrominance color space images | |
US9723291B2 (en) | Apparatus and method for generating 3D video data | |
US9693033B2 (en) | Transmitting apparatus, transmitting method, receiving apparatus and receiving method for transmission and reception of image data for stereoscopic display using multiview configuration and container with predetermined format | |
JP2000308089A (en) | Stereoscopic image encoder and decoder | |
JP2003070022A (en) | Three-dimensional image compressing method, apparatus and system | |
US8896663B2 (en) | Transmitting device, receiving device, communication system and program | |
JP2003319417A (en) | Stereoscopic image generating device, stereoscopic image display device, and their methods | |
JP2013021683A (en) | Image signal processing device, image signal processing method, image display device, image display method, and image processing system | |
JP2015005807A (en) | Stereoscopic video encoding device, stereoscopic video decoding device, stereoscopic video encoding system, stereoscopic video encoding program and stereoscopic video decoding program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |