CN114422769A - Transmitting card, receiving card, display control method and storage medium of display system - Google Patents

Transmitting card, receiving card, display control method and storage medium of display system Download PDF

Info

Publication number
CN114422769A
CN114422769A CN202210053922.3A CN202210053922A CN114422769A CN 114422769 A CN114422769 A CN 114422769A CN 202210053922 A CN202210053922 A CN 202210053922A CN 114422769 A CN114422769 A CN 114422769A
Authority
CN
China
Prior art keywords
data
video
frame
eye image
eye
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210053922.3A
Other languages
Chinese (zh)
Inventor
黄斌
李永杰
刘世良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Zhouming Technology Co Ltd
Original Assignee
Shenzhen Zhouming Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Zhouming Technology Co Ltd filed Critical Shenzhen Zhouming Technology Co Ltd
Priority to CN202210053922.3A priority Critical patent/CN114422769A/en
Publication of CN114422769A publication Critical patent/CN114422769A/en
Priority to PCT/CN2022/136061 priority patent/WO2023138226A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/385Image reproducers alternating rapidly the location of the left-right image components on the display screens
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention discloses a sending card, a receiving card, a display control method and a storage medium of a display system, and belongs to the technical field of display system control. Wherein, this display system's sending card includes: the 3D video input analysis module, the field synchronization signal capture module, the first field synchronization framing module, the storage module, the 3D video segmentation reading module and the group data frame sending module complete 3D video interweaving on a sending card of the display system, so that the data volume of the 3D video needing to be sent to a receiving card of the display system is reduced, the storage resource bandwidth utilization rate of the receiving card is reduced, and the stability of the display system is improved; by generating the interleaved 3D video frame from the interleaved 3D video data, transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved.

Description

Transmitting card, receiving card, display control method and storage medium of display system
Technical Field
The present invention relates to the field of display system control technologies, and in particular, to a transmitting card, a receiving card, a display control method, and a storage medium for a display system.
Background
At present, the control technology of the LED cinema screen system is gradually formed and tends to be rich in functions, wherein the support of 3D film playing gradually becomes a popular market demand, and in addition, the good film viewing experience of 3D display of the LED display screen also provides a driving force for the development of the technology.
However, the LED 3D display has its particularity and problems to be solved specifically, for example, the frame-up scheme of 3D display mentioned in the patent with application number 202011183750.9, and the problem of screen flicker when the LED display screen is displayed in a full screen at a low frame rate is solved, but the practical application problem is not considered. Because the size of the LED screen is relatively large (the width of 10 meters or more), the pixel pitch of the LED screen is generally relatively large, and due to the limitation of the box body and the low scanning number of the LED screen, a large number of receiving cards may be provided, even if the above-described patent is adopted to place the frame-lifting processing unit into the receiving card, and a transmitting card is connected to the receiving card end, the number of ports still needs to be increased, or a single port needs to be connected to more receiving cards, which may bring a great challenge to the existing control system, and in addition, if the frame rate to be displayed is relatively high, for example, 4K @120fps or 8K @60fps is re-supported, the bandwidth utilization rate of the storage resource of the receiving card may be too high, thereby reducing the stability of the system. Synchronization issues between a larger number of receiving cards also place higher demands on frame packet design.
Disclosure of Invention
In view of the above, an embodiment of the present invention provides a sending card, a receiving card, a display control method and a storage medium for a display system, so as to at least solve the technical problems of the display system stability reduction caused by the too high bandwidth utilization of the storage resource of the receiving card and the synchronization among a large number of receiving cards.
The technical scheme adopted by the invention for solving the technical problems is as follows:
according to a first aspect of embodiments of the present invention, there is provided a transmitting card of a display system, the transmitting card of the display system including:
the 3D video input analysis module is used for analyzing a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source;
the field synchronization signal capturing module is used for generating first field synchronization data according to the frame synchronization signal;
the first field synchronization framing module is used for generating a field synchronization frame according to the first field synchronization data;
the storage module is used for separately storing the left eye data and the right eye data after receiving the first 3D video data;
a 3D video segmentation reading module for reading the left eye data and the right eye data alternately in rows, thereby outputting interleaved 3D video data;
and the group data frame sending module is used for generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame to a receiving card of a display system as communication frames.
According to a second aspect of embodiments of the present invention, there is provided a receiving card of a display system, the receiving card of the display system including:
the communication frame input analysis module is used for analyzing and generating a video synchronization frame and an interlaced 3D video frame according to a communication frame received from a sending card of the display system;
the frequency raising module is used for raising the frame rate of the video synchronous frame to a preset frame rate and generating second field synchronous data corresponding to the preset frame rate;
the second field synchronization framing module is used for forming a finally displayed target field synchronization signal according to the second field synchronization data;
the 3D video input analysis module is used for analyzing the interweaved 3D video frame to obtain interweaved 3D video data;
the splitting and storing module is used for splitting the interweaved 3D video data into left-eye image data and right-eye image data, and storing the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area respectively;
the 3D video frame reading module is used for reading left eye image data and right eye image data in a whole frame;
the 3D video frame expansion module is used for generating second 3D video data with preset resolution and frame rate according to the second field synchronization data, the left eye image data and the right eye image data;
and the 3D video display sending module is used for outputting the second 3D video data to a display screen for display according to the target field synchronizing signal.
According to a third aspect of the embodiments of the present invention, there is provided a display control method applied to a transmission card of the display system, the method including:
analyzing a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source;
generating first field synchronization data according to the frame synchronization signal;
generating a field sync frame according to the first field sync data;
storing left-eye data and right-eye data separately after receiving the first 3D video data;
alternately reading the left-eye data and the right-eye data by lines, thereby outputting interleaved 3D video data;
and generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame to a receiving card of a display system as communication frames.
According to a fourth aspect of the embodiments of the present invention, there is provided a display control method applied to a receiving card of the display system, the method including:
analyzing and generating a video synchronization frame and an interlaced 3D video frame according to a communication frame received from a transmitting card of a display system;
increasing the frame rate of the video synchronization frame to a preset frame rate, and generating second field synchronization data corresponding to the preset frame rate;
forming a final displayed target field synchronous signal according to the second field synchronous data;
analyzing the interlaced 3D video frame to obtain interlaced 3D video data;
splitting the interlaced 3D video data into left-eye image data and right-eye image data, and respectively storing the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area;
reading left eye image data and right eye image data in a whole frame;
generating second 3D video data with preset resolution and frame rate according to the second field synchronization data, the left eye image data and the right eye image data;
and outputting the second 3D video data to a display screen for displaying according to the target field synchronous signal.
According to a fifth aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a display control program that, when executed by a processor, implements the steps of the display control method of the third aspect described above, or implements the steps of the display control method of the fourth aspect described above.
According to the sending card, the receiving card, the display control method and the storage medium of the display system, 3D video interweaving is completed through the sending card of the display system, and the data volume of the 3D video needing to be transmitted to the receiving card of the display system is reduced, so that the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; by generating the interleaved 3D video frame from the interleaved 3D video data, transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The display data transmission processing and display of the 3D video source with various 3D video source formats and various frame rates can be completed in a display system based on lower cost.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
FIG. 1 is a diagram of an application scenario in which embodiments of the present invention are concerned;
fig. 2 is a schematic structural diagram of a display system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a left-right separation data format according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a data format of a left-right combination format according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating a data format of a top-bottom combination format according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a transmitting card of a display system according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a memory module according to an embodiment of the present invention storing left-eye data and right-eye data;
FIG. 8(a) is an effect diagram of interleaved 3D video data output by an embodiment of the present invention;
FIG. 8(b) is a diagram of an effect of outputting another interlaced 3D video data according to the embodiment of the present invention;
FIG. 9 is a diagram of still another interleaved 3D video data effect output by an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a receiving card of a display system according to an embodiment of the present invention;
FIG. 11 is a diagram of an effect of an image to be restored obtained by splitting according to an embodiment of the present invention;
FIG. 12 is a graph of interpolation coefficients versus number of interpolated frames according to an embodiment of the present invention;
FIG. 13 is a schematic diagram of inter-frame interpolation according to an embodiment of the present invention;
fig. 14 is a flowchart of a display control method according to an embodiment of the present invention;
fig. 15 is a flowchart of another display control method according to an embodiment of the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.
Example one
In order to at least partially solve the technical problems of the reduction of the stability of the display system caused by the over-high utilization rate of the storage resource bandwidth of the receiving cards and the synchronization among a large number of receiving cards, the embodiment provides a sending card of the display system. The sending card of the display system is suitable for a 3D display system, taking the display system as a cinema screen control system as an example, and fig. 1 is an application scene of the 3D display system according to the embodiment of the present invention. In the applicable scene, the film comes from a cinema video server or a PC machine with a film playing function, the server decodes the film and outputs a 12bit X ' Y ' Z ' code stream to a cinema screen control system, the code stream is firstly processed by a display sending processing unit (such as a sending card) of the cinema screen control system, then is processed and packaged and then is sent to a display receiving processing unit (such as a receiving card) of the cinema screen control system, and finally is output to a display unit (such as a 3D LED display screen) for video display.
Fig. 2 is a schematic structural diagram of a display system according to an embodiment of the present invention. Continuing with the example of a cinema screen control system, the cinema screen control system includes one or more transmitter cards, where a single transmitter card has n connectors, and each single connector has multiple receiver cards.
The 3D video source format suitable for the embodiment of the present invention includes a separation type and a synthesis type, where the separation type includes a left-right separation type, and the synthesis type includes a left-right synthesis type and an up-down synthesis type.
The data volume of various 3D video source formats is analyzed below for a 3D video with a resolution of 4096 × 2160 at 4K @24 fps. In the left-right split type 3D video, if the input video is viewed as a 2D video, 4K @48fps, and the left eye and the right eye are each 24fps, the input video is time-division cross-input, as shown in fig. 3, the data size of the 3D video source format is the largest in the current 3D video source format, and the data consumption transmission bandwidth is the highest. In the left and right composite 3D video, if the input video is viewed as a 2D video, the frame rate is 4K @24fps, and the resolution of both the left and right eyes is 2048 × 2160, which are combined to 4096 × 2160, as shown in fig. 4. In the vertical synthesized 3D video, if the input video is viewed as a 2D video, the frame rate is 4K @24fps, and the resolution of both the left and right eyes is 4096 × 1080, which in combination becomes 4096 × 2160, as shown in fig. 5.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a sending card of a display system according to an embodiment of the present invention. The transmitting card of the display system includes:
the 3D video input parsing module 601 is configured to parse a 3D video source format, first 3D video data, and a frame synchronization signal according to an input 3D video source;
a field sync signal capture module 602, configured to generate first field sync data according to the frame sync signal;
a first field sync framing module 603, configured to generate a field sync frame according to the first field sync data;
a storage module 604, configured to store left-eye data and right-eye data separately after receiving the first 3D video data;
a 3D video division reading module 605 for reading the left-eye data and the right-eye data alternately by rows, thereby outputting interleaved 3D video data;
a group data frame sending module 606, configured to generate a video synchronization frame according to the field synchronization frame, generate an interlaced 3D video frame according to the interlaced 3D video data, and send the video synchronization frame and the interlaced 3D video frame to a receiving card of a display system as communication frames.
Specifically, first, the 3D video input parsing module 601 parses the 3D video source format, the first 3D video data and the frame synchronization signal according to the input 3D video source, and outputs the first 3D video data to the storage module 604 and the frame synchronization signal to the field synchronization signal capturing module 602; then, the field sync signal capture module 602 generates first field sync data according to the frame sync signal, and outputs the first field sync data to the first field sync framing module 603; then, the first field sync framing module 603 generates a field sync frame according to the first field sync data, and outputs the field sync frame to the framing data frame sending module 606; then, after receiving the first 3D video data, the storage module 604 separately stores the left-eye data and the right-eye data according to the parsed 3D video source format, and the storage result is as shown in fig. 7 by taking a 3D video with a resolution of 4096 × 2160 at 4K @24fps as an example; then, the 3D video segmentation reading module 605 reads the left-eye data and the right-eye data stored in the storage module 604 alternately in lines, thereby outputting the interleaved 3D video data to the group data frame transmitting module 606; finally, the group data frame sending module 606 generates a video synchronization frame according to the field synchronization frame, generates an interlaced 3D video frame according to the interlaced 3D video data, and sends the video synchronization frame and the interlaced 3D video frame as communication frames to a receiving card of a display system. Therefore, 3D video interweaving is completed on a sending card of the display system, the data volume of the 3D video needing to be sent to a receiving card of the display system is reduced, the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; furthermore, by generating the interleaved 3D video frame by the interleaved 3D video data, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The display data transmission processing and display of the 3D video source with various 3D video source formats and various frame rates can be completed in a display system based on lower cost. As can be understood by those skilled in the art, after the 3D video input parsing module 601 parses the 3D video source format, the first 3D video data and the frame synchronization signal according to the input 3D video source, the field synchronization signal capturing module 602, the first field synchronization framing module 603, the storage module 604, and the 3D video segmentation reading module 605 may work simultaneously or sequentially to generate a field synchronization frame and interleave 3D video data respectively, and the sequence of the work is not limited in this embodiment. The alternately reading the left-eye data and the right-eye data by lines can be alternately reading the left-eye data and the right-eye data line by line, and can also be alternately reading the left-eye data and the right-eye data by line; the specific reading mode is determined according to the analyzed 3D video source format, if the 3D video source format is a left-right separation type, the left-eye data and the right-eye data are read alternately in an interlaced mode, and therefore the data volume of the 3D video needing to be transmitted to a receiving card of a display system is reduced by 50%; and if the 3D video source format is a left-right composite type or a top-bottom composite type, alternately reading the left-eye data and the right-eye data line by line to keep the data volume of the 3D video needing to be transmitted to the receiving card of the display system, so that the data volume of the 3D video needing to be transmitted to the receiving card of the display system in various video formats is the same.
In one embodiment, the alternately reading the left-eye data and the right-eye data by rows comprises: if the 3D video source format is a left-right separation type, reading the odd-even lines of the left-eye data and the right-eye data alternately and respectively, and setting a line taking mark for recording the odd-numbered lines or the even-numbered lines of each frame and corresponding to the left-eye data or the right-eye data, wherein the odd-numbered lines or the even-numbered lines of each frame alternate once per frame; and if the 3D video source format is a left-right composite type or an up-down composite type, reading the continuous left-eye data and the continuous right-eye data alternately and respectively.
In this embodiment, taking a 3D video with a resolution of 4096 × 2160 of 4K @24fps as an example, if the 3D video source format is left-right separation type, two consecutive left-right eye frames are alternately and respectively taken as odd-even lines, that is, left-right eye data are interlaced and interleaved, and are combined into a 3D video with a resolution of 4K, so as to reduce the data amount transmitted to the receiving card, and ensure that the data amount is consistent when each 3D video source format receives the receiving card. For example, the current frame reads odd lines in the left-eye data storage area first, then reads even lines in the right-eye data storage area, the next frame reads odd lines in the right-eye data storage area first, then reads even lines in the left-eye data storage area, and it is assumed that gray represents left-eye image line data and black represents right-eye image line data, when the frame number is an odd frame, the left-eye image takes the odd lines and the right-eye image takes the even lines as shown in fig. 8 (a); fig. 8(b) shows that when the frame number is an even frame, the left-eye image is an even line, and the right-eye image is an odd line. At this time, a line-taking flag of 0 may be set to indicate that the left-eye image takes odd lines, and a line-taking flag of 1 may be set to indicate that the left-eye image takes even lines. If the 3D video source format is left-right composite, the left-eye data and the right-eye data are alternately and respectively read, that is, the left-eye data and the right-eye data are interlaced line by line and combined into a 3D video with 4K resolution, as shown in fig. 9, so that the data amount of each 3D video source format is consistent when the card is received. And if the 3D video source format is a vertical synthesis type, reading the continuous left eye data and the continuous right eye data alternately, namely interleaving the left eye data and the right eye data line by line, and combining the left eye data and the right eye data into a 3D video with 4K resolution, so that the data volume is consistent when each 3D video source format receives the card.
Optionally, when the 3D video source format is preset to be a left-right composite type or a top-bottom composite type, the left-eye data is read first, or the right-eye data is read first, so that a receiving card of the display system analyzes the left-eye data and the right-eye data according to a preset sequence.
For example, the format of the video sync frame is shown in table 1.
Figure BDA0003475431130000081
TABLE 1 video synchronization frame Format
The description of the fields in the video sync frame is shown in table 2.
Figure BDA0003475431130000082
Figure BDA0003475431130000091
Table 2 field description of video sync frames
The format of the interleaved 3D video frames is shown in table 3.
Figure BDA0003475431130000092
Table 3 format of interleaved 3D video frames
A description of the fields in the interlaced 3D video frame is shown in table 4.
FH Frame header Identification of field synchronous communication frame type, 0x0
LINE Line taking mark Determining data location based on flags
WIDTH Width of Number of image pixels per line of storage area
COUNT Number of Total number of pixels
PN Pixel N +1 th pixel data, 36bit
CRC32 Check code 32-bit CRC check code
RFU Reservation Reserved byte with value 0x0
Table 4 description of fields in interlaced 3D video frames
The sending card of the display system of the embodiment of the invention comprises: the 3D video input parsing module 601 is configured to parse a 3D video source format, first 3D video data, and a frame synchronization signal according to an input 3D video source; a field sync signal capture module 602, configured to generate first field sync data according to the frame sync signal; a first field sync framing module 603, configured to generate a field sync frame according to the first field sync data; a storage module 604, configured to store left-eye data and right-eye data separately after receiving the first 3D video data; a 3D video division reading module 605 for reading the left-eye data and the right-eye data alternately by rows, thereby outputting interleaved 3D video data; a group data frame sending module 606, configured to generate a video synchronization frame according to the field synchronization frame, generate an interlaced 3D video frame according to the interlaced 3D video data, and send the video synchronization frame and the interlaced 3D video frame to a receiving card of a display system as communication frames. 3D video interweaving is completed on a sending card of the display system, so that the data volume of the 3D video needing to be sent to a receiving card of the display system is reduced, the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; by generating the interleaved 3D video frame from the interleaved 3D video data, transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The display data transmission processing and display of the 3D video source with various 3D video source formats and various frame rates can be completed in a display system based on lower cost.
Example two
In order to at least partially solve the technical problems of the reduction of the stability of the display system caused by the over-high utilization rate of the storage resource bandwidth of the receiving card and the synchronization among a large number of receiving cards, the embodiment provides a receiving card of the display system. The receiving card of the display system is suitable for a 3D display system, and the applicable scene and the related structure of the display system are the same as those in the first embodiment. Referring to fig. 10, fig. 10 is a schematic structural diagram of a receiving card of a display system according to an embodiment of the present invention. The receiving card of the display system includes:
a communication frame input parsing module 1001 for parsing to generate a video synchronization frame and an interlaced 3D video frame according to a communication frame received from a transmitting card of a display system;
the frequency raising module 1002 is configured to raise a frame rate of the video synchronization frame to a preset frame rate, and generate second field synchronization data corresponding to the preset frame rate;
a second field sync framing module 1003, configured to compose a final displayed target field sync signal according to the second field sync data;
a 3D video input parsing module 1004 for parsing the interleaved 3D video frames to obtain interleaved 3D video data;
a splitting storage module 1005, configured to split the interleaved 3D video data into left-eye image data and right-eye image data, and store the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area, respectively;
a 3D video frame reading module 1006, configured to read left-eye image data and right-eye image data in a whole frame;
a 3D video frame expansion module 1007, configured to generate second 3D video data with a preset resolution and a preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data;
and a 3D video display sending module 1008, configured to output the second 3D video data to a display screen for display according to the target field synchronization signal.
Specifically, first, the communication frame input parsing module 1001 parses a communication frame received from a transmission card of the display system to generate a video synchronization frame and an interlaced 3D video frame, outputs the video synchronization frame to the up-conversion module 1002, and outputs the interlaced 3D video frame to the 3D video input parsing module 1004; then, the frequency up-conversion module 1002 increases the frame rate of the video sync frame to a preset frame rate, generates second field sync data corresponding to the preset frame rate, and outputs the second field sync data to the second field sync framing module 1003; then, the second field sync framing module 1003 composes a final displayed target field sync signal according to the second field sync data, and outputs the target field sync signal to the 3D video display transmitting module 1008; then, the 3D video input parsing module 1004 parses the input interlaced 3D video frame to obtain interlaced 3D video data, and outputs the interlaced 3D video data to the splitting storage module 1005; then, the splitting storage module 1005 splits the interlaced 3D video data into left-eye image data and right-eye image data, and stores the left-eye image data and the right-eye image data in the left-eye image storage area and the right-eye image storage area, respectively; then, the 3D video frame reading module 1006 reads the left eye image data and the right eye image data in a whole frame, and outputs the read left eye image data and right eye image data to the 3D video frame expanding module 1007; then, the 3D video frame expansion module 1007 generates second 3D video data with a preset resolution and a preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data, and outputs the second 3D video data to the 3D video display transmission module 1008; finally, the 3D video display sending module 1008 outputs the second 3D video data to a display screen for display according to the target field synchronization signal. Therefore, the splitting, frame rate expansion and resolution unification of the interlaced 3D video are finished at the receiving card of the display system, and the data volume of the 3D video received from the sending card of the display system is reduced, so that the bandwidth utilization rate of the storage resource of the receiving card is reduced, and the stability of the display system is improved; furthermore, by receiving the interleaved 3D video frames, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The display data transmission processing and high frame rate display of the 3D video sources with various 3D video source formats and various frame rates can be completed in a display system based on lower cost. As can be understood by those skilled in the art, after the communication frame input parsing module 1001 parses the communication frame received from the transmitting card of the display system to generate the video synchronization frame and the interleaved 3D video frame, the frequency-up module 1002, the 3D video input parsing module 1004, and the splitting storage module 1005 may work simultaneously or sequentially, and the sequence of the work is not limited in this embodiment. Wherein the raising the frame rate of the video synchronization frame to a preset frame rate comprises: the frame rate of the video synchronization frame is increased to the frame rate of the video data output by the receiving card to the display screen, for example, two frame rates of 24fps and 48fps are respectively increased by 6 times and 3 times to reach the frame rate of 144 fps. Splitting the interleaved 3D video data into left-eye image data and right-eye image data, and storing the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area, respectively, includes: according to a line-fetching mark for recording odd lines or even lines of each frame and corresponding to left-eye data or right-eye data or a preset sequence for reading left-eye image data and right-eye image data and the effective line length of each line, the interleaved 3D video data is divided into left-eye image data and right-eye image data, and the left-eye image data and the right-eye image data are respectively stored in a left-eye image storage area and a right-eye image storage area, and the storage result is shown in fig. 7 by taking a 3D video with a resolution of 4096 × 2160 as an example. Generating second 3D video data with a preset resolution and a preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data includes: if the 3D video source format is a left-right separation type, firstly expanding the left eye image data and the right eye image data to a preset resolution, and then expanding the left eye image data and the right eye image data expanded to the preset resolution to the preset frame rate; and if the 3D video source format is a left-right synthetic type or a top-bottom synthetic type, directly expanding the left-eye image data and the right-eye image data to the preset frame rate. The preset resolution may be 4096 × 2160 or other resolutions, and the specific value is not limited in this embodiment. The preset frame rate may be 144fps, or other frame rates, and the specific value is not limited in this embodiment.
In one embodiment, the splitting the interleaved 3D video data into left-eye image data and right-eye image data comprises: and if the format of the interlaced 3D video frame is in a left-right separation type, splitting the interlaced 3D video data into left-eye image data and right-eye image data according to a line-taking mark for recording odd lines or even lines of each frame and corresponding to the left-eye data or the right-eye data.
In this embodiment, split storage is performed according to the line fetching mark and the line effective length, for example, when the line fetching mark is 0, which indicates that the left-eye image fetches the odd lines, the interlaced 3D video data is first intercepted according to the line effective length, the odd lines are stored in the left-eye image storage area, and the even lines are stored in the right-eye image storage area; when the line-taking mark is 1, the left-eye image is shown to take even lines, firstly, the interlaced 3D video data is intercepted according to the effective length of the lines, the odd lines are stored in the right-eye image storage area, and the even lines are stored in the left-eye image storage area; taking a 3D video with a resolution of 4096 × 2160 at 4K @24fps as an example, the storage results are shown in fig. 7.
In one embodiment, the splitting the interleaved 3D video data into left-eye image data and right-eye image data comprises: and if the format of the interlaced 3D video frame is a left-right composite type or a top-bottom composite type, splitting the interlaced 3D video data into left-eye image data and right-eye image data according to a preset sequence of reading left-eye data first or reading right-eye data first.
In one embodiment, the generating the second 3D video data at the preset resolution and the preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data includes: and if the format of the interlaced 3D video frame is a left-right separation type, expanding the resolution of the left-eye image data and the right-eye image data to a preset resolution.
In the present embodiment, since the left-right separation type 3D video source is interlaced on the transmitting card side and half of the data is discarded, the left-eye image and the right-eye image before resolution expansion are shown in fig. 11, where blank lines in FL1-FL4 and FR1-FR4 indicate pixels to be expanded, and it is necessary to perform resolution expansion on the receiving card side so that the resolution of the 3D video source format is the same as the resolution of the other 3D video source formats.
In one embodiment, the expanding the resolution of the left eye image data and the right eye image data to a preset resolution includes: and expanding the resolution of the left eye image data and the right eye image data to a preset resolution by an intra-frame interpolation method.
In the present embodiment, in order to improve image quality, resolution extension is performed by an intra interpolation method. Specifically, the intra-frame interpolation method is to use the pixel average value of the corresponding column positions of the previous row and the next row of images in the current row space, for example, the position of the extended target pixel point P is (i, j), where i is a horizontal coordinate value and j is a vertical coordinate value, then the intra-frame interpolation can be written as the following formula:
Figure BDA0003475431130000131
wherein, picu (i, j) represents the intra-frame interpolation result of the ith column and jth row pixel of the current frame, Pcur (i, j-1) represents the pixel value of the ith column and jth row pixel of the current frame, and Pcur (i, j +1) represents the pixel value of the ith column and jth +1 row pixel of the current frame.
Optionally, during intra interpolation computation, pixels beyond the boundary take on valid boundary values. Taking an example of taking an odd line of the left-eye image from the first frame, discarding the even line of the left-eye image from the first frame, discarding the odd line of the right-eye image, when the data of the first line is restored from the right-eye image, Pcur (i, j-1) is not existed, and at this time, Pcur (i, j-1) is made to be equal to Pcur (i, j +1), because Pcur (i, j) is a pixel to be restored and is regarded as an invalid boundary, similarly, the bottom boundary processing is the same, and Pcur (i, j +1) is not existed, and thus, Pcur (i, j +1) is made to be equal to Pcur (i, j-1).
In one embodiment, the generating the second 3D video data at the preset resolution and the preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data includes: and expanding the left eye image data and the right eye image data to the preset frame rate by an inter-frame interpolation method.
In the present embodiment, in order to improve image quality, the left eye image data and the right eye image data are extended to the preset frame rate by an inter-frame interpolation method. Specifically, the interframe interpolation formula is as follows:
Figure BDA0003475431130000141
wherein PI (i, j) represents an inter-frame interpolation result of ith and jth pixels, Pprev (i, j) represents ith and jth pixel values of a previous frame, Pnext (i, j) represents ith and jth pixel values of a next frame, n is a frame number of a current insertion frame, and is calculated from 0 to 2 times of a frame rate expansion multiple k, that is, n belongs to [0, 2 ] k, m is 2 k-n, taking a preset frame rate as 144fps as an example, if the frame rate of the video synchronization frame is 24fps or 48fps, a value (144/24 or 144/48) of k is 6 or 3, and the up-conversion module 1002 calculates the k value through the preset frame rate.
Alternatively, during the inter-frame interpolation calculation, the image pixels beyond the video range take valid boundary values. For example, Pprev (i, j) does not exist in the first frame, and in this case, Pprev (i, j) is made to be Pnext (i, j), and Pnext (i, j) is made to be Pprev (i, j) in the last frame.
In one embodiment, if the 3D video source format is left-right separation, the final interpolation result after the inter-frame interpolation and the intra-frame interpolation can be written as:
Figure BDA0003475431130000142
the final interpolation result includes frame rate extension processing, where n1 ═ k- | k-n |, and m1 ═ 2 ═ k-n1, as shown in fig. 12, the interpolation coefficients are biased toward inter-frame interpolation, the head and tail of the inserted frame completely adopt inter-frame interpolation, and the interpolation coefficients of the intermediate frames of the inserted frame are equal; in the resolution expansion process, when n is a special case of k, it indicates that the pixel value of the n-th frame insertion frame is calculated when n is another value. Fig. 13 is a schematic diagram of inter-frame interpolation with a frame rate expansion multiple k of 3, where a gray circle represents a line of data existing in one frame of image, a white circle represents a line of data to be restored in one frame of image, each line of data of one frame of image is represented from top to bottom, and the video frame situation is represented from left to right. Taking the P point to be restored as an example, the P point frame interpolation value uses the data of the column position where the two lines of data of L1 and L3 are the same, and is calculated by substituting formula 1, namely L1 ═ Pcur (i, j-1), L3 ═ Pcur (i, j + 1); there are 7P-point frame interpolation results, which are L2, IL1, IL2, IL3(P), IL4, IL5, and L4 in fig. 13, respectively, where L2 and L4 directly obtain actual pixel values without calculation, and the result can also be obtained by substituting n-0 and n-6 into equation 3.
In one embodiment, if the 3D video source format is a left-right composite formula or a top-bottom composite formula, the extended frame rate processing directly uses formula 2, where Pprev (i, j) and Pnext (i, j) represent ith column and jth row pixel values of two adjacent frames, and the calculation result is an image of an interpolated frame.
The receiving card of the display system of the embodiment of the invention comprises: a communication frame input parsing module 1001 for parsing to generate a video synchronization frame and an interlaced 3D video frame according to a communication frame received from a transmitting card of a display system; the frequency raising module 1002 is configured to raise a frame rate of the video synchronization frame to a preset frame rate, and generate second field synchronization data corresponding to the preset frame rate; a second field sync framing module 1003, configured to compose a final displayed target field sync signal according to the second field sync data; a 3D video input parsing module 1004 for parsing the interleaved 3D video frames to obtain interleaved 3D video data; a splitting storage module 1005, configured to split the interleaved 3D video data into left-eye image data and right-eye image data, and store the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area, respectively; a 3D video frame reading module 1006, configured to read left-eye image data and right-eye image data in a whole frame; a 3D video frame expansion module 1007, configured to generate second 3D video data with a preset resolution and a preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data; and a 3D video display sending module 1008, configured to output the second 3D video data to a display screen for display according to the target field synchronization signal. Therefore, the splitting, frame rate expansion and resolution unification of the interlaced 3D video are finished at the receiving card of the display system, and the data volume of the 3D video received from the sending card of the display system is reduced, so that the bandwidth utilization rate of the storage resource of the receiving card is reduced, and the stability of the display system is improved; furthermore, by receiving the interleaved 3D video frames, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The display data transmission processing and high frame rate display of the 3D video sources with various 3D video source formats and various frame rates can be completed in a display system based on lower cost.
EXAMPLE III
Fig. 14 is a flowchart of a display control method according to an embodiment of the present invention. The process in this embodiment is executed by the sending card of the display system in the first embodiment, where each step may be executed sequentially according to a sequence in the flowchart, or multiple steps may be executed simultaneously according to an actual situation, and this is not limited herein. The display control method includes:
step S1401, parsing the 3D video source format, the first 3D video data, and the frame synchronization signal according to the input 3D video source.
Step S1402 generates first field sync data according to the frame sync signal.
Step S1403, a field sync frame is generated from the first field sync data.
In step S1404, left-eye data and right-eye data are separately stored after receiving the first 3D video data.
Step S1405, reading the left-eye data and the right-eye data alternately by lines, thereby outputting interleaved 3D video data.
Step S1406, generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame as communication frames to a receiving card of a display system.
In this embodiment, it should be noted that the 3D implementation technology types applicable to the embodiment of the present invention include polarization type and time-sharing type (i.e., active shutter type), and the 3D video source format applicable to the embodiment of the present invention includes separation type and synthesis type, where the separation type includes left-right separation type, and the synthesis type includes left-right synthesis type and up-down synthesis type.
Specifically, firstly, a sending card of the display system analyzes a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source; then, generating first field synchronization data according to the frame synchronization signal; then, generating a field synchronous frame according to the first field synchronous data; then, according to the analyzed 3D video source format and the first 3D video data, storing the left-eye data and the right-eye data separately, taking a 3D video with a resolution of 4096 × 2160 at 4K @24fps as an example, and storing the result as shown in fig. 7; then, alternately reading the left-eye data and the right-eye data in rows, thereby outputting interlaced 3D video data; and finally, generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame to a receiving card of a display system as communication frames. Therefore, 3D video interweaving is completed on a sending card of the display system, the data volume of the 3D video needing to be sent to a receiving card of the display system is reduced, the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; furthermore, by generating the interleaved 3D video frame by the interleaved 3D video data, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The display data transmission processing and display of the 3D video source with various 3D video source formats and various frame rates can be completed in a display system based on lower cost. As can be understood by those skilled in the art, after parsing the 3D video source format, the first 3D video data, and the frame synchronization signal according to the input 3D video source, the steps of generating the field synchronization frame and generating the interlaced 3D video data may be performed simultaneously or sequentially, and the generation order is not limited in this embodiment. The alternately reading the left-eye data and the right-eye data by lines can be alternately reading the left-eye data and the right-eye data line by line, and can also be alternately reading the left-eye data and the right-eye data by line; the specific reading mode is determined according to the analyzed 3D video source format, if the 3D video source format is a left-right separation type, the left-eye data and the right-eye data are read alternately in an interlaced mode, and therefore the data volume of the 3D video needing to be transmitted to a receiving card of a display system is reduced by 50%; and if the 3D video source format is a left-right composite type or a top-bottom composite type, alternately reading the left-eye data and the right-eye data line by line to keep the data volume of the 3D video needing to be transmitted to the receiving card of the display system, so that the data volume of the 3D video needing to be transmitted to the receiving card of the display system in various video formats is the same.
In one embodiment, the alternately reading the left-eye data and the right-eye data by rows comprises: if the 3D video source format is a left-right separation type, reading the odd-even lines of the left-eye data and the right-eye data alternately and respectively, and setting a line taking mark for recording the odd-numbered lines or the even-numbered lines of each frame and corresponding to the left-eye data or the right-eye data, wherein the odd-numbered lines or the even-numbered lines of each frame alternate once per frame; and if the 3D video source format is a left-right composite type or an up-down composite type, reading the continuous left-eye data and the continuous right-eye data alternately and respectively.
In this embodiment, taking a 3D video with a resolution of 4096 × 2160 of 4K @24fps as an example, if the 3D video source format is left-right separation type, two consecutive left-right eye frames are alternately and respectively taken as odd-even lines, that is, left-right eye data are interlaced and interleaved, and then combined into a 3D video with a resolution of 4K, so as to reduce the data amount transmitted to the receiving card and ensure that the data amount is consistent when each 3D video source format receives the receiving card. For example, the current frame reads odd lines in the left-eye data storage area first, then reads even lines in the right-eye data storage area, the next frame reads odd lines in the right-eye data storage area first, then reads even lines in the left-eye data storage area, and it is assumed that gray represents left-eye image line data and black represents right-eye image line data, when the frame number is an odd frame, the left-eye image takes the odd lines and the right-eye image takes the even lines as shown in fig. 8 (a); fig. 8(b) shows that when the frame number is an even frame, the left-eye image is an even line, and the right-eye image is an odd line. At this time, a line-taking flag of 0 may be set to indicate that the left-eye image takes odd lines, and a line-taking flag of 1 may be set to indicate that the left-eye image takes even lines. If the 3D video source format is left-right composite, the left-eye data and the right-eye data are read alternately and respectively, that is, the left-eye data and the right-eye data are interlaced line by line, as shown in fig. 9, so that it is ensured that the data amount is consistent when each 3D video source format receives the card. And if the 3D video source format is a vertical synthesis type, reading the continuous left eye data and the continuous right eye data alternately and respectively, namely interleaving the left eye data and the right eye data line by line, so that the data volume is consistent when each 3D video source format receives a card.
Optionally, if the 3D video source format is a left-right composite type or a top-bottom composite type, after reading the continuous left-eye data and the continuous right-eye data alternately and respectively, the method further includes: the order of reading the left-eye data or the right-eye data is preset, so that a receiving card of the display system analyzes and obtains the left-eye data and the right-eye data according to the preset order. Specifically, when the 3D video source format is preset to be a left-right composite type or a top-bottom composite type, the left-eye data is read first, or the right-eye data is read first, so that the receiving card analyzes the left-eye data and the right-eye data according to a preset sequence.
Optionally, the communication frame comprises a line active length representing a number of line pixels.
For example, the communication frame includes a video synchronization frame and an interlaced 3D video frame, the format of the video synchronization frame is shown in table 1, the description of each field in the video synchronization frame is shown in table 2, the format of the interlaced 3D video frame is shown in table 3, and the description of each field in the interlaced 3D video frame is shown in table 4. The communication frame includes a line active length representing a number of line pixels such that a receiving card of the display system splits the interlaced 3D video frame accordingly.
According to the display control method in the embodiment of the invention, the 3D video source format, the first 3D video data and the frame synchronization signal are analyzed according to the input 3D video source; generating first field synchronization data according to the frame synchronization signal; generating a field sync frame according to the first field sync data; storing left-eye data and right-eye data separately after receiving the first 3D video data; alternately reading the left-eye data and the right-eye data by lines, thereby outputting interleaved 3D video data; and generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame to a receiving card of a display system as communication frames. 3D video interweaving is completed on a sending card of the display system, so that the data volume of the 3D video needing to be sent to a receiving card of the display system is reduced, the bandwidth utilization rate of storage resources of the receiving card is reduced, and the stability of the display system is improved; furthermore, the interlaced 3D video frame is generated by the interlaced 3D video data, so that the transmission delay among the receiving cards of the display system is reduced, and the technical problem of synchronization among a large number of receiving cards is solved. The display data transmission processing and display of the 3D video source with various 3D video source formats and various frame rates can be completed in a display system based on lower cost.
Example four
Fig. 15 is a flowchart of another display control method according to an embodiment of the present invention. The process in this embodiment is executed through the receiving card of the display system in the second embodiment, where each step may be executed sequentially according to a sequence in the flowchart, or multiple steps may be executed simultaneously according to an actual situation, and this is not limited herein. The display control method includes:
in step S1501, a video synchronization frame and an interlaced 3D video frame are generated by parsing based on a communication frame received from a transmission card of a display system.
Step S1502, increasing the frame rate of the video synchronization frame to a preset frame rate, and generating second field synchronization data corresponding to the preset frame rate.
And step S1503, forming a final displayed target field sync signal according to the second field sync data.
Step S1504, analyzing the interlaced 3D video frame to obtain interlaced 3D video data.
In step S1505, the 3D interleaved video data is divided into left-eye image data and right-eye image data, and stored in the left-eye image storage region and the right-eye image storage region, respectively.
In step S1506, the left-eye image data and the right-eye image data are read for the entire frame.
Step S1507, generating second 3D video data with a preset resolution and a preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data.
Step S1508, outputting the second 3D video data to a display screen for displaying according to the target field sync signal.
Specifically, firstly, a receiving card of the display system analyzes and generates a video synchronization frame and an interlaced 3D video frame according to a communication frame received from a transmitting card of the display system; then, the frame rate of the video synchronization frame is increased to a preset frame rate, and second field synchronization data corresponding to the preset frame rate are generated; then, forming a final displayed target field synchronous signal according to the second field synchronous data; then, analyzing the interlaced 3D video frame to obtain interlaced 3D video data; then, splitting the interweaved 3D video data into left-eye image data and right-eye image data, and respectively storing the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area; then, reading left eye image data and right eye image data in a whole frame; then, generating second 3D video data with preset resolution and frame rate according to the second field synchronization data, the left eye image data and the right eye image data; and finally, outputting the second 3D video data to a display screen for displaying according to the target field synchronous signal. Therefore, the splitting, frame rate expansion and resolution unification of the interlaced 3D video are finished at the receiving card of the display system, and the data volume of the 3D video received from the sending card of the display system is reduced, so that the bandwidth utilization rate of the storage resource of the receiving card is reduced, and the stability of the display system is improved; furthermore, by receiving the interleaved 3D video frames, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The display data transmission processing and high frame rate display of the 3D video sources with various 3D video source formats and various frame rates can be completed in a display system based on lower cost. As will be understood by those skilled in the art, after parsing to generate the video synchronization frame and the interleaved 3D video frame according to the communication frame received from the transmitting card of the display system, the step S1502 and the steps S1504 to S1506 may be executed simultaneously or sequentially, and the operation order is not limited in this embodiment. Wherein the raising the frame rate of the video synchronization frame to a preset frame rate comprises: the frame rate of the video synchronization frame is increased to the frame rate of the video data output by the receiving card to the display screen, for example, the frame rates of 24fps and 48fps are increased by 6 times and 3 times respectively to reach the frame rate of 144 fps. Splitting the interleaved 3D video data into left-eye image data and right-eye image data, and storing the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area, respectively, includes: according to a line-fetching mark for recording odd lines or even lines of each frame corresponding to left-eye data or right-eye data or a preset order of reading left-eye image data and right-eye image data and a line effective length, the interlaced 3D video data is divided into left-eye image data and right-eye image data, and the left-eye image data and the right-eye image data are respectively stored in a left-eye image storage area and a right-eye image storage area, and the storage result is shown in fig. 7 by taking a 3D video with a resolution of 4096 × 2160 as an example. Generating second 3D video data with a preset resolution and a preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data includes: if the 3D video source format is a left-right separation type, firstly expanding the left eye image data and the right eye image data to a preset resolution, and then expanding the left eye image data and the right eye image data expanded to the preset resolution to the preset frame rate; and if the 3D video source format is a left-right synthetic type or a top-bottom synthetic type, directly expanding the left-eye image data and the right-eye image data to the preset frame rate.
In one embodiment, the splitting the interleaved 3D video data into left-eye image data and right-eye image data comprises: and if the format of the interlaced 3D video frame is in a left-right separation type, splitting the interlaced 3D video data into left-eye image data and right-eye image data according to a line-taking mark for recording odd lines or even lines of each frame and corresponding to the left-eye data or the right-eye data.
In this embodiment, split storage is performed according to the line fetching mark and the line effective length, for example, when the line fetching mark is 0, which indicates that the left-eye image fetches the odd lines, the interlaced 3D video data is first intercepted according to the line effective length, the odd lines are stored in the left-eye image storage area, and the even lines are stored in the right-eye image storage area; when the line-taking mark is 1, the left-eye image is shown to take even lines, firstly, the interlaced 3D video data is intercepted according to the effective length of the lines, the odd lines are stored in the right-eye image storage area, and the even lines are stored in the left-eye image storage area; taking a 3D video with a resolution of 4096 × 2160 at 4K @24fps as an example, the storage results are shown in fig. 7.
In one embodiment, the splitting the interleaved 3D video data into left-eye image data and right-eye image data comprises: and if the format of the interlaced 3D video frame is a left-right composite type or a top-bottom composite type, splitting the interlaced 3D video data into left-eye image data and right-eye image data according to a preset sequence of reading left-eye data first or reading right-eye data first.
In one embodiment, the generating the second 3D video data at the preset resolution and the preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data includes: and if the format of the interlaced 3D video frame is a left-right separation type, expanding the resolution of the left-eye image data and the right-eye image data to a preset resolution.
In the present embodiment, since the left-right separation type 3D video source is subjected to the interlace value processing on the transmitting card side, and half of the data is discarded, the left-eye image and the right-eye image before expansion need to be subjected to resolution expansion on the receiving card side as shown in fig. 11, so that the resolution of the 3D video source format is the same as the resolution of the other 3D video source formats.
In one embodiment, the expanding the resolution of the left eye image data and the right eye image data to a preset resolution includes: and expanding the resolution of the left eye image data and the right eye image data to a preset resolution by an intra-frame interpolation method.
In the present embodiment, in order to improve image quality, resolution extension is performed by an intra interpolation method. The specific intra-frame interpolation calculation method is the same as that in the second embodiment, and please refer to the second embodiment for details, which are not described herein again.
Optionally, the pixels that exceed the boundary during the interpolation calculation take valid boundary values. Specifically, the method for obtaining the effective boundary value of the pixel beyond the boundary is the same as the embodiment, and please refer to embodiment two for details, which are not described herein again.
In one embodiment, the generating the second 3D video data at the preset resolution and the preset frame rate according to the second field synchronization data, the left eye image data, and the right eye image data includes: and expanding the left eye image data and the right eye image data to the preset frame rate by an inter-frame interpolation method.
In the present embodiment, in order to improve image quality, the left eye image data and the right eye image data are extended to the preset frame rate by an inter-frame interpolation method. The specific calculation method of the inter-frame interpolation is the same as that of the second embodiment, and please refer to the second embodiment specifically, which is not described herein again.
Alternatively, during the inter-frame interpolation calculation, the image pixels beyond the video range take valid boundary values. Specifically, the method for obtaining the valid boundary value for the image pixel beyond the video range is the same as the embodiment, and please refer to embodiment two for details, which are not described herein again.
In one embodiment, if the 3D video source format is left-right separation, the final interpolation result is obtained through inter-frame interpolation and intra-frame interpolation. The specific calculation method of the final interpolation result is the same as that of the embodiment two, and please refer to the embodiment two specifically, which is not described herein again.
In one embodiment, if the 3D video source format is a left-right composite type or a top-bottom composite type, the image of the inserted frame is calculated directly by an inter-frame interpolation method.
In the display control method in the embodiment of the invention, a video synchronization frame and an interlaced 3D video frame are generated by analyzing according to a communication frame received from a sending card of a display system; increasing the frame rate of the video synchronization frame to a preset frame rate, and generating second field synchronization data corresponding to the preset frame rate; forming a final displayed target field synchronous signal according to the second field synchronous data; analyzing the interlaced 3D video frame to obtain interlaced 3D video data; splitting the interlaced 3D video data into left-eye image data and right-eye image data, and respectively storing the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area; reading left eye image data and right eye image data in a whole frame; generating second 3D video data with preset resolution and frame rate according to the second field synchronization data, the left eye image data and the right eye image data; and outputting the second 3D video data to a display screen for displaying according to the target field synchronous signal. Therefore, the splitting, frame rate expansion and resolution unification of the interlaced 3D video are finished at the receiving card of the display system, and the data volume of the 3D video received from the sending card of the display system is reduced, so that the bandwidth utilization rate of the storage resource of the receiving card is reduced, and the stability of the display system is improved; furthermore, by receiving the interleaved 3D video frames, the transmission delay between the receiving cards of the display system is reduced, and the technical problem of synchronization between a large number of receiving cards is solved. The display data transmission processing and high frame rate display of the 3D video sources with various 3D video source formats and various frame rates can be completed in a display system based on lower cost.
EXAMPLE five
An embodiment of the present invention further provides a computer-readable storage medium, where a display control program is stored on the computer-readable storage medium, and the display control program, when executed by a processor, implements the steps of the display control method according to the third embodiment or the fourth embodiment.
The computer-readable storage medium of the embodiment of the present invention and the methods of the third embodiment and the fourth embodiment belong to the same concept, and specific implementation processes thereof are detailed in the corresponding method embodiments, and technical features in the method embodiments are correspondingly applicable in the computer-readable storage medium embodiments, and are not described herein again.
The corresponding technical features in the above embodiments may be used with each other without causing contradiction in the schemes or without being implementable.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (16)

1. A transmitter card of a display system, comprising:
the 3D video input analysis module is used for analyzing a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source;
the field synchronization signal capturing module is used for generating first field synchronization data according to the frame synchronization signal;
the first field synchronization framing module is used for generating a field synchronization frame according to the first field synchronization data;
the storage module is used for separately storing the left eye data and the right eye data after receiving the first 3D video data;
a 3D video segmentation reading module for reading the left eye data and the right eye data alternately in rows, thereby outputting interleaved 3D video data;
and the group data frame sending module is used for generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame to a receiving card of a display system as communication frames.
2. A receiving card for a display system, the receiving card comprising:
the communication frame input analysis module is used for analyzing and generating a video synchronization frame and an interlaced 3D video frame according to a communication frame received from a sending card of the display system;
the frequency raising module is used for raising the frame rate of the video synchronous frame to a preset frame rate and generating second field synchronous data corresponding to the preset frame rate;
the second field synchronization framing module is used for forming a finally displayed target field synchronization signal according to the second field synchronization data;
the 3D video input analysis module is used for analyzing the interweaved 3D video frame to obtain interweaved 3D video data;
the splitting and storing module is used for splitting the interweaved 3D video data into left-eye image data and right-eye image data, and storing the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area respectively;
the 3D video frame reading module is used for reading left eye image data and right eye image data in a whole frame;
the 3D video frame expansion module is used for generating second 3D video data with preset resolution and frame rate according to the second field synchronization data, the left eye image data and the right eye image data;
and the 3D video display sending module is used for outputting the second 3D video data to a display screen for display according to the target field synchronizing signal.
3. A display control method, characterized in that, applied to a transmission card of the display system according to claim 1, the method comprises:
analyzing a 3D video source format, first 3D video data and a frame synchronization signal according to an input 3D video source;
generating first field synchronization data according to the frame synchronization signal;
generating a field sync frame according to the first field sync data;
storing left-eye data and right-eye data separately after receiving the first 3D video data;
alternately reading the left-eye data and the right-eye data by lines, thereby outputting interleaved 3D video data;
and generating a video synchronization frame according to the field synchronization frame, generating an interlaced 3D video frame according to the interlaced 3D video data, and sending the video synchronization frame and the interlaced 3D video frame to a receiving card of a display system as communication frames.
4. The display control method according to claim 3, wherein the technology types of the 3D video source include polarization type and time-sharing type.
5. The display control method according to claim 3, wherein the 3D video source format includes a left-right separation type, a left-right combination type, and a top-bottom combination type.
6. The display control method according to claim 5, wherein the alternately reading the left-eye data and the right-eye data by rows comprises:
if the 3D video source format is a left-right separation type, reading the odd-even lines of the left-eye data and the right-eye data alternately and respectively, and setting a line taking mark for recording the odd-numbered lines or the even-numbered lines of each frame and corresponding to the left-eye data or the right-eye data, wherein the odd-numbered lines or the even-numbered lines of each frame alternate once per frame;
and if the 3D video source format is a left-right composite type or an up-down composite type, reading the continuous left-eye data and the continuous right-eye data alternately and respectively.
7. The method according to claim 6, wherein if the 3D video source format is a left-right composite type or a top-bottom composite type, the method further comprises, after reading the left-eye data and the right-eye data respectively and consecutively, alternately:
the order of reading the left-eye data or the right-eye data is preset, so that a receiving card of the display system analyzes and obtains the left-eye data and the right-eye data according to the preset order.
8. The display control method according to any one of claims 3 to 7, wherein the communication frame includes a line effective length representing a number of line pixels.
9. A display control method applied to a reception card of the display system according to claim 2, the method comprising:
analyzing and generating a video synchronization frame and an interlaced 3D video frame according to a communication frame received from a transmitting card of a display system;
increasing the frame rate of the video synchronization frame to a preset frame rate, and generating second field synchronization data corresponding to the preset frame rate;
forming a final displayed target field synchronous signal according to the second field synchronous data;
analyzing the interlaced 3D video frame to obtain interlaced 3D video data;
splitting the interlaced 3D video data into left-eye image data and right-eye image data, and respectively storing the left-eye image data and the right-eye image data in a left-eye image storage area and a right-eye image storage area;
reading left eye image data and right eye image data in a whole frame;
generating second 3D video data with preset resolution and frame rate according to the second field synchronization data, the left eye image data and the right eye image data;
and outputting the second 3D video data to a display screen for displaying according to the target field synchronous signal.
10. The method of claim 9, wherein splitting the interlaced 3D video data into left-eye image data and right-eye image data comprises:
and if the format of the interlaced 3D video frame is a left-right composite type or a top-bottom composite type, splitting the interlaced 3D video data into left-eye image data and right-eye image data according to a preset sequence of reading left-eye data first or reading right-eye data first.
11. The method according to claim 9, wherein the generating second 3D video data at a preset resolution and a preset frame rate from the second field sync data, the left eye image data, and the right eye image data comprises:
and if the format of the interlaced 3D video frame is a left-right separation type, expanding the resolution of the left-eye image data and the right-eye image data to a preset resolution.
12. The method according to claim 11, wherein the expanding the resolution of the left-eye image data and the right-eye image data to a preset resolution comprises:
and expanding the resolution of the left eye image data and the right eye image data to a preset resolution by an intra-frame interpolation method.
13. The method according to claim 12, wherein the expanding the resolution of the left-eye image data and the right-eye image data to a preset resolution by the intra interpolation method includes:
during the intra-frame interpolation calculation, the pixels beyond the boundary take valid boundary values.
14. The method according to any one of claims 9 to 13, wherein the generating second 3D video data at a preset resolution and a preset frame rate from the second field sync data, left eye image data, and right eye image data comprises:
and expanding the left eye image data and the right eye image data to the preset frame rate by an inter-frame interpolation method.
15. The method according to claim 14, wherein the expanding the left-eye image data and the right-eye image data to the preset frame rate by the inter-frame interpolation method includes:
during the inter-frame interpolation calculation, the image pixels beyond the video range take valid boundary values.
16. A computer-readable storage medium, having a display control program stored thereon, which, when executed by a processor, implements the steps of the display control method according to any one of claims 3-8, or implements the steps of the display control method according to any one of claims 9-15.
CN202210053922.3A 2022-01-18 2022-01-18 Transmitting card, receiving card, display control method and storage medium of display system Pending CN114422769A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210053922.3A CN114422769A (en) 2022-01-18 2022-01-18 Transmitting card, receiving card, display control method and storage medium of display system
PCT/CN2022/136061 WO2023138226A1 (en) 2022-01-18 2022-12-02 Sending card and receiving card for display system, display control method, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210053922.3A CN114422769A (en) 2022-01-18 2022-01-18 Transmitting card, receiving card, display control method and storage medium of display system

Publications (1)

Publication Number Publication Date
CN114422769A true CN114422769A (en) 2022-04-29

Family

ID=81272691

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210053922.3A Pending CN114422769A (en) 2022-01-18 2022-01-18 Transmitting card, receiving card, display control method and storage medium of display system

Country Status (2)

Country Link
CN (1) CN114422769A (en)
WO (1) WO2023138226A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023138226A1 (en) * 2022-01-18 2023-07-27 深圳市洲明科技股份有限公司 Sending card and receiving card for display system, display control method, and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116915965B (en) * 2023-09-08 2023-12-22 北京小鸟科技股份有限公司 System, method and electronic equipment for displaying 3D videos in different formats on same screen

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MX9201959A (en) * 1991-04-29 1992-11-01 Rca Licensing Corp APPARATUS FOR COMPRESSING VIDEO SIGNALS.
US6784917B1 (en) * 1996-12-06 2004-08-31 Sanyo Electric Co., Ltd. Digital broadcasting system
WO2010133852A2 (en) * 2009-05-21 2010-11-25 British Broadcasting Corporation An apparatus and method of transmitting three- dimensional video pictures via a two dimensional monoscopic video channel
US20160021354A1 (en) * 2014-07-16 2016-01-21 Arris Enterprises, Inc. Adaptive stereo scaling format switch for 3d video encoding
CN112188182A (en) * 2019-07-02 2021-01-05 西安诺瓦星云科技股份有限公司 Stereoscopic display control system, stereoscopic display system and stereoscopic display controller
CN112599083A (en) * 2020-12-24 2021-04-02 深圳市洲明科技股份有限公司 Data transmission method, data receiving method, sending card and receiving card of display screen
US11048082B1 (en) * 2018-04-13 2021-06-29 Apple Inc. Wireless bandwidth reduction with display data interleaving

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7034819B2 (en) * 2002-10-04 2006-04-25 Silicon Integrated Systems Corp. Apparatus and method for generating an interleaved stereo image
JP2011055148A (en) * 2009-08-31 2011-03-17 Toshiba Corp Video combining device, video display apparatus, and video combining method
CN104243964A (en) * 2014-09-12 2014-12-24 西安诺瓦电子科技有限公司 Stereoscopic LED display control system and method and display control card
CN109151434B (en) * 2018-10-26 2020-10-16 深圳市奥拓电子股份有限公司 3D display control method, system, storage medium and 3D display system
CN114422769A (en) * 2022-01-18 2022-04-29 深圳市洲明科技股份有限公司 Transmitting card, receiving card, display control method and storage medium of display system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MX9201959A (en) * 1991-04-29 1992-11-01 Rca Licensing Corp APPARATUS FOR COMPRESSING VIDEO SIGNALS.
US6784917B1 (en) * 1996-12-06 2004-08-31 Sanyo Electric Co., Ltd. Digital broadcasting system
WO2010133852A2 (en) * 2009-05-21 2010-11-25 British Broadcasting Corporation An apparatus and method of transmitting three- dimensional video pictures via a two dimensional monoscopic video channel
US20160021354A1 (en) * 2014-07-16 2016-01-21 Arris Enterprises, Inc. Adaptive stereo scaling format switch for 3d video encoding
US11048082B1 (en) * 2018-04-13 2021-06-29 Apple Inc. Wireless bandwidth reduction with display data interleaving
CN112188182A (en) * 2019-07-02 2021-01-05 西安诺瓦星云科技股份有限公司 Stereoscopic display control system, stereoscopic display system and stereoscopic display controller
CN112599083A (en) * 2020-12-24 2021-04-02 深圳市洲明科技股份有限公司 Data transmission method, data receiving method, sending card and receiving card of display screen

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023138226A1 (en) * 2022-01-18 2023-07-27 深圳市洲明科技股份有限公司 Sending card and receiving card for display system, display control method, and storage medium

Also Published As

Publication number Publication date
WO2023138226A1 (en) 2023-07-27

Similar Documents

Publication Publication Date Title
CN114422769A (en) Transmitting card, receiving card, display control method and storage medium of display system
CN1741621B (en) Method of generating stereoscopic image signal and method of scaling the same
US9961325B2 (en) 3D caption display method and 3D display apparatus for implementing the same
US9253469B2 (en) Method for displaying 3D caption and 3D display apparatus for implementing the same
US20110018966A1 (en) Receiving Device, Communication System, Method of Combining Caption With Stereoscopic Image, Program, and Data Structure
EP2265032A2 (en) 2D/3D video transmission apparatus
KR101318711B1 (en) Video image processing apparatus and method for controlling video image processing apparatus
CN101984671B (en) Method for synthesizing video images and interface graphs by 3DTV receiving system
US20140078248A1 (en) Transmitting apparatus, transmitting method, receiving apparatus, and receiving method
KR20130052621A (en) Method for combining images relating to a three-dimensional content
US9088777B2 (en) Methods and systems for processing stereoscopic video data
JP4748251B2 (en) Video conversion method and video conversion apparatus
KR20150095765A (en) Apparatus and method for generating and rebuilding a video stream
EP2326096A2 (en) 3D Image Display Apparatus and Display Method
KR101177412B1 (en) apparatus for transmitting and receiving broadcast signal and method thereof
JP5682149B2 (en) Stereo image data transmitting apparatus, stereo image data transmitting method, stereo image data receiving apparatus, and stereo image data receiving method
US20120307153A1 (en) Video processing device and video processing method
JP2000308089A (en) Stereoscopic image encoder and decoder
JP2009010455A (en) Transmission device, reception device, and program
US20120163700A1 (en) Image processing device and image processing method
US8896663B2 (en) Transmitting device, receiving device, communication system and program
KR100823561B1 (en) Display device for displaying two-three dimensional image
US10284840B2 (en) Apparatus and method for reproducing 3D image
JP2013021683A (en) Image signal processing device, image signal processing method, image display device, image display method, and image processing system
JP2010087720A (en) Device and method for signal processing that converts display scanning method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination