CN113625982A - Multi-screen display method and device - Google Patents

Multi-screen display method and device Download PDF

Info

Publication number
CN113625982A
CN113625982A CN202110828380.8A CN202110828380A CN113625982A CN 113625982 A CN113625982 A CN 113625982A CN 202110828380 A CN202110828380 A CN 202110828380A CN 113625982 A CN113625982 A CN 113625982A
Authority
CN
China
Prior art keywords
screen
pictures
resolution
picture
physical interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110828380.8A
Other languages
Chinese (zh)
Inventor
董宇
顾国梁
罗小伟
汤鹏川
胡明
徐晟�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Spreadtrum Communications Shanghai Co Ltd
Original Assignee
Spreadtrum Communications Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Spreadtrum Communications Shanghai Co Ltd filed Critical Spreadtrum Communications Shanghai Co Ltd
Priority to CN202110828380.8A priority Critical patent/CN113625982A/en
Publication of CN113625982A publication Critical patent/CN113625982A/en
Priority to PCT/CN2021/143413 priority patent/WO2023000621A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/40Scaling the whole image or part thereof
    • G06T3/4038Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/40Scaling the whole image or part thereof
    • G06T3/4092Image resolution transcoding, e.g. client/server architecture
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/32Indexing scheme for image data processing or generation, in general involving image mosaicing

Abstract

The embodiment of the application discloses a multi-screen display method and a multi-screen display device, wherein the method comprises the following steps: the AP chip generates a plurality of screen pictures, if the total bandwidth required by pixel transmission of the plurality of screen pictures is greater than the maximum output bandwidth of the single-screen physical interface, the plurality of screen pictures are compressed to obtain a plurality of intermediate pictures, and the total bandwidth required by pixel transmission of the plurality of intermediate pictures is less than or equal to the maximum output bandwidth of the single-screen physical interface; splicing the multiple intermediate pictures to obtain a target picture; the target picture is input to the switching chip through the single-screen physical interface, the problem that the output bandwidth of the single-screen physical interface is insufficient when a plurality of high-resolution screens are connected can be solved, and therefore multi-screen display is achieved through the single-screen physical interface.

Description

Multi-screen display method and device
Technical Field
The present application relates to the field of communications technologies, and in particular, to a multi-screen display method and apparatus.
Background
With the vigorous development of display technology, the demand of the dual-screen different display function in the markets of consumption, financial payment and business display is more and more. Currently, the screen output of most Application Processors (APs) is usually a single Mobile Industry Processor Interface (MIPI) Display Serial Interface (DSI), which can only connect to a single MIPI Display screen.
The output bandwidth of the MIPI DSI of the AP chip of the single-path MIPI DSI is designed according to the bandwidth requirement of connecting a single display screen. Therefore, when multiple display screens are connected, a single MIPI DSI cannot output the multiple screen pictures to the multiple display screens at the same time for display.
Disclosure of Invention
The embodiment of the application provides a multi-screen display method and device, which can synthesize pictures of a plurality of screens with different resolutions into one screen picture, and solve the problem that the output bandwidth of a single-screen physical interface is insufficient when a plurality of high-resolution screens are connected, so that multi-screen display is realized through the single-screen physical interface.
In a first aspect, an embodiment of the present application provides a multi-screen display method, which is applied to an AP chip, and the method includes:
generating a plurality of screen pictures;
if the total bandwidth required by the pixel transmission of the multiple screen pictures is larger than the maximum output bandwidth of a single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures, wherein the total bandwidth required by the pixel transmission of the multiple intermediate pictures is smaller than or equal to the maximum output bandwidth of the single-screen physical interface;
splicing the plurality of intermediate pictures to obtain a target picture;
and inputting the target picture to a switching chip through the single-screen physical interface.
In a second aspect, an embodiment of the present application provides a multi-screen display method, applied to a switch chip, the method including:
segmenting the received target picture to obtain a plurality of intermediate pictures;
comparing the resolutions of the plurality of intermediate pictures with a plurality of target resolutions respectively, wherein the target resolution is the screen resolution of a target screen corresponding to the intermediate pictures;
if the resolution of the intermediate picture is different from the target resolution, adjusting the resolution of the intermediate picture to obtain a plurality of screen pictures, wherein the resolution of the screen pictures is the same as the target resolution;
and respectively sending the multiple screen pictures to the multiple target screens.
In a third aspect, an embodiment of the present application provides a multi-screen display device, which is applied to an AP chip, and the device includes:
the processing unit is used for generating a plurality of screen pictures;
the processing unit is further configured to compress the multiple screen pictures to obtain multiple intermediate pictures if a total bandwidth required by pixel transmission of the multiple screen pictures is greater than a maximum output bandwidth of a single-screen physical interface, where the total bandwidth required by pixel transmission of the multiple intermediate pictures is less than or equal to the maximum output bandwidth of the single-screen physical interface;
the processing unit is further configured to splice the plurality of intermediate pictures to obtain a target picture;
and the receiving and sending unit is used for inputting the target picture to a switching chip through the single-screen physical interface.
In a fourth aspect, an embodiment of the present application provides a multi-panel display device applied to a switch chip, where the multi-panel display device includes:
the processing unit is used for segmenting the received target picture to obtain a plurality of intermediate pictures;
the processing unit is further configured to compare resolutions of the plurality of intermediate pictures with target resolutions respectively, where the target resolution is a screen resolution of a target screen corresponding to the intermediate pictures;
the processing unit is further configured to adjust the resolution of the intermediate picture to obtain multiple screen pictures if the resolution of the intermediate picture is different from a target resolution, where the resolution of the screen pictures is the same as the target resolution;
and the transceiving unit is used for respectively sending the screen pictures to the target screens.
In a fifth aspect, embodiments of the present application provide a chip comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing some or all of the steps described in the method of the first or second aspect.
In a sixth aspect, the present application provides a computer-readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer to perform some or all of the steps described in the method of the first or second aspect.
In a seventh aspect, an embodiment of the present application provides a computer program product including instructions, which, when run on an electronic device, causes the electronic device to perform the method of the first aspect or the second aspect.
According to the technical scheme, the AP chip generates a plurality of screen pictures, if the total bandwidth required by pixel transmission of the plurality of screen pictures is larger than the maximum output bandwidth of the single-screen physical interface, the plurality of screen pictures are compressed to obtain a plurality of intermediate pictures, and the total bandwidth required by the pixel transmission of the plurality of intermediate pictures is smaller than or equal to the maximum output bandwidth of the single-screen physical interface; splicing the multiple intermediate pictures to obtain a target picture; the target picture is input to the switching chip through the single-screen physical interface, the problem that the output bandwidth of the single-screen physical interface is insufficient when a plurality of high-resolution screens are connected can be solved, and therefore multi-screen display is achieved through the single-screen physical interface.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a schematic diagram of a multi-screen display system according to an embodiment of the present disclosure;
FIG. 2 is a flowchart illustrating a multi-screen display method according to an embodiment of the present disclosure;
FIG. 3 is a flowchart illustrating another multi-screen display method according to an embodiment of the present disclosure;
FIG. 3a is a diagram illustrating screen image compression and decompression according to an embodiment of the present disclosure;
FIG. 4 is a flowchart illustrating another multi-screen display method according to an embodiment of the present disclosure;
FIG. 4a is a diagram illustrating another example of screen picture compression and decompression according to an embodiment of the present disclosure;
FIG. 5 is a flowchart illustrating another multi-screen display method according to an embodiment of the present disclosure;
FIG. 6 is a flowchart illustrating another multi-screen display method according to an embodiment of the present disclosure;
FIG. 7 is a flowchart illustrating another multi-screen display method according to an embodiment of the present application;
FIG. 8 is a block diagram illustrating functional units of a multi-panel display apparatus according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a chip according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The MIPI is an open standard and a standard which are initiated by an MIPI alliance and set for a mobile application processor, and aims to standardize interfaces in the mobile terminal, such as a camera, a display screen interface, a radio frequency/baseband interface and the like, so that the design complexity of the mobile terminal is reduced and the design flexibility is increased. The MIPI alliance governs different workgroups (Work groups) to meet different requirements of each subsystem of the mobile terminal. Different working groups are responsible for formulating specific protocols, and define a set of internal interface standards of the mobile device, such as camera serial interface CSI, display serial interface DSI, radio frequency interface DigRF, microphone/speaker interface SLIMbus, and the like, for different hardware devices.
At present, most of the screen outputs of the AP chip are usually single-screen physical interfaces, and can only be connected to a single MIPI LCD screen, and in order to implement multi-screen differential display, a single MIPI DSI output of the AP chip must be converted into multiple MIPI DSI outputs through a switching chip or an FPGA, so as to connect multiple screens. Some existing multi-screen display schemes expanded by an external SOC or FPGA chip are adopted, but the schemes generally include that an AP chip performs simple left and right or up and down splicing and multiplexing on a plurality of screen pictures to form a picture and outputs the picture to an external expansion chip, and the external expansion chip demultiplexes the whole picture and then outputs the picture to a plurality of LCD screens respectively. Since the MIPI DSI output bandwidth of the AP chip of the single-channel MIPI DSI is designed according to the bandwidth requirement of a single LCD screen, when multiple (two or more) LCD screens are connected, it may be necessary to reduce the maximum resolution or refresh rate of each LCD screen to meet the requirement of the MIPI DSI bandwidth requirement, and meanwhile, if the resolution of the multiple (two or more) LCD screens is wide and the height of the multiple (two or more) LCD screens is different, such as LCD _ 1: 1080 × 1920, LCD _ 2: 1080 × 960, when the switching chip or FPGA refreshes two screens synchronously, LCD _2 may have a screen flash phenomenon due to non-uniform refreshing.
In order to solve the above problems, the present application provides a multi-screen display method, where an AP chip performs pixel compression on one or more screen pictures to reduce resolution or perform overall chroma compression according to resolution of a plurality of current screen pictures if the total resolution of the plurality of screen pictures is greater than a single maximum output bandwidth of the AP chip, and then splices the plurality of screen pictures to synthesize an image, which is output to a switching chip through a single-screen physical interface. The switching chip firstly demultiplexes the received spliced pictures into a plurality of screen pictures, then carries out resolution adjustment on the screen pictures subjected to pixel compression or carries out chrominance adjustment on the screen pictures subjected to chrominance compression, and then synchronously refreshes and outputs the plurality of processed screen pictures to a plurality of screens line by line for display. The problem of insufficient bandwidth of a single-screen physical interface when a plurality of high-resolution screens are connected can be solved, and the problem of non-uniformity in refreshing when the resolution ratios of the plurality of screens are different is also solved, so that multi-screen display is realized through the single-screen physical interface.
The present application will be described in detail with reference to specific examples.
Referring to fig. 1, fig. 1 is a schematic diagram of a multi-screen display system according to an embodiment of the present disclosure, the multi-screen display system includes an AP chip 10, a switch chip 20, and a plurality of display screens 30. The AP chip is configured to generate a screen picture displayed by each display screen 30, and transmit the screen picture to the switch-over chip 20 through the single MIPI DSI after processing the screen picture, the switch-over chip 20 is configured to adjust the received screen picture and simultaneously send the adjusted screen picture to the plurality of display screens 30 line by line according to a preset frame rate, the display screens 30 are in communication connection with the switch-over chip 20, and can receive and display the screen picture transmitted by the AP chip 10 through the switch-over chip 20, so that the multi-screen display can be realized through the single MIPI DSI.
In particular, the AP chip may include one or more processors, memories, WIFI modules, serial/parallel interfaces, and the like. The serial/parallel Interface may include a General Purpose Input/Output (GPIO) Interface, a High Definition Multimedia Interface (HDMI), a common system Interface CSI, a single MIPI DSI, and other physical interfaces. The AP chip 10 may be connected to the adaptor chip 20 through the single MIPI DSI, and the processor generates a screen picture and transmits the screen picture to the adaptor chip 20 through the single MIPI DSI. The WiFi module is used for wireless network communication.
The adaptor chip 20 may include a plurality of DSI interfaces, each connected to one display screen 30. The switching chip 20 adjusts the received screen pictures and then simultaneously sends the adjusted screen pictures to the corresponding display screen 30 through the DSI interface for displaying.
Referring to fig. 2, fig. 2 is a flowchart illustrating a multi-screen display method according to an embodiment of the present application, applied to the AP chip shown in fig. 1. As shown in fig. 2, the method includes the following steps.
And S210, generating a plurality of screen pictures.
The resolution of the screen picture is the same as a target resolution, and the target resolution is the screen resolution of a target screen corresponding to the screen picture. In practical applications, one electronic device may be connected to a plurality of display screens to display picture contents. When the multiple display screens need to be displayed simultaneously, the AP chip may first obtain the screen resolutions of the multiple display screens, and then generate multiple screen pictures having the same screen resolutions as the multiple display screens in a Central Processing Unit (CPU) or a Graphics Processing Unit (GPU) manner.
For example, the resolution of the screen picture may also be different from the screen resolution of the target screen corresponding to the screen picture. For example, when a host in a supermarket foreground is connected with two display screens with different resolutions for display, an AP chip in the host may generate two screen pictures with the same resolution, and then a switching chip in the host adjusts the resolution of the screen pictures to be equal to the screen resolution of a target screen and then sends the screen pictures to a display for display, or the switching chip directly sends the screen pictures to the display for display.
S220, if the total bandwidth required by the pixel transmission of the multiple screen pictures is larger than the maximum output bandwidth of the single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures, wherein the total bandwidth required by the pixel transmission of the multiple intermediate pictures is smaller than or equal to the maximum output bandwidth of the single-screen physical interface.
Wherein, the single screen physical interface may be a single MIPI DSI. When the single MIPI DSI of the AP chip can not output the multiple screen pictures to the display screen to be displayed at the same time, the resolution of the multiple screen pictures can be adjusted by the AP chip, so that the single MIPI DSI can transmit the adjusted screen pictures.
In a possible example, if the total bandwidth required for pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of the single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures includes: splicing the plurality of screen pictures according to a first direction to obtain a spliced picture, wherein the first direction is the row direction of the screen pictures; if the resolution multiplied by the frame rate of the spliced image is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution width of the spliced image is larger than the maximum resolution width of the single-screen physical interface, performing pixel compression on the spliced image or at least one screen image along the first direction, or performing chroma compression on the spliced image or at least one screen image to obtain a plurality of intermediate images.
In the application, the AP chip can splice a plurality of screen pictures according to the row direction of the screen pictures so as to judge whether the sum of the resolution widths of the plurality of screen pictures is greater than the maximum resolution width of the single-screen physical interface. And if the resolution width multiplied by the frame rate of the spliced picture obtained by splicing the multiple screen pictures is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution width of the spliced image is larger than the maximum resolution width of the single-screen physical interface, indicating that the single-screen physical interface of the AP chip cannot transmit the spliced picture. At this time, the AP chip may directly perform pixel compression on the spliced picture or the at least one screen picture with a large resolution height along the row direction, and the AP chip may also perform pigment compression on the at least one screen picture with a large resolution height to obtain a plurality of intermediate pictures, so that the single-screen physical interface may transmit the plurality of intermediate pictures, thereby implementing multi-screen display of the single-screen physical interface.
The pixel compression may be linear filtering downsampling of pixel RGB color components for the screen picture and the stitched picture, for example, bilinear filtering downsampling and other methods, which compress the resolution width or the resolution height of the screen picture and the stitched picture. The chroma compression can be used for converting the screen picture or the spliced picture from a 24-bit RGB888 format to a 16-bit RGB565 format or a 12-bit YUV420 format, and can simultaneously compress the resolution width and the resolution height of the screen picture and the spliced picture so as to reduce the resolution of the screen picture or the spliced picture and reduce the data volume of the screen picture or the spliced picture.
In another possible example, if the total bandwidth required for pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of a single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures includes: splicing the plurality of screen pictures according to a second direction to obtain spliced pictures, wherein the second direction is the row direction of the screen pictures; and if the resolution multiplied by the frame rate of the spliced image is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution height of the spliced image is larger than the maximum resolution height of the single-screen physical interface, performing pixel compression on the spliced image or at least one screen image along the second direction, or performing chroma compression on the spliced image or at least one screen image to obtain a plurality of intermediate images.
In this embodiment of the application, the AP chip may splice a plurality of screen pictures according to the height direction of the screen pictures to determine whether the sum of the resolution heights of the plurality of screen pictures is greater than the maximum resolution height of the single-screen physical interface. And if the resolution multiplied frame rate of the spliced picture obtained by splicing the multiple screen pictures is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution height of the spliced image is larger than the maximum resolution height of the single-screen physical interface, indicating that the single-screen physical interface of the AP chip cannot transmit the spliced picture. At this moment, the AP chip can directly carry out pixel compression on the spliced picture or the at least one screen picture with larger resolution height along the column direction, and the AP chip can also directly carry out pixel compression on the spliced picture or the at least one screen picture with larger resolution height to obtain a plurality of intermediate pictures, so that the single-screen physical interface can transmit the plurality of intermediate pictures, and multi-screen display of the single-screen physical interface is realized.
And S230, splicing the plurality of intermediate pictures to obtain a target picture.
After the multiple screen pictures are processed in the row direction to obtain multiple intermediate pictures, the AP chip splices the multiple intermediate pictures in the row direction, namely splices the multiple intermediate pictures left and right to obtain a target picture; and if the multiple screen pictures are processed in the column direction to obtain multiple intermediate pictures, the AP chip splices the multiple intermediate pictures in the column direction, namely, the multiple intermediate pictures are spliced up and down to obtain the target picture.
And S240, inputting the target picture to a switching chip through the single-screen physical interface.
After the target picture is obtained, the AP chip outputs the spliced picture to the SOC or FPGA chip for switching through the single MIPI DSI.
The method includes that an AP chip generates a plurality of screen pictures, if the total bandwidth required by pixel transmission of the plurality of screen pictures is larger than the maximum output bandwidth of a single-screen physical interface, the plurality of screen pictures are compressed to obtain a plurality of intermediate pictures, and the total bandwidth required by the pixel transmission of the plurality of intermediate pictures is smaller than or equal to the maximum output bandwidth of the single-screen physical interface; splicing the plurality of intermediate pictures to obtain a target picture; the target picture is input to the switching chip through the single-screen physical interface, the problem that the output bandwidth of the single-screen physical interface is insufficient when a plurality of high-resolution screens are connected can be solved, and therefore multi-screen display is achieved through the single-screen physical interface.
Referring to fig. 3, fig. 3 is a schematic flow chart of another multi-screen display method according to an embodiment of the present application, applied to the AP chip shown in fig. 1. As shown in fig. 3, the method includes the following steps.
And S310, generating a plurality of screen pictures.
S320, if the resolution height of the first screen picture is larger than the resolution height corresponding to the maximum output bandwidth of the single-screen physical interface, performing width-to-height ratio conversion on the first screen picture, wherein the multiple screen pictures comprise the first screen picture.
Before splicing the multiple screen pictures, whether the resolution heights of the multiple screen pictures are larger than the maximum resolution height of the single-screen physical interface or not can be judged, if the resolution heights of the screen pictures are larger than the maximum resolution height of the single-screen physical interface, the screen pictures are subjected to width-height conversion of resolution pixels, and the resolution heights of the screen pictures are smaller than or equal to the maximum resolution height.
S330, splicing the multiple screen pictures according to a first direction to obtain a spliced picture, wherein the first direction is the row direction of the screen pictures.
S340, if the resolution × the frame rate of the stitched image is greater than the maximum output bandwidth of the single-screen physical interface, and/or the resolution width of the stitched image is greater than the maximum resolution width of the single-screen physical interface, performing pixel compression on the stitched image or at least one screen image along the first direction, or performing chroma compression on the stitched image or the at least one screen image, to obtain the plurality of intermediate images.
Wherein, the single screen physical interface may be a single MIPI DSI. When the single MIPI DSI of the AP chip can not output the multiple screen pictures to the display screen for displaying, the resolution of the multiple screen pictures can be adjusted by the AP chip, so that the single MIPI DSI can transmit the adjusted screen pictures.
In this embodiment of the application, the AP chip may splice multiple screen pictures according to the row direction of the screen pictures to determine whether the sum of the resolution widths of the multiple screen pictures is greater than the maximum resolution width of the single-screen physical interface. And if the resolution width multiplied by the frame rate of the spliced picture obtained by splicing the multiple screen pictures is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution width of the spliced image is larger than the maximum resolution width of the single-screen physical interface, indicating that the single-screen physical interface of the AP chip cannot transmit the spliced picture. At this time, the AP chip may directly perform pixel compression on the spliced picture or the at least one screen picture with a large resolution height along the row direction, and the AP chip may also perform pigment compression on the at least one screen picture with a large resolution height to obtain a plurality of intermediate pictures, so that the single-screen physical interface may transmit the plurality of intermediate pictures, thereby implementing multi-screen display of the single-screen physical interface.
The pixel compression may be linear filtering downsampling of pixel RGB color components for the screen picture and the stitched picture, for example, bilinear filtering downsampling and other methods, which compress the resolution width of the screen picture or the stitched picture. The chroma compression can be used for converting the screen picture or the spliced picture from a 24-bit RGB888 format to a 16-bit RGB565 format or a 12-bit YUV420 format, and can simultaneously compress the resolution width and the resolution height of the screen picture and the spliced picture so as to reduce the resolution of the screen picture or the spliced picture and reduce the data volume of the screen picture or the spliced picture.
And S350, splicing the plurality of intermediate pictures to obtain a target picture.
After the multiple screen pictures are processed according to the row direction to obtain multiple intermediate pictures, the AP chip splices the multiple intermediate pictures according to the row direction, namely, splices the multiple intermediate pictures left and right to obtain the target picture.
And S360, inputting the target picture to a switching chip through the single-screen physical interface.
After the target picture is obtained, the AP chip outputs the spliced picture to the SOC or FPGA chip for switching through the single MIPI DSI.
For example, the maximum output bandwidth of a single MIPI AP chip can support a single 1920 × 108060 FPS screen, the width of pixels in the picture row direction of MIPI output is limited to 1920, that is, the maximum resolution width is 1920, the resolution of the display screen 1 is 1920 × 108060 FPS, and the resolution of the display screen 2 is 360 × 120060 FPS.
The AP chip firstly draws two screen pictures with the screen resolution of two output display screens in a CPU or GPU mode and the like, and the two screen pictures are recorded as a screen picture 1: 1920 × 108060 FPS and screen picture 2: 360 × 120060FPS, since the sum of the resolution widths of the screen 1 and the screen 2 exceeds 1920 and the resolution height of the screen picture 2 exceeds 1080, as shown in fig. 3a, the AP chip performs a wide-high conversion of the pixels on the screen picture 2, converts the resolution of the screen picture 2 from 360 × 1200 to 720 × 600, and performs a pixel compression of the pixels in the line direction on the screen picture 1, that is, each component of the RGB three color components of the screen picture 1 is downsampled by using FIR filtering 1/2 to implement 1/2 compression, so that the resolution of the screen picture 1 is compressed from 1920 × 1080 to 960 × 1080. And finally, the total resolution of the processed screen picture 1 and the processed screen picture 2 is 1680 × 1080, the frame rate is 60FPS, and the frame rate is smaller than the maximum output bandwidth, so that the processed screen pictures can be output to an SOC or FPGA chip line by the single MIPI of the AP chip for switching.
In this application, when the sum of the resolution widths of a plurality of screen pictures is greater than the maximum output bandwidth of a single-screen physical interface, through compressing and width-height conversion to the screen pictures, multi-screen display through the single-screen physical interface can be realized, and the problems that the bandwidth of the single-screen physical interface is limited and that a certain screen is continuously blanked (Blanking) due to the difference of the resolution widths of a plurality of screens is too much to cause uneven refreshing and screen flashing can be effectively solved.
Referring to fig. 4, fig. 4 is a schematic flow chart of another multi-screen display method according to an embodiment of the present application, applied to the AP chip shown in fig. 1. As shown in fig. 4, the method includes the following steps.
And S410, generating a plurality of screen pictures.
And S420, if the resolution width of a second screen picture is larger than the resolution width corresponding to the maximum output bandwidth of the single-screen physical interface, performing width-to-height ratio conversion on the second screen picture, wherein the multiple screen pictures comprise the second screen picture.
Before splicing the multiple screen pictures, whether the resolution widths of the multiple screen pictures are larger than the maximum resolution width of the single-screen physical interface or not can be judged, if the resolution width of the screen picture is larger than the maximum resolution width of the single-screen physical interface, the screen picture is subjected to width-height conversion of resolution pixels, and the resolution width of the screen picture is smaller than or equal to the maximum resolution width.
And S430, splicing the plurality of screen pictures according to a second direction to obtain a spliced picture, wherein the second direction is the column direction of the screen pictures.
And S440, if the resolution multiplied by the frame rate of the spliced image is greater than the maximum output bandwidth of the single-screen physical interface and/or the resolution height of the spliced image is greater than the maximum resolution height of the single-screen physical interface, performing pixel compression on the spliced image or at least one screen image along the second direction, or performing chroma compression on the spliced image or the at least one screen image to obtain a plurality of intermediate images.
In this embodiment of the application, the AP chip may splice a plurality of screen pictures according to the column direction of the screen pictures to determine whether the sum of the resolution heights of the plurality of screen pictures is greater than the maximum resolution height of the single-screen physical interface. And if the resolution height multiplied by the frame rate of the spliced picture obtained by splicing the multiple screen pictures is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution height of the spliced image is larger than the maximum resolution height of the single-screen physical interface, indicating that the single-screen physical interface of the AP chip cannot transmit the spliced picture. At this time, the AP chip may directly perform pixel compression on the spliced picture or the at least one screen picture with a large resolution width along the column direction, and the AP chip may also perform pigment compression on the spliced picture or the at least one screen picture with a large resolution width to obtain a plurality of intermediate pictures, so that the single-screen physical interface may transmit the plurality of intermediate pictures, thereby implementing multi-screen display of the single-screen physical interface.
The pixel compression may be linear filtering downsampling of pixel RGB color components for the screen picture and the stitched picture, for example, bilinear filtering downsampling and other methods, which compress the resolution widths of the screen picture and the stitched picture. The chroma compression can be used for converting the screen picture or the spliced picture from a 24-bit RGB888 format to a 16-bit RGB565 format or a 12-bit YUV420 format, and can simultaneously compress the resolution width and the resolution height of the screen picture and the spliced picture so as to reduce the resolution of the screen picture or the spliced picture and reduce the data volume of the screen picture or the spliced picture.
And S450, splicing the plurality of intermediate pictures according to the second direction to obtain a target picture.
After the multiple screen pictures are processed in the column direction to obtain multiple intermediate pictures, the AP chip splices the multiple intermediate pictures in the column direction, namely splices the multiple intermediate pictures up and down to obtain the target picture.
And S460, inputting the target picture to a switching chip through the single-screen physical interface.
After the target picture is obtained, the AP chip outputs the spliced picture to the SOC or FPGA chip for switching through the single MIPI DSI.
For example, the maximum output bandwidth of a single MIPI AP chip can support a single 540 × 120060FPS screen, the height of pixels in the column direction of the picture output by the MIPI is limited to 1200, that is, the maximum resolution height is 1200, the resolution of the display screen 1 is 1080 × 27060 FPS, and the resolution of the display screen 2 is 540 × 120060 FPS.
The AP chip firstly draws two screen pictures with the screen resolution of two output display screens in a CPU or GPU mode and the like, and the two screen pictures are recorded as a screen picture 1: 1080 × 27060 FPS and screen picture 2: 540 × 120060FPS, since the sum of the resolution heights of the screen 1 and the screen 2 exceeds 1200, and the resolution width of the screen picture 1 is greater than 540, as shown in fig. 4a, the AP chip performs a width-to-height conversion of the pixels on the screen picture 1, converts the resolution of the screen picture 1 from 1080 × 270 to 540 × 540, and performs a pixel compression of the pixels in the column direction on the screen picture 2, that is, each of the three RGB color components of the screen picture 2 is downsampled by using FIR filtering 1/2 to implement 1/2 compression, so that the resolution of the screen picture 1 is compressed from 540 × 1200 to 540 × 600. Finally, the total resolution of the processed screen picture 1 and the processed screen picture 2 is 540 × 1140, the frame rate is 60FPS, and both the resolution and the frame rate are smaller than the maximum output bandwidth, so that the processed screen pictures can be output to an SOC or FPGA chip line by line through a single MIPI of an AP chip for switching.
In this application, when the sum of the resolution ratio height of many screen pictures is greater than the maximum output bandwidth of single screen physical interface, through compressing and width high transform to the screen picture, can realize carrying out many screen display through single screen physical interface to can effectively solve single screen physical interface bandwidth limited and because a plurality of screen resolution ratio height difference lead to certain screen continuous Blanking (Blanking) too much to lead to refreshing inhomogeneous the screen and dodge the problem.
Referring to fig. 5, fig. 5 is a flowchart illustrating another multi-screen display method according to an embodiment of the present application, applied to the AP chip shown in fig. 1. As shown in fig. 5, the method includes the following steps.
And S510, generating a plurality of screen pictures.
S520, if the sum of the resolution widths of the multiple screen pictures is larger than the resolution width corresponding to the maximum output bandwidth of the single-screen physical interface, or if the sum of the resolution heights of the multiple screen pictures is larger than the resolution height corresponding to the maximum output bandwidth of the single-screen physical interface, performing chroma compression or pixel compression on at least one screen picture to obtain multiple intermediate pictures.
In this application, when the sum of the resolution widths of the multiple screen pictures is greater than the resolution width corresponding to the maximum output bandwidth of the single-screen physical interface, or when the sum of the resolution heights of the multiple screen pictures is greater than the resolution height corresponding to the maximum output bandwidth of the single-screen physical interface, the single-screen physical interface of the AP chip may not output the multiple screen pictures to the display screen for display at the same time. Therefore, in the present application, when the sum of the resolutions of the multiple screen pictures (i.e. the sum of the resolution widths and/or the resolution heights of the multiple screen pictures) is greater than the maximum output bandwidth of the single-screen physical interface, the resolutions of the multiple screen pictures are adjusted, so that the sum of the resolutions of the adjusted screen pictures is less than or equal to the maximum output bandwidth of the single-screen physical interface, thereby implementing the multi-screen display through the single-screen physical interface.
In one possible example, when the AP chip splices and sends multiple screen pictures to the switching chip according to the row direction, before the splicing, the AP chip needs to determine whether the sum of the resolution widths of the multiple screen pictures is greater than the maximum resolution width of the single-screen physical interface. If the sum of the resolution widths of the multiple screen pictures is greater than the maximum resolution width of the single-screen physical interface, the single-screen physical interface of the AP chip cannot simultaneously transmit the multiple screen pictures. The AP chip can carry out pigment compression or pixel compression along the row direction on at least one of the multiple screen pictures to obtain multiple intermediate pictures, so that the single-screen physical interface can transmit the multiple intermediate pictures, and multi-screen display of the single-screen physical interface is realized.
Optionally, the method further includes: and respectively calculating the difference value of the resolution heights of any two screen pictures in the multiple screen pictures to obtain at least one first difference value, and if the first difference value is greater than a first preset difference value, adjusting the resolution heights of the multiple screen pictures to the first resolution height.
For example, before compressing at least one screen picture, the AP chip may first determine whether the resolution heights of the multiple screen pictures are greater than the maximum resolution height of the single-screen physical interface, and if the resolution height of the screen picture is greater than the maximum resolution height of the single-screen physical interface, perform width-to-height conversion of resolution pixels on the screen picture, so that the resolution height of the screen picture is less than or equal to the maximum resolution height. And then calculating the difference value of the resolution heights of any two screen pictures in the multiple screen pictures, and if the first difference value is greater than a first preset difference value, performing width-height conversion of resolution pixels on the multiple screen pictures to enable the resolution heights of the multiple screen pictures to be close. Specifically, the resolution widths of the multiple screen pictures are set to be first resolution widths for width-to-height conversion, and the first resolution heights are smaller than or equal to the maximum resolution height of the MIPI of the single-screen physical interface.
In another possible example, when the AP chip splices and sends multiple screen pictures to the switching chip along the column direction, before the splicing, the AP chip needs to determine whether the sum of the resolution heights of the multiple screen pictures is greater than the maximum resolution height of the single-screen physical interface. If the sum of the resolution heights of the multiple screen pictures is greater than the maximum resolution height of the single-screen physical interface, the single-screen physical interface of the AP chip cannot transmit the multiple screen pictures simultaneously. The AP chip can carry out pigment compression or pixel compression along the column direction on at least one of the multiple screen pictures to obtain multiple intermediate pictures, so that the single-screen physical interface can transmit the multiple intermediate pictures, and multi-screen display of the single-screen physical interface is realized.
Optionally, the method further includes: and respectively calculating the difference value of the resolution widths of any two screen pictures in the multiple screen pictures to obtain at least one second difference value, and if the first difference value is greater than a second preset difference value, adjusting the resolution widths of the multiple screen pictures to the first resolution width.
Before compressing at least one screen picture, whether the resolution widths of the multiple screen pictures are larger than the maximum resolution width of the single-screen physical interface or not can be judged, if the resolution width of the screen picture is larger than the maximum resolution width of the single-screen physical interface, the screen picture is subjected to width-height conversion of resolution pixels, and the resolution width of the screen picture is smaller than or equal to the maximum resolution width. And then calculating the difference value of the resolution widths of any two screen pictures in the multiple screen pictures, and if the second difference value is greater than the second preset difference value, performing width-height conversion on resolution pixels of the multiple screen pictures to enable the resolution widths of the multiple screen pictures to be close. Specifically, the resolution widths of the multiple screen pictures are set to be a first resolution width for width-to-height conversion, and the first resolution width is smaller than or equal to the maximum resolution width of the single-screen physical interface.
And S530, splicing the plurality of intermediate pictures to obtain a target picture.
After the multiple screen pictures are processed according to the row direction to obtain multiple intermediate pictures, the AP chip splices the multiple intermediate pictures according to the row direction, namely, the multiple intermediate pictures are spliced up and down to obtain the target picture. And if the multiple screen pictures are processed in the column direction to obtain multiple intermediate pictures, the AP chip splices the multiple intermediate pictures in the column direction, namely, the multiple intermediate pictures are spliced up and down to obtain the target picture.
And S540, inputting the target picture to a switching chip through the single-screen physical interface.
After the target picture is obtained, the AP chip outputs the spliced picture to the SOC or FPGA chip for switching through the single MIPI DSI.
In the application, when the sum of the resolution widths and/or the resolution heights of a plurality of screen pictures is larger than the maximum output bandwidth of a single-screen physical interface, multi-screen display through the single-screen physical interface can be realized by compressing and width-to-height conversion of the screen pictures, and the problems that the bandwidth of the single-screen physical interface is limited and that a certain screen is continuously blanked (blanked) due to the fact that the resolution heights and/or the widths of the plurality of screens are different so that the refreshing is not uniform and screen flashing occurs can be effectively solved.
Referring to fig. 6, fig. 6 is a schematic flowchart illustrating another multi-screen display method according to an embodiment of the present application, applied to the adaptor chip shown in fig. 1. As shown in fig. 6, the method includes the following steps.
S610, the received target picture is divided to obtain a plurality of intermediate pictures.
The switching chip receives a target picture transmitted by the AP chip through the DSI interface, then reads the target picture line by line, and if the AP chip is spliced according to the row direction to obtain a spliced image, the switching chip demultiplexes the target picture into a plurality of intermediate pictures according to the row direction; and if the AP chip is spliced according to the column direction to obtain a spliced image, the switching chip demultiplexes the target picture into a plurality of intermediate pictures according to the column direction. Thereby, the intermediate pictures are divided to obtain a plurality of intermediate pictures. Wherein the split position of the intermediate picture can be notified to the switching chip by the AP chip by sending a control signal.
S620, comparing the resolutions of the plurality of intermediate pictures with a plurality of target resolutions respectively, wherein the target resolution is the screen resolution of a target screen corresponding to the intermediate pictures.
Specifically, in order to enable the display screen to normally display the screen picture, the switching chip may compare the resolution of the intermediate picture with a plurality of target resolutions respectively to determine whether the intermediate picture is subjected to the compression processing and/or the width-height conversion processing.
S630, if the resolution of the intermediate picture is different from the target resolution, adjusting the resolution of the intermediate picture to obtain a plurality of screen pictures, wherein the resolution of the screen pictures is the same as the target resolution.
Wherein the target resolution is a screen resolution of a display screen. By comparing the resolution of the intermediate picture with the target resolution, the intermediate picture that needs resolution adjustment can be determined.
Optionally, the adjusting the resolution of the intermediate picture includes: if the resolution width of the intermediate picture is smaller than the width of the target resolution, adjusting the resolution of the intermediate picture to the width of the target resolution; and if the resolution height of the intermediate picture is smaller than the height of the target resolution, adjusting the resolution height of the intermediate picture to the height of the target resolution.
For example, if the resolution of the screen picture generated by the AP chip is the same as the screen resolution of the corresponding display screen, the switching chip may decompress the compressed intermediate picture, and perform the high-width ratio restoration processing on the intermediate picture subjected to the high-width ratio conversion, so as to directly obtain the screen picture with the same screen resolution of the corresponding display screen.
For example, if the resolution of the screen picture generated by the AP chip is different from the resolution of the screen corresponding to the display screen, the switching chip may adjust the resolution of the screen picture after performing decompression processing and/or restoration processing of a high width ratio so that the final resolution of the screen picture is the same as the resolution of the screen corresponding to the display screen, or may directly send the screen picture to the display screen for display.
Specifically, if any one of the intermediate pictures is subjected to linear pixel compression or chroma compression, the intermediate picture subjected to pixel compression is subjected to linear de-filtering and upsampling line by line to complete resolution adjustment, and the intermediate picture subjected to chroma compression (such as conversion from RGB888 to RGB565) is subjected to chroma conversion (such as conversion from RGB565 to RGB888) to complete chroma adjustment. If any one of the plurality of intermediate pictures is subjected to the too wide high ratio conversion, the intermediate pictures which are read line by line and subjected to the too wide high ratio conversion are output line by line according to the normal line width, the wide high ratio recovery is realized, and therefore a plurality of screen pictures are obtained.
For example, as shown in fig. 3a, the switching chip reads the pictures output by the AP chip of the single-screen physical interface line by line, and performs left and right demultiplexing to obtain line by line pixels of the screen picture 1 and the screen picture 2. Then each component of the three color components of RGB of the pixel of the screen picture 1 is decompressed 2 times by using FIR filtering and upsampling method 2 times line by line, and output to the MIPI interface of the screen picture 1 line by line, so that the resolution of the screen picture 1 is restored from 960 × 1080 to 1920 × 1080. For the screen picture 2, 720 pixels are read in line by line, 360 pixels are output to the MIPI interface of the screen 2 line by line, the width and height recovery of the pixels is completed, and the resolution of the screen picture 2 is recovered from 720 × 600 to 360 × 1200. And finally, synchronously displaying the screen picture 1 and the screen picture 2 in a refreshing mode by 60FPS (field programmable gate array) to two screens line by line synchronously.
And S640, respectively sending the multiple screen pictures to the multiple target screens.
After the target picture is adjusted to obtain a plurality of screen pictures, the switching chip can simultaneously send the plurality of screen pictures to the display screens of the interfaces such as the MIPI DSI, the LVDS, the EDp and the like line by line according to a preset frame rate, so that the corresponding screen pictures are respectively displayed on the plurality of display screens.
According to the multi-screen display method, the switching chip divides the received target picture to obtain a plurality of intermediate pictures; comparing the resolutions of the plurality of intermediate pictures with a plurality of target resolutions respectively, wherein the target resolution is the screen resolution of a target screen corresponding to the intermediate pictures; if the resolution of the intermediate picture is different from the target resolution, adjusting the resolution of the intermediate picture to obtain a plurality of screen pictures, wherein the resolution of the screen pictures is the same as the target resolution; and respectively sending a plurality of screen pictures to a plurality of target screens. The AP chip is used for converting the single-screen physical interface output into a multi-channel interface and connecting a plurality of display screens by the aid of the external switching chip, and meanwhile, the target pictures are adjusted into a plurality of screen pictures, and the plurality of screens are respectively sent to the corresponding display screens to be displayed.
Referring to fig. 7, fig. 7 is a flowchart illustrating another multi-screen display method according to an embodiment of the present application, applied to the system shown in fig. 1. As shown in fig. 7, the method includes the following steps.
S710, generating a plurality of screen pictures by the AP chip;
s720, if the total bandwidth required by the pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of a single-screen physical interface, the AP chip compresses the multiple screen pictures to obtain multiple intermediate pictures, and the total bandwidth required by the pixel transmission of the multiple intermediate pictures is less than or equal to the maximum output bandwidth of the single-screen physical interface;
s730, the AP chip splices the intermediate pictures to obtain a target picture;
and S740, the AP chip inputs the target picture to a switching chip through the single-screen physical interface.
The specific implementation manners of S710 to S740 may refer to the implementation manners in fig. 2 to fig. 5, which are not described herein again.
S750, the switching chip divides the received target picture to obtain a plurality of intermediate pictures;
s760, the switching chip compares the resolutions of the intermediate pictures with the target resolutions respectively;
s770, if the resolution of the intermediate picture is different from the target resolution, the switching chip adjusts the resolution of the intermediate picture to obtain the multiple screen pictures;
and S780, the switching chip respectively sends the screen pictures to the target screens.
The specific implementation manner of S750-S780 may refer to the implementation manner in fig. 6, and is not described herein again.
It can be seen that, in the multi-screen display method provided in the embodiment of the present application, for an AP chip of a single-screen physical interface, according to resolution ratios of a plurality of current screen pictures, if a total resolution ratio of the plurality of screen pictures is greater than a single maximum output bandwidth of the AP chip, pixel compression is performed on one or more of the plurality of screen pictures to reduce the resolution ratio or perform overall chromaticity compression, and then the plurality of screen pictures are spliced and synthesized into one image, which is output to a switching chip through the single-screen physical interface. The switching chip firstly demultiplexes the received spliced pictures into a plurality of screen pictures, then carries out resolution adjustment on the screen pictures subjected to pixel compression or carries out chrominance adjustment on the screen pictures subjected to chrominance compression, and then synchronously refreshes and outputs the plurality of processed screen pictures to a plurality of screens line by line for display. The problem that the bandwidth of a single-screen physical interface is insufficient when a plurality of high-resolution screens are connected can be solved, and multi-screen display is achieved through the single-screen physical interface.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the network device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
Referring to fig. 8, fig. 8 is a block diagram illustrating functional units of a multi-panel display apparatus 800 according to an embodiment of the present disclosure, in which the apparatus 800 is applied to a chip, and the apparatus 800 includes: a processing unit 810 and a transceiving unit 820.
In a possible implementation manner, the apparatus 800 is configured to execute the respective procedures and steps corresponding to the AP chip in the indication method.
The processing unit 810 is configured to generate a plurality of screen pictures;
the processing unit 810 is further configured to compress the multiple screen pictures to obtain multiple intermediate pictures if a total bandwidth required for pixel transmission of the multiple screen pictures is greater than a maximum output bandwidth of a single-screen physical interface, where the total bandwidth required for pixel transmission of the multiple intermediate pictures is less than or equal to the maximum output bandwidth of the single-screen physical interface;
the processing unit 810 is further configured to splice the plurality of intermediate pictures to obtain a target picture;
the transceiving unit 820 is configured to input the target picture to a forwarding chip through the single-screen physical interface.
Optionally, in the aspect that if the total bandwidth required for pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of the single-screen physical interface, the multiple screen pictures are compressed to obtain multiple intermediate pictures, the processing unit 810 is specifically configured to:
splicing the plurality of screen pictures according to a first direction to obtain a spliced picture, wherein the first direction is the row direction of the screen pictures; if the resolution multiplied by the frame rate of the spliced image is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution width of the spliced image is larger than the maximum resolution width of the single-screen physical interface, performing pixel compression on the spliced image or at least one screen image along the first direction, or performing chroma compression on the spliced image or at least one screen image to obtain a plurality of intermediate images.
Optionally, in the aspect that if the total bandwidth required for pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of the single-screen physical interface, the multiple screen pictures are compressed to obtain multiple intermediate pictures, the processing unit 810 is specifically configured to:
and if the sum of the resolution widths of the multiple screen pictures is greater than the resolution width corresponding to the maximum output bandwidth of the single-screen physical interface, or if the sum of the resolution heights of the multiple screen pictures is greater than the resolution height corresponding to the maximum output bandwidth of the single-screen physical interface, performing pixel compression or chroma compression on at least one screen picture to obtain multiple intermediate pictures.
Optionally, the processing unit 810 is further configured to: and if the resolution height of the first screen picture is greater than the resolution height corresponding to the maximum output bandwidth of the single-screen physical interface, performing width-to-height ratio conversion on the first screen picture, wherein the multiple screen pictures comprise the first screen picture.
Optionally, if the resolution width of the second screen picture is greater than the resolution width corresponding to the maximum output bandwidth of the single-screen physical interface, performing aspect ratio conversion on the second screen picture, where the multiple screen pictures include the second screen picture.
Optionally, in the aspect that if the total bandwidth required for pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of the single-screen physical interface, the multiple screen pictures are compressed to obtain multiple intermediate pictures, the processing unit 810 is specifically configured to: if the sum of the resolution widths of the multiple screen pictures is larger than the resolution width corresponding to the maximum output bandwidth of the single-screen physical interface, or if the sum of the resolution heights of the multiple screen pictures is larger than the resolution height corresponding to the maximum output bandwidth of the single-screen physical interface, performing pixel compression or chroma compression on at least one screen picture to obtain the multiple intermediate pictures
In another possible implementation manner, the apparatus 800 is configured to execute the respective processes and steps corresponding to the transit chip in the indication method.
The processing unit 810 is configured to segment the received target picture to obtain a plurality of intermediate pictures;
the processing unit 810 is further configured to compare resolutions of the multiple intermediate pictures with a target resolution, where the target resolution is a screen resolution of a target screen corresponding to the intermediate picture;
the processing unit 810 is further configured to adjust the resolution of the intermediate picture to obtain multiple screen pictures if the resolution of the intermediate picture is different from a target resolution, where the resolution of the screen pictures is the same as the target resolution;
the transceiving unit 820 is configured to send the multiple screen pictures to the multiple target screens, respectively.
Optionally, in terms of adjusting the resolution of the intermediate picture, the processing unit 810 is specifically configured to: if the resolution width of the intermediate picture is smaller than the width of the target resolution, adjusting the resolution of the intermediate picture to the width of the target resolution; and if the resolution height of the intermediate picture is smaller than the height of the target resolution, adjusting the resolution height of the intermediate picture to the height of the target resolution.
It should be appreciated that the apparatus 800 herein is embodied in the form of a functional unit. The term "unit" herein may refer to an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (e.g., a shared, dedicated, or group processor) and memory that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that support the described functionality. In an optional example, a person skilled in the art may understand that the apparatus 800 may be embodied as an AP chip and a switch chip in the foregoing embodiment, and the apparatus 800 may be configured to execute each process and/or step corresponding to the AP chip and the switch chip in the foregoing method embodiment, and details are not described here again to avoid repetition.
The device 800 of each of the above schemes has functions of implementing corresponding steps executed by the AP chip and the adaptor chip in the above methods; the functions can be realized by hardware, and the functions can also be realized by executing corresponding software by hardware. The hardware or software comprises one or more modules corresponding to the functions; for example, the transceiving unit 820 may be replaced by a transmitter and a receiver, and the processing unit 810 may be replaced by a processor, which perform transceiving operations and related processing operations in the respective method embodiments, respectively.
Referring to fig. 9, fig. 9 is a schematic structural diagram of a chip according to an embodiment of the present disclosure, where the chip includes: one or more processors, one or more memories, one or more communication interfaces, and one or more programs; the one or more programs are stored in the memory and configured to be executed by the one or more processors.
In one possible implementation, the chip is an AP chip, and the program includes instructions for performing the following steps:
generating a plurality of screen pictures;
if the total bandwidth required by the pixel transmission of the multiple screen pictures is larger than the maximum output bandwidth of a single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures, wherein the total bandwidth required by the pixel transmission of the multiple intermediate pictures is smaller than or equal to the maximum output bandwidth of the single-screen physical interface;
splicing the plurality of intermediate pictures to obtain a target picture;
and inputting the target picture to a switching chip through the single-screen physical interface.
In another possible implementation, the chip is a switch, and the program includes instructions for performing the following steps:
segmenting the received target picture to obtain a plurality of intermediate pictures;
comparing the resolutions of the plurality of intermediate pictures with a plurality of target resolutions respectively, wherein the target resolution is the screen resolution of a target screen corresponding to the intermediate pictures;
if the resolution of the intermediate picture is different from the target resolution, adjusting the resolution of the intermediate picture to obtain a plurality of screen pictures, wherein the resolution of the screen pictures is the same as the target resolution;
and respectively sending the multiple screen pictures to the multiple target screens.
All relevant contents of each scene related to the method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.
It will be appreciated that the memory described above may include both read-only memory and random access memory, and provides instructions and data to the processor. The portion of memory may also include non-volatile random access memory. For example, the memory may also store device type information.
In the embodiment of the present application, the processor of the above apparatus may be a Central Processing Unit (CPU), and the processor may also be other general processors, Digital Signal Processors (DSP), Application Specific Integrated Circuits (ASIC), Field Programmable Gate Arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
It is to be understood that reference to "at least one" in the embodiments of the present application means one or more, and "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone, wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of the singular or plural items. For example, at least one (one) of a, b, or c, may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or multiple.
And, unless stated to the contrary, the embodiments of the present application refer to the ordinal numbers "first", "second", etc., for distinguishing a plurality of objects, and do not limit the sequence, timing, priority, or importance of the plurality of objects. For example, the first information and the second information are different information only for distinguishing them from each other, and do not indicate a difference in the contents, priority, transmission order, importance, or the like of the two kinds of information.
In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The steps of a method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software elements in a processor. The software elements may be located in ram, flash, rom, prom, or eprom, registers, among other storage media that are well known in the art. The storage medium is located in a memory, and a processor executes instructions in the memory, in combination with hardware thereof, to perform the steps of the above-described method. To avoid repetition, it is not described in detail here.
Embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the methods as described in the above method embodiments.
Embodiments of the present application further provide a computer program product including instructions, which, when run on an electronic device, cause the electronic device to perform the method according to any of the above embodiments.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiments of the present application.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially or partially contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server, or a TRP, etc.) to execute all or part of the steps of the method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash disk, ROM, RAM, magnetic or optical disk, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (12)

1. A multi-screen display method is applied to an AP chip, and the method comprises the following steps:
generating a plurality of screen pictures;
if the total bandwidth required by the pixel transmission of the multiple screen pictures is larger than the maximum output bandwidth of a single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures, wherein the total bandwidth required by the pixel transmission of the multiple intermediate pictures is smaller than or equal to the maximum output bandwidth of the single-screen physical interface;
splicing the plurality of intermediate pictures to obtain a target picture;
and inputting the target picture to a switching chip through the single-screen physical interface.
2. The method of claim 1, wherein if the total bandwidth required for pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of a single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures comprises:
splicing the plurality of screen pictures according to a first direction to obtain a spliced picture, wherein the first direction is the row direction of the screen pictures;
if the resolution multiplied by the frame rate of the spliced image is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution width of the spliced image is larger than the maximum resolution width of the single-screen physical interface, performing pixel compression on the spliced image or at least one screen image along the first direction, or performing chroma compression on the spliced image or at least one screen image to obtain a plurality of intermediate images.
3. The method of claim 1, wherein if the total bandwidth required for pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of a single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures comprises:
splicing the plurality of screen pictures according to a second direction to obtain spliced pictures, wherein the second direction is the row direction of the screen pictures;
and if the resolution multiplied by the frame rate of the spliced image is larger than the maximum output bandwidth of the single-screen physical interface and/or the resolution height of the spliced image is larger than the maximum resolution height of the single-screen physical interface, performing pixel compression on the spliced image or at least one screen image along the second direction, or performing chroma compression on the spliced image or at least one screen image to obtain a plurality of intermediate images.
4. The method of claim 1, wherein if the total bandwidth required for pixel transmission of the multiple screen pictures is greater than the maximum output bandwidth of a single-screen physical interface, compressing the multiple screen pictures to obtain multiple intermediate pictures comprises:
and if the sum of the resolution widths of the multiple screen pictures is greater than the resolution width corresponding to the maximum output bandwidth of the single-screen physical interface, or if the sum of the resolution heights of the multiple screen pictures is greater than the resolution height corresponding to the maximum output bandwidth of the single-screen physical interface, performing pixel compression or chroma compression on at least one screen picture to obtain multiple intermediate pictures.
5. The method according to any one of claims 1-4, further comprising:
and if the resolution height of the first screen picture is greater than the resolution height corresponding to the maximum output bandwidth of the single-screen physical interface, performing width-to-height ratio conversion on the first screen picture, wherein the multiple screen pictures comprise the first screen picture.
6. The method according to any one of claims 1-4, further comprising:
and if the resolution width of a second screen picture is larger than the resolution width corresponding to the maximum output bandwidth of the single-screen physical interface, performing width-to-height ratio conversion on the second screen picture, wherein the plurality of screen pictures comprise the second screen picture.
7. A multi-screen display method is applied to a switching chip, and the method comprises the following steps:
segmenting the received target picture to obtain a plurality of intermediate pictures;
comparing the resolutions of the plurality of intermediate pictures with a plurality of target resolutions respectively, wherein the target resolution is the screen resolution of a target screen corresponding to the intermediate pictures;
if the resolution of the intermediate picture is different from the target resolution, adjusting the resolution of the intermediate picture to obtain a plurality of screen pictures, wherein the resolution of the screen pictures is the same as the target resolution;
and respectively sending the multiple screen pictures to the multiple target screens.
8. The method of claim 7, wherein the adjusting the resolution of the intermediate picture comprises:
if the resolution width of the intermediate picture is smaller than the target resolution width, adjusting the resolution width of the intermediate picture to the target resolution width;
and if the resolution height of the intermediate picture is smaller than the target resolution height, adjusting the resolution height of the intermediate picture to the target resolution height.
9. A multi-screen display device applied to an AP chip, the device comprising:
the processing unit is used for generating a plurality of screen pictures;
the processing unit is further configured to compress the multiple screen pictures to obtain multiple intermediate pictures if a total bandwidth required by pixel transmission of the multiple screen pictures is greater than a maximum output bandwidth of a single-screen physical interface, where the total bandwidth required by pixel transmission of the multiple intermediate pictures is less than or equal to the maximum output bandwidth of the single-screen physical interface;
the processing unit is further configured to splice the plurality of intermediate pictures to obtain a target picture;
and the receiving and sending unit is used for inputting the target picture to a switching chip through the single-screen physical interface.
10. A multi-screen display device applied to a switching chip, the device comprising:
the processing unit is used for segmenting the received target picture to obtain a plurality of intermediate pictures;
the processing unit is further configured to compare resolutions of the plurality of intermediate pictures with target resolutions respectively, where the target resolution is a screen resolution of a target screen corresponding to the intermediate pictures;
the processing unit is further configured to adjust the resolution of the intermediate picture to obtain multiple screen pictures if the resolution of the intermediate picture is different from a target resolution, where the resolution of the screen pictures is the same as the target resolution;
and the transceiving unit is used for respectively sending the screen pictures to the target screens.
11. A chip comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-6 or the steps in the method of claim 6 or 7.
12. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program causes a computer to perform the steps of the method according to any one of claims 1-6 or the steps of the method according to claim 6 or 7.
CN202110828380.8A 2021-07-21 2021-07-21 Multi-screen display method and device Pending CN113625982A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110828380.8A CN113625982A (en) 2021-07-21 2021-07-21 Multi-screen display method and device
PCT/CN2021/143413 WO2023000621A1 (en) 2021-07-21 2021-12-30 Multi-screen display method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110828380.8A CN113625982A (en) 2021-07-21 2021-07-21 Multi-screen display method and device

Publications (1)

Publication Number Publication Date
CN113625982A true CN113625982A (en) 2021-11-09

Family

ID=78380473

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110828380.8A Pending CN113625982A (en) 2021-07-21 2021-07-21 Multi-screen display method and device

Country Status (2)

Country Link
CN (1) CN113625982A (en)
WO (1) WO2023000621A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114650372A (en) * 2022-03-16 2022-06-21 展讯通信(上海)有限公司 Dynamic adaptive multi-screen display method, device and system
WO2023000620A1 (en) * 2021-07-21 2023-01-26 展讯通信(上海)有限公司 Multi-screen display method and device
WO2023000621A1 (en) * 2021-07-21 2023-01-26 展讯通信(上海)有限公司 Multi-screen display method and apparatus

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116471216B (en) * 2023-05-26 2024-02-27 南京国兆光电科技有限公司 Hardware platform for MIPI protocol layer verification and verification method thereof
CN117412011A (en) * 2023-11-21 2024-01-16 北京视睿讯科技有限公司 Video processor resolution control method, system, terminal and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101256762A (en) * 2008-03-21 2008-09-03 广东威创视讯科技股份有限公司 Multiple-screen splitting and jointing method and device
CN105653224A (en) * 2015-12-31 2016-06-08 京东方科技集团股份有限公司 Tiled display system and display method thereof
CN107948578A (en) * 2017-12-28 2018-04-20 深圳华望技术有限公司 The method of adjustment and adjusting apparatus of video conferencing system transmission bandwidth and resolution ratio
CN109168041A (en) * 2018-09-26 2019-01-08 深圳壹账通智能科技有限公司 A kind of mobile terminal monitored method and system
CN109992226A (en) * 2017-12-29 2019-07-09 浙江宇视科技有限公司 Image display method and device and spliced display screen
WO2020062498A1 (en) * 2018-09-25 2020-04-02 北京嗨动视觉科技有限公司 Image display method and video processing device
CN111324320A (en) * 2018-12-14 2020-06-23 深圳市智车联技术有限公司 Multi-screen display method and device and SOC system
CN111581408A (en) * 2020-04-27 2020-08-25 北京电信易通信息技术股份有限公司 Super-resolution-based picture storage method and system
CN112423046A (en) * 2020-10-22 2021-02-26 深圳Tcl新技术有限公司 Method, device and equipment for transmitting video data and readable storage medium
CN112565627A (en) * 2020-11-30 2021-03-26 天津津航计算技术研究所 Multi-channel video centralized display design method based on bitmap superposition

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101394926B1 (en) * 2007-07-10 2014-05-15 엘지디스플레이 주식회사 Expandable Display Apparatus Having Multi-Module
CN101404151B (en) * 2008-08-04 2011-11-09 广东威创视讯科技股份有限公司 Multi-screen splicing apparatus and method
CN113625982A (en) * 2021-07-21 2021-11-09 展讯通信(上海)有限公司 Multi-screen display method and device
CN113625981A (en) * 2021-07-21 2021-11-09 展讯通信(上海)有限公司 Multi-screen display method and device

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101256762A (en) * 2008-03-21 2008-09-03 广东威创视讯科技股份有限公司 Multiple-screen splitting and jointing method and device
CN105653224A (en) * 2015-12-31 2016-06-08 京东方科技集团股份有限公司 Tiled display system and display method thereof
CN107948578A (en) * 2017-12-28 2018-04-20 深圳华望技术有限公司 The method of adjustment and adjusting apparatus of video conferencing system transmission bandwidth and resolution ratio
CN109992226A (en) * 2017-12-29 2019-07-09 浙江宇视科技有限公司 Image display method and device and spliced display screen
WO2020062498A1 (en) * 2018-09-25 2020-04-02 北京嗨动视觉科技有限公司 Image display method and video processing device
CN109168041A (en) * 2018-09-26 2019-01-08 深圳壹账通智能科技有限公司 A kind of mobile terminal monitored method and system
CN111324320A (en) * 2018-12-14 2020-06-23 深圳市智车联技术有限公司 Multi-screen display method and device and SOC system
CN111581408A (en) * 2020-04-27 2020-08-25 北京电信易通信息技术股份有限公司 Super-resolution-based picture storage method and system
CN112423046A (en) * 2020-10-22 2021-02-26 深圳Tcl新技术有限公司 Method, device and equipment for transmitting video data and readable storage medium
CN112565627A (en) * 2020-11-30 2021-03-26 天津津航计算技术研究所 Multi-channel video centralized display design method based on bitmap superposition

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023000620A1 (en) * 2021-07-21 2023-01-26 展讯通信(上海)有限公司 Multi-screen display method and device
WO2023000621A1 (en) * 2021-07-21 2023-01-26 展讯通信(上海)有限公司 Multi-screen display method and apparatus
CN114650372A (en) * 2022-03-16 2022-06-21 展讯通信(上海)有限公司 Dynamic adaptive multi-screen display method, device and system

Also Published As

Publication number Publication date
WO2023000621A1 (en) 2023-01-26

Similar Documents

Publication Publication Date Title
CN113625982A (en) Multi-screen display method and device
CN113625981A (en) Multi-screen display method and device
US7030932B2 (en) Apparatus and method for converting multi-source input images
US10402940B2 (en) Method and system for accelerating video preview digital camera
US20120314777A1 (en) Method and apparatus for generating a display data stream for transmission to a remote display
US11463715B2 (en) Image scaling
US7646929B2 (en) Signal-transmitting system, data-transmitting apparatus and data-receiving apparatus
CN105657485A (en) Audio/video playing equipment
CN110569013B (en) Image display method and device based on display screen
GB2526773A (en) Video signal transmission
WO2020248838A1 (en) Display apparatus and method for driving same
CN114020228A (en) Screen display method and device
CN111988552B (en) Image output control method and device and video processing equipment
CN112650460A (en) Media display method and media display device
CN111554248A (en) Liquid crystal display chip
CN112492247A (en) Video display design method based on LVDS input
JP2015096920A (en) Image processor and control method of image processing system
US7885487B2 (en) Method and apparatus for efficiently enlarging image by using edge signal component
EP2693426A1 (en) Display apparatus, image post-processing apparatus and method for image post-processing of contents
CN114782250A (en) Video image processing method and device, electronic equipment and storage medium
CN105407311A (en) Television receiving signal processing method and device
CN113377313A (en) Multi-screen multiplexing display device and method
US8488897B2 (en) Method and device for image filtering
CN106658056B (en) Nonlinear editing system, device and method
CN108243293B (en) Image display method and system based on virtual reality equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20211109

RJ01 Rejection of invention patent application after publication