CN112243149B - Method, device and system for displaying ultra-wide picture - Google Patents
Method, device and system for displaying ultra-wide picture Download PDFInfo
- Publication number
- CN112243149B CN112243149B CN201910655109.1A CN201910655109A CN112243149B CN 112243149 B CN112243149 B CN 112243149B CN 201910655109 A CN201910655109 A CN 201910655109A CN 112243149 B CN112243149 B CN 112243149B
- Authority
- CN
- China
- Prior art keywords
- picture
- multimedia
- ultra
- wide
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides a method, a device and a system for displaying an ultra-wide picture, wherein the method comprises the following steps: drawing more than one multimedia resource in a first canvas to obtain an ultra-wide multimedia drawing source; drawing a multimedia resource corresponding to the ultra-wide multimedia drawing source in a second canvas according to the output resolution to obtain an output drawing source; and each display device acquires the output picture source, displays the corresponding picture block, and performs splicing fusion display. Through the scheme, the multimedia resources corresponding to the ultra-wide multimedia drawing source are drawn in the second canvas, so that the real-time rendering of the multimedia resources is realized, and compared with a mode of completely replacing the multimedia drawing source, the calculation amount is reduced, and the processing efficiency is improved.
Description
Technical Field
The invention relates to the technical field of multimedia information, in particular to a method and a device for displaying an ultra-wide picture and electronic equipment.
Background
The currently popular HDMI2.0 or 1.4/1.3 version interface has the highest display resolution of 3840x2160, and many special scenes need to display ultra-wide pictures, especially scenes that are fused and displayed by using a projector, often need to display ultra-wide pictures of 5: 1(5400x1080) or even 8: 1(8640x 720).
In order to solve the above problems, one scheme is to compress the picture into 3840x960 or even 3840x480 resolution, divide the super-wide picture into pictures, and output the pictures to each projector through a plurality of HDMI interfaces for display, so that the display pictures of a plurality of projectors are fused and spliced into a larger picture to form fused projection, thereby providing a wider and more shocking visual experience. By the scheme and method for compressing, cutting and fusing the pictures, details of a plurality of pictures can be lost, and the ultra-large bandwidth of the HDMI interface is wasted.
Yet another solution is: cutting the ultra-wide multimedia source into a plurality of picture blocks; and in the display size range of the display device, taking the width value of the resolution of the ultra-wide multimedia source as a picture block cutting width value; in the multimedia interface display size range, equally dividing the length value of the resolution of the ultra-wide multimedia source as the picture block cutting length value; and sequentially layering the drawing blocks to be recombined into an output drawing source which accords with the display size range of the multimedia interface. Although the scheme can realize the fusion display of the ultra-wide pictures in a relatively economic way, the scheme is limited by the display size of the multimedia interface, the ultra-wide multimedia picture source is directly spliced with the picture blocks after being cut into the picture blocks, and then the spliced picture is directly sent to a plurality of display devices for splicing and fusion display. After the multimedia source is cut and spliced, new component elements cannot be rendered on the blocks, if new component elements need to be additionally displayed, the new component elements need to be rendered on the original ultra-wide picture again, an ultra-wide picture needs to be rendered again, and the newly rendered ultra-wide picture is cut and recombined, so that the operation resources are wasted, and the processing efficiency is also reduced.
Therefore, how to achieve fusion display of ultra-wide pictures in an economic manner by using fewer multimedia interfaces under the condition of ensuring the picture quality of the multimedia source as much as possible, and simultaneously, how to update the multimedia resources for displaying the fusion interface in real time is a big problem troubling the technical personnel in the field.
Disclosure of Invention
Therefore, a technical scheme for displaying the ultra-wide picture needs to be provided, so as to solve the problems that when the ultra-wide picture is fused and displayed in an economic manner, new component elements cannot be rendered in real time, and the ultra-wide picture display cannot be updated in real time.
In order to achieve the above object, the inventor provides a method for displaying an ultra-wide picture, the method comprising the steps of:
drawing more than one multimedia resource in the first canvas to obtain an ultra-wide multimedia drawing source;
drawing a multimedia resource corresponding to the ultra-wide multimedia picture source in a second canvas according to the output resolution to obtain an output picture source;
and each display device acquires the output picture source, displays the corresponding picture block, and performs splicing fusion display.
Further, the step of drawing more than one multimedia resource in the first canvas to obtain the ultra-wide multimedia drawing source includes:
Establishing a first canvas, constructing a background scene in the first canvas, and drawing more than one multimedia resource on the background scene to obtain an ultra-wide multimedia picture source.
Further, the step of drawing the multimedia resource corresponding to the ultra-wide multimedia drawing source in the second canvas according to the output resolution to obtain the output drawing source includes:
cutting the ultra-wide multimedia picture source into a plurality of picture blocks according to the output resolution;
sequentially layering the drawing blocks to enable the recombined layering drawing blocks to accord with the display size range of the multimedia interface;
and establishing a second canvas according to the area size of the layered drawing block, and drawing corresponding multimedia resources in the corresponding drawing block area to obtain an output drawing source.
Further, when an instruction of adding the display multimedia resource is received, the newly added multimedia resource is drawn to the corresponding picture block area of the second canvas in real time.
Further, the "drawing the newly added multimedia resource to the corresponding drawing block area of the second canvas" includes:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia resource is displayed, the two picture blocks are considered to have a display boundary;
if the two picture blocks are not adjacent in the output picture source and the content or the whole content in the ultra-wide multimedia resource is repeated, the two picture blocks are considered to have a fusion area;
If the new multimedia resource width is located in the fusion area, step S11 is executed: respectively drawing new multimedia resources for the corresponding areas of the two picture blocks with the fusion area;
if the newly added multimedia resource width crosses the display boundary of two blocks with display boundaries, execute step S12: cutting the newly added multimedia resources according to the display boundary, wherein each picture block correspondingly draws part of the newly added multimedia resources positioned in the cut picture block;
if the newly added multimedia resource width spans the blending region of a tile and the tile adjacent to the tile, then step S2 is executed: cutting the newly added multimedia resources according to the boundary between the fusion area and the adjacent picture block, and drawing and cutting the part of the newly added multimedia resources in the picture block after the adjacent picture block is cut; and the two picture blocks with the fusion area draw and cut the corresponding area and then the part of the two picture blocks with the fusion area is added with multimedia resources.
Further, the "drawing the newly added multimedia resource to the corresponding drawing block area of the second canvas" includes:
when the width of the newly added multimedia resource does not intersect with the fusion area of the two blocks or the display boundaries of the two blocks having the display boundaries, executing step S3:
S3: and directly drawing the newly added multimedia resource in the drawing area of the newly added multimedia resource on the drawing block.
Further, when an instruction of moving or scaling the newly added multimedia resource is received, the newly added multimedia resource is drawn to the corresponding picture block area of the moved or scaled second canvas according to any one of the operations of the step S11, the step S12, the step S2 and the step S3.
Further, the number of the newly added multimedia resources is more than one, and the newly added multimedia resources include one or more of the following: h5 page, video, picture, photo, text, or wine list.
Further, after the step of drawing the newly added multimedia resource to the corresponding drawing block area of the second canvas, the following steps are included: and sending the redrawn output picture source to more than two display devices in real time, wherein each display device displays the picture block area corresponding to the display device in the output picture source, and updating and displaying the picture block areas after splicing and fusing the picture block areas.
The inventors also provide an apparatus for ultra-wide visual display, which processes multimedia assets according to the method as described above.
The inventor also provides a system for displaying the ultra-wide picture, which comprises an apparatus for displaying the ultra-wide picture and more than two display devices, wherein each display device is respectively connected with the apparatus;
Each display device is used for broadcasting the corresponding picture block area in the output picture source and splicing, fusing and displaying each picture block area;
the device is as described hereinbefore.
The display method, the device and the system of the ultra-wide picture in the technical scheme have the following steps: drawing more than one multimedia resource in a first canvas to obtain an ultra-wide multimedia drawing source; drawing a multimedia resource corresponding to the ultra-wide multimedia drawing source in a second canvas according to the output resolution to obtain an output drawing source; and each display device acquires the output picture source, displays the corresponding picture block, and performs splicing fusion display. By the scheme, the multimedia resource corresponding to the ultra-wide multimedia picture source is drawn in the second canvas, so that the real-time updating drawing of the multimedia resource is realized, and the display content of the ultra-wide picture can be updated in real time; meanwhile, compared with a processing mode of completely replacing the multimedia drawing source, the method reduces the calculation amount and improves the processing efficiency.
Drawings
Fig. 1 is a schematic diagram of super-wide frame cutting and reorganization according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating an ultra-wide frame slice reconstruction according to another embodiment of the present invention;
FIG. 3 is a diagram illustrating an ultra-wide frame slice reconstruction according to another embodiment of the present invention;
FIG. 4 is a diagram illustrating an ultra-wide frame slice reconstruction according to another embodiment of the present invention;
FIG. 5 is a flowchart illustrating a method for displaying an ultra-wide frame according to an embodiment of the present invention;
FIG. 6 is a diagram of an ultra-wide view display device according to an embodiment of the present invention;
fig. 7 is a flowchart of a method for displaying an ultra-wide frame according to an embodiment of the present invention.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
At present, a multimedia interface on the market generally supports display of 4K resolution ratio to the maximum, when an ultra-wide resolution ratio picture needs to be output, scaling is usually performed on the basis of the original picture proportion, and although it is ensured that an output picture source meets the requirement of the length-width ratio of the ultra-wide picture, the resolution ratio of the output picture source is sacrificed, and the sensory experience of a user is influenced. In order to ensure that the resolution of the output picture source is not lost, the invention firstly cuts the ultra-wide picture according to the output resolution and then recombines the ultra-wide picture, thereby ensuring that the resolution of the output picture source is not lost, and simultaneously solving the problems of large operation amount and low processing efficiency of rendering operation caused by that the updating display of the ultra-wide picture can only be realized by replacing the whole ultra-wide multimedia picture source in the prior art.
Fig. 5 is a flowchart of a method for performing an operation on an ultra-wide frame according to an embodiment of the present invention. The method comprises the following steps:
firstly, the method proceeds to step S501, in which more than one multimedia resource is drawn in a first canvas, so as to obtain an ultra-wide multimedia drawing source. The ultra-wide multimedia source, as the name implies, refers to a multimedia source with a large length-width ratio, for example, a conventional display device can only output an image with a resolution of 3840x2160 at most, while the ultra-wide multimedia source in the present invention refers to a multimedia source with a resolution in the long direction exceeding 3840, or a multimedia source with a resolution in the wide direction exceeding 2160, for example, an image or a video with a resolution of 6720x1080 or 8960x720 to be output.
The first canvas is a drawing area of a multimedia resource, and because an ultra-wide multimedia drawing source needs to be drawn, and the display size of the existing multimedia interface cannot realize the drawing of the ultra-wide multimedia drawing source, in the embodiment, the first canvas is a virtual drawing area, and the size of the virtual drawing area is not smaller than that of the ultra-wide multimedia drawing source. The drawn multimedia resources can be pictures, videos, characters and the like. Preferably, a background image of the fusion display interface is drawn on the first canvas.
And then step S502 is carried out, the multimedia resource corresponding to the ultra-wide multimedia picture source is drawn in the second canvas according to the output resolution ratio, and the output picture source is obtained. The output resolution is the resolution of the final spliced and fused display picture, and the output resolution can be configured in advance. The size of the second canvas meets the requirements of the output size of the multimedia interface. And the multimedia resources corresponding to the ultra-wide multimedia drawing source are drawn on the second canvas, so that the multimedia resources in the ultra-wide multimedia drawing source are redrawn into the second canvas which accords with the output size of the multimedia interface.
In the actual manufacturing process, when the ultra-wide multimedia picture source is displayed for the first time, the multimedia resources drawn on the first canvas are the same as the multimedia resources drawn by the second canvas. Therefore, after the multimedia resources are drawn by the first canvas, the drawing data is stored in the display memory, and when the multimedia resources are drawn again in the second canvas, the drawing data only needs to be read from the display memory and copied to the corresponding position. In the subsequent display process, when the display content needs to be updated, for example, when a new multimedia resource is additionally displayed, the multimedia resource needing to be updated and displayed is only required to be drawn on the second canvas in real time in the drawing process of the second canvas.
And then, in step S503, each display device acquires an output picture source, displays the corresponding picture blocks, and performs splicing, fusion and display. Because the aspect ratio of the output picture source is large, the length is long, and a single display device cannot completely play the multimedia picture source, more than two display devices are needed to respectively intercept a certain segment of the picture source, and play the picture after splicing and fusing, so that the displayed picture meets the requirement of the ultra-wide picture source. In the practical application process, after each display device can receive the complete output picture source, the display device respectively intercepts a part of multimedia picture sources to be played, and then splices, fuses and displays the part of multimedia picture sources played by each display device. Each display device can also only receive a part of multimedia picture sources which need to be played, and then the part of multimedia picture sources played by each display device are spliced, fused and displayed.
Taking 3 display devices as an example, as shown in fig. 6, the display device includes a display device 1, a display device 2, and a display device 3, and in an actual use process, after the display devices 1, 2, and 3 respectively receive an output picture source (resolution is 6720x1080), respectively intercept data of resolutions 2880x1080, 960x1080, and 2880x1080, and splice and merge the three, and then project and play the data. Preferably, the fusion display interface of the projection playing is in an L shape or a surrounding shape of 360 degrees, and the fusion display interface can be played on scene canvas or directly projected on a wall for playing.
In order to improve the drawing efficiency, in some embodiments, the step of "drawing more than one multimedia resource in the first canvas to obtain an ultra-wide multimedia picture source" includes: establishing a first canvas, constructing a background scene in the first canvas, and drawing more than one multimedia resource on the background scene to obtain an ultra-wide multimedia picture source. Therefore, the new multimedia resources are added in the background scene constructed in the first canvas, and the drawing efficiency is effectively improved. In other embodiments, a plurality of background scenes can be pre-stored, so that when the background scenes need to be replaced, the pre-stored background scenes are directly called, the background scenes can be quickly drawn in the first canvas, and the drawing efficiency is improved.
In some embodiments, as shown in fig. 7, the "drawing, in the second canvas, the multimedia resource corresponding to the ultra-wide multimedia image source according to the output resolution to obtain the output image source" includes:
firstly, the method proceeds to step S701, and cuts the ultra-wide multimedia picture source into a plurality of picture blocks according to the output resolution. For example, in fig. 1, the output resolution is 6720x1080, and the output resolution can be cut into A, B, C three blocks, and the resolutions corresponding to the three blocks are 2880x1080, 960x1080 and 2880x1080, respectively.
Then, step S702 is performed to sequentially list the tiles, so that the rearranged tiles conform to the display size range of the multimedia interface. In this embodiment, the multimedia interface display size refers to a maximum size range in which a multimedia resource can be displayed on a display device. The recombined output picture source accords with the display size range of the multimedia interface, and the real-time rendering of the multimedia resource can be feasible, so that the operation resource is saved, and the processing efficiency is improved (the original ultra-wide picture exceeds the display size, and the newly added multimedia resource cannot be directly drawn in the display size range of the multimedia interface under the condition of ensuring the output resolution ratio).
As shown in fig. 1, an output picture source with a resolution of 6720x1080 is cut into A, B, C three block areas, wherein the resolutions of the three block areas are 2880x1080, 960x1080 and 2880x1080 respectively, and then the three block areas are layered into a picture block a and a picture block B in the same layer and serve as an upper layer; and the paintings B 'and C are arranged on the same layer and serve as a lower layer, wherein the display contents of the paintings B and B' are the same, so that the spliced paintings conform to the resolution of the multimedia output interface 3840x 2160.
As shown in fig. 2, the output frame source with a resolution of 6720 × 1080 is also cut, and the cutting scheme and the recombination scheme are the same as those in fig. 1.
As shown in fig. 3, the output source with the resolution of 8960x720 is cut into A, B, C, D, E five block areas, the resolutions of the five block areas are 2560x720, 1280x720 and 2560x720 respectively, and then the block a and the block B are layered in the same layer and used as the first layer; the picture blocks B ', C and D are arranged on the same layer and serve as a second layer, and the picture blocks D' and E are arranged on the same layer and serve as a third layer, wherein the display contents of the picture blocks B and B 'are the same, and the display contents of the picture blocks D and D' are the same, so that the spliced picture blocks conform to the resolution of the multimedia output interface 3840x 2160.
As shown in fig. 4, the output frame source with a resolution of 7680x1080 is cut into A, B, C, D four frame areas, the resolutions corresponding to the four frame areas are 2880x1080, 960x1080 and 2880x1080, and then the frame block a and the frame block B are layered and used as a first layer; and the picture blocks C and D are in the same layer and are used as a second layer, so that the spliced picture blocks conform to the resolution of the multimedia output interface 3840x 2160.
As also shown in fig. 6, the output frame with a resolution of 7680 × 1080 is divided into A, B, C, D four frame areas, which are divided and rearranged in the same way as in fig. 4. The difference from fig. 4 is that: a blend region exists for the picture pane A and the picture pane B, and a blend region also exists for the picture pane C and the picture pane D.
And then step S703 is performed to establish a second canvas according to the area size of the layered drawing block, and draw the corresponding multimedia resource in the corresponding drawing block area, so as to obtain the output drawing source. The second canvas is established according to the area size of the layered drawing blocks, the arrangement of the layered drawing blocks accords with the display size of the multimedia interface, when the multimedia resource is drawn, the whole ultra-wide multimedia drawing source does not need to be replaced, the real-time drawing of the multimedia resource can be realized, and the processing efficiency is improved.
In some embodiments, when an instruction to add a display multimedia resource is received, the newly added multimedia resource is drawn to the corresponding block area of the second canvas in real time.
Taking fig. 1 as an example, when an instruction is received to add a certain picture to the a picture block, the newly added picture is drawn in the a picture block in the second canvas (the drawing area corresponding to the arrangement of the layered picture blocks) in real time; when an instruction of displaying a certain picture on the C picture block is received, the newly-added picture is drawn into the C picture block in the second canvas (a drawing area corresponding to the arrangement of the layered picture blocks) in real time; when an instruction of displaying a certain picture on the B picture block is received, the newly added picture is simultaneously drawn into the B picture block and the B' picture block (the drawing area corresponding to the arrangement of the layer picture blocks) in the second canvas.
In some embodiments, said "drawing the newly added multimedia resource to the corresponding drawing block area of the second canvas" comprises:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia resource is displayed, the two picture blocks are considered to have a display boundary;
if the two picture blocks are not adjacent in the output picture source and the content or the whole content in the ultra-wide multimedia resource is repeated, the two picture blocks are considered to have a fusion area;
if the newly added multimedia resource width is located in the fusion area, execute step S11: respectively drawing new multimedia resources for the corresponding areas of the two picture blocks with the fusion area;
if the newly added multimedia resource width crosses the display boundary of two blocks with display boundaries, execute step S12: and cutting the newly added multimedia resources according to the display boundary, wherein each picture block correspondingly draws part of the newly added multimedia resources positioned in the cut picture block.
For example, in a certain application scene, a picture needs to be drawn on the second canvas, and the adding position of the picture is located in the shadow portion (i.e., the blending region) of the first layer B picture block in fig. 1, then when the picture is drawn to the shadow portion (i.e., the blending region) of the first layer B picture block, the shadow portion of the second layer B' picture block is also correspondingly drawn, so that the picture is drawn and rendered in real time.
Similarly, when the picture block in the upper column of fig. 4 receives a picture adding instruction, and when the added picture position crosses B, C two picture blocks, the picture is divided into two parts according to the display boundary of B, C picture blocks (the right boundary of the B picture block and the left boundary of the C picture block are the display boundary between the two picture blocks) when the picture is drawn, one part of the picture is drawn and displayed on the right boundary of the B picture block, and the other part of the picture is drawn and displayed on the left boundary of the C picture block, so that the picture can be completely displayed when the picture is spliced and fused. In addition, the adding operation of the picture is carried out in the second canvas, and the size of the second canvas conforms to the display size of the multimedia interface, so that the adding display of the newly added multimedia resource is realized under the condition of ensuring that the resolution of the output picture source is not lost.
In some embodiments, if the new multimedia resource width spans the blending region of a tile and the tiles adjacent to the tile, step S2 is executed: cutting the newly added multimedia resources according to the boundary between the fusion area and the adjacent picture block, and drawing and cutting the part of the newly added multimedia resources in the picture block after the adjacent picture block is cut; and the two picture blocks with the fusion area draw and cut the corresponding area and then the part of the two picture blocks with the fusion area is added with multimedia resources.
Taking fig. 2 as an example, the current blending region is a B picture block and a B 'picture block, the size of the current blending region is a B picture block, and the B picture block and the B' picture block have the same size, when a picture is added between the picture block a and the picture block B, since the width of the picture spans the B picture block (i.e., the blending region) and is adjacent to the a picture block (i.e., the picture block adjacent to the B picture block), step S2 will be executed: the picture is cut according to display boundaries among A, B picture blocks, and then corresponding cut parts are correspondingly drawn on A, B picture blocks, wherein when the part of the picture is drawn on a B picture block, the picture part drawn on the B picture block is also drawn on a B' picture block synchronously. Therefore, when the width of the drawn picture passes through the junction of the A picture block and the B picture block, the picture drawn in real time can be smoothly displayed on the ultra-wide picture, and the situation that the adding operation of the picture cannot be carried out due to the limitation of the display size of the multimedia interface is avoided.
In some embodiments, said "drawing the newly added multimedia resource to the corresponding drawing block area of the second canvas" comprises: when the width of the newly added multimedia resource does not intersect with the fusion area of the two tiles or the display boundary of the two tiles with the display boundary, step S3 is executed:
S3: and directly drawing the newly added multimedia resource in the drawing area of the newly added multimedia resource on the drawing block.
Also taking the new picture as an example, if the added picture position is completely located in the a block or the B block in fig. 2, or there is no intersection with the shaded portion in fig. 1, there is no case that the added picture width crosses the display boundary or the blending region, and the picture will be directly drawn on the current block during drawing.
In order to ensure that the rendered dynamic multimedia resource can also be displayed in the merged display interface, in some embodiments, when an instruction to move or scale the new multimedia resource is received, the new multimedia resource is rendered into a corresponding tile area of the moved or scaled second canvas according to any one of the operations in step S11, step S12, step S2, and step S3. Taking the drawing picture movement as an example, the picture movement effect is presented by the slight change of the positions of the multi-frame images, and then the corresponding processing is sequentially carried out according to the positions of the pictures in the current frame when the multi-frame images corresponding to the picture are drawn.
Specifically, when the position of the picture in the current frame does not intersect with the fusion area of some two picture blocks or the display boundary of the two picture blocks having the display boundary, the picture is directly drawn in the current picture block, that is, the processing is executed according to step S3; when the position of the picture in the current frame intersects with the blending area of a certain two tiles or the display boundary of the two tiles having the display boundary, the processing is performed according to the above steps S11, S12, and S2.
Preferably, the number of the newly added multimedia resources is more than one, and the newly added multimedia resources include one or more of the following: h5 page, video, picture, photo, text, or wine list. When the received instruction is an instruction for scaling a newly added picture, or the multimedia resource is other multimedia resources listed above except for the picture, the corresponding drawing processing mode is similar to the processing mode for moving the newly added picture, and details are not repeated here.
In some embodiments, the step of "drawing the newly added multimedia resource to the corresponding picture block area of the second canvas" further comprises the following steps: and sending the redrawn output picture source to more than two display devices in real time, wherein each display device displays the picture block area corresponding to the display device in the output picture source, and updating and displaying the picture block areas after splicing and fusing the picture block areas. For example, the newly added and drawn multimedia resource is a drinking water list, the drinking water list is newly added and drawn on the basis of the original output picture source at the current output picture source, and the output picture source containing the drinking water list is displayed in the spliced and fused display picture.
For another example, if the newly added multimedia resource is to newly display a plurality of videos, the newly added videos are displayed in real time in the fusion displayed picture after the newly added videos are drawn to the second canvas, so that the multi-screen interaction effect can be realized. For another example, if the newly added multimedia resource is a series of photos and the effect of moving the series of photos from one end of the interface to the other end is realized, the effect of moving the series of photos from one end of the interface to the other end of the interface is realized by drawing the series of frame pictures of the series of photos moving on the second canvas in real time.
The inventors also provide an apparatus for ultra-wide visual display, which processes multimedia assets according to the method as described above.
The inventor also provides a system for displaying the ultra-wide picture, which comprises an apparatus for displaying the ultra-wide picture and more than two display devices, wherein each display device is respectively connected with the apparatus;
each display device is used for broadcasting the corresponding picture block area in the output picture source and splicing, fusing and displaying each picture block area;
the device is as described hereinbefore.
The invention provides a method, a device and a system for displaying an ultra-wide picture, wherein the method comprises the following steps: drawing more than one multimedia resource in a first canvas to obtain an ultra-wide multimedia drawing source; drawing a multimedia resource corresponding to the ultra-wide multimedia drawing source in a second canvas according to the output resolution to obtain an output drawing source; and each display device acquires the output picture source, displays the corresponding picture block, and performs splicing fusion display. Through the scheme, the multimedia resources corresponding to the ultra-wide multimedia drawing source are drawn in the second canvas, so that the real-time rendering of the multimedia resources is realized, and compared with a mode of completely replacing the multimedia drawing source, the calculation amount is reduced, and the processing efficiency is improved.
It should be noted that, although the above embodiments have been described herein, the scope of the present invention is not limited thereby. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.
Claims (9)
1. A method for ultra-wide screen display, the method comprising the steps of:
drawing more than one multimedia resource in a first canvas to obtain an ultra-wide multimedia drawing source;
drawing a multimedia resource corresponding to the ultra-wide multimedia drawing source in a second canvas according to the output resolution to obtain an output drawing source;
each display device obtains an output picture source, displays the corresponding picture blocks, and performs splicing fusion display;
the step of drawing the multimedia resource corresponding to the ultra-wide multimedia drawing source in the second canvas according to the output resolution ratio to obtain the output drawing source comprises the following steps: cutting the ultra-wide multimedia picture source into a plurality of picture blocks according to the output resolution; sequentially layering the drawing blocks to enable the recombined layering drawing blocks to accord with the display size range of the multimedia interface; establishing a second canvas according to the area size of the layered drawing block, and drawing corresponding multimedia resources in the corresponding drawing block area to obtain an output drawing source;
And when an instruction of adding and displaying the multimedia resources is received, the newly added multimedia resources are drawn to the corresponding drawing block area of the second canvas in real time.
2. The method for displaying an ultra-wide frame according to claim 1, wherein said rendering more than one multimedia resource in a first canvas to obtain an ultra-wide multimedia frame source comprises:
establishing a first canvas, constructing a background scene in the first canvas, and drawing more than one multimedia resource on the background scene to obtain an ultra-wide multimedia picture source.
3. The method for displaying super-wide frames according to claim 1, wherein said step of drawing the new multimedia resource to the corresponding frame area of the second canvas comprises:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia resource is displayed, the two picture blocks are considered to have a display boundary;
if the two picture blocks are not adjacent in the output picture source and the content or the whole content in the ultra-wide multimedia resource is repeated, the two picture blocks are considered to have a fusion area;
if the new multimedia resource width is located in the fusion area, step S11 is executed: respectively drawing new multimedia resources for the corresponding areas of the two picture blocks with the fusion area;
If the newly added multimedia asset width crosses the display boundary of two tiles with display boundaries, step S12 is executed: cutting the newly added multimedia resources according to the display boundary, wherein each picture block correspondingly draws and cuts part of the newly added multimedia resources in the picture block;
if the newly added multimedia asset width spans the blending region of a tile and the tile adjacent to the tile, execute step S2: cutting the newly added multimedia resources according to the boundary of the fusion area and the adjacent picture blocks, and drawing and cutting the adjacent picture blocks and then adding the part of the newly added multimedia resources in the picture blocks; and the two picture blocks with the fusion area draw and cut the corresponding area and then the part of the two picture blocks with the fusion area is added with multimedia resources.
4. The method of ultrawide frame display of claim 3, wherein said drawing the newly added multimedia asset to the corresponding block area of the second canvas comprises:
when the width of the newly added multimedia resource does not intersect with the fusion area of the two blocks or the display boundaries of the two blocks having the display boundaries, executing step S3:
s3: and directly drawing the newly added multimedia resource in the drawing area of the newly added multimedia resource on the drawing block.
5. The method of displaying an ultra-wide screen according to claim 4, wherein when an instruction to move or zoom the newly added multimedia asset is received, the newly added multimedia asset is drawn to a corresponding block area of the moved or zoomed second canvas according to any one of the operations of the step S11, the step S12, the step S2 and the step S3.
6. The method for displaying ultra-wide frames according to any one of claims 1-5, wherein the number of the newly added multimedia resources is more than one, and the newly added multimedia resources comprise one or more of the following: h5 page, video, picture, photo, text, or wine list.
7. The method for ultra-wide screen display according to any of claims 1-5, wherein the step of drawing the newly added multimedia resource to the corresponding block area of the second canvas further comprises the steps of: and sending the redrawn output picture source to more than two display devices in real time, wherein each display device displays the picture block area corresponding to the display device in the output picture source, and updating and displaying the picture block areas after splicing and fusing the picture block areas.
8. An apparatus for ultrawide visual display, characterized in that the apparatus processes a multimedia asset according to the method of any one of claims 1 to 7.
9. The system for displaying the ultra-wide picture is characterized by comprising an ultra-wide picture display device and more than two display devices, wherein each display device is respectively connected with the device;
each display device is used for broadcasting a picture block area corresponding to the display device in the output picture source and splicing, fusing and displaying each picture block area;
the apparatus is as claimed in claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910655109.1A CN112243149B (en) | 2019-07-19 | 2019-07-19 | Method, device and system for displaying ultra-wide picture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910655109.1A CN112243149B (en) | 2019-07-19 | 2019-07-19 | Method, device and system for displaying ultra-wide picture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112243149A CN112243149A (en) | 2021-01-19 |
| CN112243149B true CN112243149B (en) | 2022-05-27 |
Family
ID=74167464
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910655109.1A Active CN112243149B (en) | 2019-07-19 | 2019-07-19 | Method, device and system for displaying ultra-wide picture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112243149B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101184217A (en) * | 2007-12-14 | 2008-05-21 | 华南理工大学 | Wireless ultra-broadband combination type high resolution large screen display method and apparatus |
| CN103135955A (en) * | 2012-10-17 | 2013-06-05 | 深圳市骄阳数字图像技术有限责任公司 | Splicing screen synchronizer with a large resolution ratio |
| CN103312989A (en) * | 2013-06-04 | 2013-09-18 | 天津朗合数字科技有限公司 | Graphic image mosaic and fusion system |
| CN103686388A (en) * | 2012-09-12 | 2014-03-26 | 武汉麦塔威科技有限公司 | Video player system capable of playing ultrahigh resolution video |
| CN106060630A (en) * | 2016-06-06 | 2016-10-26 | 深圳市金嵘达科技有限公司 | LCD splicing control system capable of realizing synchronization |
| WO2018076560A1 (en) * | 2016-10-27 | 2018-05-03 | 深圳市元征科技股份有限公司 | Picture display method and apparatus |
| CN109819180A (en) * | 2019-01-18 | 2019-05-28 | 上海皓空数码科技有限公司 | A kind of ultra-wide picture fusion display methods and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8520970B2 (en) * | 2010-04-23 | 2013-08-27 | Flir Systems Ab | Infrared resolution and contrast enhancement with fusion |
-
2019
- 2019-07-19 CN CN201910655109.1A patent/CN112243149B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101184217A (en) * | 2007-12-14 | 2008-05-21 | 华南理工大学 | Wireless ultra-broadband combination type high resolution large screen display method and apparatus |
| CN103686388A (en) * | 2012-09-12 | 2014-03-26 | 武汉麦塔威科技有限公司 | Video player system capable of playing ultrahigh resolution video |
| CN103135955A (en) * | 2012-10-17 | 2013-06-05 | 深圳市骄阳数字图像技术有限责任公司 | Splicing screen synchronizer with a large resolution ratio |
| CN103312989A (en) * | 2013-06-04 | 2013-09-18 | 天津朗合数字科技有限公司 | Graphic image mosaic and fusion system |
| CN106060630A (en) * | 2016-06-06 | 2016-10-26 | 深圳市金嵘达科技有限公司 | LCD splicing control system capable of realizing synchronization |
| WO2018076560A1 (en) * | 2016-10-27 | 2018-05-03 | 深圳市元征科技股份有限公司 | Picture display method and apparatus |
| CN109819180A (en) * | 2019-01-18 | 2019-05-28 | 上海皓空数码科技有限公司 | A kind of ultra-wide picture fusion display methods and system |
Non-Patent Citations (1)
| Title |
|---|
| 边缘融合技术在多媒体系统中的设计和实现;刘玉梅;《数字技术与应用》;20180405(第04期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112243149A (en) | 2021-01-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110351592B (en) | Animation presentation method and device, computer equipment and storage medium | |
| CN107678722B (en) | Multi-screen splicing method and device and multi-projection spliced large screen | |
| US7439982B2 (en) | Optimized scene graph change-based mixed media rendering | |
| CN108108140B (en) | Multi-screen cooperative display method, storage device and equipment supporting 3D display | |
| KR100335306B1 (en) | Method and apparatus for displaying panoramas with streaming video | |
| TWI542190B (en) | Method and system for encoding a 3d image signal, encoded 3d image signal, method and system for decoding a 3d image signal | |
| CN107197341B (en) | Dazzle screen display method and device based on GPU and storage equipment | |
| EP3660781A1 (en) | Image stitching method and device, and storage medium | |
| US11783445B2 (en) | Image processing method, device and apparatus, image fitting method and device, display method and apparatus, and computer readable medium | |
| US10623609B1 (en) | Virtual video environment display systems | |
| KR20140030111A (en) | Pseudo-3d forced perspective methods and devices | |
| US20110175988A1 (en) | 3d video graphics overlay | |
| KR20120037400A (en) | Viewer-centric user interface for stereoscopic cinema | |
| CN108881873B (en) | Method, device and system for fusing high-resolution images | |
| CN109819180B (en) | Ultra-wide picture fusion display method and system | |
| WO2018113218A1 (en) | Spliced wall display method, device and system | |
| KR101973985B1 (en) | System and method of image rendering through distributed parallel processing for high resolution display | |
| TW201822534A (en) | Panoramic video compression method and device | |
| US8817013B2 (en) | Method for processing a spatial image | |
| CN112583821A (en) | Display method, display system, electronic device, and computer-readable storage medium | |
| CN109587478A (en) | A kind of processing method and processing device of media information | |
| CN113038220A (en) | Program directing method, program directing system, program directing apparatus, and computer-readable storage medium | |
| CN106951204B (en) | Image synchronization method based on computer cluster visualization system | |
| CN112243149B (en) | Method, device and system for displaying ultra-wide picture | |
| CN110910485B (en) | Immersion type cave image manufacturing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |