CN110456995B - Method, device and system for executing operation on ultra-wide picture - Google Patents
Method, device and system for executing operation on ultra-wide picture Download PDFInfo
- Publication number
- CN110456995B CN110456995B CN201910654643.0A CN201910654643A CN110456995B CN 110456995 B CN110456995 B CN 110456995B CN 201910654643 A CN201910654643 A CN 201910654643A CN 110456995 B CN110456995 B CN 110456995B
- Authority
- CN
- China
- Prior art keywords
- picture
- multimedia
- block
- window
- ultra
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
Abstract
The invention provides a method, a device and a system for executing operation on an ultra-wide picture, wherein the method comprises the following steps: acquiring an ultra-wide multimedia drawing source; sending the ultra-wide multimedia picture source to more than two playing devices for splicing, fusing and displaying; and receiving and executing an operation instruction aiming at the ultra-wide multimedia drawing source, and executing the operation instruction on the fusion display interface. By the scheme, the operation instruction can be executed on the fusion display interface, the interactivity between the fusion display interface and the user is enhanced, and the user experience is improved.
Description
Technical Field
The present invention relates to the field of multimedia information technologies, and in particular, to a method, an apparatus, and an electronic device for performing an operation on an ultra-wide screen.
Background
The currently popular HDMI2.0 or 1.4/1.3 version interface has the highest display resolution of 3840x2160, and many special scenes need to display ultra-wide pictures, especially scenes that are fused and displayed by using a projector, often need to display ultra-wide pictures of 5: 1(5400x1080) or even 8: 1(8640x 720).
In order to solve the above problems, one scheme is to compress the picture into 3840x960 or even 3840x480 resolution, divide the super-wide picture into pictures, and output the pictures to each projector through a plurality of HDMI interfaces for display, so that the display pictures of a plurality of projectors are fused and spliced into a larger picture to form fused projection, thereby providing a wider and more shocking visual experience. By the scheme and method for compressing, cutting and fusing the pictures, the details of a plurality of pictures can be lost, and the ultra-large bandwidth of the HDMI interface is wasted.
Yet another solution is: cutting the ultra-wide multimedia source into a plurality of picture blocks; and in the display size range of the display device, taking the width value of the resolution of the ultra-wide multimedia source as a picture block cutting width value; in the multimedia interface display size range, equally dividing the length value of the resolution of the ultra-wide multimedia source as the picture block cutting length value; and sequentially layering the drawing blocks to be recombined into an output drawing source which accords with the display size range of the multimedia interface. Although the scheme can realize the fusion display of the ultra-wide pictures in a relatively economic way, the method is limited by the display size of multimedia, the ultra-wide multimedia picture source cannot operate (such as adding a window) the picture blocks after being cut into the picture blocks which are arranged in a stacked mode, if the operation needs to be executed, the ultra-wide multimedia picture source needs to be cut again after executing the operation instruction, and the method has the advantages of complex operation, low speed and high cost.
Therefore, how to implement fusion display of ultra-wide pictures in an economic manner by using fewer multimedia interfaces under the condition of ensuring the picture quality of the multimedia source as much as possible and implement operation on the fusion display interface is a big problem bothering the technical personnel in the field.
Disclosure of Invention
Therefore, a technical scheme for executing operation on the ultra-wide picture is needed to be provided, so as to solve the problem that when the ultra-wide picture is fused and displayed in an economic manner, an operation instruction cannot be executed on a fusion display interface, and therefore interactivity and user experience are poor.
To achieve the above object, the inventors provide a method for performing an operation on an ultra-wide screen, the method comprising the steps of:
acquiring an ultra-wide multimedia drawing source;
sending the ultra-wide multimedia picture source to more than two playing devices for splicing, fusing and displaying;
receiving and executing an operation instruction aiming at the ultra-wide multimedia drawing source;
and executing the operation instruction on the fusion display interface.
Further, the step of sending the ultra-wide multimedia picture source to more than two playing devices for splicing, fusing and displaying comprises the following steps:
cutting the ultra-wide multimedia picture source into a plurality of picture blocks according to a preset output resolution;
sequentially layering the picture blocks to enable the recombined output picture source to accord with the display size range of the multimedia interface;
and sending the output picture source to more than two playing devices, wherein each playing device plays the picture block area corresponding to the playing device in the output picture source, and splicing, fusing and displaying each picture block area.
Further, the receiving the operation instruction for the ultra-wide multimedia drawing source comprises: and receiving and executing an operation instruction at any position of the drawing block after the layer column, wherein the operation instruction comprises one or more of adding component elements, closing component elements, moving component elements and zooming component elements.
Further, the "receiving and executing an operation instruction at any position of a block after the layer column" includes:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia picture source is displayed, the two picture blocks are considered to have a display boundary;
if the two blocks are not adjacent in the output picture source and the content or the whole content in the middle of the ultra-wide multimedia picture source is repeated, the two blocks are considered to have a fusion area;
when the operation instruction is received on the tile after the hierarchical list, if the execution region of the current operation instruction is located in the fusion region or crosses two tiles having the display boundary, step S1 is executed:
respectively executing an operation instruction on the two picture blocks with the fusion area or the two corresponding areas of the two picture blocks with the display boundary;
or when an operation instruction is received on a tile after the hierarchical list, if the execution region of the current operation instruction spans the merge region on one tile and a tile adjacent to the tile, then step S2 is executed:
and executing an operation instruction in the two picture blocks with the fusion area and the area corresponding to the adjacent picture block respectively.
Further, the component elements comprise one or two of windows and multimedia materials;
when the component element is a window, the operation instruction comprises one or more of a window adding instruction, a window zooming instruction, a window moving instruction or a window closing instruction;
when the component element is multimedia material, the operation instruction comprises one or more of an instruction for adding the multimedia material, an instruction for zooming the multimedia material, an instruction for moving the multimedia material or an instruction for closing the multimedia material.
Further, the "receiving and executing an operation instruction at any position of a block after the layer column" includes:
if the window or the multimedia material width is located in the fusion area, step S11 is executed: respectively adding windows or multimedia materials to the corresponding areas of the two picture blocks with the fusion area;
if the window or multimedia material width spans two tiles with display boundaries, step S12 is executed: cutting the window or the multimedia material according to the display boundary, wherein each picture block correspondingly adds part of the window or the multimedia material which is positioned in the picture block after cutting;
if the window or multimedia material width spans the blending region of a tile and the tiles adjacent to the tile, then step S2 is executed: cutting the window or the multimedia material according to the boundary of the fusion area and the adjacent picture block, and adding part of the window or the multimedia material in the cut adjacent picture block; and adding and cutting partial windows or multimedia materials in the fusion area after the two picture blocks with the fusion area are added and cut in the corresponding area.
Further, the "executing an operation instruction at any position of a block after the layer column" includes:
when the width of the window or the multimedia material does not intersect with the fusion area of the two tiles or the display boundaries of the two tiles having the display boundaries, step S3 is executed:
s3: the instructions to add, move or zoom the window or multimedia material are performed directly on the current block of the drawing receiving the operating instructions.
Further, the same or different multimedia material is rendered in the different windows.
Further, the number of the windows or the multimedia materials is multiple, and the multimedia materials include one or more of the following: h5 page, video, picture, photo, text or wine list.
Further, the component element is a mouse, the operation instruction is to move the mouse, and step S1 includes:
when the mouse is moved to the display boundary of one of the two blocks with the display boundary, jumping the mouse to the display boundary of the other block; the distance between the mouse and the upper edge of each drawing block is the same;
and when the mouse moves to the fusion area of the two drawing blocks, respectively adding the mouse to the fusion area of the two drawing blocks, wherein the distance between the mouse added to the display boundary and the upper edge of each drawing block is the same.
Further, the step of executing the operation instruction on the fusion display interface comprises the following steps: and sending the output picture source after the operation instruction is executed to more than two playing devices, playing the picture block areas corresponding to the playing devices in the output picture source by each playing device, splicing, fusing and displaying the picture block areas, and executing the operation instruction by a fusion display interface.
The inventors also provide an apparatus for performing an operation on an ultrawide frame that processes an ultrawide multimedia frame source according to the method as described above.
The inventor also provides a system for executing operation on the ultra-wide picture, which comprises a device for executing operation on the ultra-wide picture and more than two playing devices, wherein each playing device is respectively connected with the device;
each playing device is used for playing the picture block areas corresponding to the playing device in the output picture source and splicing, fusing and displaying the picture block areas;
the device is as described hereinbefore.
The method, the device and the system for executing the operation on the ultra-wide picture in the technical scheme comprise the following steps: acquiring an ultra-wide multimedia drawing source; sending the ultra-wide multimedia picture source to more than two playing devices for splicing, fusing and displaying; and receiving and executing an operation instruction aiming at the ultra-wide multimedia drawing source, and executing the operation instruction on the fusion display interface. By the scheme, the operation instruction can be executed in real time on the fusion display interface, so that the real-time addition, deletion, amplification and reduction of multimedia resources on the displayed ultra-wide multimedia drawing source are realized, and the operation execution of a mouse and the like is executed in real time; the interactivity between the fusion display interface and the user is enhanced, and the user experience is improved.
Drawings
Fig. 1 is a schematic diagram of super-wide frame cutting and reorganization according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating an ultra-wide frame slice reconstruction according to another embodiment of the present invention;
FIG. 3 is a diagram illustrating an ultra-wide frame slice reconstruction according to another embodiment of the present invention;
FIG. 4 is a diagram illustrating an ultra-wide frame slice reconstruction according to another embodiment of the present invention;
FIG. 5 is a flow chart of a method for performing an operation on an ultrawide frame according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating an apparatus for performing operations on an ultrawide frame, according to an embodiment of the present invention;
fig. 7 is a flowchart of a method for performing an operation on an ultra-wide frame according to an embodiment of the present invention.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
At present, a multimedia interface on the market generally supports display of 4K resolution ratio to the maximum, when an ultra-wide resolution ratio picture needs to be output, scaling is usually performed on the basis of the original picture proportion, and although it is ensured that an output picture source meets the requirement of the length-width ratio of the ultra-wide picture, the resolution ratio of the output picture source is sacrificed, and the sensory experience of a user is influenced. In order to ensure that the resolution of the output picture source is not lost, the invention adopts the steps of firstly cutting and then recombining the ultra-wide picture according to the output resolution, thereby ensuring that the resolution of the output picture source is not lost, and simultaneously solving the problem of poor interactivity caused by the fact that the interface cannot execute an operation instruction when the picture source is subjected to fusion display.
Fig. 5 is a flowchart illustrating a method for performing an operation on an ultra-wide frame according to an embodiment of the present invention. The method comprises the following steps:
the method first proceeds to step S501 to obtain an ultra-wide multimedia image source. The super-wide multimedia source, as the name implies, refers to a multimedia source with a large length-width ratio, for example, a conventional playing device can only output an image with a resolution of 3840x2160 at most, while the super-wide multimedia source in the present invention refers to a multimedia source with a resolution in the long direction exceeding 3840, or a multimedia source with a resolution in the wide direction exceeding 2160, for example, an image or a video with a resolution of 6720x1080 or 8960x 720.
And then step S502 is carried out to send the ultra-wide multimedia picture source to more than two playing devices for splicing, fusing and displaying. Because the aspect ratio of the ultra-wide multimedia picture source is large, the length is long, and a single playing device cannot always play the multimedia picture source completely, more than two playing devices are needed to respectively intercept a certain section of the picture source, and play the picture after splicing and fusion, so that the picture of the display interface meets the requirement of the ultra-wide picture source. In the practical application process, after each playing device receives a complete ultra-wide multimedia picture source, the playing devices respectively intercept a part of multimedia picture source to be played, and then splice, merge and display the part of multimedia picture source played by each playing device.
Taking 3 playing devices as an example, as shown in fig. 6, the playing devices include a playing device 1, a playing device 2, and a playing device 3, and in the actual use process, after the playing devices 1, 2, and 3 receive the ultra-wide multimedia rendering (with a resolution of 6720x1080), the playing devices respectively intercept data with resolutions of 2880x1080, 960x1080, and 2880x1080, and splice and merge the three, and then project and play the data. Preferably, the fusion display interface of the projection playing is in an L shape or a surrounding shape of 360 degrees, and the fusion display interface can be played on scene canvas or directly projected on a wall for playing.
And then step S503 is executed to receive and execute the operation instruction for the ultra-wide multimedia drawing source. In this embodiment, the operation instruction includes one or more of an add component element, a close component element, a move component element, and a zoom component element.
And then, the operation command is executed on the fusion display interface in step S504. Therefore, the operation instruction for the multimedia drawing source can be directly displayed on the fusion display interface, the interactivity of the fusion display interface and a user is enhanced, and the user experience is improved.
As shown in fig. 7, in an embodiment, the "sending the ultra-wide multimedia drawing source to two or more playing devices for splicing, fusing and displaying" includes:
firstly, the method proceeds to step S701, and cuts the ultra-wide multimedia picture source into a plurality of picture blocks according to a preset output resolution. The preset output resolution refers to the resolution of the final output picture source (i.e. the picture displayed on the fusion display interface), and may be configured in advance. For example, in fig. 1, the preset output resolution is 6720x1080, and may be cut into A, B, C three blocks, where the resolutions of the three blocks are 2880x1080, 960x1080, and 2880x1080, respectively.
And then step S702 is entered to arrange the drawing blocks in layers in order to make the recombined output drawing source conform to the display size range of the multimedia interface. In this embodiment, the multimedia interface display size refers to a maximum size range in which a multimedia resource can be displayed on a display device. The recombined output picture source accords with the display size range of the multimedia interface, so that the output picture source can receive operation instructions to be feasible, and the operation flow is simplified (the original ultra-wide picture exceeds the display size, and the ultra-wide picture cannot be directly operated in the display size range of the multimedia interface under the condition of ensuring the output resolution ratio).
And then step S703 is carried out to send the output picture source to more than two playing devices, each playing device plays the picture block area corresponding to the playing device in the output picture source, and all the picture block areas are spliced, fused and displayed. For example, in fig. 1, the preset output resolution is 6720x1080, the preset output resolution may be A, B, C three block areas, the resolutions corresponding to the three block areas are 2880x1080, 960x1080 and 2880x1080, respectively, and when displaying, A, B, C three block areas are displayed as a picture with the resolution of 6720x1080 in a splicing and fusing manner.
As shown in fig. 1, an output picture source with a resolution of 6720x1080 is cut into A, B, C three block areas, wherein the resolutions of the three block areas are 2880x1080, 960x1080 and 2880x1080 respectively, and then the three block areas are layered into the same layer of a block a and a block B; and the picture blocks B 'and the picture blocks C are arranged in the same layer, wherein the display contents of the picture blocks B and the picture blocks B' are the same, so that the spliced picture blocks conform to the resolution of the multimedia output interface 3840x 2160.
As shown in fig. 2, the output frame source with the resolution of 6720 × 1080 is also cut, and the cutting scheme and the recombination scheme are the same as those in fig. 1.
As shown in fig. 3, the output source with the resolution of 8960x720 is cut into A, B, C, D, E five block areas, the resolutions of the five block areas are 2560x720, 1280x720 and 2560x720, respectively, and then the block a and the block B are layered as the same layer and are taken as the first layer; the drawing block B ', the drawing block C and the drawing block D are arranged on the same layer and serve as a second layer, and the drawing block D' and the drawing block E are arranged on the same layer and serve as a third layer, wherein the display contents of the drawing block B and the drawing block B 'are the same, and the display contents of the drawing block D and the drawing block D' are the same, so that the spliced drawing block conforms to the resolution of the multimedia output interface 3840x 2160.
As shown in fig. 4, the output frame with a resolution of 7680x1080 is divided into A, B, C, D four frame areas, wherein the resolutions of the four frame areas are 2880x1080, 960x1080 and 2880x1080, respectively, and then the frame a and the frame B are layered as the first layer; the painting blocks C and D are on the same layer and serve as a second layer, so that the spliced painting blocks conform to the resolution of the multimedia output interface 3840x 2160.
As also shown in fig. 6, the output frame with a resolution of 7680 × 1080 is divided into A, B, C, D four frame areas, which are divided and rearranged in the same way as in fig. 4. The difference from fig. 4 is that: the tile A and the tile B have a blend region, and the tile C and the tile D also have a blend region.
In some embodiments, the receiving the operation instruction for the ultra-wide multimedia drawing source comprises: and receiving and executing an operation instruction at any position of the drawing block after the layer column, wherein the operation instruction comprises one or more of adding component elements, closing component elements, moving component elements and zooming component elements. Because the layered picture blocks are the output picture sources sent to the playing device, the operation instructions are received and executed at any positions of the layered picture blocks, and the operation instructions can be correspondingly executed on the fusion display interface, so that the interactivity between the fusion display interface and a user is improved, and the user experience is enhanced.
In some embodiments, the "receiving and executing an operation instruction at any position of a block after a layer column" includes:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia picture source is displayed, the two picture blocks are considered to have a display boundary; for example, in FIG. 4, the tiles B and C are considered to have a display boundary.
If the two blocks are not adjacent in the output picture source and the content or the whole content in the middle of the ultra-wide multimedia picture source is repeated, the two blocks are considered to have a fusion area; for example, the hatched area in fig. 1, 2, and 3 is the fusion region.
When the operation instruction is received on the tile after the hierarchical list, if the execution region of the current operation instruction is located in the fusion region or crosses two tiles having the display boundary, step S1 is executed:
and respectively executing an operation instruction on the corresponding areas of the two picture blocks with the fusion area or the two picture blocks with the display boundary.
For example, a picture exists on a tile of a layer column, the picture needs to be moved from the tile a to the tile C in fig. 1 (i.e. a picture moving instruction is received), and when the picture is moved to a shadow portion of the tile of the first layer B (i.e. a blending region), the picture is correspondingly displayed on the shadow portion of the tile of the second layer B ', so that after the picture is moved from the tile a of the first layer to the shadow portion of the tile B of the first layer, the picture can be synchronously moved to the tile C of the second layer at the shadow portion of the tile B', and further the movement within the picture length distance range within the display size of the multimedia interface (i.e. the movement from the tile a to the tile C) is realized.
Similarly, when the block in the upper column of fig. 4 receives an operation instruction to move the picture from the a block to the D block, when the picture moves from the B block to the C block, especially when B, C two blocks are to be crossed, after the picture moves to the right boundary of the B block, the corresponding portion of the picture is simultaneously displayed on the left boundary of the C block (the right boundary of the B block and the left boundary of the C block are display boundaries between the two blocks) to ensure that the picture can smoothly move from the right boundary of the B block to the left boundary of the C block and then to the D block, thereby realizing the movement of the picture in the ultra-wide picture long distance range (i.e. the movement from the block a to the block D).
In some embodiments, when an operation command is received on a tile after the hierarchical list, if the execution area of the current operation command spans the blending area on one tile and the tile adjacent to the tile, step S2 is executed:
and executing an operation instruction in the two picture blocks with the fusion area and the area corresponding to the adjacent picture block respectively.
The above embodiment is further described by taking the example that the picture moving command is received by the layer column block in fig. 2. The current region of fusing is B draws the piece and B ' draws the piece, and the size that fuses the region is B draws the piece, and B draws the piece and B ' draws the piece size the same, and when the picture moved to A draw the display boundary of piece and B draw the piece or fuse regional, can correspond on B ' draws the piece and show this picture to guarantee can smoothly draw the piece and smoothly transition to move to B draw the piece and C draw the piece from A in fusing the picture that shows at this picture.
In some embodiments, the component elements include one or both of a window, multimedia material; when the component element is a window, the operation instruction comprises one or more of a window adding instruction, a window zooming instruction, a window moving instruction or a window closing instruction; when the component element is multimedia material, the operation instruction comprises one or more of an instruction for adding the multimedia material, an instruction for zooming the multimedia material, an instruction for moving the multimedia material or an instruction for closing the multimedia material.
The step of receiving and executing the operation instruction at any position of the layered block comprises the following steps:
if the window or the multimedia material width is located in the fusion area, step S11 is executed: respectively adding windows or multimedia materials to the corresponding areas of the two picture blocks with the fusion area;
if the window or multimedia material width spans two tiles with display boundaries, step S12 is executed: and cutting the window or the multimedia material according to the display boundary, wherein each picture block correspondingly adds part of the window or the multimedia material which is positioned in the picture block after cutting.
For example, a window is added to the output frame after being reorganized in fig. 1, and when there is an overlapping area between the added window and the shaded portion of the B frame block, the portion of the window displayed in the shaded portion of the B frame block is also displayed in the shaded portion of the B' frame block. Therefore, the operation of adding the window in the ultra-wide picture can be synchronously performed, and the added window can be completely displayed during fusion display.
In some embodiments, if the window or multimedia material width spans the blending region of a tile and the tiles adjacent to the tile, step S2 is executed:
cutting the window or the multimedia material according to the boundary of the fusion area and the adjacent picture block, and adding part of the window or the multimedia material in the cut adjacent picture block; and adding and cutting partial windows or multimedia materials in the fusion area after the two picture blocks with the fusion area are added and cut in the corresponding area.
Taking fig. 2 as an example, the current blending region is a B tile and a B 'tile, the size of the current blending region is the B tile, and the B tile and the B' tile are the same, when a window is added between the tile a and the tile B, since the width of the window spans the B tile (i.e., the blending region) and is adjacent to the a tile (i.e., the tile adjacent to the B tile), step S2 is executed: when a portion of a window is displayed on a B tile, the portion of the window displayed on the B tile will also be displayed synchronously on the B' tile. Therefore, when the position of the added window passes through the junction of the A picture block and the B picture block, the window which is set in real time can be smoothly displayed on the ultra-wide picture, and the phenomenon that the adding operation of the window cannot be carried out due to the display size limitation of the multimedia interface is avoided.
In some embodiments, the "executing the operation instruction at any position of the block after the layer column" includes:
when the width of the window or the multimedia material does not intersect with the fusion area of the two tiles or the display boundaries of the two tiles having the display boundaries, step S3 is executed:
s3: the instructions to add, move or zoom the window or multimedia material are performed directly on the current block of the drawing receiving the operating instructions.
Also taking the operation instruction as an example of adding a window, if the added window is completely located in the a frame block or the B frame block in fig. 2, or there is no intersection with the shaded portion in fig. 1, there is no case that the added window crosses the display boundary or the blending region, and the window adding operation is directly performed on the current frame block.
It should be noted that, when the operation instruction is to move or zoom the window, or to move, add, zoom, open or close the multimedia material (such as an image), the processing method is similar to that of adding the window, and details are not repeated here.
In some embodiments, the same or different multimedia material is rendered in the different windows. Preferably, the number of the windows or the multimedia materials is multiple, and the multimedia materials include one or more of the following: h5 page, video, picture, photo, text or wine list.
For example, in a KTV application scene, a user may send a mode of adding a window instruction, a plurality of windows are opened on an ultra-wide picture displayed in a fusion manner, the same or different multimedia materials may be rendered in the opened windows, for example, 3 windows 1, 2, and 3 are opened, so that a song MV played on a current television screen may be synchronously displayed in the windows 1, 2, and 3, a personal picture, a video, and the like sent by the user may also be displayed, and a drink list, and the like, which is preset by a merchant, may also be displayed. By rendering the same or different multimedia materials in the window, the interactivity of the display picture and the user is effectively improved, and the user experience is improved.
In some embodiments, the component element is a mouse, the operation instruction is to move the mouse, and step S1 includes:
when the mouse is moved to the display boundary of one of the two blocks with the display boundary, jumping the mouse to the display boundary of the other block; the distance between the mouse and the upper edge of each drawing block is the same;
and when the mouse moves to the fusion area of the two drawing blocks, the mouse is added to the fusion area of the two drawing blocks respectively, and the distance between the mouse added to the display boundary and the upper edge of each drawing block is the same.
For example, in fig. 4, a display boundary exists between the painting block B and the painting block C, when the mouse moves to the right boundary of the painting block B, the mouse jumps to the left boundary position of the painting block C next, and the distances between the positions of the mouse before and after the jump and the upper edge of the painting block are the same, so that the operation of the mouse on the picture can be smoothly performed.
In some embodiments, the "executing the operation instruction in the fusion display interface" includes the following steps: and sending the output picture source after the operation instruction is executed to more than two playing devices, playing the picture block areas corresponding to the playing devices in the output picture source by each playing device, splicing, fusing and displaying the picture block areas, and executing the operation instruction by a fusion display interface. For example, if the operation instruction is an add window, the added window will be displayed in the spliced and fused displayed picture, and if the operation instruction is a moving picture, the moving operation process of the picture will be synchronously displayed in the spliced picture when the picture is moved.
The inventors also provide an apparatus for performing an operation on an ultrawide frame that processes an ultrawide multimedia frame source according to the method steps described above.
The inventor also provides a system for executing operation on the ultra-wide picture, which comprises a device for executing operation on the ultra-wide picture and more than two playing devices, wherein each playing device is respectively connected with the device;
each playing device is used for playing the picture block areas corresponding to the playing device in the output picture source and splicing, fusing and displaying the picture block areas;
the device is the device for executing the operation on the ultra-wide screen.
The invention provides a method, a device and a system for executing operation on an ultra-wide picture, wherein the method comprises the following steps: acquiring an ultra-wide multimedia drawing source; sending the ultra-wide multimedia picture source to more than two playing devices for splicing, fusing and displaying; and receiving and executing an operation instruction aiming at the ultra-wide multimedia drawing source, and executing the operation instruction on the fusion display interface. By the scheme, the operation instruction can be executed on the fusion display interface, the interactivity of the fusion display interface and a user is enhanced, and the user experience is improved.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.
Claims (11)
1. A method of performing an operation on an ultrawide display, the method comprising:
acquiring an ultra-wide multimedia drawing source;
sending the ultra-wide multimedia picture source to more than two playing devices for splicing, fusing and displaying;
receiving and executing an operation instruction aiming at the ultra-wide multimedia drawing source;
executing the operation instruction on a fusion display interface;
the step of sending the ultra-wide multimedia picture source to more than two playing devices for splicing, fusing and displaying comprises the following steps:
cutting the ultra-wide multimedia picture source into a plurality of picture blocks according to a preset output resolution;
sequentially layering the picture blocks to enable the recombined output picture source to accord with the display size range of the multimedia interface;
sending the output picture source to more than two playing devices, wherein each playing device plays the picture block area corresponding to the playing device in the output picture source, and splicing, fusing and displaying each picture block area;
the step of receiving and executing the operation instruction aiming at the ultra-wide multimedia drawing source comprises the following steps: receiving and executing an operation instruction at any position of the layered drawing block, wherein the step of receiving and executing an operation instruction at any position of the layered drawing block comprises the following steps:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia picture source is displayed, the two picture blocks are considered to have a display boundary;
if the two blocks are not adjacent in the output picture source and the content or the whole content in the middle of the ultra-wide multimedia picture source is repeated, the two blocks are considered to have a fusion area;
when the operation instruction is received on the tile after the hierarchical list, if the execution region of the current operation instruction is located in the fusion region or crosses two tiles having the display boundary, step S1 is executed:
respectively executing an operation instruction on the two picture blocks with the fusion area or the two corresponding areas of the two picture blocks with the display boundary;
or when an operation instruction is received on a tile after the hierarchical list, if the execution area of the current operation instruction spans the blending area on one tile and the tile adjacent to the tile, then step S2 is executed:
and executing an operation instruction in the two picture blocks with the fusion area and the area corresponding to the adjacent picture block respectively.
2. A method of performing an operation on an ultrawide screen as recited in claim 1, wherein the operation instruction comprises one or more of an add component element, a close component element, a move component element, a zoom component element.
3. A method of performing an operation on an ultrawide screen as recited in claim 2, wherein the component element comprises one or both of a window, multimedia material;
when the component element is a window, the operation instruction comprises one or more of a window adding instruction, a window zooming instruction, a window moving instruction or a window closing instruction;
when the component element is multimedia material, the operation instruction comprises one or more of an instruction for adding the multimedia material, an instruction for zooming the multimedia material, an instruction for moving the multimedia material or an instruction for closing the multimedia material.
4. A method of performing an operation on an ultrawide frame, as recited in claim 3, wherein the receiving and executing an operation instruction at any position of a block after a hierarchy comprises:
if the window or the multimedia material width is located in the fusion area, step S11 is executed: respectively adding windows or multimedia materials to the corresponding areas of the two picture blocks with the fusion area;
if the window or multimedia material width spans two tiles with display boundaries, step S12 is executed: cutting the window or the multimedia material according to the display boundary, wherein each picture block correspondingly adds part of the window or the multimedia material which is positioned in the picture block after cutting;
if the window or multimedia material width spans the blending region of a tile and the tiles adjacent to the tile, then step S2 is executed: cutting the window or the multimedia material according to the boundary of the fusion area and the adjacent picture block, and adding part of the window or the multimedia material in the cut adjacent picture block; and adding a part of window or multimedia material which is positioned in the fusion area after cutting in the corresponding area by the two picture blocks with the fusion area.
5. The method of performing an operation on an ultrawide screen as recited in claim 4, wherein the "performing an operation instruction at an arbitrary position of a block after a layer" comprises:
when the width of the window or the multimedia material does not intersect with the fusion area of the two tiles or the display boundary of the two tiles having the display boundary, step S3 is executed:
s3: the instructions to add, move or zoom the window or multimedia material are performed directly on the current block of the drawing receiving the operating instructions.
6. A method of performing an operation on an ultrawide screen as recited in any of claims 3-5, wherein the same or different multimedia material is rendered in different of the windows.
7. A method of performing an operation on an ultrawide picture as recited in any of claims 3-5, wherein the number of windows or multimedia material is plural, the multimedia material comprising one or more of: h5 page, video, picture, photo, text or wine list.
8. The method of claim 2, wherein the component element is a mouse, the operation command is to move the mouse, and the step S1 includes:
when the mouse is moved to the display boundary of one of the two blocks with the display boundary, jumping the mouse to the display boundary of the other block; the distance between the mouse and the upper edge of each drawing block is the same;
and when the mouse moves to the fusion area of the two drawing blocks, the mouse is added to the fusion area of the two drawing blocks respectively, and the distance between the mouse added to the display boundary and the upper edge of each drawing block is the same.
9. The method for executing operation on ultra-wide screen according to any one of claims 2-5 and 8, wherein the step of executing the operation instruction on the fusion display interface comprises the following steps: and sending the output picture source after the operation instruction is executed to more than two playing devices, playing the picture block areas corresponding to the playing devices in the output picture source by each playing device, splicing, fusing and displaying the picture block areas, and executing the operation instruction by a fusion display interface.
10. An apparatus for performing an operation on an ultrawide frame, characterized in that the apparatus processes an ultrawide multimedia frame source according to the method of any one of claims 1 to 9.
11. A system for executing operation on an ultra-wide picture is characterized by comprising a device for executing operation on the ultra-wide picture and more than two playing devices, wherein each playing device is respectively connected with the device;
each playing device is used for playing the picture block areas corresponding to the playing device in the output picture source and splicing, fusing and displaying the picture block areas;
the apparatus of claim 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910654643.0A CN110456995B (en) | 2019-07-19 | 2019-07-19 | Method, device and system for executing operation on ultra-wide picture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910654643.0A CN110456995B (en) | 2019-07-19 | 2019-07-19 | Method, device and system for executing operation on ultra-wide picture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110456995A CN110456995A (en) | 2019-11-15 |
| CN110456995B true CN110456995B (en) | 2022-07-08 |
Family
ID=68481486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910654643.0A Active CN110456995B (en) | 2019-07-19 | 2019-07-19 | Method, device and system for executing operation on ultra-wide picture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110456995B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8937685B1 (en) * | 2008-10-09 | 2015-01-20 | Tp Lab, Inc. | Method and system for overlaying videos in a television set using a television script |
| CN104461430A (en) * | 2014-12-08 | 2015-03-25 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN109819180A (en) * | 2019-01-18 | 2019-05-28 | 上海皓空数码科技有限公司 | A kind of ultra-wide picture fusion display methods and system |
-
2019
- 2019-07-19 CN CN201910654643.0A patent/CN110456995B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8937685B1 (en) * | 2008-10-09 | 2015-01-20 | Tp Lab, Inc. | Method and system for overlaying videos in a television set using a television script |
| CN104461430A (en) * | 2014-12-08 | 2015-03-25 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN109819180A (en) * | 2019-01-18 | 2019-05-28 | 上海皓空数码科技有限公司 | A kind of ultra-wide picture fusion display methods and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110456995A (en) | 2019-11-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108108140B (en) | Multi-screen cooperative display method, storage device and equipment supporting 3D display | |
| KR101686693B1 (en) | Viewer-centric user interface for stereoscopic cinema | |
| US8418063B2 (en) | Aiding device in creation of content involving image display according to scenario and aiding method therein | |
| CN103248941B (en) | A kind of method of multi-channel video source simultaneous display and device | |
| US20170150212A1 (en) | Method and electronic device for adjusting video | |
| KR102274723B1 (en) | Device, method and computer program for editing time slice images | |
| CN113038220A (en) | Program directing method, program directing system, program directing apparatus, and computer-readable storage medium | |
| US20090273715A1 (en) | Method And Apparatus For Displaying An Image With A Production Switcher | |
| JP4988042B2 (en) | Stereo image editing method | |
| CN110456995B (en) | Method, device and system for executing operation on ultra-wide picture | |
| CN114466222A (en) | Video synthesis method and device, electronic equipment and storage medium | |
| JP2007522732A (en) | Changing the aspect ratio of the image displayed on the screen | |
| CN110910485B (en) | Immersion type cave image manufacturing method | |
| CN108881873A (en) | The methods, devices and systems of high-definition picture fusion | |
| US20040008198A1 (en) | Three-dimensional output system | |
| US8063916B2 (en) | Graphics layer reduction for video composition | |
| CN112243149B (en) | Method, device and system for displaying ultra-wide picture | |
| US7046732B1 (en) | Video coloring book | |
| CN110677600B (en) | Multi-group display method and system of ultra-wide picture, on-demand equipment and on-demand system | |
| US20130038607A1 (en) | Time line operation control device, time line operation control method, program and image processor | |
| CN112788349B (en) | Data stream pushing method, system, computer equipment and readable storage medium | |
| KR101577671B1 (en) | Method of producing and implementing for dynamic cinema | |
| CN110430454B (en) | Multi-device real-time interactive display method and device | |
| CN109669753B (en) | Digital audio-visual system interface display method and computer readable storage medium | |
| CN103336678B (en) | A kind of resource exhibition method, device and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |