CN110430454B - Multi-device real-time interactive display method and device - Google Patents
Multi-device real-time interactive display method and device Download PDFInfo
- Publication number
- CN110430454B CN110430454B CN201910654620.XA CN201910654620A CN110430454B CN 110430454 B CN110430454 B CN 110430454B CN 201910654620 A CN201910654620 A CN 201910654620A CN 110430454 B CN110430454 B CN 110430454B
- Authority
- CN
- China
- Prior art keywords
- demand
- multimedia
- multimedia resource
- picture
- demand equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Processing Or Creating Images (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method and a device for multi-device real-time interactive display, wherein the method comprises the following steps: the method comprises the steps that a first multicast device obtains more than one multimedia resource; the second on-demand equipment acquires more than one multimedia resource; the first on-demand equipment plays one multimedia resource and sends a trigger instruction to the second on-demand equipment; and the second on-demand equipment plays the multimedia resources corresponding to the trigger instruction according to the received trigger instruction, and the multimedia resources of at least one on-demand equipment are displayed on the ultra-wide screen. Therefore, when the first on-demand equipment plays the multimedia resource corresponding to the first on-demand equipment, the second on-demand equipment is triggered to synchronously play the corresponding multimedia resource, and the interaction between the first on-demand equipment and the second on-demand equipment is enhanced; and because the multimedia resources of one on-demand device are displayed on the ultra-wide screen, the cool and dazzling feeling of multimedia resource playing is enhanced, and the sensory experience of a user is improved.
Description
Technical Field
The invention relates to the technical field of multimedia information, in particular to a multi-device real-time interactive display method and device and electronic equipment.
Background
With the improvement of living standard, digital audio-visual places (such as KTV places) have become places where people often go, and the song ordering machine in the earliest KTV places simply supports song ordering and singing. With the improvement of the requirements of people, many song-ordering machines begin to display interface operating systems of different skins, and various special effects are added to different singing videos so as to achieve the effects of enhancing entertainment and improving user experience.
Although the interface style of the operating system is changed to a certain extent by changing the skin of the interface operating system, the skin changing only changes the visual effect of a UI layer, the essence that the song ordering system depends on television screen playing display is not changed, the pursuit of the user for the cool and dazzling display picture is still met, and more entertainment and play methods cannot be provided.
With the development of projection display technology, ultra-wide screen displays, such as circular screens, giant screens, etc., have appeared. Although the current digital audio-visual places (such as KTV places) have applied technologies such as circular screen, the circular screen generally only replaces decoration of a background wall to display a background scene, and the function of the circular screen only plays a role in creating a box atmosphere and reducing the box decoration cost. The background scene cannot interact with the content of the television screen at the front end of the box, and the effect of improving the user experience cannot be achieved.
Disclosure of Invention
Therefore, a technical scheme for multi-device real-time interactive display is required to be provided, so as to solve the problem of poor user operation experience in the multimedia resource playing process.
To achieve the above object, the inventor provides a method for real-time interactive display of multiple devices, the method comprising the following steps:
the method comprises the steps that a first multicast device obtains more than one multimedia resource;
the second on-demand equipment acquires more than one multimedia resource;
the first on-demand equipment plays one multimedia resource and sends a trigger instruction to the second on-demand equipment; and the second on-demand equipment plays the multimedia resources corresponding to the trigger instruction according to the received trigger instruction, and the multimedia resources of at least one on-demand equipment are displayed on the ultra-wide screen.
Furthermore, the second on-demand equipment is connected with more than one slave on-demand equipment, and more than one multimedia resource is obtained from the on-demand equipment; after receiving the trigger instruction of the first on-demand equipment, the second on-demand equipment distributes corresponding trigger instructions to the slave on-demand equipment; and after receiving the trigger instruction, each slave on-demand equipment controls the corresponding multimedia resource to play, and the multimedia resource of at least one slave on-demand equipment is displayed on the ultra-wide screen.
Furthermore, the first on-demand equipment, the second on-demand equipment and each slave on-demand equipment respectively preset synchronous playing time axes, and the multimedia resources to be played are played in sequence according to the time axis progress; the multimedia resources to be played on each time axis are provided with corresponding playing time points, and when the first on-demand equipment plays the corresponding multimedia resources according to the playing time points, the currently played multimedia resources send triggering broadcast to the second on-demand equipment; and after monitoring the trigger broadcast, the second on-demand equipment forwards the trigger broadcast to all the slave on-demand equipment, and the second on-demand equipment and all the slave on-demand equipment judge whether the trigger broadcast is the pre-subscribed trigger broadcast, and if so, trigger the multimedia resource corresponding to the trigger broadcast to play.
Furthermore, in the process that each slave on-demand device plays the multimedia resource, each multimedia resource sends out corresponding trigger broadcast, and the second on-demand device monitors each trigger broadcast and forwards each trigger broadcast to the first on-demand device; and the first on-demand equipment and the second on-demand equipment judge whether each trigger broadcast has a pre-subscribed trigger broadcast, and if so, trigger the multimedia resource corresponding to the trigger broadcast to play.
Further, the "displaying the multimedia resource on the ultra-wide screen" includes:
drawing more than one multimedia resource in a first canvas to obtain an ultra-wide multimedia drawing source;
drawing a multimedia resource corresponding to the ultra-wide multimedia drawing source in a second canvas according to the output resolution to obtain an output drawing source;
and each display device acquires the output picture source, displays the corresponding picture block, and performs splicing fusion display.
Further, the step of drawing more than one multimedia resource in the first canvas to obtain the ultra-wide multimedia drawing source includes:
establishing a first canvas, establishing a background scene in the first canvas, and drawing more than one multimedia resource on the background scene to obtain the ultra-wide multimedia picture source.
Further, the step of drawing the multimedia resource corresponding to the ultra-wide multimedia drawing source in the second canvas according to the output resolution to obtain the output drawing source includes:
cutting the ultra-wide multimedia picture source into a plurality of picture blocks according to the output resolution;
sequentially layering the drawing blocks to enable the recombined layering drawing blocks to accord with the display size range of the multimedia interface;
and establishing a second canvas according to the area size of the layered drawing block, and drawing corresponding multimedia resources in the corresponding drawing block area to obtain an output drawing source.
Further, when an instruction for updating and displaying the multimedia resource is received, the updated multimedia resource is drawn to a corresponding picture block area of the second canvas in real time;
and sending the redrawn output picture source to more than two display devices in real time, wherein each display device displays the picture block area corresponding to the display device in the output picture source, and updates and displays the picture block areas after splicing and fusing the picture block areas.
Further, the "drawing the updated multimedia resource to the corresponding drawing block area of the second canvas" includes:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia resource is displayed, the two picture blocks are considered to have a display boundary;
if the two picture blocks are not adjacent in the output picture source and the content or the whole content in the ultra-wide multimedia resource is repeated, the two picture blocks are considered to have a fusion area;
when the updated multimedia resource width is located in the fusion area, step S11 is executed: respectively drawing updated multimedia resources for the areas corresponding to the two picture blocks with the fusion areas;
when the updated multimedia asset width crosses the display boundary of two tiles where the display boundary exists, step S12 is performed: cutting the updated multimedia resource according to the display boundary, wherein each picture block correspondingly draws the part located in the cut picture block to update the multimedia resource;
when the updated multimedia resource width spans the blending region of a tile and the tile adjacent to the tile, step S2 is executed: cutting the updated multimedia resource according to the boundary of the fusion area and the adjacent picture block, and drawing the part of the adjacent picture block positioned in the picture block after cutting to update the multimedia resource; and the two picture blocks with the fusion area update the multimedia resources in the part of the fusion area after the corresponding area is cut.
Further, the "drawing the updated multimedia resource to the corresponding drawing block area of the second canvas" includes:
when the updated multimedia asset has no intersection with the blending area of the two tiles or the display boundaries of the two tiles where the display boundaries exist, the step S3 is executed:
s3: and directly updating the drawing area of the multimedia resource on the drawing block to draw the updated multimedia resource.
Further, the multimedia resource comprises one or more of the following: h5 page, video, picture, photo, text or wine list.
Further, the first on-demand device, the second on-demand device, the multimedia resources played by each on-demand device and the multimedia resources triggered to be played by the triggered broadcast thereof interact with each other, and the interaction includes one or more of the following:
the multimedia resources played by the first on-demand equipment at a certain time point of a time axis are song MVs, and after the second on-demand equipment receives the trigger broadcast of the song MVs, the 3D scene multimedia resources matched with the types of the songs are triggered and played;
or the multimedia resource played by the first on-demand equipment at another time point of the time axis is a song MV, and after the second on-demand equipment receives the trigger broadcast of the song MV, the 3D scene matched with one or more of the song number, the song name and the lyric content is triggered and played; after the second on-demand equipment transfers corresponding trigger broadcasts to the slave on-demand equipment, one of the slave on-demand equipment which subscribes the trigger broadcasts in advance plays a 3D scene which is matched with one or more of the song number, the song name and the lyric content;
or the multimedia resource played by the first on-demand equipment at another time point of the time axis is a song MV, and after the second on-demand equipment receives the trigger broadcast of the song MV, the second on-demand equipment triggers to play the visual video generated according to the song audio; the generating of the visual video according to the song audio comprises: acquiring audio data corresponding to a song MV, identifying the audio beat value and the audio amplitude, and generating a video of the audio data according to the audio beat value and the audio amplitude, wherein the display speed of the audio amplitude is determined according to the audio beat value.
The inventor also provides a device for multi-device real-time interactive display, which comprises a first on-demand device and a second on-demand device, wherein the first on-demand device and the second on-demand device interact according to the method described above.
Further, the second on-demand device is further connected with more than one slave on-demand devices, and each slave on-demand device interacts with the first on-demand device and the second on-demand device according to the method of any one of claims 2 to 12.
The method and the device for multi-device real-time interactive display in the technical scheme comprise the following steps: the method comprises the steps that a first multicast device obtains more than one multimedia resource; the second on-demand equipment acquires more than one multimedia resource; the first on-demand equipment plays one multimedia resource and sends a trigger instruction to the second on-demand equipment; and the second on-demand equipment plays the multimedia resources corresponding to the trigger instruction according to the received trigger instruction, and the multimedia resources of at least one on-demand equipment are displayed on the ultra-wide screen. Therefore, when the first on-demand equipment plays the multimedia resource corresponding to the first on-demand equipment, the second on-demand equipment is triggered to synchronously play the corresponding multimedia resource, so that the multimedia resources played by the first on-demand equipment and the second on-demand equipment can realize interaction; meanwhile, because the multimedia resource of one on-demand device is displayed on the ultra-wide screen, the multimedia resource displayed on the ultra-wide screen can be interacted with the multimedia resource played by the other on-demand device while the ultra-wide screen is introduced for displaying, so that the cool feeling of playing the multimedia resource is enhanced, and the sensory experience of a user is improved.
Drawings
Fig. 1 is a flowchart of a multi-device real-time interactive display method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a multi-device real-time interactive display method according to another embodiment of the present invention;
FIG. 3 is a flowchart of a multi-device real-time interactive display method according to another embodiment of the present invention;
FIG. 4 is a schematic diagram of a multi-device real-time interactive display apparatus according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a multi-device real-time interactive display apparatus according to another embodiment of the present invention;
FIG. 6 is a schematic diagram of a display device according to an embodiment of the present invention;
FIG. 7 is a diagram illustrating an ultra-wide frame slice reconstruction according to an embodiment of the present invention;
FIG. 8 is a diagram illustrating an ultra-wide frame slice reconstruction according to another embodiment of the present invention;
FIG. 9 is a diagram illustrating an ultra-wide frame slice reconstruction according to another embodiment of the present invention;
FIG. 10 is a diagram illustrating an ultra-wide cut and rebinning according to another embodiment of the present invention;
description of reference numerals:
10. a multi-device real-time interactive display device;
101. a first multicast device;
102. a second on-demand device;
103. a display screen;
104. a display device;
105. an ultra-wide screen.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Referring to fig. 1, a schematic diagram of a multi-device mutual display method according to an embodiment of the present invention is shown. The method can be applied to digital audio-visual places, such as KTV boxes, and can improve the sensory experience of multimedia resource playing in an energy-efficient manner, and comprises the following steps:
first, the first on-demand device acquires one or more multimedia resources in step S101.
In this embodiment, the first on-demand device is a digital on-demand device, such as a set-top box. The set-top box can establish communication connection with the management server through a network and acquire multimedia resources from the management server. The multimedia resources comprise image resources, video resources, audio resources, animation resources, character resources and the like.
And then step S102 is entered for the second on-demand device to obtain more than one multimedia resource.
In this embodiment, the second on-demand device is a digital on-demand device, such as a set-top box, a convergence server connectable to a projector, or the like. The set-top box can establish communication connection with the management server through a network, acquire multimedia resources from the management server, and also can directly acquire the multimedia resources from the first on-demand equipment. The multimedia resources comprise image resources, video resources, audio resources, animation resources, character resources and the like. The second on-demand device may not only obtain the multimedia resource from the management server or the first on-demand device, but also obtain the multimedia resource from a storage medium storing the multimedia resource. Such storage media include, but are not limited to: u disk, hard disk, network disk, etc. The multimedia resources obtained by the first on-demand device and the second on-demand device may be the same or different.
Then step S103 is carried out, wherein the first on-demand equipment plays one of the multimedia resources and sends a trigger instruction to the second on-demand equipment; and the second on-demand equipment plays the multimedia resources corresponding to the trigger instruction according to the received trigger instruction, and the multimedia resources of at least one on-demand equipment are displayed on the ultra-wide screen.
Taking a KTV practical application scenario as an example, the display screen corresponding to the first on-demand device may be a display screen in a box, and the display screen corresponding to the second on-demand device may be an ultra-wide screen. The display screen is a television display screen in the box, and the ultra-wide screen can be a wall in the KTV box or canvas which is arranged in the KTV box in advance. When the first multimedia resource is played and displayed on the display screen, the first on-demand equipment sends a trigger instruction to the second on-demand equipment, so that the second on-demand equipment starts to play and display the corresponding multimedia resource in a wall body or an ultra-wide canvas in a box. Therefore, the multimedia resource contents played by the first on-demand equipment and the second on-demand equipment can be interacted, and meanwhile, the interactive contents are displayed through the ultra-wide screen, so that the picture playing in the song ordering process is more shocked, and the sensory experience of a user is effectively improved.
In other embodiments, the display screen of the first jukebox device may be a super-wide screen and the display screen of the second jukebox device may be a television screen. Or the display screens of the first on-demand equipment and the second on-demand equipment are both ultra-wide screens.
In an actual application scenario, in order to better display the interactive effect of the multimedia resources, in some embodiments, as shown in fig. 4, the second on-demand device is connected to more than one slave on-demand devices, and the slave on-demand devices acquire more than one multimedia resources; after receiving the trigger instruction of the first on-demand equipment, the second on-demand equipment distributes corresponding trigger instructions to the slave on-demand equipment; and after receiving the trigger instruction, each slave on-demand equipment controls the corresponding multimedia resource to play, and the multimedia resource of at least one slave on-demand equipment is displayed on the ultra-wide screen.
The slave on-demand device is a digital on-demand device, such as a set-top box, and is distinguished from the first on-demand device and the second on-demand device, and is hereinafter referred to as a third set-top box. The third set-top box is connected with the second set-top box (namely, the second on-demand equipment), and interaction between the third set-top box and the first set-top box (namely, the first on-demand equipment) is realized through the second set-top box. Compared with the mode that other on-demand devices (a second on-demand device and each slave on-demand device) are connected with the first on-demand device, by adopting the scheme in the embodiment, the control module of each slave on-demand device only needs to set the control command required by the control module, and all control command interaction does not need to be realized; meanwhile, the first on-demand equipment only needs to interact with the second on-demand equipment, and does not need to directly interact with all the slave on-demand equipment, so that the requirement on the performance of the first on-demand equipment is greatly reduced, and the equipment cost is effectively reduced.
In some embodiments, the first on-demand device, the second on-demand device and each slave on-demand device respectively preset a synchronous playing time axis, and sequentially play the multimedia resources to be played according to the time axis progress; the multimedia resources to be played on each time axis are provided with corresponding playing time points, and when the first on-demand equipment plays the corresponding multimedia resources according to the playing time points, the currently played multimedia resources send triggering broadcast to the second on-demand equipment; and after monitoring the trigger broadcast, the second on-demand equipment forwards the trigger broadcast to all the slave on-demand equipment, and the second on-demand equipment and all the slave on-demand equipment judge whether the trigger broadcast is the pre-subscribed trigger broadcast, and if so, trigger the multimedia resource corresponding to the trigger broadcast to play. Therefore, interactivity among the on-demand devices in the multimedia resource playing process can be effectively improved, user experience is improved, and the scheme described in the embodiment is specifically explained in combination with the on-demand devices by taking different application scenes as examples.
In some embodiments, in the process of playing the multimedia resources by each slave on-demand device, each multimedia resource sends out a corresponding trigger broadcast to the outside, and the second on-demand device forwards each trigger broadcast to the first on-demand device after monitoring each trigger broadcast; and the first on-demand equipment and the second on-demand equipment judge whether each trigger broadcast has a pre-subscribed trigger broadcast, and if so, trigger the multimedia resource corresponding to the trigger broadcast to play.
The pre-subscribed trigger broadcast may be set in advance, for example, a certain slave on-demand device sends out the trigger broadcast when playing MV to 1 minute, the control module of the second on-demand device is configured with the response to the broadcast information in advance, and the response operation is to play a certain light music, while the control module of the first on-demand device is not configured with the response to the broadcast information. Then when the MV is played from the jukebox for 1 minute, the second jukebox will trigger the start of playing the light music after receiving the trigger broadcast sent from the jukebox, and the first jukebox will not respond to the trigger broadcast because it has not subscribed to the trigger broadcast in advance.
In short, the slave on-demand device may not only receive the trigger broadcast sent by the first on-demand device through the second on-demand device to realize interaction with the first on-demand device in the process of playing the multimedia resource by the first on-demand device, but also actively send the corresponding trigger broadcast to the first on-demand device or the second on-demand device in the process of playing the multimedia resource by the slave on-demand device, so as to realize interaction with the first on-demand device and the second on-demand device.
In a certain application scenario, a user needs to play a personal photo on a display screen in a KTV box, and when the personal photo starts to be played on the display screen (i.e., when a first on-demand device plays a multimedia resource), the personal photo is simultaneously displayed on an ultra-wide screen in the box (i.e., a trigger broadcast of the multimedia resource of the personal photo is a trigger broadcast subscribed by a second on-demand device in advance, and after the second on-demand device monitors the trigger broadcast, the second on-demand device simultaneously plays a corresponding multimedia resource), or when the playing of the personal photo on the display screen is finished, the personal photo (or other content associated therewith) starts to be displayed and played on the ultra-wide screen in the box.
In another application scenario, a user needs to play a song MV (the song is a military song) on a display screen in a KTV box, when the song MV starts to play on the display screen (namely, when a first on-demand device plays a multimedia resource), a second on-demand device monitors a trigger broadcast of the multimedia resource of the song MV and judges whether the trigger broadcast is a pre-subscribed trigger broadcast, and when the trigger broadcast is judged to be pre-subscribed, the second on-demand device triggers a circular screen in the same box to play a 3D scene multimedia resource related to a theme of the military, so that interaction between the display screen of the same box and content displayed by the circular screen is realized.
In another application scenario, a user needs to play a song MV on a display screen in a KTV box, wherein the song is named "sea", and when the song MV starts to be played on the display screen (namely, when a first on-demand device plays multimedia resources), a second on-demand device receives a trigger broadcast of the song MV and then triggers to play various 3D scenes matched with the song name "sea"; meanwhile, after the second on-demand equipment transfers the corresponding trigger broadcast to each slave on-demand equipment, one of the slave on-demand equipment which subscribes the trigger broadcast in advance plays the 3D scene matched with the lyric content, so that the display screen of the same box and the content displayed by the circular screen are interacted.
In another application scenario, a user needs to play a football game on a display screen in a KTV box, and when the football game starts to be played on the display screen (namely when the first on-demand equipment plays multimedia resources), the second on-demand equipment receives trigger broadcast of the multimedia resources of the football game and then triggers to play order information of the wine list on a circular screen of the box; meanwhile, after the second on-demand equipment transfers the corresponding trigger broadcast to each slave on-demand equipment, one of the slave on-demand equipment which is subscribed with the trigger broadcast in advance plays information introductions of the history, members and the like of the two teams related to the ball game in the other circular screen, so that the display screen of the same compartment and the content displayed by the circular screen are interacted.
In another application scenario, a user needs to play a song MV on a display screen in a KTV box, when the song MV starts to play on the display screen (i.e., when a first on-demand device plays a multimedia resource), a second on-demand device monitors a trigger broadcast of the song MV on the multimedia resource and determines whether the trigger broadcast is a pre-subscribed trigger broadcast, and when the trigger broadcast is determined to be the pre-subscribed trigger broadcast, the second on-demand device triggers a preset play multimedia resource at the same play time point on a circular screen play synchronization time axis in the same box, so that the display screen of the same box and the content displayed on the circular screen are interacted. The preset played multimedia resources can be multimedia and resources which are replaced in real time according to user operation. For example, the user selects one of the 3D scenes from the 3D scenes prestored in the second on-demand device, and replaces another multimedia resource at a certain playing time point on the time axis, and when the broadcast is triggered to play the multimedia resource at the time point, the multimedia resource replaced by the user is played. The user can also select one 3D scene from the 3D scenes prestored in the first on-demand equipment, send the 3D scene to the second on-demand equipment, and replace other multimedia resources at a certain playing time point on the synchronous time axis of the second on-demand equipment.
In another application scenario, a user needs to play a song MV on a display screen in a KTV box, and when the song MV starts to be played on the display screen (namely when a first on-demand device plays multimedia resources), a second on-demand device triggers a circular screen of the same box to play a visual video generated according to a song audio after receiving a trigger broadcast of the song MV; the generating of the visual video according to the song audio comprises: acquiring audio data corresponding to a song MV, identifying the audio beat value and the audio amplitude, and generating a video of the audio data according to the audio beat value and the audio amplitude, wherein the display speed of the audio amplitude is determined according to the audio beat value. By the method, sound effect interaction is realized among the display screen, the played audio and the content displayed by the circular screen of the same box, and user experience is improved.
The "generating the audio data according to the audio beat value and the audio amplitude" specifically includes:
displaying the audio data by using an electrocardiogram, wherein the potential change of the electrocardiogram represents the change of the audio amplitude value, and the speed of the potential change represents the audio beat value;
or displaying the audio data by using a sound column graph moving left and right, wherein the length of the sound column represents the audio amplitude, and the moving speed of the sound column represents the audio beat value;
or displaying the audio data by using a sound column graph with elevation change, wherein the elevation height of the sound column represents the audio amplitude, and the elevation speed of the sound column represents the audio beat value;
or displaying the audio data by using the flicker change of the light, wherein the brightness of the light represents the audio amplitude, and the flicker speed of the light represents the audio beat value.
In another application scenario, a user needs to play a photo on a display screen in a KTV box, and the photo can present an effect of moving from left to right on the display screen, that is, a played multimedia resource includes a photo rendering effect and a photo moving effect, when the photo moves to the rightmost side on the display screen (that is, when the photo is going to disappear from a television screen), at this time, the photo will display a photo 3D fragmentation effect on an ultra-wide screen in the box (assuming that a multimedia resource of a second on-demand device is displayed on the ultra-wide screen, the played multimedia resource is the photo 3D fragmentation effect), and since there is interactive content in the content played by the first on-demand device and the second on-demand device, compared with a mode of playing a certain rendering data singly, the sensory visual effect is effectively enhanced.
At present, a multimedia interface on the market generally supports display of 4K resolution ratio to the maximum, when an ultra-wide resolution ratio picture needs to be output, scaling is usually performed on the basis of the original picture proportion, and although it is ensured that an output picture source meets the requirement of the length-width ratio of the ultra-wide picture, the resolution ratio of the output picture source is sacrificed, and the sensory experience of a user is influenced. In order to ensure that the resolution of the output picture source is not lost, the invention firstly cuts the ultra-wide picture according to the output resolution and then recombines the ultra-wide picture, thereby ensuring that the resolution of the output picture source is not lost, and simultaneously solving the problems of large operation amount and low processing efficiency of rendering operation caused by that the updating display of the ultra-wide picture can only be realized by replacing the whole ultra-wide multimedia picture source in the prior art.
Please refer to fig. 5, which is a flowchart illustrating a multi-device real-time interactive display method according to an embodiment of the present invention. The method comprises the following steps:
firstly, step S201 is entered to draw more than one multimedia resource in the first canvas, so as to obtain an ultra-wide multimedia source.
The ultra-wide multimedia source, as the name implies, refers to a multimedia source with a large length-width ratio, for example, a conventional display device can only output an image with a resolution of 3840x2160 at most, while the ultra-wide multimedia source in the present invention refers to a multimedia source with a resolution in the long direction exceeding 3840, or a multimedia source with a resolution in the wide direction exceeding 2160, for example, an image or a video with a resolution of 6720x1080 or 8960x720 to be output.
The first canvas is a drawing area of a multimedia resource, and because an ultra-wide multimedia drawing source needs to be drawn, and the display size of the existing multimedia interface cannot realize the drawing of the ultra-wide multimedia drawing source, in the embodiment, the first canvas is a virtual drawing area, and the size of the virtual drawing area is not smaller than that of the ultra-wide multimedia drawing source. The drawn multimedia resources can be pictures, videos, animations, characters and the like. Preferably, a background image of the ultra-wide fusion display interface is drawn on the first canvas.
And then step S202 is carried out, the multimedia resource corresponding to the ultra-wide multimedia picture source is drawn in the second canvas according to the output resolution ratio, and the output picture source is obtained.
The output resolution is the resolution of the final splicing fusion display picture, and the output resolution can be configured in advance. The second canvas has a size that meets the output size requirements of the multimedia interface. And the multimedia resources corresponding to the ultra-wide multimedia drawing source are drawn on the second canvas, so that the multimedia resources in the ultra-wide multimedia drawing source are redrawn into the second canvas which accords with the output size of the multimedia interface. In the actual manufacturing process, when the ultra-wide multimedia picture source is displayed for the first time, the multimedia resources drawn on the first canvas are the same as the multimedia resources drawn by the second canvas. Therefore, the first canvas stores the drawing data in the display memory after the multimedia resources are drawn, and when the multimedia resources are drawn again in the second canvas, the drawing data only need to be read from the display memory and copied to the corresponding position. In the subsequent display process, when the display content needs to be updated, for example, when a new multimedia resource is additionally displayed, the multimedia resource needing to be updated and displayed is only required to be drawn on the second canvas in real time in the drawing process of the second canvas.
And then, in the step S203, each display device acquires an output picture source, displays the corresponding picture blocks, and performs splicing, fusion and display.
Because the aspect ratio of the output picture source is large, the length is long, and a single display device cannot always play the multimedia picture source completely, more than two display devices are needed to respectively capture a certain section of the picture source, and play the multimedia picture source after splicing and fusion, so that the displayed picture meets the requirement of the ultra-wide picture source. In the practical application process, after each display device can receive the complete output picture source, the part of the multimedia picture source to be played is respectively intercepted, and then the part of the multimedia picture source played by each display device is spliced, fused and displayed. Each display device can also only receive the part of the multimedia picture source which needs to be played, and then the part of the multimedia picture source played by each display device is spliced, fused and displayed.
Taking 3 display devices as an example, as shown in fig. 6, each display device includes a display device 1 (i.e., a projector 1), a display device 2 (i.e., a projector 2), and a display device 3 (i.e., a projector 3), and in an actual use process, after the projectors 1, 2, and 3 receive output picture sources (with a resolution of 6720x1080), data with resolutions of 2880x1080, 960x1080, and 2880x1080 are respectively intercepted, and the three are spliced and fused, and then projected and played. Preferably, the fusion display interface of the projection playing is in an L shape or a surrounding shape of 360 degrees, and the fusion display interface can be played on scene canvas or directly projected on a wall for playing.
In order to improve the drawing efficiency, in some embodiments, the "drawing more than one multimedia resource in the first canvas to obtain the ultra-wide multimedia picture source" includes: establishing a first canvas, establishing a background scene in the first canvas, and drawing more than one multimedia resource on the background scene to obtain the ultra-wide multimedia picture source. A plurality of background scenes can be preset in the system, the background scenes can be directly called when needed, newly added multimedia resources are directly drawn in the background scenes, and the drawing efficiency is effectively improved.
As shown in fig. 3, in some embodiments, the "drawing a multimedia resource corresponding to the ultra-wide multimedia drawing source in the second canvas according to the output resolution to obtain the output drawing source" includes:
firstly, step S301 is entered to cut the ultra-wide multimedia image source into a plurality of image blocks according to the output resolution. For example, in fig. 1, the output resolution is 6720x1080, and the output resolution can be cut into A, B, C three blocks, and the resolutions corresponding to the three blocks are 2880x1080, 960x1080 and 2880x1080, respectively.
And then step S302 is carried out to sequentially arrange the layer drawing blocks so as to enable the recombined layer drawing blocks to accord with the display size range of the multimedia interface. In this embodiment, the multimedia interface display size refers to a maximum size range in which a multimedia resource can be displayed on a display device. The recombined output picture source accords with the display size range of the multimedia interface, and the real-time rendering of the multimedia resource can be feasible, so that the operation resource is saved, and the processing efficiency is improved (the original ultra-wide picture exceeds the display size, and the newly added multimedia resource cannot be directly drawn in the display size range of the multimedia interface under the condition of ensuring the output resolution ratio).
As shown in fig. 7, the output picture source with the resolution of 6720x1080 is cut into A, B, C three block areas, the resolutions of the three block areas are 2880x1080, 960x1080 and 2880x1080 respectively, and then the three block areas are layered into the same layer of a block a and a block B and serve as an upper layer; the picture blocks B 'and C are arranged on the same layer and serve as a lower layer, wherein the display contents of the picture blocks B and B' are the same, and therefore the spliced picture blocks conform to the resolution of the multimedia output interface 3840x 2160.
As shown in fig. 8, the output frame source with the resolution of 6720 × 1080 is also cut, and the cutting scheme and the recombination scheme are the same as those in fig. 7.
As shown in fig. 9, the output source with the resolution of 8960x720 is cut into A, B, C, D, E five block areas, the resolutions of the five block areas are 2560x720, 1280x720 and 2560x720, respectively, and then the block a and the block B are layered as the same layer and as the first layer; the drawing block B ', the drawing block C and the drawing block D are arranged on the same layer and serve as a second layer, and the drawing block D' and the drawing block E are arranged on the same layer and serve as a third layer, wherein the display contents of the drawing block B and the drawing block B 'are the same, and the display contents of the drawing block D and the drawing block D' are the same, so that the spliced drawing block conforms to the resolution of the multimedia output interface 3840x 2160.
As shown in fig. 10, the output frame with a resolution of 7680x1080 is divided into A, B, C, D four frame areas, wherein the resolutions of the four frame areas are 2880x1080, 960x1080 and 2880x1080, respectively, and then the frame a and the frame B are layered as the first layer; the painting blocks C and D are on the same layer and serve as a second layer, so that the spliced painting blocks conform to the resolution of the multimedia output interface 3840x 2160.
And then step S303 is carried out to establish a second canvas according to the area size of the layered picture block, and corresponding multimedia resources are drawn in the corresponding picture block area to obtain an output picture source.
The second canvas is established according to the area size of the layered drawing blocks, the arrangement of the layered drawing blocks accords with the display size of the multimedia interface, when the multimedia resource is drawn, the whole ultra-wide multimedia drawing source does not need to be replaced, the real-time drawing of the multimedia resource can be realized, and the processing efficiency is improved.
In some embodiments, when an instruction to update the display multimedia resource is received, the updated multimedia resource is rendered to a corresponding block area of the second canvas in real time; and sending the redrawn output picture source to more than two display devices in real time, wherein each display device displays the picture block area corresponding to the display device in the output picture source, and updating and displaying the picture block areas after splicing and fusing the picture block areas.
Taking fig. 7 as an example, when an instruction is received to add a certain picture to the a picture block, the newly added picture is drawn in the a picture block in the second canvas (the drawing area corresponding to the arrangement of the layer picture blocks) in real time; when an instruction of displaying a certain picture on the C picture block is received, the newly-added picture is drawn into the C picture block in the second canvas (a drawing area corresponding to the arrangement of the layered picture blocks) in real time; when an instruction of displaying a certain picture on the B picture block is received, the newly added picture is simultaneously drawn into the B picture block and the B' picture block (the drawing area corresponding to the arrangement of the layer picture blocks) in the second canvas.
In some embodiments, the "drawing the updated multimedia resource to the corresponding block area of the second canvas" includes:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia resource is displayed, the two picture blocks are considered to have a display boundary;
if the two picture blocks are not adjacent in the output picture source and the content or the whole content in the ultra-wide multimedia resource is repeated, the two picture blocks are considered to have a fusion area;
when the updated multimedia resource width is located in the fusion area, step S11 is executed: respectively drawing updated multimedia resources for the areas corresponding to the two picture blocks with the fusion areas;
when the updated multimedia asset width crosses the display boundary of two tiles where the display boundary exists, step S12 is performed: and cutting the updated multimedia resources according to the display boundary, wherein each picture block correspondingly draws the part positioned in the cut picture block to update the multimedia resources.
For example, in a certain application scene, a picture needs to be drawn on the second canvas, and the adding position of the picture is located in the shadow portion (i.e., the blending region) of the first layer B picture block in fig. 7, then when the picture is drawn to the shadow portion (i.e., the blending region) of the first layer B picture block, the shadow portion of the second layer B' picture block is also correspondingly drawn, so that the picture is drawn and rendered in real time.
Similarly, when the picture block in the upper column of fig. 10 receives a picture adding instruction, and when the added picture position crosses B, C two picture blocks, the picture is divided into two parts according to the display boundary of B, C picture blocks (the right boundary of the B picture block and the left boundary of the C picture block are the display boundary between the two picture blocks) when the picture is drawn, one part of the picture is drawn and displayed on the right boundary of the B picture block, and the other part of the picture is drawn and displayed on the left boundary of the C picture block, so that the picture can be completely displayed when the picture is spliced and fused. In addition, the adding operation of the picture is carried out in the second canvas, and the size of the second canvas conforms to the display size of the multimedia interface, so that the adding display of the newly added multimedia resource is realized under the condition of ensuring that the resolution of the output picture source is not lost.
In some embodiments, when the updated multimedia resource width spans the blending region of a tile and the tiles adjacent to the tile, step S2 is executed: cutting the updated multimedia resource according to the boundary of the fusion area and the adjacent picture block, and drawing the part of the adjacent picture block positioned in the picture block after cutting to update the multimedia resource; and the two picture blocks with the fusion area update the multimedia resources in the part of the fusion area after the corresponding area is cut.
Taking fig. 8 as an example, the current blending region is a B picture block and a B 'picture block, the size of the current blending region is a B picture block, and the B picture block and the B' picture block have the same size, when a picture is added between the picture block a and the picture block B, since the width of the picture spans the B picture block (i.e., the blending region) and is adjacent to the a picture block (i.e., the picture block adjacent to the B picture block), step S2 will be executed: the picture is cut according to display boundaries among A, B picture blocks, and then corresponding cut parts are correspondingly drawn on A, B picture blocks, wherein when the part of the picture is drawn on a B picture block, the picture part drawn on the B picture block is also drawn on a B' picture block synchronously. Therefore, when the width of the drawn picture passes through the junction of the A picture block and the B picture block, the picture drawn in real time can be smoothly displayed on the ultra-wide picture, and the situation that the adding operation of the picture cannot be carried out due to the limitation of the display size of the multimedia interface is avoided.
In some embodiments, the "drawing the updated multimedia resource to the corresponding block area of the second canvas" includes:
when the updated multimedia asset has no intersection with the blending area of the two tiles or the display boundaries of the two tiles where the display boundaries exist, the step S3 is executed:
s3: and directly updating the drawing area of the multimedia resource on the drawing block to draw the updated multimedia resource.
Also for the example of a newly added picture, if the position of the added picture is completely located in the a block or the B block in fig. 8, or there is no intersection with the shaded portion in fig. 7, there is no case that the width of the added picture crosses the display boundary or the blending region, and the picture is directly drawn on the current block when drawing.
In order to ensure that the drawn dynamic multimedia resources can also be displayed in the merged display interface, in some embodiments, when an instruction to move or zoom the newly added multimedia resource is received, the newly added multimedia resource is drawn to the block region corresponding to the moved or zoomed second canvas according to any one of the operations in step S11, step S12, step S2, and step S3. Taking the drawing picture movement as an example, the picture movement effect is presented by the slight change of the positions of the multi-frame images, and then the corresponding processing is sequentially carried out according to the positions of the current intra-frame pictures when the multi-frame images corresponding to the picture are drawn.
In certain embodiments, the multimedia assets include one or more of the following: h5 page, video, picture, photo, text or wine list. When the received instruction is an instruction for scaling a newly added picture, or the multimedia resource is other multimedia resources listed above except for the picture, the corresponding drawing processing mode is similar to the processing mode for moving the newly added picture, and details are not repeated here.
In some embodiments, the "drawing the newly added multimedia resource to the corresponding block area of the second canvas" further includes the following steps: and sending the redrawn output picture source to more than two display devices in real time, wherein each display device displays the picture block area corresponding to the display device in the output picture source, and updating and displaying the picture block areas after splicing and fusing the picture block areas. For example, the newly added and drawn multimedia resource is a drinking water list, the drinking water list is newly added and drawn on the basis of the original output picture source at the current output picture source, and the output picture source containing the drinking water list is displayed in the spliced and fused display picture.
For another example, if the newly added multimedia resource is a newly added display of multiple videos, the newly added multiple videos are displayed in real time in the fusion display picture after the newly added multiple videos are drawn to the second canvas, so that the multi-screen interaction effect can be realized. For another example, if the newly added multimedia resource is a series of photos and the effect of moving the series of photos from one end of the interface to the other end is realized, the effect of moving the series of photos from one end of the interface to the other end of the interface is realized by drawing the series of frame pictures of the series of photos moving on the second canvas in real time.
The inventor also provides a device for multi-device real-time interactive display, which comprises a first on-demand device and a second on-demand device, wherein the first on-demand device and the second on-demand device interact according to the method described in the foregoing.
The invention provides a method and a device for multi-device real-time interactive display, wherein the method comprises the following steps: the method comprises the steps that a first multicast device obtains more than one multimedia resource; the second on-demand equipment acquires more than one multimedia resource; the first on-demand equipment plays one multimedia resource and sends a trigger instruction to the second on-demand equipment; and the second on-demand equipment plays the multimedia resources corresponding to the trigger instruction according to the received trigger instruction, and the multimedia resources of at least one on-demand equipment are displayed on the ultra-wide screen. Therefore, when the first on-demand equipment plays the multimedia resource corresponding to the first on-demand equipment, the second on-demand equipment is triggered to synchronously play the corresponding multimedia resource, so that the multimedia resources played by the first on-demand equipment and the second on-demand equipment can realize interaction; meanwhile, because the multimedia resource of one on-demand device is displayed on the ultra-wide screen, the multimedia resource displayed on the ultra-wide screen can be interacted with the multimedia resource played by the other on-demand device while the ultra-wide screen is introduced for displaying, so that the cool feeling of playing the multimedia resource is enhanced, and the sensory experience of a user is improved.
Furthermore, the second on-demand device is also connected with more than one slave on-demand devices, and each slave on-demand device interacts with the first on-demand device and the second on-demand device according to the aforementioned interaction method.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.
Claims (13)
1. A method for multi-device real-time interactive display, which is characterized by comprising the following steps:
the method comprises the steps that a first multicast device obtains more than one multimedia resource;
the second on-demand equipment acquires more than one multimedia resource;
the first on-demand equipment plays one multimedia resource and sends a trigger instruction to the second on-demand equipment; the second on-demand equipment plays the multimedia resources corresponding to the trigger instruction according to the received trigger instruction, and the multimedia resources of at least one on-demand equipment are displayed on the ultra-wide screen;
the second on-demand equipment is connected with more than one slave on-demand equipment, and the slave on-demand equipment acquires more than one multimedia resource; after receiving the trigger instruction of the first on-demand equipment, the second on-demand equipment distributes corresponding trigger instructions to the slave on-demand equipment; and after receiving the trigger instruction, each slave on-demand equipment controls the corresponding multimedia resource to play, and the multimedia resource of at least one slave on-demand equipment is displayed on the ultra-wide screen.
2. The method for multi-device real-time interactive display according to claim 1, wherein the first on-demand device, the second on-demand device and each slave on-demand device respectively preset a synchronous playing time axis, and sequentially play the multimedia resources to be played according to the time axis progress; the multimedia resources to be played on each time axis are provided with corresponding playing time points, and when the first on-demand equipment plays the corresponding multimedia resources according to the playing time points, the currently played multimedia resources send triggering broadcast to the second on-demand equipment; and after monitoring the trigger broadcast, the second on-demand equipment forwards the trigger broadcast to all the slave on-demand equipment, and the second on-demand equipment and all the slave on-demand equipment judge whether the trigger broadcast is the pre-subscribed trigger broadcast, and if so, trigger the multimedia resource corresponding to the trigger broadcast to play.
3. The method for multi-device real-time interactive display according to claim 2, wherein in the process of playing the multimedia resources by each slave on-demand device, each multimedia resource sends out a corresponding trigger broadcast to the outside, and the second on-demand device forwards each trigger broadcast to the first on-demand device after monitoring each trigger broadcast; and the first on-demand equipment and the second on-demand equipment judge whether each trigger broadcast has a pre-subscribed trigger broadcast, and if so, trigger the multimedia resource corresponding to the trigger broadcast to play.
4. The method for multi-device real-time interactive display according to claim 1, wherein said displaying the multimedia resource on an ultra-wide screen comprises:
drawing more than one multimedia resource in a first canvas to obtain an ultra-wide multimedia drawing source;
drawing a multimedia resource corresponding to the ultra-wide multimedia drawing source in a second canvas according to the output resolution to obtain an output drawing source;
and each display device acquires the output picture source, displays the corresponding picture block, and performs splicing fusion display.
5. The method for multi-device real-time interactive display according to claim 4, wherein the step of drawing more than one multimedia resource in a first canvas to obtain an ultra-wide multimedia drawing source comprises:
establishing a first canvas, establishing a background scene in the first canvas, and drawing more than one multimedia resource on the background scene to obtain the ultra-wide multimedia picture source.
6. The method for multi-device real-time interactive display according to claim 4,
the step of drawing the multimedia resource corresponding to the ultra-wide multimedia drawing source in the second canvas according to the output resolution to obtain the output drawing source comprises the following steps:
cutting the ultra-wide multimedia picture source into a plurality of picture blocks according to the output resolution;
sequentially layering the drawing blocks to enable the recombined layering drawing blocks to accord with the display size range of the multimedia interface;
and establishing a second canvas according to the area size of the layered drawing block, and drawing corresponding multimedia resources in the corresponding drawing block area to obtain an output drawing source.
7. The method for multi-device real-time interactive display according to claim 6, wherein when an instruction for updating the display multimedia resource is received, the updated multimedia resource is drawn to a corresponding picture block area of the second canvas in real time;
and sending the redrawn output picture source to more than two display devices in real time, wherein each display device displays the picture block area corresponding to the display device in the output picture source, and updates and displays the picture block areas after splicing and fusing the picture block areas.
8. The method for multi-device real-time interactive display according to claim 7, wherein said "drawing the updated multimedia resource to the corresponding block area of the second canvas" comprises:
if the two picture blocks are not adjacent in the output picture source and are in adjacent positions when the ultra-wide multimedia resource is displayed, the two picture blocks are considered to have a display boundary;
if the two picture blocks are not adjacent in the output picture source and the content or the whole content in the ultra-wide multimedia resource is repeated, the two picture blocks are considered to have a fusion area;
when the updated multimedia resource width is located in the fusion area, step S11 is executed: respectively drawing updated multimedia resources for the areas corresponding to the two picture blocks with the fusion areas;
when the updated multimedia asset width crosses the display boundary of two tiles where the display boundary exists, step S12 is performed: cutting the updated multimedia resource according to the display boundary, wherein each picture block correspondingly draws the part located in the cut picture block to update the multimedia resource;
when the updated multimedia resource width spans the blending region of a tile and the tile adjacent to the tile, step S2 is executed: cutting the updated multimedia resource according to the boundary of the fusion area and the adjacent picture block, and drawing the part of the adjacent picture block positioned in the picture block after cutting to update the multimedia resource; and the two picture blocks with the fusion area update the multimedia resources in the part of the fusion area after the corresponding area is cut.
9. The method for multi-device real-time interactive display according to claim 7, wherein said "drawing the updated multimedia resource to the corresponding block area of the second canvas" comprises:
when the updated multimedia asset has no intersection with the blending area of the two tiles or the display boundaries of the two tiles where the display boundaries exist, the step S3 is executed:
s3: and directly updating the drawing area of the multimedia resource on the drawing block to draw the updated multimedia resource.
10. The method for multi-device real-time interactive display according to any of claims 1-9, wherein the multimedia resources comprise one or more of the following: h5 page, video, picture, photo, text or wine list.
11. The method for multi-device real-time interactive display according to claim 2, wherein the first on-demand device, the second on-demand device, the multimedia resources played from each on-demand device and the multimedia resources triggered to be played by the triggered broadcast thereof interact with each other, and the method comprises one or more of the following:
the multimedia resources played by the first on-demand equipment at a certain time point of a time axis are song MVs, and after the second on-demand equipment receives the trigger broadcast of the song MVs, the 3D scene multimedia resources matched with the types of the songs are triggered and played;
or the multimedia resource played by the first on-demand equipment at another time point of the time axis is a song MV, and after the second on-demand equipment receives the trigger broadcast of the song MV, the 3D scene matched with one or more of a song number, a song name and lyric content corresponding to the song MV is triggered and played; after the second on-demand equipment transfers corresponding trigger broadcasts to the slave on-demand equipment, one of the slave on-demand equipment which subscribes the trigger broadcasts in advance plays a 3D scene which is matched with one or more of the song number, the song name and the lyric content;
or the multimedia resource played by the first on-demand equipment at another time point of the time axis is a song MV, and after the second on-demand equipment receives the trigger broadcast of the song MV, the second on-demand equipment triggers to play the visual video generated according to the song audio; the generating of the visual video according to the song audio comprises: the method comprises the steps of obtaining audio data corresponding to a song MV, identifying an audio beat value and an audio amplitude corresponding to the audio data, and generating a video of the audio data according to the audio beat value and the audio amplitude, wherein the display speed of the audio amplitude is determined according to the audio beat value.
12. An apparatus for multi-device real-time interactive display, wherein the apparatus comprises a first on-demand device and a second on-demand device, and the first on-demand device and the second on-demand device interact according to the method of any one of claims 1 to 11.
13. The apparatus for multi-device real-time interactive display according to claim 12, wherein the second on-demand device is further connected to more than one slave on-demand devices, and each slave on-demand device interacts with the first on-demand device and the second on-demand device according to any one of the methods of claims 2-11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910654620.XA CN110430454B (en) | 2019-07-19 | 2019-07-19 | Multi-device real-time interactive display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910654620.XA CN110430454B (en) | 2019-07-19 | 2019-07-19 | Multi-device real-time interactive display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110430454A CN110430454A (en) | 2019-11-08 |
| CN110430454B true CN110430454B (en) | 2021-06-22 |
Family
ID=68410178
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910654620.XA Active CN110430454B (en) | 2019-07-19 | 2019-07-19 | Multi-device real-time interactive display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110430454B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109819180A (en) * | 2019-01-18 | 2019-05-28 | 上海皓空数码科技有限公司 | A kind of ultra-wide picture fusion display methods and system |
| CN109996024A (en) * | 2018-01-02 | 2019-07-09 | 中国移动通信有限公司研究院 | A kind of exchange method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017016339A1 (en) * | 2015-07-27 | 2017-02-02 | 腾讯科技（深圳）有限公司 | Video sharing method and device, and video playing method and device |
-
2019
- 2019-07-19 CN CN201910654620.XA patent/CN110430454B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109996024A (en) * | 2018-01-02 | 2019-07-09 | 中国移动通信有限公司研究院 | A kind of exchange method and device |
| CN109819180A (en) * | 2019-01-18 | 2019-05-28 | 上海皓空数码科技有限公司 | A kind of ultra-wide picture fusion display methods and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110430454A (en) | 2019-11-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6878014B2 (en) | Image processing device and its method, program, image processing system | |
| CN110798697B (en) | Video display method, device and system and electronic equipment | |
| CN107197341B (en) | Dazzle screen display method and device based on GPU and storage equipment | |
| CN108108140B (en) | Multi-screen cooperative display method, storage device and equipment supporting 3D display | |
| JP2015187797A (en) | Image data generation device and image data reproduction device | |
| CN110225224B (en) | Virtual image guiding and broadcasting method, device and system | |
| CN106060606A (en) | Large-screen partition display method, play terminal and system of digital audio-visual place, and digital video-on-demand system | |
| US20210211632A1 (en) | Three-dimensional content distribution system, three-dimensional content distribution method and computer program | |
| JP2011501501A (en) | Apparatus and method for providing stereoscopic 3D video content for LASeR-based terminals | |
| CN113473207B (en) | Live broadcast method and device, storage medium and electronic equipment | |
| JP2011525732A (en) | Method and system for switching between video sources | |
| KR101340598B1 (en) | Method for generating a movie-based, multi-viewpoint virtual reality and panoramic viewer using 3d surface tile array texture mapping | |
| CN113596553A (en) | Video playing method and device, computer equipment and storage medium | |
| CN104967898A (en) | Method and device for displaying speech made by virtual spectators | |
| CN110730340B (en) | Virtual audience display method, system and storage medium based on lens transformation | |
| KR101752691B1 (en) | Apparatus and method for providing virtual 3d contents animation where view selection is possible | |
| Oyman et al. | Virtual reality industry forum's view on state of the immersive media industry | |
| CN112153472A (en) | Method and device for generating special picture effect, storage medium and electronic equipment | |
| CN110430454B (en) | Multi-device real-time interactive display method and device | |
| CN110677600B (en) | Multi-group display method and system of ultra-wide picture, on-demand equipment and on-demand system | |
| CN105142033A (en) | Interactive information display method and system | |
| CN103336678B (en) | A kind of resource exhibition method, device and terminal | |
| KR100676672B1 (en) | Method for authoring majority view contents or panorama contents, system and apparatus and method for interactive multi-view contents using its | |
| Daras et al. | An MPEG-4 tool for composing 3D scenes | |
| CN115665461B (en) | Video recording method and virtual reality device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |