CN109669753B - Digital audio-visual system interface display method and computer readable storage medium - Google Patents
Digital audio-visual system interface display method and computer readable storage medium Download PDFInfo
- Publication number
- CN109669753B CN109669753B CN201811572786.9A CN201811572786A CN109669753B CN 109669753 B CN109669753 B CN 109669753B CN 201811572786 A CN201811572786 A CN 201811572786A CN 109669753 B CN109669753 B CN 109669753B
- Authority
- CN
- China
- Prior art keywords
- multimedia
- fuzzy
- multimedia resource
- displayed
- resources
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/142—Edging; Contouring
Abstract
The invention relates to the technical field of multimedia, and discloses a digital audio-visual system interface display method and a computer readable storage medium, wherein the digital audio-visual system interface display method comprises the following steps: acquiring more than two multimedia resources, and setting different spatial coordinate positions for the multimedia resources; presetting more than two virtual cameras, wherein a space coordinate area where each multimedia resource is located at least corresponds to one virtual camera; rendering the space coordinate region sequentially through the virtual camera according to a time axis, and sequentially switching and displaying the multimedia resources. According to the technical scheme, the effect of switching and displaying a plurality of multimedia resources in the MV can be realized by combining the virtual camera and the time axis, the display switching among different multimedia resources is smoother and more coordinated, and the multimedia resource display effect of the photo MV is greatly improved.
Description
Technical Field
The present invention relates to the multimedia technology field, and in particular, to a digital audiovisual system interface display method and a computer readable storage medium.
Background
When a digital audiovisual system such as KTV and karaoke requests a song, the corresponding song MV is also played. The MV is a Music Video (english name: Music Video), which is a short Video accompanied by audio (usually, mostly songs). The MVs in the digital audiovisual system include photo MVs in addition to conventional video MVs. The photo MV comprises a plurality of photos, and different photos are displayed in turn, such as an electronic photo album of a wedding photo or a personal electronic photo album.
However, in the conventional photos MV, when the photos are played, the photos are mainly switched between the front and rear photos directly, or the photos are switched between the front and rear photos by reducing and enlarging the sizes of the front and rear photos. Therefore, the display effect of switching the photos in the photo MV is very hard and discordant, and the user experience is not good.
Disclosure of Invention
Therefore, a new digital audio-visual system interface display method needs to be provided to solve the technical problems in the prior art that the picture switching display effect in the MV picture is hard and discordant and the user experience is poor.
In order to achieve the above object, the inventor provides an interface display method for a digital audiovisual system, where the digital audiovisual system obtains audio data to play through an audio output device, and the audio data is a singing audio or a mixed audio of the singing audio and a song accompaniment audio; the interface display method comprises the following steps:
the method comprises the steps of obtaining more than two multimedia resources, sequentially switching and displaying the multimedia resources, wherein when the multimedia resources are switched and displayed, the current multimedia resources are gradually changed from clear to fuzzy in a motion state, and the next multimedia resource to be displayed is gradually changed from fuzzy to clear in the motion state.
Further, when the display is switched, the current multimedia resource gradually changes from clear to fuzzy until disappearing in the motion state, the next multimedia resource to be displayed gradually changes from fuzzy to clear in the motion state, and then the next multimedia resource to be displayed is displayed in a fuzzy manner.
Further, after the multimedia resource is acquired, the method further comprises the following steps:
respectively superposing the more than two multimedia resources into the fuzzy background multimedia resources with the depth of field effect to form more than two 3D display objects;
and during the switching display, sequentially switching and displaying the 3D display objects, so that the current 3D display object gradually changes from clear to fuzzy in the motion state, and the next 3D display object gradually changes from fuzzy to clear in the motion state.
Further, the step of acquiring more than two multimedia resources comprises the following steps:
acquiring more than two multimedia resources;
establishing a 3D space coordinate system, and adding the more than two multimedia resources to different positions in the 3D space coordinate system;
the method comprises the following steps that the multimedia resources are sequentially switched and displayed, when the multimedia resources are switched and displayed, the current multimedia resources are gradually switched from clear to fuzzy in a motion state, and the next multimedia resource to be displayed is gradually switched from fuzzy to clear, and comprises the following steps:
presetting more than two virtual cameras, wherein a space coordinate area where each multimedia resource is located at least corresponds to one virtual camera;
sequentially switching the virtual cameras according to a time axis to render the corresponding space coordinate areas;
when the multimedia resources are switched, the current multimedia resources gradually change from clear to fuzzy in the motion state, and the next multimedia resource to be displayed gradually changes from fuzzy to clear in the motion state.
Further, the space coordinate areas corresponding to two adjacent virtual cameras are partially overlapped, so that the space coordinate area corresponding to the virtual camera contains the next adjacent multimedia resource;
and when the virtual camera is used for rendering, the next multimedia resource is subjected to fuzzy processing, so that the picture rendered by the virtual camera has a clear current multimedia resource and a fuzzy next multimedia resource at the same time, and the display effect of gradually changing from fuzzy to clear is realized when the multimedia resources are switched.
Furthermore, two virtual cameras are respectively preset in a space coordinate area where each multimedia resource is located, wherein one virtual camera is used for acquiring clear multimedia resources, and the other virtual camera is used for acquiring fuzzy background multimedia resources behind the multimedia resources;
and superposing the pictures acquired by the two virtual cameras front and back to synthesize a 3D display object with a depth-of-field fuzzy effect.
Further, the space coordinate areas corresponding to two adjacent virtual cameras are partially overlapped, so that the space coordinate areas corresponding to the virtual cameras contain more than three multimedia resources;
when the virtual camera renders the corresponding space coordinate area, the digital audio-visual system interface simultaneously displays more than three multimedia resources, wherein one multimedia resource is a clear current multimedia resource, and the remaining more than two multimedia resources are fuzzy multimedia resources to be displayed;
when the virtual camera is switched according to the time axis, the current multimedia resource gradually changes from clear to fuzzy until disappearing in the motion state, the next multimedia resource to be displayed gradually changes from fuzzy to clear display in the motion state, and then the next multimedia resource to be displayed is displayed in a fuzzy manner.
Further, more than two display templates with different sizes are preset, and when the multimedia resources are obtained, the corresponding display templates are matched according to the sizes of the multimedia resources, or the multimedia resources are cut or zoomed according to the appointed display templates.
Further, when the multimedia resources are sequentially switched and displayed, a background material is displayed in an overlapping mode, and the background material is one or combination of a photo, the multimedia resources, a text, animation or a video.
Further, the digital audio-visual system interface display method of the present invention further comprises the steps of:
and acquiring lyrics of the audio data, and superposing the lyrics of the audio data on a display interface.
Further, the step of acquiring more than two multimedia resources comprises:
establishing communication connection with a mobile terminal;
and receiving more than two multimedia resources sent by the mobile terminal.
In order to solve the above technical problem, the present invention further provides a computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of any one of the above technical solutions.
Different from the prior art, the digital audio-visual system in the technical scheme can obtain the multimedia resources, and switch different multimedia resources according to the time axis on the display interface, the multimedia resource switching display is realized by changing the current multimedia resource from clear to fuzzy, and simultaneously changing the next multimedia resource to be displayed from fuzzy to clear, so that the display switching between different multimedia resources is smoother and more coordinated, and the display effect of the photo MV in the digital audio-visual system is greatly improved.
Drawings
FIG. 1 is a flow chart illustrating a method for displaying an interface of a digital audio visual system according to an embodiment;
FIG. 1a is a schematic diagram illustrating transmission of a photo in a song requested by a singing venue in accordance with an exemplary embodiment;
FIG. 2 is a diagram of a virtual camera and timeline according to an embodiment;
FIG. 3 is a schematic view of the virtual camera during the switching blurring process of the multimedia resources according to an embodiment;
FIG. 4 is a schematic view of the virtual camera during depth-of-field blur processing of the multimedia resource according to an embodiment;
FIG. 5 is a block diagram of a computer-readable storage medium in accordance with an embodiment;
description of reference numerals:
10. a requesting device;
20. a mobile terminal;
30. a computer-readable storage medium;
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Referring to fig. 1 to 5, the present embodiment provides a method for displaying an interface of a digital audiovisual system, wherein the digital audiovisual system can play audio data, and switch and display a plurality of multimedia resources inserted in real time on the display interface.
As shown in fig. 1, a flow chart of a method for playing audio data and displaying an interface for the digital audiovisual system is shown. The digital audio-visual system interface display method comprises the following steps:
s101, a digital audio-visual system acquires audio data and plays the audio data through audio output equipment, wherein the audio data can be singing audio or mixed audio of the singing audio and song accompaniment audio;
s102, acquiring more than two multimedia resources;
s103, the multimedia resources are sequentially switched and displayed, when the display is switched, the current multimedia resource is gradually changed from clear to fuzzy in the motion state, and the next multimedia resource to be displayed is gradually changed from fuzzy to clear in the motion state.
The above steps S101 to S103 are executed in a digital audiovisual system, which refers to a digital multimedia device having video data playing (including multimedia resource data) and audio data input and output (i.e. a jukebox function) at the same time. The digital audio-visual system can be specifically a song ordering system of public entertainment places such as KTV, karaoke and the like, and can also be a household digital set-top box or a home theater system with a song ordering function.
In step S101, the digital audiovisual system may receive audio data input by an audio input device such as a microphone, and send the audio data to an audio output device for playing, or mix the input audio data with song accompaniment audio played by the system, and play the mixed audio obtained after mixing.
Step S102 may be performed in parallel with step S101, that is, step S102 and step S101 may be controlled by two different threads, so that there may be no obvious sequence in time between them, and step S102 may be performed synchronously with step S101, or may be started only when step S101 is executed at any time.
In step S102, the multimedia resource may be a multimedia resource already stored locally in the computer device, or a multimedia resource downloaded in real time from a network, and the multimedia resource may be a character photo, a scene photo, a multimedia resource, text, animation, or video, or other types of multimedia resources. The obtained multimedia resources can correspond to different moments on a time axis, so that different multimedia resources can be sequentially switched and displayed according to the time sequence. When different multimedia resources are switched and displayed, the multimedia resources displayed in the front and the back are processed, so that the current multimedia resource is converted from clear to fuzzy in the motion state, and the next multimedia resource to be displayed is converted from fuzzy to clear in the motion state, therefore, in the switching process of the multimedia resources, the display switching among the different multimedia resources is smoother and more coordinated, and the display effect of the photo MV in the digital audio-visual system is greatly improved.
In some embodiments, in the display interface of the digital audiovisual system, only two multimedia resources before and after the current switching may be displayed simultaneously, that is, a clear multimedia resource (i.e., the current multimedia resource) and a fuzzy multimedia resource (i.e., the next multimedia resource to be displayed) may be displayed at the same time in the display interface. The switching display of the current multimedia resource and the next multimedia resource to be displayed can be carried out discontinuously, namely when the display interface is switched from the multimedia resource to the multimedia resource II, only the multimedia resource II is displayed on the display interface for a period of time, and then the switching of the multimedia resource II to the multimedia resource III is carried out.
In some embodiments, the switching display of the current multimedia resource and the next multimedia resource to be displayed is performed continuously, that is, when the current multimedia resource changes from clear to fuzzy until disappears in the motion state, the next multimedia resource to be displayed changes from fuzzy to clear display in the motion state, and the next multimedia resource to be displayed is displayed in the display interface in a fuzzy manner, so that a clear multimedia resource and a fuzzy multimedia resource exist at any time in the display interface.
In other embodiments, when the current multimedia resource changes from clear to fuzzy in the motion state but does not disappear completely, the next multimedia resource to be displayed changes from fuzzy to clear in the motion state, and the next multimedia resource to be displayed is displayed in the display interface in a fuzzy manner, so that three multimedia resources can be seen on the display interface at the same time. And the fuzzy degree and the transparency of the next to-be-displayed multimedia resource are larger than those of the next to-be-displayed multimedia resource, namely, the next to-be-displayed multimedia resource is displayed less clearly relative to the next to-be-displayed multimedia resource and is only invisible. By adopting the mode of continuously switching and displaying the multimedia resources, on one hand, the switching time interval between different multimedia resources can be shortened, and more multimedia resources can be switched and displayed in unit time; on the other hand, the switching of the multimedia resources in the display interface is more continuous, so that a better visual effect is achieved.
In a preferred embodiment, the switching display of the multimedia resource can be realized by a space coordinate system and a virtual camera. In step S102, a spatial coordinate system may be pre-established, and the acquired multimedia resource is configured with different spatial coordinate positions in the spatial coordinate system, where the spatial coordinate positions are related to the last display position of the multimedia resource on the display screen, and the different coordinate positions correspond to different display positions.
In step S103, more than two virtual cameras may be preset, and a spatial coordinate area where each multimedia resource is located corresponds to at least one virtual camera; and rendering through the virtual camera to realize the display of the multimedia resources on a display interface. The virtual camera simulates the function of a real camera by using a computer program, so that the virtual camera has an imaging function similar to that of the real camera. The difference lies in that the real camera images according to the light emitted into the imaging chip from the outside, and the virtual camera images according to the multimedia resource data corresponding to the virtual camera.
As shown in fig. 2, in step S102, each virtual camera points to a coordinate area in the coordinate system, and thus the virtual camera is responsible for rendering and imaging the area. And each coordinate area is at least provided with one multimedia resource, so that when different coordinate areas are rendered through different virtual cameras, a picture which cannot become the multimedia resource can be generated.
In order to enable the display interface to see three multimedia resources at the same time, the spatial coordinate areas corresponding to the two adjacent virtual cameras are partially overlapped, and the spatial coordinate areas corresponding to the virtual cameras contain more than three multimedia resources, namely, the viewing frame of the virtual camera can simultaneously cover the areas where the more than three multimedia resources are located.
Therefore, when the virtual camera renders the corresponding space coordinate area, the three or more multimedia resources can be simultaneously displayed on the digital audio-visual system interface. In order to enable the display interface to display the visual effects of the current multimedia resource being clear and other multimedia resources being fuzzy, the multimedia resources may be disposed at different positions of the 3D coordinate system, so that the distances from the multimedia resources to the virtual cameras are different, and the virtual cameras are gathered to one of the multimedia resources (i.e., the current multimedia resource). The aggregated multimedia asset (i.e., the current multimedia asset) is displayed clearly, while the remaining multimedia assets in the frame are displayed in a blurred manner. Another virtual camera adjacent to the other virtual camera is gathered to another multimedia asset (i.e., the next multimedia asset to be displayed).
Therefore, when the virtual camera is switched according to the time sequence, the current multimedia resource is changed from clear to fuzzy until disappearing in the motion state, the next multimedia resource to be displayed is changed from fuzzy to clear in the motion state, and then the next multimedia resource to be displayed is displayed in a fuzzy manner.
In order to make the transition of the display interface smoother when different virtual cameras are switched, an interface switching transition mechanism can be set. One of the transition mechanisms is a fade-in/fade-out transition mechanism, and the other is a view frame translation transition mechanism.
The fade-in fade-out transition mechanism is that in the display interface switching process, a display image formed by rendering of the current virtual camera is gradually faded, and when the fading reaches a certain threshold value, the current virtual camera is switched to the next virtual camera for rendering imaging. The next virtual camera is displayed as a lighter (i.e., more transparent) image when rendering the image, and gradually deepens the display effect of the image with time. Therefore, the current image gradually becomes fuzzy and light in the switching process, and then when the switching is carried out to the next image, the next image is changed from fuzzy to clear and from light to dark.
The viewfinder translation transition mechanism is as follows: the viewfinder of each virtual camera is arranged to be movable, namely the viewfinder area corresponding to the virtual camera can be moved. And in the process of switching the display interface, the viewing frame of the current virtual camera moves towards the area corresponding to the next virtual camera, so that the image generated by the current virtual camera is closer to the image generated by the next virtual camera. And when the view frame of the current virtual camera is overlapped (or nearly overlapped) with the view frame of the next virtual camera, the current virtual camera is switched to the next virtual camera, so that the images generated by the two virtual cameras during switching are approximately the same, and smooth switching is realized.
In step S103, the time axis is a time sequence in which two or more events are connected in series so that different events are sequentially executed. In step S103, two or more virtual cameras are associated with the time axis, so that the virtual cameras are sequentially triggered in time sequence. As shown in fig. 2, for convenience of understanding, the time axis is schematically marked below the first to third virtual cameras and points to the right from the left, which means that the first to third virtual cameras are triggered in time sequence, when the first virtual camera is triggered to operate, the first multimedia resource is rendered and displayed on the display screen, and when the second virtual camera is triggered to operate, the second multimedia resource is rendered and displayed on the display screen. In the present embodiment, the virtual cameras are operated alternately in the time axis, that is, the virtual cameras are not always in an operating state, and different virtual cameras are operated alternately in the time axis from on to off. When the next virtual camera is triggered to work, the last virtual camera is closed (for example, when the second virtual camera works in fig. 2, the virtual camera is closed as soon as the second virtual camera works), so that the switching from the multimedia resource to the second multimedia resource is realized. But this does not mean that the last virtual camera will be turned off as soon as the next virtual camera is triggered. Taking fig. 2 as an example, the first virtual camera may be turned off after the second virtual camera operates for a period of time, so that the first multimedia resource and the second multimedia resource have a period of time and can be simultaneously displayed on the display screen, thereby achieving the display effect of seamless switching. Or the virtual camera can be closed before the virtual camera II is started to work, so that the multimedia resource I and the multimedia resource II are discontinuously displayed on the display screen.
When the virtual camera renders the spatial coordinate region, the virtual camera may perform a blurring process on a surrounding region of the multimedia resource in the spatial coordinate region, so that the multimedia resource is clear, and the surrounding of the multimedia resource is blurred (i.e., the next multimedia resource to be displayed is also blurred). Therefore, when different virtual cameras are switched according to the time axis, the different virtual cameras alternately generate clear pictures of the surrounding fuzzy middle multimedia resources, so that when the switching of the different multimedia resources is visually realized, the current multimedia resource is changed from clear to fuzzy, and the next multimedia resource to be displayed is gradually changed from fuzzy to clear.
In this embodiment. By presetting more than two virtual cameras, each virtual camera corresponds to a space coordinate area where different multimedia resources are located, and rendering is performed on the areas where the different multimedia resources are located sequentially through the different virtual cameras according to a time axis, the multimedia resources are sequentially switched and displayed, so that the effect of switching and displaying the plurality of multimedia resources in a display interface is achieved, the effect of fuzzy switching of the multimedia resources is achieved through fuzzy processing of the virtual cameras, the display switching among the different multimedia resources is smoother and more coordinated, and the multimedia resource display effect of the photo MV is greatly improved.
In step S102, the acquired multimedia resource may be transmitted by the mobile terminal, that is, in step S102, the digital audiovisual system establishes a communication connection with the mobile terminal, and then receives more than two multimedia resources transmitted by the mobile terminal. Because the existing mobile terminals such as smart phones and tablet computers have strong functions and usually store a large amount of materials of multimedia resources, users can select the materials of the multimedia resources according to the needs of the users and upload the materials to a digital audio-visual system, and the digital audio-visual system makes corresponding multimedia resources MV.
As shown in fig. 1a, the interface display method of the digital audio-visual system is described by taking the requesting song in the KTV singing place as an example, wherein the requesting device 10 in the singing place has functions of receiving multimedia resources and processing multimedia resources in addition to the original requesting function, and the specific steps are as follows:
1. the song ordering device 10 in the singing place plays the ordered song and the MV of the song (wherein the MV of the song is made in advance);
2. the mobile terminal 20 establishes a connection with the singing requesting device 10 and sends the multimedia resource to the singing requesting device 10 (wherein, step 2 can be before step 1 or after step 1, that is, the mobile terminal can be connected with the singing requesting device at any time and send the multimedia resource);
3. the singing-requesting device 10 sequentially triggers different virtual cameras according to a time axis, so that the different virtual cameras alternately perform rendering imaging on different multimedia resources, the surrounding areas of the multimedia resources are subjected to fuzzy processing through the virtual cameras, the current multimedia resources are displayed clearly, the next image is displayed in a fuzzy manner, the multimedia resources uploaded by the mobile terminal are superposed into the existing MV, the multimedia resources are sequentially switched and displayed in the MV, and the effects that the current multimedia resources are gradually converted from clear to fuzzy in a motion state and the next multimedia resources to be displayed are gradually converted from fuzzy to clear in the motion state are achieved during switching and displaying. Of course, in some cases, it may not be necessary to make the song MV in advance, and the jukebox device may directly display the multimedia resources on the display interface in sequence according to the acquired multimedia resources.
As shown in fig. 2, the coordinate area corresponding to each virtual camera is larger than the area where the multimedia resource is located, that is, the coordinate area corresponding to each virtual camera includes the corresponding multimedia resource and also has redundancy. Therefore, when the virtual camera renders the space coordinate region, redundant parts around the multimedia resources are subjected to fuzzy processing.
In the embodiment shown in fig. 2, the coordinate regions corresponding to the virtual cameras are independent from each other, that is, do not overlap with each other, so that the screen contents rendered by the virtual cameras are also not intersected with each other, and the multimedia resources are displayed independently.
In another embodiment, as shown in fig. 3, the multimedia resources are adjacently disposed in the spatial coordinate system, and the coordinate regions corresponding to the adjacently disposed virtual cameras are partially overlapped, so that the virtual cameras can image the overlapped next spatial coordinate region, and the spatial coordinate region corresponding to the virtual camera includes the next adjacent multimedia resource. In fig. 3, the first virtual camera may image a first region and may image a second region overlapping the first region, and the second multimedia resource may be located in the overlapping region or partially located in the overlapping region. Similarly, virtual camera two and virtual camera three are also similar. Therefore, when the virtual camera performs rendering in step S103, two multimedia assets can be imaged at the same time.
The spatial coordinate region division is adopted to enable different multimedia resources to show a motion blur effect when being switched and displayed, namely the current multimedia resource is gradually changed from clear to fuzzy in a motion state, and the next multimedia resource to be displayed is gradually changed from fuzzy to clear in the motion state. The method specifically comprises the following steps: when the multimedia resource is switched to be subjected to fuzzy processing, the virtual camera images a corresponding space coordinate area, and an obtained picture comprises the multimedia resource in the space coordinate area and a next multimedia resource in an overlapping area; and carrying out fuzzy processing on the next multimedia resource to ensure that the picture obtained by the virtual camera has clear multimedia resources and fuzzy next multimedia resources at the same time, so that the display effect of changing the fuzzy gradual change into the clear multimedia resources is realized when the multimedia resources are switched.
Taking fig. 3 as an example, a picture obtained by rendering by the virtual camera i includes the multimedia resource i in the area i and part of the multimedia resource i in the area i and the multimedia resource ii in the area i overlapping part, and when the time axis triggers the virtual camera ii to render, part of the picture of the multimedia resource ii in the area ii, the multimedia resource iii in the area ii, and the area ii and the area iii that are blurred in the area iii can be displayed. Therefore, when the time axis enables the first virtual camera and the second virtual camera to work alternately, the switching process of the second multimedia resource from the fuzzy state to the clear state is displayed, and the switching display effect of the third multimedia resource and the fourth multimedia resource is similar to that of the second multimedia resource.
In the above embodiment, the acquired multimedia resource may be a two-dimensional planar multimedia resource or a two-dimensional video, and in order to achieve a better display effect, the digital audiovisual system may display and switch the acquired planar multimedia resource or the video in a 3D stereoscopic effect. The digital audio-visual system can respectively superpose the more than two multimedia resources into the fuzzy background multimedia resource with the depth of field effect to form more than two 3D display objects;
and during the switching display, sequentially switching and displaying the 3D display objects according to a time axis, so that the current 3D display object is converted from clear to fuzzy in the motion state, and the next 3D display object is converted from fuzzy to clear in the motion state.
As shown in fig. 4, in order to realize the switching display of the 3D display objects, two virtual cameras need to be preset in a space coordinate region where each 3D display object is located, one of the virtual cameras is used to obtain a clear multimedia resource, and the other virtual camera is used to obtain a background multimedia resource behind the multimedia resource (where the length direction of the multimedia resource is an X axis, the width direction is a Y axis, and the rear of the multimedia resource is a Z axis). And superposing the multimedia resources acquired by the two virtual cameras and the background multimedia resources front and back to synthesize a 3D display object with a field depth fuzzy effect, thereby creating a stronger 3D visual effect. When two virtual cameras corresponding to different space coordinate areas are triggered in sequence according to a time axis, fuzzy switching display of the 3D display object can be achieved, namely the current 3D display object is switched from clear to fuzzy, and the next 3D display object is switched from fuzzy to clear.
As shown in fig. 4, there are two virtual cameras corresponding to the first to third areas, wherein one of the virtual cameras in each area is used to acquire the clear multimedia resources in the area, and the other virtual camera can be used to acquire the background multimedia resources in the corresponding area. Then, each area superposes the multimedia resources acquired by the two virtual cameras, so that the clear multimedia resources are behind the front background multimedia resources, and a field depth fuzzy effect with fuzzy background is formed.
Since the sizes of the obtained multimedia resources may be different, in an embodiment, more than two multimedia resource templates with different sizes are preset. In step S102, when the multimedia resource is obtained, the corresponding multimedia resource template may be matched according to the size of the multimedia resource, or the multimedia resource may be trimmed or scaled according to the designated multimedia resource template. The multimedia resources can be automatically cut or zoomed by presetting the multimedia resource template, and the efficiency of processing the multimedia resources can be greatly improved.
In an embodiment, in order to enrich the display content of the display interface, the display interface can add a background material in addition to the effect of fuzzy switching display of the multimedia resources, so that the multimedia resources are switched and displayed in a scene with a background. The background material may be one or more of a photo, a multimedia asset, text, animation, or video.
In step S101, the played audio data may be a song file, so that in order to facilitate singing of the song, the display interface may further display the corresponding lyrics in an overlaid manner on the display interface of the digital audiovisual system.
In the above embodiment, the steps S102 to S103 may be implemented by Unity, which is a cross-platform 2D/3D game engine developed by Unity Technologies, and may be used to develop a stand-alone game of Windows, MacOS and Linux platforms, a video game of game host platforms such as PlayStation, XBox, Wii, 3DS and nintendo Switch, or a game of mobile devices such as iOS and Android. Various functional plugins are integrated in the unit, wherein the functional plugins comprise Timeline, Cinemachine, Post processing stack and the like. The Timeline function plug-in is a Timeline plug-in, and can sequentially trigger corresponding objects according to a time sequence. The Cinemachine function plug-in is a virtual camera plug-in, and different objects can be rendered and imaged through the plug-in. The Post processing stack function plug-in can realize the fuzzy processing function of multimedia resources. In step S102, a plurality of virtual cameras in the Cinemachine function plug-in may correspond to different spatial coordinate regions where the multimedia resources are located; and in step S103, the virtual cameras are sequentially triggered by the Timeline functional plug-ins. The multimedia resource switching fuzzy processing and the depth-of-field fuzzy processing can be executed through the Post processing stack functional plug-in. Therefore, through the combined use of the Timeline, the cinema chip and the Post processing stack functional plug-in the unity, the switching display of a plurality of multimedia resources in the MV can be realized, the switching of the multimedia resources is soft and smooth, the effects of fuzzy switching and field depth blurring are achieved, and a strong 3D space feeling is created.
The multimedia resource templates can also be realized through the unity, a multimedia resource assembly can be established in the unity, each multimedia resource assembly comprises multimedia resource templates with different sizes and shapes, such as a rectangle, a square or a star, the proportional sizes of the photos sent by the mobile terminal can be automatically identified in real time through a setting program, and the appropriate multimedia resource templates can be intelligently matched, so that manual processing of a user is not needed.
As shown in fig. 5, the inventors also provide a computer-readable storage medium 30 having a computer program stored therein. Such storage media include, but are not limited to: RAM, ROM, magnetic disk, magnetic tape, optical disk, flash memory, U disk, removable hard disk, memory card, memory stick, network server storage, network cloud storage, etc. The computer program when executed by a processor implementing the steps of:
s101, a digital audio-visual system acquires audio data and plays the audio data through audio output equipment, wherein the audio data can be singing audio or mixed audio of the singing audio and song accompaniment audio;
s102, acquiring more than two multimedia resources;
s103, the multimedia resources are sequentially switched and displayed, when the display is switched, the current multimedia resource is gradually changed from clear to fuzzy in the motion state, and the next multimedia resource to be displayed is gradually changed from fuzzy to clear in the motion state.
The above steps S101 to S103 are executed in a digital audiovisual system, which refers to a digital multimedia device having video data playing (including multimedia resource data) and audio data input and output (i.e. a jukebox function) at the same time. The digital audio-visual system can be specifically a song ordering system of public entertainment places such as KTV, karaoke and the like, and can also be a household digital set-top box or a home theater system with a song ordering function.
In step S101, the digital audiovisual system may receive audio data input by an audio input device such as a microphone, and send the audio data to an audio output device for playing, or mix the input audio data with song accompaniment audio played by the system, and play the mixed audio obtained after mixing.
Step S102 may be performed in parallel with step S101, that is, step S102 and step S101 may be controlled by two different threads, so that there may be no obvious sequence in time between them, and step S102 may be performed synchronously with step S101, or may be started only when step S101 is executed at any time.
In step S102, the multimedia resource may be a multimedia resource already stored locally in the computer device, or a multimedia resource downloaded in real time from a network, and the multimedia resource may be a character photo, a scene photo multimedia resource, a text, a video, an animation, or other types of multimedia resources. The obtained multimedia resources can correspond to different moments on a time axis, so that different multimedia resources can be sequentially switched and displayed according to the time sequence. When different multimedia resources are switched and displayed, the multimedia resources displayed in the front and the back are processed, so that the current multimedia resource is converted from clear to fuzzy in the motion state, and the next multimedia resource to be displayed is converted from fuzzy to clear in the motion state, therefore, the display switching of the different multimedia resources is smoother and more coordinated in the switching process of the multimedia resources, and the display effect of the photo MV in the digital audio-visual system is greatly improved.
In some embodiments, in the display interface of the digital audiovisual system, only two multimedia resources before and after the current switching may be displayed simultaneously, that is, at most, only one clear multimedia resource (i.e., the current multimedia resource) and one fuzzy multimedia resource (i.e., the next multimedia resource to be displayed) may be displayed at the same time in the display interface. The switching display of the current multimedia resource and the next multimedia resource to be displayed can be carried out discontinuously, namely when the display interface is switched from the multimedia resource to the multimedia resource II, only the multimedia resource II is displayed on the display interface for a period of time, and then the switching of the multimedia resource II to the multimedia resource III is carried out.
In some embodiments, the switching display of the current multimedia resource and the next multimedia resource to be displayed is performed continuously, that is, when the current multimedia resource changes from clear to fuzzy until disappears, the next multimedia resource to be displayed changes from fuzzy to clear, and the next multimedia resource to be displayed is displayed in the display interface in a fuzzy manner, so that a clear multimedia resource and a fuzzy multimedia resource are available at any time in the display interface.
In other embodiments, when the current multimedia resource changes from clear to fuzzy but does not disappear completely, the next multimedia resource to be displayed changes from fuzzy to clear simultaneously, and the next multimedia resource to be displayed is displayed in the display interface in a fuzzy manner, so that three multimedia resources can be seen on the display interface simultaneously. And the fuzzy degree and the transparency of the next to-be-displayed multimedia resource are larger than those of the next to-be-displayed multimedia resource, namely, the next to-be-displayed multimedia resource is displayed less clearly relative to the next to-be-displayed multimedia resource and is only invisible. By adopting the mode of continuously switching and displaying the multimedia resources, on one hand, the switching time interval between different multimedia resources can be shortened, and more multimedia resources can be switched and displayed in unit time; on the other hand, the switching of the multimedia resources in the display interface is more continuous, so that a better visual effect is achieved.
In the above embodiment, the switching display of the multimedia resource can be realized by the spatial coordinate system and the virtual camera. In step S102, a spatial coordinate system may be pre-established, and the acquired multimedia resource is configured with different spatial coordinate positions in the spatial coordinate system, where the spatial coordinate positions are related to the last display position of the multimedia resource on the display screen, and the different coordinate positions correspond to different display positions.
In step S103, more than two virtual cameras may be preset, and a spatial coordinate area where each multimedia resource is located corresponds to at least one virtual camera; and rendering through the virtual camera to realize the display of the multimedia resources on a display interface. The virtual camera simulates the function of a real camera by using a computer program, so that the virtual camera has an imaging function similar to that of the real camera. The difference lies in that the real camera images according to the light emitted into the imaging chip from the outside, and the virtual camera images according to the multimedia resource data corresponding to the virtual camera.
As shown in fig. 2, in step S102, each virtual camera points to a coordinate area in the coordinate system, and thus the virtual camera is responsible for rendering and imaging the area. And each coordinate area is at least provided with one multimedia resource, so that when different coordinate areas are rendered through different virtual cameras, a picture which cannot become the multimedia resource can be generated.
In order to enable three multimedia resources to be simultaneously seen on the display interface, the space coordinate areas corresponding to the two adjacent virtual cameras are partially overlapped, and the space coordinate areas corresponding to the virtual cameras contain more than three multimedia resources, namely the viewing frame of the virtual camera can simultaneously cover the areas where the more than three multimedia resources are located.
Therefore, when the virtual camera renders the corresponding space coordinate area, the three or more multimedia resources can be simultaneously displayed on the digital audio-visual system interface. In order to enable the display interface to display the visual effects of the current multimedia resource being clear and other multimedia resources being fuzzy, the multimedia resource may be disposed at different positions of the 3D coordinate system, so that the distances from the multimedia resource to the virtual cameras are different, and the virtual cameras are gathered to one of the multimedia resources (i.e., the current multimedia resource). The aggregated multimedia asset (i.e., the current multimedia asset) is displayed clearly, while the remaining multimedia assets in the frame are displayed in a blurred manner. Another virtual camera adjacent to the other virtual camera is gathered to another multimedia asset (i.e., the next multimedia asset to be displayed).
Therefore, when the virtual camera is switched according to the time axis, the current multimedia resource is changed from clear to fuzzy until disappearing in the motion state, the next multimedia resource to be displayed is changed from fuzzy to clear in the motion state, and then the next multimedia resource to be displayed is displayed in a fuzzy manner.
In order to make the transition of the display interface smoother when different virtual cameras are switched, an interface switching transition mechanism can be set. One of the transition mechanisms is a fade-in/fade-out transition mechanism, and the other is a view frame translation transition mechanism.
The fade-in fade-out transition mechanism is that in the display interface switching process, multimedia resources formed by rendering of the current virtual camera are gradually faded, and when the multimedia resources are faded to a certain threshold value, the current virtual camera is switched to the next virtual camera for rendering imaging. The next virtual camera displays the rendered image in a lighter (i.e., more transparent) multimedia resource, and gradually deepens the display effect of the multimedia resource with time. Therefore, the current multimedia resource gradually becomes fuzzy and faded in the switching process, and then when the next multimedia resource is switched to, the next multimedia resource is changed from fuzzy to clear and from faded to dark.
The viewfinder translation transition mechanism is as follows: the viewfinder of each virtual camera is arranged to be movable, namely the viewfinder area corresponding to the virtual camera can be moved. And in the switching process of the display interface, the viewing frame of the current virtual camera moves to the area corresponding to the next virtual camera, so that the multimedia resource generated by the current virtual camera is closer to the multimedia resource generated by the next virtual camera. And when the view frame of the current virtual camera is overlapped (or nearly overlapped) with the view frame of the next virtual camera, the current virtual camera is switched to the next virtual camera, so that the multimedia resources generated by the two virtual cameras during switching are approximately the same, and smooth switching is realized.
In step S103, the time axis is a time sequence in which two or more events are connected in series so that different events are sequentially executed. In step S103, two or more virtual cameras are associated with the time axis, so that the virtual cameras are sequentially triggered in time sequence. As shown in fig. 2, for convenience of understanding, the time axis is schematically marked below the first to third virtual cameras and points to the right from the left, which means that the first to third virtual cameras are triggered in time sequence, when the first virtual camera is triggered to operate, the first multimedia resource is rendered and displayed on the display screen, and when the second virtual camera is triggered to operate, the second multimedia resource is rendered and displayed on the display screen. In the present embodiment, the virtual cameras are operated alternately in the time axis, that is, the virtual cameras are not always in an operating state, and different virtual cameras are operated alternately in the time axis from on to off. When the next virtual camera is triggered to work, the last virtual camera is closed (for example, when the second virtual camera works in fig. 2, the virtual camera is closed as soon as the second virtual camera works), so that the switching from the multimedia resource to the second multimedia resource is realized. But this does not mean that the last virtual camera will be turned off as soon as the next virtual camera is triggered. Taking fig. 2 as an example, the first virtual camera may be turned off after the second virtual camera operates for a period of time, so that the first multimedia resource and the second multimedia resource have a period of time and can be simultaneously displayed on the display screen, thereby achieving the display effect of seamless switching. Or the virtual camera can be closed before the virtual camera II is started to work, so that the multimedia resource I and the multimedia resource II are discontinuously displayed on the display screen.
When the virtual camera renders the spatial coordinate region, the virtual camera may perform a blurring process on a surrounding region of the multimedia resource in the spatial coordinate region, so that the multimedia resource is clear, and the surrounding of the multimedia resource is blurred (i.e., the next multimedia resource to be displayed is also blurred). Therefore, when different virtual cameras are switched according to the time axis, the different virtual cameras alternately generate clear pictures of the surrounding fuzzy middle multimedia resources, so that when the switching of the different multimedia resources is visually realized, the current multimedia resources are changed from clear to fuzzy in the motion state, and the next multimedia resources to be displayed are gradually changed from fuzzy to clear in the motion state.
In this embodiment. By presetting more than two virtual cameras, each virtual camera corresponds to a space coordinate area where different multimedia resources are located, and the areas where the different multimedia resources are located are rendered sequentially through the different virtual cameras according to a time axis, the multimedia resources are sequentially switched and displayed, so that the effect of switching and displaying a plurality of multimedia resources in a display interface is realized, the effect of fuzzy switching of the multimedia resources is realized through fuzzy processing of the virtual cameras, the display switching among the different multimedia resources is smoother and more coordinated, and the multimedia resource display effect of the photo MV is greatly improved.
In step S102, the acquired multimedia resources may be transmitted by the mobile terminal, that is, in step S102, the digital audiovisual system establishes a communication connection with the mobile terminal, and then receives more than two multimedia resources transmitted by the mobile terminal. Because the existing mobile terminals such as smart phones and tablet computers have strong functions and usually store a large amount of materials of multimedia resources, users can select the materials of the multimedia resources according to the needs of the users and send the materials to the digital audio-visual system, and the digital audio-visual system makes corresponding multimedia resources MV.
As shown in fig. 1a, the interface display method of the digital audio-visual system is described by taking a KTV singing place to request songs as an example, wherein the song requesting device 10 in the singing place has functions of receiving multimedia resources and processing multimedia resources in addition to an original song requesting function, and the specific steps are as follows:
1. the song ordering device 10 in the singing place plays the ordered song and the MV of the song (wherein the MV of the song is made in advance);
2. the mobile terminal 20 establishes a connection with the singing requesting device 10 and sends the multimedia resource to the singing requesting device 10 (wherein, step 2 can be before step 1 or after step 1, that is, the mobile terminal can be connected with the singing requesting device at any time and send the multimedia resource);
3. the singing-requesting device 10 sequentially triggers different virtual cameras according to a time axis, so that the different virtual cameras alternately perform rendering imaging on different multimedia resources, the virtual cameras perform fuzzy processing on the surrounding area of the multimedia resources, the current multimedia resources are displayed clearly, the next multimedia resources are displayed in a fuzzy manner, the multimedia resources uploaded by the mobile terminal are superposed into the existing MV, the multimedia resources are sequentially switched and displayed in the MV, and the effects that the current multimedia resources are gradually converted from clear to fuzzy in the motion state and the next multimedia resources to be displayed are gradually converted from fuzzy to clear in the motion state are achieved during switching and displaying. Of course, in some cases, the song MV may not need to be prepared in advance, and the jukebox device switches the display on the display interface in real time according to the acquired multimedia resource and the background multimedia resource.
As shown in fig. 2, the coordinate area corresponding to each virtual camera is larger than the area where the multimedia resource is located, that is, the coordinate area corresponding to each virtual camera includes the corresponding multimedia resource and also has redundancy. Therefore, when the virtual camera renders the space coordinate region, redundant parts around the multimedia resources are subjected to fuzzy processing.
In the embodiment shown in fig. 2, the coordinate regions corresponding to the virtual cameras are independent from each other, that is, do not overlap with each other, so that the screen contents rendered by the virtual cameras do not intersect with each other, and the multimedia resources are displayed independently.
In another embodiment, as shown in fig. 3, the multimedia resources are adjacently disposed in the spatial coordinate system, and the coordinate regions corresponding to the adjacently disposed virtual cameras are partially overlapped, so that the virtual cameras can image the overlapped next spatial coordinate region, and the spatial coordinate region corresponding to the virtual camera includes the next adjacent multimedia resource. In fig. 3, the first virtual camera may image a first region and may image a second region overlapping the first region, and the second multimedia resource may be located in the overlapping region or partially located in the overlapping region. Similarly, virtual camera two and virtual camera three are also similar. Therefore, when the virtual camera performs rendering in step S103, two multimedia assets can be imaged simultaneously.
The spatial coordinate region division is adopted to enable different multimedia resources to show a motion blur effect when being switched and displayed, namely the current multimedia resource is gradually changed from clear to fuzzy in a motion state, and the next multimedia resource to be displayed is gradually changed from fuzzy to clear in the motion state. The method specifically comprises the following steps: when the multimedia resource is switched to be subjected to fuzzy processing, the virtual camera images a corresponding space coordinate area, and an obtained picture comprises the multimedia resource in the space coordinate area and a next multimedia resource to be displayed in an overlapping area; and carrying out fuzzy processing on the next multimedia resource to ensure that the picture obtained by the virtual camera has a clear current multimedia resource and a fuzzy next multimedia resource at the same time, so that the display effect of gradually changing from fuzzy to clear is realized when the multimedia resources are switched.
Taking fig. 3 as an example, a picture obtained by rendering by the virtual camera i includes the multimedia resource i in the area i and part of the multimedia resource i in the area i and the multimedia resource ii in the area i overlapping part, and when the time axis triggers the virtual camera ii to render, part of the picture of the multimedia resource ii in the area ii, the multimedia resource iii in the area ii, and the area ii and the area iii that are blurred in the area iii can be displayed. Therefore, when the time axis enables the first virtual camera and the second virtual camera to work alternately, the switching process of the second multimedia resource from the fuzzy state to the clear state is displayed, and the switching display effect of the third multimedia resource and the fourth multimedia resource is similar to that of the second multimedia resource.
In the above embodiment, the acquired multimedia resource may be a two-dimensional planar multimedia resource or a two-dimensional video, and in order to achieve a better display effect, the digital audiovisual system may display and switch the acquired planar multimedia resource or the video in a 3D stereoscopic effect. The digital audio-visual system can respectively superpose the more than two multimedia resources into the fuzzy background multimedia resource with the depth of field effect to form more than two 3D display objects;
and during the switching display, sequentially switching and displaying the 3D display objects according to a time axis, so that the current 3D display object is converted from clear to fuzzy in the motion state, and the next 3D display object is converted from fuzzy to clear in the motion state.
As shown in fig. 4, in order to realize the switching display of the 3D display objects, two virtual cameras need to be preset in a space coordinate region where each 3D display object is located, one of the virtual cameras is used to obtain a clear multimedia resource, and the other virtual camera is used to obtain a background multimedia resource behind the multimedia resource (where the length direction of the multimedia resource is an X axis, the width direction is a Y axis, and the rear of the multimedia resource is a Z axis). And superposing the multimedia resources acquired by the two virtual cameras and the background multimedia resources front and back to synthesize a 3D display object with a field depth fuzzy effect, thereby creating a stronger 3D visual effect. When two virtual cameras corresponding to different space coordinate areas are triggered in sequence according to a time axis, fuzzy switching display of the 3D display object can be achieved, namely the current 3D display object is switched from clear to fuzzy, and the next 3D display object is switched from fuzzy to clear.
As shown in fig. 4, there are two virtual cameras corresponding to the first to third areas, where one of the virtual cameras in each area is used to acquire clear multimedia resources in the area, and the other virtual camera can be used to acquire background multimedia resources in the corresponding area. And then, overlapping the multimedia resources acquired by the two virtual cameras and the background multimedia resources in each area, so that the clear multimedia resources are behind the front background multimedia resources, thereby forming a field depth fuzzy effect with fuzzy background.
Since the sizes of the obtained multimedia resources may be different, in an embodiment, more than two multimedia resource templates with different sizes are preset. In step S102, when the multimedia resource is obtained, the corresponding multimedia resource template may be matched according to the size of the multimedia resource, or the multimedia resource may be trimmed or scaled according to the designated multimedia resource template. The multimedia resources can be automatically cut or zoomed by presetting the multimedia resource template, and the efficiency of processing the multimedia resources can be greatly improved. For example, the multimedia resource or text can be automatically cut or scaled by calling the multimedia resource template with the matched size according to the size of the acquired multimedia resource, text and the like.
In an embodiment, in order to enrich the display content of the display interface, the display interface can add a background material in addition to the effect of fuzzy switching display of the multimedia resources, so that the multimedia resources are switched and displayed in a scene with a background. The background material may be one or more of a photo, a multimedia asset, text, animation, or video.
In step S101, the played audio data may be a song file, so that in order to facilitate singing of the song, the display interface may further display the corresponding lyrics in an overlaid manner on the display interface of the digital audiovisual system.
In the above embodiment, the steps S102 to S103 may be implemented by Unity, which is a cross-platform 2D/3D game engine developed by Unity Technologies, and may be used to develop a stand-alone game of Windows, MacOS and Linux platforms, a video game of game host platforms such as PlayStation, XBox, Wii, 3DS and nintendo Switch, or a game of mobile devices such as iOS and Android. Various functional plugins are integrated in the unit, wherein the functional plugins comprise Timeline, Cinemachine, Post processing stack and the like. The Timeline function plug-in is a Timeline plug-in, and can sequentially trigger corresponding objects according to a time sequence. The Cinemachine function plug-in is a virtual camera plug-in, and different objects can be rendered and imaged through the plug-in. The Post processing stack function plug-in can realize the fuzzy processing function of multimedia resources. In step S102, a plurality of virtual cameras in the Cinemachine function plug-in may correspond to different spatial coordinate regions where the multimedia resources are located; and in step S103, the virtual cameras are sequentially triggered by the Timeline functional plug-ins. The multimedia resource switching fuzzy processing and the depth-of-field fuzzy processing can be executed through the Post processing stack functional plug-in. Therefore, through the combined use of the Timeline, the cinema chip and the Post processing stack functional plug-in the unity, the switching display of a plurality of multimedia resources in the MV can be realized, the switching of the multimedia resources is soft and smooth, the effects of fuzzy switching and field depth blurring are achieved, and a strong 3D space feeling is created.
The multimedia resource templates can be realized through the unity, a multimedia resource assembly can be established in the unity, each multimedia resource assembly comprises multimedia resource templates with different sizes and shapes, such as a rectangle, a square or a star, the proportional sizes of the photos uploaded by the user can be automatically identified in real time through a setting program, and the appropriate multimedia resource templates can be intelligently matched, so that the manual processing of the user is not needed.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.
Claims (11)
1. The digital audio-visual system interface display method is characterized in that the digital audio-visual system acquires audio data and plays the audio data through audio output equipment, wherein the audio data is singing audio or mixed audio of the singing audio and song accompaniment audio; the interface display method comprises the following steps:
the method comprises the steps of obtaining more than two multimedia resources, and sequentially switching and displaying the multimedia resources, wherein when the multimedia resources are switched and displayed, the current multimedia resources are gradually converted from clear to fuzzy in a motion state, and the next multimedia resource to be displayed is gradually converted from fuzzy to clear in the motion state;
the method for acquiring more than two multimedia resources comprises the following steps:
acquiring more than two multimedia resources;
establishing a 3D space coordinate system, and adding the more than two multimedia resources to different positions in the 3D space coordinate system;
the method comprises the following steps that the multimedia resources are sequentially switched and displayed, when the multimedia resources are switched and displayed, the current multimedia resources are gradually switched from clear to fuzzy in a motion state, and the next multimedia resource to be displayed is gradually switched from fuzzy to clear, and comprises the following steps:
presetting more than two virtual cameras, wherein a space coordinate area where each multimedia resource is located at least corresponds to one virtual camera;
sequentially switching the virtual cameras according to a time axis to render the corresponding space coordinate areas;
when the multimedia resources are switched, the current multimedia resources gradually change from clear to fuzzy in the motion state, and the next multimedia resource to be displayed gradually changes from fuzzy to clear in the motion state.
2. The digital audio-visual system interface display method of claim 1, wherein in the switching display, the current multimedia resource gradually changes from clear to fuzzy until disappearing in the motion state, the next multimedia resource to be displayed gradually changes from fuzzy to clear display in the motion state, and the next multimedia resource to be displayed is displayed in a fuzzy manner.
3. The digital audio-visual system interface display method of claim 1, further comprising, after acquiring the multimedia resource, the steps of:
respectively superposing the more than two multimedia resources into the fuzzy background multimedia resources with the depth of field effect to form more than two 3D display objects;
and during the switching display, sequentially switching and displaying the 3D display objects, so that the current 3D display object gradually changes from clear to fuzzy in the motion state, and the next 3D display object gradually changes from fuzzy to clear in the motion state.
4. A digital audio-visual system interface display method according to claim 1, wherein the spatial coordinate regions corresponding to two said virtual cameras disposed adjacently are partially overlapped, so that the spatial coordinate region corresponding to said virtual camera contains the next adjacent multimedia resource;
and when the virtual camera is used for rendering, the next multimedia resource is subjected to fuzzy processing, so that the rendered picture of the virtual camera has a clear current multimedia resource and a fuzzy next multimedia resource at the same time, and the display effect of gradually changing from fuzzy to clear is realized when the multimedia resources are switched.
5. The digital audio-visual system interface display method of claim 1, wherein two virtual cameras are preset in a spatial coordinate area where each multimedia resource is located, wherein one virtual camera is used for acquiring clear multimedia resources, and the other virtual camera acquires fuzzy background multimedia resources behind the multimedia resources;
and superposing the pictures acquired by the two virtual cameras front and back to synthesize a 3D display object with a depth-of-field fuzzy effect.
6. A digital audio-visual system interface display method according to claim 1, wherein the spatial coordinate regions corresponding to two of the virtual cameras disposed adjacently are partially overlapped, so that the spatial coordinate region corresponding to the virtual camera contains more than three multimedia resources;
when the virtual camera renders the corresponding space coordinate area, the digital audio-visual system interface simultaneously displays more than three multimedia resources, wherein one multimedia resource is a clear current multimedia resource, and the remaining more than two multimedia resources are fuzzy multimedia resources to be displayed;
when the virtual camera is switched according to the time axis, the current multimedia resource gradually changes from clear to fuzzy until disappearing in the motion state, the next multimedia resource to be displayed gradually changes from fuzzy to clear display in the motion state, and then the next multimedia resource to be displayed is displayed in a fuzzy manner.
7. The digital audio-visual system interface display method of claim 1, wherein more than two display templates with different sizes are preset, and when the multimedia resource is obtained, the corresponding display template is matched according to the size of the multimedia resource, or the multimedia resource is cut or scaled according to a specified display template.
8. A digital audio-visual system interface display method as claimed in claim 1, further comprising displaying a background material in an overlapping manner when the multimedia assets are sequentially switched to display, wherein the background material is one or more of a photo, a multimedia asset, a text, an animation and a video.
9. A digital audio-visual system interface display method as claimed in claim 8, further comprising the steps of:
and acquiring lyrics of the audio data, and superposing the lyrics of the audio data on a display interface.
10. A digital audio-visual system interface display method as claimed in claim 1, wherein said step of obtaining more than two multimedia assets includes:
establishing communication connection with a mobile terminal;
and receiving more than two multimedia resources sent by the mobile terminal.
11. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the steps of any of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811572786.9A CN109669753B (en) | 2018-12-21 | 2018-12-21 | Digital audio-visual system interface display method and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811572786.9A CN109669753B (en) | 2018-12-21 | 2018-12-21 | Digital audio-visual system interface display method and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109669753A CN109669753A (en) | 2019-04-23 |
| CN109669753B true CN109669753B (en) | 2022-02-22 |
Family
ID=66145842
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811572786.9A Active CN109669753B (en) | 2018-12-21 | 2018-12-21 | Digital audio-visual system interface display method and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109669753B (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103400409A (en) * | 2013-08-27 | 2013-11-20 | 华中师范大学 | 3D (three-dimensional) visualization method for coverage range based on quick estimation of attitude of camera |
| CN204222732U (en) * | 2014-11-20 | 2015-03-25 | 成都易默生汽车技术有限公司 | A kind of steering light device of vehicle based on information fusion |
| CN104463954A (en) * | 2014-11-14 | 2015-03-25 | 无锡梵天信息技术股份有限公司 | Three-dimensional image surface detail simulation method and system |
| CN104704818A (en) * | 2013-06-19 | 2015-06-10 | 松下知识产权经营株式会社 | Image display device and image display method |
| CN104780356A (en) * | 2013-10-03 | 2015-07-15 | 晶晨半导体(上海)有限公司 | 2D to 3D image conversion device and method |
| CN104882151A (en) * | 2015-06-05 | 2015-09-02 | 福建星网视易信息系统有限公司 | Method, device and system for displaying multimedia resources in song singing |
| CN105407259A (en) * | 2015-11-26 | 2016-03-16 | 北京理工大学 | Virtual camera shooting method |
| CN106161956A (en) * | 2016-08-16 | 2016-11-23 | 深圳市金立通信设备有限公司 | The processing method of a kind of preview screen when shooting and terminal |
| CN106157357A (en) * | 2015-04-01 | 2016-11-23 | Tcl集团股份有限公司 | A kind of dynamic luminous efficiency realization method and system accelerated based on GPU |
| CN106231205A (en) * | 2016-08-10 | 2016-12-14 | 苏州黑盒子智能科技有限公司 | Augmented reality mobile terminal |
| CN106293375A (en) * | 2015-06-03 | 2017-01-04 | 深圳市腾讯计算机系统有限公司 | A kind of method for changing scenes, and equipment |
| CN106303288A (en) * | 2015-06-05 | 2017-01-04 | 福建凯米网络科技有限公司 | The method of video, Apparatus and system are sung in synthesis |
| CN106576160A (en) * | 2014-09-03 | 2017-04-19 | 英特尔公司 | Imaging architecture for depth camera mode with mode switching |
| CN108053495A (en) * | 2018-01-19 | 2018-05-18 | 姚惜珺 | 2D digital resources be converted into can dynamic change 3D digital resources method and system |
| CN108647313A (en) * | 2018-05-10 | 2018-10-12 | 福建星网视易信息系统有限公司 | A kind of real-time method and system for generating performance video |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10156455B2 (en) * | 2012-06-05 | 2018-12-18 | Apple Inc. | Context-aware voice guidance |
| US9052197B2 (en) * | 2012-06-05 | 2015-06-09 | Apple Inc. | Providing navigation instructions while device is in locked mode |
-
2018
- 2018-12-21 CN CN201811572786.9A patent/CN109669753B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104704818A (en) * | 2013-06-19 | 2015-06-10 | 松下知识产权经营株式会社 | Image display device and image display method |
| CN103400409A (en) * | 2013-08-27 | 2013-11-20 | 华中师范大学 | 3D (three-dimensional) visualization method for coverage range based on quick estimation of attitude of camera |
| CN104780356A (en) * | 2013-10-03 | 2015-07-15 | 晶晨半导体(上海)有限公司 | 2D to 3D image conversion device and method |
| CN106576160A (en) * | 2014-09-03 | 2017-04-19 | 英特尔公司 | Imaging architecture for depth camera mode with mode switching |
| CN104463954A (en) * | 2014-11-14 | 2015-03-25 | 无锡梵天信息技术股份有限公司 | Three-dimensional image surface detail simulation method and system |
| CN204222732U (en) * | 2014-11-20 | 2015-03-25 | 成都易默生汽车技术有限公司 | A kind of steering light device of vehicle based on information fusion |
| CN106157357A (en) * | 2015-04-01 | 2016-11-23 | Tcl集团股份有限公司 | A kind of dynamic luminous efficiency realization method and system accelerated based on GPU |
| CN106293375A (en) * | 2015-06-03 | 2017-01-04 | 深圳市腾讯计算机系统有限公司 | A kind of method for changing scenes, and equipment |
| CN104882151A (en) * | 2015-06-05 | 2015-09-02 | 福建星网视易信息系统有限公司 | Method, device and system for displaying multimedia resources in song singing |
| CN106303288A (en) * | 2015-06-05 | 2017-01-04 | 福建凯米网络科技有限公司 | The method of video, Apparatus and system are sung in synthesis |
| CN105407259A (en) * | 2015-11-26 | 2016-03-16 | 北京理工大学 | Virtual camera shooting method |
| CN106231205A (en) * | 2016-08-10 | 2016-12-14 | 苏州黑盒子智能科技有限公司 | Augmented reality mobile terminal |
| CN106161956A (en) * | 2016-08-16 | 2016-11-23 | 深圳市金立通信设备有限公司 | The processing method of a kind of preview screen when shooting and terminal |
| CN108053495A (en) * | 2018-01-19 | 2018-05-18 | 姚惜珺 | 2D digital resources be converted into can dynamic change 3D digital resources method and system |
| CN108647313A (en) * | 2018-05-10 | 2018-10-12 | 福建星网视易信息系统有限公司 | A kind of real-time method and system for generating performance video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109669753A (en) | 2019-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10313652B1 (en) | Cubic or spherical mapped content for presentation of pre-rendered images viewed from a fixed point of view in HTML, javascript and/or XML for virtual reality applications | |
| KR101686693B1 (en) | Viewer-centric user interface for stereoscopic cinema | |
| JP2015187797A (en) | Image data generation device and image data reproduction device | |
| CN109218630B (en) | Multimedia information processing method and device, terminal and storage medium | |
| US20150070467A1 (en) | Depth key compositing for video and holographic projection | |
| CN113115110B (en) | Video synthesis method and device, storage medium and electronic equipment | |
| CN113473207B (en) | Live broadcast method and device, storage medium and electronic equipment | |
| KR102274723B1 (en) | Device, method and computer program for editing time slice images | |
| WO2019193364A1 (en) | Method and apparatus for generating augmented reality images | |
| JP2005020607A (en) | Composite image output device and composite image output processing program | |
| CN109872400B (en) | Panoramic virtual reality scene generation method | |
| CN109669753B (en) | Digital audio-visual system interface display method and computer readable storage medium | |
| KR101752691B1 (en) | Apparatus and method for providing virtual 3d contents animation where view selection is possible | |
| CN116962745A (en) | Mixed drawing method, device and live broadcast system of video image | |
| CN109561338B (en) | Interface seamless switching display method and storage medium of song-ordering system | |
| US20220207848A1 (en) | Method and apparatus for generating three dimensional images | |
| Koppal et al. | A viewer-centric editor for stereoscopic cinema | |
| Morvan et al. | Handling occluders in transitions from panoramic images: A perceptual study | |
| CN115665461B (en) | Video recording method and virtual reality device | |
| CN110430454B (en) | Multi-device real-time interactive display method and device | |
| CN111344744A (en) | Method for presenting a three-dimensional object, and related computer program product, digital storage medium and computer system | |
| KR101743874B1 (en) | System and Method for Creating Video Contents Using Collaboration of Performing Objects | |
| WO2023196850A2 (en) | System and method for providing dynamic backgrounds in live-action videography | |
| WO2020149146A1 (en) | Image processing device, image processing method, and program | |
| WO2023196845A2 (en) | System and method for providing dynamic backgrounds in live-action videography |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |