CN114363598B

CN114363598B - Three-dimensional scene interactive video generation method and generation device

Info

Publication number: CN114363598B
Application number: CN202210016488.1A
Authority: CN
Inventors: 马志友; 邓辉中
Original assignee: Kandao Technology Co Ltd
Current assignee: Kandao Technology Co Ltd
Priority date: 2022-01-07
Filing date: 2022-01-07
Publication date: 2023-04-07
Anticipated expiration: 2042-01-07
Also published as: CN116233382A; CN114363598A; WO2023130544A1

Abstract

The invention provides a three-dimensional scene interactive video generation method, which comprises the following steps: acquiring a three-dimensional scene interaction template; displaying a hot spot preview interface of the fixed scene hot spot, and creating at least one active scene element in the hot spot preview interface based on a user local media library; setting parameters of the active scene elements and trigger conditions of all the scene elements; and carrying out storage operation on the fixed scene hot spots, the fixed scene elements and the movable scene elements to generate the three-dimensional scene interactive video. The invention also provides a device for generating the three-dimensional scene interactive video, and the three-dimensional scene interactive video has simple generation process and lower difficulty.

Description

Three-dimensional scene interactive video generation method and generation device

Technical Field

The invention relates to the technical field of image processing, in particular to a three-dimensional scene interactive video generation method and a three-dimensional scene interactive video generation device.

Background

With the development of science and technology, users have higher and higher requirements on video images, such as interaction with display contents in the video images, personalized setting of the video images, and the like.

However, the existing multimedia image content includes various contents such as a three-dimensional video, a two-dimensional video, a three-dimensional image, a two-dimensional image, an audio and the like, if the various multimedia image contents of different types need to be integrated to generate a corresponding three-dimensional scene interactive video, professional video processing personnel generally need to edit and process the different multimedia image contents according to the requirements of customers, and the processing process is high in professional and difficult.

Therefore, it is necessary to provide a method and a device for generating an interactive video of a three-dimensional scene to solve the problems of the prior art.

Disclosure of Invention

The embodiment of the invention provides a three-dimensional scene interactive video generation method and a three-dimensional scene interactive video generation device capable of integrating various multimedia image contents of different types, and aims to solve the technical problems of high professional and high difficulty in editing different multimedia image contents by the conventional three-dimensional scene interactive video generation method and the conventional three-dimensional scene interactive video generation device.

The embodiment of the invention provides a three-dimensional scene interactive video generation method, which comprises the following steps:

acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises a fixed scene hot spot and fixed scene elements in the fixed scene hot spot; wherein the fixed scene hotspot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element;

displaying a hot spot preview interface of the fixed scene hot spot, and creating at least one active scene element in the hot spot preview interface based on a user local media library, wherein the active scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

setting parameters of the active scene elements and trigger conditions of all scene elements; and

and performing storage operation on the fixed scene hot spot, the fixed scene element and the movable scene element to generate a three-dimensional scene interactive video.

The invention also provides a three-dimensional scene interactive video generation method, which comprises the following steps:

acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises a fixed scene hotspot, a fixed scene element and a template movable scene element in the fixed scene hotspot; wherein the fixed scene hotspot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element; the template activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

displaying a hotspot preview interface of the fixed scene hotspot, and creating at least one local activity scene element in the hotspot preview interface based on a user local media library, wherein the local activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

setting parameters of the template activity scene elements and the local activity scene elements and trigger conditions of all scene elements; and

and performing storage operation on the fixed scene hot spot, the fixed scene element, the template movable scene element and the local movable scene element to generate a three-dimensional scene interactive video.

The invention also provides a three-dimensional scene interactive video generation device, which comprises:

the template acquisition module is used for acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises a fixed scene hotspot and a fixed scene element in the fixed scene hotspot; wherein the fixed scene hotspot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element;

the activity scene element creating module is used for displaying a hot spot preview interface of the fixed scene hot spot and creating at least one activity scene element in the hot spot preview interface based on a user local media library, wherein the activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

a scene element setting module for setting the parameters of the active scene elements and the trigger conditions of all the scene elements; and

and the video generation module is used for storing the fixed scene hot spots, the fixed scene elements and the movable scene elements so as to generate the three-dimensional scene interactive video.

the template acquisition module is used for acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises a fixed scene hotspot, a fixed scene element and a template movable scene element in the fixed scene hotspot; wherein the fixed scene hotspot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element; the template activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

the activity scene element creating module is used for displaying a hot spot preview interface of the fixed scene hot spot and creating at least one local activity scene element in the hot spot preview interface based on a user local media library, wherein the local activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

the scene element setting module is used for setting parameters of the template active scene elements and the local active scene elements and triggering conditions of all the scene elements; and

and the video generation module is used for storing the fixed scene hot spot, the fixed scene element, the template movable scene element and the local movable scene element so as to generate the three-dimensional scene interactive video.

Embodiments of the present invention further provide a computer-readable storage medium, in which processor-executable instructions are stored, where the instructions are loaded by one or more processors to perform any one of the above three-dimensional scene interactive video generation methods.

Compared with the prior art, the three-dimensional scene interactive video generation method and the three-dimensional scene interactive video generation device provided by the invention have the advantages that the scene hotspots and scene elements are created by using the three-dimensional scene interactive template, so that a user can conveniently integrate different types of multimedia image contents in a hotspot preview interface, the three-dimensional scene interactive video generation process is simple and has low difficulty, and the technical problems of high professional and high difficulty in editing different multimedia image contents by using the conventional three-dimensional scene interactive video generation method and the conventional three-dimensional scene interactive video generation device are effectively solved.

Drawings

FIG. 1 is a flowchart of an embodiment of a three-dimensional scene interactive video generation method according to the present invention;

fig. 2 is a flowchart of a three-dimensional scene interactive template generation method according to a first embodiment of the three-dimensional scene interactive video generation method of the present invention;

FIG. 3 is a flowchart illustrating a method for generating an interactive video of a three-dimensional scene according to a second embodiment of the present invention;

fig. 4 is a flowchart illustrating a process of generating a three-dimensional scene interaction template in a second embodiment of a method for generating a three-dimensional scene interaction video according to the present invention;

fig. 5 is a schematic structural diagram of a three-dimensional scene interactive video generating device according to a first embodiment of the present invention;

fig. 6 is a schematic structural diagram of a three-dimensional scene interactive video generating device according to a second embodiment of the present invention;

FIG. 7 is a flowchart illustrating the template creation process of the three-dimensional scene interaction template according to the present invention;

FIGS. 8a-8i are schematic diagrams of a template creation flow.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The three-dimensional scene interactive video generation method and device of the present invention are used for electronic devices for performing integrated editing on different types of multimedia image contents, including but not limited to wearable devices, head-mounted devices, medical health platforms, personal computers, server computers, hand-held or laptop devices, mobile devices (such as mobile phones, personal Digital Assistants (PDAs), media players, etc.), multiprocessor systems, consumer electronic devices, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like. The electronic equipment is preferably content editing electronic equipment for integrating and editing multimedia image contents, so that different types of multimedia image contents can be integrated and edited to generate a corresponding three-dimensional scene interactive video.

Referring to fig. 1, fig. 1 is a flowchart illustrating a three-dimensional scene interactive video generating method according to a first embodiment of the present invention. The method for generating the three-dimensional scene interactive video according to the embodiment can be implemented by using the content editing electronic device. The three-dimensional scene interactive video generation method of the embodiment comprises the following steps:

step S101, a three-dimensional scene interaction module is obtained, wherein the three-dimensional scene interaction module comprises a fixed scene hotspot and a fixed scene element in the fixed scene hotspot; wherein the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element;

step S102, showing a hot spot preview interface of a fixed scene hot spot, and creating at least one active scene element in the hot spot preview interface based on a user local media library, wherein the active scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element;

step S103, setting parameters of the active scene elements and trigger conditions of all the scene elements;

and step S104, storing the fixed scene hotspots, the fixed scene elements and the movable scene elements to generate the three-dimensional scene interactive video.

The interactive video generation process of the three-dimensional scene interactive video generation method according to the embodiment is described in detail below.

In step S101, the content editing electronic device acquires a three-dimensional scene interaction template; the three-dimensional scene interaction template comprises a fixed scene hotspot and fixed scene elements, wherein the fixed scene hotspot comprises a three-dimensional picture and/or a three-dimensional video, and the fixed scene elements comprise a two-dimensional picture element, a two-dimensional video element or a text element.

The three-dimensional scene interactive template is a preset video scene template with a plurality of fixed scene hotspots and a plurality of fixed scene elements, such as a winter snowscape template, a Christmas template, a new year template and the like, so that a user can form an individualized three-dimensional scene interactive video only by adding the individualized moving scene element on the corresponding three-dimensional scene interactive template, and the difficulty of the user in manufacturing the individualized three-dimensional scene interactive video is effectively reduced.

In step S102, the content editing electronic device displays a hot spot preview interface of the fixed scene hot spot. The hot spot preview interface is a scene interface for setting corresponding active scene elements on the corresponding fixed scene hot spots. The user can set the two-dimensional picture, the two-dimensional video and/or the character elements in the local media library of the user into the hot spot preview interface so as to create at least one active scene element in the hot spot preview interface and further edit the active scene element subsequently.

In step S103, the content editing electronic device sets parameters of the active scene elements and trigger conditions of all scene elements.

Specifically, if the active scene element is a two-dimensional picture element, the content editing electronic device sets a size parameter, a position parameter, a picture transparency, and an element lifetime parameter of the two-dimensional picture element. The dimension parameter of the two-dimensional picture element refers to the dimension parameter of the two-dimensional picture; the position parameter of the two-dimensional picture element refers to position information of the two-dimensional picture in a hot spot preview interface; the picture transparency of the two-dimensional picture element refers to transparency information of the two-dimensional picture in a hot spot preview interface; the element life parameter of the two-dimensional picture element refers to the embedding life of the two-dimensional picture in the hot spot preview interface, for example, the embedding in-point time and the embedding out-point time of the two-dimensional picture in the three-dimensional video are set.

And if the active scene element is a character element, the content editing electronic equipment sets a size parameter, a position parameter, a character transparency parameter and an element life parameter of the character element. The dimension parameter of the character element refers to the dimension parameter of the character element; the size parameter of the character element refers to the position information of the character element in the hot spot preview interface; the text transparency of the text elements refers to transparency information of the text elements in the hot spot preview interface; the element life parameter of the text element refers to the embedding life of the text element in the hot spot preview interface, for example, the embedding in-point time and the embedding out-point time of the text element in the three-dimensional video are set.

And if the activity scene element is a two-dimensional video element, the content editing electronic equipment sets a size parameter, a position parameter, a picture transparency, a video progress parameter and an element life parameter of the two-dimensional video element. The size parameter of the two-dimensional video element refers to the size parameter of the picture size of the two-dimensional video; the position parameter of the two-dimensional video element refers to the position information of the two-dimensional video in the hot spot preview interface; the picture transparency of the two-dimensional video element refers to transparency information of the two-dimensional video in a hot spot preview interface; the video progress parameter of the two-dimensional video element refers to a playing parameter of the two-dimensional video in the hot spot preview interface, such as whether to play circularly, setting playing content, setting a playing controller and the like. The element life parameter of the two-dimensional video element refers to the embedding life of the two-dimensional video in the hot spot preview interface, for example, the embedding in-point time and the embedding out-point time of the two-dimensional video in the three-dimensional video are set.

The trigger condition of the scene element refers to a condition for triggering a two-dimensional picture element, a two-dimensional video element or a text element in a hot spot preview interface. The trigger here may be a display operation on the two-dimensional picture element or the text element, and a play operation on the two-dimensional video element.

In order to further save resources of the video playing client, the content editing electronic device may set the position parameter of the scene element to be within the display range of the scene hotspot, and start the scene element of the display range content, that is, display the corresponding two-dimensional picture element or text element, or play the corresponding two-dimensional video element. If the position parameter of the scene element is not located within the display range of the scene hotspot, the user cannot observe the scene element outside the display range of the scene hotspot, so that the scene element outside the display range is closed, and the resources of the video playing client are saved.

Of course, the corresponding scene element may be turned on or off based on the click operation of the user on the scene element, that is, the user performs manual on or off control on the scene element.

In order to improve the relevance of different scene elements under the same hotspot preview interface, the content editing electronic device may set an opening relevance relationship and a closing relevance relationship of different scene elements under the same hotspot preview interface, and when a scene element is opened, the opening relevance relationship is opened together with other scene elements having an opening relevance relationship with the scene element of state switching. For example, a two-dimensional picture element of a tv open button may be set to establish an open association relationship between a two-dimensional video element of a next tv on the hot spot preview interface and the two-dimensional video element of the next tv on the hot spot preview interface. Or when the two-dimensional picture element of the radio is triggered, the sound element of the set broadcasting station is simultaneously triggered, thereby causing the display effect of opening the radio for the user.

Similarly, when a scene element is closed, other scene elements having a close association relationship with the scene element whose state is switched are closed together. For example, a two-dimensional picture element with a tv closing button may be set to establish a closing association relationship between a two-dimensional video of a next tv on the hot spot preview interface and the two-dimensional picture element, and when the tv closing button is triggered, the two-dimensional video element of the tv is closed at the same time.

The closing of the scene elements can also be associated with the opening of other scene elements, and the opening of the scene elements can also be associated with the closing of other scene elements, so that a user can realize the associated triggering or closing of a plurality of scene elements by clicking one scene element, the user can conveniently set the linkage of the scene elements under the same hot spot preview interface, and the viewing experience of the interactive video of the user is improved.

Since the editing method of the fixed scene elements is similar to that of the movable scene elements, and the scene frames of the whole three-dimensional scene interaction template are not affected irreversibly, the trigger conditions for setting the fixed scene elements and the movable scene elements by the user are set, but the parameters of the fixed scene elements cannot be changed.

In step S104, the content editing electronic device performs a storage operation on the fixed scene hotspot obtained in step S101, the fixed scene element obtained in step S103, and the moving scene element to generate a three-dimensional scene interactive video. The user can view all scene hotspots and scene elements in the scene hotspots by interacting with the three-dimensional scene interactive video.

Thus, the process of creating the three-dimensional scene interactive video of the three-dimensional scene interactive video generation method of the embodiment is completed.

Referring to fig. 2 in detail, fig. 2 is a flowchart illustrating a process of generating a three-dimensional scene interactive template in a first embodiment of a three-dimensional scene interactive video generating method according to the present invention. The generation process of the three-dimensional scene interactive template comprises the following steps:

step S201, acquiring a preset media library, wherein the preset media library comprises a three-dimensional picture, a two-dimensional picture, a three-dimensional video and a two-dimensional video;

step S202, displaying a scene preview interface, and creating at least one scene hotspot in the scene preview interface based on a first operation of a user, wherein the scene hotspot is a three-dimensional picture and/or a three-dimensional video;

step S203, setting parameters of scene hotspots based on second operation of the user;

step S204, showing a hot spot preview interface of the scene hot spot, and creating at least one scene element in the hot spot preview interface based on a third operation of a user, wherein the scene element is a two-dimensional picture element, a two-dimensional video element or a character element;

step S205, setting parameters of scene elements and trigger conditions of the scene elements based on the fourth operation of the user;

step S206, setting the scene hotspot as a fixed scene hotspot, and setting the scene element as a fixed scene element;

and step S207, generating a three-dimensional scene interactive template according to the fixed scene hot spot and the fixed scene element in the fixed scene hot spot.

The following describes in detail the generation flow of the three-dimensional scene interaction template according to this embodiment.

In step S201, the content editing electronic device obtains a preset media library, where the preset media library is used to store multimedia image content such as three-dimensional pictures, two-dimensional pictures, three-dimensional videos, and two-dimensional videos.

The three-dimensional picture is a panoramic picture of a content image of 360 degrees around a user observation point serving as a central point; the three-dimensional video is a panoramic video of a content image of 360 degrees around a user observation point as a central point; the two-dimensional picture is a planar picture of a content image in a certain area range; the three-dimensional video is a flat video of a content image in a certain area.

Because the content images displayed by the three-dimensional pictures and the three-dimensional videos are generally larger than the actual observation range of the user, the three-dimensional pictures and the three-dimensional videos can be set as scene hot spots so as to create virtual scenes around the user. Meanwhile, the content images displayed by the two-dimensional picture and the two-dimensional video are generally smaller than the actual observation range of the user, so that the two-dimensional picture and the two-dimensional video can be set as scene elements in scene hot spots so as to create partial virtual elements in a virtual scene around the user. Subsequently, the process goes to step S202.

In step S202, the content editing electronic device displays a scene preview interface, where the scene preview interface is an interface for setting a scene hotspot, and a user can set a three-dimensional picture and a three-dimensional video in a preset media library in a field Jing Yulan interface so as to edit the scene hotspot.

Specifically, the three-dimensional picture and the three-dimensional video can be displayed in a preset media library in a content preview image mode, so that a user can add scene hot spots such as the three-dimensional picture and the three-dimensional video to a scene preview interface in a content preview image dragging mode.

In addition, as a plurality of scene hotspots are created in the scene preview interface based on the first operation of the user (dragging the content preview image and the like), the content editing electronic device can also create a connection relationship between the plurality of scene hotspots based on the first operation of the user (creating a connection line between different scene hotspots) so as to realize switching between different scene hotspots. The connection relation of the scene hotspot is used for setting an adjacent hotspot link corresponding to the connection relation in a corresponding hotspot preview interface. Subsequently, the process goes to step S203.

In step S203, the content editing electronic device sets parameters of the scene hotspot based on a second operation of the user.

Specifically, if the scene hotspot is a three-dimensional picture, the content editing electronic device sets an initial angle parameter and an initial range parameter of the three-dimensional picture based on a second operation of the user. The initial angle parameter refers to an initial angle of the three-dimensional picture which can be observed by a user when the three-dimensional picture enters a scene hot spot corresponding to the three-dimensional picture. The initial range parameter refers to an angle range of the three-dimensional picture which can be observed by a user when the three-dimensional picture enters a scene hotspot corresponding to the three-dimensional picture. The second operation here may be an operation in which the user directly inputs the parameters of the scene hotspot or adjusts the parameters of the scene hotspot on the basis of preset parameters.

For example, the three-dimensional picture is a three-dimensional picture of an internal structure of a bedroom, the initial angle parameter of the three-dimensional picture may be an angle of the user facing away from a doorway of the bedroom, and the initial range parameter of the three-dimensional picture may be picture content of the three-dimensional picture, which is approximately 120 degrees of the three-dimensional picture and can be observed by the user at the doorway of the bedroom, so that a scene of the user entering the bedroom in the interactive video can be well reconstructed.

And then the content editing electronic equipment generates a hot spot preview interface of the three-dimensional picture based on the set initial angle parameter and initial range parameter of the three-dimensional picture. If the scene hot spot has an adjacent scene hot spot, an adjacent hot spot link of the adjacent scene hot spot can be set on a hot spot preview interface of the three-dimensional picture.

If the scene hotspot is a three-dimensional video, the content editing electronic device sets an initial angle parameter, an initial range parameter and a video progress parameter of the three-dimensional video based on a second operation of the user. The initial supervision parameter refers to an initial angle of the three-dimensional video which can be observed by a user when the user enters a scene hotspot corresponding to the three-dimensional video. The initial range parameter refers to an angle range of the three-dimensional video which can be observed by a user when the three-dimensional video enters a scene hotspot corresponding to the three-dimensional video. The video progress parameter refers to the playing progress of the three-dimensional video when a scene hotspot corresponding to the three-dimensional video is entered.

And then the content editing electronic equipment can generate a hot spot preview interface of the three-dimensional video based on the set initial angle parameter, initial range parameter and video progress parameter of the three-dimensional video. If the scene hotspot has an adjacent scene hotspot, an adjacent hotspot link of the adjacent scene hotspot can be set on a hotspot preview interface of the three-dimensional video.

Here, a scene hotspot may have multiple adjacent scene hotspots, each of which has a corresponding adjacent hotspot link, where some adjacent hotspot links are set at fixed positions of a three-dimensional video or a three-dimensional picture, and some adjacent hotspot links may be set on a certain moving object (for example, a character of a certain activity on the three-dimensional video) on the three-dimensional video, so that the content editing electronic device may set the adjacent hotspot links of the scene hotspot actively on the three-dimensional video based on a video progress parameter of the three-dimensional video, that is, based on a difference in the video progress parameter of the three-dimensional video, positions of the adjacent hotspot links in the three-dimensional video are also different. Subsequently, the process goes to step S204.

In step S204, the content editing electronic device displays a hot spot preview interface of the scene hot spot. The hot spot preview interface is a scene interface for setting corresponding scene elements on corresponding scene hot spots. The user can set the two-dimensional picture, the two-dimensional video and/or the text element in the preset media library into the hot spot preview interface through a third operation, so that at least one scene element is created in the hot spot preview interface, and the scene element is edited subsequently. The third operation may be a drag operation or a selection operation of the user on the content preview image of the scene element.

Specifically, since the three-dimensional video of the scene hot spot has active content, the scene hot spot may conflict with the presentation of the scene element content.

For example, a display interface of a general scene element should cover a display interface of a scene hotspot to achieve effective display of the scene element in the scene hotspot, for example, a two-dimensional video of a television content is set in the scene hotspot as the scene element, and the two-dimensional video of the television content should be located in the display interface at the highest layer. However, if the presentation interface of the scene element always covers the presentation interface of the scene hotspot, if the scene hotspot also has a moving object (e.g., a moving person), there may be a conflict effect that the moving object in the scene hotspot should pass through the front of the television, but the picture is a collision effect that the television content blocks the moving object.

To avoid the three-dimensional video in the scene hot spot from conflicting with the content in the scene element. Here, the content editing electronic device may acquire a static area in the three-dimensional video, where the static area refers to an area where the picture content does not change during the playing process of the three-dimensional video. In this way, in the hot spot preview interface for displaying the scene hot spot, a static scene element (a scene element arranged in the static area) can be created in the static area of the hot spot preview interface, and since the content of the three-dimensional video in the static area is unchanged, a display conflict that the static scene element shields the active content of the scene hot spot is not generated, and the display interface for setting the scene element covers the display interface for the scene hot spot. Subsequently, the process goes to step S205.

In step S205, the content editing electronic device sets parameters of the scene element and trigger conditions of the scene element based on a fourth operation by the user.

Specifically, if the scene element is a two-dimensional picture element, the content editing electronic device sets a size parameter, a position parameter, a picture transparency, and an element lifetime parameter of the two-dimensional picture element based on the fourth operation. The dimension parameter of the two-dimensional picture element refers to the dimension parameter of the two-dimensional picture; the position parameter of the two-dimensional picture element refers to position information of the two-dimensional picture in a hot spot preview interface; the picture transparency of the two-dimensional picture element refers to transparency information of the two-dimensional picture in a hot spot preview interface; the element life parameter of the two-dimensional picture element refers to the embedding life of the two-dimensional picture in the hot spot preview interface, for example, the embedding in-point time and the embedding out-point time of the two-dimensional picture in the three-dimensional video are set. The fourth operation here may be an operation in which the user directly inputs the parameters of the two-dimensional picture element or adjusts the parameters of the two-dimensional picture element on the basis of preset parameters.

And if the scene element is a character element, the content editing electronic equipment sets the size parameter, the position parameter, the character transparency and the element life parameter of the character element based on the fourth operation. The dimension parameter of the character element refers to the dimension parameter of the character element; the size parameter of the character element refers to the position information of the character element in the hot spot preview interface; the text transparency of the text elements refers to transparency information of the text elements in the hot spot preview interface; the element life parameter of the text element refers to the embedding life of the text element in the hot spot preview interface, such as the time of an embedding point and the time of an embedding point of the text element in the three-dimensional video, and the like. The fourth operation here may be an operation in which the user directly inputs the parameters of the text elements or adjusts the parameters of the text elements on the basis of preset parameters.

If the scene element is a two-dimensional video element, the content editing electronic device sets a size parameter, a position parameter, a screen transparency, a video progress parameter, and an element lifetime parameter of the two-dimensional video element based on a fourth operation. The size parameter of the two-dimensional video element refers to the size parameter of the picture size of the two-dimensional video; the position parameter of the two-dimensional video element refers to the position information of the two-dimensional video in the hot spot preview interface; the picture transparency of the two-dimensional video element refers to transparency information of the two-dimensional video in a hot spot preview interface; the video progress parameter of the two-dimensional video element refers to a playing parameter of the two-dimensional video in the hot spot preview interface, such as whether to play circularly, setting playing content, setting a playing controller and the like. The element life parameter of the two-dimensional video element refers to the embedding life of the two-dimensional video in the hot spot preview interface, for example, the embedding in-point time and the embedding out-point time of the two-dimensional video in the three-dimensional video are set. The fourth operation herein may be an operation in which the user directly inputs the parameters of the two-dimensional video element or adjusts the parameters of the two-dimensional video element on the basis of preset parameters.

In order to improve the relevance of different scene elements under the same hotspot preview interface, the content editing electronic device may set an opening relevance relationship and a closing relevance relationship of different scene elements under the same hotspot preview interface, and when one scene element is opened, the other scene elements having the opening relevance relationship with the scene element with the state switching are opened together. For example, a two-dimensional picture element of a tv open button may be set to establish an open association relationship between a two-dimensional video element of a next tv on the hot spot preview interface and the two-dimensional video element of the next tv on the hot spot preview interface. Or when the two-dimensional picture element of the radio is triggered, the sound element of the set broadcasting station is simultaneously triggered, thereby causing the display effect of opening the radio for the user.

Similarly, when a scene element is closed, other scene elements having a closing association relationship with the scene element whose state is switched are closed together. For example, a two-dimensional picture element with a tv closing button may be set to establish a closing association relationship between a two-dimensional video of a next tv on the hot spot preview interface and the two-dimensional picture element, and when the tv closing button is triggered, the two-dimensional video element of the tv is closed at the same time.

The closing of the scene elements can also be associated with the opening of other scene elements, and the opening of the scene elements can also be associated with the closing of other scene elements, so that a user can realize the associated triggering or closing of a plurality of scene elements by clicking one scene element, the user can conveniently set the linkage of the scene elements under the same hot spot preview interface, and the viewing experience of the interactive video of the user is improved. Subsequently, the process goes to step S206.

In step S206, the content editing electronic device sets the scene hotspot set in step S202 as a fixed scene hotspot, and sets the scene element set in step S204 as a fixed scene element; the fixed scene hotspot is a scene hotspot where the three-dimensional scene interaction template cannot be subjected to parameter change, and the fixed scene element is a scene element where the three-dimensional scene interaction template cannot be subjected to parameter change, so that a user can conveniently add an active scene element on the three-dimensional scene interaction template. Subsequently, it goes to step S207.

In step S207, the content editing electronic device generates a three-dimensional scene interaction template according to the fixed scene hotspot and the fixed scene element in the fixed scene hotspot, so that a subsequent user can call the three-dimensional scene interaction template.

The three-dimensional scene interactive video generation method of the embodiment uses the three-dimensional scene interactive template to create scene hotspots and scene elements, so that a user can conveniently integrate different types of multimedia image contents in a hotspot preview interface, and the three-dimensional scene interactive video generation process is simple and has low difficulty.

Referring to fig. 3, fig. 3 is a flowchart illustrating a three-dimensional scene interactive video generating method according to a second embodiment of the invention. The three-dimensional scene interactive video generation method of the embodiment can be implemented by using the content editing electronic device. The three-dimensional scene interactive video generation method of the embodiment comprises the following steps:

step S301, acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises a fixed scene hotspot, a fixed scene element and a template movable scene element in the fixed scene hotspot; the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element; the template activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element;

step S302, showing a hot spot preview interface of a fixed scene hot spot, and creating at least one local activity scene element in the hot spot preview interface based on a user local media library, wherein the local activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

step S303, setting parameters of template activity scene elements and local activity scene elements and trigger conditions of all scene elements;

and step S304, storing the fixed scene hotspots, the fixed scene elements, the template movable scene elements and the local movable scene elements to generate the three-dimensional scene interactive video.

On the basis of the first embodiment of the three-dimensional scene interactive video generation method, a template active scene element is further set in a fixed scene hotspot of a three-dimensional scene interactive template of the three-dimensional scene interactive video generation method of this embodiment, where the template active scene element refers to an active scene element that a user can edit the template individually.

In step S302, the content editing electronic device displays a hot spot preview interface of the fixed scene hot spot. The hot spot preview interface is a scene interface for setting corresponding active scene elements on the corresponding fixed scene hot spots. The user can set the two-dimensional picture, the two-dimensional video and/or the text element in the local media library of the user into the hotspot preview interface so as to create at least one local activity scene element in the hotspot preview interface and further edit the local activity scene element subsequently.

In step S303, the content editing electronic device sets parameters of the template active scene element and the local active scene element and trigger conditions of all scene elements.

The specific setting process of the template active scene element and the local active scene element is the same as or similar to the setting process of the active scene element in step S103, and please refer to the setting process of the active scene element in step S103.

In step S304, the content editing electronic device performs a storage operation on the acquired fixed scene hotspot, the fixed scene element, the template active scene element, and the local active scene element to generate a three-dimensional scene interactive video. The user can view all scene hotspots, template activity scene elements in the scene hotspots and local activity scene elements through interacting with the three-dimensional scene interactive video.

Referring to fig. 4, fig. 4 is a flowchart illustrating a process of generating a three-dimensional scene interactive template in a second embodiment of a method for generating a three-dimensional scene interactive video according to the present invention. The generation process of the three-dimensional scene interaction template comprises the following steps:

step S401, acquiring a preset media library, wherein the preset media library comprises a three-dimensional picture, a two-dimensional picture, a three-dimensional video and a two-dimensional video;

step S402, displaying a scene preview interface, and creating at least one scene hotspot in the scene preview interface based on a first operation of a user, wherein the scene hotspot is a three-dimensional picture and/or a three-dimensional video;

step S403, setting parameters of the scene hotspots based on the second operation of the user;

step S404, showing a hot spot preview interface of a scene hot spot, and creating at least one scene element in the hot spot preview interface based on a third operation of a user, wherein the scene element is a two-dimensional picture element, a two-dimensional video element or a text element;

step S405, setting parameters of scene elements and trigger conditions of the scene elements based on fourth operation of a user;

step S406, setting the scene hotspot as a fixed scene hotspot, and setting a fixed scene element and a template movable scene element in the scene element;

step S407, generating a three-dimensional scene interaction template according to the fixed scene hotspots, the fixed scene elements in the fixed scene hotspots and the template moving scene elements.

On the basis of the first embodiment, when the three-dimensional scene interaction template of the three-dimensional scene interaction video generation method of the embodiment is generated, a fixed scene element and a template movable scene element are arranged in the fixed scene element, wherein the fixed scene hotspot is a scene hotspot where the three-dimensional scene interaction template cannot be subjected to parameter change, the fixed scene element is a scene element where the three-dimensional scene interaction template cannot be subjected to parameter change, and the template movable scene element is a scene element where the three-dimensional scene interaction template can be subjected to parameter change, so that a subsequent user can edit the template movable scene element based on the personalized needs of the user to generate the three-dimensional scene interaction video desired by the user.

On the basis of the first embodiment, the three-dimensional scene interaction template of the embodiment is simultaneously provided with the fixed scene elements and the template moving scene elements, and a user can edit the template moving scene elements in the three-dimensional scene interaction template, so that the editing capacity of the user on the three-dimensional scene interaction video is further improved.

Referring to fig. 5, fig. 5 is a schematic structural diagram of a three-dimensional scene interactive video generating device according to a first embodiment of the present invention. The three-dimensional scene interactive video generating device of the present embodiment can be implemented by using the three-dimensional scene interactive video generating method, and the three-dimensional scene interactive video generating device 50 includes a template obtaining module 51, an active scene element creating module 52, a scene element setting module 53, and a video generating module 54.

The template obtaining module 51 is configured to obtain a three-dimensional scene interaction template, where the three-dimensional scene interaction template includes a fixed scene hotspot and a fixed scene element in the fixed scene hotspot; wherein the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element; the active scene element creating module 52 is configured to display a hot spot preview interface of a fixed scene hot spot, and create at least one active scene element in the hot spot preview interface based on a user local media library, where the active scene element includes a two-dimensional picture element, a two-dimensional video element, or a text element; the scene element setting module 53 is used for setting parameters of the active scene elements and trigger conditions of all the scene elements; the video generating module 54 is configured to perform a storage operation on the fixed scene hotspot, the fixed scene element, and the moving scene element to generate a three-dimensional scene interactive video.

When the three-dimensional scene interactive video generating device 50 of the present embodiment is used, firstly, the template obtaining module 51 obtains a three-dimensional scene interactive template; the three-dimensional scene interaction template comprises a fixed scene hotspot and fixed scene elements, wherein the fixed scene hotspot comprises a three-dimensional picture and/or a three-dimensional video, and the fixed scene elements comprise two-dimensional picture elements, two-dimensional video elements or character elements.

The active scene element creation module 52 then exposes a hotspot preview interface for the fixed scene hotspot. The hot spot preview interface is a scene interface for setting corresponding active scene elements on the corresponding fixed scene hot spots. The user can set the two-dimensional picture, the two-dimensional video and/or the character elements in the local media library of the user into the hot spot preview interface so as to create at least one active scene element in the hot spot preview interface and further edit the active scene element subsequently.

The scene element setting module 53 then sets the parameters of the active scene elements and the trigger conditions of all scene elements.

Finally, the video generation module 54 performs storage operation on the acquired fixed scene hotspots, the acquired fixed scene elements, and the acquired moving scene elements to generate a three-dimensional scene interactive video. The user can view all scene hotspots and scene elements in the scene hotspots by interacting with the three-dimensional scene interactive video.

In this way, the process of generating the three-dimensional scene interactive video by the three-dimensional scene interactive video generating device 50 of the present embodiment is completed.

The generation process of the three-dimensional scene interactive video in this embodiment is the same as or similar to the generation process of the three-dimensional scene interactive video in the first embodiment of the three-dimensional scene interactive video generation method, and specific reference is made to the related description in the first embodiment of the three-dimensional scene interactive video generation method.

Referring to fig. 6, fig. 6 is a schematic structural diagram of a three-dimensional scene interactive video generating device according to a second embodiment of the present invention. The three-dimensional scene interactive video generating device of the present embodiment can be implemented by using the three-dimensional scene interactive video generating method, and the three-dimensional scene interactive video generating device 60 includes a template obtaining module 61, an active scene element creating module 62, a scene element setting module 63, and a video generating module 64.

The template obtaining module 61 is configured to obtain a three-dimensional scene interaction template, where the three-dimensional scene interaction template includes a fixed scene hotspot, a fixed scene element in the fixed scene hotspot, and a template moving scene element; wherein the fixed scene hotspot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element; the template activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element; the active scene element creating module 62 is configured to display a hot spot preview interface of a fixed scene hot spot, and create at least one local active scene element in the hot spot preview interface based on a user local media library, where the local active scene element includes a two-dimensional picture element, a two-dimensional video element, or a text element; the scene element setting module 63 is configured to set parameters of the template active scene element and the local active scene element, and trigger conditions of all scene elements; the video generation module 64 is configured to perform a storage operation on the fixed scene hotspots, the fixed scene elements, the template active scene elements, and the local active scene elements to generate a three-dimensional scene interactive video.

On the basis of the first embodiment, when the three-dimensional scene interactive template of the three-dimensional scene interactive video generating device 60 of the present embodiment is generated, a fixed scene element and a template active scene element are set in the fixed scene element, where the fixed scene hotspot is a scene hotspot where the three-dimensional scene interactive template cannot perform parameter change, the fixed scene element is a scene element where the three-dimensional scene interactive template cannot perform parameter change, and the template active scene element is a scene element in the three-dimensional scene interactive template that can perform parameter change, so that a user can edit the template active scene element based on his own personalized needs to generate a three-dimensional scene interactive video that he wants.

The generation process of the three-dimensional scene interactive video in this embodiment is the same as or similar to the generation process of the three-dimensional scene interactive video in the second embodiment of the three-dimensional scene interactive video generation method, and specific reference is made to the related description in the first embodiment of the three-dimensional scene interactive video generation method.

The following describes a process of creating a three-dimensional scene interaction template according to an embodiment of the present invention. Referring to fig. 7 and fig. 8a to 8i, fig. 7 is a flowchart of template creation of the three-dimensional scene interaction template according to the present invention. FIGS. 8a-8i are schematic diagrams of a template creation flow.

The process of creating the three-dimensional scene interaction template by the content editing electronic equipment comprises the following steps:

in step S701, the content editing electronic device creates a preset media library, that is, stores the prepared three-dimensional picture, two-dimensional picture, three-dimensional video, and two-dimensional video into the preset media library, as shown in 81 of fig. 8 a.

In step S702, the content editing electronic device displays a scene preview interface, such as the scene preview interface 82 in fig. 8b, and a user can create a plurality of scene hotspots and a connection relationship between the plurality of scene hotspots by dragging the content preview image of the scene hotspot in the preset media library 83 to the scene preview interface 82 (simultaneously creating an adjacent hotspot link in the scene hotspot). For example, the hot spot preview interface 84 in fig. 8b is provided with an adjacent hot spot link 85 of an adjacent scene hot spot.

Step S703, the content editing electronic device sets parameters of the scene hotspots. As shown in fig. 8c, the scene hotspot is a three-dimensional video, so the video progress parameter of the three-dimensional video can be set by the progress controller 86, the initial range parameter of the three-dimensional video is set by the field angle adjustment of the scene perspective setting 87, and the initial angle parameter of the three-dimensional video is set by the horizontal adjustment of the scene perspective setting 87, that is, the positions of the first horizontal axis (the left-right direction axis based on the existing user viewpoint), the second horizontal axis (the front-back direction axis based on the existing user viewpoint), and the vertical axis (the up-down direction axis based on the existing user viewpoint) of the user viewpoint are changed. Meanwhile, the position of the adjacent hotspot link 85 in the hotspot preview interface 84 can be adjusted, and if the adjacent hotspot link 85 is arranged on a movable object of a scene hotspot corresponding to a hotspot preview interface, the position of the adjacent hotspot link 85 in the hotspot preview interface can be adjusted based on the video progress parameter of the scene hotspot.

Step S704, the content editing electronic device displays a hot spot preview interface of the scene hot spot. As shown in the hotspot preview interface 84 in fig. 8d, a user can embed a two-dimensional picture, a three-dimensional picture, a two-dimensional video, a three-dimensional video, a text element, and an audio element in the hotspot preview interface through the embedded material interface 88, thereby creating a plurality of scene elements in the hotspot preview interface.

In step S705, the content editing electronic device sets parameters of the scene element and trigger conditions of the scene element based on a fourth operation by the user.

As shown in fig. 8e, the user can set the size parameter, position parameter, display angle parameter, character transparency, and element life parameter of the character element through the character material embedding interface 89.

The parameter settings of the scene elements of the two-dimensional picture and the three-dimensional picture are as shown in fig. 8f, and the user can set the size parameter, the position parameter, the display angle parameter, the character transparency and the element life parameter of the two-dimensional picture and the three-dimensional picture through the picture material embedding interface 8 a.

The parameter setting of the scene elements of the two-dimensional video and the three-dimensional video is shown in fig. 8g, and the user can set the size parameter, the position parameter, the picture transparency, the video progress parameter and the element life parameter of the two-dimensional video and the three-dimensional video through the video material embedding interface 8 b.

Parameter setting of audio element as shown in fig. 8h, the user can set the position parameter, volume parameter, and element life parameter of the audio element through the audio material embedding interface 8 c.

Further, the content editing electronic device may further set an opening association relationship and a closing association relationship of different scene elements, specifically, as shown in an interface 8d of an audio material embedding interface 8c in fig. 8h, a user may set an association relationship between the audio material and other scene elements, and similarly, a user may set an association relationship between all scene elements of different types.

Step S706, the content editing electronic device stores the edited scene hotspot and the scene element in the scene hotspot, and generates a three-dimensional scene interaction template, as shown in fig. 8 i.

The three-dimensional scene interactive video generation method and the generation device provided by the invention use the three-dimensional scene interactive template to create scene hotspots and scene elements, so that a user can conveniently integrate different types of multimedia image contents in a hotspot preview interface, the generation process of the three-dimensional scene interactive video is simple and has low difficulty, and the technical problems of strong specialty and high difficulty in editing different multimedia image contents by the conventional three-dimensional scene interactive video generation method and the conventional three-dimensional scene interactive video generation device are effectively solved.

In summary, although the present invention has been disclosed in the foregoing embodiments, the serial numbers before the embodiments are used for convenience of description only, and the sequence of the embodiments of the present invention is not limited. Furthermore, the above embodiments are not intended to limit the present invention, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention, therefore, the scope of the present invention shall be limited by the appended claims.

Claims

1. A three-dimensional scene interactive video generation method is characterized by comprising the following steps:

acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises a fixed scene hotspot and a fixed scene element in the fixed scene hotspot; wherein the fixed scene hotspot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a character element;

storing the fixed scene hotspots, the fixed scene elements and the movable scene elements to generate a three-dimensional scene interactive video;

generating the three-dimensional scene interaction template by:

acquiring a preset media library, wherein the preset media library comprises a three-dimensional picture, a two-dimensional picture, a three-dimensional video and a two-dimensional video;

displaying a scene preview interface, and creating at least one scene hotspot in the scene preview interface based on a first operation of a user, wherein the scene hotspot is a three-dimensional picture and/or a three-dimensional video;

setting parameters of the scene hot spots based on second operation of a user;

displaying a hot spot preview interface of the scene hot spot, and creating at least one scene element in the hot spot preview interface based on a third operation of a user, wherein the scene element is a two-dimensional picture element, a two-dimensional video element or a text element;

setting parameters of the scene elements and trigger conditions of the scene elements based on a fourth operation of a user;

setting the scene hotspot as a fixed scene hotspot, and setting the scene element as a fixed scene element;

generating a three-dimensional scene interaction template according to the fixed scene hotspots and the fixed scene elements in the fixed scene hotspots;

the step of setting the parameters of the scene hotspot based on the second operation of the user comprises:

if the scene hotspot is a three-dimensional picture, setting an initial angle parameter and an initial range parameter of the three-dimensional picture based on a second operation of the user;

generating a hot spot preview interface of the three-dimensional picture based on the initial angle parameter and the initial range parameter of the three-dimensional picture, and setting an adjacent hot spot link on the hot spot preview interface based on a second operation of a user;

if the scene hotspot is a three-dimensional video, setting an initial angle parameter, an initial range parameter and a video progress parameter of the three-dimensional video based on a second operation of the user;

and generating a hotspot preview interface of the three-dimensional video based on the initial angle parameter, the initial range parameter and the video progress parameter of the three-dimensional video, and setting an adjacent hotspot link on the hotspot preview interface based on a second operation of a user.

2. The method as claimed in claim 1, wherein the step of setting the parameters of the active scene element comprises:

if the active scene element is a two-dimensional picture element, setting a size parameter, a position parameter, a picture transparency and an element life parameter of the two-dimensional picture element;

if the active scene element is a character element, setting a size parameter, a position parameter, a character transparency and an element life parameter of the character element;

and if the active scene element is a two-dimensional video element, setting a size parameter, a position parameter, a picture transparency, a video progress parameter and an element life parameter of the two-dimensional video element.

3. The method as claimed in claim 2, wherein the setting of the trigger condition for all scene elements comprises:

when the position parameters of the scene elements are positioned in the display range of the scene hot spots, starting the scene elements in the display range; when the position parameters of the scene elements are not located in the display range of the scene hot spot, closing the scene elements outside the display range;

opening or closing the corresponding scene element based on the clicking operation of the user on the scene element;

setting opening association relations of the scene elements, and when one scene element is opened, opening the scene element together with other scene elements of which the scene elements are switched to the state and have the opening association relations; and/or;

and setting the closing association relationship of the scene elements, and closing the scene elements together with other scene elements with the closing association relationship with the scene element with the state switching when one scene element is closed.

4. The method for generating the three-dimensional scene interactive video according to claim 1, wherein the adjacent hotspot links of the scene hotspot are actively set on the three-dimensional video based on the video progress parameter of the three-dimensional video.

5. A three-dimensional scene interactive video generation method is characterized by comprising the following steps:

storing the fixed scene hotspots, the fixed scene elements, the template moving scene elements and the local moving scene elements to generate a three-dimensional scene interactive video;

generating the three-dimensional scene interaction template by:

setting parameters of the scene hot spots based on second operation of a user;

setting the scene hotspots as fixed scene hotspots, and setting fixed scene elements and template active scene elements in the scene elements;

generating a three-dimensional scene interaction template according to the fixed scene hotspots, the fixed scene elements in the fixed scene hotspots and the template movable scene elements;

6. An interactive video generating device for three-dimensional scenes, comprising:

the mobile scene element creating module is used for displaying a hot spot preview interface of the fixed scene hot spot and creating at least one mobile scene element in the hot spot preview interface based on a local media library of a user, wherein the mobile scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

the scene element setting module is used for setting parameters of the active scene elements and trigger conditions of all the scene elements; and

the video generation module is used for storing the fixed scene hot spots, the fixed scene elements and the movable scene elements to generate a three-dimensional scene interactive video;

generating the three-dimensional scene interaction template by:

setting parameters of the scene hot spots based on second operation of a user;

if the scene hot spot is a three-dimensional picture, setting an initial angle parameter and an initial range parameter of the three-dimensional picture based on a second operation of the user;

7. An interactive video generating device for three-dimensional scenes, comprising:

the scene element setting module is used for setting parameters of the template activity scene elements and the local activity scene elements and trigger conditions of all the scene elements; and

the video generation module is used for storing the fixed scene hotspots, the fixed scene elements, the template moving scene elements and the local moving scene elements so as to generate a three-dimensional scene interactive video;

generating the three-dimensional scene interaction template by:

setting parameters of the scene hot spots based on second operation of a user;