CN116233382A

CN116233382A - Three-dimensional scene interaction video generation method and generation device based on scene elements

Info

Publication number: CN116233382A
Application number: CN202310237717.7A
Authority: CN
Inventors: 马志友; 邓辉中
Original assignee: Kandao Technology Co Ltd
Current assignee: Kandao Technology Co Ltd
Priority date: 2022-01-07
Filing date: 2022-01-07
Publication date: 2023-06-06
Also published as: CN114363598A; WO2023130544A1; CN114363598B

Abstract

The invention provides a three-dimensional scene interaction video generation method based on scene elements, which comprises the following steps: acquiring a three-dimensional scene interaction template; displaying a hot spot preview interface of a fixed scene hot spot, and creating at least one active scene element in the hot spot preview interface based on a user local media library; setting parameters of the active scene elements and triggering conditions of all scene elements; and storing the fixed scene hot spot, the fixed scene elements and the movable scene elements to generate the three-dimensional scene interactive video. The invention also provides a device for generating the three-dimensional scene interactive video, which has simple generating process and lower difficulty.

Description

Three-dimensional scene interaction video generation method and generation device based on scene elements

The application is a divisional application of an invention patent with the application number of 202210016488.1, the application date of 2022.01.07 and the name of three-dimensional scene interactive video generation method and generation device.

Technical Field

The invention relates to the technical field of image processing, in particular to a three-dimensional scene interactive video generation method and device.

Background

With the development of technology, users have increasingly high requirements on video images, such as interaction with presentation content in the video images, personalized setting of the video images, and the like.

However, the existing multimedia image content includes various contents such as three-dimensional video, two-dimensional video, three-dimensional image, two-dimensional image and audio, if the multimedia image content of various different types needs to be integrated to generate corresponding three-dimensional scene interactive video, professional video processing personnel are generally required to edit and process the different multimedia image content according to the requirements of clients, and the processing process has strong specialization and great difficulty.

Therefore, it is necessary to provide a method and a device for generating a three-dimensional scene interactive video, so as to solve the problems in the prior art.

Disclosure of Invention

The embodiment of the invention provides a three-dimensional scene interactive video generation method and a three-dimensional scene interactive video generation device capable of integrating various different types of multimedia image contents, which are used for solving the technical problems of strong specialization and high difficulty in editing and processing different multimedia image contents in the existing three-dimensional scene interactive video generation method and the generation device.

The embodiment of the invention provides a three-dimensional scene interactive video generation method, which comprises the following steps:

acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises fixed scene hot spots and fixed scene elements in the fixed scene hot spots; wherein the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

displaying a hot spot preview interface of the fixed scene hot spot, and creating at least one active scene element in the hot spot preview interface based on a user local media library, wherein the active scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

setting parameters of the active scene elements and triggering conditions of all scene elements; and

and carrying out storage operation on the fixed scene hot spot, the fixed scene element and the movable scene element to generate a three-dimensional scene interactive video.

The invention also provides a three-dimensional scene interactive video generation method, which comprises the following steps:

acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises a fixed scene hot spot, fixed scene elements in the fixed scene hot spot and template activity scene elements; wherein the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element; the template activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

Displaying a hot spot preview interface of the fixed scene hot spot, and creating at least one local active scene element in the hot spot preview interface based on a user local media library, wherein the local active scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

setting parameters of the template activity scene elements and the local activity scene elements and triggering conditions of all scene elements; and

and carrying out storage operation on the fixed scene hot spot, the fixed scene element, the template activity scene element and the local activity scene element to generate a three-dimensional scene interactive video.

The invention also provides a three-dimensional scene interactive video generation device, which comprises:

the template acquisition module is used for acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises a fixed scene hot spot and fixed scene elements in the fixed scene hot spot; wherein the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

the system comprises an active scene element creation module, a display module and a display module, wherein the active scene element creation module is used for displaying a hot spot preview interface of the fixed scene hot spot and creating at least one active scene element in the hot spot preview interface based on a user local media library, wherein the active scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

The scene element setting module is used for setting parameters of the active scene elements and triggering conditions of all the scene elements; and

and the video generation module is used for carrying out storage operation on the fixed scene hot spot, the fixed scene element and the movable scene element so as to generate a three-dimensional scene interactive video.

the template acquisition module is used for acquiring a three-dimensional scene interaction template, wherein the three-dimensional scene interaction template comprises fixed scene hot spots, fixed scene elements in the fixed scene hot spots and template activity scene elements; wherein the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element; the template activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

the system comprises an active scene element creation module, a fixed scene element display module and a fixed scene element display module, wherein the active scene element creation module is used for displaying a hot spot preview interface of the fixed scene hot spot and creating at least one local active scene element in the hot spot preview interface based on a local media library of a user, and the local active scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

The scene element setting module is used for setting parameters of the template activity scene elements and the local activity scene elements and triggering conditions of all scene elements; and

and the video generation module is used for carrying out storage operation on the fixed scene hot spot, the fixed scene element, the template activity scene element and the local activity scene element so as to generate a three-dimensional scene interaction video.

The embodiment of the invention also provides a computer-readable storage medium, in which processor-executable instructions are stored, the instructions being loaded by one or more processors to perform any of the three-dimensional scene interactive video generation methods described above.

Compared with the prior art, the three-dimensional scene interactive video generation method and the three-dimensional scene interactive video generation device use the three-dimensional scene interactive template to create scene hotspots and scene elements, so that a user can conveniently integrate different types of multimedia image contents in a hotspot preview interface, the three-dimensional scene interactive video generation flow is simple and has lower difficulty, and the technical problems of higher speciality and higher difficulty in editing processing of different multimedia image contents in the existing three-dimensional scene interactive video generation method and the generation device are effectively solved.

Drawings

FIG. 1 is a flow chart of a method for generating a three-dimensional scene interactive video according to an embodiment of the invention;

FIG. 2 is a flowchart of generating a three-dimensional scene interaction template in a first embodiment of a three-dimensional scene interaction video generating method according to the present invention;

FIG. 3 is a flowchart of a second embodiment of a method for generating a three-dimensional scene interactive video according to the present invention;

FIG. 4 is a flowchart of generating a three-dimensional scene interaction template in a second embodiment of the method for generating a three-dimensional scene interaction video according to the present invention;

FIG. 5 is a schematic structural diagram of a first embodiment of a three-dimensional scene interactive video generating apparatus according to the present invention;

FIG. 6 is a schematic structural diagram of a three-dimensional scene interactive video generating apparatus according to a second embodiment of the present invention;

FIG. 7 is a template creation flow chart of the three-dimensional scene interaction template of the present invention;

fig. 8a-8i are schematic diagrams of a template creation process.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

The three-dimensional scene interactive video generation method and the generation device are used for electronic equipment for integrating and editing different types of multimedia image contents, wherein the electronic equipment comprises, but is not limited to, wearable equipment, head-mounted equipment, medical health platforms, personal computers, server computers, handheld or laptop equipment, mobile equipment (such as mobile phones, personal Digital Assistants (PDAs), media players and the like), multiprocessor systems, consumer electronic equipment, small computers, large computers, distributed computing environments comprising any system or equipment, and the like. The electronic device is preferably a content editing electronic device for performing integrated editing on the multimedia image content, so as to perform integrated editing on the multimedia image content of different types and generate corresponding three-dimensional scene interactive video.

Referring to fig. 1, fig. 1 is a flowchart of a three-dimensional scene interactive video generating method according to a first embodiment of the invention. The three-dimensional scene interactive video generation method of the present embodiment may be implemented using the content editing electronic device described above. The three-dimensional scene interactive video generation method of the embodiment comprises the following steps:

Step S101, a three-dimensional scene interaction module is obtained, wherein the three-dimensional scene interaction module comprises a fixed scene hot spot and fixed scene elements in the fixed scene hot spot; the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene elements comprise two-dimensional picture elements, two-dimensional video elements or text elements;

step S102, a hot spot preview interface of a fixed scene hot spot is displayed, and at least one active scene element is created in the hot spot preview interface based on a user local media library, wherein the active scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

step S103, setting parameters of the active scene elements and triggering conditions of all scene elements;

and step S104, storing the fixed scene hot spot, the fixed scene elements and the movable scene elements to generate the three-dimensional scene interactive video.

The following describes in detail the interactive video generation process of the three-dimensional scene interactive video generation method of the present embodiment.

In step S101, the content editing electronic device acquires a three-dimensional scene interaction template; the three-dimensional scene interaction template comprises fixed scene hot spots and fixed scene elements, wherein the fixed scene hot spots comprise three-dimensional pictures and/or three-dimensional videos, and the fixed scene elements comprise two-dimensional picture elements, two-dimensional video elements or text elements.

The three-dimensional scene interaction template is a preset video scene template with a plurality of fixed scene hot spots and a plurality of fixed scene elements, such as a snow scene template in winter, a Christmas template, a new year template and the like, so that a user can form a personalized three-dimensional scene interaction video only by adding personalized active scene elements on the corresponding three-dimensional scene interaction template, and the difficulty of the user in manufacturing the personalized three-dimensional scene interaction video is effectively reduced.

In step S102, the content editing electronic device presents a hotspot preview interface of the fixed scene hotspot. The hot spot preview interface is a scene interface for setting corresponding active scene elements on the corresponding fixed scene hot spot. The user may set two-dimensional pictures, two-dimensional videos, and/or text elements in the user's local media library into the hotspots preview interface to create at least one active scene element in the hotspots preview interface for subsequent editing of the active scene element.

In step S103, the content editing electronic apparatus sets parameters of the active scene elements and trigger conditions of all the scene elements.

Specifically, if the active scene element is a two-dimensional picture element, the content editing electronic device sets a size parameter, a position parameter, a picture transparency, and an element lifetime parameter of the two-dimensional picture element. The size parameter of the two-dimensional picture element refers to the size parameter of the two-dimensional picture; the position parameters of the two-dimensional picture elements refer to the position information of the two-dimensional picture in the hot spot preview interface; the picture transparency of the two-dimensional picture element refers to transparency information of the two-dimensional picture in a hot spot preview interface; the element life parameter of the two-dimensional picture element refers to the embedding life of the two-dimensional picture in the hot spot preview interface, such as setting the embedding in-point time and the embedding out-point time of the two-dimensional picture in the three-dimensional video.

If the activity scene element is a text element, the content editing electronic device sets a size parameter, a position parameter, a text transparency and an element lifetime parameter of the text element. The size parameter of the text element refers to the size parameter of the text element; the size parameter of the text element refers to the position information of the text element in the hot spot preview interface; the character transparency of the character element refers to transparency information of the character element in the hot spot preview interface; the element life parameter of the text element refers to the embedding life of the text element in the hot spot preview interface, such as setting the embedding in-point time and the embedding out-point time of the text element in the three-dimensional video.

If the active scene element is a two-dimensional video element, the content editing electronic device sets a size parameter, a position parameter, a picture transparency, a video progress parameter and an element lifetime parameter of the two-dimensional video element. The size parameter of the two-dimensional video element refers to the picture size parameter of the two-dimensional video; the position parameters of the two-dimensional video elements refer to the position information of the two-dimensional video in the hot spot preview interface; the picture transparency of the two-dimensional video element refers to transparency information of the two-dimensional video in a hot spot preview interface; the video progress parameter of the two-dimensional video element refers to a play parameter of the two-dimensional video in the hot spot preview interface, such as whether to play circularly, set play content, set a play controller and the like. The element life parameter of the two-dimensional video element refers to the embedding life of the two-dimensional video in the hot spot preview interface, such as setting the embedding in-point time and the embedding out-point time of the two-dimensional video in the three-dimensional video.

The triggering condition of the scene element refers to a condition that a two-dimensional picture element, a two-dimensional video element or a text element is triggered in the hot spot preview interface. The trigger here may be a display operation on a two-dimensional picture element or a text element, and a play operation on a two-dimensional video element.

In order to further save resources of the video playing client, when the position parameters of the scene elements can be set by the content editing electronic device to be located in the display range of the scene hot spot, the scene elements of the content in the display range are started, namely, the corresponding two-dimensional picture elements or text elements are displayed, or the corresponding two-dimensional video elements are played. If the position parameter of the scene element is not located in the display range of the scene hotspot, the user cannot observe the scene element outside the display range of the scene hotspot, so that the scene element outside the display range is closed, and resources of the video playing client are saved.

Of course, the corresponding scene element can be opened or closed based on the clicking operation of the user on the scene element, that is, the user performs manual opening or closing control on the scene element.

In order to improve the relevance of different scene elements in the same hot spot preview interface, the content editing electronic device can set the on-incidence relation and the off-incidence relation of different scene elements in the same hot spot preview interface, and when one scene element is started, the content editing electronic device is started together with other scene elements with the on-incidence relation with the scene elements with state switching. If a two-dimensional picture element of a television opening button exists, a two-dimensional video element of the next television on the hot spot preview interface can be set to establish an opening association relationship with the two-dimensional video element, and when the television opening button is triggered, the two-dimensional video element of the television is triggered at the same time. Or when the two-dimensional picture element of the radio is triggered, the sound element of the set broadcasting station is also triggered at the same time, so that the display effect of opening the radio is caused for a user.

Similarly, when one scene element is closed, other scene elements with closing association relation with the scene element with state switching are closed together. If the two-dimensional picture element of the television closing button exists, the two-dimensional video of the next television on the hot spot preview interface can be set to establish a closing association relation with the two-dimensional video of the next television, and when the television closing button is triggered, the two-dimensional video element of the television is closed at the same time.

The closing of the scene elements can be associated with the opening of other scene elements, and the opening of the scene elements can be associated with the closing of other scene elements, so that a user can realize the associated triggering or closing among a plurality of scene elements by clicking one scene element, the linkage setting of the plurality of scene elements under the same hot spot preview interface by the user is facilitated, and the viewing experience of the interactive video of the user is improved.

Since the editing method of the fixed scene element is similar to the editing method of the movable scene element and the scene frame of the whole three-dimensional scene interaction template is not irreversibly influenced, the triggering conditions of the fixed scene element and the movable scene element can be set by a user, but the parameters of the fixed scene element cannot be changed.

In step S104, the content editing electronic device performs a storage operation on the fixed scene hotspot acquired in step S101, the fixed scene element acquired in step S103, and the active scene element, so as to generate a three-dimensional scene interactive video. The user can watch all scene hotspots and scene elements in the scene hotspots by interacting with the three-dimensional scene interactive video.

Thus, the three-dimensional scene interactive video creation process of the three-dimensional scene interactive video generation method of the embodiment is completed.

Referring to fig. 2, fig. 2 is a flowchart illustrating a three-dimensional scene interaction template generation process in a first embodiment of the three-dimensional scene interaction video generation method according to the present invention. The generation flow of the three-dimensional scene interaction template comprises the following steps:

step S201, a preset media library is obtained, wherein the preset media library comprises three-dimensional pictures, two-dimensional pictures, three-dimensional videos and two-dimensional videos;

step S202, a scene preview interface is displayed, and at least one scene hot spot is created in the scene preview interface based on a first operation of a user, wherein the scene hot spot is a three-dimensional picture and/or a three-dimensional video;

Step S203, setting parameters of scene hotspots based on a second operation of the user;

step S204, a hot spot preview interface of a scene hot spot is displayed, and at least one scene element is created in the hot spot preview interface based on a third operation of a user, wherein the scene element is a two-dimensional picture element, a two-dimensional video element or a text element;

step S205, setting parameters of the scene elements and triggering conditions of the scene elements based on a fourth operation of a user;

step S206, setting the scene hot spot as a fixed scene hot spot and setting the scene element as a fixed scene element;

step S207, generating a three-dimensional scene interaction template according to the fixed scene hot spot and the fixed scene elements in the fixed scene hot spot.

The following describes the generation flow of the three-dimensional scene interaction template in the embodiment in detail.

In step S201, the content editing electronic device obtains a preset media library, where the preset media library is used to store multimedia image content such as three-dimensional pictures, two-dimensional pictures, three-dimensional videos, and two-dimensional videos.

The three-dimensional picture is a panoramic picture of 360-degree content images around the user observation point serving as a center point; the three-dimensional video is a panoramic video of 360-degree content images around the user observation point as a center point; the two-dimensional picture is a plane picture of the content image in a certain area range; the three-dimensional video is a planar video of a content image of a certain area range.

Since the content image displayed by the three-dimensional picture and the three-dimensional video is generally larger than the actual observation range of the user, the three-dimensional picture and the three-dimensional video can be set as scene hotspots so as to create virtual scenes around the user. The content images displayed by the two-dimensional pictures and the two-dimensional videos are generally smaller than the actual observation range of the user, so that the two-dimensional pictures and the two-dimensional videos can be set as scene elements in scene hotspots so as to create part of virtual elements in virtual scenes around the user. And then goes to step S202.

In step S202, the content editing electronic device displays a scene preview interface, where the scene preview interface is an interface for setting a scene hotspot, and a user may set a three-dimensional picture and a three-dimensional video in a preset media library into the scene preview interface so as to edit the scene hotspot.

Specifically, the three-dimensional picture and the three-dimensional video can be displayed in a preset media library in a content preview mode, so that a user can add scene hot spots such as the three-dimensional picture and the three-dimensional video into a scene preview interface in a mode of dragging the content preview.

In addition, if a plurality of scene hotspots are created in the scene preview interface based on the first operation of the user (dragging the content preview, etc.), the content editing electronic device may also create a connection relationship between the plurality of scene hotspots based on the first operation of the user (creating a connection line between different scene hotspots) so as to implement switching between the different scene hotspots. The connection relation of the scene hotspots is used for setting adjacent hotspot links corresponding to the connection relation in the corresponding hotspot preview interface. And then goes to step S203.

In step S203, the content editing electronic device sets parameters of the scene hotspot based on the second operation of the user.

Specifically, if the scene hotspot is a three-dimensional picture, the content editing electronic device sets an initial angle parameter and an initial range parameter of the three-dimensional picture based on a second operation of a user. The initial angle parameter refers to an initial angle of the three-dimensional picture which can be observed by a user when entering a scene hot spot corresponding to the three-dimensional picture. The initial range parameter refers to an angle range of the three-dimensional picture which can be observed by a user when entering a scene hot spot corresponding to the three-dimensional picture. The second operation herein may be an operation in which the user directly inputs parameters of the scene hotspot or adjusts parameters of the scene hotspot on the basis of preset parameters.

For example, the three-dimensional picture is a three-dimensional picture of an internal structure of a bedroom, the initial angle parameter of the three-dimensional picture can be an angle of a user facing away from a door of the bedroom, and the initial range parameter of the three-dimensional picture can be picture content of a range of approximately 120 degrees of the three-dimensional picture which can be observed by the user standing at the door of the bedroom, so that a scene of the user entering the bedroom in the interactive video can be better reconstructed.

And then the content editing electronic equipment generates a hot spot preview interface of the three-dimensional picture based on the set initial angle parameter and the initial range parameter of the three-dimensional picture. If the scene hotspot has a neighboring scene hotspot, a neighboring hotspot link of the neighboring scene hotspot can be set on a hotspot preview interface of the three-dimensional picture.

If the scene hotspot is a three-dimensional video, the content editing electronic device sets an initial angle parameter, an initial range parameter and a video progress parameter of the three-dimensional video based on a second operation of a user. The initial supervision parameter refers to an initial angle of the three-dimensional video which can be observed by a user when entering a scene hot spot corresponding to the three-dimensional video. The initial range parameter refers to the angle range of the three-dimensional video which can be observed by a user when entering a scene hot spot corresponding to the three-dimensional video. The video progress parameter refers to the playing progress of the three-dimensional video when the scene hot spot corresponding to the three-dimensional video is accessed.

The content editing electronic device may then generate a hotspot preview interface for the three-dimensional video based on the set initial angle parameter, initial range parameter, and video progress parameter of the three-dimensional video. If the scene hotspot has a neighboring scene hotspot, a neighboring hotspot link of the neighboring scene hotspot can be set on a hotspot preview interface of the three-dimensional video.

Here, a scene hotspot may have a plurality of adjacent scene hotspots, each of the adjacent scene hotspots has a corresponding adjacent hotspot link, where some adjacent hotspot links are disposed at a fixed position of the three-dimensional video or the three-dimensional picture, and some adjacent hotspot links may be disposed on a certain active object on the three-dimensional video (such as a person moving on the three-dimensional video), so the content editing electronic device may actively set the adjacent hotspot links of the scene hotspot on the three-dimensional video based on the video progress parameter of the three-dimensional video, that is, based on the difference of the video progress parameters of the three-dimensional video, the positions of the adjacent hotspot links in the three-dimensional video are also different. And then goes to step S204.

In step S204, the content editing electronic device presents a hot spot preview interface of the scene hot spot. The hot spot preview interface is a scene interface for setting corresponding scene elements on the corresponding scene hot spot. The user can set the two-dimensional pictures, the two-dimensional videos and/or the text elements in the preset media library into the hot spot preview interface through a third operation so as to create at least one scene element in the hot spot preview interface, and then edit the scene element subsequently. The third operation may be a drag operation or a selection operation of the content preview of the scene element by the user.

Specifically, since the three-dimensional video of the scene hotspot has active content, there may be a conflict with the presentation of the scene element content.

For example, the display interface of the general scene element should cover the display interface of the scene hotspot, so as to realize effective display of the scene element in the scene hotspot, for example, a two-dimensional video of a television content is set in the scene hotspot as the scene element, and the two-dimensional video of the television content should be located at the display interface of the highest layer. However, the display interface of the scene element always covers the display interface of the scene hotspot, for example, the scene hotspot also has an active object (such as an active person), which may cause the active object in the scene hotspot to pass in front of the television, but the screen is a conflicting effect that the television content shields the active object.

To avoid the three-dimensional video in the scene hotspot from conflicting with the content in the scene element. The content editing electronic device acquires a static area in the three-dimensional video, wherein the static area refers to an area where the picture content is not changed in the playing process of the three-dimensional video. In this way, in the hot spot preview interface for displaying the scene hot spot, static scene elements (scene elements arranged in the static area) can be created in the static area of the hot spot preview interface, and because the content of the three-dimensional video in the static area is unchanged, the display conflict of the active content of the scene hot spot blocked by the static scene elements cannot be generated, and the display interface of the scene elements is arranged to cover the display interface of the scene hot spot. And then goes to step S205.

In step S205, the content editing electronic apparatus sets parameters of the scene element and trigger conditions of the scene element based on the fourth operation by the user.

Specifically, if the scene element is a two-dimensional picture element, the content editing electronic device sets a size parameter, a position parameter, a picture transparency, and an element lifetime parameter of the two-dimensional picture element based on the fourth operation. The size parameter of the two-dimensional picture element refers to the size parameter of the two-dimensional picture; the position parameters of the two-dimensional picture elements refer to the position information of the two-dimensional picture in the hot spot preview interface; the picture transparency of the two-dimensional picture element refers to transparency information of the two-dimensional picture in a hot spot preview interface; the element life parameter of the two-dimensional picture element refers to the embedding life of the two-dimensional picture in the hot spot preview interface, such as setting the embedding in-point time and the embedding out-point time of the two-dimensional picture in the three-dimensional video. The fourth operation herein may be an operation in which the user directly inputs the parameters of the two-dimensional picture element or adjusts the parameters of the two-dimensional picture element on the basis of preset parameters.

If the scene element is a text element, the content editing electronic device sets a size parameter, a position parameter, a text transparency, and an element lifetime parameter of the text element based on the fourth operation. The size parameter of the text element refers to the size parameter of the text element; the size parameter of the text element refers to the position information of the text element in the hot spot preview interface; the character transparency of the character element refers to transparency information of the character element in the hot spot preview interface; the element life parameter of the text element refers to the embedding life of the text element in the hot spot preview interface, such as setting the embedding in-point time and the embedding out-point time of the text element in the three-dimensional video. The fourth operation may be an operation in which the user directly inputs the parameters of the text element or adjusts the parameters of the text element based on the preset parameters.

If the scene element is a two-dimensional video element, the content editing electronic device sets a size parameter, a position parameter, a picture transparency, a video progress parameter, and an element lifetime parameter of the two-dimensional video element based on the fourth operation. The size parameter of the two-dimensional video element refers to the picture size parameter of the two-dimensional video; the position parameters of the two-dimensional video elements refer to the position information of the two-dimensional video in the hot spot preview interface; the picture transparency of the two-dimensional video element refers to transparency information of the two-dimensional video in a hot spot preview interface; the video progress parameter of the two-dimensional video element refers to a play parameter of the two-dimensional video in the hot spot preview interface, such as whether to play circularly, set play content, set a play controller and the like. The element life parameter of the two-dimensional video element refers to the embedding life of the two-dimensional video in the hot spot preview interface, such as setting the embedding in-point time and the embedding out-point time of the two-dimensional video in the three-dimensional video. The fourth operation herein may be an operation in which the user directly inputs the parameters of the two-dimensional video element or adjusts the parameters of the two-dimensional video element on the basis of preset parameters.

The closing of the scene elements can be associated with the opening of other scene elements, and the opening of the scene elements can be associated with the closing of other scene elements, so that a user can realize the associated triggering or closing among a plurality of scene elements by clicking one scene element, the linkage setting of the plurality of scene elements under the same hot spot preview interface by the user is facilitated, and the viewing experience of the interactive video of the user is improved. And then goes to step S206.

In step S206, the content editing electronic apparatus sets the scene hotspot set in step S202 as a fixed scene hotspot, and sets the scene element set in step S204 as a fixed scene element; the fixed scene hot spot is a scene hot spot which cannot be subjected to parameter change by the three-dimensional scene interaction template, and the fixed scene element is a scene element which cannot be subjected to parameter change by the three-dimensional scene interaction template, so that a later user can conveniently add the active scene element on the three-dimensional scene interaction template. And then goes to step S207.

In step S207, the content editing electronic device generates a three-dimensional scene interaction template according to the fixed scene hotspot and the fixed scene element in the fixed scene hotspot, so that a subsequent user can call the three-dimensional scene interaction template.

According to the three-dimensional scene interactive video generation method, the three-dimensional scene interactive template is used for creating scene hotspots and scene elements, so that a user can integrate different types of multimedia image contents in a hotspot preview interface conveniently, and the three-dimensional scene interactive video generation flow is simple and low in difficulty.

Referring to fig. 3, fig. 3 is a flowchart of a three-dimensional scene interactive video generating method according to a second embodiment of the invention. The three-dimensional scene interactive video generation method of the present embodiment may be implemented using the content editing electronic device described above. The three-dimensional scene interactive video generation method of the embodiment comprises the following steps:

step S301, a three-dimensional scene interaction template is obtained, wherein the three-dimensional scene interaction template comprises fixed scene hot spots, fixed scene elements in the fixed scene hot spots and template activity scene elements; the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene elements comprise two-dimensional picture elements, two-dimensional video elements or text elements; the template activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

Step S302, a hot spot preview interface of a fixed scene hot spot is displayed, and at least one local active scene element is created in the hot spot preview interface based on a local media library of a user, wherein the local active scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element;

step S303, setting parameters of template activity scene elements and local activity scene elements and triggering conditions of all scene elements;

and step S304, storing the fixed scene hot spot, the fixed scene element, the template activity scene element and the local activity scene element to generate a three-dimensional scene interactive video.

On the basis of the first embodiment of the three-dimensional scene interactive video generation method, a template active scene element is further arranged in a fixed scene hot spot of a three-dimensional scene interactive template of the three-dimensional scene interactive video generation method, wherein the template active scene element refers to an active scene element which can be edited by a user in a personalized way.

In step S302, the content editing electronic device presents a hot spot preview interface of a fixed scene hot spot. The hot spot preview interface is a scene interface for setting corresponding active scene elements on the corresponding fixed scene hot spot. The user may set two-dimensional pictures, two-dimensional videos, and/or text elements in the user's local media library into the hotspot preview interface to create at least one local active scene element in the hotspot preview interface for subsequent editing of the local active scene element.

In step S303, the content editing electronic device sets parameters of the template active scene element and the local active scene element and trigger conditions of all the scene elements.

The specific setting flow of the template active scene element and the local active scene element is the same as or similar to the setting flow of the active scene element in step S103, specifically please refer to the setting flow of the active scene element in step S103.

In step S304, the content editing electronic device performs a storage operation on the obtained fixed scene hot spot, fixed scene element, template active scene element, and local active scene element, so as to generate a three-dimensional scene interactive video. The user can watch all scene hotspots and template activity scene elements and local activity scene elements in the scene hotspots by interacting with the three-dimensional scene interactive video.

Next, the process of generating the three-dimensional scene interaction template in the present embodiment will be described in detail, with reference to fig. 4, and fig. 4 is a flowchart illustrating the generation of the three-dimensional scene interaction template in the second embodiment of the three-dimensional scene interaction video generating method of the present invention. The generation flow of the three-dimensional scene interaction template comprises the following steps:

Step S401, a preset media library is obtained, wherein the preset media library comprises three-dimensional pictures, two-dimensional pictures, three-dimensional videos and two-dimensional videos;

step S402, a scene preview interface is displayed, and at least one scene hot spot is created in the scene preview interface based on a first operation of a user, wherein the scene hot spot is a three-dimensional picture and/or a three-dimensional video;

step S403, setting parameters of scene hotspots based on a second operation of the user;

step S404, displaying a hot spot preview interface of a scene hot spot, and creating at least one scene element in the hot spot preview interface based on a third operation of a user, wherein the scene element is a two-dimensional picture element, a two-dimensional video element or a text element;

step S405, setting parameters of the scene element and triggering conditions of the scene element based on a fourth operation of the user;

step S406, setting a scene hotspot as a fixed scene hotspot, and setting fixed scene elements and template activity scene elements in the scene elements;

step S407, generating a three-dimensional scene interaction template according to the fixed scene hot spot, the fixed scene elements in the fixed scene hot spot, and the template activity scene elements.

On the basis of the first embodiment, when the three-dimensional scene interaction template of the three-dimensional scene interaction video generation method is generated, fixed scene elements and template activity scene elements are arranged in the fixed scene elements, wherein the fixed scene hot spots are scene hot spots which cannot be subjected to parameter modification by the three-dimensional scene interaction template, the fixed scene elements are scene elements which cannot be subjected to parameter modification by the three-dimensional scene interaction template, and the template activity scene elements are scene elements which can be subjected to parameter modification by the three-dimensional scene interaction template, so that a later user can edit the template activity scene elements based on own personalized requirements to generate the three-dimensional scene interaction video wanted by the user.

On the basis of the first embodiment, the three-dimensional scene interaction template of the embodiment is simultaneously provided with the fixed scene elements and the template activity scene elements, so that a user can edit the template activity scene elements in the three-dimensional scene interaction template, and the editing capability of the user on the three-dimensional scene interaction video is further improved.

The present invention also provides a three-dimensional scene interactive video generating device, please refer to fig. 5, fig. 5 is a schematic structural diagram of a first embodiment of the three-dimensional scene interactive video generating device of the present invention. The three-dimensional scene interactive video generating apparatus of the present embodiment may be implemented using the three-dimensional scene interactive video generating method described above, and the three-dimensional scene interactive video generating apparatus 50 includes a template acquisition module 51, an active scene element creation module 52, a scene element setting module 53, and a video generating module 54.

The template obtaining module 51 is configured to obtain a three-dimensional scene interaction template, where the three-dimensional scene interaction template includes a fixed scene hotspot and a fixed scene element in the fixed scene hotspot; the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene elements comprise two-dimensional picture elements, two-dimensional video elements or text elements; the active scene element creation module 52 is configured to display a hotspot preview interface of a fixed scene hotspot, and create at least one active scene element in the hotspot preview interface based on a local media library of a user, where the active scene element includes a two-dimensional picture element, a two-dimensional video element, or a text element; the scene element setting module 53 is configured to set parameters of the active scene elements and trigger conditions of all the scene elements; the video generation module 54 is configured to store the fixed scene hot spot, the fixed scene element, and the active scene element to generate a three-dimensional scene interactive video.

When the three-dimensional scene interaction video generating device 50 of the present embodiment is used, firstly, the template obtaining module 51 obtains a three-dimensional scene interaction template; the three-dimensional scene interaction template comprises fixed scene hot spots and fixed scene elements, wherein the fixed scene hot spots comprise three-dimensional pictures and/or three-dimensional videos, and the fixed scene elements comprise two-dimensional picture elements, two-dimensional video elements or text elements.

The activity scene element creation module 52 then exposes a hot spot preview interface for the fixed scene hot spot. The hot spot preview interface is a scene interface for setting corresponding active scene elements on the corresponding fixed scene hot spot. The user may set two-dimensional pictures, two-dimensional videos, and/or text elements in the user's local media library into the hotspots preview interface to create at least one active scene element in the hotspots preview interface for subsequent editing of the active scene element.

The scene element setting module 53 then sets the parameters of the active scene elements and the trigger conditions of all scene elements.

Finally, the video generating module 54 performs a storage operation on the obtained fixed scene hot spot, the obtained fixed scene element and the active scene element to generate a three-dimensional scene interactive video. The user can watch all scene hotspots and scene elements in the scene hotspots by interacting with the three-dimensional scene interactive video.

Thus, the three-dimensional scene interactive video generation process of the three-dimensional scene interactive video generation device 50 of the present embodiment is completed.

The generating process of the three-dimensional scene interactive video in this embodiment is the same as or similar to the generating process of the three-dimensional scene interactive video in the first embodiment of the three-dimensional scene interactive video generating method described above, and please refer to the related description in the first embodiment of the three-dimensional scene interactive video generating method.

Referring to fig. 6, fig. 6 is a schematic structural diagram of a three-dimensional scene interactive video generating apparatus according to a second embodiment of the invention. The three-dimensional scene interactive video generating apparatus of the present embodiment may be implemented using the three-dimensional scene interactive video generating method described above, and the three-dimensional scene interactive video generating apparatus 60 includes a template acquisition module 61, an active scene element creation module 62, a scene element setting module 63, and a video generating module 64.

The template obtaining module 61 is configured to obtain a three-dimensional scene interaction template, where the three-dimensional scene interaction template includes a fixed scene hotspot, and a fixed scene element and a template active scene element in the fixed scene hotspot; wherein the fixed scene hot spot comprises a three-dimensional picture and/or a three-dimensional video; the fixed scene elements comprise two-dimensional picture elements, two-dimensional video elements or text elements; the template activity scene element comprises a two-dimensional picture element, a two-dimensional video element or a text element; the active scene element creation module 62 is configured to display a hotspot preview interface of a fixed scene hotspot, and create at least one local active scene element in the hotspot preview interface based on a local media library of a user, where the local active scene element includes a two-dimensional picture element, a two-dimensional video element, or a text element; the scene element setting module 63 is configured to set parameters of the template active scene element and the local active scene element, and trigger conditions of all the scene elements; the video generation module 64 is configured to store the fixed scene hot spot, the fixed scene element, the template active scene element, and the local active scene element, so as to generate a three-dimensional scene interactive video.

On the basis of the first embodiment, when the three-dimensional scene interaction template of the three-dimensional scene interaction video generating device 60 of the present embodiment is generated, fixed scene elements and template activity scene elements are set in the fixed scene elements, wherein the fixed scene hot spot is a scene hot spot where the three-dimensional scene interaction template cannot be subjected to parameter modification, the fixed scene element is a scene element where the three-dimensional scene interaction template cannot be subjected to parameter modification, and the template activity scene element is a scene element where the three-dimensional scene interaction template can be subjected to parameter modification, so that a later user can edit the template activity scene element based on own personalized requirements to generate a three-dimensional scene interaction video wanted by himself.

The generating process of the three-dimensional scene interactive video in this embodiment is the same as or similar to the generating process of the three-dimensional scene interactive video in the second embodiment of the generating method of the three-dimensional scene interactive video described above, and please refer to the related description in the first embodiment of the generating method of the three-dimensional scene interactive video.

The following describes a process for creating the three-dimensional scene interaction template according to the present invention through a specific embodiment. Referring to fig. 7 and fig. 8a-8i, fig. 7 is a flowchart illustrating the creation of a three-dimensional scene interaction template according to the present invention. Fig. 8a-8i are schematic diagrams of a template creation process.

The process of creating the three-dimensional scene interaction template by the content editing electronic equipment comprises the following steps:

step S701, the content editing electronic device creates a preset media library, i.e. stores the prepared three-dimensional picture, two-dimensional picture, three-dimensional video and two-dimensional video into the preset media library, as shown by 81 in fig. 8a

In step S702, the content editing electronic device displays a scene preview interface, such as the scene preview interface 82 in fig. 8b, and the user can create a plurality of scene hotspots and a connection relationship between the plurality of scene hotspots (simultaneously create adjacent hotspot links in the scene hotspots) by dragging the content preview image of the scene hotspots in the preset media library 83 to the scene preview interface 82. Such as adjacent hotspot links 85 for adjacent scene hotspots are provided in the hotspot preview interface 84 in fig. 8 b.

In step S703, the content editing electronic device sets parameters of the scene hotspot. As shown in fig. 8c, the scene hotspot is a three-dimensional video, so the video progress parameter of the three-dimensional video can be set by the progress controller 86, the initial range parameter of the three-dimensional video can be set by the view angle adjustment of the scene view angle setting 87, and the initial angle parameter of the three-dimensional video can be set by the horizontal adjustment of the scene view angle setting 87, namely, the positions of the first horizontal axis (the left-right direction axis based on the existing user viewpoint), the second horizontal axis (the front-rear direction axis based on the existing user viewpoint), and the vertical axis (the up-down direction axis based on the existing user viewpoint) of the user viewpoint are changed. Meanwhile, the position of the adjacent hot spot link 85 in the hot spot preview interface 84 can be adjusted, if the adjacent hot spot link 85 is disposed on a moving object of a scene hot spot corresponding to a hot spot preview interface, the position of the adjacent hot spot link 85 in the hot spot preview interface can be adjusted based on the video progress parameter of the scene hot spot.

In step S704, the content editing electronic device displays a hot spot preview interface of the scene hot spot. As shown in the hotspot preview interface 84 in fig. 8d, a user may create multiple scene elements in the hotspot preview interface by embedding two-dimensional pictures, three-dimensional pictures, two-dimensional video, three-dimensional video, text elements, and audio elements in the hotspot preview interface via the embedded material interface 88.

In step S705, the content editing electronic device sets parameters of the scene element and trigger conditions of the scene element based on the fourth operation of the user.

The parameter settings of the scene elements of the text elements are shown in fig. 8e, and the user can set the size parameters, position parameters, display angle parameters, text transparency and element lifetime parameters of the text elements through the text material embedding interface 89.

The parameter settings of the scene elements of the two-dimensional picture and the three-dimensional picture are shown in fig. 8f, and the user can set the size parameters, the position parameters, the display angle parameters, the character transparency and the element life parameters of the two-dimensional picture and the three-dimensional picture through the picture material embedding interface 8 a.

The parameter setting of the scene elements of the two-dimensional video and the three-dimensional video is shown in fig. 8g, and the user can set the size parameters, the position parameters, the picture transparency, the video progress parameters and the element lifetime parameters of the two-dimensional video and the three-dimensional video through the video material embedding interface 8 b.

Parameter settings for audio elements as shown in fig. 8h, the user can set the position parameters, volume parameters, and element lifetime parameters of the audio elements through the audio material embedding interface 8 c.

Further, the content editing electronic device may further set an on association relationship and an off association relationship of different scene elements, specifically, as shown in an interface 8d of the audio material embedding interface 8c in fig. 8h, the user may set an association relationship between the audio material and other scene elements, and similarly, the user may set an association relationship between all the scene elements of different types.

In step S706, the content editing electronic device stores the edited scene hot spot and the scene elements in the scene hot spot, and generates a three-dimensional scene interaction template, as shown in fig. 8 i.

The three-dimensional scene interactive video generation method and the generation device of the invention use the three-dimensional scene interactive template to create scene hotspots and scene elements, so that a user can conveniently integrate different types of multimedia image contents in a hotspot preview interface, the generation flow of the three-dimensional scene interactive video is simple and has lower difficulty, and the technical problems of stronger specialization and higher difficulty of editing different multimedia image contents in the existing three-dimensional scene interactive video generation method and the generation device are effectively solved.

In summary, although the embodiments of the present invention have been described above, the numbers before the embodiments are used for convenience of description, and the order of the embodiments of the present invention is not limited. Moreover, the above-mentioned embodiments are not intended to limit the present invention, and those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, so the scope of the present invention is defined by the claims.

Claims

1. The three-dimensional scene interaction video generation method based on scene elements is characterized by comprising the following steps of:

performing storage operation on the fixed scene hot spot, the fixed scene element and the movable scene element to generate a three-dimensional scene interactive video;

the step of setting parameters of the activity scene element includes:

if the active scene element is a two-dimensional picture element, setting a size parameter, a position parameter, a picture transparency and an element life parameter of the two-dimensional picture element;

if the activity scene element is a character element, setting a size parameter, a position parameter, a character transparency and an element service life parameter of the character element;

if the active scene element is a two-dimensional video element, setting a size parameter, a position parameter, a picture transparency, a video progress parameter and an element life parameter of the two-dimensional video element;

the setting of the triggering conditions of all scene elements comprises:

when the position parameter of the scene element is positioned in the display range of the scene hot spot, starting the scene element in the display range; when the position parameter of the scene element is not located in the display range of the scene hot spot, closing the scene element outside the display range;

Opening or closing the corresponding scene element based on clicking operation of the user on the scene element;

setting an opening association relation of scene elements, and opening the scene elements together with other scene elements with the opening association relation of the scene elements with state switching when one scene element is opened; and/or

And setting a closing association relation of the scene elements, and closing the scene elements together with other scene elements with the closing association relation of the scene elements with the state switching when one scene element is closed.

2. The method for generating a three-dimensional scene interaction video based on scene elements according to claim 1, wherein the three-dimensional scene interaction template is generated by:

acquiring a preset media library, wherein the preset media library comprises three-dimensional pictures, two-dimensional pictures, three-dimensional videos and two-dimensional videos;

displaying a scene preview interface, and creating at least one scene hot spot in the scene preview interface based on a first operation of a user, wherein the scene hot spot is a three-dimensional picture and/or a three-dimensional video;

setting parameters of the scene hot spot based on a second operation of a user;

displaying a hot spot preview interface of the scene hot spot, and creating at least one scene element in the hot spot preview interface based on a third operation of a user, wherein the scene element is a two-dimensional picture element, a two-dimensional video element or a text element;

Setting parameters of the scene elements and triggering conditions of the scene elements based on a fourth operation of a user;

setting the scene hot spot as a fixed scene hot spot, and setting the scene element as a fixed scene element;

and generating a three-dimensional scene interaction template according to the fixed scene hot spot and the fixed scene elements in the fixed scene hot spot.

3. The method for generating a three-dimensional scene interactive video based on scene elements according to claim 2, wherein the step of setting parameters of the scene hot spot based on the second operation of the user comprises:

if the scene hotspot is a three-dimensional picture, setting an initial angle parameter and an initial range parameter of the three-dimensional picture based on a second operation of the user;

generating a hot spot preview interface of the three-dimensional picture based on the initial angle parameter and the initial range parameter of the three-dimensional picture, and setting adjacent hot spot links on the hot spot preview interface based on a second operation of a user;

if the scene hotspot is a three-dimensional video, setting an initial angle parameter, an initial range parameter and a video progress parameter of the three-dimensional video based on a second operation of the user;

And generating a hot spot preview interface of the three-dimensional video based on the initial angle parameter, the initial range parameter and the video progress parameter of the three-dimensional video, and setting adjacent hot spot links on the hot spot preview interface based on a second operation of a user.

4. The method for generating a three-dimensional scene interactive video based on scene elements according to claim 3, wherein adjacent hot spot links of the scene hot spot are actively set on the three-dimensional video based on video progress parameters of the three-dimensional video.

5. The three-dimensional scene interaction video generation method based on scene elements is characterized by comprising the following steps of:

storing the fixed scene hot spot, the fixed scene element, the template activity scene element and the local activity scene element to generate a three-dimensional scene interactive video;

the step of setting parameters of the template activity scene element and the local activity scene element includes:

the setting of the triggering conditions of all scene elements comprises:

6. The method for generating a three-dimensional scene interactive video based on scene elements according to claim 5, wherein said three-dimensional scene interactive template is generated by:

setting parameters of the scene hot spot based on a second operation of a user;

setting the scene hot spot as a fixed scene hot spot, and setting fixed scene elements and template activity scene elements in the scene elements;

and generating a three-dimensional scene interaction template according to the fixed scene hot spot, the fixed scene elements in the fixed scene hot spot and the template activity scene elements.

7. A three-dimensional scene interactive video generation device based on scene elements, comprising:

the video generation module is used for carrying out storage operation on the fixed scene hot spot, the fixed scene element and the movable scene element so as to generate a three-dimensional scene interaction video;

wherein the parameters of the activity scene element are set by:

wherein the trigger conditions for all scene elements are set by:

8. A three-dimensional scene interactive video generation device based on scene elements, comprising:

the video generation module is used for carrying out storage operation on the fixed scene hot spot, the fixed scene element, the template activity scene element and the local activity scene element so as to generate a three-dimensional scene interaction video;

wherein the parameters of the activity scene element are set by:

wherein the trigger conditions for all scene elements are set by: