CN111640196A - Space capsule special effect generation method and device, electronic equipment and storage medium - Google Patents
Space capsule special effect generation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111640196A CN111640196A CN202010515231.1A CN202010515231A CN111640196A CN 111640196 A CN111640196 A CN 111640196A CN 202010515231 A CN202010515231 A CN 202010515231A CN 111640196 A CN111640196 A CN 111640196A
- Authority
- CN
- China
- Prior art keywords
- decoration
- space capsule
- real
- capsule
- special effect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The disclosure provides a method, a device, electronic equipment and a storage medium for generating special effects of a space capsule, wherein the method comprises the following steps: acquiring a scene image including an indoor environment; acquiring a space capsule decoration basic material corresponding to a real figure in an indoor environment based on the acquired scene image; generating special effect data of the space capsule decoration corresponding to the real figure based on the determined basic material of the space capsule decoration and the appearance characteristics of the real figure in the indoor environment; and generating AR special effect data of the space capsule decoration worn by the real character based on the generated space capsule decoration special effect data corresponding to the real character in the indoor environment. The space capsule decoration method based on the real scene is more vivid in decoration effect, automatically adds space capsule decoration special effects to real characters, does not need manual editing, and is high in decoration efficiency.
Description
Technical Field
The disclosure relates to the technical field of AR (augmented reality) equipment, in particular to a method and a device for generating special effects of a space capsule, electronic equipment and a storage medium.
Background
Augmented Reality (AR) is a digital processing technology that superimposes a virtual world generated by a computer into the real world, and is widely used in various fields such as engineering machinery, medical applications, tourism, exhibition, entertainment projects, and the like.
In order to ensure the AR experience of the user, a virtual decoration technique for a specific scene is provided in the related art. For example, when a special effect of the space capsule is added, the space capsule needs to be edited manually under a special tool, so that the efficiency is low, and the decoration effect is poor due to the fact that the space capsule is edited without a real scene.
Disclosure of Invention
The embodiment of the disclosure at least provides a scheme for generating a special effect of a space capsule, automatically adds a special effect of space capsule decoration for a real character based on a real scene and carries out AR display, and the space capsule special effect generation method is high in decoration efficiency and has a good decoration effect.
In a first aspect, an embodiment of the present disclosure provides a method for generating a special effect of a space capsule, where the method includes:
acquiring a scene image including an indoor environment;
acquiring a space capsule decoration base material corresponding to a real figure in the indoor environment based on the acquired scene image;
generating space capsule decoration special effect data corresponding to the real character based on the determined space capsule decoration basic material and the appearance characteristics of the real character in the indoor environment;
and generating AR special effect data of the space capsule decoration worn by the real character based on the generated space capsule decoration special effect data corresponding to the real character in the indoor environment.
In one embodiment, the acquiring a space capsule decoration base material corresponding to a real person in the indoor environment based on the acquired scene image includes:
after a real person is identified in the scene image based on the acquired scene image, acquiring a plurality of space capsule decoration article materials worn by the real person in a space capsule, and taking the plurality of space capsule decoration article materials as the space capsule decoration basic materials; the plurality of space capsule decorative article materials comprise an aerospace hat and an aerospace garment.
In one embodiment, the acquiring a space capsule decoration base material corresponding to a real person in the indoor environment based on the acquired scene image includes:
after a real person is identified in the scene image based on the acquired scene image, acquiring a capsule decoration marking material for marking the character attribute information of the real person, and taking the capsule decoration marking material as the capsule decoration basic material; the space capsule decorative mark material comprises a sticker.
In one embodiment, the generating of the capsule decoration special effect data corresponding to the real person based on the determined capsule decoration base material and the appearance characteristics of the real person in the indoor environment includes:
determining size characteristics corresponding to the basic spacecraft decoration material based on the determined basic spacecraft decoration material and the appearance characteristics of the real figures;
and generating the special effect data of the space capsule decoration corresponding to the real character according to the space capsule decoration basic material and the determined size characteristic corresponding to the space capsule decoration basic material.
In one embodiment, the generating AR special effect data of the space capsule decoration worn by the real person based on the generated space capsule decoration special effect data corresponding to the real person in the indoor environment includes:
determining motion trajectory data corresponding to a real person in the indoor environment based on the acquired scene image;
determining the motion trail data of the space capsule decoration indicated by the space capsule decoration special effect data corresponding to the real character according to the determined motion trail data corresponding to the real character;
generating the AR special effect data of the space capsule decoration worn by the real figure based on the generated space capsule decoration special effect data corresponding to the real figure in the indoor environment and the motion trail data.
In one embodiment, the acquiring a space capsule decoration base material corresponding to a real person in the indoor environment based on the acquired scene image includes:
determining a virtual space capsule character matched with a real character in the indoor environment based on the acquired scene image;
acquiring a three-dimensional model corresponding to the virtual space capsule figure matched with the real figure;
and searching the basic spacecraft decoration materials corresponding to the obtained three-dimensional models from the corresponding relation between the three-dimensional models and the basic spacecraft decoration materials.
In one embodiment, the determining a virtual capsule character matching a real character in the indoor environment based on the acquired scene image comprises:
identifying attribute information corresponding to a real person in the indoor environment based on the acquired scene image;
based on the identified attribute information, a virtual capsule persona that matches the attribute information is determined.
In a second aspect, an embodiment of the present disclosure further provides an apparatus for generating a special effect of a space capsule, where the apparatus includes:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a scene image comprising an indoor environment;
the second acquisition module is used for acquiring a space capsule decoration basic material corresponding to a real person in the indoor environment based on the acquired scene image;
the first generation module is used for generating space capsule decoration special effect data corresponding to a real figure based on the determined space capsule decoration basic material and the appearance characteristics of the real figure in the indoor environment;
and the second generation module is used for generating the AR special effect data of the space capsule decoration worn by the real character based on the generated space capsule decoration special effect data corresponding to the real character in the indoor environment.
In a third aspect, an embodiment of the present disclosure further provides an electronic device, including: a processor, a memory and a bus, the memory storing machine readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is running, the machine readable instructions when executed by the processor performing the steps of the method of space capsule special effects generation as set forth in the first aspect and any of its various aspects.
In a fourth aspect, the disclosed embodiments also provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs the steps of the method for generating a space capsule special effect according to the first aspect and any of its various embodiments.
According to the scheme for generating the space capsule special effect, a scene image comprising an indoor environment is firstly acquired, a space capsule decoration base material corresponding to a real character in the indoor environment is acquired based on the acquired scene image, space capsule decoration special effect data corresponding to the real character can be generated based on the determined space capsule decoration base material and the appearance characteristic of the real character in the indoor environment, and AR special effect data of the space capsule decoration worn by the real character is generated based on the generated space capsule decoration special effect data corresponding to the real character in the indoor environment. According to the scheme for generating the special effect of the space capsule, the space capsule decoration base material corresponding to the live figure in the indoor environment can be determined through analysis of the obtained real scene image (namely the scene image comprising the indoor environment), space capsule decoration special effect data generated based on the material and the appearance characteristics of the real figure can be used for wearing space capsule decoration for the real figure in an AR presentation effect, the decoration effect presented by relying on the real scene is more vivid, the space capsule decoration special effect is automatically added for the real figure, manual editing is not needed, and the efficiency is high.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.
Fig. 1 is a flowchart illustrating a method for generating a special effect of a space capsule according to an embodiment of the present disclosure;
fig. 2(a) is a schematic application diagram of a method for generating a special effect of a space capsule according to an embodiment of the present disclosure;
fig. 2(b) is an application schematic diagram of a method for generating a special effect of a space capsule provided in an embodiment of the present disclosure
Fig. 3 is a schematic diagram illustrating an apparatus for generating a special effect of a space capsule according to a second embodiment of the disclosure;
fig. 4 shows a schematic diagram of an electronic device provided in a third embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
Research shows that when the special effect of the space capsule is added, manual editing under a special tool is needed, the efficiency is low, and the decoration effect is poor due to the fact that editing is separated from a real scene.
Based on the research, the space capsule special effect generation method and the space capsule special effect generation system provide at least one space capsule special effect generation scheme, automatically add space capsule decoration special effects for real characters based on a real scene, perform AR display, and have high decoration efficiency and good decoration effect.
The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
To facilitate understanding of the present embodiment, first, a detailed description is given to a method for generating a special effect of a space capsule disclosed in an embodiment of the present disclosure, where an execution subject of the method for generating a special effect of a space capsule provided in an embodiment of the present disclosure is generally an electronic device with certain computing capability, and the electronic device includes, for example: a terminal device, which may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, and the like, or a server or other processing device, which may be an Augmented Reality (AR) device such as AR glasses or an AR helmet. In some possible implementations, the method for generating the capsule special effect may be implemented by a processor calling computer readable instructions stored in a memory.
The method for generating the special effect of the space capsule provided by the embodiment of the disclosure is described below by taking an execution subject as a server.
Example one
Referring to fig. 1, which is a flowchart of a method for generating a special effect of a space capsule provided by the embodiment of the present disclosure, the method includes steps S101 to S104, where:
s101, obtaining a scene image comprising an indoor environment;
s102, acquiring a space capsule decoration base material corresponding to a real person in an indoor environment based on the acquired scene image;
s103, generating special effect data of the space capsule decoration corresponding to the real character based on the determined space capsule decoration basic material and the appearance characteristics of the real character in the indoor environment;
and S104, generating AR special effect data of the space capsule decoration worn by the real person based on the generated space capsule decoration special effect data corresponding to the real person in the indoor environment.
Here, in order to facilitate understanding of the method for generating the special effect of the space capsule provided by the embodiment of the present disclosure, an application scenario of the method for generating the special effect of the space capsule is first described in detail. The method for generating the special effect of the space capsule provided by the embodiment of the disclosure can be applied to any indoor environment, such as a home environment, a work office environment and the like, so that when a user wears an AR device and enters an indoor scene where the method for generating the special effect of the space capsule is deployed, an AR scene image about the space capsule decoration worn by a real character can be provided for the user, that is, the user can view the AR scene image of the real character worn by the space capsule decoration by using the AR device, the constructed virtual space environment can enable the user to generate an external space experience of being personally on the scene, and as the space capsule special effect decoration is automatically added to the real character based on the real scene and the AR display is carried out, the decoration efficiency is higher, and a better decoration effect is achieved.
The AR scene image may be generated based on AR special effect data, and the AR special effect data may be obtained based on space capsule decoration base material determined for a real person in an indoor environment and space capsule decoration special effect data generated based on an appearance feature of the real person.
The basic material of the space capsule decoration can be determined based on different decoration effects, and the decoration effect in the embodiment of the disclosure can be an effect related to human body protection of real characters in a special environment of space, such as space suits, space hats and the like; the method can also be used for decorative effects related to character attribute information of real characters and other decorative effects related to space experience, and the embodiment of the disclosure does not specifically limit the effects. The appearance characteristics of the real person can be height, weight and other related characteristics.
According to the method for generating the special effect of the space capsule, after the basic material of the space capsule decoration corresponding to the real character and the appearance characteristics of the real character are determined, the corresponding special effect data of the space capsule decoration can be generated according to the basic material of the space capsule decoration and the appearance characteristics. The method for generating the special effect data of the space capsule decoration specifically comprises the following steps:
step one, determining size characteristics corresponding to the basic material for space capsule decoration based on the determined basic material for space capsule decoration and appearance characteristics of real figures;
and secondly, generating special effect data of the space capsule decoration corresponding to the real character according to the space capsule decoration basic material and the determined size characteristics corresponding to the space capsule decoration basic material.
In the embodiment of the disclosure, in order to determine the special effect data of the space capsule decoration, firstly, the size characteristics corresponding to the basic material of the space capsule decoration can be determined based on the basic material of the space capsule decoration and the appearance characteristics of the real character, and then, the special effect data of the space capsule decoration corresponding to the real character can be generated according to the basic material of the space capsule decoration and the size characteristics corresponding to the material.
Here, taking an aerospace suit as an example of a basic material for space capsule decoration, when it is determined that a real character belongs to a child based on the appearance characteristics of the real character, an aerospace suit of a small size may be selected as space capsule decoration special effect data corresponding to the child, and when it is determined that the real character belongs to an adult based on the appearance characteristics of the real character, an aerospace suit of a larger size may be selected as space capsule decoration special effect data corresponding to the adult.
In order to determine the appearance features of the real person, the embodiment of the present disclosure may be implemented by using an image processing method or a deep learning method. For example, a feature extraction network capable of performing appearance feature extraction may be trained in advance by using a plurality of image samples, and then the acquired scene image is input into the trained feature extraction network, that is, the appearance features of the real person included in the scene image may be extracted and obtained.
It should be noted that, before the outline feature extraction is performed, the method for generating the special effect of the space capsule provided by the embodiment of the present disclosure needs to perform recognition of a real person first, and here, on one hand, an image processing method may be adopted to implement the method, and on the other hand, a deep learning method may be adopted to implement the method specifically. For example, a person recognition network capable of performing person recognition may be trained in advance using a plurality of image samples, and then the acquired scene image may be input into the trained person recognition network, so that the real person may be recognized from the scene image.
Considering the key influence of the determination of the basic material of the space capsule decoration on the subsequent decoration effect, the following two aspects can be specifically explained.
In a first aspect: the space capsule decoration object material identification method and device can acquire a plurality of space capsule decoration object materials, such as space helmets and space suits, used for real characters to wear in space capsules after real characters appear on the basis of acquired scene image identification, and determine the object materials as space capsule decoration base materials.
In a second aspect: the space capsule decoration marking material, such as the character sticker, used for marking the character attribute information of the real character can be obtained after the real character appears on the basis of the obtained scene image recognition, and the marking material can be determined to be the space capsule decoration basic material.
It should be noted that, in the method for generating a special effect of a space capsule provided in the embodiment of the present disclosure, after the occurrence of real characters is not identified based on the acquired scene image, the AR scene image may be presented according to a common AR scene superposition effect, which is not described herein again.
In order to further improve the decoration effect, the embodiment of the disclosure may also enable the space capsule decoration corresponding to the real figure to move when the real figure in the real environment is determined to move, that is, generate the AR special effect that the decoration moves along with the real figure. Here, it can be realized as follows:
step one, determining motion trail data corresponding to a real person in an indoor environment based on an acquired scene image;
determining the motion track data of the space capsule decoration indicated by the space capsule decoration special effect data corresponding to the real character according to the determined motion track data corresponding to the real character;
and thirdly, generating AR special effect data of the space capsule decoration worn by the real person based on the generated space capsule decoration special effect data and the motion trail data corresponding to the real person in the indoor environment.
Here, in the embodiment of the present disclosure, first, motion trajectory data corresponding to a real person in an indoor environment may be determined based on an acquired scene image, and motion trajectory data of a space capsule decoration indicated by space capsule decoration special effect data corresponding to the real person may be determined based on the motion trajectory data, so that AR special effect data of a space capsule decoration worn by the real person may be generated based on the generated space capsule decoration special effect data corresponding to the real person in the indoor environment and the motion trajectory data. That is, the AR effect presented in the embodiments of the present disclosure may be a decorative effect in which the space capsule decoration (e.g., space suit) moves following the motion of the real person, thereby further enhancing the AR immersion experience of the user.
In order to facilitate understanding of the above-mentioned implementation process of the space capsule special effect generation, as shown in fig. 2(a) -2 (b), the following description may be made in conjunction with a display effect diagram of the AR device.
As shown in fig. 2(a), a scene image including an indoor environment is acquired for the acquired AR device, so that after it is determined that the AR device enters the indoor environment based on the scene image, AR special effect data of a space capsule decoration worn by a real person may be generated, where an aerospace suit is taken as the space capsule decoration, so that the AR device may display a corresponding AR scene image according to the AR special effect data, as shown in fig. 2 (b).
The AR effect presented by the embodiments of the present disclosure may be based on a presentation effect of a real figure wearing a capsule decoration, and may also be a presentation effect of a virtual capsule figure mapping the real figure to an AR scene image. Here, the virtual space capsule character mapped by the real character may be determined first, then the space capsule decoration base material corresponding to the virtual space capsule character may be determined based on the mapped virtual space capsule character, and then the virtual space capsule character wearing the space capsule decoration base material may be displayed by combining with the AR superimposition technology, and in the process of specific display, the virtual space capsule character may be used to replace the corresponding real character.
In order to determine the space capsule decoration basic material corresponding to the virtual space capsule character, the method can be implemented according to the following steps:
step one, determining a virtual space capsule character matched with a real character in an indoor environment based on an acquired scene image;
step two, acquiring a three-dimensional model corresponding to a virtual space capsule figure matched with a real figure;
and step three, searching the basic spacecraft decoration materials corresponding to the obtained three-dimensional models from the corresponding relation between the three-dimensional models and the basic spacecraft decoration materials.
Here, the virtual capsule character matching the real character may be determined based on the scene image, and then the three-dimensional model corresponding to the virtual capsule character may be acquired, so that the capsule decoration base material corresponding to the acquired three-dimensional model may be searched based on the correspondence between each three-dimensional model and each capsule decoration base material.
In order to determine a virtual capsule character corresponding to a real character, character attribute information corresponding to the real character may be first identified based on the acquired scene image, so as to determine a corresponding virtual capsule character according to the character attribute information.
The character attribute information may include character characteristics related to gender, age, occupation, and the like, and different real characters have different character attribute information, so that the determined virtual space capsule characters are different. The virtual capsule character may be a virtual character selected from among preset virtual capsule characters and matching the character attribute information.
It should be noted that the virtual space capsule character matched based on the real character may also implement a dynamic AR special effect according to the special effect tracking method, and the specific process is not described herein again.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
Based on the same inventive concept, the embodiment of the present disclosure further provides a device for generating a special effect of a space capsule corresponding to the method for generating a special effect of a space capsule.
Example two
Referring to fig. 3, an architecture diagram of an apparatus for generating a special effect of a space capsule provided in an embodiment of the present disclosure is shown, where the apparatus includes: a first acquisition module 301, a second acquisition module 302, a first generation module 303 and a second generation module 304; wherein the content of the first and second substances,
a first obtaining module 301, configured to obtain a scene image including an indoor environment;
a second obtaining module 302, configured to obtain a basic material for space capsule decoration corresponding to a real person in an indoor environment based on the obtained scene image;
the first generation module 303 is configured to generate capsule decoration special effect data corresponding to a real character based on the determined capsule decoration basic material and the appearance characteristics of the real character in the indoor environment;
and a second generating module 304, configured to generate, based on the generated capsule decoration special effect data corresponding to the real person in the indoor environment, AR special effect data of the capsule decoration worn by the real person.
In one embodiment, the second obtaining module 302 is configured to obtain the space capsule decoration base material corresponding to the real person in the indoor environment according to the following steps:
after a real character is recognized to exist in the scene image based on the acquired scene image, acquiring a plurality of space capsule decoration article materials worn by the real character in a space capsule, and taking the plurality of space capsule decoration article materials as space capsule decoration basic materials; the plurality of space capsule decorative article materials comprise an aerospace hat and an aerospace garment.
In one embodiment, the second obtaining module 302 is configured to obtain the space capsule decoration base material corresponding to the real person in the indoor environment according to the following steps:
after a real character exists in the scene image based on the acquired scene image, acquiring a space capsule decoration marking material for marking character attribute information of the real character, and taking the space capsule decoration marking material as a space capsule decoration basic material; the space capsule decorative mark material comprises a sticker.
In one embodiment, the first generating module 303 is configured to generate capsule decoration special effect data corresponding to a real person based on the determined capsule decoration base material and the appearance characteristics of the real person in the indoor environment according to the following steps:
determining size characteristics corresponding to the basic spacecraft decoration material based on the determined basic spacecraft decoration material and the appearance characteristics of the real figures;
and generating special effect data of the space capsule decoration corresponding to the real character according to the space capsule decoration basic material and the determined size characteristics corresponding to the space capsule decoration basic material.
In one embodiment, the second generating module 304 is configured to generate the AR special effect data of the space capsule decoration worn by the real person based on the generated space capsule decoration special effect data corresponding to the real person in the indoor environment according to the following steps:
determining motion trajectory data corresponding to a real person in an indoor environment based on the acquired scene image;
determining the motion trail data of the space capsule decoration indicated by the space capsule decoration special effect data corresponding to the real character according to the determined motion trail data corresponding to the real character;
and generating AR special effect data of the space capsule decoration worn by the real character based on the generated space capsule decoration special effect data and the motion trail data corresponding to the real character in the indoor environment.
In one embodiment, the second obtaining module 302 is configured to obtain the space capsule decoration base material corresponding to the real person in the indoor environment based on the obtained scene image according to the following steps:
determining a virtual space capsule character matched with a real character in an indoor environment based on the acquired scene image;
acquiring a three-dimensional model corresponding to a virtual space capsule figure matched with a real figure;
and searching the basic spacecraft decoration materials corresponding to the obtained three-dimensional models from the corresponding relation between the three-dimensional models and the basic spacecraft decoration materials.
In one embodiment, the second obtaining module 302 is configured to determine a virtual space capsule character matching a real character in an indoor environment based on the obtained scene image according to the following steps:
identifying character attribute information corresponding to a real character in an indoor environment based on the acquired scene image;
and determining a virtual space capsule character matched with the character attribute information based on the identified character attribute information.
The description of the processing flow of each module in the device and the interaction flow between the modules may refer to the related description in the above method embodiments, and will not be described in detail here.
EXAMPLE III
An embodiment of the present disclosure further provides an electronic device, as shown in fig. 4, which is a schematic structural diagram of the electronic device provided in the embodiment of the present disclosure, and the electronic device includes: a processor 401, a memory 402, and a bus 403. The memory 402 stores machine-readable instructions executable by the processor 401, the processor 401 and the memory 402 communicating via the bus 403 when the electronic device is operating, the machine-readable instructions when executed by the processor 401 performing the following:
acquiring a scene image including an indoor environment;
acquiring a space capsule decoration basic material corresponding to a real figure in an indoor environment based on the acquired scene image;
generating special effect data of the space capsule decoration corresponding to the real figure based on the determined basic material of the space capsule decoration and the appearance characteristics of the real figure in the indoor environment;
and generating AR special effect data of the space capsule decoration worn by the real character based on the generated space capsule decoration special effect data corresponding to the real character in the indoor environment.
In one embodiment, the instructions executed by the processor 401 to obtain the space capsule decoration base material corresponding to the real person in the indoor environment based on the obtained scene image includes:
after a real character is recognized to exist in the scene image based on the acquired scene image, acquiring a plurality of space capsule decoration article materials worn by the real character in a space capsule, and taking the plurality of space capsule decoration article materials as space capsule decoration basic materials; the plurality of space capsule decorative article materials comprise an aerospace hat and an aerospace garment.
In one embodiment, the instructions executed by the processor 401 to obtain the space capsule decoration base material corresponding to the real person in the indoor environment based on the obtained scene image includes:
after a real character exists in the scene image based on the acquired scene image, acquiring a space capsule decoration marking material for marking character attribute information of the real character, and taking the space capsule decoration marking material as a space capsule decoration basic material; the space capsule decorative mark material comprises a sticker.
In one embodiment, the instructions executed by the processor 401 to generate the capsule decoration special effect data corresponding to the real person based on the determined capsule decoration base material and the appearance characteristics of the real person in the indoor environment includes:
determining size characteristics corresponding to the basic spacecraft decoration material based on the determined basic spacecraft decoration material and the appearance characteristics of the real figures;
and generating special effect data of the space capsule decoration corresponding to the real character according to the space capsule decoration basic material and the determined size characteristics corresponding to the space capsule decoration basic material.
In one embodiment, the instructions executed by the processor 401 to generate the AR special effect data of the space capsule decoration worn by the real person based on the generated space capsule decoration special effect data corresponding to the real person in the indoor environment includes:
determining motion trajectory data corresponding to a real person in an indoor environment based on the acquired scene image;
determining the motion trail data of the space capsule decoration indicated by the space capsule decoration special effect data corresponding to the real character according to the determined motion trail data corresponding to the real character;
and generating AR special effect data of the space capsule decoration worn by the real character based on the generated space capsule decoration special effect data and the motion trail data corresponding to the real character in the indoor environment.
In one embodiment, the instructions executed by the processor 401 to obtain the space capsule decoration base material corresponding to the real person in the indoor environment based on the obtained scene image includes:
determining a virtual space capsule character matched with a real character in an indoor environment based on the acquired scene image;
acquiring a three-dimensional model corresponding to a virtual space capsule figure matched with a real figure;
and searching the basic spacecraft decoration materials corresponding to the obtained three-dimensional models from the corresponding relation between the three-dimensional models and the basic spacecraft decoration materials.
In one embodiment, the instructions executed by the processor 401 for determining a virtual space capsule character matching a real character in an indoor environment based on the acquired scene image includes:
identifying character attribute information corresponding to a real character in an indoor environment based on the acquired scene image;
and determining a virtual space capsule character matched with the character attribute information based on the identified character attribute information.
The disclosed embodiments also provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by the processor 401, performs the steps of the method for generating a space capsule special effect in the above-mentioned method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.
The computer program product of the method for generating a special effect of a space capsule provided by the embodiment of the present disclosure includes a computer readable storage medium storing program codes, where instructions included in the program codes may be used to execute steps of the method for generating a special effect of a space capsule described in the above method embodiment, which may be referred to in the above method embodiment specifically, and are not described herein again.
The embodiments of the present disclosure also provide a computer program, which when executed by a processor implements any one of the methods of the foregoing embodiments. The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing an electronic device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (10)
1. A method for space capsule special effect generation, the method comprising:
acquiring a scene image including an indoor environment;
acquiring a space capsule decoration base material corresponding to a real figure in the indoor environment based on the acquired scene image;
generating space capsule decoration special effect data corresponding to the real character based on the determined space capsule decoration basic material and the appearance characteristics of the real character in the indoor environment;
and generating AR special effect data of the space capsule decoration worn by the real character based on the generated space capsule decoration special effect data corresponding to the real character in the indoor environment.
2. The method of claim 1, wherein the obtaining of the capsule decoration base material corresponding to the real person in the indoor environment based on the obtained scene image comprises:
after a real person is identified in the scene image based on the acquired scene image, acquiring a plurality of space capsule decoration article materials worn by the real person in a space capsule, and taking the plurality of space capsule decoration article materials as the space capsule decoration basic materials; the plurality of space capsule decorative article materials comprise an aerospace hat and an aerospace garment.
3. The method of claim 1, wherein the obtaining of the capsule decoration base material corresponding to the real person in the indoor environment based on the obtained scene image comprises:
after a real person is identified in the scene image based on the acquired scene image, acquiring a capsule decoration marking material for marking the character attribute information of the real person, and taking the capsule decoration marking material as the capsule decoration basic material; the space capsule decorative mark material comprises a sticker.
4. The method according to any one of claims 1 to 3, wherein the generating of the capsule decoration special effect data corresponding to the real person based on the determined capsule decoration base material and the appearance characteristics of the real person in the indoor environment comprises:
determining size characteristics corresponding to the basic spacecraft decoration material based on the determined basic spacecraft decoration material and the appearance characteristics of the real figures;
and generating the special effect data of the space capsule decoration corresponding to the real character according to the space capsule decoration basic material and the determined size characteristic corresponding to the space capsule decoration basic material.
5. The method according to any one of claims 1 to 4, wherein the generating AR special effect data of the space capsule decoration worn by the real person based on the generated space capsule decoration special effect data corresponding to the real person in the indoor environment comprises:
determining motion trajectory data corresponding to a real person in the indoor environment based on the acquired scene image;
determining the motion trail data of the space capsule decoration indicated by the space capsule decoration special effect data corresponding to the real character according to the determined motion trail data corresponding to the real character;
generating the AR special effect data of the space capsule decoration worn by the real figure based on the generated space capsule decoration special effect data corresponding to the real figure in the indoor environment and the motion trail data.
6. The method of claim 1, wherein the obtaining of the capsule decoration base material corresponding to the real person in the indoor environment based on the obtained scene image comprises:
determining a virtual space capsule character matched with a real character in the indoor environment based on the acquired scene image;
acquiring a three-dimensional model corresponding to the virtual space capsule figure matched with the real figure;
and searching the basic spacecraft decoration materials corresponding to the obtained three-dimensional models from the corresponding relation between the three-dimensional models and the basic spacecraft decoration materials.
7. The method of claim 6, wherein determining a virtual capsule character matching a real character in the indoor environment based on the captured scene image comprises:
identifying attribute information corresponding to a real person in the indoor environment based on the acquired scene image;
based on the identified attribute information, a virtual capsule persona that matches the attribute information is determined.
8. An apparatus for space capsule special effect generation, the apparatus comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a scene image comprising an indoor environment;
the second acquisition module is used for acquiring a space capsule decoration basic material corresponding to a real person in the indoor environment based on the acquired scene image;
the first generation module is used for generating space capsule decoration special effect data corresponding to a real figure based on the determined space capsule decoration basic material and the appearance characteristics of the real figure in the indoor environment;
and the second generation module is used for generating the AR special effect data of the space capsule decoration worn by the real character based on the generated space capsule decoration special effect data corresponding to the real character in the indoor environment.
9. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is operating, the machine readable instructions when executed by the processor performing the steps of the method of space capsule special effects generation as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the method of space capsule special effects generation according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010515231.1A CN111640196A (en) | 2020-06-08 | 2020-06-08 | Space capsule special effect generation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010515231.1A CN111640196A (en) | 2020-06-08 | 2020-06-08 | Space capsule special effect generation method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111640196A true CN111640196A (en) | 2020-09-08 |
Family
ID=72331221
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010515231.1A Pending CN111640196A (en) | 2020-06-08 | 2020-06-08 | Space capsule special effect generation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111640196A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106492461A (en) * | 2016-09-13 | 2017-03-15 | 广东小天才科技有限公司 | A kind of implementation method of augmented reality AR game and device, user terminal |
| CN108475442A (en) * | 2017-06-29 | 2018-08-31 | 深圳市大疆创新科技有限公司 | Augmented reality method, processor and unmanned plane for unmanned plane |
| CN110072046A (en) * | 2018-08-24 | 2019-07-30 | 北京微播视界科技有限公司 | Image composition method and device |
| CN110298283A (en) * | 2019-06-21 | 2019-10-01 | 北京百度网讯科技有限公司 | Matching process, device, equipment and the storage medium of picture material |
| CN110910512A (en) * | 2019-11-29 | 2020-03-24 | 北京达佳互联信息技术有限公司 | Virtual object self-adaptive adjusting method and device, computer equipment and storage medium |
| CN111243101A (en) * | 2019-12-31 | 2020-06-05 | 浙江省邮电工程建设有限公司 | Method, system and device for increasing AR environment immersion degree of user based on artificial intelligence |
-
2020
- 2020-06-08 CN CN202010515231.1A patent/CN111640196A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106492461A (en) * | 2016-09-13 | 2017-03-15 | 广东小天才科技有限公司 | A kind of implementation method of augmented reality AR game and device, user terminal |
| CN108475442A (en) * | 2017-06-29 | 2018-08-31 | 深圳市大疆创新科技有限公司 | Augmented reality method, processor and unmanned plane for unmanned plane |
| CN110072046A (en) * | 2018-08-24 | 2019-07-30 | 北京微播视界科技有限公司 | Image composition method and device |
| CN110298283A (en) * | 2019-06-21 | 2019-10-01 | 北京百度网讯科技有限公司 | Matching process, device, equipment and the storage medium of picture material |
| CN110910512A (en) * | 2019-11-29 | 2020-03-24 | 北京达佳互联信息技术有限公司 | Virtual object self-adaptive adjusting method and device, computer equipment and storage medium |
| CN111243101A (en) * | 2019-12-31 | 2020-06-05 | 浙江省邮电工程建设有限公司 | Method, system and device for increasing AR environment immersion degree of user based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111626218B (en) | Image generation method, device, equipment and storage medium based on artificial intelligence | |
| CN110021061A (en) | Collocation model building method, dress ornament recommended method, device, medium and terminal | |
| CN103218844A (en) | Collocation method, implementation method, client side, server and system of virtual image | |
| CN111640202B (en) | AR scene special effect generation method and device | |
| CN111651047A (en) | Virtual object display method and device, electronic equipment and storage medium | |
| CN111627117B (en) | Image display special effect adjusting method and device, electronic equipment and storage medium | |
| CN109420336A (en) | Game implementation method and device based on augmented reality | |
| CN111640171A (en) | Historical scene explaining method and device, electronic equipment and storage medium | |
| CN108109209A (en) | A kind of method for processing video frequency and its device based on augmented reality | |
| CN111694431A (en) | Method and device for generating character image | |
| CN111640200B (en) | AR scene special effect generation method and device | |
| CN111652987A (en) | Method and device for generating AR group photo image | |
| CN111581547A (en) | Tour information pushing method and device, electronic equipment and storage medium | |
| CN111640167A (en) | AR group photo method, AR group photo device, computer equipment and storage medium | |
| CN106527695A (en) | Method and device for information output | |
| CN111652983A (en) | Augmented reality AR special effect generation method, device and equipment | |
| CN111639613A (en) | Augmented reality AR special effect generation method and device and electronic equipment | |
| CN111639615A (en) | Trigger control method and device for virtual building | |
| CN111640196A (en) | Space capsule special effect generation method and device, electronic equipment and storage medium | |
| Cho et al. | Augmented reality coloring book with transitional user interface | |
| CN111665944A (en) | Method and device for decorating special effect of space capsule, electronic equipment and storage medium | |
| CN111640195A (en) | History scene reproduction method and device, electronic equipment and storage medium | |
| CN105809612A (en) | Method of transforming image into expression and intelligent terminal | |
| CN111651049A (en) | Interaction method and device, computer equipment and storage medium | |
| CN112184886A (en) | Image processing method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |