CN111640195A - History scene reproduction method and device, electronic equipment and storage medium - Google Patents
History scene reproduction method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111640195A CN111640195A CN202010515017.6A CN202010515017A CN111640195A CN 111640195 A CN111640195 A CN 111640195A CN 202010515017 A CN202010515017 A CN 202010515017A CN 111640195 A CN111640195 A CN 111640195A
- Authority
- CN
- China
- Prior art keywords
- scene
- historical
- data
- dimensional
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Abstract
The embodiment of the disclosure provides a method and a device for reproducing a historical scene, an electronic device and a storage medium, wherein a real scene picture shot by an AR device is obtained; the real scene picture shows scene data to be reproduced; acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model; and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model. Therefore, the virtual historical object can be combined into the historical recurring scene, the recurring content of the historical recurring scene can be increased, and a user can visit the more complete, rich and real historical scene.
Description
Technical Field
The present disclosure relates to the field of AR technologies, and in particular, to a method and an apparatus for reproducing a history scene, an electronic device, and a storage medium.
Background
With the progress of the times and the development of science and technology, the living standard of people is greatly improved, the spiritual life becomes a greater pursuit of people, more and more people are more and more interested in historical culture, and the mode of visiting a calendar and a museum becomes the choice of most people, but the historical buildings, articles and the like which can be excavated and stored can only be displayed in the calendar and the museum generally, so that a lot of things which do not exist can not be reflected, and users can not be better integrated into the history, and can not obtain better historical display.
With the rapid development of artificial intelligence, virtual reality and augmented reality technologies are increasingly applied, and how to improve the restoration of the history based on the technologies is a research worthy problem to help users to better perceive, experience and integrate into the history.
Disclosure of Invention
The embodiment of the disclosure at least provides a method for reproducing a historical scene.
In a first aspect, an embodiment of the present disclosure provides a method for reproducing a history scenario, where the method includes:
acquiring a real scene picture shot by AR equipment; the real scene picture shows scene data to be reproduced;
acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model;
and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model.
In the embodiment of the disclosure, the virtual historical object can be combined into the historical recurring scene, and by the method, the recurring content of the historical recurring scene can be increased, so that a user can visit a more complete, rich and real historical scene.
In one possible embodiment, the three-dimensional scene model may be created according to the following steps:
acquiring a live-action image of the target historical scene; the live-action image comprises a plurality of two-dimensional codes;
and performing three-dimensional reconstruction on the target historical scene based on the position information of the two-dimensional codes in the live-action image and the preset real distance between the two-dimensional codes to obtain a three-dimensional scene model, and placing a virtual historical article corresponding to the target historical scene in the three-dimensional scene model.
In the embodiment of the disclosure, the target historical scene is subjected to three-dimensional modeling by acquiring the live-action image provided with the two-dimensional code with the preset real distance, so that the three-dimensional scene model in which the virtual historical articles are placed is obtained, the accuracy of the three-dimensional scene model can be ensured, the display contents in the scene model can be increased and decreased, and a user can experience more complete, rich and real historical contents when watching.
In a possible implementation manner, obtaining a pre-established three-dimensional scene model corresponding to the scene data to be reconstructed includes:
and performing attribute identification on the real scene picture based on the scene data to be repeated, and acquiring a three-dimensional scene model matched with the attribute information according to the identified attribute information.
In the embodiment of the disclosure, the three-dimensional scene model is obtained by performing the attribute on the real scene picture, so that the accuracy of the reproduced content can be ensured.
In one possible embodiment, the attribute information includes at least one of the following information:
year, place, type of item.
In a possible implementation manner, after acquiring a pre-established three-dimensional scene model corresponding to the scene data to be reproduced and before generating the AR historical scene reproduction data, the reproduction method further includes:
determining a target virtual historical item, wherein no corresponding real historical item appears in the real scene picture, in the virtual historical items displayed in the three-dimensional scene model;
generating AR historical scene reproduction data obtained by fusing the virtual historical article and the scene data to be reproduced according to the display pose data of the virtual historical article in the three-dimensional scene model, wherein the AR historical scene reproduction data comprises:
and generating AR historical scene reproduction data obtained by fusing the target virtual historical article and the scene data to be reproduced according to the display pose data of the target virtual historical article in the three-dimensional scene model.
In a possible implementation manner, generating AR historical scene recurrence data obtained by fusing the virtual historical item and the scene data to be recovered according to the display pose data of the virtual historical item in the three-dimensional scene model includes:
and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model and the content introduction card corresponding to the virtual historical article.
In the embodiment of the disclosure, by adding the introduction of the virtual history object, the related history can be intuitively embodied, so that a user can obtain better history experience when watching.
In a possible implementation manner, generating AR historical scene recurrence data obtained by fusing the virtual historical item and the scene data to be recovered according to the display pose data of the virtual historical item in the three-dimensional scene model includes:
and generating AR historical scene recurrence data after the virtual historical object and the scene data to be recovered are fused according to the display pose data of the virtual historical object in the three-dimensional scene model, the content introduction card corresponding to the virtual historical object and the sound material explaining the virtual historical object.
In the embodiment of the disclosure, by adding introduction and explanation materials of the virtual history object, the relevant history can be intuitively embodied from a multi-dimensional angle, so that a user can obtain better history experience when watching.
In a second aspect, an embodiment of the present disclosure further provides a device for reproducing a history scenario, where the device includes:
the data acquisition module is used for acquiring a real scene picture shot by the AR equipment; the real scene picture shows scene data to be reproduced;
the model acquisition module is used for acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model;
and the data generation module is used for generating AR historical scene recurrence data after the virtual historical article and the scene data to be recovered are fused according to the display pose data of the virtual historical article in the three-dimensional scene model.
In the embodiment of the disclosure, the virtual historical object can be combined into the historical recurring scene, and by the method, the recurring content of the historical recurring scene can be increased, so that a user can obtain more complete, rich and real historical experience.
In a possible implementation, the reproduction apparatus further includes a model creation module, and the model creation module may create the three-dimensional scene model according to the following steps:
acquiring a live-action image of the target historical scene; the live-action image comprises a plurality of two-dimensional codes;
and performing three-dimensional reconstruction on the target historical scene based on the position information of the two-dimensional codes in the live-action image and the preset real distance between the two-dimensional codes to obtain a three-dimensional scene model, and placing a virtual historical article corresponding to the target historical scene in the three-dimensional scene model.
In the embodiment of the disclosure, the three-dimensional modeling is performed on the target historical scene by acquiring the live-action image provided with the two-dimensional code with the preset real distance, so that the three-dimensional scene model with the virtual historical article placed therein is obtained, the accuracy of the three-dimensional scene model can be ensured, the display content in the scene model can be increased or decreased, and a user can visit more complete, rich and real historical content when watching.
In a possible implementation, the model obtaining module is specifically configured to:
and performing attribute identification on the real scene picture based on the scene data to be repeated, and acquiring a three-dimensional scene model matched with the attribute information according to the identified attribute information.
In the embodiment of the disclosure, the three-dimensional scene model is obtained by performing the attribute on the real scene picture, so that the accuracy of the reproduced content can be ensured.
In one possible embodiment, the attribute information includes at least one of the following information:
year, place, type of item.
In one possible embodiment, the reproduction apparatus further includes:
the article determining module is used for determining a target virtual historical article which is displayed in the three-dimensional scene model and has no corresponding real historical article appearing in the real scene picture;
the data generation module is specifically configured to:
and generating AR historical scene reproduction data obtained by fusing the target virtual historical article and the scene data to be reproduced according to the display pose data of the target virtual historical article in the three-dimensional scene model.
In a possible implementation manner, the data generating module is specifically configured to:
and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model and the content introduction card corresponding to the virtual historical article.
In the embodiment of the disclosure, by adding the introduction of the virtual history object, the related history can be intuitively embodied, so that a user can obtain better history experience when watching.
In a possible implementation manner, the data generating module is specifically configured to:
and generating AR historical scene recurrence data after the virtual historical object and the scene data to be recovered are fused according to the display pose data of the virtual historical object in the three-dimensional scene model, the content introduction card corresponding to the virtual historical object and the sound material explaining the virtual historical object.
In the embodiment of the disclosure, by adding introduction and explanation materials of the virtual history object, the relevant history can be intuitively embodied from a multi-dimensional angle, so that a user can obtain better history experience when watching.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the method for recurring historical scenes according to the first aspect.
In a fourth aspect, the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, performs the steps of the method for reproducing historical scenes according to the first aspect.
According to the method, the device, the electronic equipment and the storage medium for reproducing the historical scene, the real scene picture shot by the AR equipment is obtained; the real scene picture shows scene data to be reproduced; acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model; and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model. Therefore, the virtual historical object can be combined into the historical recurring scene, the recurring content of the historical recurring scene can be increased, and a user can visit the more complete, rich and real historical scene.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.
Fig. 1 is a flowchart of a method for reproducing a history scenario according to an embodiment of the present disclosure;
fig. 2 is a flowchart of building a three-dimensional scene model according to an embodiment of the present disclosure;
fig. 3 is a flowchart of another method for reproducing a history scenario according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a device for reproducing a history scenario according to an embodiment of the present disclosure;
fig. 5 is a second schematic structural diagram of a device for reproducing a history scenario according to an embodiment of the present disclosure;
fig. 6 is a third schematic structural diagram of a device for reproducing a history scenario according to an embodiment of the present disclosure;
fig. 7 is a schematic view of an electronic device provided in an embodiment of the disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
Research shows that most historical venues and the like can only display discovered and stored historical buildings, articles and the like when people visit historical cultural places such as a history hall and the like, so that a lot of things which do not exist can not be reflected, users can not be better integrated into the history, and better history display can not be obtained.
Based on the above, the disclosure provides a historical scene recurrence method, which is characterized in that virtual historical articles and a three-dimensional scene model of a historical scene are fused to obtain AR historical scene recurrence data, and the historical scene is repeated by an AR technology, so that recurrence content of the historical recurrence scene can be increased, and a user can obtain more complete, rich and real historical experience.
To facilitate understanding of the embodiment, first, a detailed description is given to a method for recreating a history scene disclosed in the embodiment of the present disclosure, where an execution main body of the method for recreating a history scene provided in the embodiment of the present disclosure may be a computer device with certain computing capability, specifically, may be a terminal device, a server, or other processing device, for example, a server connected to an AR device, where the AR device may include, for example, AR glasses, a tablet computer, a smart phone, a smart wearable device, and other devices with display functions and data processing capabilities, and the AR device may be connected to the server through an application program. Without limitation, in some possible implementations, the method for reproducing the historical scenario may be implemented by a processor calling a computer readable instruction stored in a memory.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for reproducing a history scenario according to an embodiment of the disclosure. As shown in fig. 1, the reproduction method includes steps S101 to S103, in which:
s101, acquiring a real scene picture shot by AR equipment; and displaying scene data to be reproduced in the real scene picture.
In this step, when the user is visiting in the exhibition hall and wants to watch a certain historical scene, the AR device may be used to shoot the real scene, and at this time, the real scene picture including the scene data to be reproduced may be obtained.
For example, a user visits an ancient temple or a museum which is repaired and restored in reality, and after seeing an ancient table, in a real scene, only the ancient table is actually placed on the ground, at this time, the user can use the AR device to shoot the ancient table and the surrounding scene to obtain a real scene picture, and the real scene picture includes scene data to be restored of the ancient table.
The scene data can include various ancient cultural relic images such as ancient weapons, chinaware, ancient paintings and the like.
S102, acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model.
In this step, according to a real scene picture shot by the AR device, a three-dimensional scene model matching the scene data to be reproduced may be obtained, and then based on display pose data of a virtual historical article in the three-dimensional scene model, AR historical scene reproduction data obtained by fusing the virtual historical article and the scene data to be reproduced is generated, which is described in detail in S103 below.
In a possible implementation manner, a pre-established three-dimensional scene model corresponding to the scene data to be replicated is obtained, attribute recognition may be performed on the real scene picture based on the scene data to be replicated to recognize attribute information corresponding to the real scene picture, and then the stored three-dimensional scene model matching the attribute information is obtained according to the recognized attribute information.
Wherein the attribute information includes at least one of the following information: year, place, type of item. Illustratively, the article type may be an article type, such as an ancient book, an ancient weapon, an ancient figure portrait, an ancient kitchen ware, and the like.
Here, the three-dimensional scene model may be obtained by three-dimensionally reconstructing a target historical scene in advance from a real-world live-action image.
Specifically, please refer to fig. 2, and fig. 2 is a flowchart illustrating a process of building a three-dimensional scene model according to an embodiment of the present disclosure. As shown in fig. 2, in one possible implementation, the three-dimensional scene model may be built according to the following steps:
s1021, acquiring a live-action image of the target historical scene; the live-action image comprises a plurality of two-dimensional codes.
And S1022, performing three-dimensional reconstruction on the target historical scene based on the position information of the two-dimensional codes in the live-action image and the preset real distance between the two-dimensional codes to obtain a three-dimensional scene model, and placing the virtual historical object corresponding to the target historical scene in the three-dimensional scene model.
For example, scene models can be firstly constructed for various historical scenes needing to be reproduced through a three-dimensional modeling technology, and in the modeling process, historical articles related to the corresponding historical scenes can be added to the model corresponding to each historical scene to construct various historical scene models, wherein the various historical scenes comprise the target historical scene.
Specifically, in the process of modeling various historical scenes, taking modeling of a target historical scene as an example, scene data acquisition may be performed in a real scene corresponding to the target historical scene to obtain a real image corresponding to the target historical scene, and in order to better fuse data obtained from the real image during data acquisition, a reference object such as a two-dimensional code may be set in the real scene during real image acquisition, so that the obtained real image includes a plurality of two-dimensional codes, and then position information of the plurality of two-dimensional codes in the real image may be determined, and a three-dimensional scene model of the target historical scene is obtained through three-dimensional reconstruction by using image position information of the two-dimensional codes and preset real distances between the plurality of two-dimensional codes.
Here, by setting the plurality of two-dimensional codes calibrated with the real distance information, the dimensional proportional relationship between the scene and the object in the model can be aligned with the real scene when the three-dimensional scene model is constructed, so that the three-dimensional scene model can accurately represent the real target historical scene.
When modeling is conducted on live-action collection, the number of the two-dimensional codes is important in relation to the size of the live-action environment, therefore, in order to restore the live-action, the two-dimensional codes can be set as many as possible, the two-dimensional codes can be deployed in the live-action environment according to the preset real distance, the distance of the two-dimensional codes is based on the distance of two-dimensional code center points on the same horizontal plane, and the precision of the two-dimensional codes determines the precision of whole scene restoration.
S103, generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model.
In this step, after the three-dimensional scene model is obtained, display pose data of the displayed virtual historical item, for example, morphological data such as a position, a direction, an angle, and the like of the virtual historical item, may be obtained from the three-dimensional scene model, and then the display pose data and the scene data to be reproduced are fused to obtain fused AR historical scene reproduction data, so that the AR device displays an AR scene fused into the virtual historical item based on the AR historical scene reproduction data.
Illustratively, a user visits an ancient temple or a museum which is repaired and restored in reality, when seeing an ancient table, the user can shoot the ancient table and the surrounding scene through AR equipment to obtain a real scene picture, the obtained real scene picture comprises the data of the ancient table and the scene to be restored of the ancient table, then a pre-constructed three-dimensional scene model corresponding to the data of the scene to be restored can be obtained, the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene, the three-dimensional scene model comprises wooden fish or books and other virtual historical articles on the ancient table, then the display pose data of the virtual historical articles can be obtained from the three-dimensional scene model, and the display pose data and the data of the scene to be restored are fused to obtain the AR historical scene reconstruction data of the wooden fish or books and other virtual historical articles placed on the ancient table, therefore, the AR scene merged into the virtual historical article can be displayed through the AR equipment of the user.
With respect to S103 described above, in one possible embodiment, S103 includes:
and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model and the content introduction card corresponding to the virtual historical article.
In this step, the item information of the virtual historical item may also be acquired, so as to obtain a content introduction card corresponding to the virtual historical item, and after the display pose data of the virtual historical item is acquired from the three-dimensional scene model, the display pose data and the content introduction card may be added to the scene data to be reproduced together, that is, the display pose data, the content introduction card and the scene data to be reproduced are fused, so as to obtain AR historical scene reproduction data obtained by fusing the virtual historical item and the scene data to be reproduced.
In this way, detailed information of the virtual historical item can be increased, which is helpful for improving the experience of the user when watching the recurrent scene.
With respect to S103 described above, in another possible embodiment, S103 includes:
and generating AR historical scene recurrence data after the virtual historical object and the scene data to be recovered are fused according to the display pose data of the virtual historical object in the three-dimensional scene model, the content introduction card corresponding to the virtual historical object and the sound material explaining the virtual historical object.
In this step, article information and introduction information of the virtual historical article, for example, a content introduction card corresponding to the virtual historical article and a sound material for introducing the virtual historical article, may also be obtained, and after obtaining the display pose data of the virtual historical article from the three-dimensional scene model, the display pose data, the content introduction card and the sound material may be added to the scene data to be restored together, that is, the display pose data, the content introduction card, the sound material and the scene data to be restored are fused, so as to obtain AR historical scene reproduction data obtained by fusing the virtual historical article and the scene data to be restored.
Therefore, detailed information and introduction of the virtual historical object can be increased, when a user watches the recurrent scene, the user can visually see the introduction and listen to related explanation, and the user experience degree when watching the recurrent scene is improved.
According to the method for reproducing the historical scene, the virtual historical object can be combined into the historical reproduction scene, the reproduction content of the historical reproduction scene can be increased, and a user can obtain more complete, rich and real historical experience.
Referring to fig. 3, fig. 3 is a flowchart of another history scenario recurrence method according to an embodiment of the present disclosure. As shown in fig. 3, the reproducing method includes steps S301 to S304, in which:
s301, acquiring a real scene picture shot by the AR equipment; and displaying scene data to be reproduced in the real scene picture.
S302, acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model.
The descriptions of step S301 and step S302 may refer to the descriptions of step S101 and step S102, and the same technical effect may be achieved, which is not described herein again.
S303, determining a target virtual historical item in which no corresponding real historical item appears in the real scene picture in the virtual historical items displayed in the three-dimensional scene model.
In this step, after the three-dimensional scene model is obtained, in order to add a virtual historical article with a target, the virtual historical article in the three-dimensional scene model may be distinguished, for example, by matching the virtual historical article displayed in the three-dimensional scene model with the real historical article appearing in the real scene image, and determining a virtual article which does not have a corresponding real historical article in the virtual historical article and matches the real historical article as the target virtual historical article to be displayed in the recurrent historical scene.
For example, in a history museum in the 80 s or 90 s, since a television of the corresponding year is not available or not complete, the television is not shown in the corresponding real scene picture, but a virtual television matching the current year can be shown in the three-dimensional scene model, so that the virtual television can be used as a target virtual historical item to be shown.
S304, generating AR historical scene recurrence data obtained by fusing the target virtual historical article and the scene data to be recovered according to the display pose data of the target virtual historical article in the three-dimensional scene model.
In this step, after the target virtual historical item is determined, display pose data of the target virtual historical item, for example, morphological data such as a position, a direction, an angle, and the like of the target virtual historical item, may be obtained from the three-dimensional scene model, and then the display pose data of the target virtual historical item and the scene data to be reproduced are fused to obtain fused AR historical scene reproduction data, so that when a user uses an AR device, a reproduced historical scene may be obtained through the fused AR historical scene reproduction data.
The method for reproducing the historical scene, provided by the embodiment of the disclosure, can be used for combining the target virtual historical object into the historical reproduction scene in a targeted manner, can be used for increasing the reproduction content of the historical reproduction scene, and enables a user to obtain more complete, rich and real historical experience.
It will be understood by those skilled in the art that in the methods of the above embodiments of the detailed description, the writing order of the steps does not imply a strict order of execution and any limitations on the implementation should be interpreted as having a functionality and possibly inherent logic.
Based on the same inventive concept, the embodiment of the present disclosure further provides a device for displaying a scene image corresponding to the method for displaying a scene image, and since the principle of the device in the embodiment of the present disclosure for solving the problem is similar to the method for displaying a scene image in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and repeated details are not repeated.
Referring to fig. 4 to 6, fig. 4 is a first schematic structural diagram of a history scenario reproduction apparatus according to an embodiment of the present disclosure, fig. 5 is a second schematic structural diagram of a history scenario reproduction apparatus according to an embodiment of the present disclosure, and fig. 6 is a third schematic structural diagram of a history scenario reproduction apparatus according to an embodiment of the present disclosure. As illustrated in fig. 4, the replication apparatus 400 provided by the embodiment of the present disclosure includes a data obtaining module 410, a model obtaining module 420, and a data generating module 430, wherein:
a data acquisition module 410, configured to acquire a real scene picture taken by the AR device; the real scene picture shows scene data to be reproduced;
a model obtaining module 420, configured to obtain a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model;
a data generating module 430, configured to generate, according to the display pose data of the virtual historical article in the three-dimensional scene model, AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered.
In a possible implementation, as shown in fig. 5, the reproduction apparatus 400 further includes a model creation module 440, and the model creation module 440 may create the three-dimensional scene model according to the following steps:
acquiring a live-action image of the target historical scene; the live-action image comprises a plurality of two-dimensional codes;
and performing three-dimensional reconstruction on the target historical scene based on the position information of the two-dimensional codes in the live-action image and the preset real distance between the two-dimensional codes to obtain a three-dimensional scene model, and placing a virtual historical article corresponding to the target historical scene in the three-dimensional scene model.
In a possible implementation, the model obtaining module 420 is specifically configured to:
and performing attribute identification on the real scene picture based on the scene data to be repeated, and acquiring a three-dimensional scene model matched with the attribute information according to the identified attribute information.
In one possible embodiment, the attribute information includes at least one of the following information:
year, place, type of item.
In one possible implementation, as shown in fig. 6, the reproduction apparatus 400 further includes:
an item determining module 450, configured to determine, from the virtual historical items displayed in the three-dimensional scene model, a target virtual historical item for which no corresponding real historical item appears in the real scene picture;
the data generating module 430 is specifically configured to:
and generating AR historical scene reproduction data obtained by fusing the target virtual historical article and the scene data to be reproduced according to the display pose data of the target virtual historical article in the three-dimensional scene model.
In a possible implementation manner, the data generating module 430 is specifically configured to:
and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model and the content introduction card corresponding to the virtual historical article.
In a possible implementation manner, the data generating module 430 is specifically configured to:
and generating AR historical scene recurrence data after the virtual historical object and the scene data to be recovered are fused according to the display pose data of the virtual historical object in the three-dimensional scene model, the content introduction card corresponding to the virtual historical object and the sound material explaining the virtual historical object.
The description of the processing flow of each module in the device and the interaction flow between the modules may refer to the related description in the above method embodiments, and will not be described in detail here.
Corresponding to the method for reproducing the history scenario in fig. 1, an embodiment of the present disclosure further provides an electronic device 700, and as shown in fig. 7, a schematic structural diagram of the electronic device 700 provided in the embodiment of the present disclosure includes:
a processor 71, a memory 72, and a bus 73; the memory 72 is used for storing execution instructions and includes a memory 721 and an external memory 722; the memory 721 is also referred to as an internal memory, and is used for temporarily storing the operation data in the processor 71 and the data exchanged with the external memory 722 such as a hard disk, the processor 71 exchanges data with the external memory 722 through the memory 721, and when the electronic device 700 operates, the processor 71 communicates with the memory 72 through the bus 73, so that the processor 71 executes the following instructions: acquiring a real scene picture shot by AR equipment; the real scene picture shows scene data to be reproduced; acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model; and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model.
The embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the method for reproducing the historical scenario in the above method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.
The computer program product of the method for presenting a scene image according to the embodiments of the present disclosure includes a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute steps of the method for reproducing a historical scene in the above method embodiments, which may be referred to in the above method embodiments specifically, and are not described herein again.
The embodiments of the present disclosure also provide a computer program, which when executed by a processor implements any one of the methods of the foregoing embodiments. The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (10)
1. A reproduction method of a history scene, the reproduction method comprising:
acquiring a real scene picture shot by AR equipment; the real scene picture shows scene data to be reproduced;
acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model;
and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model.
2. Reproduction method according to claim 1, characterized in that the three-dimensional scene model is built according to the following steps:
acquiring a live-action image of the target historical scene; the live-action image comprises a plurality of two-dimensional codes;
and performing three-dimensional reconstruction on the target historical scene based on the position information of the two-dimensional codes in the live-action image and the preset real distance between the two-dimensional codes to obtain a three-dimensional scene model, and placing a virtual historical article corresponding to the target historical scene in the three-dimensional scene model.
3. The reproduction method according to claim 1 or 2, wherein obtaining a pre-established three-dimensional scene model corresponding to the scene data to be reproduced includes:
and performing attribute identification on the real scene picture based on the scene data to be repeated, and acquiring a three-dimensional scene model matched with the attribute information according to the identified attribute information.
4. The reproduction method according to claim 3, wherein the attribute information includes at least one of the following information:
year, place, type of item.
5. The reproduction method according to any one of claims 1 to 4, wherein after acquiring a pre-established three-dimensional scene model corresponding to the scene data to be reproduced and before generating the AR historical scene reproduction data, the reproduction method further comprises:
determining a target virtual historical item, wherein no corresponding real historical item appears in the real scene picture, in the virtual historical items displayed in the three-dimensional scene model;
generating AR historical scene reproduction data obtained by fusing the virtual historical article and the scene data to be reproduced according to the display pose data of the virtual historical article in the three-dimensional scene model, wherein the AR historical scene reproduction data comprises:
and generating AR historical scene reproduction data obtained by fusing the target virtual historical article and the scene data to be reproduced according to the display pose data of the target virtual historical article in the three-dimensional scene model.
6. The reproduction method according to any one of claims 1 to 5, wherein generating AR historical scene reproduction data obtained by fusing the virtual historical item and the scene data to be reproduced according to the display pose data of the virtual historical item in the three-dimensional scene model comprises:
and generating AR historical scene recurrence data obtained by fusing the virtual historical article and the scene data to be recovered according to the display pose data of the virtual historical article in the three-dimensional scene model and the content introduction card corresponding to the virtual historical article.
7. The reproduction method according to any one of claims 1 to 6, wherein generating AR historical scene reproduction data obtained by fusing the virtual historical item and the scene data to be reproduced according to the display pose data of the virtual historical item in the three-dimensional scene model comprises:
and generating AR historical scene recurrence data after the virtual historical object and the scene data to be recovered are fused according to the display pose data of the virtual historical object in the three-dimensional scene model, the content introduction card corresponding to the virtual historical object and the sound material explaining the virtual historical object.
8. A reproduction apparatus of a history scene, the reproduction apparatus comprising:
the data acquisition module is used for acquiring a real scene picture shot by the AR equipment; the real scene picture shows scene data to be reproduced;
the model acquisition module is used for acquiring a pre-established three-dimensional scene model corresponding to the scene data to be repeated; the three-dimensional scene model is obtained by three-dimensionally reconstructing a target historical scene; virtual historical articles are displayed in the three-dimensional scene model;
and the data generation module is used for generating AR historical scene recurrence data after the virtual historical article and the scene data to be recovered are fused according to the display pose data of the virtual historical article in the three-dimensional scene model.
9. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the method of recurring historical scenarios of any of claims 1 to 7.
10. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method of recurring historical scenes according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010515017.6A CN111640195A (en) | 2020-06-08 | 2020-06-08 | History scene reproduction method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010515017.6A CN111640195A (en) | 2020-06-08 | 2020-06-08 | History scene reproduction method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111640195A true CN111640195A (en) | 2020-09-08 |
Family
ID=72333057
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010515017.6A Pending CN111640195A (en) | 2020-06-08 | 2020-06-08 | History scene reproduction method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111640195A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112988007A (en) * | 2021-03-12 | 2021-06-18 | 深圳市慧鲤科技有限公司 | Three-dimensional material interaction method and device |
| CN113034668A (en) * | 2021-03-01 | 2021-06-25 | 中科数据(青岛)科技信息有限公司 | AR-assisted mechanical simulation operation method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106816077A (en) * | 2015-12-08 | 2017-06-09 | 张涛 | Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality |
| CN107993292A (en) * | 2017-12-19 | 2018-05-04 | 北京疯狂互动网络科技有限公司 | Augmented reality scene restored method, device and computer-readable recording medium |
| US20180349700A1 (en) * | 2017-05-30 | 2018-12-06 | Luigi Percuoco | Augmented reality smartglasses for use at cultural sites |
| CN109213834A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | A kind of guidance method and system based on augmented reality |
| CN110187774A (en) * | 2019-06-06 | 2019-08-30 | 北京悉见科技有限公司 | The AR equipment and its entity mask method of optical perspective formula |
-
2020
- 2020-06-08 CN CN202010515017.6A patent/CN111640195A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106816077A (en) * | 2015-12-08 | 2017-06-09 | 张涛 | Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality |
| US20180349700A1 (en) * | 2017-05-30 | 2018-12-06 | Luigi Percuoco | Augmented reality smartglasses for use at cultural sites |
| CN109213834A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | A kind of guidance method and system based on augmented reality |
| CN107993292A (en) * | 2017-12-19 | 2018-05-04 | 北京疯狂互动网络科技有限公司 | Augmented reality scene restored method, device and computer-readable recording medium |
| CN110187774A (en) * | 2019-06-06 | 2019-08-30 | 北京悉见科技有限公司 | The AR equipment and its entity mask method of optical perspective formula |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113034668A (en) * | 2021-03-01 | 2021-06-25 | 中科数据(青岛)科技信息有限公司 | AR-assisted mechanical simulation operation method and system |
| CN113034668B (en) * | 2021-03-01 | 2023-04-07 | 中科数据(青岛)科技信息有限公司 | AR-assisted mechanical simulation operation method and system |
| CN112988007A (en) * | 2021-03-12 | 2021-06-18 | 深圳市慧鲤科技有限公司 | Three-dimensional material interaction method and device |
| CN112988007B (en) * | 2021-03-12 | 2022-09-09 | 深圳市慧鲤科技有限公司 | Three-dimensional material interaction method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111638793B (en) | Display method and device of aircraft, electronic equipment and storage medium | |
| CN109636919B (en) | Holographic technology-based virtual exhibition hall construction method, system and storage medium | |
| CN112348969A (en) | Display method and device in augmented reality scene, electronic equipment and storage medium | |
| CN111679742A (en) | Interaction control method and device based on AR, electronic equipment and storage medium | |
| CN112148197A (en) | Augmented reality AR interaction method and device, electronic equipment and storage medium | |
| JP2022505998A (en) | Augmented reality data presentation methods, devices, electronic devices and storage media | |
| CN111651057A (en) | Data display method and device, electronic equipment and storage medium | |
| CN105955455A (en) | Device and method for adding object in virtual scene | |
| CN112348968B (en) | Display method and device in augmented reality scene, electronic equipment and storage medium | |
| CN111653175B (en) | Virtual sand table display method and device | |
| CN111651051A (en) | Virtual sand table display method and device | |
| CN111696215A (en) | Image processing method, device and equipment | |
| CN111882674A (en) | Virtual object adjusting method and device, electronic equipment and storage medium | |
| CN111640195A (en) | History scene reproduction method and device, electronic equipment and storage medium | |
| CN111640184A (en) | Ancient building reproduction method, ancient building reproduction device, electronic equipment and storage medium | |
| CN111625100A (en) | Method and device for presenting picture content, computer equipment and storage medium | |
| CN111651058A (en) | Historical scene control display method and device, electronic equipment and storage medium | |
| CN112882576A (en) | AR interaction method and device, electronic equipment and storage medium | |
| CN112905014A (en) | Interaction method and device in AR scene, electronic equipment and storage medium | |
| CN114153548A (en) | Display method and device, computer equipment and storage medium | |
| CN111651055A (en) | City virtual sand table display method and device, computer equipment and storage medium | |
| CN111639613A (en) | Augmented reality AR special effect generation method and device and electronic equipment | |
| CN111599292A (en) | Historical scene presenting method and device, electronic equipment and storage medium | |
| CN113178017A (en) | AR data display method and device, electronic equipment and storage medium | |
| CN111580679A (en) | Space capsule display method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |