CN111640171B - Historical scene explanation method and device, electronic equipment and storage medium - Google Patents
Historical scene explanation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111640171B CN111640171B CN202010525275.2A CN202010525275A CN111640171B CN 111640171 B CN111640171 B CN 111640171B CN 202010525275 A CN202010525275 A CN 202010525275A CN 111640171 B CN111640171 B CN 111640171B
- Authority
- CN
- China
- Prior art keywords
- scene
- historical
- content
- virtual tour
- tour guide
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 239000000463 material Substances 0.000 claims abstract description 19
- 230000000694 effects Effects 0.000 claims abstract description 16
- 238000004590 computer program Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 5
- 239000008492 tangshen Substances 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000006467 substitution reaction Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000002040 relaxant effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/14—Travel agencies
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Tourism & Hospitality (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides a method, a device, electronic equipment and a storage medium for explaining a historical scene, wherein a real scene picture shot by a user through AR equipment is obtained, and historical scene content is displayed in the real scene picture; acquiring image data and explanation data of a virtual tour guide matched with the real scene picture; and controlling the AR equipment to play the AR special effect content of the virtual tour guide for explaining the historical scene content based on the image data and the explanation data of the virtual tour guide. Therefore, labor cost can be saved, consumption of manpower and material resources for explanation of historical content can be effectively reduced, the explanation content is more accurate, and one-to-one matching of users and virtual tour guides can be realized.
Description
Technical Field
The disclosure relates to the technical field of AR, and in particular, to a method and device for explaining a history scene, an electronic device and a storage medium.
Background
With the progress of the age and the development of technology, the physical living standard of people is greatly improved, mental life becomes a bigger pursuit of people, more and more people are interested in history culture, more and more people choose to go through various history scenic spots or history exhibition halls as a growing and smelling and relaxing way, and most people choose to follow the tour guide in the scenic spots, visit and listen to the explanation at the same time for better improving browsing efficiency and better familiarity with history scene content.
At present, along with the increase of the number of people going out, each historical sight spot and exhibition hall need be equipped with a large number of mature guides, but the mature guides are fewer, and the manpower cost is high, so that the tour requirement of users can not be met.
Disclosure of Invention
The embodiment of the disclosure at least provides a method for explaining a historical scene.
In a first aspect, an embodiment of the present disclosure provides an explanation method for a history scenario, where the explanation method includes:
acquiring a real scene picture shot by a user through AR equipment, wherein the real scene picture is provided with historical scene content;
acquiring image data and explanation data of a virtual tour guide matched with the real scene picture;
and controlling the AR equipment to play the AR special effect content of the virtual tour guide for explaining the historical scene content based on the image data and the explanation data of the virtual tour guide.
In the embodiment of the disclosure, the historical scene content is explained through the virtual tour guide, so that the labor cost can be saved, the consumption of manpower and material resources for the explanation of the historical content is effectively reduced, the explanation content is more accurate, and one-to-one matching of the user and the virtual tour guide can be realized.
In one possible implementation, the image data of the virtual tour matched to the real scene picture is determined by:
identifying scene attribute features corresponding to the real scene picture;
and selecting the image data of the virtual tour guide matched with the scene attribute features based on the scene attribute features.
In the embodiment of the disclosure, the corresponding virtual tour guide is matched based on the scene attribute characteristics of the real scene picture, so that the substitution sense of the user when listening and speaking is improved.
In one possible implementation, the scene attribute features include a year, and/or a type of item in the historical scene.
In one possible implementation, the interpretation data of the virtual tour that matches the real scene picture is determined by:
and acquiring the history materials aiming at the history scene content, and taking the history materials as the explanation data of the virtual tour guide.
In a possible implementation manner, in a case that a plurality of history scene contents are displayed in a real scene corresponding to the real scene picture, based on the image data and the explanation data of the virtual tour guide, the AR device is controlled to play the AR special effect content of the virtual tour guide for explaining the history scene contents, including:
based on the image data and the explanation data of the virtual tour guide, the AR equipment is controlled to play the virtual tour guide to walk to the display position corresponding to each historical scene content, and the AR special effect content for explaining the historical scene content is controlled.
According to the embodiment of the disclosure, the plurality of historical scene contents are sequentially taught at the corresponding positions through the virtual tour guide, so that the user can complete tour of different historical scene contents, meanwhile, the virtual tour guide can be effectively taught, the tour key points of the user can be effectively guided, and the accuracy and the completeness of the user tour are improved.
In a possible implementation manner, based on the image data and the explanation data of the virtual tour guide, the AR device is controlled to play the virtual tour guide to walk to a display position corresponding to each historical scene content, and the AR special effect content for explaining the historical scene content includes:
aiming at each historical scene content displayed in a real scene corresponding to the real scene picture, acquiring a display position corresponding to the historical scene content and explanation data corresponding to the historical scene content;
planning a walking route of the virtual tour guide according to the display position corresponding to each historical scene content;
based on the image data of the virtual tour guide, controlling the virtual tour guide to travel to a display position corresponding to each historical scene content according to the travel route in the AR equipment, explaining the explanation content represented by the explanation data corresponding to the historical scene content, and controlling the mouth shape change of the virtual tour guide in the process of playing the explanation data.
In one possible implementation manner, the planning the walking route of the virtual tour guide according to the display position corresponding to each historical scene content includes:
when the AR equipment starts to shoot a real scene, displaying historical scene content at the center position of a shot real scene picture;
and taking the historical scene content as a starting point of a navigation route, and planning a walking route of the virtual tour guide.
In a second aspect, an embodiment of the present disclosure further provides an explanation device for a history scenario, where the explanation device includes:
the scene acquisition module is used for acquiring a real scene picture shot by a user through the AR equipment, wherein the real scene picture is provided with historical scene content;
the data acquisition module is used for acquiring image data and explanation data of the virtual tour guide matched with the real scene picture;
and the explanation playing module is used for controlling the AR equipment to play the AR special effect content of the virtual tour guide for explaining the historical scene content based on the image data and the explanation data of the virtual tour guide.
In one possible embodiment, the explanation device further includes an avatar data determining module for determining avatar data of a virtual tour matched with the real scene picture by:
identifying scene attribute features corresponding to the real scene picture;
and selecting the image data of the virtual tour guide matched with the scene attribute features based on the scene attribute features.
In one possible implementation, the scene attribute features include a year, and/or a type of item in the historical scene.
In one possible embodiment, the explanation device further includes an explanation data determining module, and the image data determining module is configured to determine explanation data of a virtual tour guide matched with the real scene picture by:
and acquiring the history materials aiming at the history scene content, and taking the history materials as the explanation data of the virtual tour guide.
In a possible implementation manner, in a case that the real scene corresponding to the real scene picture has a plurality of displayed historical scene contents, the explanation playing module is specifically configured to:
based on the image data and the explanation data of the virtual tour guide, the AR equipment is controlled to play the virtual tour guide to walk to the display position corresponding to each historical scene content, and the AR special effect content for explaining the historical scene content is controlled.
In one possible implementation manner, the explanation playing module is specifically configured to:
aiming at each historical scene content displayed in a real scene corresponding to the real scene picture, acquiring a display position corresponding to the historical scene content and explanation data corresponding to the historical scene content;
planning a walking route of the virtual tour guide according to the display position corresponding to each historical scene content;
based on the image data of the virtual tour guide, controlling the virtual tour guide to travel to a display position corresponding to each historical scene content according to the travel route in the AR equipment, explaining the explanation content represented by the explanation data corresponding to the historical scene content, and controlling the mouth shape change of the virtual tour guide in the process of playing the explanation data.
In one possible implementation manner, the explanation playing module is specifically configured to:
when the AR equipment starts to shoot a real scene, displaying historical scene content at the center position of a shot real scene picture;
and taking the historical scene content as a starting point of a navigation route, and planning a walking route of the virtual tour guide.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor in communication with the memory via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the method of interpreting historical scenarios as described in the first aspect.
In a fourth aspect, embodiments of the present disclosure provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method for interpreting historical scenarios as described in the first aspect.
According to the explanation method, the explanation device, the electronic equipment and the storage medium of the historical scene, the real scene picture shot by the user through the AR equipment is obtained, and the historical scene content is displayed in the real scene picture; acquiring image data and explanation data of a virtual tour guide matched with the real scene picture; and controlling the AR equipment to play the AR special effect content of the virtual tour guide for explaining the historical scene content based on the image data and the explanation data of the virtual tour guide. Therefore, by configuring the virtual tour guide in the AR scene to explain the historical scene content, the labor cost can be saved, the consumption of manpower and material resources for the explanation of the historical content can be effectively reduced, the explanation content is more accurate, and one-to-one matching of the user and the virtual tour guide can be realized.
The foregoing objects, features and advantages of the disclosure will be more readily apparent from the following detailed description of the preferred embodiments taken in conjunction with the accompanying drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for the embodiments are briefly described below, which are incorporated in and constitute a part of the specification, these drawings showing embodiments consistent with the present disclosure and together with the description serve to illustrate the technical solutions of the present disclosure. It is to be understood that the following drawings illustrate only certain embodiments of the present disclosure and are therefore not to be considered limiting of its scope, for the person of ordinary skill in the art may admit to other equally relevant drawings without inventive effort.
FIG. 1 is a flow chart of a method of explanation of a historical scenario provided by an embodiment of the present disclosure;
FIG. 2 is a flow chart illustrating a virtual tour guide according to an embodiment of the present disclosure for a plurality of historical scene content;
fig. 3 is a schematic structural diagram of an explanation device for a history scenario according to an embodiment of the present disclosure;
fig. 4 is a second schematic structural diagram of an explanation device for a history scenario according to an embodiment of the present disclosure;
fig. 5 is a schematic diagram of an electronic device according to an embodiment of the disclosure.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. The components of the embodiments of the present disclosure, which are generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure provided in the accompanying drawings is not intended to limit the scope of the disclosure, as claimed, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be made by those skilled in the art based on the embodiments of this disclosure without making any inventive effort, are intended to be within the scope of this disclosure.
According to research, when people choose to go to various historical attractions or historical exhibition halls and go out as a way of growing, smelling and relaxing, most people choose to follow the tour in the attractions for visiting in order to better understand, experience and blend into the history, so that a large number of mature tour guides are required to be equipped for each historical attraction and exhibition hall, but the number of mature tour guides is small, the labor cost is high, and the user requirements cannot be met.
Based on the above study, the disclosure provides a method for explaining a history scene, which is to configure a virtual tour guide in an AR scene to explain the content of the history scene, so that not only can the labor cost be saved and the consumption of manpower and material resources for explaining the history content be effectively reduced, but also the explanation content is more accurate, and one-to-one matching between a user and the virtual tour guide can be realized.
For the sake of understanding the present embodiment, first, a description of a method for explaining a history scenario disclosed in the present embodiment will be described in detail, an execution subject of the method for explaining a history scenario provided in the present embodiment may be a computer device with a certain computing capability, specifically may be a terminal device, a server or other processing devices, and the server may be a server connected to an AR device, where the AR device may include, for example, devices with a display function and a data processing capability, such as AR glasses, a tablet computer, a smart phone, and an intelligent wearable device, and the AR device may be connected to the server through an application program. Without limitation in the embodiments of the present disclosure, in some possible implementations, the method of interpreting the historical scene may be implemented by a processor invoking computer readable instructions stored in a memory.
Referring to fig. 1, fig. 1 is a flowchart of an explanation method of a history scenario according to an embodiment of the disclosure. As shown in fig. 1, the explanation method includes steps S101 to S103, in which:
s101, acquiring a real scene picture shot by a user through AR equipment, wherein historical scene content is displayed in the real scene picture.
In the step, when a user visits a scenic spot or a exhibition hall, and visits a certain historical place or an environment with historical articles displayed, the AR equipment can be used for shooting a real scene, and at the moment, a real scene picture with historical scene contents displayed can be obtained.
For example, when a user visits a historic museum and the like and sees a guqin, and at this time, when the user wants to learn more information, he/she can use the AR device to shoot the guqin and the surrounding scenes to obtain a real scene picture, and the real scene picture includes the historic scene content showing the guqin.
S102, acquiring image data and explanation data of the virtual tour guide matched with the real scene picture.
In this step, after the real scene picture is obtained, virtual data matched with the real scene (the real scene with the history scene content is shown) can be obtained through the real scene to which the real scene picture belongs, wherein the virtual data comprises a virtual tour guide, and specifically, the image data and the explanation data of the virtual tour guide are obtained. The explanation data may be data including explanation for the historical scene content.
In specific implementation, a three-dimensional scene model matched with a real scene presented by a real scene picture can be determined from three-dimensional scene models (obtained by performing three-dimensional reconstruction after performing omnibearing shooting on the real scene) of various real scenes, and virtual data stored corresponding to the three-dimensional scene model can be acquired, wherein the virtual data comprises image data of virtual tour guides for explaining displayed historical scene contents and explanation data corresponding to each historical scene content.
Here, the pose data of the AR device (based on visual localization) may be determined in combination with the real scene picture photographed by the AR device and the three-dimensional scene model, and the AR scene picture to be presented in the AR device may be determined based on the pose data of the AR device; the AR scene includes virtual data incorporated into the real scene in addition to the real history scene content in the real scene, including the image data of the virtual tour guide (in addition to the above, there may be some virtual history objects, etc.).
For the real scene or based on the three-dimensional scene model, multiple guides can be provided, for example, guides with different ages, sexes, listening hobbies and the like of the user are respectively set, guides with different sexes and different explanation styles can be provided according to historical scenes with different attribute characteristics, multiple types of guides can be provided according to historical scenes with different attribute characteristics, and then corresponding virtual guides can be selected according to the actual situation of the user, for example, virtual guides with cartoon styles can be preferentially selected for children.
Specifically, in one possible embodiment, the image data of the virtual tour guide matched with the real scene picture may be determined by:
identifying scene attribute features corresponding to the real scene picture; and selecting the image data of the virtual tour guide matched with the scene attribute features based on the scene attribute features.
In this step, the image data of the virtual tour matched with the scene attribute features can be matched for the user through the scene attribute features of the real scene picture.
Wherein the scene attribute features include a year, and/or an item type in the historical scene.
For example, if the historical scene content displayed in the real scene picture is a weapon of tangshen, the scene attribute feature of the real scene picture can be identified from the real scene picture as tangshen, and the object type of the weapon, that is, the historical information related to tangshen and tangshen needs to be explained, at this time, in order to give the user better substitution sense and experience sense, virtual guide of the character of tangshen can be matched for the user to conduct explanation, that is, the image data of the virtual guide is mainly based on the data related to tangshen, for example, the virtual guide can be made to watch the tangshen clothing, and even the weapon armor of tangshen can be used for conducting explanation.
Specifically, in one possible embodiment, the explanation data of the virtual tour guide matched with the real scene picture may be determined by:
and acquiring the history materials aiming at the history scene content, and taking the history materials as the explanation data of the virtual tour guide.
In the step, the history materials aiming at the history scene content can be matched for the user through the history scene content displayed by the real scene picture, and even the history materials of the history content related to the history scene content can be used as the explanation data of the virtual tour guide.
For example, if the historical scene content displayed in the real scene picture is a bazaar scene in a city of tangsheng, then the historical content related to the tangsheng bazaar can be used as the historical materials to be explained, and thus the data related to the historical materials can be used as the explanation data of the virtual tour guide.
And S103, based on the image data and the explanation data of the virtual tour guide, controlling the AR equipment to play the AR special effect content of the virtual tour guide for explaining the historical scene content.
In this step, based on the obtained image data and explanation data, a virtual tour guide corresponding to the image data may be played in the AR device, and an AR screen for explaining the historical scene content using the explanation data in the historical scene.
In the embodiment of the disclosure, the historical scene content is explained through the virtual tour guide, so that the labor cost can be saved, the consumption of manpower and material resources for the explanation of the historical content is effectively reduced, the explanation content is more accurate, and one-to-one matching of the user and the virtual tour guide can be realized.
The above-described S101 to S103 will be explained below with reference to specific embodiments.
For the content explained in S103, when there are a plurality of history scene contents displayed in the real scene corresponding to the real scene picture, the history scene contents may be explained in the following manner:
based on the image data and the explanation data of the virtual tour guide, the AR equipment is controlled to play the virtual tour guide to walk to the display position corresponding to each historical scene content, and the AR special effect content for explaining the historical scene content is controlled.
In this way, the plurality of historical scene contents displayed on the real scene picture can be played through the AR device, then when the plurality of historical scene contents are displayed, the virtual guide corresponding to the image data can be displayed, and the virtual guide can be controlled to sequentially travel to the display position corresponding to each historical scene content, so that the corresponding historical scene contents are explained.
The order of the virtual tour guide walking to the display position corresponding to each historical scene content can be arranged according to at least one of the importance degree, the reputation degree, the distance degree and the like of each historical scene content.
Specifically, referring to fig. 2, fig. 2 is a flowchart illustrating a plurality of historical scene contents by a virtual tour guide according to an embodiment of the present disclosure when the plurality of historical scene contents are displayed in a real scene corresponding to the real scene frame. As shown in fig. 2, in a possible embodiment, in a case where there are a plurality of history scene contents that are shown in the real scene corresponding to the real scene picture, for the above step S103, explanation may be made by:
s201, aiming at each historical scene content displayed in a real scene corresponding to the real scene picture, acquiring a display position corresponding to the historical scene content and explanation data corresponding to the historical scene content.
In this step, in the case where a plurality of history scene contents are presented in the real scene picture, each history scene content presented in the real scene can be identified from the real scene picture, then a presentation position corresponding to each history scene content is determined, and interpretation data corresponding to each history scene content can be acquired.
The display position corresponding to each historical scene content may be different with respect to the position where the historical scene content is located, for example, the display position of the historical scene content may be located at the left side of the historical scene content, and the display position of some historical scene content may be located at the right side, the upper side, or the upper left side of the historical scene content, etc., specifically, may be continuously arranged according to the content presented by the historical scene content being different, the occupied area, the shape of the area in the real scene picture, etc.
S202, planning a walking route of the virtual tour guide according to the display position corresponding to each historical scene content.
In the step, after the display position corresponding to each historical scene content is determined, the walking route of the virtual tour guide can be planned according to the difference of each display position.
The planned walking route may be the shortest or the longest walking route, or may be planned according to a certain route shape.
The real scene picture is displayed with three historical scene contents, namely a historical scene 1, a historical scene 2 and a historical scene 3, and correspondingly comprises a display position 1, a display position 2 and a display position 3 respectively, when a route is planned, the route can be planned according to the rule of shortest route, if the virtual tour guide is from the display position 1 to the display position 3, and the route formed from the virtual tour guide to the display position 2 is shortest, the route formed from the display position 1, the display position 3 and the display position 2 can be sequentially used as the walking route of the virtual tour guide.
And S203, controlling the virtual tour guide to travel to a display position corresponding to each historical scene content according to the travel route based on the image data of the virtual tour guide, explaining the explanation content represented by the explanation data corresponding to the historical scene content, and controlling the mouth shape change of the virtual tour guide in the process of playing the explanation data.
In the step, after the walking route is planned, the virtual tour guide corresponding to the image data can be displayed in the AR equipment, the virtual tour guide is controlled to walk to the display position of each historical scene content in sequence according to the walking route to conduct explanation according to the content corresponding to the explanation data, and meanwhile, the mouth shape change of the virtual tour guide in the process of playing the explanation data can be controlled, so that the authenticity of the explanation of the virtual tour guide is guaranteed.
Further, in a possible implementation manner, for step S202, the walking route of the virtual tour guide may be determined by:
when the AR equipment starts to shoot a real scene, displaying historical scene content at the center position of a shot real scene picture; and taking the historical scene content as a starting point of a navigation route, and planning a walking route of the virtual tour guide.
In this step, when a plurality of historical scene contents are presented in the real scene picture, it may be determined that the user starts to shoot the real scene using the AR device from the shot real scene picture, and then the historical scene contents at the central position in the real scene picture may be used as a starting point of a navigation route, and other preset historical scene contents may be used as an end point of the navigation route, so as to plan a walking route.
It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.
Based on the same inventive concept, the embodiment of the disclosure further provides an explanation device for a history scenario corresponding to the explanation method for the history scenario, and since the principle of solving the problem by the device in the embodiment of the disclosure is similar to that of the method in the embodiment of the disclosure, the implementation of the explanation device can refer to the implementation of the explanation method, and the repetition is omitted.
Referring to fig. 3 and fig. 4, fig. 3 is a schematic structural diagram of an explanation device for a history scenario according to an embodiment of the disclosure, and fig. 4 is a second schematic structural diagram of an explanation device for a history scenario according to an embodiment of the disclosure. As shown in fig. 3, the explanation device 300 provided in the embodiment of the present disclosure includes a scene acquisition module 310, a data acquisition module 320, and an explanation playing module 330, where:
a scene acquisition module 310, configured to acquire a real scene picture shot by a user through an AR device, where the real scene picture has historical scene content displayed therein;
the data acquisition module 320 is configured to acquire image data and explanation data of a virtual tour guide matched with the real scene picture;
and the explanation playing module 330 is configured to control the AR device to play the AR special effect content of the virtual tour guide for explaining the historical scene content based on the image data and the explanation data of the virtual tour guide.
In one possible embodiment, as shown in fig. 4, the explanation device 300 further includes a character data determining module 340, and the character data determining module 340 is configured to determine character data of the virtual tour guide matched with the real scene picture by:
identifying scene attribute features corresponding to the real scene picture;
and selecting the image data of the virtual tour guide matched with the scene attribute features based on the scene attribute features.
In one possible implementation, the scene attribute features include a year, and/or a type of item in the historical scene.
In one possible implementation, as shown in fig. 4, the explanation device 300 further includes an explanation data determining module 350, where the explanation data determining module 350 is configured to determine explanation data of a virtual tour guide matching the real scene frame by:
and acquiring the history materials aiming at the history scene content, and taking the history materials as the explanation data of the virtual tour guide.
In one possible implementation manner, in a case that the real scene corresponding to the real scene picture has a plurality of history scene contents displayed, the explanation playing module 330 is specifically configured to:
based on the image data and the explanation data of the virtual tour guide, the AR equipment is controlled to play the virtual tour guide to walk to the display position corresponding to each historical scene content, and the AR special effect content for explaining the historical scene content is controlled.
According to the embodiment of the disclosure, the plurality of historical scene contents are sequentially taught at the corresponding positions through the virtual tour guide, so that the user can complete tour of different historical scene contents, meanwhile, the virtual tour guide can be effectively taught, the tour key points of the user can be effectively guided, and the accuracy and the completeness of the user tour are improved.
In one possible implementation, the explanation playing module 330 is specifically configured to:
aiming at each historical scene content displayed in a real scene corresponding to the real scene picture, acquiring a display position corresponding to the historical scene content and explanation data corresponding to the historical scene content;
planning a walking route of the virtual tour guide according to the display position corresponding to each historical scene content;
based on the image data of the virtual tour guide, controlling the virtual tour guide to travel to a display position corresponding to each historical scene content according to the travel route in the AR equipment, explaining the explanation content represented by the explanation data corresponding to the historical scene content, and controlling the mouth shape change of the virtual tour guide in the process of playing the explanation data.
In one possible implementation, the explanation playing module 330 is specifically configured to:
when the AR equipment starts to shoot a real scene, displaying historical scene content at the center position of a shot real scene picture;
and taking the historical scene content as a starting point of a navigation route, and planning a walking route of the virtual tour guide.
The process flow of each module in the apparatus and the interaction flow between the modules may be described with reference to the related descriptions in the above method embodiments, which are not described in detail herein.
The embodiment of the present disclosure further provides an electronic device 500 corresponding to the explanation method of the history scenario in fig. 1, as shown in fig. 5, which is a schematic structural diagram of the electronic device 500 provided in the embodiment of the present disclosure, including:
a processor 51, a memory 52, and a bus 53; memory 52 is used to store execution instructions, including memory 521 and external storage 522; the memory 521 is also referred to as an internal memory, and is used for temporarily storing operation data in the processor 51 and data exchanged with the external memory 522 such as a hard disk, and the processor 51 exchanges data with the external memory 522 through the memory 521, and when the electronic device 500 is operated, the processor 51 and the memory 52 communicate with each other through the bus 53, so that the processor 51 executes the following instructions: acquiring a real scene picture shot by a user through AR equipment, wherein the real scene picture is provided with historical scene content; acquiring image data and explanation data of a virtual tour guide matched with the real scene picture; and controlling the AR equipment to play the AR special effect content of the virtual tour guide for explaining the historical scene content based on the image data and the explanation data of the virtual tour guide.
The disclosed embodiments also provide a computer readable storage medium having a computer program stored thereon, which when executed by a processor performs the steps of the method for interpreting historical scenarios described in the method embodiments above. Wherein the storage medium may be a volatile or nonvolatile computer readable storage medium.
The computer program product of the scene image display method provided in the embodiments of the present disclosure includes a computer readable storage medium storing program codes, where the program codes include instructions for executing the steps of the method for explaining the history scene described in the above method embodiments, and the specific reference may be made to the above method embodiments, which are not repeated herein.
The disclosed embodiments also provide a computer program which, when executed by a processor, implements any of the methods of the previous embodiments. The computer program product may be realized in particular by means of hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied as a computer storage medium, and in another alternative embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), or the like.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described system and apparatus may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. The above-described apparatus embodiments are merely illustrative, for example, the division of the units is merely a logical function division, and there may be other manners of division in actual implementation, and for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some communication interface, device or unit indirect coupling or communication connection, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present disclosure may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in essence or a part contributing to the prior art or a part of the technical solution, or in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present disclosure. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Finally, it should be noted that: the foregoing examples are merely specific embodiments of the present disclosure, and are not intended to limit the scope of the disclosure, but the present disclosure is not limited thereto, and those skilled in the art will appreciate that while the foregoing examples are described in detail, it is not limited to the disclosure: any person skilled in the art, within the technical scope of the disclosure of the present disclosure, may modify or easily conceive changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features thereof; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the disclosure, and are intended to be included within the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (8)
1. A method for teaching historical scenes, comprising:
acquiring a real scene picture shot by a user through AR equipment, wherein the real scene picture is provided with historical scene content;
acquiring image data and explanation data of a virtual tour guide matched with the real scene picture;
based on the image data and the explanation data of the virtual tour guide, the AR equipment is controlled to play AR special effect content of the virtual tour guide for explaining the historical scene content;
under the condition that a plurality of history scene contents are displayed in a real scene corresponding to the real scene picture, based on the image data and the explanation data of the virtual tour guide, the AR equipment is controlled to play the AR special effect contents of the virtual tour guide for explaining the history scene contents, and the method comprises the following steps:
aiming at each historical scene content displayed in a real scene corresponding to the real scene picture, acquiring a display position corresponding to the historical scene content and explanation data corresponding to the historical scene content;
planning a walking route of the virtual tour guide according to the display position corresponding to each historical scene content;
based on the image data of the virtual tour guide, controlling the virtual tour guide to travel to a display position corresponding to each historical scene content according to the travel route in the AR equipment, explaining the explanation content represented by the explanation data corresponding to the historical scene content, and controlling the mouth shape change of the virtual tour guide in the process of playing the explanation data.
2. The method of claim 1, wherein the avatar data of the virtual tour that matches the real scene is determined by:
identifying scene attribute features corresponding to the real scene picture;
and selecting the image data of the virtual tour guide matched with the scene attribute features based on the scene attribute features.
3. The method of claim 2, wherein the scene attribute features include a year, and/or a type of item in the historical scene.
4. A method of teaching according to any of claims 1-3 and characterized in that the virtual tour guide's interpretation data matching the real scene picture is determined by:
and acquiring the history materials aiming at the history scene content, and taking the history materials as the explanation data of the virtual tour guide.
5. The method of claim 1, wherein planning the travel route of the virtual tour guide according to the presentation position corresponding to each historical scene content comprises:
when the AR equipment starts to shoot a real scene, displaying historical scene content at the center position of a shot real scene picture;
and taking the historical scene content as a starting point of a navigation route, and planning a walking route of the virtual tour guide.
6. An explanation device for a history scene, comprising:
the scene acquisition module is used for acquiring a real scene picture shot by a user through the AR equipment, wherein the real scene picture is provided with historical scene content;
the data acquisition module is used for acquiring image data and explanation data of the virtual tour guide matched with the real scene picture;
the explanation playing module is used for controlling the AR equipment to play the AR special effect content of the virtual tour guide for explaining the historical scene content based on the image data and the explanation data of the virtual tour guide;
under the condition that a plurality of history scene contents are displayed in a real scene corresponding to the real scene picture, the explanation playing module is specifically used for:
aiming at each historical scene content displayed in a real scene corresponding to the real scene picture, acquiring a display position corresponding to the historical scene content and explanation data corresponding to the historical scene content;
planning a walking route of the virtual tour guide according to the display position corresponding to each historical scene content;
based on the image data of the virtual tour guide, controlling the virtual tour guide to travel to a display position corresponding to each historical scene content according to the travel route in the AR equipment, explaining the explanation content represented by the explanation data corresponding to the historical scene content, and controlling the mouth shape change of the virtual tour guide in the process of playing the explanation data.
7. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory in communication over the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the method of interpreting historical scenarios of any one of claims 1 to 5.
8. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, performs the steps of the method of interpreting historical scenes according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010525275.2A CN111640171B (en) | 2020-06-10 | 2020-06-10 | Historical scene explanation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010525275.2A CN111640171B (en) | 2020-06-10 | 2020-06-10 | Historical scene explanation method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111640171A CN111640171A (en) | 2020-09-08 |
| CN111640171B true CN111640171B (en) | 2023-09-01 |
Family
ID=72333128
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010525275.2A Active CN111640171B (en) | 2020-06-10 | 2020-06-10 | Historical scene explanation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111640171B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112987921B (en) * | 2021-02-19 | 2024-03-15 | 车智互联（北京）科技有限公司 | VR scene explanation scheme generation method |
| CN113359983A (en) * | 2021-06-03 | 2021-09-07 | 北京市商汤科技开发有限公司 | Augmented reality data presentation method and device, electronic equipment and storage medium |
| CN113359986B (en) * | 2021-06-03 | 2023-06-20 | 北京市商汤科技开发有限公司 | Augmented reality data display method and device, electronic equipment and storage medium |
| CN113359984A (en) * | 2021-06-03 | 2021-09-07 | 北京市商汤科技开发有限公司 | Bottle special effect presenting method and device, computer equipment and storage medium |
| CN113345108B (en) * | 2021-06-25 | 2023-10-20 | 北京市商汤科技开发有限公司 | Augmented reality data display method and device, electronic equipment and storage medium |
| CN113345107A (en) * | 2021-06-25 | 2021-09-03 | 北京市商汤科技开发有限公司 | Augmented reality data display method and device, electronic equipment and storage medium |
| CN113362474A (en) * | 2021-06-28 | 2021-09-07 | 北京市商汤科技开发有限公司 | Augmented reality data display method and device, electronic equipment and storage medium |
| CN113568504B (en) * | 2021-07-22 | 2024-08-16 | 深圳市赫拉新能源有限责任公司 | AR display processing method and system based on mobile equipment |
| CN114578958B (en) * | 2021-08-30 | 2024-07-02 | 北京航空航天大学 | Method for calculating real-time optimized position of virtual tour guide based on virtual scene and user semantic information |
| CN114511671A (en) * | 2022-01-06 | 2022-05-17 | 安徽淘云科技股份有限公司 | Exhibit display method, guide method, device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107281752A (en) * | 2017-06-16 | 2017-10-24 | 苏州蜗牛数字科技股份有限公司 | It is a kind of that the method that intelligent virtual is conducted a sightseeing tour is set in VR game |
| CN109065055A (en) * | 2018-09-13 | 2018-12-21 | 三星电子（中国）研发中心 | Method, storage medium and the device of AR content are generated based on sound |
| CN109885778A (en) * | 2018-12-27 | 2019-06-14 | 福建农林大学 | A kind of tourism guide to visitors application method and system based on augmented reality |
| CN109917918A (en) * | 2019-03-07 | 2019-06-21 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment based on augmented reality |
| CN110689623A (en) * | 2019-08-20 | 2020-01-14 | 重庆特斯联智慧科技股份有限公司 | Tourist guide system and method based on augmented reality display |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9286711B2 (en) * | 2011-09-30 | 2016-03-15 | Microsoft Technology Licensing, Llc | Representing a location at a previous time period using an augmented reality display |
| US9310955B2 (en) * | 2012-04-11 | 2016-04-12 | Myriata, Inc. | System and method for generating a virtual tour within a virtual environment |
-
2020
- 2020-06-10 CN CN202010525275.2A patent/CN111640171B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107281752A (en) * | 2017-06-16 | 2017-10-24 | 苏州蜗牛数字科技股份有限公司 | It is a kind of that the method that intelligent virtual is conducted a sightseeing tour is set in VR game |
| CN109065055A (en) * | 2018-09-13 | 2018-12-21 | 三星电子（中国）研发中心 | Method, storage medium and the device of AR content are generated based on sound |
| CN109885778A (en) * | 2018-12-27 | 2019-06-14 | 福建农林大学 | A kind of tourism guide to visitors application method and system based on augmented reality |
| CN109917918A (en) * | 2019-03-07 | 2019-06-21 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment based on augmented reality |
| CN110689623A (en) * | 2019-08-20 | 2020-01-14 | 重庆特斯联智慧科技股份有限公司 | Tourist guide system and method based on augmented reality display |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111640171A (en) | 2020-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111640171B (en) | Historical scene explanation method and device, electronic equipment and storage medium | |
| KR102417645B1 (en) | AR scene image processing method, device, electronic device and storage medium | |
| Papagiannakis et al. | Mixed reality, gamified presence, and storytelling for virtual museums | |
| Marr | Extended reality in practice: 100+ amazing ways virtual, augmented and mixed reality are changing business and society | |
| CN111640202B (en) | AR scene special effect generation method and device | |
| CN104937641A (en) | Information processing device, terminal device, information processing method, and programme | |
| CN103971401A (en) | Information Processing Device, Terminal Device, Information Processing Method, And Programme | |
| KR20150126938A (en) | System and method for augmented and virtual reality | |
| Hjorth | Mobile art: Rethinking intersections between art, user created content (UCC), and the quotidian | |
| CN111652987A (en) | Method and device for generating AR group photo image | |
| CN114332374A (en) | Virtual display method, equipment and storage medium | |
| WO2018000608A1 (en) | Method for sharing panoramic image in virtual reality system, and electronic device | |
| JP7150894B2 (en) | AR scene image processing method and device, electronic device and storage medium | |
| CN111581547B (en) | Tour information pushing method and device, electronic equipment and storage medium | |
| CN111651058A (en) | Historical scene control display method and device, electronic equipment and storage medium | |
| CN114153548A (en) | Display method and device, computer equipment and storage medium | |
| JP7550456B2 (en) | Information processing system, information processing method, and information processing program | |
| CN113362474A (en) | Augmented reality data display method and device, electronic equipment and storage medium | |
| CN111599292A (en) | Historical scene presenting method and device, electronic equipment and storage medium | |
| JP7245890B1 (en) | Information processing system, information processing method, information processing program | |
| CN113031846B (en) | Method and device for displaying description information of task and electronic equipment | |
| US9886865B2 (en) | Providing enhanced experience based on device location | |
| Pranith et al. | Real‐Time Applications of Virtual Reality | |
| CN111626521A (en) | Tour route generation method and device | |
| EP2960889A1 (en) | Enhanced experience for reading, playing, learning, by combining digital media such as audio, video, with physical form such as books, magazine, board games |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |