CN108109212B - Cultural relic restoration method, device and system - Google Patents

Cultural relic restoration method, device and system Download PDF

Info

Publication number
CN108109212B
CN108109212B CN201611060601.7A CN201611060601A CN108109212B CN 108109212 B CN108109212 B CN 108109212B CN 201611060601 A CN201611060601 A CN 201611060601A CN 108109212 B CN108109212 B CN 108109212B
Authority
CN
China
Prior art keywords
dimensional model
actual
model data
repaired
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611060601.7A
Other languages
Chinese (zh)
Other versions
CN108109212A (en
Inventor
陶智
朱哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201611060601.7A priority Critical patent/CN108109212B/en
Publication of CN108109212A publication Critical patent/CN108109212A/en
Application granted granted Critical
Publication of CN108109212B publication Critical patent/CN108109212B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/64Three-dimensional objects
    • G06V20/653Three-dimensional objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The application discloses a cultural relic repair method, a cultural relic repair device and a cultural relic repair system, as well as electronic equipment, another two cultural relic repair methods, another two cultural relic repair devices and another electronic equipment. The cultural relic restoration method comprises the following steps: acquiring a data set of a part to be repaired of a specified cultural relic; generating at least one repairing scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data; and displaying the repaired three-dimensional model of each part to be repaired under each corresponding repairing scheme. By adopting the cultural relic restoration method, the cultural relic restoration cost can be effectively reduced, the restoration efficiency and the restoration accuracy are improved, and decision information of the restoration scheme is provided for cultural relic restoration personnel.

Description

Cultural relic restoration method, device and system
Technical Field
The application relates to the technical field of virtual reality, in particular to a cultural relic restoration method, a cultural relic restoration device and a cultural relic restoration system, and electronic equipment. The application simultaneously relates to other two cultural relic repair methods, devices and electronic equipment, and a further cultural relic repair system.
Background
The traditional cultural relic restoration method is mainly characterized in that a manual restoration method is adopted to truly restore the cultural relic. With this repair method, the following problems inevitably arise: 1) because the repair is carried out manually, the repair cost is high and the repair time is long; 2) because the repairing effect depends on the repairing experience of a repairing person, such as: the personal cognitive ability of the repairmen to the whole cultural relics, the personal technical ability of the repairmen in the repairing process and the like, so that great uncertainty exists in the cultural relics repairing process, and the repairing accuracy cannot be guaranteed.
Therefore, how to research and develop a new cultural relic repair method, which can reduce the cultural relic repair cost, improve the repair efficiency and repair accuracy, is a technical problem that needs to be solved urgently by the technical personnel in the field.
Disclosure of Invention
The application provides a cultural relic restoration method, which aims to solve the problems of high restoration cost, low restoration efficiency and low restoration accuracy in the prior art. The application also provides a cultural relic repair device and electronic equipment, a cultural relic repair system, other two cultural relic repair methods, devices and electronic equipment, and another cultural relic repair system.
The application provides a cultural relic restoration method, which comprises the following steps:
acquiring a data set of a part to be repaired of a specified cultural relic;
generating at least one repairing scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data;
and displaying the repaired three-dimensional model of each part to be repaired under each corresponding repairing scheme.
Optionally, the acquiring a data set of a component to be repaired of a specified cultural relic includes:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic;
aiming at each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset part, and acquiring the defect rate of the actual three-dimensional model of the preset part; judging whether the defect rate is larger than a preset defect rate threshold value of the preset component or not; if the judgment result is yes, determining the preset component as a component to be repaired;
and generating the data set of the component to be repaired according to the determined component to be repaired.
Optionally, the method further includes:
and if the judgment result is negative, determining the preset component as the component to be repaired according to a forced repair instruction input by a user.
Optionally, after the determining that the preset component is determined to be the component to be repaired and before the determining that the preset component is determined to be the component to be repaired, the method further includes:
displaying an actual three-dimensional model of the virtual reality of the preset component;
receiving a confirmation instruction of a user;
judging whether the confirmation instruction is an instruction for determining the preset component as a component to be repaired; if yes, the next step is carried out.
Optionally, the acquiring of the actual three-dimensional model data of each preset part of the designated cultural relic adopts the following method:
and acquiring actual three-dimensional model data of each preset part of the appointed cultural relic by a preset scanning technology.
Optionally, the at least one repairing scheme corresponding to each component to be repaired is generated according to the actual three-dimensional model data of the component to be repaired, the pre-stored historical actual three-dimensional model data set, and the at least one historical repairing scheme corresponding to the historical actual three-dimensional model data, and the following method is adopted:
for each part to be repaired, the following steps are carried out:
determining historical actual three-dimensional model data matched with the actual three-dimensional model data of the part to be repaired from the historical actual three-dimensional model data set;
and generating at least one repair scheme corresponding to the part to be repaired according to the at least one historical repair scheme corresponding to the determined historical actual three-dimensional model data.
Optionally, the determining, from the historical actual three-dimensional model data set, one historical actual three-dimensional model data that matches the actual three-dimensional model data of the component to be repaired includes:
screening out historical actual three-dimensional model data of the part to be repaired of the specified cultural relic from the historical actual three-dimensional model data set;
comparing the actual three-dimensional model data of the component to be repaired with the screened historical three-dimensional model data respectively, and obtaining model similarity between the actual three-dimensional model of the component to be repaired and each screened historical three-dimensional model;
and selecting one historical actual three-dimensional model data from the screened historical actual three-dimensional model data according to the model similarity and a preset model selection rule.
Optionally, the selecting, according to the model similarity and a preset model selection rule, one piece of historical actual three-dimensional model data from the screened historical actual three-dimensional model data includes:
taking the historical actual three-dimensional model data with the model similarity greater than or equal to a preset minimum model similarity threshold value as matched model data to form a matched model data set;
and selecting historical actual three-dimensional model data which accords with a preset model selection rule from the matched model data set.
Optionally, the preset model selection rule includes selecting historical actual three-dimensional model data with the highest model similarity.
Optionally, different historical repair schemes corresponding to the same historical actual three-dimensional model data correspond to different repair result fault tolerance rates, and different parts to be repaired correspond to different repair result fault tolerance rates.
Optionally, the historical actual three-dimensional model data set includes: the historical actual three-dimensional model data set of the specified cultural relic or the historical actual three-dimensional model data set of at least one preset cultural relic which is similar to the specified cultural relic.
Optionally, the repaired three-dimensional model of the component to be repaired in the virtual reality under the repair scheme is displayed by adopting the following steps:
generating repaired three-dimensional model data of the part to be repaired according to the actual three-dimensional model data of the part to be repaired and the repair scheme;
and displaying the repaired three-dimensional model of the part to be repaired in the virtual reality under the repair scheme according to the repaired three-dimensional model data.
Optionally, the generating the repaired three-dimensional model data of the component to be repaired according to the actual three-dimensional model data of the component to be repaired and the repair scheme includes:
generating an image processing instruction sequence corresponding to the restoration scheme according to each restoration step included in the restoration scheme and a preset corresponding relation set between the restoration step and an image processing instruction;
and sequentially executing each image processing instruction on the actual three-dimensional model data to generate the repaired three-dimensional model data.
Optionally, the repaired three-dimensional model of the virtual reality is displayed in the following manner:
and displaying the repaired three-dimensional model of the virtual reality in a preset scene graph.
Optionally, the displaying the repaired three-dimensional model of the virtual reality of each component to be repaired under each corresponding repair scheme includes:
displaying information of each repair scheme corresponding to each component to be repaired;
and displaying a repaired three-dimensional model of the specific part to be repaired under the specific repair scheme according to the specific part to be repaired and the specific repair scheme specified by the user.
Optionally, the method further includes:
and forming a repair scheme of the specified cultural relics according to the repair scheme of each part to be repaired specified by the user.
Optionally, the method further includes:
and displaying the repair scheme of the specified cultural relics.
Optionally, the method further includes:
and displaying the repaired three-dimensional model of the virtual reality of the specified cultural relic under the repairing scheme of the specified cultural relic.
The present application further provides a cultural relic repair device, including:
the device comprises a to-be-repaired component data set acquisition unit, a to-be-repaired component data set acquisition unit and a to-be-repaired component data set acquisition unit, wherein the to-be-repaired component data set acquisition unit is used for acquiring a to-be-repaired component data set of a specified cultural relic;
the repair scheme generation unit is used for generating at least one repair scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model data;
and the repaired three-dimensional model display unit is used for displaying the repaired three-dimensional model of each part to be repaired under each repair scheme corresponding to the part to be repaired.
The present application further provides an electronic device, comprising:
a processor; and
a memory for storing a program for implementing the cultural relic repair method, wherein after the device is powered on and the program for implementing the cultural relic repair method is run by the processor, the following steps are executed: acquiring a data set of a part to be repaired of a specified cultural relic; generating at least one repairing scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data; and displaying the repaired three-dimensional model of each part to be repaired under each corresponding repairing scheme.
The present application further provides a cultural relic repair system, including: the cultural relic restoration device according to any one of the above; a display processing device of the virtual reality display device; and the interactive instruction input processing device of the virtual reality input equipment.
The application also provides a cultural relic repair method, which comprises the following steps:
receiving a repair request for a particular part of a specified cultural relic;
acquiring actual three-dimensional model data of the specific part;
generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model;
and displaying the repaired three-dimensional model of the virtual reality of the specific part under each repairing scheme.
The present application further provides a cultural relic repair device, including:
a repair request receiving unit for receiving a repair request for a specific part of a specified cultural relic;
the actual three-dimensional model data acquisition unit is used for acquiring actual three-dimensional model data of the specific part;
a repair plan generating unit, configured to generate at least one repair plan corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set, and at least one historical repair plan corresponding to the historical actual three-dimensional model;
and the repaired three-dimensional model display unit is used for displaying the repaired three-dimensional model of the specific component in virtual reality under each repair scheme.
The present application further provides an electronic device, comprising:
a processor; and
a memory for storing a program for implementing the cultural relic repair method, wherein after the device is powered on and the program for implementing the cultural relic repair method is run by the processor, the following steps are executed: receiving a repair request for a particular part of a specified cultural relic; acquiring actual three-dimensional model data of the specific part; generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model; and displaying the repaired three-dimensional model of the virtual reality of the specific part under each repairing scheme.
The present application further provides a cultural relic repair system, including: the cultural relic restoration device according to any one of the above; and a display processing device of the virtual reality display device.
The application also provides a cultural relic repair method, which comprises the following steps:
receiving a repair scenario generation request for a specific part of a specified cultural relic;
acquiring actual three-dimensional model data of the specific part;
and generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
The present application further provides a cultural relic repair device, including:
a repair scenario generation request receiving unit for receiving a repair scenario generation request for a specific part of a specified cultural relic;
the actual three-dimensional model data acquisition unit is used for acquiring actual three-dimensional model data of the specific part;
and the repair scheme generating unit is used for generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
The present application further provides an electronic device, comprising:
a processor; and
a memory for storing a program for implementing the cultural relic repair method, wherein after the device is powered on and the program for implementing the cultural relic repair method is run by the processor, the following steps are executed: receiving a repair scenario generation request for a specific part of a specified cultural relic; acquiring actual three-dimensional model data of the specific part; and generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
Compared with the prior art, the cultural relic repair method provided by the application comprises the steps of acquiring a data set of a part to be repaired of a specified cultural relic; generating at least one repairing scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data; and displaying the repaired three-dimensional model of each part to be repaired under each corresponding repairing scheme.
By using the cultural relic restoration method provided by the application, at least one restoration scheme corresponding to each component to be restored is automatically generated according to the actual three-dimensional model data of each component to be restored of the appointed cultural relic, the pre-stored historical actual three-dimensional model data set and at least one historical restoration scheme corresponding to the historical actual three-dimensional model data, and a virtual restoration effect graph with a sense of space formed after each component to be restored adopts each restoration scheme is displayed to a user through virtual reality display equipment; according to the processing mode, the cultural relics can be repaired without depending on a repairing person, the repairing process is independent of the personal repairing experience of the repairing person, and a user can personally observe and experience the virtual repairing effect with the sense of space formed after each part to be repaired is repaired by adopting each repairing scheme; therefore, the cultural relic repair cost can be effectively reduced, the repair efficiency and the repair accuracy are improved, and decision information of a repair scheme is provided for cultural relic repair personnel.
Drawings
FIG. 1 is a flow chart of a first embodiment of a method for repairing cultural relics provided by the present application;
FIG. 2 is a detailed flow chart of a repair solution generation process according to an embodiment of the first cultural relic repair method provided by the present application;
FIG. 3 is a detailed flowchart showing a repaired three-dimensional model of a first cultural relic repair method provided by the application;
FIG. 4 is a detailed flowchart of a first embodiment of a cultural relic repair method provided by the present application;
FIG. 5 is a schematic view of an embodiment of a first device for repairing cultural relics provided by the present application;
FIG. 6 is a schematic diagram of an embodiment of a first electronic device provided herein;
fig. 7 is a schematic diagram of an embodiment of a cultural relic repair system provided by the present application.
FIG. 8 is a flow chart of an embodiment of a second method of cultural relic repair provided by the present application;
FIG. 9 is a schematic view of an embodiment of a second device for the repair of cultural relics provided by the present application;
FIG. 10 is a schematic diagram of an embodiment of a second electronic device provided herein;
FIG. 11 is a schematic view of an embodiment of a second system for cultural relic repair provided by the present application;
FIG. 12 is a flow chart of an embodiment of a third method of cultural relic repair provided by the present application;
FIG. 13 is a schematic view of an embodiment of a third device for the repair of cultural relics provided in the present application;
fig. 14 is a schematic diagram of an embodiment of a third electronic device provided in the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit and scope of this application, and it is therefore not limited to the specific implementations disclosed below.
In the application, three cultural relic repair methods, three cultural relic repair devices, three electronic devices and two cultural relic repair systems are provided. Details are described in the following examples one by one.
The basic idea of the cultural relic repair method provided by the application is as follows: the method comprises the steps of automatically generating at least one repairing scheme corresponding to each part to be repaired respectively according to actual three-dimensional model data of each part to be repaired of a designated cultural relic, a pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data, and displaying a virtual repairing effect picture with a space sense formed after each part to be repaired adopts various repairing schemes to a user through virtual reality display equipment. Because the cultural relics can be repaired without depending on the repairing personnel, the repairing process is independent of the individual repairing experience of the repairing personnel, and a user can personally observe and experience the virtual repairing effect with the sense of space formed after each part to be repaired is repaired by adopting each repairing scheme, the cultural relics repairing cost can be effectively reduced, and the repairing efficiency and the repairing accuracy are improved.
Please refer to fig. 1, which is a flowchart illustrating a first method for repairing cultural relics according to an embodiment of the present application. The method comprises the following steps:
step S101: and acquiring a data set of the part to be repaired of the specified cultural relic.
To implement the cultural relic repair method provided by the application, a data set of a part to be repaired of a specified cultural relic needs to be acquired. The data set of the parts to be repaired of the specified historical relic comprises data of all parts needing repair of the specified historical relic, such as part identification of the parts to be repaired.
As an alternative, the data set of the part to be repaired of the designated cultural relic may be a data set formed by data of the part to be repaired directly designated by a repairing person, for example, after the repairing person actually surveys the cultural relic and evaluates the actual survey result, the repairing person directly determines which parts need to be repaired and which parts do not need to be repaired, and directly forms the data set of the part to be repaired according to the determination result. However, since the solution requires a repairman to actually survey the cultural relics themselves, there are problems of high surveying cost, low surveying efficiency and low surveying result accuracy.
In order to solve the problems of the above alternatives, the data set of the parts to be repaired of the specified cultural relics can be automatically generated by the computing device. To realize automatic generation of a data set of a part to be repaired of a specified cultural relic, the following steps can be adopted: 1) acquiring actual three-dimensional model data of each preset part of the specified cultural relic; 2) aiming at each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset part, and acquiring the defect rate of the actual three-dimensional model of the preset part; judging whether the defect rate is larger than a preset defect rate threshold value of the preset component or not; if the judgment result is yes, determining the preset component as a component to be repaired; 3) and generating the data set of the component to be repaired according to the determined component to be repaired.
In specific implementation, the actual three-dimensional model data of each preset part of the appointed cultural relic can be acquired through a preset scanning technology.
In specific implementation, after the defect rate of the actual three-dimensional model of a preset component is determined to be greater than the defect rate threshold of the component, the actual three-dimensional model of the virtual reality of the component can be firstly displayed to a user, the user can send a confirmation instruction after observing the actual three-dimensional model with the spatial sense of the component through a virtual reality display device, if the confirmation instruction is an instruction for determining the component as the component to be repaired, the operation for determining the component as the component to be repaired is executed, and otherwise, if the confirmation instruction is an instruction for determining the component as the component not to be repaired, the operation for determining the component as the component to be repaired is not executed. By adopting the processing mode, the user can intervene in the final determination result of the part to be repaired, so that the effect of improving the user experience is achieved.
In addition, in order to improve the flexibility of determining the part to be repaired, when the defect rate of the actual three-dimensional model of a preset part is less than or equal to the defect rate threshold of the part, the part can be determined as the part to be repaired according to a forced repair instruction input by a user. By adopting the processing mode, the user can intervene in the final determination result of the part to be repaired, and the user experience can be further improved.
After the data set of the part to be repaired of the specified cultural relic is acquired, the next step can be entered, and at least one repairing scheme corresponding to each part to be repaired is generated according to the actual three-dimensional model data of the part to be repaired, the pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data.
Step S103: and generating at least one repairing scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, the pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data.
According to the cultural relic repair method provided by the embodiment of the application, the repair scheme of the part to be repaired can be learned from the historical maintenance record of the cultural relic in a machine learning mode. To realize the function of learning the repair scheme of the part to be repaired from the historical repair record, at least three aspects of data are needed: actual three-dimensional model data of the component to be repaired, a historical actual three-dimensional model data set and a historical repair scheme corresponding to the historical actual three-dimensional model data.
The actual three-dimensional model data refers to the three-dimensional model data of the state of the cultural relic when the three-dimensional model data of the specified cultural relic is acquired.
The historical actual three-dimensional model data set may be a data set including only historical actual three-dimensional model data of each preset part of the designated cultural relic, or may be a data set including historical actual three-dimensional model data of each preset part of at least one preset cultural relic of the same kind as the designated cultural relic.
As a preferable scheme, the historical actual three-dimensional model data set may be formed according to historical actual three-dimensional model data of each preset part of the designated cultural relic; in the processing mode, the historical actual three-dimensional model data is historical data of the same cultural relic, and the data entries in the data set are fewer; therefore, the accuracy of the generated restoration scheme can be effectively ensured, and the generation speed of the restoration scheme can be improved.
It should be noted that, to ensure the implementation effect of the preferred embodiment, it is premised on that sufficient historical actual three-dimensional model data needs to be generated in advance. In order to obtain sufficient historical actual three-dimensional model data, corresponding three-dimensional model data can be simulated according to various possible damage degrees of the cultural relics and used as the historical actual three-dimensional model data, and a corresponding repairing scheme is set for the historical actual three-dimensional model data. In addition, in order to show the repairing effect which can be achieved by adopting the repairing scheme, the repairing scheme described by the characters is converted into a corresponding image processing instruction, and the repaired three-dimensional model can be generated by executing the corresponding image processing instruction on the historical actual three-dimensional model data.
As an alternative, the historical actual three-dimensional model data set may be formed according to historical actual three-dimensional model data of each preset part of at least one preset cultural relic of the same kind as the specified cultural relic; in the processing mode, the historical actual three-dimensional model data is derived from a plurality of similar cultural relics, and the data items in the data set are more. Compared with the optimal scheme, the accuracy of the repair scheme generated by the scheme may be poor, and the generation speed of the repair scheme may be low.
The historical actual three-dimensional model data corresponds to at least one historical repair scheme, different historical repair schemes may correspond to different repair result fault tolerance rates, for example, for a hand of 'Temple Buddha', multiple repair schemes may be adopted for repair, and the fault tolerance rates which can be achieved by different repair schemes may be different.
In specific implementation, different repair result fault tolerance rates can be set for different parts of a specified cultural relic, namely: the repair result fault tolerance rates corresponding to the components can be uniformly set to be the same value, and different repair result fault tolerance rates can be set for the components according to the characteristics of the components. The fault tolerance of the repair result can be set according to experience. For example, the fault tolerance rate of two repair results is set to be 3% and 5% for the hand of the 'temple Buddha', and the fault tolerance rate of four repair results is set to be 3%, 5%, 7%, 9% and the like for the head of the 'temple Buddha'.
Taking the temple Buddha as an example, the generation process of the historical actual three-dimensional model data set and at least one historical restoration scheme corresponding to the historical actual three-dimensional model data is described.
First, basic information of the cultural relic, for example, which parts the cultural relic includes, the material of each part, original damage description, original three-dimensional model data, original data recording time and manufacturing process, the age of the cultural relic, etc. can be collected and stored, as shown in table 1:
Figure BDA0001161854190000111
TABLE 1
Then, the historical repair record of the cultural relic is recorded to form the information shown in table 2:
Figure BDA0001161854190000112
Figure BDA0001161854190000121
TABLE 2
Finally, the digital processing is carried out on the historical repair record of the cultural relic, and the method specifically comprises the following steps: 1) according to the damage description of the cultural relic component, three-dimensional model data under the damage state is simulated, namely: generating actual three-dimensional model data corresponding to the damage description; 2) converting each maintenance step included in the maintenance scheme into an image processing instruction for the model data; 3) the label repair scheme is an actual implementation or an alternative. In this embodiment, a history actual three-dimensional model data set formed by digitizing the history repair record in table 2 and history repair scenario information corresponding to the history actual three-dimensional model data are shown in table 3:
Figure BDA0001161854190000122
Figure BDA0001161854190000131
TABLE 3
Please refer to fig. 2, which is a specific flowchart of a repair scenario generation method according to an embodiment of the present application. In this embodiment, generating the repair plan of the component to be repaired may include the following specific steps:
step S201: and determining historical actual three-dimensional model data matched with the actual three-dimensional model data of the part to be repaired from the historical actual three-dimensional model data set.
The historical actual three-dimensional model data set comprises a plurality of historical actual three-dimensional model data of each preset part of the appointed cultural relic. As can be seen, in the historical actual three-dimensional model data set, a part of the model data matches with the actual three-dimensional model data of the part to be repaired, for example, the historical actual three-dimensional model data of the head of "temple buddha" matches with the actual three-dimensional model data of the head; the other part of the model data does not match with the actual three-dimensional model data of the part to be repaired, for example, the historical actual three-dimensional model data of the head of the temple Buddha does not match with the actual three-dimensional model data of the hand. Furthermore, a model data is determined from the matched historical actual three-dimensional model data. Therefore, it is first necessary to determine one historical actual three-dimensional model data that matches the actual three-dimensional model data of the part to be repaired from the historical actual three-dimensional model data set.
In specific implementation, the step S201 may include the following specific steps:
step S2011: and screening out historical actual three-dimensional model data of the part to be repaired of the specified cultural relic from the historical actual three-dimensional model data set.
Step S2013: and comparing the actual three-dimensional model data of the component to be repaired with the screened historical three-dimensional model data respectively, and obtaining the model similarity between the actual three-dimensional model of the component to be repaired and each screened historical three-dimensional model.
Step S2015: and selecting one historical actual three-dimensional model data from the screened historical actual three-dimensional model data according to the model similarity and a preset model selection rule.
When the step S2015 is specifically implemented, the following specific steps may be included: 1) taking the historical actual three-dimensional model data with the model similarity greater than or equal to a preset minimum model similarity threshold value as matched model data to form a matched model data set; 2) and selecting historical actual three-dimensional model data which accords with a preset model selection rule from the matched model data set.
The preset minimum model similarity threshold value is used as an index for measuring whether the two model data are matched, and may be set empirically, for example, the value may be set to 80%, that is, only the historical actual three-dimensional model data with the model similarity greater than or equal to 80% may be used as the model data matched with the actual three-dimensional model data of the component to be repaired.
The preset model selection rule may be to select the historical actual three-dimensional model data with the highest model similarity, or to select any one of the historical actual three-dimensional model data from the matched model data.
It should be noted that the above-mentioned embodiment of step S201 is only an optional embodiment, and in practical applications, other embodiments may also be adopted, for example, step S2011 may not be executed, and the actual three-dimensional model data of the component to be repaired may be respectively compared with each historical three-dimensional model data in the historical actual three-dimensional model data set, and the like; for another example, when the function of step S2015 is implemented, the minimum model similarity threshold may not be set, but only one piece of historical actual three-dimensional model data may be selected according to the model similarity and the preset model selection rule. These different embodiments are modifications of the embodiments, which do not depart from the core of the present application, and therefore all fall within the scope of the present application.
Step S202: and generating at least one repair scheme corresponding to the part to be repaired according to the at least one historical repair scheme corresponding to the determined historical actual three-dimensional model data.
Because the determined historical actual three-dimensional model data is matched with the actual three-dimensional model data of the component to be repaired, at least one repair scheme corresponding to the component to be repaired can be generated according to at least one historical repair scheme corresponding to the historical actual three-dimensional model data.
In specific implementation, all the repair schemes corresponding to the determined historical actual three-dimensional model data can be used as the repair schemes of the component to be repaired; or selecting a historical repair scheme reaching the repair result fault tolerance rate from all historical repair schemes corresponding to historical actual three-dimensional model data according to the repair result fault tolerance rate preset for the component to be repaired, and using the selected historical repair scheme as the repair scheme corresponding to the component to be repaired.
Now, a specific embodiment of step S103 is explained. It should be noted that the above specific implementation manner of step S103 is only an optional implementation manner, and in practical application, the function of step S103 may also be implemented in other manners to generate a repair scheme of the component to be repaired, for example, a training sample set for machine learning may be formed according to a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model data, the feature data of the training sample may include historical actual three-dimensional model data, a cultural relic category, a belonging component, a material, a year, a manufacturing process, a defect rate, repair time, and the like, the labeled data of the training sample may be set as the repair scheme, and in addition, the training sample corresponding to the actually implemented scheme may be used as a positive sample, and the training sample corresponding to the alternative scheme may be used as a negative sample; then, learning from the training sample set through a preset machine learning algorithm (such as an SVM model, a neural network model and the like) to obtain a repair scheme generation model; and finally, taking the actual three-dimensional model data, the cultural relic category, the affiliated part, the material, the age, the manufacturing process, the defect rate, the repair time and other characteristic data of the part to be repaired as the input of a repair scheme generation model, and automatically generating a repair scheme corresponding to the part to be repaired through the repair scheme generation model. Variations of the above-described forms, such as: the model data matching method, the machine learning model calculation method, and the like are modifications of the embodiments and do not depart from the core of the present application, and therefore, are all within the scope of the present application.
Step S105: and displaying the repaired three-dimensional model of each part to be repaired under each corresponding repairing scheme.
In the step, the repaired three-dimensional models of the parts to be repaired under the corresponding repair schemes are displayed for users to watch in a virtual reality mode, and the users can personally observe the repair effect picture with spatial sense through the virtual reality display equipment so as to evaluate and determine the actually adopted implementation scheme.
It should be noted that, the three-dimensional model after restoration displayed on the computer is directly viewed by human eyes, which cannot bring experience with spatial sense to the user. The method emphasizes that a user watches the repaired three-dimensional model with the sense of space through the virtual interactive display equipment. The virtual reality display device can be a VR head-mounted display device (VR glasses, VR helmet) and the like. Taking the VR head display as an example, the device utilizes the head-mounted display device to seal the human vision and hearing from the outside, and guides the user to generate a sense of being in a virtual environment. The display principle is that the left and right eye screens respectively display images of the left and right eyes, and the human eyes generate stereoscopic impression in the brain after acquiring the information with the difference.
Please refer to fig. 3, which is a flowchart illustrating a repaired three-dimensional model according to an embodiment of the cultural relic repairing method of the present application. In this embodiment, the post-repair three-dimensional model of the component to be repaired in the repair scheme through virtual reality may be displayed by adopting the following steps:
step S301: and generating the repaired three-dimensional model data of the part to be repaired according to the actual three-dimensional model data of the part to be repaired and the repair scheme.
It should be noted that the repair plan generated in step S103 may be a text-description repair plan or a repair plan in the form of an image processing instruction. If the repair solution generated at step S103 is a text-description repair solution, step S301 may include the steps of: 1) generating an image processing instruction sequence corresponding to the restoration scheme according to each restoration step included in the restoration scheme and a preset corresponding relation set between the restoration step and an image processing instruction; 2) and sequentially executing each image processing instruction on the actual three-dimensional model data to generate the repaired three-dimensional model data.
The preset corresponding relation set between the repairing steps and the image processing instructions comprises a plurality of corresponding relations between the repairing steps and the image processing instructions. The repairing step is a repairing step described in a text form, and the image processing instruction is an image processing instruction corresponding to the repairing step, for example, if the repairing step is to grind a damaged part flat, the corresponding image processing instruction may be an image processing instruction for converting a curved surface displayed at a corresponding position into a flat surface, and the like.
Step S302: and displaying the repaired three-dimensional model of the part to be repaired in the virtual reality under the repair scheme according to the repaired three-dimensional model data.
In addition, in order to create a cultural relic restoration scene with reality for a user, the following mode can be adopted when the restored three-dimensional model is displayed: and displaying the repaired three-dimensional model of the virtual reality in a preset scene graph.
The preset scene graph is a simulation graph of a real environment where the cultural relics are located during restoration, for example, the scene graph of the 'Temple Buddha' can be a scene image of an actual space (Temple hall) where the Buddha is located. Through the processing mode of displaying the repaired three-dimensional model of the virtual reality in the preset scene graph, the effect of repairing the cultural relics in the real scene by the repairing personnel can be achieved.
In order to enable the user to actively control and view which component to be repaired is under which repair scheme, the step S105 may include the following steps: 1) displaying information of each repair scheme corresponding to each component to be repaired, for example, displaying options of the component to be repaired and options of the repair scheme to a user; 2) and displaying a repaired three-dimensional model of the specific part to be repaired under the specific repair scheme according to the specific part to be repaired and the specific repair scheme specified by the user. By adopting the processing mode, the user experience can be improved.
When a user views information of each repair scheme corresponding to each component to be repaired through the virtual reality display device, the user can send an operation instruction (for example, a display instruction of a repaired three-dimensional model for a specific component to be repaired and a specific repair scheme) through the virtual reality input device, and can also send the operation instruction through other modes, for example, for operation behavior information sent by the user through a gesture, the gesture can be detected and recognized through the hand information capture device, so that the operation instruction of the gesture class can be obtained.
As a preferable scheme, the user can send the operation instruction through the virtual reality input device. A Virtual Reality input device is a device capable of mapping real world environment data to a Virtual world, that is, a device for inputting a user operation instruction to a VR (Virtual Reality) system. Unlike keyboards, mice, and gestures, virtual reality input devices emphasize immersion.
The virtual reality input device includes, but is not limited to, a glove, a handle, a double handle, a full body suit and other virtual reality input devices. With the development of virtual display technology, more and more virtual reality input devices are available for users. For example, a conventional handle incorporating an inertial sensor, a rumble motor, is used as a virtual reality input device, which is typically operated using conventional buttons/joysticks/touch pads and interacts with a rumble sensation.
The cultural relic restoration method can form the restoration scheme of the designated cultural relic according to the restoration scheme of each part to be restored designated by the user, and displays the restoration scheme of the designated cultural relic to the user, and further can display a three-dimensional model of the designated cultural relic after the restoration of the designated cultural relic under the restoration scheme of the designated cultural relic, so that the user can view the final restoration effect diagram of the selected scheme, and provide decision information of cultural relic restoration for the user.
Please refer to fig. 4, which is a flowchart illustrating a first method for repairing cultural relics according to an embodiment of the present application. As can be seen from fig. 4, the present embodiment includes the following steps: 1) acquiring original three-dimensional model data of each preset part of the appointed cultural relic by a CT scanning technology; 2) the method comprises the steps of appointing the defect rate and the repair result fault tolerance rate of each preset component of the cultural relic; 3) digitizing the traditional maintenance record to form a historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model data; 4) forming a training sample set according to the historical actual three-dimensional model data set and at least one historical restoration scheme corresponding to the historical actual three-dimensional model data, and learning from the training sample set through a machine learning algorithm to obtain a restoration scheme generation model; 5) acquiring actual three-dimensional model data of each preset part of the appointed cultural relic by a CT scanning technology; 6) calculating the defect rate of the actual three-dimensional model of each preset component; 7) judging whether the defect rate of the actual three-dimensional model of each preset component is larger than the defect rate threshold value of the preset component one by one; if the fault-tolerant rate of the preset component is equal to or higher than the preset fault-tolerant rate, generating a model according to a pre-generated repair scheme, and generating a repair scheme of the preset component under the preset fault-tolerant rate of the repair result; 8) displaying the repaired effect graphs corresponding to different repairing schemes; 9) and determining the actually adopted repair scheme according to the repair scheme specified by the user.
In the above embodiments, a first cultural relic repair method is provided, and correspondingly, a first cultural relic repair device is also provided. The apparatus corresponds to an embodiment of the method described above.
Please refer to fig. 5, which is a schematic diagram of a first embodiment of the cultural relic repair device of the present application. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
The first historical relic prosthetic devices of this embodiment includes:
a to-be-repaired component data set acquisition unit 101 configured to acquire a to-be-repaired component data set of a specified cultural relic;
a repair plan generating unit 103, configured to generate at least one repair plan corresponding to each component to be repaired according to the actual three-dimensional model data of the component to be repaired, a pre-stored historical actual three-dimensional model data set, and at least one historical repair plan corresponding to the historical actual three-dimensional model data;
and the repaired three-dimensional model display unit 105 is used for displaying the repaired three-dimensional model of the virtual reality of each part to be repaired under each repair scheme corresponding to the part to be repaired.
Optionally, the to-be-repaired component data set obtaining unit 101 includes:
the actual three-dimensional model data acquisition subunit is used for acquiring actual three-dimensional model data of each preset part of the specified cultural relic;
the part to be repaired determining subunit is used for comparing actual three-dimensional model data of the preset part with pre-stored original three-dimensional model data of the preset part aiming at each preset part to obtain the defect rate of the actual three-dimensional model of the preset part; judging whether the defect rate is larger than a preset defect rate threshold value of the preset component or not; if the judgment result is yes, determining the preset component as a component to be repaired;
and the data set generation subunit of the component to be repaired is used for generating the data set of the component to be repaired according to the determined component to be repaired.
Optionally, the component to be repaired determining subunit includes:
and the forcible-designated to-be-repaired component subunit is used for determining the preset component as the to-be-repaired component according to a forcible repair instruction input by a user if the judgment result is negative.
Optionally, the component to be repaired determining subunit further includes:
the actual three-dimensional model display subunit is used for displaying the actual three-dimensional model of the virtual reality of the preset component;
the user confirmation instruction receiving subunit is used for receiving a confirmation instruction of a user;
the instruction judging subunit is used for judging whether the confirmation instruction is an instruction for determining the preset component as a component to be repaired; if yes, the next step is carried out.
Optionally, the actual three-dimensional model data collecting subunit is specifically configured to collect, by using a preset scanning technology, actual three-dimensional model data of each preset component of the designated cultural relic.
Optionally, the repair plan generating unit 103 is specifically configured to, for each component to be repaired, perform the following steps: determining historical actual three-dimensional model data matched with the actual three-dimensional model data of the part to be repaired from the historical actual three-dimensional model data set; and generating at least one repair scheme corresponding to the part to be repaired according to the at least one historical repair scheme corresponding to the determined historical actual three-dimensional model data.
Optionally, the repair scheme generating unit 103 includes:
a first determining subunit, configured to determine, from the historical actual three-dimensional model data set, one historical actual three-dimensional model data that matches the actual three-dimensional model data of the component to be repaired;
the first determining subunit includes:
the first selection subunit is used for screening out historical actual three-dimensional model data of the part to be repaired of the specified cultural relic from the historical actual three-dimensional model data set;
the model similarity calculation operator unit is used for comparing the actual three-dimensional model data of the part to be repaired with the screened historical three-dimensional model data respectively and obtaining the model similarity between the actual three-dimensional model of the part to be repaired and each screened historical three-dimensional model;
and the second selection subunit is used for selecting one piece of historical actual three-dimensional model data from the screened historical actual three-dimensional model data according to the model similarity and a preset model selection rule.
Optionally, the second selecting subunit includes:
the matched model data set generating subunit is used for taking the historical actual three-dimensional model data with the model similarity greater than or equal to a preset minimum model similarity threshold as matched model data to form a matched model data set;
and the selecting subunit is used for selecting one historical actual three-dimensional model data which accords with a preset model selecting rule from the matched model data set.
Optionally, the preset model selection rule includes selecting historical actual three-dimensional model data with the highest model similarity.
Optionally, different historical repair schemes corresponding to the same historical actual three-dimensional model data correspond to different repair result fault tolerance rates, and different parts to be repaired correspond to different repair result fault tolerance rates.
Optionally, the historical actual three-dimensional model data set includes: the historical actual three-dimensional model data set of the specified cultural relic or the historical actual three-dimensional model data set of at least one preset cultural relic which is similar to the specified cultural relic.
Optionally, the repaired three-dimensional model display unit 105 includes:
the repaired three-dimensional model data generating subunit is used for generating repaired three-dimensional model data of the part to be repaired according to the actual three-dimensional model data of the part to be repaired and the repair scheme;
and the first repaired three-dimensional model display subunit is used for displaying the repaired three-dimensional model of the part to be repaired in the virtual reality under the repair scheme according to the repaired three-dimensional model data.
Optionally, the repaired three-dimensional model data generating subunit includes:
an image processing instruction sequence generating subunit, configured to generate an image processing instruction sequence corresponding to the repair scheme according to each repair step included in the repair scheme and a preset correspondence set between a repair step and an image processing instruction;
and the second repaired three-dimensional model data generating subunit is used for sequentially executing each image processing instruction on the actual three-dimensional model data to generate the repaired three-dimensional model data.
Optionally, the repaired three-dimensional model display unit 105 is specifically configured to display the repaired three-dimensional model of the virtual reality in a preset scene graph.
Optionally, the repaired three-dimensional model display unit 105 includes:
the system comprises a plurality of repair scheme information display subunits, a plurality of repair module units and a plurality of repair module units, wherein the repair scheme information display subunits are used for displaying the information of each repair scheme corresponding to each component to be repaired;
and the specific repair scheme model display subunit is used for displaying the repaired three-dimensional model of the specific part to be repaired in the virtual reality under the specific repair scheme according to the specific part to be repaired and the specific repair scheme specified by the user.
Optionally, the apparatus further comprises:
and the total repair scheme generation unit is used for forming the repair scheme of the specified cultural relics according to the repair scheme of each part to be repaired specified by the user.
Optionally, the apparatus further comprises:
and the total restoration scheme display unit is used for displaying the restoration scheme of the specified cultural relic.
Optionally, the apparatus further comprises:
and the repaired cultural relic model display unit is used for displaying the repaired three-dimensional model of the specified cultural relic in the virtual reality under the repair scheme of the specified cultural relic.
Please refer to fig. 6, which is a schematic diagram of a first electronic device according to an embodiment of the present application. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
A first electronic device of this embodiment, the electronic device includes: a processor 101; the memory 103 is used for acquiring a data set of the part to be repaired of the specified cultural relic; generating at least one repairing scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data; and displaying the repaired three-dimensional model of each part to be repaired under each corresponding repairing scheme.
The embodiment of the present application further provides a first cultural relic repair system, as shown in fig. 7, the system includes the first cultural relic repair processing apparatus 101, the display processing apparatus 102 of the virtual reality display device, and the interaction instruction input processing apparatus 103 of the virtual reality input device described in the above embodiments. The cultural relic repair device 101 is usually deployed in a server, but is not limited to the server, and may be any equipment capable of implementing the first cultural relic repair method; the display processing apparatus 102 is deployed in a virtual reality display device, for example, a virtual reality head-mounted display device; the interactive instruction input processing device 103 is disposed in a virtual reality input device, such as a handle, a glove, a somatosensory seat, and the like.
For example, the cultural relic repair device 101 is deployed in a server, and can obtain a data set of a part to be repaired of a specified cultural relic, generate at least one repair scheme corresponding to each part to be repaired according to actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model data, and then display a repaired three-dimensional model of each part to be repaired in a virtual reality under each repair scheme corresponding to the part to be repaired; the display processing device 102 is disposed on a VR head display, the VR head display can be connected to a display device (display) for displaying a single-field model and an even-field model corresponding to a repaired three-dimensional model through an HDMI (High Definition Multimedia Interface) connection line, the two models are respectively pushed to a left-eye screen and a right-eye screen of the VR head display through the HDMI connection line, and the model of the left-eye screen and the model of the right-eye screen are superimposed and imaged into a repair effect image with a spatial sense, so as to create a real experience environment for a user; the interactive instruction input processing device 103 is disposed on the somatosensory handle, and can send the effect graph display instruction information of a user for a certain repair scheme to the cultural relic repair device 101; after receiving the instruction information, the cultural relic repair device 101 displays the repaired three-dimensional model corresponding to the repair scheme.
Corresponding to the first cultural relic repair method, the application also provides a second cultural relic repair method. Please refer to fig. 8, which is a flowchart illustrating an embodiment of a second method for repairing a cultural relic provided in the present application, wherein the same contents as those in the first embodiment are not repeated, and please refer to corresponding parts in the first embodiment. The second cultural relic repair method provided by the application comprises the following steps:
step S101: a repair request for a particular part of a specified cultural relic is received.
Step S103: actual three-dimensional model data of the particular part is acquired.
In specific implementation, the actual three-dimensional model data of the specific part can be acquired through a preset scanning technology. The preset scanning technology may adopt a three-dimensional laser scanning technology, a Computed Tomography (CT) scanning technology, and the like.
Step S105: and generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
Step S107: and displaying the repaired three-dimensional model of the virtual reality of the specific part under each repairing scheme.
In the above embodiment, a second cultural relic repair method is provided, and correspondingly, a second cultural relic repair device is also provided in the present application. The apparatus corresponds to an embodiment of the method described above.
Please refer to fig. 9, which is a schematic diagram of a second embodiment of the cultural relic repair device of the present application. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
The second cultural relic restoration device of the embodiment comprises:
a repair request receiving unit 101 for receiving a repair request for a specific part of a specified historical relic;
an actual three-dimensional model data acquisition unit 103 for acquiring actual three-dimensional model data of the specific part;
a repair plan generating unit 105, configured to generate at least one repair plan corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set, and at least one historical repair plan corresponding to the historical actual three-dimensional model;
and a repaired three-dimensional model display unit 107 for displaying the repaired three-dimensional model of the specific component in the virtual reality under each repair scheme.
Please refer to fig. 10, which is a diagram illustrating a second electronic device according to an embodiment of the present application. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
A second electronic device of the present embodiment includes: a processor 101; and a memory 103 that receives a repair request for a specific part of a specified cultural relic; acquiring actual three-dimensional model data of the specific part; generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model; and displaying the repaired three-dimensional model of the virtual reality of the specific part under each repairing scheme.
The embodiment of the present application further provides a second cultural relic repair system, as shown in fig. 11, the system includes the second cultural relic repair processing apparatus 101, the display processing apparatus 102 of the virtual reality display device, and the interaction instruction input processing apparatus 103 of the virtual reality input device described in the above embodiments. The cultural relic repair device 101 is usually deployed in a server, but is not limited to the server, and may be any equipment capable of implementing the second cultural relic repair method; the display processing apparatus 102 is deployed in a virtual reality display device, for example, a virtual reality head-mounted display device; the interactive instruction input processing device 103 is disposed in a virtual reality input device, such as a handle, a glove, a somatosensory seat, and the like.
For example, the second cultural relic repair device 101 is deployed in a server, and is capable of receiving a repair request for a specific part of a specified cultural relic, acquiring actual three-dimensional model data of the specific part, generating at least one repair solution corresponding to the specific part according to the actual three-dimensional model data of the specific part, a pre-stored historical actual three-dimensional model data set and at least one historical repair solution corresponding to the historical actual three-dimensional model, and displaying a virtual-reality repaired three-dimensional model of the specific part under each repair solution; the display processing device 102 is disposed on a VR head display, the VR head display can be connected to a display device (display) for displaying a single-field model and an even-field model corresponding to a repaired three-dimensional model through an HDMI (High Definition Multimedia Interface) connection line, the two models are respectively pushed to a left-eye screen and a right-eye screen of the VR head display through the HDMI connection line, and the model of the left-eye screen and the model of the right-eye screen are superimposed and imaged into a repair effect image with a spatial sense, so as to create a real experience environment for a user; the interactive instruction input processing device 103 is disposed on the somatosensory handle, and can send the effect graph display instruction information of a user for a certain repair scheme to the cultural relic repair device 101; after receiving the instruction information, the cultural relic repair device 101 displays the repaired three-dimensional model corresponding to the repair scheme.
Corresponding to the first cultural relic repair method, the application also provides a third cultural relic repair method. Please refer to fig. 12, which is a flowchart illustrating an embodiment of a third method for repairing a cultural relic provided in the present application, wherein the same contents as those in the first embodiment are not repeated, and please refer to corresponding parts in the first embodiment. The third cultural relic repair method provided by the application comprises the following steps:
step S101: a repair solution generation request for a particular component of a specified cultural relic is received.
Step S103: actual three-dimensional model data of the particular part is acquired.
In specific implementation, the actual three-dimensional model data of the specific part can be acquired through a preset scanning technology. The preset scanning technology may adopt a three-dimensional laser scanning technology, a Computed Tomography (CT) scanning technology, and the like.
Step S105: and generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
In the above embodiments, a third cultural relic repair method is provided, and correspondingly, a third cultural relic repair device is also provided in the present application. The apparatus corresponds to an embodiment of the method described above.
Please refer to fig. 13, which is a schematic diagram of a third embodiment of the cultural relic repair device of the present application. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
The third historical relic prosthetic devices of this embodiment includes:
a repair scenario generation request receiving unit 101 for receiving a repair scenario generation request for a specific part of a specified cultural relic;
an actual three-dimensional model data acquisition unit 103 for acquiring actual three-dimensional model data of the specific part;
and a repair plan generating unit 105, configured to generate at least one repair plan corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set, and at least one historical repair plan corresponding to the historical actual three-dimensional model.
Please refer to fig. 14, which is a diagram illustrating a third electronic device according to an embodiment of the present application. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
A third electronic device of the present embodiment includes: a processor 101; and a memory 103 receiving a repair scenario generation request for a specific part of a specified cultural relic; acquiring actual three-dimensional model data of the specific part; and generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
1. Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.
2. As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Claims (27)

1. A cultural relic restoration method is characterized by comprising the following steps:
acquiring a data set of a part to be repaired of a specified cultural relic, wherein the acquiring of the data set of the part to be repaired of the specified cultural relic comprises the following steps:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired;
generating at least one repairing scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data;
and displaying the repaired three-dimensional model of each part to be repaired under each corresponding repairing scheme.
2. The cultural relic repair method according to claim 1, further comprising:
and if the judgment result is negative, determining the preset component as the component to be repaired according to a forced repair instruction input by a user.
3. The cultural relic repair method according to claim 1, wherein after the judging result is yes and before the determining the preset component as the component to be repaired, the method further comprises:
displaying an actual three-dimensional model of the virtual reality of the preset component;
receiving a confirmation instruction of a user;
judging whether the confirmation instruction is an instruction for determining the preset component as a component to be repaired; if yes, the next step is carried out.
4. The cultural relic repair method according to claim 1, wherein the actual three-dimensional model data of each preset part of the specified cultural relic is acquired by adopting the following method:
and acquiring actual three-dimensional model data of each preset part of the appointed cultural relic by a preset scanning technology.
5. The cultural relic repair method according to claim 1, wherein the at least one repair solution corresponding to each component to be repaired is generated according to the actual three-dimensional model data of the component to be repaired, the pre-stored historical actual three-dimensional model data set and the at least one historical repair solution corresponding to the historical actual three-dimensional model data, and the following method is adopted:
for each part to be repaired, the following steps are carried out:
determining historical actual three-dimensional model data matched with the actual three-dimensional model data of the part to be repaired from the historical actual three-dimensional model data set;
and generating at least one repair scheme corresponding to the part to be repaired according to the at least one historical repair scheme corresponding to the determined historical actual three-dimensional model data.
6. The cultural relic repair method according to claim 5, wherein the determining one historical actual three-dimensional model data which matches the actual three-dimensional model data of the part to be repaired from the historical actual three-dimensional model data set comprises:
screening out historical actual three-dimensional model data of the part to be repaired of the specified cultural relic from the historical actual three-dimensional model data set;
comparing the actual three-dimensional model data of the component to be repaired with the screened historical three-dimensional model data respectively, and obtaining model similarity between the actual three-dimensional model of the component to be repaired and each screened historical three-dimensional model;
and selecting one historical actual three-dimensional model data from the screened historical actual three-dimensional model data according to the model similarity and a preset model selection rule.
7. The cultural relic repair method according to claim 6, wherein the selecting a historical actual three-dimensional model data from the screened historical actual three-dimensional model data according to the model similarity and a preset model selection rule comprises:
taking the historical actual three-dimensional model data with the model similarity greater than or equal to a preset minimum model similarity threshold value as matched model data to form a matched model data set;
and selecting historical actual three-dimensional model data which accords with a preset model selection rule from the matched model data set.
8. The cultural relic repair method of claim 6, wherein the preset model selection rule comprises selecting historical actual three-dimensional model data with the highest model similarity.
9. The cultural relic repair method according to claim 1, wherein different historical repair schemes corresponding to the same historical actual three-dimensional model data correspond to different repair result fault tolerance rates, and different parts to be repaired correspond to different repair result fault tolerance rates.
10. The cultural relic repair method according to claim 1, wherein the historical actual three-dimensional model data set comprises: the historical actual three-dimensional model data set of the specified cultural relic or the historical actual three-dimensional model data set of at least one preset cultural relic which is similar to the specified cultural relic.
11. The cultural relic repair method according to claim 1, wherein the repaired three-dimensional model of the component to be repaired under the repair scheme is displayed by adopting the following steps:
generating repaired three-dimensional model data of the part to be repaired according to the actual three-dimensional model data of the part to be repaired and the repair scheme;
and displaying the repaired three-dimensional model of the part to be repaired in the virtual reality under the repair scheme according to the repaired three-dimensional model data.
12. The cultural relic repair method according to claim 11, wherein the generating of the repaired three-dimensional model data of the component to be repaired according to the actual three-dimensional model data of the component to be repaired and the repair plan comprises:
generating an image processing instruction sequence corresponding to the restoration scheme according to each restoration step included in the restoration scheme and a preset corresponding relation set between the restoration step and an image processing instruction;
and sequentially executing each image processing instruction on the actual three-dimensional model data to generate the repaired three-dimensional model data.
13. The cultural relic repair method according to claim 1, wherein the repaired three-dimensional model of the virtual reality is displayed in the following manner:
and displaying the repaired three-dimensional model of the virtual reality in a preset scene graph.
14. The cultural relic repair method according to claim 1, wherein the displaying of the repaired three-dimensional model of the virtual reality of each component to be repaired under each repair solution corresponding thereto comprises:
displaying information of each repair scheme corresponding to each component to be repaired;
and displaying a repaired three-dimensional model of the specific part to be repaired under the specific repair scheme according to the specific part to be repaired and the specific repair scheme specified by the user.
15. The cultural relic repair method according to claim 1, further comprising:
and forming a repair scheme of the specified cultural relics according to the repair scheme of each part to be repaired specified by the user.
16. The cultural relic repair method according to claim 11, further comprising:
and displaying the repair scheme of the specified cultural relics.
17. The cultural relic repair method according to claim 11, further comprising:
and displaying the repaired three-dimensional model of the virtual reality of the specified cultural relic under the repairing scheme of the specified cultural relic.
18. A cultural relic restoration device, comprising:
a to-be-repaired component data set acquisition unit configured to acquire a to-be-repaired component data set of a specified historical relic, where the acquiring of the to-be-repaired component data set of the specified historical relic includes:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired;
the repair scheme generation unit is used for generating at least one repair scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model data;
and the repaired three-dimensional model display unit is used for displaying the repaired three-dimensional model of each part to be repaired under each repair scheme corresponding to the part to be repaired.
19. An electronic device, comprising:
a processor; and
a memory for storing a program for implementing the cultural relic repair method, wherein after the device is powered on and the program for implementing the cultural relic repair method is run by the processor, the following steps are executed: acquiring a data set of a part to be repaired of a specified cultural relic, wherein the acquiring of the data set of the part to be repaired of the specified cultural relic comprises the following steps:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired; generating at least one repairing scheme corresponding to each part to be repaired according to the actual three-dimensional model data of the part to be repaired, a pre-stored historical actual three-dimensional model data set and at least one historical repairing scheme corresponding to the historical actual three-dimensional model data; and displaying the repaired three-dimensional model of each part to be repaired under each corresponding repairing scheme.
20. A cultural relic repair system, comprising: the cultural relic repair device according to claim 18; a display processing device of the virtual reality display device; and the interactive instruction input processing device of the virtual reality input equipment.
21. A cultural relic restoration method is characterized by comprising the following steps:
receiving a repair request for a particular part of a specified cultural relic;
acquiring actual three-dimensional model data of the specific part, wherein the acquiring of the actual three-dimensional model data of the specific part comprises the following steps:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired;
generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model;
and displaying the repaired three-dimensional model of the virtual reality of the specific part under each repairing scheme.
22. A cultural relic restoration device, comprising:
a repair request receiving unit for receiving a repair request for a specific part of a specified cultural relic;
an actual three-dimensional model data acquisition unit for acquiring actual three-dimensional model data of the specific part, wherein the acquisition of the actual three-dimensional model data of the specific part performs the following steps:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired;
a repair plan generating unit, configured to generate at least one repair plan corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set, and at least one historical repair plan corresponding to the historical actual three-dimensional model;
and the repaired three-dimensional model display unit is used for displaying the repaired three-dimensional model of the specific component in virtual reality under each repair scheme.
23. An electronic device, comprising:
a processor; and
a memory for storing a program for implementing the cultural relic repair method, wherein after the device is powered on and the program for implementing the cultural relic repair method is run by the processor, the following steps are executed: receiving a repair request for a particular part of a specified cultural relic; acquiring actual three-dimensional model data of the specific part, wherein the acquiring of the actual three-dimensional model data of the specific part comprises the following steps:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired; generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model; and displaying the repaired three-dimensional model of the virtual reality of the specific part under each repairing scheme.
24. A cultural relic repair system, comprising: the cultural relic repair device according to claim 22; and a display processing device of the virtual reality display device.
25. A cultural relic restoration method is characterized by comprising the following steps:
receiving a repair scenario generation request for a specific part of a specified cultural relic;
acquiring actual three-dimensional model data of the specific part, wherein the acquiring of the actual three-dimensional model data of the specific part comprises the following steps:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired;
and generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
26. A cultural relic restoration device, comprising:
a repair scenario generation request receiving unit for receiving a repair scenario generation request for a specific part of a specified cultural relic;
an actual three-dimensional model data acquisition unit for acquiring actual three-dimensional model data of the specific part, wherein the acquisition of the actual three-dimensional model data of the specific part performs the following steps:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired;
and the repair scheme generating unit is used for generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
27. An electronic device, comprising:
a processor; and
a memory for storing a program for implementing the cultural relic repair method, wherein after the device is powered on and the program for implementing the cultural relic repair method is run by the processor, the following steps are executed: receiving a repair scenario generation request for a specific part of a specified cultural relic; acquiring actual three-dimensional model data of the specific part, wherein the acquiring of the actual three-dimensional model data of the specific part comprises the following steps:
acquiring actual three-dimensional model data of each preset part of the specified cultural relic,
for each preset part, comparing the actual three-dimensional model data of the preset part with the pre-stored original three-dimensional model data of the preset component, acquiring the defect rate of the actual three-dimensional model of the preset component, judging whether the defect rate is greater than a preset defect rate threshold value of the preset component, and if so, determining the preset component as a component to be repaired; and generating at least one repair scheme corresponding to the specific component according to the actual three-dimensional model data of the specific component, a pre-stored historical actual three-dimensional model data set and at least one historical repair scheme corresponding to the historical actual three-dimensional model.
CN201611060601.7A 2016-11-25 2016-11-25 Cultural relic restoration method, device and system Active CN108109212B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611060601.7A CN108109212B (en) 2016-11-25 2016-11-25 Cultural relic restoration method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611060601.7A CN108109212B (en) 2016-11-25 2016-11-25 Cultural relic restoration method, device and system

Publications (2)

Publication Number Publication Date
CN108109212A CN108109212A (en) 2018-06-01
CN108109212B true CN108109212B (en) 2022-02-11

Family

ID=62205380

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611060601.7A Active CN108109212B (en) 2016-11-25 2016-11-25 Cultural relic restoration method, device and system

Country Status (1)

Country Link
CN (1) CN108109212B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108898127B (en) * 2018-07-11 2022-03-01 宁波艾腾湃智能科技有限公司 Anti-counterfeiting method and device based on three-dimensional model matching
CN108961400B (en) * 2018-10-22 2019-01-22 湖南六新智能科技有限公司 A kind of historical relic is intelligent to assist bootstrap technique and guidance system
CN109727209B (en) * 2018-12-13 2021-03-02 北京爱奇艺科技有限公司 Method and device for determining complete image of incomplete cultural relic
CN109934880A (en) * 2019-03-18 2019-06-25 广州欧科信息技术股份有限公司 Cultural relic images restored method, device and equipment based on artificial intelligence
CN110111403A (en) * 2019-04-27 2019-08-09 重庆电子工程职业学院 A kind of line holographic projections dinosaur restoring means
CN112632741B (en) * 2020-10-21 2023-04-07 湖南省博物馆 Cultural relic restoration method and device, storage medium and electronic equipment
CN112530002A (en) * 2020-12-10 2021-03-19 雷磊 Cultural relic virtual simulation intelligent restoration method and device
CN116229010B (en) * 2022-11-29 2024-01-23 北京市园林古建设计研究院有限公司 Three-dimensional visualization auxiliary ancient tree rejuvenation method and device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101141963B1 (en) * 2011-12-15 2014-03-19 관동대학교산학협력단 Filtering method of lidar data by multiple linear regression analysis
CN103253061B (en) * 2012-12-27 2015-11-11 上海建为历保工程科技股份有限公司 Based on the historical building woodcarving restorative procedure of 3D technology
CN104484326B (en) * 2014-09-30 2018-08-21 天津大学 A kind of interaction heuristic approach of the historical relic integrated information based on visual analysis
CN105149862B (en) * 2015-10-21 2017-10-03 武汉大学 A kind of restorative procedure for being broken defect bronze relic

Also Published As

Publication number Publication date
CN108109212A (en) 2018-06-01

Similar Documents

Publication Publication Date Title
CN108109212B (en) Cultural relic restoration method, device and system
US11467709B2 (en) Mixed-reality guide data collection and presentation
US10943401B2 (en) Active visual recognition in mobile augmented reality
US10854006B2 (en) AR-enabled labeling using aligned CAD models
CN106708270B (en) Virtual reality equipment display method and device and virtual reality equipment
CN102906671B (en) Gesture input device and gesture input method
CN108701352A (en) Amending image using the identification based on three dimensional object model and enhancing
CN108197547A (en) Face pose estimation, device, terminal and storage medium
CN106598229A (en) Virtual reality scene generation method and equipment, and virtual reality system
CN110573992B (en) Editing augmented reality experiences using augmented reality and virtual reality
CN107357434A (en) Information input equipment, system and method under a kind of reality environment
Broy et al. Framebox and mirrorbox: Tools and guidelines to support designers in prototyping interfaces for 3d displays
CN112101123A (en) Attention detection method and device
TWI443601B (en) Facial animation system and production method
Marton et al. Natural exploration of 3D massive models on large-scale light field displays using the FOX proximal navigation technique
US20230237777A1 (en) Information processing apparatus, learning apparatus, image recognition apparatus, information processing method, learning method, image recognition method, and non-transitory-computer-readable storage medium
Yang et al. Generating visual scenes from touch
CN106530410A (en) Automobile assembly demonstration system based on augmented reality technology
US11106949B2 (en) Action classification based on manipulated object movement
US20160110909A1 (en) Method and apparatus for creating texture map and method of creating database
US10831277B2 (en) Region of interest classification
Ye et al. 3D curve creation on and around physical objects with mobile AR
CN109461203B (en) Gesture three-dimensional image generation method and device, computer equipment and storage medium
CN108109195B (en) Method, device and system for displaying cultural relic defect component
EP3695294A1 (en) Mixed reality simulator for professional training

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant