CN109917918A - A kind of information processing method and electronic equipment based on augmented reality - Google Patents
A kind of information processing method and electronic equipment based on augmented reality Download PDFInfo
- Publication number
- CN109917918A CN109917918A CN201910172548.7A CN201910172548A CN109917918A CN 109917918 A CN109917918 A CN 109917918A CN 201910172548 A CN201910172548 A CN 201910172548A CN 109917918 A CN109917918 A CN 109917918A
- Authority
- CN
- China
- Prior art keywords
- identity
- explanation
- data
- image
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
This application discloses a kind of information processing method and electronic equipment based on augmented reality, this method comprises: being scanned to object, to generate the characteristic information and posture information of the object；The characteristic stored in the characteristic information and preset feature database is compared, determines the identity of the object, and form corresponding identity；The corresponding explanation data of the object are obtained according to the identity, wherein the explanation data include key diagram picture；Based on the posture information, the explanation image is shown on the carrier in electronic equipment, and the position adaptable with the picture of the object.This method is able to use family during using the electronic equipments such as AR glasses viewing object, receive corresponding explanation data, realize the explanation to object, so that user just can get in the case where not having to other people and helping (such as professional announcer) explains the corresponding content of data (such as watch and explain image), manpower is saved, using effect is improved.
Description
Technical field
This application involves augmented reality (AR) or the fields virtual reality (VR), in particular to a kind of to be based on augmented reality skill
The information processing method and electronic equipment of art.
Background technique
In production and living, people are frequently desired to understand the object for the specific necessary being seen in depth, with
Just more extensive information associated with the object is obtained, but the acquisition process is often inconvenient to realize.Such as it is swum in people
It lookes at during museum, when it is seen that when historical relic, it usually needs the scene explanation of professional guide could really understand this
Historical relic historical background and other information associated with the historical relic, but the quantity of the guide in museum is simultaneously under normal conditions
Seldom, even if having a guide to explain, surrounding audience also can be very more, and often only standing can in the front-seat talent
The content of explanation is solved, a lot of other audiences can not get explaining information well, experience poor.
Summary of the invention
The embodiment of the present application be designed to provide a kind of information processing method based on augmented reality and electronics is set
It is standby.
Embodiments herein adopts the technical scheme that a kind of information processing method based on augmented reality,
Include:
Object is scanned, to generate the characteristic information and posture information of the object；
The characteristic stored in the characteristic information and preset feature database is compared, determines the object
Identity, and form corresponding identity；
The corresponding explanation data of the object are obtained according to the identity, wherein the explanation data include explaining
Image；
Based on the posture information, the explanation image is shown on the carrier in electronic equipment, and with the target
The adaptable position of the picture of object.
Preferably, the method also includes:
Judge whether the object has breakage；
If there is breakage then obtains the repairing model of the object according to the identity, and by the repairing model
It is set on the object.
Preferably, the method also includes:
Image Acquisition is carried out to object to be selected, and the characteristic stored in the image of acquisition and the feature database is compared
It is right, to judge whether the object to be selected is the object.
Preferably, described include: according to the corresponding explanation data of the identity acquisition object
The identity is sent to cloud, so that the cloud is corresponding described according to identity lookup
Data are explained, wherein the identity and the explanation data have incidence relation；
Receive the explanation data that the cloud is sent.
Preferably, described be scanned object, to generate the characteristic information and posture information of the object
Include:
3-D scanning is carried out to the object and forms corresponding 3-D image, and according to default extracting rule from described three
The three-dimensional feature of the object is extracted in dimension image；
The characteristic information and the posture information are generated according to the three-dimensional feature.
Preferably, the explanation data further include explaining audio, and the method also includes: it is shown by the explanation image
Show during position adaptable with the picture of the object on carrier, plays the explanation audio.
The embodiment of the present application also provides a kind of electronic equipment, comprising:
Acquisition module, the acquisition module are configured to be scanned object, to generate the feature letter of the object
Breath and posture information；
Data module, the data module are configured to the characteristic that will be stored in the characteristic information and preset feature database
According to being compared, the identity of the object is determined, and form corresponding identity；
Module is obtained, the acquisition module is configured to obtain the corresponding explanation number of the object according to the identity
According to wherein the explanation data include key diagram picture；
Processing module, the processing module are configured to the posture information, and the explanation image is shown in electronics
On carrier in equipment, and the position adaptable with the picture of the object.
Preferably, the processing module is further configured to:
Judge whether the object has breakage；
If there is breakage then obtains the repairing model of the object according to the identity, and by the repairing model
It is set on the object.
Preferably, the acquisition module is further configured to carry out Image Acquisition to object to be selected, so that the comparison mould
The characteristic stored in the image of acquisition and the feature database is compared block, to judge whether the object to be selected is described
Object.
Preferably, the acquisition module is further configured to:
The identity is sent to cloud, so that the cloud is corresponding described according to identity lookup
Data are explained, wherein the identity and the explanation data have incidence relation；
Receive the explanation data that the cloud is sent.
The beneficial effect of the embodiment of the present application is: this method is able to use family and is watched using electronic equipments such as AR glasses
During object, the corresponding explanation for explaining data, realizing to object is received, so that user is not having to other people (as specially
Industry announcer) help in the case where just can get and explain the corresponding content of data (such as watch and explain image), save
Manpower improves using effect.
Detailed description of the invention
Fig. 1 is the flow chart of the information processing method based on augmented reality of the embodiment of the present application；
Fig. 2 is the flow chart of one embodiment of the information processing method of the embodiment of the present application；
Fig. 3 is the flow chart of step S3 in Fig. 1 of the embodiment of the present application；
Fig. 4 is the flow chart of another specific embodiment of the information processing method of the embodiment of the present application；
Fig. 5 is the structural schematic diagram of the electronic equipment of the embodiment of the present application.
Specific embodiment
The various schemes and feature of the application are described herein with reference to attached drawing.
It should be understood that various modifications can be made to the embodiment applied herein.Therefore, description above should not regard
To limit, and only as the example of embodiment.Those skilled in the art will expect in the scope and spirit of the present application
Other modifications.
The attached drawing being included in the description and forms part of the description shows embodiments herein, and with it is upper
What face provided is used to explain the application together to substantially description and the detailed description given below to embodiment of the application
Principle.
By the description of the preferred form with reference to the accompanying drawings to the embodiment for being given as non-limiting example, the application's
These and other characteristic will become apparent.
It is also understood that although the application is described referring to some specific examples, those skilled in the art
Member realizes many other equivalents of the application in which can determine, they have feature as claimed in claim and therefore all
In the protection scope defined by whereby.
When read in conjunction with the accompanying drawings, in view of following detailed description, above and other aspect, the feature and advantage of the application will become
It is more readily apparent.
The specific embodiment of the application is described hereinafter with reference to attached drawing；It will be appreciated, however, that applied embodiment is only
Various ways implementation can be used in the example of the application.Known and/or duplicate function and structure and be not described in detail to avoid
Unnecessary or extra details makes the application smudgy.Therefore, applied specific structural and functionality is thin herein
Section is not intended to restrictions, but as just the basis of claim and representative basis be used to instructing those skilled in the art with
Substantially any appropriate detailed construction diversely uses the application.
This specification can be used phrase " in one embodiment ", " in another embodiment ", " in another embodiment
In " or " in other embodiments ", it can be referred to one or more of the identical or different embodiment according to the application.
A kind of information processing method based on augmented reality of the embodiment of the present application, augmented reality (Augmented
Reality, abbreviation AR), it is a kind of position for calculating camera image in real time and angle and plus respective image, video, 3D
The technology of model, the target of this technology are that virtual world is covered in real world and interacted on the screen.This method energy
It is enough particularly applicable on the electronic equipment with augmented reality effect, if the electronic equipment can be AR glasses, AR helmet etc. is set
It is standby.And there is the electronic equipment of augmented reality effect can apply in the scene for needing to explain object for this, so that
User can get corresponding explanation while watching object, can such as apply in museum, and user watches target
It in the scene of historical relic, or applies in merchandise display place, user watches end article etc. wherein.In addition, such as Fig. 1 institute
Show, method includes the following steps:
S1 is scanned object, to generate the characteristic information and posture information of object.Object is real world
In specific object, which is corresponding with corresponding characteristic information and posture information, and wherein characteristic information is for characterizing the mesh
Mark object itself has the special feature that, can be used to determine the information of its identity；And posture information is used to characterize the posture of the object
With form.Such as the object is the historical relic in museum or extensive stock in merchandise display place etc., user can be right
It is observed.In one embodiment, the electronic equipment with augmented reality effect of wearing can be used to target in user
Object is observed, and is also able to use the electronic equipment and is scanned to target, is scanned including the surface texture to object,
Such as user wear AR glasses after it can be observed that museum in historical relic, while also can be used the AR glasses to the historical relic into
The scanning of row 3 D stereo, and then the characteristic information and posture information of the historical relic are generated, different objects has its corresponding spy
Reference breath and posture information, as a certain historical relic in museum has its exclusive characteristic information and posture information, certain appearance
State information is not different and different with the placed angle of object, as no matter it lays flat or stands the porcelain historical relic in museum
It stands up and sets, corresponding posture information can't change.
The characteristic stored in characteristic information and preset feature database is compared, determines the identity of object by S2,
And form corresponding identity.Feature database can be preset in different positions, such as can be set in network server, can also
To be set up directly in the electronic equipment with augmented reality effect that user uses, this feature is previously stored with object in library
Characteristic, this feature data the operation such as can be increased, be deleted or modified.In one embodiment, feature database is pre-
Be located in the electronic equipment with augmented reality effect that user uses (at this time feature database can by efficient calling, reduce
Response time), and the characteristic of its storage can be preset for specific usage scenario.Such as first electronics set
Standby to apply in the first museum, user needs then to set using first electronic equipment come the historical relic watched in the first museum
Setting can be constructed in the feature database in first electronic equipment for each historical relic in the first museum, such as may include
The characteristic of all historical relics in first museum.For another example second electronic apparatus application is in the second museum, Yong Huxu
The historical relic to be watched in the second museum using second electronic equipment, then be arranged in the feature database in second electronic equipment
It can be constructed for each historical relic in the second museum, such as may include the characteristic of all historical relics in the second museum
According to.Historical relic in first museum and the second museum is if it is different, then characteristic in the feature database of the first electronic equipment
It is different from the characteristic in the feature database of the second electronic equipment.
In the present embodiment, the characteristic stored in feature database is the related data of object, the feature including object
The information such as the dimensional parameters of information and posture information and object, image information even pertinent audio information.Each object
Respective characteristic is all had, is compared by the characteristic stored in the characteristic information of generation and preset feature database
Afterwards, and it can determine the identity of the object, the characteristic information such as generated is identical as the fisrt feature information in characteristic, just
It can determine that corresponding object is the identity that fisrt feature information is characterized, and then form corresponding identity, such as shape
At corresponding identity ID.
S3 obtains the corresponding explanation data of object according to identity, wherein explaining data includes key diagram picture.In conjunction with
Fig. 4, explaining data is to watch the user of object and being directed to the data, including image, audio, video etc. that object is explained
Content, due to explaining in the larger database (database in such as cloud) that can be preset in server of data, so that AR
The electronic equipments such as mirror can obtain the explanation data from the database of server.The explanation data can be preset criterion numeral
According to, it is of course possible to the operation such as modify or supplement to it.Such as corresponding explanation data are carried out to the historical relic in museum, it is interior
Appearance may include the introduction of the historical background of the historical relic, historical relic itself, information relevant to the historical relic (other such as relevant historical relics
Information) etc..In the present embodiment, since its different corresponding explanation data of each object are also different, need according to body
Part mark obtains corresponding explanation data, and in the present embodiment, explaining data includes key diagram picture, which can fold
It is added on the image of object, to carry out more vivid explanation to object, user is more fully understood
The object, the explanation image can occur in the form of text, picture, video etc..
S4 is based on posture information, will explain image and shows on the carrier in electronic equipment, and mutually fits with the picture of object
The position answered.Specifically, it can will explain image and show carrier (such as mirror of AR glasses in electronic equipment (such as AR glasses)
Piece) on the position adaptable with the picture of object, can also play and explain audio etc., as user is watching mesh using electronic equipment
When marking object, object is to be shown with three-dimensional image and be imaged on carrier, can will explain image according to the imaging of object and show
Show the position adaptable on carrier and with the picture of object, so that the explanation image can't be to picture of the object on carrier
It interferes or blocks.For example, user watches the historical relic in museum using AR glasses, historical relic is specific with it
Posture (being corresponding with posture information) shows that historical relic can be seen that carrier can be AR glasses through AR glasses by human eye to user
Eyeglass, i.e. human eye can see the picture of historical relic on carrier, at this time can based on historical relic on carrier at picture, image will be explained
It is shown in position appropriate on carrier, such as is shown in side or the surrounding of imaging, to watch the historical relic not influencing user
While can play the role of explanation to the historical relic, effectively raise the experience of user.
In one embodiment of the application, as shown in Figure 2 and Fig. 4 is combined, this method is further comprising the steps of:
S5, judges whether object has breakage.Object breakage is object to be incomplete, due to many reasons, target
Object may be complete, it is also possible to and it is incomplete, such as historical relic in museum is not good at due to saving and causes incompleteness, such as porcelain
There is gap in device, and situations such as abrasion occurs in bronze ware.It needs to observe user using electronic equipment in the present embodiment
Object carries out the judgement of integrity degree, such as can by in database (in one embodiment be above-mentioned feature database)
Related data, which is compared, to be judged, which can be set the electronics with augmented reality effect used in user and set
The AR glasses electronic equipment that user uses when in standby, also can be set on the server, such as being arranged on the server can lead to
It crosses network login server and the related data of database is inquired and compared, to judge whether object has breakage.
Such as the characteristic stored in feature database includes damaged mark, has indicated that since the historical relic self-study examination Gu is excavated be damaged shape
State determines that the historical relic has breakage so as to identify by breakage.
Repairing model if there is the damaged repairing model for then obtaining object according to identity, and is set in mesh by S6
It marks on object.The repairing model of object is to carry out digitlization repairing to damaged object by way of repairing in advance and formed
Model, generate repairing model need to be stored, such as can store on the server.User is seen using electronic equipments such as AR glasses
When seeing object, if it is determined that object has the damaged network that can then be passed through according to the identity of the object from server
Whether inquiry is stored with corresponding repairing model, if there is then the available repairing model, identity illustrate the target
The identity of object can be the data such as identity ID.After getting the repairing model of object, which is set in object
On, certain repairing model can be only the damaged portion of repairing, be also possible to the complete model of object, so that when that will repair
Model can be to user intuitively to experience after being set on object, and it is non-damaged state that user, which can see the object,
Under image.
In one embodiment of the application, this method is further comprising the steps of: carrying out Image Acquisition to object to be selected, and will
The characteristic stored in the image of acquisition and feature database is compared, to judge whether object to be selected is object.
Specifically, object to be selected is not necessarily the non-historical relic equipment in object, such as museum, as light units,
The articles holding table etc. for putting historical relic is not object, and in the present embodiment, user checks object to be selected using electronic equipments such as AR glasses,
And Image Acquisition is carried out to object to be selected, and the characteristic stored in the image of acquisition and feature database is compared, such as special
Levy lab setting in the electronic equipment with augmented reality effect that user uses when, can be based on this feature library to object to be selected into
Row quickly judgement, and then object (such as historical relic) is determined whether it is, it can be then scanned if it is object
Operation.Judge whether object to be selected is that object can effectively avoid carrying out maloperation to non-targeted object, further improves knowledge
The accuracy of other object.
In one embodiment of the application, as shown in figure 3, described obtain the corresponding solution of object according to identity
The step of saying data the following steps are included:
Identity is sent to cloud by S31, so that corresponding explanation data are searched according to identity in cloud,
Middle identity and explanation data have incidence relation；
S32 receives the explanation data that cloud is sent.
Specifically, each object is corresponding with corresponding explanation data, explains data and is arranged according to actual needs, example
Such as the historical relic in museum is explained, or the exhibit in sales field is explained, it is lively and rich due to generally requiring
Rich explanation, thus it is larger for the explanation data of museum or sales field, it can will explain data storage beyond the clouds, call
The identity information of object is sent to cloud when explaining data, it is corresponding that the identity information according to identity information is searched in cloud
Data are explained, wherein identity and explanation data have incidence relation, for example, the first identity with first object object is closed
Connection has the first explanation data and second to explain data, is explained using the first explanation data first object object, if with
Family, which wants to know about, more then can also obtain the second explanation with the correlation circumstance of the second object as first object species
Data, and the electronic equipments such as AR glasses are sent to as user's explanation by cloud.Such as first object object is first porcelain
Device vase, be corresponding with first china vase first explain data, if user is watching first china vase and connecing
By the explanation of the electronic equipments such as AR glasses, other second porcelain similar with first china vase are wanted to know about in the process
The explanation of device vase, then it is that user explains that corresponding second explanation data, which can be used, to meet the different need of user
It wants.
It is described that object is scanned in one embodiment of the application, to generate the characteristic information of object
And the step of posture information, forms corresponding 3-D image the following steps are included: carrying out 3-D scanning to object, and according to pre-
If extracting rule extracts the three-dimensional feature of object from 3-D image；Characteristic information and posture letter are generated according to three-dimensional feature
Breath.
Specifically, since object is usually to be presented to user in the form of 3 D stereo, then user uses AR glasses
Wait electronic equipments that can carry out the 3-D scanning of different angle when checking the object from different angles to it, to be formed
Corresponding 3-D image may then pass through the three-dimensional feature that preset algorithm extracts object from 3-D image, such as use
SLAM algorithm, SfM algorithm, PnP algorithm or algorithms of different the default extracting rule such as combination extract three-dimensional feature, calculate simultaneously
Obtain the characteristic information and posture information of object.
In one embodiment of the application, the explanation data further include explaining audio, the method also includes: it is inciting somebody to action
During explanation image is shown in position adaptable with the picture of object on carrier, the explanation audio is played.It is specific next
It says, explains data and include key diagram picture and explain audio, explain image and be shown in carrier (such as AR in the electronic equipments such as AR glasses
The eyeglass of glasses) on and the position adaptable with the picture of object (such as displaying target object on carrier at picture surrounding margins
Place), for user's viewing, while explanation audio is played, the side that can be played simultaneously by explaining image with explanation audio in this way
Formula is abundant to explain content, improves and explains effect.
The embodiment of the present application also provides a kind of electronic equipment, which has the function of augmented reality, and enhancing is existing
Real (Augmented Reality, abbreviation AR) is a kind of position for calculating camera image in real time and angle and plus corresponding
The technology of image, video, 3D model, the target of this technology are that virtual world is covered in real world and carried out mutual on the screen
It is dynamic.The electronic equipment can be AR glasses, the equipment such as AR helmet.And there is the electronic equipment of augmented reality effect can apply for this
In the scene for needing to explain object, so that user can get corresponding solution while watching object
It says, can such as apply in museum, user watches in the scene of target historical relic, or applies in merchandise display place, uses
End article etc. is watched at family wherein.As shown in Figure 5 and Fig. 4 is combined, which includes:
Acquisition module, acquisition module are configured to be scanned object, to generate the characteristic information and posture of object
Information.Object is specific object in the real world, which is corresponding with corresponding characteristic information and posture information, wherein
Characteristic information itself has the special feature that for characterizing the object, can be used to determine the information of its identity；And posture information is used
In the posture and form that characterize the object.Such as the object is the historical relic or each in merchandise display place in museum
Kind commodity etc., user can observe it.In one embodiment, making with augmented reality for wearing can be used in user
Electronic equipment observes object, is also able to use acquisition module and is scanned to target, including to object
Surface texture is scanned, such as the historical relic in museum is observed that after user's wearing AR glasses, while also can be used
Acquisition module in the AR glasses carries out 3 D stereo scanning to the historical relic, and then generates the characteristic information and posture letter of the historical relic
Breath, different objects have its corresponding characteristic information and posture information, as a certain historical relic in museum has its exclusive
Characteristic information and posture information, certain posture information not with the placed angle of object is different and different, such as natural science
Porcelain historical relic in shop no matter its placement that lays flat or stand, corresponding posture information can't change.
Data module, data module are configured to compare the characteristic stored in characteristic information and preset feature database
It is right, determine the identity of object, and form corresponding identity.Feature database can be preset in different positions, can such as set
It sets in network server, also can be arranged directly in the electronic equipment with augmented reality effect that user uses, the spy
It is previously stored with the characteristic of object in sign library, the operation such as this feature data can be increased, be deleted or modified.?
In one embodiment, feature database is preset in the electronic equipment with augmented reality effect that user uses that (feature database can at this time
To reduce the response time by efficient calling), and the characteristic of its storage can be for specific usage scenario come pre-
First it is arranged.Such as first electronic apparatus application in the first museum, user needs to watch using first electronic equipment
Historical relic in one museum, then the feature database in first electronic equipment is arranged in can be for each text in the first museum
Object is constructed, and such as may include the characteristic of all historical relics in the first museum.For another example second electronic apparatus application
In the second museum, user needs the historical relic watched in the second museum using second electronic equipment, then is arranged at this
Feature database in second electronic equipment can be constructed for each historical relic in the second museum, and it is rich such as to may include second
The characteristic of all historical relics in object shop.Historical relic in first museum and the second museum is if it is different, then the first electronics is set
Characteristic in standby feature database is different from the characteristic in the feature database of the second electronic equipment.
In the present embodiment, the characteristic stored in feature database is the related data of object, the feature including object
The information such as the dimensional parameters of information and posture information and object, image information even pertinent audio information.Each object
Respective characteristic is all had, in the characteristic that data module will store in the characteristic information of generation and preset feature database
After being compared, and it can determine the identity of the object, the fisrt feature letter in the characteristic information and characteristic such as generated
Manner of breathing is same, just can determine that corresponding object is the identity that fisrt feature information is characterized, and then forms corresponding identity
Mark, such as forms corresponding identity ID.
Module is obtained, module is obtained and is configured to obtain the corresponding explanation data of object according to identity, wherein explaining
Data include key diagram picture.In conjunction with Fig. 4, explaining data is to watch the user of object and being directed to the number that object is explained
According to, including the contents such as image, audio, video, due to explaining larger database (such as cloud that can be preset in server of data
The database at end) in, so that the acquisition module in the electronic equipments such as AR glasses obtains the explanation number from the database of server
According to.The explanation data can be preset normal data, it is of course possible to the operation such as modify or supplement to it.Such as to natural science
Historical relic in shop carries out corresponding explanation data, and content may include the introduction of the historical background of the historical relic, historical relic itself and be somebody's turn to do
The relevant information of historical relic (information of other such as relevant historical relics).In the present embodiment, due to its different correspondence of each object
Explanation data be also different, obtain module needs corresponding explanation data, the present embodiment are obtained according to identity
In, explaining data includes key diagram picture, which can be superimposed upon on the image of object, to carry out more to object
The explanation for adding image, allows user more fully to understand the object, which can be with text, picture, view
The forms such as frequency occur.
Processing module, processing module are configured to posture information, will explain image and show the carrier in electronic equipment
On, and the position adaptable with the picture of object.Specifically, image can will be explained to show at electronic equipment (such as AR glasses)
In carrier (such as eyeglasses of AR glasses) on the position adaptable with the picture of object, can also play and explain audio etc., user
When using electronic equipment viewing object, object is to be shown with three-dimensional image and be imaged on carrier, and processing module can be with
According to the imaging of object, image will be explained and show the position adaptable on carrier and with the picture of object, so that the explanation
Image can't be interfered or be blocked to picture of the object on carrier.For example, user is using AR glasses to museum
In historical relic watched, historical relic with its specific posture (being corresponding with posture information) to user show, historical relic penetrate AR glasses
It can be seen by human eye, carrier can be the eyeglass of AR glasses, i.e. human eye can see the picture of historical relic on carrier, handle mould at this time
Block can based on historical relic on carrier at picture, image will be explained and show the position appropriate on carrier, such as be shown in imaging
Side or surrounding, so that the explanation to the historical relic can be played the role of while not influencing user and watching the historical relic, effectively
The experience for improving user.
In one embodiment of the application, in conjunction with Fig. 4, processing module is further configured to: judging whether object has
It is damaged；If there is the damaged repairing model for then obtaining object according to identity, and repairing model is set on object.
Object breakage is object to be incomplete, and due to many reasons, object may be complete, it is also possible to residual
It is scarce, such as historical relic in museum is not good at due to saving and causes incompleteness, if gap occurs in porcelain, bronze ware occurs
Situations such as abrasion.Processing module needs to carry out integrity degree using the object that electronic equipment is observed to user in the present embodiment
Judgement, such as can by be compared with the related data in database (in one embodiment be above-mentioned feature database) into
Row judgement, the database can be set in the electronic equipment with augmented reality effect that user uses, also can be set
On server, such as setting on the server when the AR glasses electronic equipment that uses of user in processing module can pass through network
Game server is simultaneously inquired and is compared to the related data of database, to judge whether object has breakage.Such as it is special
The characteristic stored in sign library includes damaged mark, has indicated that since the historical relic self-study examination Gu is excavated be damaged state, thus
It can be identified by breakage and determine that the historical relic has breakage.
The repairing model of object is to carry out digitlization repairing and shape to damaged object by way of repairing in advance
At model, generate repairing model need to be stored, such as can store on the server.User uses the electronic equipments such as AR glasses
When watching object, network can be passed through according to the identity of the object if processing module judges that object has breakage
It is inquired from server and whether is stored with corresponding repairing model, if there is then available repairing model, identity table
The identity for having shown the object can be the data such as identity ID.After processing module gets the repairing model of object, this is repaired
Multiple model is set on object, and certain repairing model can be only the damaged portion of repairing, is also possible to the complete of object
Integral mould, so that can be to user intuitively to experience after repairing model is set on object, user can see
The object is the image under non-damaged state.
In one embodiment of the application, acquisition module is further configured to carry out Image Acquisition to object to be selected, so that
The characteristic stored in the image of acquisition and feature database is compared comparison module, to judge whether object to be selected is target
Object.
Specifically, object to be selected is not necessarily the non-historical relic equipment in object, such as museum, as light units,
The articles holding table etc. for putting historical relic is not object, and in the present embodiment, user checks object to be selected using electronic equipments such as AR glasses,
Acquisition module carries out Image Acquisition to object to be selected, and the characteristic stored in the image of acquisition and feature database is compared,
Such as feature lab setting in the electronic equipment with augmented reality effect that user uses when, can be treated based on this feature library
It selects object quickly to be judged, and then determines whether it is object, the behaviour such as can then be scanned to it if it is object
Make.Judge whether object to be selected is that object can effectively avoid carrying out maloperation to non-targeted object, further improves identification
The accuracy of object.
In one embodiment of the application, obtains module and be further configured to: identity is sent to cloud, so that
Corresponding explanation data are searched according to identity in cloud, and wherein identity and explanation data have incidence relation；It receives
The explanation data that cloud is sent.
Specifically, each object is corresponding with corresponding explanation data, explains data and is arranged according to actual needs, example
Such as the historical relic in museum is explained, or the exhibit in sales field is explained, it is lively and rich due to generally requiring
Rich explanation, thus it is larger for the explanation data of museum or sales field, it can will explain data storage beyond the clouds, call
Module being obtained when explaining data, the identity information of object being sent to cloud, the identity information is searched according to identity information in cloud
Corresponding explanation data, wherein identity and explanation data have incidence relation, for example, the first body with first object object
Part mark is associated to have the first explanation data and second to explain data, is solved to first object object using the first explanation data
Say, if user want to know about more with the correlation circumstance of the second object as first object species if can also obtain
Second explains data, and is sent to the electronic equipments such as AR glasses by cloud as user's explanation.Such as first object object is one
A first china vase, be corresponding with first china vase first explain data, if user is watching first porcelain
Vase and the explanation for receiving the electronic equipments such as AR glasses want to know about other similar with first china vase in the process
The second china vase explanation, then can be used it is corresponding second explanation data be user explain, to meet user
Different need.
In one embodiment of the application, acquisition module is further configured to: being carried out 3-D scanning to object and is formed
Corresponding 3-D image, and the three-dimensional feature of object is extracted according to default extracting rule from 3-D image；According to three-dimensional special
Sign generates characteristic information and posture information.
Specifically, since object is usually to be presented to user in the form of 3 D stereo, then user uses AR glasses
Equal electronic equipments, and different angles can be carried out to it when checking the object from different angles by acquisition module therein
The 3-D scanning of degree may then pass through preset algorithm to form corresponding 3-D image to extract mesh from 3-D image
The three-dimensional feature of object is marked, such as uses the default extracting rule of combination of SLAM algorithm, SfM algorithm, PnP algorithm or algorithms of different
Three-dimensional feature is extracted, while the characteristic information and posture information of object is calculated.
In one embodiment of the application, explaining data further includes explaining audio, and processing module is further configured to:
Image will be explained to show during the adaptable position of the picture on carrier and with object, play and explain audio.It is specific next
It says, explains data and include key diagram picture and explain audio, explain image and be shown in carrier (such as AR in the electronic equipments such as AR glasses
The eyeglass of glasses) on and the position adaptable with the picture of object (such as displaying target object on carrier at picture surrounding margins
Place), for user's viewing, while processing module plays and explains audio, in this way can be by explaining image and explaining audio simultaneously
The mode of broadcasting is abundant to explain content, improves and explains effect.
Above embodiments are only the exemplary embodiment of the application, are not used in limitation the application, the protection scope of the application
It is defined by the claims.Those skilled in the art can make respectively the application in the essence and protection scope of the application
Kind modification or equivalent replacement, this modification or equivalent replacement also should be regarded as falling within the scope of protection of this application.
Claims (10)
1. a kind of information processing method based on augmented reality, comprising:
Object is scanned, to generate the characteristic information and posture information of the object；
The characteristic stored in the characteristic information and preset feature database is compared, determines the body of the object
Part, and form corresponding identity；
The corresponding explanation data of the object are obtained according to the identity, wherein the explanation data include key diagram
Picture；
Based on the posture information, the explanation image is shown on the carrier in electronic equipment, and with the object
As adaptable position.
2. according to the method described in claim 1, the method also includes:
Judge whether the object has breakage；
If there is breakage then obtains the repairing model of the object according to the identity, and the repairing model is arranged
On the object.
3. according to the method described in claim 1, the method also includes:
Image Acquisition is carried out to object to be selected, and the characteristic stored in the image of acquisition and the feature database is compared,
To judge whether the object to be selected is the object.
4. according to the method described in claim 1, described obtain the corresponding explanation of the object according to the identity
Data include:
The identity is sent to cloud, so that the corresponding explanation is searched according to the identity in the cloud
Data, wherein the identity and the explanation data have incidence relation；
Receive the explanation data that the cloud is sent.
5. according to the method described in claim 1, described be scanned object, to generate the feature letter of the object
Breath and posture information include:
3-D scanning is carried out to the object and forms corresponding 3-D image, and according to default extracting rule from the three-dimensional figure
The three-dimensional feature of the object is extracted as in；
The characteristic information and the posture information are generated according to the three-dimensional feature.
6. according to the method described in claim 1, the explanation data further include explain audio, the method also includes: will
During the explanation image is shown in position adaptable with the picture of the object on carrier, the interpretation speech is played
Frequently.
7. a kind of electronic equipment, comprising:
Acquisition module, the acquisition module are configured to be scanned object, with generate the object characteristic information and
Posture information；
Data module, the data module be configured to the characteristic that will be stored in the characteristic information and preset feature database into
Row compares, and determines the identity of the object, and form corresponding identity；
Module is obtained, the acquisition module is configured to obtain the corresponding explanation data of the object according to the identity,
Wherein the explanation data include key diagram picture；
Processing module, the processing module are configured to the posture information, and the explanation image is shown in electronic equipment
In carrier on, and the position adaptable with the picture of the object.
8. electronic equipment according to claim 7, the processing module is further configured to:
Judge whether the object has breakage；
If there is breakage then obtains the repairing model of the object according to the identity, and the repairing model is arranged
On the object.
9. electronic equipment according to claim 7, the acquisition module is further configured to adopt object to be selected progress image
Collection, so that the characteristic stored in the image of acquisition and the feature database is compared the comparison module, to judge
State whether object to be selected is the object.
10. electronic equipment according to claim 7, the acquisition module is further configured to:
The identity is sent to cloud, so that the corresponding explanation is searched according to the identity in the cloud
Data, wherein the identity and the explanation data have incidence relation；
Receive the explanation data that the cloud is sent.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910172548.7A CN109917918A (en) | 2019-03-07 | 2019-03-07 | A kind of information processing method and electronic equipment based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910172548.7A CN109917918A (en) | 2019-03-07 | 2019-03-07 | A kind of information processing method and electronic equipment based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109917918A true CN109917918A (en) | 2019-06-21 |
Family
ID=66963728
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910172548.7A Pending CN109917918A (en) | 2019-03-07 | 2019-03-07 | A kind of information processing method and electronic equipment based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109917918A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110992569A (en) * | 2019-11-15 | 2020-04-10 | 重庆特斯联智慧科技股份有限公司 | Shared intelligent travel service method and system |
| CN111221803A (en) * | 2019-12-27 | 2020-06-02 | 深圳云天励飞技术有限公司 | Characteristic library management method and coprocessor |
| CN111504308A (en) * | 2020-04-21 | 2020-08-07 | 南京比特互动创意科技有限公司 | Intelligent exhibition hall supporting system based on AR technology |
| CN111625091A (en) * | 2020-05-14 | 2020-09-04 | 佳都新太科技股份有限公司 | Label overlapping method and device based on AR glasses |
| CN111640171A (en) * | 2020-06-10 | 2020-09-08 | 浙江商汤科技开发有限公司 | Historical scene explaining method and device, electronic equipment and storage medium |
| CN112150507A (en) * | 2020-09-29 | 2020-12-29 | 厦门汇利伟业科技有限公司 | Method and system for synchronously reproducing 3D model of object posture and displacement |
| CN112445321A (en) * | 2019-08-28 | 2021-03-05 | 菜鸟智能物流控股有限公司 | Article processing method and device and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105224618A (en) * | 2015-09-20 | 2016-01-06 | 杭州电子科技大学 | Based on expansion of content method and the device of the paper media of mobile terminal |
| CN105468159A (en) * | 2016-01-11 | 2016-04-06 | 湖北视纪印象科技股份有限公司 | Traveling instruction system based on augmented reality (AR) and method thereof |
| US20170153787A1 (en) * | 2015-10-14 | 2017-06-01 | Globalive Xmg Jv Inc. | Injection of 3-d virtual objects of museum artifact in ar space and interaction with the same |
| CN108829250A (en) * | 2018-06-04 | 2018-11-16 | 苏州市职业大学 | A kind of object interaction display method based on augmented reality AR |
| CN108876880A (en) * | 2018-04-22 | 2018-11-23 | 平安科技（深圳）有限公司 | Learning method, device, equipment and storage medium based on ARkit |
| CN109085966A (en) * | 2018-06-15 | 2018-12-25 | 广东康云多维视觉智能科技有限公司 | A kind of three-dimensional display system and method based on cloud computing |
| CN109254659A (en) * | 2018-08-30 | 2019-01-22 | Oppo广东移动通信有限公司 | Control method, device, storage medium and the wearable device of wearable device |
| CN109300533A (en) * | 2018-09-13 | 2019-02-01 | 广州中医药大学(广州中医药研究院) | Image display method and apparatus |
-
2019
- 2019-03-07 CN CN201910172548.7A patent/CN109917918A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105224618A (en) * | 2015-09-20 | 2016-01-06 | 杭州电子科技大学 | Based on expansion of content method and the device of the paper media of mobile terminal |
| US20170153787A1 (en) * | 2015-10-14 | 2017-06-01 | Globalive Xmg Jv Inc. | Injection of 3-d virtual objects of museum artifact in ar space and interaction with the same |
| CN105468159A (en) * | 2016-01-11 | 2016-04-06 | 湖北视纪印象科技股份有限公司 | Traveling instruction system based on augmented reality (AR) and method thereof |
| CN108876880A (en) * | 2018-04-22 | 2018-11-23 | 平安科技（深圳）有限公司 | Learning method, device, equipment and storage medium based on ARkit |
| CN108829250A (en) * | 2018-06-04 | 2018-11-16 | 苏州市职业大学 | A kind of object interaction display method based on augmented reality AR |
| CN109085966A (en) * | 2018-06-15 | 2018-12-25 | 广东康云多维视觉智能科技有限公司 | A kind of three-dimensional display system and method based on cloud computing |
| CN109254659A (en) * | 2018-08-30 | 2019-01-22 | Oppo广东移动通信有限公司 | Control method, device, storage medium and the wearable device of wearable device |
| CN109300533A (en) * | 2018-09-13 | 2019-02-01 | 广州中医药大学(广州中医药研究院) | Image display method and apparatus |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112445321A (en) * | 2019-08-28 | 2021-03-05 | 菜鸟智能物流控股有限公司 | Article processing method and device and electronic equipment |
| CN110992569A (en) * | 2019-11-15 | 2020-04-10 | 重庆特斯联智慧科技股份有限公司 | Shared intelligent travel service method and system |
| CN111221803A (en) * | 2019-12-27 | 2020-06-02 | 深圳云天励飞技术有限公司 | Characteristic library management method and coprocessor |
| CN111221803B (en) * | 2019-12-27 | 2024-01-09 | 深圳云天励飞技术有限公司 | Feature library management method and coprocessor |
| CN111504308A (en) * | 2020-04-21 | 2020-08-07 | 南京比特互动创意科技有限公司 | Intelligent exhibition hall supporting system based on AR technology |
| CN111625091A (en) * | 2020-05-14 | 2020-09-04 | 佳都新太科技股份有限公司 | Label overlapping method and device based on AR glasses |
| CN111625091B (en) * | 2020-05-14 | 2021-07-20 | 佳都科技集团股份有限公司 | Label overlapping method and device based on AR glasses |
| CN111640171A (en) * | 2020-06-10 | 2020-09-08 | 浙江商汤科技开发有限公司 | Historical scene explaining method and device, electronic equipment and storage medium |
| CN111640171B (en) * | 2020-06-10 | 2023-09-01 | 浙江商汤科技开发有限公司 | Historical scene explanation method and device, electronic equipment and storage medium |
| CN112150507A (en) * | 2020-09-29 | 2020-12-29 | 厦门汇利伟业科技有限公司 | Method and system for synchronously reproducing 3D model of object posture and displacement |
| CN112150507B (en) * | 2020-09-29 | 2024-02-02 | 厦门汇利伟业科技有限公司 | 3D model synchronous reproduction method and system for object posture and displacement |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109917918A (en) | A kind of information processing method and electronic equipment based on augmented reality | |
| US20120162384A1 (en) | Three-Dimensional Collaboration | |
| CN105320271B (en) | It is calibrated using the head-mounted display of direct Geometric Modeling | |
| CN105210093B (en) | Apparatus, system and method for capturing and displaying appearance | |
| CN105704479B (en) | The method and system and display equipment of the measurement human eye interpupillary distance of 3D display system | |
| US20130300739A1 (en) | Stereoscopic apparel try-on method and device | |
| CN106256122A (en) | Image processing equipment and image processing method | |
| JP2006325165A (en) | Device, program and method for generating telop | |
| US20160371542A1 (en) | Image processing apparatus, method and storage medium | |
| WO2002069272A2 (en) | Real-time virtual viewpoint in simulated reality environment | |
| CN109598796A (en) | Real scene is subjected to the method and apparatus that 3D merges display with dummy object | |
| JP5756322B2 (en) | Information processing program, information processing method, information processing apparatus, and information processing system | |
| US20140043328A1 (en) | Reference Object for Three-Dimensional Modeling | |
| JP2012221261A (en) | Information processing program, information processing method, information processor and information processing system | |
| US11250618B2 (en) | Method and system for estimating the geometry of a scene | |
| CN104750933A (en) | Eyeglass trying on method and system based on Internet | |
| CN104599317A (en) | Mobile terminal and method for achieving 3D (three-dimensional) scanning modeling function | |
| CN108537126A (en) | A kind of face image processing system and method | |
| CN104539868B (en) | A kind of information processing method and electronic equipment | |
| Yuan et al. | A mixed reality system for virtual glasses try-on | |
| CN110765525A (en) | Method, device, electronic equipment and medium for generating scene picture | |
| CN111862340A (en) | Augmented reality data presentation method and device, display equipment and storage medium | |
| CN110431601A (en) | Information processing unit | |
| CN111918114A (en) | Image display method, image display device, display equipment and computer readable storage medium | |
| US20170039768A1 (en) | Apparatus for displaying image content based on pop-up book and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190621 |
|
| RJ01 | Rejection of invention patent application after publication |