CN108711188A - A kind of factory's real time data methods of exhibiting and system based on AR - Google Patents
A kind of factory's real time data methods of exhibiting and system based on AR Download PDFInfo
- Publication number
- CN108711188A CN108711188A CN201810156815.7A CN201810156815A CN108711188A CN 108711188 A CN108711188 A CN 108711188A CN 201810156815 A CN201810156815 A CN 201810156815A CN 108711188 A CN108711188 A CN 108711188A
- Authority
- CN
- China
- Prior art keywords
- image
- identification
- equipment
- real time
- image identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 230000001747 exhibiting effect Effects 0.000 title claims abstract description 11
- 238000013507 mapping Methods 0.000 claims abstract description 98
- 239000011159 matrix material Substances 0.000 claims description 20
- 230000009466 transformation Effects 0.000 claims description 14
- 238000010030 laminating Methods 0.000 claims description 2
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000010304 firing Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Abstract
The factory's real time data methods of exhibiting and system, this method that the invention discloses a kind of based on AR include：It establishes and the unique corresponding image identification of equipment to be presented；Establish real time information mapping table of the image identification with corresponding equipment；Ambient image is obtained, and the image identification in ambient image is identified；The real time information that the image identification of identification is corresponded to equipment, by three-dimensional overlay mode Overlapping display in ambient image.Real information and virtual information can be added in same picture and show by the present invention.
Description
Technical field
The invention belongs to augmented reality fields, specifically, more particularly to a kind of factory's real time data based on AR
Methods of exhibiting and system.
Background technology
In the prior art, factory's real time data is typically to be shown in receiving terminal in a manner of information list, statistical graph etc.,
Lack real-time exhibition platform.
Above-mentioned factory's realtime curve mode disconnects with field device, and site operation personnel is difficult to obtain data in real time,
There is no intuitive impression and experience to the relationship of data and equipment room.
Invention content
In order to solve the above technical problem, the present invention provides a kind of factory's real time data methods of exhibiting based on AR and it is
System, shows real information and virtual information to be added in same picture.
According to an aspect of the invention, there is provided a kind of factory's real time data methods of exhibiting based on AR, including：
It establishes and the unique corresponding image identification of equipment to be presented；
Establish described image mark and the real time information mapping table of corresponding equipment；
Ambient image is obtained, and the image identification in the ambient image is known based on the real time information mapping table
Not；
The real time information that the image identification of identification is corresponded to equipment, by three-dimensional overlay mode Overlapping display in the environment
In image.
According to one embodiment of present invention, described image mark and the real time information mapping table of corresponding equipment are established, into
One step includes：
Establish described image mark and the first mapping relations of corresponding equipment；
Establish the second mapping relations that equipment corresponds to the real time information of equipment with device databases；
According to first mapping relations and the second mapping relations, establishes image identification and reflected with the real time information of corresponding equipment
Firing table.
According to one embodiment of present invention, ambient image is obtained, and the image identification in the ambient image is carried out
Identification, further comprises：
Obtain ambient image；
Obtain the gray feature point in the ambient image；
Image identification is obtained based on the gray feature point；
The image identification of acquisition is matched with the image identification in the real time information mapping table, with the figure to acquisition
As mark is identified.
According to one embodiment of present invention, by the real time information of the image identification of identification and corresponding equipment, pass through three-dimensional
Stacked system Overlapping display further comprises in the ambient image：
Image characteristic point is obtained according to matched image identification in the image identification of acquisition and the real time information mapping table
It is right；
According to described image characteristic point to carrying out projective transformation, to calculate image rotation matrix；
The image identification that identification is obtained from device databases corresponds to the coordinate of equipment, and is based on described image spin moment
Coordinate of the corresponding equipment of the image identification of identification under the first coordinate system, is converted to the second coordinate where ambient image by battle array
Coordinate under system；
Equipment is corresponded at the coordinate under the second coordinate system in the image identification of identification, is drawn and is shown using d engine
The image identification of acquisition corresponds to the threedimensional model of equipment；
The image identification that identification is obtained from device databases corresponds to the real time information of equipment, and Overlapping display is in the ring
At the threedimensional model for corresponding to equipment in the image of border.
According to one embodiment of present invention, establish described image mark and the real time information mapping table of corresponding equipment it
Before, further include：
Coordinate, status information and the attribute information of all equipment to be presented in preset range are obtained in real time, and are stored in institute
It states in device databases.
According to another aspect of the present invention, a kind of factory's real time data display systems based on AR are additionally provided, including：
Image identification establishes module, is configured to establish and the unique corresponding image identification of equipment to be presented；
Mapping table establishes module, is configured to establish described image mark and the real time information mapping table of corresponding equipment；
Image identification identification module is configured to obtain ambient image, and based on the real time information mapping table to described
Image identification in ambient image is identified；
Information superposition module, the image identification for being configured to identify correspond to the real time information of equipment, pass through three-dimensional overlay
Mode Overlapping display is in the ambient image.
According to one embodiment of present invention, the mapping table is established module and is further comprised：
First mapping relations establish module, are configured to the first mapping pass for establishing described image mark with corresponding equipment
System；
Second mapping relations establish module, are configured to establish the real time information that equipment corresponds to equipment with device databases
The second mapping relations；
Mapping table establishes unit, is configured to, according to first mapping relations and the second mapping relations, establish image mark
Know and the real time information mapping table of corresponding equipment.
According to one embodiment of present invention, described image mark identification module further comprises：
Ambient image acquiring unit is configured to obtain ambient image；
Gray feature acquiring unit is configured to obtain the gray feature point in the ambient image；
Image identification acquiring unit is configured to the gray feature point and obtains image identification；
Image identification recognition unit is configured to the image identification that will be obtained and the image in the real time information mapping table
Mark is matched, and is identified with the image identification to acquisition.
According to one embodiment of present invention, described information laminating module further comprises：
Image characteristic point is configured to according in the image identification of acquisition and the real time information mapping table acquiring unit
Matched image identification obtains image characteristic point pair；
Image rotation matrix acquiring unit is configured to according to described image characteristic point to carrying out projective transformation, to resolve
Go out image rotation matrix；
Coordinate transformation unit, the image identification for being configured to obtain identification from device databases correspond to the coordinate of equipment,
And it is based on described image spin matrix, coordinate of the corresponding equipment of the image identification of identification under the first coordinate system is converted into ring
The coordinate under the second coordinate system where the image of border；
Threedimensional model drawing unit is configured to correspond to coordinate of the equipment under the second coordinate system in the image identification of identification
Place, is drawn using d engine and shows that the image identification of acquisition corresponds to the threedimensional model of equipment；
Information superposition unit, the image identification for being configured to obtain identification from device databases correspond to the real-time letter of equipment
Breath, and Overlapping display is corresponded in the ambient image at the threedimensional model of equipment.
According to one embodiment of present invention, further include real time information acquisition module, be configured to obtain predetermined model in real time
Coordinate, status information and the attribute information of interior all equipment to be presented are enclosed, and is stored in the device databases.
Advantageous effect in the present invention：
In the present invention, real information (ambient image) and virtual information (device coordinate and job information) are added to together
It is shown in one picture, factory's real time data can be by site operation personnel's quick obtaining, and intuitively shows.
Other features and advantages of the present invention will be illustrated in the following description, and partly becomes from specification
It is clear that understand through the implementation of the invention.The purpose of the present invention and other advantages can be by wanting in specification, right
Specifically noted structure is sought in book and attached drawing to realize and obtain.
Description of the drawings
Attached drawing is used to provide further understanding of the present invention, and a part for constitution instruction, the reality with the present invention
It applies example and is used together to explain the present invention, be not construed as limiting the invention.In the accompanying drawings：
Fig. 1 is factory's real time data methods of exhibiting flow chart of AR according to an embodiment of the invention a kind of；
Fig. 2 is factory's real time data display systems structure chart of AR according to an embodiment of the invention a kind of.
Specific implementation mode
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and examples, how to be applied to the present invention whereby
Technological means solves technical problem, and the realization process for reaching technique effect can fully understand and implement.It needs to illustrate
As long as not constituting conflict, each embodiment in the present invention and each feature in each embodiment can be combined with each other,
It is formed by technical solution within protection scope of the present invention.
In the prior art, factory's realtime curve mode disconnects with field device, and site operation personnel is difficult in real time
Data are obtained, do not have intuitive impression and experience to the relationship of data and equipment room.Therefore, the present invention provides one kind being based on AR
Factory's real time data methods of exhibiting and system, by AR image recognition technologys, factory's real time data can be by execute-in-place people
Member's quick obtaining, and intuitively show.It is existing to be also referred to as mixing for AR (AugmentedReality) i.e. augmented realities
It is real.AR is by computer technology, and by virtual Information application to real world, true environment and virtual object are superimposed in real time
It is existed simultaneously to the same picture or space.
First embodiment
According to an aspect of the invention, there is provided a kind of factory's real time data methods of exhibiting based on AR, as shown in Figure 1
For according to a kind of factory's real time data methods of exhibiting flow chart based on AR of one embodiment of the present of invention, below with reference to Fig. 1
It is next that the present invention is described in detail.
First, in step s 110, it establishes and the unique corresponding image identification of equipment to be presented.Specifically, for each
Equipment to be presented establishes corresponding unique images mark.The image identification can be simple lines or pattern mark
Know, or the specific pattern designed as required, the invention is not limited thereto.
In the step s 120, real time information mapping table of the image identification with corresponding equipment is established.It is stored in the mapping table
The mapping relations of image identification and corresponding equipment can obtain the real-time letter that image identification corresponds to equipment by the mapping relations
Breath.
It establishes image identification and specifically includes the following steps with the real time information mapping table of corresponding equipment.First, it establishes
First mapping relations of image identification and corresponding equipment.That is, establishing corresponding unique figure to each equipment
As mark, i.e. an image identification corresponds to an equipment, and the image identification of distinct device is different.
Then, the second mapping relations that equipment corresponds to the real time information of equipment with device databases are established.Specifically, logical
It crosses and establishes the second mapping relations, after determining equipment, the real time information of corresponding equipment can be obtained from device databases.
Before establishing real time information mapping table of the image identification with corresponding equipment, a device databases are also established.It should
Device databases are stored with coordinate, status information and the attribute information of all equipment to be presented in preset range.Also, it is also real
When monitor the information change situation of each equipment to be presented, and when monitoring that the information of each equipment to be presented changes, to depositing
The data stored up in device databases timely update.
In step s 130, ambient image is obtained, and based on the real time information mapping table to the image in ambient image
Mark is identified.That is, acquisition includes the ambient image of image identification, then identified from ambient image corresponding with equipment
Image identification.If not containing image identification corresponding with equipment in the ambient image obtained, ambient image is reacquired,
And the image identification in the ambient image of reacquisition is identified.
The following steps are specifically included when image identification in ambient image is identified.First, environment map is obtained
Picture, it is preferable that acquisition includes the ambient image of image identification corresponding with equipment.It can be acquired by camera to be presented
The ambient enviroment image of equipment can also obtain the ambient enviroment image of equipment to be presented by other image collecting devices.
Then, the gray feature point in ambient image is obtained.Specifically, the gray feature point in ambient image is obtained, with
Object in ambient image is identified.These gray feature points had both included that the gray scale of image identification corresponding with equipment is special
Sign, also includes the gray feature of other background images.Wherein, in ambient image image identification corresponding with equipment gray feature
Target gray feature.
Then, it is based on gray feature point and obtains image identification.Specifically, being solved to the gray feature point in ambient image
Analysis, can obtain corresponding gradation of image feature.Gradation of image feature is combined, corresponding image identification can be obtained.
Finally, the image identification of acquisition is matched with the image identification in mapping table, with the image identification to acquisition
It is identified.
Specifically, after the image identification in obtaining ambient image, the image that will store in the image identification and mapping table
Mark is matched, only successful match, just can determine that the corresponding equipment of the image identification, and then obtain the correspondence equipment
Real time information.Otherwise, illustrate the mapping relations for not preserving the image identification and corresponding equipment in mapping table, the figure cannot be obtained
As the real time information of the corresponding equipment of mark.
It is folded by three-dimensional overlay mode by the real time information of the image identification of identification and corresponding equipment in step S140
Add and is shown in ambient image.
Specifically, by the real time information of the image identification of identification and corresponding equipment, Overlapping display, can be in ambient image
Equipment and corresponding real time information are also loaded in ambient image.
By the real time information of the image identification of identification and corresponding equipment, by three-dimensional overlay mode Overlapping display in environment map
The following steps are specifically included as in.
First, image characteristic point is obtained according to matched image identification in the image identification of acquisition and real time information mapping table
It is right.That is, the characteristics of image in the image identification of acquisition is corresponding with matched image identification in real time information mapping table
Characteristics of image matched, matched benchmark is specific image characteristic point in image identification.Pass through the image mark that will be obtained
Knowledge obtains characteristics of image with matched image identification in real time information mapping table and is matched, and can obtain corresponding characteristics of image
Point pair.
Then, according to image characteristic point to carrying out projective transformation, to calculate image rotation matrix.Specifically, according to spy
Sign point calculates image rotation matrix and spatial positional information to get to picture posture to carrying out projective transformation.
Then, the image identification that identification is obtained from device databases corresponds to the coordinate of equipment, and is based on image rotation square
Coordinate of the corresponding equipment of the image identification of identification under the first coordinate system, is converted to the second coordinate where ambient image by battle array
Coordinate under system.Posture of picture posture i.e. the first coordinate system relative to the second coordinate system where the camera of mobile terminal.It utilizes
Coordinate of the corresponding equipment of identification feature under the first coordinate system is converted to the coordinate under the second coordinate system by spin matrix.Specifically
, after to the image identification identification in ambient image, according to the first mapping relations preserved in information MAP table, it may be determined that
The corresponding equipment of image identification in ambient image.After determining corresponding equipment, from device databases can obtain this sets
The standby coordinate under the first coordinate system of picture.The coordinate of each equipment picture is the relative position coordinates using picture centre as origin
System, still, the coordinate system where the image observed by camera are camera coordinates system (the second coordinate of camera itself
System).Therefore, the image identification of identification need to be corresponded into equipment in geodetic coordinates according to the transformational relation between the two coordinate systems
Coordinate under system is converted to the coordinate under camera coordinates system, in this way can carry out equipment to be presented correctly under camera coordinates system
Display.
Then, equipment is corresponded at the coordinate under the second coordinate system in the image identification of identification, drawn using d engine
And show that the image identification of acquisition corresponds to the threedimensional model of equipment.
Specifically, the image identification in identification corresponds to equipment at the coordinate under the second coordinate system, painted using d engine
The threedimensional model of the corresponding equipment of system, is then overlapped display at the coordinate by the threedimensional model under the second coordinate system.In this way,
The corresponding equipment of the image identification of identification can be shown in ambient image.
Finally, the image identification that identification is obtained from device databases corresponds to the real time information of equipment, and Overlapping display exists
At the threedimensional model for corresponding to equipment in ambient image.
In the present invention, real information (ambient image) and virtual information (device coordinate and job information) are added to together
It is shown in one picture, factory's real time data can be by site operation personnel's quick obtaining, and intuitively shows.
Second embodiment
According to an aspect of the invention, there is provided a kind of factory's real time data display systems based on AR, as shown in Figure 2
For according to a kind of factory's real time data display systems structure chart based on AR of one embodiment of the present of invention, below with reference to Fig. 2
It is next that the present invention is described in detail.
Factory's real time data display systems based on AR, including image identification establishes module, mapping table establishes module, figure
As mark identification module and information superposition module.Wherein, image identification establish module be configured to establish it is unique with equipment to be presented
Corresponding image identification.Mapping table establishes module and is configured to the real time information mapping table for establishing image identification with corresponding equipment.Figure
As mark identification module be configured to obtain ambient image, and and based on the real time information mapping table to the image in ambient image
Mark, which is identified, is identified the image identification in ambient image.Information superposition module is configured to the image identification that will be identified
The real time information of corresponding equipment, by three-dimensional overlay mode Overlapping display in ambient image.
In one embodiment of the invention, which establishes module and further comprises that the first mapping relations establish mould
Block, the second mapping relations establish module and mapping table establishes unit.Wherein, the first mapping relations establish module and are configured to establish institute
State first mapping relations of the image identification with corresponding equipment.Second mapping relations establish module and are configured to establish equipment and number of devices
According to the second mapping relations of the real time information for corresponding to equipment in library.Mapping table establish unit be configured to according to the first mapping relations and
Second mapping relations establish real time information mapping table of the image identification with corresponding equipment.
Specifically, first, the first mapping relations establish the first mapping relations that module establishes image identification with corresponding equipment.
That is, establishing corresponding unique image identification to each equipment, i.e., an image identification corresponds to an equipment,
The image identification of distinct device is different.
Then, the second mapping relations establish module and establish equipment corresponds to the real time information of equipment with device databases
Two mapping relations.Specifically, by establishing the second mapping relations, after determining equipment, can be obtained from device databases pair
Answer the real time information of equipment.
Before establishing real time information mapping table of the image identification with corresponding equipment, a device databases are also established.It should
Device databases are stored with coordinate, status information and the attribute information of all equipment to be presented in preset range.Also, it is also real
When monitor the information change situation of each equipment to be presented, and when monitoring that the information of each equipment to be presented changes, to depositing
The data stored up in device databases timely update.
In one embodiment of the invention, the image identification identification module further comprise ambient image acquiring unit,
Gray feature acquiring unit, image identification acquiring unit and image identification recognition unit.Wherein, ambient image acquiring unit configures
To obtain ambient image.Gray feature acquiring unit is configured to obtain the gray feature point in the ambient image.Image identification
Acquiring unit is configured to gray feature point and obtains image identification.Image identification identification cell configuration is the image mark that will be obtained
Knowledge is matched with the image identification in real time information mapping table, is identified with the image identification to acquisition.
Specifically, ambient image acquiring unit obtains ambient image, it is preferable that acquisition includes image corresponding with equipment
The ambient image of mark.The ambient enviroment image of equipment to be presented can be acquired by camera, can also pass through other figures
The ambient enviroment image of equipment to be presented is obtained as harvester.
Then, gray feature acquiring unit obtains the gray feature point in ambient image.Specifically, obtaining in ambient image
Gray feature point, the object in ambient image to be identified.These gray feature points had both included figure corresponding with equipment
As the gray feature of mark, also include the gray feature of other background images.Wherein, image corresponding with equipment in ambient image
The gray feature target gray feature of mark.
Then, image identification acquiring unit is based on gray feature point and obtains image identification.Specifically, in ambient image
Gray feature point is parsed, and corresponding gradation of image feature can be obtained.Gradation of image feature is combined, can be obtained
Corresponding image identification.
Finally, image identification recognition unit matches the image identification of acquisition with the image identification in mapping table, with
The image identification of acquisition is identified.
Specifically, after the image identification in obtaining ambient image, the image that will store in the image identification and mapping table
Mark is matched, only successful match, just can determine that the corresponding equipment of the image identification, and then obtain the correspondence equipment
Real time information.Otherwise, illustrate the mapping relations for not preserving the image identification and corresponding equipment in mapping table, the figure cannot be obtained
As the real time information of the corresponding equipment of mark.
In one embodiment of the invention, the information superposition module further comprise image characteristic point to acquiring unit,
Image rotation matrix acquiring unit, coordinate transformation unit, threedimensional model drawing unit and information superposition unit.Wherein, image is special
Sign point is configured to be obtained with matched image identification in the real time information mapping table according to the image identification of acquisition to acquiring unit
To image characteristic point pair.Image rotation matrix acquiring unit is configured to according to image characteristic point to carrying out projective transformation, to resolve
Go out image rotation matrix.The image identification that coordinate transformation unit is configured to obtain identification from device databases corresponds to the seat of equipment
Mark, and it is based on described image spin matrix, coordinate of the corresponding equipment of the image identification of identification under the first coordinate system is converted
For the coordinate under the second coordinate system where ambient image.Threedimensional model drawing unit is configured to correspond in the image identification of identification
Equipment is drawn using d engine at the coordinate under the second coordinate system and shows that the image identification of acquisition corresponds to the three-dimensional of equipment
Model.The image identification that information superposition unit is configured to obtain identification from device databases corresponds to the real time information of equipment, and
Overlapping display is corresponded in ambient image at the threedimensional model of equipment.
Specifically, first, image characteristic point is to acquiring unit according in the image identification and real time information mapping table of acquisition
Matched image identification obtains image characteristic point pair.That is, by characteristics of image and letter in real time in the image identification of acquisition
The corresponding characteristics of image of matched image identification is matched in breath mapping table, and matched benchmark is specifically schemed in image identification
As characteristic point.It is carried out by the way that matched image identification in the image identification of acquisition and real time information mapping table is obtained characteristics of image
Matching, can obtain corresponding image characteristic point pair.
Then, image rotation matrix acquiring unit is revolved according to image characteristic point to carrying out projective transformation with calculating image
Torque battle array.Specifically, according to characteristic point to carry out projective transformation, calculate image rotation matrix and spatial positional information to get
To picture posture.
Then, coordinate transformation unit obtains the image identification of identification from device databases and corresponds to the coordinate of equipment, and base
In image rotation matrix, coordinate of the corresponding equipment of the image identification of identification under the first coordinate system is converted into ambient image institute
The second coordinate system under coordinate.Picture posture i.e. the first coordinate system is relative to the second coordinate system where the camera of mobile terminal
Posture.Coordinate of the corresponding equipment of identification feature under the first coordinate system is converted under the second coordinate system using spin matrix
Coordinate.Specifically, after to the image identification identification in ambient image, closed according to the first mapping preserved in information MAP table
System, it may be determined that the corresponding equipment of image identification in ambient image.It, can from device databases after determining corresponding equipment
To obtain coordinate of the equipment under the first coordinate system of picture.The coordinate of each equipment picture is the phase using picture centre as origin
To position coordinate system, still, the coordinate system where the image observed by camera is the camera coordinates system of camera itself
(the second coordinate system).Therefore, the image identification of identification need to be corresponded into equipment and existed according to the transformational relation between the two coordinate systems
Coordinate under earth coordinates is converted to the coordinate under camera coordinates system, in this way can be by equipment to be presented under camera coordinates system
Correctly shown.
Then, threedimensional model drawing unit corresponds to equipment at the coordinate under the second coordinate system in the image identification of identification,
It is drawn using d engine and shows that the image identification of acquisition corresponds to the threedimensional model of equipment.
Specifically, the image identification in identification corresponds to equipment at the coordinate under the second coordinate system, painted using d engine
The threedimensional model of the corresponding equipment of system, is then overlapped display at the coordinate by the threedimensional model under the second coordinate system.In this way,
The corresponding equipment of the image identification of identification can be shown in ambient image.
Finally, information superposition unit obtains the image identification of identification from device databases and corresponds to the real time information of equipment,
And Overlapping display is corresponded in ambient image at the threedimensional model of equipment.
In one embodiment of the invention, further include real time information acquisition module, be configured to obtain predetermined model in real time
Coordinate, status information and the attribute information of interior all equipment to be presented are enclosed, and is stored in device databases.
It will be appreciated by those skilled in the art that：Realize that all or part of step of above method embodiment can pass through program
Relevant hardware is instructed to complete, program above-mentioned can be stored in a computer read/write memory medium, which is holding
When row, step including the steps of the foregoing method embodiments is executed；And storage medium above-mentioned includes：ROM, RAM, magnetic disc or CD etc.
The various media that can store program code.
Those skilled in the art should be understood that each module of the above invention or each step can use general calculating
Device realizes that they can be concentrated on a single computing device, or be distributed in network constituted by multiple computing devices
On, optionally, they can be realized with the program code that computing device can perform, it is thus possible to be stored in storage
It is performed by computing device in device, either they are fabricated to each integrated circuit modules or will be more in them
A module or step are fabricated to single integrated circuit module to realize.In this way, the present invention is not limited to any specific hardware and
Software combines.
While it is disclosed that embodiment content as above but described only to facilitate understanding the present invention and adopting
Embodiment is not limited to the present invention.Any those skilled in the art to which this invention pertains are not departing from this
Under the premise of the disclosed spirit and scope of invention, any modification and change can be made in the implementing form and in details,
But protection scope of the present invention still should be subject to the scope of the claims as defined in the appended claims.
Claims (10)
1. a kind of factory's real time data methods of exhibiting based on AR, including：
It establishes and the unique corresponding image identification of equipment to be presented；
Establish described image mark and the real time information mapping table of corresponding equipment；
Ambient image is obtained, and the image identification in the ambient image is identified based on the real time information mapping table；
The real time information that the image identification of identification is corresponded to equipment, by three-dimensional overlay mode Overlapping display in the ambient image
In.
2. according to the method described in claim 1, it is characterized in that, establishing described image mark and the real time information of corresponding equipment
Mapping table further comprises：
Establish described image mark and the first mapping relations of corresponding equipment；
Establish the second mapping relations that equipment corresponds to the real time information of equipment with device databases；
According to first mapping relations and the second mapping relations, establishes image identification and mapped with the real time information of corresponding equipment
Table.
3. according to the method described in claim 2, it is characterized in that, ambient image is obtained, and to the figure in the ambient image
It is identified, further comprises as identifying：
Obtain ambient image；
Obtain the gray feature point in the ambient image；
Image identification is obtained based on the gray feature point；
The image identification of acquisition is matched with the image identification in the real time information mapping table, with the image mark to acquisition
Knowledge is identified.
4. method according to any one of claim 1-3, which is characterized in that by the image identification of identification and corresponding equipment
Real time information further comprise by three-dimensional overlay mode Overlapping display in the ambient image：
Image characteristic point pair is obtained according to matched image identification in the image identification of acquisition and the real time information mapping table；
According to described image characteristic point to carrying out projective transformation, to calculate image rotation matrix；
The image identification that identification is obtained from device databases corresponds to the coordinate of equipment, and is based on described image spin matrix, will
Coordinate of the corresponding equipment of image identification of identification under the first coordinate system is converted under the second coordinate system where ambient image
Coordinate；
Equipment is corresponded at the coordinate under the second coordinate system in the image identification of identification, is drawn using d engine and is shown acquisition
Image identification correspond to the threedimensional model of equipment；
The image identification that identification is obtained from device databases corresponds to the real time information of equipment, and Overlapping display is in the environment map
At the threedimensional model for corresponding to equipment as in.
5. according to the method described in claim 2, it is characterized in that, establishing described image mark and the real-time letter of corresponding equipment
Before ceasing mapping table, further include：
Coordinate, status information and the attribute information of all equipment to be presented in preset range are obtained in real time, and are stored in described set
In standby database.
6. a kind of factory's real time data display systems based on AR, including：
Image identification establishes module, is configured to establish and the unique corresponding image identification of equipment to be presented；
Mapping table establishes module, is configured to establish described image mark and the real time information mapping table of corresponding equipment；
Image identification identification module is configured to obtain ambient image, and based on the real time information mapping table to the environment
Image identification in image is identified；
Information superposition module, the image identification for being configured to identify correspond to the real time information of equipment, pass through three-dimensional overlay mode
Overlapping display is in the ambient image.
7. system according to claim 6, which is characterized in that the mapping table is established module and further comprised：
First mapping relations establish module, are configured to establish described image mark and the first mapping relations of corresponding equipment；
Second mapping relations establish module, are configured to establish the of the real time information that equipment corresponds to equipment with device databases
Two mapping relations；
Mapping table establishes unit, is configured to according to first mapping relations and the second mapping relations, establish image identification with
The real time information mapping table of corresponding equipment.
8. system according to claim 7, which is characterized in that described image mark identification module further comprises：
Ambient image acquiring unit is configured to obtain ambient image；
Gray feature acquiring unit is configured to obtain the gray feature point in the ambient image；
Image identification acquiring unit is configured to the gray feature point and obtains image identification；
Image identification recognition unit is configured to the image identification that will be obtained and the image identification in the real time information mapping table
It is matched, is identified with the image identification to acquisition.
9. according to the system described in any one of claim 6-8, which is characterized in that described information laminating module further wraps
It includes：
Image characteristic point is configured to be matched with the real time information mapping table according to the image identification of acquisition to acquiring unit
Image identification obtain image characteristic point pair；
Image rotation matrix acquiring unit is configured to according to described image characteristic point to carrying out projective transformation, to calculate figure
As spin matrix；
Coordinate transformation unit, the image identification for being configured to obtain identification from device databases correspond to the coordinate of equipment, and base
In described image spin matrix, coordinate of the corresponding equipment of the image identification of identification under the first coordinate system is converted into environment map
As place the second coordinate system under coordinate；
Threedimensional model drawing unit is configured to correspond to equipment at the coordinate under the second coordinate system in the image identification of identification,
It is drawn using d engine and shows that the image identification of acquisition corresponds to the threedimensional model of equipment；
Information superposition unit, the image identification for being configured to obtain identification from device databases correspond to the real time information of equipment,
And Overlapping display is corresponded in the ambient image at the threedimensional model of equipment.
10. system according to claim 7, which is characterized in that further include real time information acquisition module, be configured in real time
Coordinate, status information and the attribute information of all equipment to be presented in preset range are obtained, and is stored in the device databases
In.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810156815.7A CN108711188A (en) | 2018-02-24 | 2018-02-24 | A kind of factory's real time data methods of exhibiting and system based on AR |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810156815.7A CN108711188A (en) | 2018-02-24 | 2018-02-24 | A kind of factory's real time data methods of exhibiting and system based on AR |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108711188A true CN108711188A (en) | 2018-10-26 |
Family
ID=63866210
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810156815.7A Pending CN108711188A (en) | 2018-02-24 | 2018-02-24 | A kind of factory's real time data methods of exhibiting and system based on AR |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108711188A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109669980A (en) * | 2018-12-21 | 2019-04-23 | 成都四方伟业软件股份有限公司 | The inter-library access method of data and device |
| CN110794962A (en) * | 2019-10-18 | 2020-02-14 | 北京字节跳动网络技术有限公司 | Information fusion method, device, terminal and storage medium |
| WO2020140524A1 (en) * | 2019-01-02 | 2020-07-09 | 珠海格力电器股份有限公司 | Augmented reality display method and device for chip structure, and readable storage medium |
| CN112991553A (en) * | 2021-03-11 | 2021-06-18 | 深圳市慧鲤科技有限公司 | Information display method and device, electronic equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070038944A1 (en) * | 2005-05-03 | 2007-02-15 | Seac02 S.R.I. | Augmented reality system with real marker object identification |
| US20080304707A1 (en) * | 2007-06-06 | 2008-12-11 | Oi Kenichiro | Information Processing Apparatus, Information Processing Method, and Computer Program |
| CN103941716A (en) * | 2014-05-13 | 2014-07-23 | 北京世纪微熵科技有限公司 | Method, device and system for construction device monitoring |
| CN103971400A (en) * | 2013-02-06 | 2014-08-06 | 阿里巴巴集团控股有限公司 | Identification code based three-dimensional interaction method and system |
| CN104506388A (en) * | 2014-12-26 | 2015-04-08 | 成都致云科技有限公司 | IDC (internet data center) monitoring method and system combined with AR (augmented reality) technology |
| CN106097425A (en) * | 2016-06-07 | 2016-11-09 | 天津天大求实电力新技术股份有限公司 | Power equipment information retrieval based on augmented reality and methods of exhibiting and system |
| CN106485956A (en) * | 2016-09-29 | 2017-03-08 | 珠海格力电器股份有限公司 | A kind of method of demonstration electronic functionalities, device and intelligent terminal |
| CN107330970A (en) * | 2017-06-15 | 2017-11-07 | 新奥泛能网络科技股份有限公司 | A kind of threedimensional model processing method, server and computer read/write memory medium |
| CN107464290A (en) * | 2017-08-07 | 2017-12-12 | 上海白泽网络科技有限公司 | Three-dimensional information methods of exhibiting, device and mobile terminal |
| CN107610238A (en) * | 2017-09-12 | 2018-01-19 | 国网上海市电力公司 | A kind of power equipment AR dynamic modeling systems and its method of work |
-
2018
- 2018-02-24 CN CN201810156815.7A patent/CN108711188A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070038944A1 (en) * | 2005-05-03 | 2007-02-15 | Seac02 S.R.I. | Augmented reality system with real marker object identification |
| US20080304707A1 (en) * | 2007-06-06 | 2008-12-11 | Oi Kenichiro | Information Processing Apparatus, Information Processing Method, and Computer Program |
| CN103971400A (en) * | 2013-02-06 | 2014-08-06 | 阿里巴巴集团控股有限公司 | Identification code based three-dimensional interaction method and system |
| CN103941716A (en) * | 2014-05-13 | 2014-07-23 | 北京世纪微熵科技有限公司 | Method, device and system for construction device monitoring |
| CN104506388A (en) * | 2014-12-26 | 2015-04-08 | 成都致云科技有限公司 | IDC (internet data center) monitoring method and system combined with AR (augmented reality) technology |
| CN106097425A (en) * | 2016-06-07 | 2016-11-09 | 天津天大求实电力新技术股份有限公司 | Power equipment information retrieval based on augmented reality and methods of exhibiting and system |
| CN106485956A (en) * | 2016-09-29 | 2017-03-08 | 珠海格力电器股份有限公司 | A kind of method of demonstration electronic functionalities, device and intelligent terminal |
| CN107330970A (en) * | 2017-06-15 | 2017-11-07 | 新奥泛能网络科技股份有限公司 | A kind of threedimensional model processing method, server and computer read/write memory medium |
| CN107464290A (en) * | 2017-08-07 | 2017-12-12 | 上海白泽网络科技有限公司 | Three-dimensional information methods of exhibiting, device and mobile terminal |
| CN107610238A (en) * | 2017-09-12 | 2018-01-19 | 国网上海市电力公司 | A kind of power equipment AR dynamic modeling systems and its method of work |
Non-Patent Citations (2)
| Title |
|---|
| 刘嘉敏等: "增强现实中基于三角标识的三维注册方法", 《沈阳工业大学学报》 * |
| 沈克等: "基于增强现实的物联网物体识别与虚拟交互", 《计算机工程》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109669980A (en) * | 2018-12-21 | 2019-04-23 | 成都四方伟业软件股份有限公司 | The inter-library access method of data and device |
| WO2020140524A1 (en) * | 2019-01-02 | 2020-07-09 | 珠海格力电器股份有限公司 | Augmented reality display method and device for chip structure, and readable storage medium |
| CN110794962A (en) * | 2019-10-18 | 2020-02-14 | 北京字节跳动网络技术有限公司 | Information fusion method, device, terminal and storage medium |
| CN112991553A (en) * | 2021-03-11 | 2021-06-18 | 深圳市慧鲤科技有限公司 | Information display method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108711188A (en) | A kind of factory's real time data methods of exhibiting and system based on AR | |
| CN103793936B (en) | Automation reference frame for augmented reality is calibrated | |
| CN106846497B (en) | Method and device for presenting three-dimensional map applied to terminal | |
| CN108765575A (en) | A kind of industrial equipment illustrated handbook methods of exhibiting and system based on AR | |
| CN108769517A (en) | A kind of method and apparatus carrying out remote assistant based on augmented reality | |
| CN107633526A (en) | A kind of image trace point acquisition methods and equipment, storage medium | |
| Andersen et al. | Virtual annotations of the surgical field through an augmented reality transparent display | |
| CN110111248A (en) | A kind of image split-joint method based on characteristic point, virtual reality system, camera | |
| CN110210328A (en) | The method, apparatus and electronic equipment of object are marked in image sequence | |
| CN109785373A (en) | A kind of six-freedom degree pose estimating system and method based on speckle | |
| CN111582240B (en) | Method, device, equipment and medium for identifying number of objects | |
| CN108344401A (en) | Localization method, device and computer readable storage medium | |
| CN110969687A (en) | Collision detection method, device, equipment and medium | |
| CN108430032B (en) | Method and equipment for realizing position sharing of VR/AR equipment | |
| CN114373047A (en) | Method, device and storage medium for monitoring physical world based on digital twin | |
| CN111311681A (en) | Visual positioning method, device, robot and computer readable storage medium | |
| US20220375148A1 (en) | Augmented Reality Mathematics in Learning Platforms | |
| CN110568934A (en) | Low-error high-efficiency multi-label-graph augmented reality system | |
| CN111653175A (en) | Virtual sand table display method and device | |
| CN103700128B (en) | Mobile equipment and enhanced display method thereof | |
| CN113052915A (en) | Camera external parameter calibration method and device, augmented reality system, terminal device and storage medium | |
| CN110390511A (en) | The credit applications measures and procedures for the examination and approval, device, equipment and storage medium | |
| CN113781541B (en) | Three-dimensional image processing method and device based on neural network and electronic equipment | |
| CN105809690A (en) | Data processing method, device and electronic device | |
| CN109087399B (en) | Method for rapidly synchronizing AR space coordinate system through positioning map |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181026 |