CN106569769A - AR technology-based machine operation instruction information display method and apparatus - Google Patents
AR technology-based machine operation instruction information display method and apparatus Download PDFInfo
- Publication number
- CN106569769A CN106569769A CN201610987399.6A CN201610987399A CN106569769A CN 106569769 A CN106569769 A CN 106569769A CN 201610987399 A CN201610987399 A CN 201610987399A CN 106569769 A CN106569769 A CN 106569769A
- Authority
- CN
- China
- Prior art keywords
- machine
- operation guidance
- guidance information
- user
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an AR technology-based machine operation instruction information display method and apparatus to provide more concrete and direct machine operation instruction information. The method comprises steps of acquiring identifying information of a designated machine in a visual field range and seen by a user via an AR device lens, extracting the operation instruction information of the machine according to the identifying information, displaying the operation instruction information on the lens in an overlaying way to enable the user to see the machine and the operation instruction information at the same time. The machine and the operation instruction information can be combined by the use of the method; the information can be overlaid and displayed in the visual field range of the user; by the use of the method, the user can operate the machine and check the operation instruction information at the same time, so accidents due to the departure of the machine upon a user checking the operation instruction information can be avoided; and therefore, the user can conveniently operate the machine and great work efficiency can be provided.
Description
Technical field
The present invention relates to augmented reality field, and in particular to a kind of machine operation guidance information exhibition based on AR technologies
Show method and device.
Background technology
Augmented reality (Augmented Reality, abbreviation AR), it is by means of photoelectric technology, interaction technique, multisensor
Technology and computer picture and multimedia technology, generate it is a kind of it is true to nature depending on, listen, power, touch and the sensation such as dynamic virtual environment,
And combine this virtual environment with real world " seamless ", as these virtual informations are necessary being,
Originally the information for being difficult to experience in the certain hour spatial dimension of real world is perceived by human sensory, breaches sky
Between, time and other objective restrictions, so as to reach the sensory experience of exceeding reality.
The heavy-duty machines complicated for certain operations, user is frequently necessary to binding operation code to operate machine, but, this
A little rule of operation are typically all what is shown with word and picture, are generally all papery version or electronic edition, and user generally requires
Operate while to check rule of operation, because rule of operation and equipment are detached, so user can not take into account simultaneously, holding
Easily attend to one thing and lose sight of another, even result in and use mistake, damage, especially in some important operating process, machine is not often from
People is opened, prevents user to check rule of operation from leaving.Therefore, the methods of exhibiting of existing operation guidance information is highly detrimental to refer to
The operation of user is led, is instructed less efficient.
The content of the invention
For drawbacks described above of the prior art, the invention provides a kind of machine operation guidance information based on AR technologies
Methods of exhibiting and device, make user convenient when machine is operated, and improve the effect that user checks machine operation guidance information
Rate.
In a first aspect, a kind of machine operation guidance information methods of exhibiting based on AR technologies that the present invention is provided, including：
Obtain the identification information of the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment；
The operation guidance information of the machine is transferred according to the identification information；
The operation guidance information described in Overlapping display on the eyeglass, so that the user sees the machine and institute simultaneously
State operation guidance information.
Optionally, the identification letter for obtaining the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment
Breath, including：
Shoot the photo comprising specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment；Or, using three
The specified machine for including within sweep of the eye that dimension stereoscan technology scanning user is seen by the eyeglass of AR equipment, obtains described
The stereoscopic image of machine；
The machine is identified from the photo or stereoscopic image using characteristics of image technology of identification, the machine is obtained
Identification information.
Optionally, before the step of operation guidance information for the machine being transferred according to the identification information described, also wrap
Include：
The current mode of operation of the machine is judged according to the photo or stereoscopic image；
The operation guidance information that the machine is transferred according to the identification information, including：
According to the current mode of operation of the identification information and the machine, transfer with the current mode of operation of the machine
The operation guidance information of the machine started for node.
Optionally, the identification letter for obtaining the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment
Breath, including：
The Quick Response Code in the specified machine for including within sweep of the eye that barcode scanning identifying user is seen by the eyeglass of AR equipment
Or bar code, obtain the identification information of the machine.
Optionally, the operation guidance information that the machine is transferred according to the identification information, including：
The operation guidance information of the machine is inquired about from local data base according to the identification information；Or
The operation guidance information of the machine is downloaded from far-end server according to the identification information.
Optionally, the operation guidance information, including：User is instructed to use the word of the operation guidance information of the machine
Illustrate, caption, demonstration video, plane Show Me animation, three-dimensional Show Me animation, one or more in guide icon of group
Close.
Optionally, the operation guidance information described in Overlapping display on the eyeglass, so that the user sees simultaneously
The machine and the operation guidance information, including：
The operation guidance information is projected on the eyeglass using shadow casting technique, makes the user see the machine
With the stereoscopic fusion scene of the operation guidance information.
Second aspect, the present invention provides a kind of machine operation guidance information exhibiting device based on AR technologies, including：
Identification information acquisition module, for obtaining the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment
Identification information；
Tutorial message transfers module, for transferring the operation guidance information of the machine according to the identification information；
Tutorial message display module, for the operation guidance information described in Overlapping display on the eyeglass, so that the use
The machine and the operation guidance information are seen simultaneously in family.
Optionally, the identification information acquisition module, including：
Take pictures image capturing unit, for shoot user by the eyeglass of AR equipment see within sweep of the eye comprising specifying
The photo of machine；Or,
Scan-image acquiring unit, for being seen by the eyeglass of AR equipment using 3 D stereo scanning technique scanning user
The specified machine for including within sweep of the eye, obtain the stereoscopic image of the machine；
Image process unit, it is described for being identified from the photo or stereoscopic image using characteristics of image technology of identification
Machine, obtains the identification information of the machine.
Optionally, the machine operation guidance information exhibiting device based on AR technologies, also includes：
Mode of operation judge module, for judging the current mode of operation of the machine according to the photo or image；
The tutorial message transfers module, including：
Partial information transfers unit, for according to the current mode of operation of the identification information and the machine, transfer with
The operation guidance information of the machine that the current mode of operation of the machine starts for node.
Optionally, the identification information acquisition module, including：
Barcode scanning unit, for the specified machine for including within sweep of the eye that barcode scanning identifying user is seen by the eyeglass of AR equipment
Quick Response Code or bar code on device, obtains the identification information of the machine.
Optionally, the tutorial message transfers module, including：
Tutorial message locally transfers unit, for the machine to be inquired about from local data base according to the identification information
Operation guidance information；Or,
Unit is transferred in tutorial message distal end, for downloading the behaviour of the machine from far-end server according to the identification information
Coach information.
Optionally, the operation guidance information, including：User is instructed to use the word of the operation guidance information of the machine
Illustrate, caption, demonstration video, plane Show Me animation, three-dimensional Show Me animation, one or more in guide icon of group
Close.
Optionally, the tutorial message display module, including：
Projecting cell, for the operation guidance information to be projected to into the eyeglass using shadow casting technique, makes the use
See the stereoscopic fusion scene of the machine and the operation guidance information in family.
As shown from the above technical solution, a kind of machine operation guidance information displaying side based on AR technologies that the present invention is provided
Method, for providing a user with more specific intuitively machine operation guidance information, first, obtains eyeglass of the user by AR equipment
The identification information of the specified machine within sweep of the eye seen；Then, the operation for transferring the machine according to the identification information refers to
Lead information；Finally, the operation guidance information described in Overlapping display on the eyeglass, so that the user sees the machine simultaneously
With the operation guidance information.Method provided by the present invention combines in machine and operation guidance information, while superposition is in
Within sweep of the eye, the fusion of virtual operation guidance information and reality machines causes the operation of user learning machine to refer to present user
Lead information more directly perceived, succinct, the method that this machine operation guidance information shows can make user operation machine and check behaviour
The information that coaches is while carry out, it is to avoid checks accident caused by operation guidance information because user leaves machine, makes user
Convenient when machine is operated, work efficiency is higher.
A kind of machine operation guidance information exhibiting device based on AR technologies that the present invention is provided, with above-mentioned based on AR technologies
Machine operation guidance information methods of exhibiting for identical inventive concept, with identical beneficial effect.
Description of the drawings
In order to be illustrated more clearly that the specific embodiment of the invention or technical scheme of the prior art, below will be to concrete
The accompanying drawing to be used needed for embodiment or description of the prior art is briefly described.In all of the figs, similar element
Or part is typically identified by similar reference.In accompanying drawing, each element or part might not draw according to actual ratio.
Fig. 1 shows a kind of machine operation guidance information displaying side based on AR technologies that first embodiment of the invention is provided
The flow chart of method；
Fig. 2 shows that a kind of machine operation guidance information based on AR technologies that second embodiment of the invention is provided shows dress
The schematic diagram put.
Specific embodiment
The embodiment of technical solution of the present invention is described in detail below in conjunction with accompanying drawing.Following examples are only used for
Technical scheme is clearly illustrated, therefore is intended only as example, and the protection of the present invention can not be limited with this
Scope.
It should be noted that unless otherwise stated, technical term used in this application or scientific terminology should be this
The ordinary meaning that bright one of ordinary skill in the art are understood.
In order to make it easy to understand, the overall inventive concept at this to the present invention is illustrated：
The AR equipment used with user of the invention is as executive agent, there is provided a kind of machine Operating Guideline based on AR technologies
Information displaying method and device, belong on the whole an identical inventive concept, are mainly made using a kind of technology based on AR
User sees machine operation guidance information and reality machines simultaneously in the same visual field, first, obtains user by AR equipment
The identification information of the specified machine within sweep of the eye that eyeglass is seen；Then, the behaviour of the machine is transferred according to the identification information
Coach information；Finally, the operation guidance information described in Overlapping display on the eyeglass, so that the user is while see described
Machine and the operation guidance information.When user is when a kind of more complicated heavy-duty machines are operated, due to operating procedure it is complicated,
Need to check operation guidance information at any time, at this moment, it is possible to use the method or apparatus that the present invention is provided make user in operation machine
While it can also be seen that operation guidance information, operating process, operation notice in operation guidance information etc. can true
Machine on carry out virtual operation demonstration, without going to take papery version or electronic edition rule of operation to check again, this operation refers to
The method for leading information displaying is very convenient, directly perceived, and instructs efficiency high.It should be noted that the present invention is not intended to limit machine
Species, all of machine and equipment is all within protection scope of the present invention.
The invention provides a kind of machine operation guidance information methods of exhibiting and device based on AR technologies.With reference to attached
Figure is illustrated to embodiments of the invention.
Fig. 1 shows that a kind of machine operation guidance information based on AR technologies that first embodiment of the invention is provided shows
The flow chart of method.As shown in figure 1, a kind of machine operation guidance information based on AR technologies that first embodiment of the invention is provided
Methods of exhibiting is comprised the following steps：
Step S101：Obtain the identification information of the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment.
In this step, the identification information of the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment is obtained
There are three kinds of modes, first kind of way is shot user and seen by the eyeglass of AR equipment by the photographic head being installed on AR equipment
Within sweep of the eye comprising specified machine photo, the machine is identified from the photo using characteristics of image technology of identification
Device, obtains the identification information of the machine, in a typical AR equipment, photographic head is provided with by eyeglass, is putting on AR
After glasses, the visual field of the outside that the visual field and the user that the photographic head shoots is seen by the eyeglass is basically identical, because
This, when user is towards specified machine, includes the machine in the picture that the photographic head shoots, that is, realize that shooting user leads to
The process of the photo comprising specified machine within sweep of the eye that the eyeglass of AR equipment is seen is crossed, wherein, the photographic head can have
One or more, it is all within protection scope of the present invention；The second way, using the AR with 3 D stereo scanning technique
The specified machine for including within sweep of the eye that device scan user is seen by the eyeglass of AR equipment, obtains the solid of the machine
Image, then the machine is identified from the stereoscopic image using characteristics of image technology of identification, obtain the identification of the machine
Information, in the AR equipment, 3 D stereo scanning lens is arranged on by AR eyeglasses, and after AR glasses are put on, user can see
To the object that the 3 D stereo scanning lens will be scanned, after targeted scans object is determined, it is possible to which it is swept
Retouch；The third mode, in the specified machine for including within sweep of the eye that barcode scanning identifying user is seen by the eyeglass of AR equipment
Quick Response Code or bar code, obtain the identification information of the machine.Same AR equipment can have these three acquisition identification informations
Mode in one or more, do not collide with each other, increased the range of application of the AR equipment, it is to avoid because outward appearance phase
The wrong identification that same model is different and causes, when outward appearance is identical, it is possible to use the mode of scanning or barcode scanning is correctly known
Not.
Wherein, the identification information is the information for referring to carry out the machine identification, such as machine models, name
Title, specification, size etc..
Step S102：The operation guidance information of the machine is transferred according to the identification information.
First kind of way or the second way in using step S101 is obtained user and is seen by the eyeglass of AR equipment
During the identification information of the specified machine within sweep of the eye for arriving, according to the photo for photographing or can scan
The stereoscopic image judges the current mode of operation of the machine, then according to the identification information and the mode of operation, adjusts
Take the operation guidance information of the machine started as node with the current mode of operation of the machine.Avoid pair it has been understood that
, the operation guidance information that did of behaviour do repetition and check, make the operation guidance information more targetedly, it is more succinct.
The operation guidance information that the machine is transferred according to the identification information, including according to the identification information from
The operation guidance information of the machine is inquired about in local data base, or, downloaded from far-end server according to the identification information
The operation guidance information of the machine, makes the range of application based on the machine operation guidance information methods of exhibiting of AR technologies wider,
Both a kind of machine had been can apply to, it is also possible to be applied to various machines.For the less operation guidance information that takes up room, so that it may
To be stored directly in local data base, operation guidance information is transferred from local data base convenient and swift, it is to avoid to server
Use, saved cost；For the larger operation guidance information that takes up room, far-end server can be stored in, be made
Used time selects to download as needed, and two kinds of methods for transferring operation guidance information are all each advantageous, all in the protection model of the present invention
Within enclosing.In addition, in one embodiment that the present invention is provided, the AR equipment had both been provided with local storage, was additionally provided with nothing
Line communication module is connected with far-end server, the Operating Guideline of the machine of the specified several models that are stored with the local storage
Information, the far-end server is located at the manufacturer of the machine, and its storage inside has all models of the manufacturer production
Machine, so, when other machines of user using the AR equipment operations producer, can download from the far-end server
Corresponding operation guidance information can be used, and improve the range of application of the AR equipment, realize using an AR equipment can
Effect with multiple stage machine.
Example 1：In factory, many heavy-duty machines are had, and the operation of every kind of machine is all more complicated, user is in operation
Shi Tongchang needs to instruct, and at this moment, user can put on the AR equipment operations machine while watching operation guidance information.User exists
After putting on AR equipment, it is necessary first to which which platform machine determine oneself operation is, then with machine described in the AR device scans,
User can see the machine on the eyeglass of AR equipment, and then AR equipment can get the stereo-picture of the machine, then
It is recognized using image recognition technology, obtains the identification information of the machine, such as machine name, specification, model,
After getting the identification information, AR equipment can search the corresponding machine according to the identification information from local storage
Operation guidance information, or download the operation guidance information of the corresponding machine from far-end server.The Operating Guideline
Information can be operating process, points for attention, performance parameter of the machine etc., and it is all within the scope of the present invention.
Example 2：One more complicated machine of user operation, if the operating procedure of the machine has seven steps, uses now
Family operation proceeds to second step, and a following step is it is uncertain how operation, at this moment, is taken pictures using AR equipment or scanned in current
The machine of mode of operation, AR equipment can be according to taking pictures the photo for obtaining or the stereo-picture for scanning adopts image recognition
Technology recognizes the machine, obtains identification information, meanwhile, the AR equipment can be according to the identification information of the machine and the place
Judge that user's concrete operations, to which step, judge to use here in the photo or stereo-picture of the machine of current operation status
Next family operation will carry out the operation of the 3rd step, then from the storage for storing the machine operation guidance information to second step
The identification information is searched in storage, the operation guidance information of the machine started as node with the mode of operation is transferred,
The 3rd step and later operation guidance information that the machine is operated is shown on the AR equipment, provides the user and connects
The operation guidance information for getting off.
Step S103：The operation guidance information described in Overlapping display on the eyeglass, so that the user sees institute simultaneously
State machine and the operation guidance information.
Operation guidance information in the embodiment of the present invention may refer to lead user on content-form and use the machine
In explanatory note, caption, demonstration video, plane Show Me animation, three-dimensional Show Me animation, the guide icon of operation guidance information
One or more of combination.
In terms of content, the operation guidance information can be the guidance of the tutorial message of operating process, operation notice
Information etc., all within the scope of the present invention.
The superposition on the eyeglass shows the operation guidance information, so that the user sees the machine simultaneously
With the operation guidance information, the operation guidance information can be projected on the eyeglass using shadow casting technique, be made described
User sees the stereoscopic fusion scene of the machine and the operation guidance information, or using transparent display as mirror
Piece, shows in translucent fashion the operation guidance information on the transparent display, and it is in protection scope of the present invention
Within.
Example 3：User's automobile during using automobile there occurs suddenly failure, need to keep in repair at once, and user can be with
The AR glasses with the auto repair operation guidance information are worn, the AR glasses can instruct the whole maintenance operation mistake of user
Journey.User is worn after AR glasses, and first, user can operate the AR glasses to allow the AR glasses to take pictures or sweep the automobile
Retouch, confirm the model of the automobile, the reason for then finding out the automobile again and break down, such as, open before the automobile
Car bonnet, check the parts such as the automobile engine, radiator, during failure cause is searched, user is on AR glasses
Can see has arrow or the estoverman in the moon instruction user to open the car bonnet before the automobile, it may appear that virtual spanner refers to
Lead which screw user should twist, twist to which direction, point out what problem where user occur in that, find asking of breaking down
After topic, the tutorial message how user can be keeped in repair from the AR glasses such as, has arrow to point to an electric wire,
Prompt tone is had simultaneously or word occurs showing that electric wire breaks, next, having sound or word together with arrow is instructed
Instruct how user should connect in the electric wire, complete the maintenance work of the failure.
By showing to the real machine and operation guidance information superposition, the operation guidance information can be made more
Plus user is presented on open arms at the moment, user can see the stereoscopic fusion scene of the machine and the operation guidance information,
User's more vivid sense is set to be subject to 3Dization, informationization, materialization, the content of the operation guidance information of simplification, so as to preferably
Understand operation guidance information content, instruct effect of the operation guidance information to user can be effectively improved, lifting is instructed efficiency, obtained
Obtain more preferable Consumer's Experience.
User utilizes this method Learning machine operation guidance information, can entirely be learnt with oneself complete independently, it is not necessary to
Experienced master worker is explained again, and vague place can be watched repeatedly, so, has not only saved experience master worker teaching
Time, and, user can wear the AR glasses when machine is operated, and the operation thing that should be noted of user is reminded at any time
Item, operating process etc., are prevented from, because carelessness caused by the careless, factor such as divert one's attention, do not understand, omitting separate step, keeping away
Some unnecessary losses or injury are exempted from.Meanwhile, the study side shown by this operation guidance information based on AR equipment
Method, allows the operation guidance information of user's Learning machine at any time, can accelerate the progress of user learning, improves learning efficiency,
Production efficiency to lifting factory has certain help.
In above-mentioned first embodiment, there is provided a kind of machine operation guidance information methods of exhibiting based on AR technologies,
Corresponding, the application also provides a kind of machine operation guidance information exhibiting device based on AR technologies.Refer to Fig. 2,
A kind of schematic diagram of its machine operation guidance information exhibiting device based on AR technologies provided for second embodiment of the invention.By
Embodiment of the method is substantially similar in device embodiment, so describing fairly simple, related part is referring to embodiment of the method
Part illustrates.Device embodiment described below is only schematic.
A kind of machine operation guidance information exhibiting device based on AR technologies that second embodiment of the invention is provided includes：
Identification information acquisition module 101, is specified within sweep of the eye for obtaining user by what the eyeglass of AR equipment was seen
The identification information of machine；
Tutorial message transfers module 102, for transferring the operation guidance information of the machine according to the identification information；
Tutorial message display module 103, for the operation guidance information described in Overlapping display on the eyeglass, so that described
User sees the machine and the operation guidance information simultaneously.
In one embodiment that the present invention is provided, the identification information acquisition module 101, including：
Take pictures image capturing unit, for shoot user by the eyeglass of AR equipment see within sweep of the eye comprising specifying
The photo of machine；Or,
Scan-image acquiring unit, for being seen by the eyeglass of AR equipment using 3 D stereo scanning technique scanning user
The specified machine for including within sweep of the eye, obtain the stereoscopic image of the machine；
Image process unit, it is described for being identified from the photo or stereoscopic image using characteristics of image technology of identification
Machine, obtains the identification information of the machine.
In one embodiment that the present invention is provided, the machine operation guidance information exhibiting device based on AR technologies,
Also include：
Mode of operation judge module, for judging the current mode of operation of the machine according to the photo or image；
The tutorial message transfers module 102, including：
Partial information transfers unit, for according to the current mode of operation of the identification information and the machine, transfer with
The operation guidance information of the machine that the current mode of operation of the machine starts for node.
In one embodiment that the present invention is provided, the identification information acquisition module 101, including：
Barcode scanning unit, for the specified machine for including within sweep of the eye that barcode scanning identifying user is seen by the eyeglass of AR equipment
Quick Response Code or bar code on device, obtains the identification information of the machine.
In one embodiment that the present invention is provided, the tutorial message transfers module 102, including：
Tutorial message locally transfers unit, for the machine to be inquired about from local data base according to the identification information
Operation guidance information；Or,
Unit is transferred in tutorial message distal end, for downloading the behaviour of the machine from far-end server according to the identification information
Coach information.
In one embodiment that the present invention is provided, the operation guidance information, including：User is instructed to use the machine
The explanatory note of operation guidance information, caption, demonstration video, plane Show Me animation, three-dimensional Show Me animation, guide icon
In one or more of combination.
In one embodiment that the present invention is provided, the tutorial message display module 103, including：
Projecting cell, for the operation guidance information to be projected to into the eyeglass using shadow casting technique, makes the use
See the stereoscopic fusion scene of the machine and the operation guidance information in family.
More than, for a kind of machine operation guidance information exhibiting device based on AR technologies that second embodiment of the invention is provided
Embodiment explanation.
A kind of machine operation guidance information exhibiting device based on AR technologies that the present invention is provided is with above-mentioned based on AR technologies
Machine operation guidance information methods of exhibiting for identical inventive concept, with identical beneficial effect, here is omitted.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example " or " some show
The description of example " etc. means that the specific features, structure, material or the feature that describe with reference to the embodiment or example are contained in the present invention
At least one embodiment or example in.In this manual, the schematic representation of above-mentioned term is not required to be directed to
Identical embodiment or example.And, the specific features of description, structure, material or feature can be in any one or more realities
Apply and combined in an appropriate manner in example or example.Additionally, in the case of not conflicting, those skilled in the art can be by
The feature of different embodiments or example and different embodiments or example described in this specification is combined and combines.Need
Illustrate, the flow chart and block diagram in accompanying drawing of the present invention show the system of multiple embodiments of the invention, method and
The architectural framework in the cards of computer program, function and operation.At this point, each side in flow chart or block diagram
Frame can represent a part for module, program segment or a code, and a part for the module, program segment or code includes one
Or multiple executable instructions for realizing the logic function of regulation.It should also be noted that in some are as the realization replaced, it is square
The function of being marked in frame can also be with different from the order marked in accompanying drawing generation.For example, two continuous square frame reality
On can perform substantially in parallel, they can also be performed in the opposite order sometimes, and this is depending on involved function.Also
It is noted that the combination of block diagram and/or each square frame in flow chart and block diagram and/or the square frame in flow chart, Ke Yiyong
Perform the function of regulation or the special hardware based system of action to realize, or can be referred to computer with specialized hardware
The combination of order is realizing.
Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method, can be with
Realize by another way.Device embodiment described above is only schematic, for example, the division of the unit,
It is only a kind of division of logic function, there can be other dividing mode when actually realizing, but for example, multiple units or component can
To combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or beg for
By coupling each other direct-coupling or communication connection can be by the indirect of some communication interfaces, device or unit
Coupling is communicated to connect, and can be electrical, mechanical or other forms.
The unit as separating component explanation can be or may not be it is physically separate, it is aobvious as unit
The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can according to the actual needs be selected to realize the mesh of this embodiment scheme
's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.
If the function is realized and as independent production marketing or when using using in the form of SFU software functional unit, can be with
In being stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer machine (can be individual
People's computer, server, or net machine etc.) perform all or part of step of each embodiment methods described of the invention.
And aforesaid storage medium includes：USB flash disk, portable hard drive, read only memory (ROM, Read-Only Memory), random access memory are deposited
Reservoir (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
Finally it should be noted that：Various embodiments above only to illustrate technical scheme, rather than a limitation；To the greatest extent
Pipe has been described in detail with reference to foregoing embodiments to the present invention, it will be understood by those within the art that：Its according to
So the technical scheme described in foregoing embodiments can be modified, either which part or all technical characteristic are entered
Row equivalent；And these modifications or replacement, do not make the essence disengaging various embodiments of the present invention technology of appropriate technical solution
The scope of scheme, it all should cover in the middle of the claim of the present invention and the scope of description.
Claims (10)
1. a kind of machine operation guidance information methods of exhibiting based on AR technologies, it is characterised in that include：
Obtain the identification information of the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment；
The operation guidance information of the machine is transferred according to the identification information；
The operation guidance information described in Overlapping display on the eyeglass, so that the user sees the machine and the behaviour simultaneously
Coach information.
2. the machine operation guidance information methods of exhibiting based on AR technologies according to claim 1, it is characterised in that described
The identification information of the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment is obtained, including：
Shoot the photo comprising specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment；Or, using three-dimensional vertical
The specified machine for including within sweep of the eye that swept-volume technology scanning user is seen by the eyeglass of AR equipment, obtains the machine
Stereoscopic image；
The machine is identified from the photo or stereoscopic image using characteristics of image technology of identification, the knowledge of the machine is obtained
Other information.
3. the machine operation guidance information methods of exhibiting based on AR technologies according to claim 2, it is characterised in that in institute
Before stating the step of transferring the operation guidance information of the machine according to the identification information, also include：
The current mode of operation of the machine is judged according to the photo or stereoscopic image；
The operation guidance information that the machine is transferred according to the identification information, including：
According to the current mode of operation of the identification information and the machine, transfer with the current mode of operation of the machine as section
The operation guidance information of the machine that point starts.
4. the machine operation guidance information methods of exhibiting based on AR technologies according to claim 1, it is characterised in that described
The identification information of the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment is obtained, including：
The Quick Response Code in the specified machine for including within sweep of the eye or bar that barcode scanning identifying user is seen by the eyeglass of AR equipment
Shape code, obtains the identification information of the machine.
5. the machine operation guidance information methods of exhibiting based on AR technologies according to claim 1, it is characterised in that described
The operation guidance information of the machine is transferred according to the identification information, including：
The operation guidance information of the machine is inquired about from local data base according to the identification information；Or
The operation guidance information of the machine is downloaded from far-end server according to the identification information.
6. the machine operation guidance information methods of exhibiting based on AR technologies according to claim 1, it is characterised in that described
Operation guidance information, including：User is instructed to use explanatory note, caption, the demonstration of the operation guidance information of the machine
The combination of one or more in video, plane Show Me animation, three-dimensional Show Me animation, guide icon.
7. the machine working specification methods of exhibiting based on AR technologies according to claim 1, it is characterised in that described in institute
Operation guidance information described in Overlapping display on eyeglass is stated, so that the user sees the machine and Operating Guideline letter simultaneously
Breath, including：
The operation guidance information is projected on the eyeglass using shadow casting technique, makes the user see the machine and institute
State the stereoscopic fusion scene of operation guidance information.
8. a kind of machine operation guidance information exhibiting device based on AR technologies, it is characterised in that include：
Identification information acquisition module, for obtaining the knowledge of the specified machine within sweep of the eye that user is seen by the eyeglass of AR equipment
Other information；
Tutorial message transfers module, for transferring the operation guidance information of the machine according to the identification information；
Tutorial message display module, for the operation guidance information described in Overlapping display on the eyeglass, so that the user is same
When see the machine and the operation guidance information.
9. the machine operation guidance information exhibiting device based on AR technologies according to claim 8, it is characterised in that described
Identification information acquisition module, including：
Take pictures image capturing unit, specified machine is included within sweep of the eye by what the eyeglass of AR equipment was seen for shooting user
Photo；Or,
Scan-image acquiring unit, for scanning user by regarding that the eyeglass of AR equipment is seen using 3 D stereo scanning technique
The specified machine included in wild scope, obtains the stereoscopic image of the machine；
Image process unit, for the machine to be identified from the photo or stereoscopic image using characteristics of image technology of identification
Device, obtains the identification information of the machine.
10. the machine operation guidance information exhibiting device based on AR technologies according to claim 8, it is characterised in that institute
State tutorial message and transfer module, including：
Tutorial message locally transfers unit, for inquiring about the operation of the machine from local data base according to the identification information
Tutorial message；Or,
Unit is transferred in tutorial message distal end, for being referred to from the operation that far-end server downloads the machine according to the identification information
Lead information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610987399.6A CN106569769A (en) | 2016-11-09 | 2016-11-09 | AR technology-based machine operation instruction information display method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610987399.6A CN106569769A (en) | 2016-11-09 | 2016-11-09 | AR technology-based machine operation instruction information display method and apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106569769A true CN106569769A (en) | 2017-04-19 |
Family
ID=58540910
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610987399.6A Pending CN106569769A (en) | 2016-11-09 | 2016-11-09 | AR technology-based machine operation instruction information display method and apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106569769A (en) |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107065808A (en) * | 2017-05-27 | 2017-08-18 | 深圳增强现实技术有限公司 | Accessories of a product method for posting, quality detecting method and production line system |
| CN107169139A (en) * | 2017-06-13 | 2017-09-15 | 深圳增强现实技术有限公司 | A kind of document file management system based on AR augmented realities, AR mobile intelligent terminals |
| CN107277172A (en) * | 2017-07-28 | 2017-10-20 | 深圳增强现实技术有限公司 | Machine operates monitor system and its ustomer premises access equipment |
| CN107316165A (en) * | 2017-07-28 | 2017-11-03 | 深圳增强现实技术有限公司 | Machine working specification creates system and operation Modeling Server |
| CN107370821A (en) * | 2017-08-03 | 2017-11-21 | 深圳增强现实技术有限公司 | Machine Operating Guideline system, method and ustomer premises access equipment |
| CN107391707A (en) * | 2017-07-28 | 2017-11-24 | 深圳增强现实技术有限公司 | Machine Operating Guideline system and ustomer premises access equipment |
| CN107422710A (en) * | 2017-07-28 | 2017-12-01 | 歌尔股份有限公司 | The method and system of assembling product or plant maintenance are aided in based on AR |
| CN107463153A (en) * | 2017-08-11 | 2017-12-12 | 深圳增强现实技术有限公司 | A kind of management method of equipment working state, management equipment and management system |
| CN107526590A (en) * | 2017-08-14 | 2017-12-29 | 深圳乐普智能医疗器械有限公司 | Operation guidance information methods of exhibiting, device and the terminal of Medical Devices |
| CN107547554A (en) * | 2017-09-08 | 2018-01-05 | 北京枭龙科技有限公司 | A kind of smart machine remote assisting system based on augmented reality |
| CN107688331A (en) * | 2017-08-30 | 2018-02-13 | 深圳增强现实技术有限公司 | Machine operates monitor system and its communication means |
| CN107730589A (en) * | 2017-08-18 | 2018-02-23 | 珠海格力电器股份有限公司 | A kind of assembly method of electrical equipment, device, storage device, mobile terminal and electrical equipment |
| CN107730008A (en) * | 2017-09-14 | 2018-02-23 | 珠海格力电器股份有限公司 | Equipment guidance method, device, computer-readable recording medium and terminal after sale |
| CN107784885A (en) * | 2017-10-26 | 2018-03-09 | 歌尔科技有限公司 | Operation training method and AR equipment based on AR equipment |
| CN107977685A (en) * | 2017-12-21 | 2018-05-01 | 江西爱驰亿维实业有限公司 | Obtain the method, apparatus and electronic equipment of electronics service manual |
| CN108021991A (en) * | 2017-11-14 | 2018-05-11 | 歌尔科技有限公司 | Obtain the method and device of device information |
| CN108168555A (en) * | 2017-12-08 | 2018-06-15 | 李志新 | Operation guidance method and system based on coordinate setting |
| CN108805294A (en) * | 2017-04-26 | 2018-11-13 | 联想新视界（天津）科技有限公司 | A kind of processing method and processing device of tutorial message for target device |
| CN109451295A (en) * | 2017-08-29 | 2019-03-08 | 深圳市掌网科技股份有限公司 | A kind of method and system obtaining virtual information |
| CN109993023A (en) * | 2017-12-29 | 2019-07-09 | 佛山市顺德区美的电热电器制造有限公司 | A kind of household electrical appliances networking indicating means, AR equipment and computer storage medium |
| CN110175681A (en) * | 2018-09-13 | 2019-08-27 | 中国国际海运集装箱(集团)股份有限公司 | Maintenance method and device for airport ground facilities |
| CN110196580A (en) * | 2019-05-29 | 2019-09-03 | 中国第一汽车股份有限公司 | Assemble guidance method, system, server and storage medium |
| CN110569265A (en) * | 2019-09-10 | 2019-12-13 | 浪潮商用机器有限公司 | server accessory information display method and device, AR glasses and media |
| WO2020057130A1 (en) * | 2018-09-17 | 2020-03-26 | 深圳市泰衡诺科技有限公司 | Application control method and means |
| CN111049687A (en) * | 2019-12-23 | 2020-04-21 | 华自科技股份有限公司 | Equipment maintenance video operation guide file processing method and device and AR terminal |
| CN111273762A (en) * | 2019-08-27 | 2020-06-12 | 上海飞机制造有限公司 | Connector pin sending method and device based on AR equipment, AR equipment and storage medium |
| US10706633B2 (en) | 2018-12-06 | 2020-07-07 | Toyota Motor Engineering & Manufacturing North America, Inc. | Augmented reality systems and methods for vehicle inspection |
| CN111915032A (en) * | 2020-08-07 | 2020-11-10 | 中国十七冶集团有限公司 | AR technology-based equipment use and maintenance method |
| TWI710357B (en) * | 2020-01-17 | 2020-11-21 | 東昕精密科技股份有限公司 | AR dental prosthesis manufacturing guidance system and its application method |
| WO2020237667A1 (en) * | 2019-05-31 | 2020-12-03 | 西门子股份公司 | Method, device, and system for transmitting task execution record, and medium |
| CN112101056A (en) * | 2020-09-29 | 2020-12-18 | 重庆市华驰交通科技有限公司 | Electromechanical equipment identification and information acquisition method and system based on wearable equipment |
| CN112288883A (en) * | 2020-10-30 | 2021-01-29 | 北京市商汤科技开发有限公司 | Method and device for prompting operation guide information, electronic equipment and storage medium |
| CN112684951A (en) * | 2020-12-17 | 2021-04-20 | 宽衍(北京)科技发展有限公司 | Fault information query method and device, AR glasses, server and storage medium |
| WO2022198547A1 (en) * | 2021-03-24 | 2022-09-29 | 成都维泰油气能源技术有限公司 | Assistance system and method for intelligent well control |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101630064A (en) * | 2009-08-11 | 2010-01-20 | 广东工业大学 | Head video perspective three-dimensional display and control method thereof |
| CN104834379A (en) * | 2015-05-05 | 2015-08-12 | 江苏卡罗卡国际动漫城有限公司 | Repair guide system based on AR (augmented reality) technology |
-
2016
- 2016-11-09 CN CN201610987399.6A patent/CN106569769A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101630064A (en) * | 2009-08-11 | 2010-01-20 | 广东工业大学 | Head video perspective three-dimensional display and control method thereof |
| CN104834379A (en) * | 2015-05-05 | 2015-08-12 | 江苏卡罗卡国际动漫城有限公司 | Repair guide system based on AR (augmented reality) technology |
Non-Patent Citations (1)
| Title |
|---|
| 饶勇等: ""增强现实设备维修系统操作状态检测方法研究"", 《机电工程技术》 * |
Cited By (41)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108805294A (en) * | 2017-04-26 | 2018-11-13 | 联想新视界（天津）科技有限公司 | A kind of processing method and processing device of tutorial message for target device |
| CN107065808A (en) * | 2017-05-27 | 2017-08-18 | 深圳增强现实技术有限公司 | Accessories of a product method for posting, quality detecting method and production line system |
| CN107169139A (en) * | 2017-06-13 | 2017-09-15 | 深圳增强现实技术有限公司 | A kind of document file management system based on AR augmented realities, AR mobile intelligent terminals |
| CN107422710A (en) * | 2017-07-28 | 2017-12-01 | 歌尔股份有限公司 | The method and system of assembling product or plant maintenance are aided in based on AR |
| CN107391707A (en) * | 2017-07-28 | 2017-11-24 | 深圳增强现实技术有限公司 | Machine Operating Guideline system and ustomer premises access equipment |
| CN107316165A (en) * | 2017-07-28 | 2017-11-03 | 深圳增强现实技术有限公司 | Machine working specification creates system and operation Modeling Server |
| CN107277172A (en) * | 2017-07-28 | 2017-10-20 | 深圳增强现实技术有限公司 | Machine operates monitor system and its ustomer premises access equipment |
| CN107370821A (en) * | 2017-08-03 | 2017-11-21 | 深圳增强现实技术有限公司 | Machine Operating Guideline system, method and ustomer premises access equipment |
| CN107370821B (en) * | 2017-08-03 | 2020-10-09 | 深圳增强现实技术有限公司 | Machine operation guidance system |
| CN107463153A (en) * | 2017-08-11 | 2017-12-12 | 深圳增强现实技术有限公司 | A kind of management method of equipment working state, management equipment and management system |
| CN107463153B (en) * | 2017-08-11 | 2019-08-20 | 深圳增强现实技术有限公司 | A kind of management method of equipment working state, management equipment and management system |
| CN107526590A (en) * | 2017-08-14 | 2017-12-29 | 深圳乐普智能医疗器械有限公司 | Operation guidance information methods of exhibiting, device and the terminal of Medical Devices |
| CN107526590B (en) * | 2017-08-14 | 2021-03-30 | 深圳乐普智能医疗器械有限公司 | Operation guidance information display method and device of medical equipment and terminal |
| CN107730589A (en) * | 2017-08-18 | 2018-02-23 | 珠海格力电器股份有限公司 | A kind of assembly method of electrical equipment, device, storage device, mobile terminal and electrical equipment |
| CN109451295A (en) * | 2017-08-29 | 2019-03-08 | 深圳市掌网科技股份有限公司 | A kind of method and system obtaining virtual information |
| CN107688331A (en) * | 2017-08-30 | 2018-02-13 | 深圳增强现实技术有限公司 | Machine operates monitor system and its communication means |
| CN107547554A (en) * | 2017-09-08 | 2018-01-05 | 北京枭龙科技有限公司 | A kind of smart machine remote assisting system based on augmented reality |
| CN107730008A (en) * | 2017-09-14 | 2018-02-23 | 珠海格力电器股份有限公司 | Equipment guidance method, device, computer-readable recording medium and terminal after sale |
| CN107784885A (en) * | 2017-10-26 | 2018-03-09 | 歌尔科技有限公司 | Operation training method and AR equipment based on AR equipment |
| CN108021991A (en) * | 2017-11-14 | 2018-05-11 | 歌尔科技有限公司 | Obtain the method and device of device information |
| CN108168555A (en) * | 2017-12-08 | 2018-06-15 | 李志新 | Operation guidance method and system based on coordinate setting |
| CN107977685A (en) * | 2017-12-21 | 2018-05-01 | 江西爱驰亿维实业有限公司 | Obtain the method, apparatus and electronic equipment of electronics service manual |
| CN109993023A (en) * | 2017-12-29 | 2019-07-09 | 佛山市顺德区美的电热电器制造有限公司 | A kind of household electrical appliances networking indicating means, AR equipment and computer storage medium |
| CN110175681A (en) * | 2018-09-13 | 2019-08-27 | 中国国际海运集装箱(集团)股份有限公司 | Maintenance method and device for airport ground facilities |
| WO2020057130A1 (en) * | 2018-09-17 | 2020-03-26 | 深圳市泰衡诺科技有限公司 | Application control method and means |
| US10706633B2 (en) | 2018-12-06 | 2020-07-07 | Toyota Motor Engineering & Manufacturing North America, Inc. | Augmented reality systems and methods for vehicle inspection |
| CN110196580A (en) * | 2019-05-29 | 2019-09-03 | 中国第一汽车股份有限公司 | Assemble guidance method, system, server and storage medium |
| CN110196580B (en) * | 2019-05-29 | 2020-12-15 | 中国第一汽车股份有限公司 | Assembly guidance method, system, server and storage medium |
| WO2020237667A1 (en) * | 2019-05-31 | 2020-12-03 | 西门子股份公司 | Method, device, and system for transmitting task execution record, and medium |
| CN111273762A (en) * | 2019-08-27 | 2020-06-12 | 上海飞机制造有限公司 | Connector pin sending method and device based on AR equipment, AR equipment and storage medium |
| CN110569265A (en) * | 2019-09-10 | 2019-12-13 | 浪潮商用机器有限公司 | server accessory information display method and device, AR glasses and media |
| CN111049687A (en) * | 2019-12-23 | 2020-04-21 | 华自科技股份有限公司 | Equipment maintenance video operation guide file processing method and device and AR terminal |
| CN111049687B (en) * | 2019-12-23 | 2023-03-24 | 华自科技股份有限公司 | Equipment maintenance video operation guide file processing method and device and AR terminal |
| CN113133844A (en) * | 2020-01-17 | 2021-07-20 | 东昕精密科技股份有限公司 | AR dental prosthesis manufacturing guide system and application method thereof |
| TWI710357B (en) * | 2020-01-17 | 2020-11-21 | 東昕精密科技股份有限公司 | AR dental prosthesis manufacturing guidance system and its application method |
| CN111915032A (en) * | 2020-08-07 | 2020-11-10 | 中国十七冶集团有限公司 | AR technology-based equipment use and maintenance method |
| CN112101056A (en) * | 2020-09-29 | 2020-12-18 | 重庆市华驰交通科技有限公司 | Electromechanical equipment identification and information acquisition method and system based on wearable equipment |
| CN112288883A (en) * | 2020-10-30 | 2021-01-29 | 北京市商汤科技开发有限公司 | Method and device for prompting operation guide information, electronic equipment and storage medium |
| CN112684951A (en) * | 2020-12-17 | 2021-04-20 | 宽衍(北京)科技发展有限公司 | Fault information query method and device, AR glasses, server and storage medium |
| WO2022198547A1 (en) * | 2021-03-24 | 2022-09-29 | 成都维泰油气能源技术有限公司 | Assistance system and method for intelligent well control |
| US11756275B2 (en) | 2021-03-24 | 2023-09-12 | Vertechs Oil & Gas Technology Co., Ltd. | Auxiliary system and method for intelligent well control |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106569769A (en) | AR technology-based machine operation instruction information display method and apparatus | |
| CN106569671A (en) | AR technology-based method and device for displaying instruction information of consumer goods | |
| JP6527507B2 (en) | Smart Prostheses to Promote Artificial Vision Using Scene Abstraction | |
| US20170124770A1 (en) | Self-demonstrating object features and/or operations in interactive 3d-model of real object for understanding object's functionality | |
| US20190251750A1 (en) | Systems and methods for using a virtual reality device to emulate user experience of an augmented reality device | |
| US20070195082A1 (en) | Three-dimensional processing device, information terminal, computer program, and three-dimensional processing method | |
| CN105589199A (en) | Display device, method of controlling the same, and program | |
| CN105513436B (en) | Interactive holographic illusion teaching system and method | |
| EP3588469A1 (en) | Method and system for sharing automatically procedural knowledge | |
| WO2018142756A1 (en) | Information processing device and information processing method | |
| US11232636B2 (en) | Methods, devices, and systems for producing augmented reality | |
| JP2018525692A (en) | Presentation of virtual reality contents including viewpoint movement to prevent simulator sickness | |
| CN110488979A (en) | A kind of automobile showing system based on augmented reality | |
| CN107730008A (en) | Equipment guidance method, device, computer-readable recording medium and terminal after sale | |
| CN104750933A (en) | Eyeglass trying on method and system based on Internet | |
| KR20160000346A (en) | Method for configuring multiple training mode, and apparatus and computer readable recording medium using the same | |
| US20190347864A1 (en) | Storage medium, content providing apparatus, and control method for providing stereoscopic content based on viewing progression | |
| CN108090491A (en) | A kind of video recording method, device and computer readable storage medium | |
| JP6969807B2 (en) | Work support system | |
| US20210037063A1 (en) | Information processing device, information processing method, and computer program | |
| CN107817701A (en) | Apparatus control method, device, computer-readable recording medium and terminal | |
| CN106162303A (en) | Information processing method, information processor and subscriber equipment | |
| CN110389447A (en) | Transmission-type head-mount type display unit, auxiliary system, display control method and medium | |
| JP2023503862A (en) | Predictive virtual reconfiguration of physical environments | |
| CN113574849A (en) | Object scanning for subsequent object detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170419 |
|
| RJ01 | Rejection of invention patent application after publication |