CN109814709A - Operating Guideline method and device based on AR system - Google Patents
Operating Guideline method and device based on AR system Download PDFInfo
- Publication number
- CN109814709A CN109814709A CN201811610289.3A CN201811610289A CN109814709A CN 109814709 A CN109814709 A CN 109814709A CN 201811610289 A CN201811610289 A CN 201811610289A CN 109814709 A CN109814709 A CN 109814709A
- Authority
- CN
- China
- Prior art keywords
- virtual screen
- picture
- instructed
- equipment
- operating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
This application discloses a kind of Operating Guideline method and devices based on AR system, wherein, the Operating Guideline method based on AR system includes: to be scanned to the picture that image content is equipment to be operated or components, obtains equipment to be operated or the corresponding model of components in the picture；The first real picture for obtaining virtual screen to be instructed and operation scene that the first operation is carried out to the model, sends the virtual screen to be instructed and the first real picture；Wherein, the virtual screen to be instructed is the virtual screen before carrying out the first operation to the model；Receive the first Operating Guideline for carrying out the first operation to the virtual screen to be instructed according to first real picture.The embodiment of the present application is not necessarily to browse papery data or expert to on-the-spot guidance when obtaining the technical data of operation equipment or components, so that environment when reducing the procurement cost of equipment or components technical data and reducing operation equipment or components influences.
Description
Technical field
The application belongs to industrial manufacturing technology field, specifically, being related to a kind of Operating Guideline method based on AR system
And device.
Background technique
Equipment and technology personnel usually need to consult technical data in assembly, maintenance of equipment in industry at present, to obtain skill
Art guidance, preferably completes the work of assembly, maintenance of equipment.The acquisition modes of usual technical data predominantly consult papery data
And expert is invited to go guidance to operate to actual place.
But technical staff often wants to consult in operation in operation in above-mentioned acquisition modes, or expert is needed to arrive
On-site support could be completed, and faulty operation is undoubtedly easy to appear.It can be seen that the acquisition modes operating cost of current technical data
Higher, poor controllability and easily it is affected by environment, be easy to appear faulty operation.
Summary of the invention
In view of this, the technical problem to be solved by the application is to provide a kind of Operating Guideline methods based on AR system
And device, with when obtaining the technical data of operation equipment or components without browsing papery data or expert to on-the-spot guidance,
To which environment when reducing the procurement cost of equipment or components technical data and reducing operation equipment or components influences.
In order to solve the above-mentioned technical problem, this application discloses a kind of Operating Guideline method based on AR system, the sides
Method includes:
Picture to image content for equipment to be operated or components is scanned, and obtains equipment to be operated in the picture
Or the corresponding model of components；
The first real picture of virtual screen to be instructed and operation scene that the first operation is carried out to the model is obtained,
Send the virtual screen to be instructed and the first real picture；Wherein, the virtual screen to be instructed be to the model into
Virtual screen before the operation of row first；
It receives and is referred to according to the first operation that first real picture carries out the first operation to the virtual screen to be instructed
It leads.
In order to solve the above technical problems, being applied to disclosed herein as well is a kind of Operating Guideline method based on AR system
The network equipment, which comprises
Receive the first real picture of virtual screen to be instructed and operation scene, wherein the virtual screen to be instructed
To treat the virtual screen before operation equipment or corresponding the first operation of model progress of components；
According to first real picture, generates the first operation that the first operation is carried out to the virtual screen to be instructed and refer to
It leads；
Send first Operating Guideline.
In order to solve the above technical problems, disclosed herein as well is a kind of Operating Guideline device based on AR system, the dress
It sets and includes:
Scanning element is scanned for the picture to image content for equipment to be operated or components, obtains the figure
Equipment to be operated or the corresponding model of components in piece；
First transmission unit carries out the virtual screen to be instructed and operate existing that first operates to the model for obtaining
First real picture of field sends the virtual screen to be instructed and the first real picture；Wherein, described wait instruct virtually to draw
Face is the virtual screen before carrying out the first operation to the model；
First receiving unit carries out first to the virtual screen to be instructed according to first real picture for receiving
First Operating Guideline of operation.
In order to solve the above technical problems, disclosed herein as well is a kind of Operating Guideline device based on AR system, the dress
It sets and includes:
Second receiving unit, for receiving the first real picture of virtual screen to be instructed and operation scene, wherein institute
Stating virtual screen to be instructed is the virtual screen before treating operation equipment or corresponding the first operation of model progress of components；
Generation unit, for generating and carrying out the first behaviour to the virtual screen to be instructed according to first real picture
The first Operating Guideline made；
Second transmission unit, for sending first Operating Guideline.
Compared with prior art, the application can be obtained including following technical effect:
The embodiment of the present application realizes a kind of Operating Guideline method and device based on AR system, can be realized using virtual
Environmental information guides the operation of equipment or components in actual environment, and operating process remote terminal can be directly obtained to model
The virtual screen to be instructed of the first operation and first real picture at operation scene are carried out, and according to the first real picture to institute
The first Operating Guideline that virtual screen to be instructed carries out the first operation is stated, the first Operating Guideline is real-time transmitted to operator's application
AR equipment.The embodiment of the present application shows the first Operating Guideline in face of operator with virtual image, like facing with expert
Face exchange progress Operating Guideline is general, and operator can intuitively be operated by guidance, and tutorial message be made to have obtained significantly more efficient biography
It reaches.The embodiment of the present application is when obtaining the technical data of operation equipment or components without browsing papery data or expert to scene
Guidance, thus environment shadow when reducing the procurement cost of equipment or components technical data and reducing operation equipment or components
It rings.The embodiment of the present application improves traditional mode of operation, can be solved the problems, such as in a manner of low cost, intelligence.
Certainly, any product for implementing the application must be not necessarily required to reach all the above technical effect simultaneously.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present application, constitutes part of this application, this Shen
Illustrative embodiments and their description please are not constituted an undue limitation on the present application for explaining the application.In the accompanying drawings:
Fig. 1 is the Operating Guideline method flow schematic diagram based on AR system that the application some embodiments provide；
Fig. 2 is the Operating Guideline method flow schematic diagram based on AR system that the application some embodiments provide；
Fig. 3 is the Operating Guideline method flow schematic diagram based on AR system that the application some embodiments provide；
Fig. 4 is the Operating Guideline method flow schematic diagram based on AR system that the application some embodiments provide；
Fig. 5 is the Operating Guideline schematic device based on AR system that the application some embodiments provide；
Fig. 6 is the Operating Guideline schematic device based on AR system that the application some embodiments provide.
Specific embodiment
Presently filed embodiment is described in detail below in conjunction with accompanying drawings and embodiments, how the application is applied whereby
Technological means solves technical problem and reaches the realization process of technical effect to fully understand and implement.
It is found by the applicant that the prior art has the following problems:
Equipment and technology personnel usually need to consult technical data in assembly, maintenance of equipment in industry at present, usual technology
The acquisition modes of data predominantly consult papery data and expert are invited to go guidance to operate to actual place.But above-mentioned acquisition side
Technical staff often wants to consult in operation in operation in formula, or needs expert that could complete to on-site support, nothing
It doubts and is easy to appear faulty operation.It can be seen that at present technical data acquisition modes operating cost is higher, poor controllability and easily
It is affected by environment, it is easy to appear faulty operation.
Environment when to reduce the procurement cost of equipment or components technical data and reduce operation equipment or components
It influences, applicant proposed a kind of technical solution, equipment to be operated or components can will be superimposed on true operation scenario
Dummy model, and visualized operation guidance is provided for operating process.
The embodiment of the present application provides a kind of Operating Guideline method based on AR system, and this method is applied to include augmented reality
The AR system of AR (full name in English Augmented Reality, abbreviation AR) equipment, which may include that wear-type AR is shown
Equipment and the terminal device being connect with wear-type AR display equipment.Wherein, wear-type AR shows that equipment can have shooting dress
Such as camera is set, scan operation is able to carry out.Specifically, wear-type AR shows that equipment can be AR glasses, the terminal device
It can be PC terminal, be also possible to mobile terminal such as IPAD, smart phone etc..It include herein AR glasses and PC to instruct system
It is illustrated for terminal, wherein there is camera in AR glasses.
Referring to Fig. 1, the Operating Guideline method based on AR system that the embodiment of the present application offer is applied to AR glasses is specific
It is as follows.
Step 102, the picture that image content is equipment to be operated or components is scanned, obtain in the picture to
Operate equipment or the corresponding model of components.
It, can be by current operation when operator encounters problems in operation needs to call in the experts Operating Guideline
Scene sends expert to, to seek Operating Guideline.In the present embodiment, operator can be by the camera in AR glasses to right
Image content is that the picture of equipment to be operated or components is scanned, and obtains equipment to be operated or components pair in the picture
The model answered.In the present embodiment, carrying out operation to equipment or components can be assembly, maintenance, disassembly, assembling, packing hair
The operation such as goods.
In one embodiment, AR glasses can store model library, which includes mark and equipment or components
The corresponding relationship of model, AR glasses are the picture progress picture identification of equipment to be operated or components to image content, are identified
The mark of the equipment to be operated or components.
AR glasses can search the mark of the equipment to be operated or components in the corresponding relationship that model library includes, with
Determine the corresponding model of mark of the equipment to be operated or components.AR glasses find the equipment to be operated or components
The corresponding model of mark after, show the model found.
Step 104, it obtains and the virtual screen to be instructed of the first operation is carried out to the model and operates live first
Real picture sends the virtual screen to be instructed and the first real picture；Wherein, the virtual screen to be instructed is to institute
State the virtual screen before the first operation of model progress.
It encounters problems when operator carries out the first operation in operation and needs the Operating Guideline that calls in the experts, it can be with
The first real picture of virtual screen to be instructed and operation scene that the first operation is carried out to the model is obtained, and will be wait refer to
It leads virtual screen and the first real picture sends the PC terminal of expert's application to, seek expert's Operating Guideline.It can see herein
Out, the first real picture is to be shot to operation scene, and operating scene is to treat operation equipment or components
Scene when the first operation is carried out, therefore the first real picture and virtual screen to be instructed are corresponding relationships, i.e., the first true picture
Face is the real scene of virtual screen to be instructed.
Step 106, it receives and the of the first operation is carried out to the virtual screen to be instructed according to first real picture
One Operating Guideline.
After expert makes according to the first real picture how to carry out the process of the first operation, it can pass through according to this process
PC terminal, which is treated, instructs virtual screen to carry out the first operation, generates the first Operating Guideline.Then PC terminal is by the first Operating Guideline
It is sent to AR glasses.AR glasses receive and show first Operating Guideline, are set with instructing operator to treat operation at operation scene
Standby or components carry out the first operation.
In one embodiment, the first Operating Guideline can be specially sent to AR glasses by the end PC in real time, i.e. expert passes through PC
Terminal treats the process for instructing virtual screen to carry out the first operation can be sent to AR glasses in real time.Operator can pass through in this way
AR glasses watch the process that expert carries out the first operation in real time, improve and instruct efficiency.
It in one embodiment, can be right at operation scene after operator watches the first Operating Guideline by AR glasses
Equipment to be operated or components carry out the first operation, and then AR glasses are obtained by camera according to first Operating Guideline pair
The equipment to be operated or components carry out the second real picture of the first operation, and then AR glasses are by second real picture
It is sent to PC terminal.PC terminal receives and shows second real picture, and expert watches the second true picture by PC terminal
Behind face, the second Operating Guideline can be generated according to second real picture, and send AR glasses for second Operating Guideline.
Second Operating Guideline can be the suggestion that the first operation is executed to operator, to instruct operator to be better carried out the first behaviour
Make.
If such as operator's not to be noted certain items when executing the first operation, or execute mistake, expert can pass through
PC terminal carries suggestion for operation flourishing to AR glasses in the second Operating Guideline.
The embodiment of the present application can be realized the operation using equipment or components in virtual environment information guidance actual environment,
Operating process remote terminal can be directly obtained virtual screen to be instructed and the operation scene that the first operation is carried out to model
The first real picture, and referred to according to the first operation that the first real picture carries out the first operation to the virtual screen to be instructed
It leads, the first Operating Guideline is real-time transmitted to the AR equipment of operator's application.The embodiment of the present application is by the first Operating Guideline with void
Quasi- image is shown in face of operator, and like carrying out Operating Guideline with expert's face-to-face exchange, operator can intuitive quilt
Guidance operation, makes tutorial message obtain significantly more efficient reception and registration.The embodiment of the present application is obtaining operation equipment or components
Without browsing papery data or expert to on-the-spot guidance when technical data, to reduce the acquisition of equipment or components technical data
Cost and the environment reduced when operating equipment or components influence.The embodiment of the present application improves traditional mode of operation, energy
It is enough to be solved the problems, such as in a manner of low cost, intelligence.
Referring to Fig. 2, the Operating Guideline method based on AR system that the embodiment of the present application offer is applied to AR glasses is specific
It is as follows.
Step 202, the picture that image content is equipment to be operated or components is scanned, obtain in the picture to
Operate the operating instruction of equipment or the corresponding model of components and the model.
It, can be by current operation when operator encounters problems in operation needs to call in the experts Operating Guideline
Scene sends expert to, to seek Operating Guideline.In the present embodiment, operator can be by the camera in AR glasses to right
Image content is that the picture of equipment to be operated or components is scanned, and obtains equipment to be operated or components pair in the picture
The model answered.
In one embodiment, AR glasses can store model library, which includes mark, equipment or components mould
The corresponding relationship that type, model manipulation illustrate, AR glasses are the picture progress picture of equipment to be operated or components to image content
Identification identifies the mark of the equipment to be operated or components.
AR glasses can search the mark of the equipment to be operated or components in the corresponding relationship that model library includes, with
Determine the corresponding model of mark of the equipment to be operated or components, the operating instruction of the model.AR glasses find described
After the corresponding model of mark and operating instruction wait operate equipment or components, the model found and operating instruction are shown.Its
In, operating instruction is the teachings operated to the model, such as to the model carry out operating process in each picture,
Text or speech explanation, points for attention etc..
Step 204, the gesture instruction for showing the operating instruction is received, is shown according to the operating instruction to the model
Carry out the first operation virtual screen before each operation, and obtain from the first operation virtual screen to the model into
The virtual screen to be instructed that row first operates；First real picture at operation scene is obtained, the virtual screen to be instructed is sent
And first real picture；Wherein, the virtual screen to be instructed is the virtual picture before carrying out the first operation to the model
Face.
When default confirmation gesture of the AR glasses by camera detection to operator, confirmation, which receives, shows the operation
The gesture instruction of explanation.Then show that the first operation before carrying out each operation to the model is empty according to the operating instruction
Quasi- picture.In one example, when AR glasses can also be shown to each operation of model progress according to the operating instruction
The second operation virtual screen, and/or the third that carries out after each operation operate virtual screen.
It encounters problems when operator carries out the first operation in operation and needs the Operating Guideline that calls in the experts, it can be with
The PC terminal used Xiang expert initiates the connection request, seeks the guidance of expert.Specifically, when receiving for sending connection request
First gesture/phonetic order when, send connection request to PC terminal, be based on connection request return when receiving PC terminal
Response when, with the PC terminal establish communicate to connect.
Then, AR glasses can from it is described first operation virtual screen in obtain to the model carry out first operation to
Virtual screen is instructed, and operation scene is shot by camera, obtains the first real picture.AR glasses again will be wait instruct
Virtual screen and the first real picture send the PC terminal of expert's application to, seek expert's Operating Guideline.This can be seen that
First real picture is to be shot to operation scene, and operating scene is to treat operation equipment or components progress
Scene when the first operation, therefore the first real picture and virtual screen to be instructed are corresponding relationships, i.e., the first real picture is
The real scene of virtual screen to be instructed.
Step 206, it receives and the of the first operation is carried out to the virtual screen to be instructed according to first real picture
One Operating Guideline.
After expert makes according to the first real picture how to carry out the process of the first operation, it can pass through according to this process
PC terminal, which is treated, instructs virtual screen to carry out the first operation, generates the first Operating Guideline.Then PC terminal is by the first Operating Guideline
It is sent to AR glasses.AR glasses receive and show first Operating Guideline, are set with instructing operator to treat operation at operation scene
Standby or components carry out the first operation.
In one embodiment, the first Operating Guideline can be specially sent to AR glasses by the end PC in real time, i.e. expert passes through PC
Terminal treats the process for instructing virtual screen to carry out the first operation can be sent to AR glasses in real time.Operator can pass through in this way
AR glasses watch the process that expert carries out the first operation in real time, improve and instruct efficiency.
Optionally, AR glasses also send the voice that operational issue description is carried out to first operation to the terminal device
Information.It in an implementation, is the problem of expert capable of being made to be best understood from operator, operator can operate generation to execution first
Operational issue carries out voice description, and voice description is then sent to PC terminal in real time.PC terminal receives and plays the voice
Description, so that the problem of expert is best understood from operator.
The embodiment of the present application obtains corresponding model by scan image, by merging with actual environment, uses virtual information
Instruct the operation of practical components, can by way of body feeling interaction quick obtaining Operating Guideline, and pass through real-time pictures biography
It is defeated to be instructed with obtaining expert.The embodiment of the present application shows the first Operating Guideline in face of operator with virtual image, like with
Expert's face-to-face exchange progress Operating Guideline is general, and operator can intuitively be operated by guidance, and tutorial message be made to have obtained more
It is effective to convey.The embodiment of the present application is not necessarily to browse papery data or special when obtaining the technical data of operation equipment or components
Family arrives on-the-spot guidance, thus when reducing the procurement cost of equipment or components technical data and reducing operation equipment or components
Environment influence.The embodiment of the present application improves traditional mode of operation, can be solved the problems, such as in a manner of low cost, intelligence.
Referring to Fig. 3, the embodiment of the present application is provided applied to terminal device (below by taking PC terminal as an example) based on AR system
The Operating Guideline method of system is specific as follows.
Step 302, the virtual screen to be instructed and operation scene that AR (below by taking AR glasses as an example) equipment is sent are received
The first real picture, wherein the virtual screen to be instructed is to treat operation equipment or the corresponding model of components carries out the
Virtual screen before one operation.
It encounters problems when operator carries out the first operation in operation and needs the Operating Guideline that calls in the experts, it can be with
The first real picture of virtual screen to be instructed and operation scene that the first operation is carried out to the model is obtained, and will be wait refer to
It leads virtual screen and the first real picture sends the PC terminal of expert's application to, seek expert's Operating Guideline.It can see herein
Out, the first real picture is to be shot to operation scene, and operating scene is to treat operation equipment or components
Scene when the first operation is carried out, therefore the first real picture and virtual screen to be instructed are corresponding relationships, i.e., the first true picture
Face is the real scene of virtual screen to be instructed.
Step 304, it according to first real picture, generates and the of the first operation is carried out to the virtual screen to be instructed
One Operating Guideline.
After expert makes according to the first real picture how to carry out the process of the first operation, it can pass through according to this process
PC terminal, which is treated, instructs virtual screen to carry out the first operation, generates the first Operating Guideline.
In one embodiment, can generate the first Operating Guideline in the following way: PC terminal shows described wait instruct
Virtual screen, and the operating process for carrying out the first operation to the virtual screen to be instructed is marked, and generates the first operation and refers to
It leads.
In another embodiment, can generate the first Operating Guideline in the following way: PC terminal obtain to it is described to
Operating process when virtual screen being instructed to carry out the first operation, using the operating process as the first Operating Guideline.In such side
In formula, PC terminal can directly choose the first Operating Guideline from local cloud resource library, and first Operating Guideline is sent to
AR glasses.Wherein, it can store the operating instruction to each model in cloud resource library, the mould of equipment or part can also be stored with
Type, image etc..Certainly, cloud resource library also can store beyond the clouds or in other equipment, and the application is not particularly limited.
Step 306, first Operating Guideline is sent.
First Operating Guideline can be sent to AR glasses by PC terminal by expert.AR glasses receive and show first behaviour
It coaches, to instruct, operator treats operation equipment at operation scene or components carry out the first operation.
In an implementation column, method shown in Fig. 3 can also include step 308 and 310.
Step 308, it receives and the first operation is carried out to the equipment to be operated or components according to first Operating Guideline
The second real picture.
After operator watches the first Operating Guideline by AR glasses, operation equipment or zero can be treated at operation scene
Part carries out the first operation, then AR glasses by camera acquisition according to first Operating Guideline to the equipment to be operated or
Components carry out the second real picture of the first operation, and then second real picture is sent to PC terminal by AR glasses.PC
Terminal receives and shows second real picture.
Step 310, according to second real picture, the second operation operated to second real picture is generated
Guidance.
After expert watches second real picture by PC terminal, second can be generated according to second real picture
Operating Guideline, and AR glasses are sent by second Operating Guideline.Second Operating Guideline, which can be, executes first to operator
The suggestion of operation, to instruct operator to be better carried out the first operation.If such as when operator's the first operation of execution not to be noted
Certain items, or mistake is executed, suggestion for operation can be carried the prosperity in the second Operating Guideline by PC terminal and given by expert
AR glasses.
To be better understood when scheme provided by the embodiments of the present application, it is illustrated below with a specific embodiment.This
The networkings of embodiment application scenarios as shown in figure 4, include AR glasses and PC terminal, below for being assembled to components into
Row explanation.
Step 401, operator take AR glasses, and take out the picture of components to be assembled and the components of assembly, make
Initiation gesture.When AR glasses pass through the camera detection initiation gesture, start in AR glasses, the AR glasses visual field presents and sweeps at this time
Retouch picture prompting.The picture of components to be assembled is scanned by AR glasses, occurs the components 3D mould assembled in the AR glasses visual field
Type and operating instruction, wherein the operating instruction may include assembly animation.Operator enters scene default and sees treating and match
The first step operating procedure of zero setting component, and default the voice prompting for hearing the first operating procedure.
Step 402, operator on the button of sight focal point to " next step ", can will make default confirmation gesture,
When AR glasses pass through default confirmation gesture of the camera detection to operator, confirmation, which receives, shows that the gesture of operating instruction refers to
It enables, into second step.
Step 403, AR glasses can show that the first operation before carrying out each operation to model is virtual according to operating instruction
The third after the second operation virtual screen and each operation of progress when picture, each operation operates virtual screen.Grasp
Author can be appreciated that operation virtual screen, text prompt and the voice prompting of each installation step, while can show in assembling process
The points for attention being likely to occur.
The step of operator can enter behind operating instruction according to the interactive mode of step 402, is drawn by each step
Lead information guiding operating process, all operating process real-time synchronizations to expert end.
Step 404, when operator encounters problems need to call in the experts Operating Guideline in operation, can choose
Remote is connected, the PC terminal used to expert initiates the connection request.Operator is by sight focal point " connection expert "
Button on, make default confirmation gesture, confirmation connection Remote, " connection expert " button becomes red and " cancels simultaneously
Connection " button.Specifically, sending and connecting to the end PC when AR glasses pass through default confirmation gesture of the camera detection to operator
Request.When receiving the response that PC terminal is returned based on the connection request, establishes and communicate to connect with the PC terminal.
AR glasses can be by real picture and virtual screen synchronous transfer to expert end, operating side after the completion of step 405, connection
Communication can be carried out by way of voice between expert end.I.e. AR glasses are also sent to PC terminal to first behaviour
Make the voice messaging of progress operational issue description.Step 406, expert show real picture and virtual screen by PC terminal.Its
Middle PC terminal can also show the interface UI of expert's operable " cloud resource ", " label ", " deletion label ".
Step 407, expert can be with markup pictures under flag state by " label " button that PC terminal receives selection
In the place to be marked, each step to be marked, generate Operating Guideline.Specifically, can held in virtual screen
First place when row first operates is marked: " 1 ", to indicate the step 1 when carrying out the first operation.Then to executing the
Second place when two operations is marked: " 2 ", to indicate the step 2 when carrying out the first operation.And so on, it has marked
One ground can after next place is marked again, the route and mark of label can also be real-time transmitted to AR glasses, grasp
Author can see the place of expert's label by AR glasses, carry out visualization guidance assembly.
Certainly, expert can also select " deleting label " button by PC terminal, delete all labels in picture, equally
It deletes to mark in picture and can also be transmitted to AR glasses.
Expert can also select cloud resource by PC terminal, can store the operating instruction to each model in cloud resource,
3D model, the image etc. of equipment or part can also be stored with.Expert can select these resources by PC terminal, click " on
Pass " button, resource is uploaded, is checked for operator.
It should be understood that operator by AR glasses receive expert upload cloud resource after, will pop up " checking " or
The interface person " cancellation " UI, operator is by sight focal point " checking " or the " Cancel " button, when AR Glasses detection to default hand
It when gesture, selects " checking ", AR glasses can show the data for being transmitted through and.
Specifically, operator by sight focal point on " cloud resource " button, when AR Glasses detection opens hand to default
When gesture, cloud resource menu is opened, cloud resource list can be showed, the cloud resource that expert uploads, operator are shown in list
It can be by checking cloud resource, guidance operation.
When step 408, operator no longer need expert to help, button " is cancelled and being connected " to sight focal point by operator,
When AR glasses pass through default confirmation gesture of the camera detection to operator, " cancelling connection " is chosen, terminates expert's request, if
Secondary request expert is needed, is operated using the mode of operation of step 404 before.
Referring to Fig. 5, the embodiment of the present application also provides a kind of Operating Guideline device based on AR system, described device packet
It includes: scanning element 500, the first transmission unit 501 and the first receiving unit 502.
Scanning element 500 is scanned, described in acquisition for the picture to image content for equipment to be operated or components
Equipment to be operated or the corresponding model of components in picture；
First transmission unit 501, for obtaining the virtual screen to be instructed and the behaviour that carry out the first operation to the model
Make first real picture at scene, sends the virtual screen to be instructed and the first real picture；Wherein, the void to be instructed
Quasi- picture is the virtual screen before carrying out the first operation to the model；
First receiving unit 502 carries out the virtual screen to be instructed according to first real picture for receiving
First Operating Guideline of the first operation.
Optionally, the scanning element 500, is specifically used for:
It is the picture progress picture identification of equipment to be operated or components to image content, identifies the equipment to be operated
Or the mark of components；
According to the mark, the corresponding model of the mark is determined from preset model library.
Optionally, the scanning element in the Operating Guideline device based on AR system is also used to: obtaining the model
Operating instruction；Then first transmission unit 501, is specifically used for: the gesture instruction for showing the operating instruction is received, according to institute
It states operating instruction and shows that first before carrying out each operation to the model operates virtual screen, and is empty from first operation
The virtual screen to be instructed that the first operation is carried out to the model is obtained in quasi- picture.
Optionally, first transmission unit 501, is also used to: described to show according to the operating instruction to the model
The third after the second operation virtual screen, and/or each operation of progress when carrying out each operation operates virtual screen；
And/or
Send the voice messaging that operational issue description is carried out to first operation.
Optionally, the first transmission unit 501 of the Operating Guideline device based on AR system, is also used to: obtaining foundation
First Operating Guideline carries out the second real picture of the first operation to the equipment to be operated or components, sends described the
Two real pictures；
First receiving unit 501 of the Operating Guideline device based on AR system, is also used to: receiving according to described second
The second Operating Guideline that real picture is sent.
Referring to Fig. 6, the embodiment of the present application also provides a kind of Operating Guideline device based on AR system, described device packet
It includes: the second receiving unit 600, generation unit 601, the second transmission unit 602.
Second receiving unit 600, for receiving the first real picture of virtual screen to be instructed and operation scene,
In, the virtual screen to be instructed is the virtual picture before treating operation equipment or corresponding the first operation of model progress of components
Face；
Generation unit 601, for generating and carrying out first to the virtual screen to be instructed according to first real picture
First Operating Guideline of operation；
Second transmission unit 602, for sending first Operating Guideline.
Optionally, the second receiving unit 600 of the Operating Guideline device based on AR system, is also used to: receiving foundation
First Operating Guideline carries out the second real picture of the first operation to the equipment to be operated or components；
The generation unit 601 of the Operating Guideline device based on AR system, is also used to: according to the described second true picture
Face generates the second Operating Guideline operated to second real picture.
Optionally, the generation unit 601, is specifically used for:
Show the virtual screen to be instructed, and to the virtual screen to be instructed carry out the operating process of the first operation into
Line flag generates the first Operating Guideline；Or
It obtains to operating process when instructing virtual screen to carry out the first operation, using the operating process as the
One Operating Guideline.
In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include non-temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
As used some vocabulary to censure specific components in the specification and claims.Those skilled in the art answer
It is understood that hardware manufacturer may call the same component with different nouns.This specification and claims are not with name
The difference of title is as the mode for distinguishing component, but with the difference of component functionally as the criterion of differentiation.Such as logical
The "comprising" of piece specification and claim mentioned in is an open language, therefore should be construed to " include but do not limit
In "." substantially " refer within the acceptable error range, those skilled in the art can within a certain error range solve described in
Technical problem basically reaches the technical effect.In addition, " coupling " word includes any direct and indirect electric property coupling herein
Means.Therefore, if it is described herein that a first device is coupled to a second device, then representing the first device can directly electrical coupling
It is connected to the second device, or the second device indirectly electrically coupled through other devices or coupling means.Specification
Subsequent descriptions be implement the application better embodiment, so it is described description be for the purpose of the rule for illustrating the application,
It is not intended to limit the scope of the present application.The protection scope of the application is as defined by the appended claims.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
Include, so that commodity or system including a series of elements not only include those elements, but also including not clear
The other element listed, or further include for this commodity or the intrinsic element of system.In the feelings not limited more
Under condition, the element that is limited by sentence "including a ...", it is not excluded that in the commodity or system for including the element also
There are other identical elements.
Several preferred embodiments of the invention have shown and described in above description, but as previously described, it should be understood that the present invention
Be not limited to forms disclosed herein, should not be regarded as an exclusion of other examples, and can be used for various other combinations,
Modification and environment, and the above teachings or related fields of technology or knowledge can be passed through within that scope of the inventive concept describe herein
It is modified.And changes and modifications made by those skilled in the art do not depart from the spirit and scope of the present invention, then it all should be in this hair
In the protection scope of bright appended claims.
Claims (10)
1. a kind of Operating Guideline method based on AR system, which is characterized in that the described method includes:
The picture that image content is equipment to be operated or components is scanned, equipment to be operated or zero in the picture is obtained
The corresponding model of component；
The first real picture for obtaining virtual screen to be instructed and operation scene that the first operation is carried out to the model, sends
The virtual screen to be instructed and the first real picture；Wherein, the virtual screen to be instructed is to carry out the to the model
Virtual screen before one operation；
Receive the first Operating Guideline for carrying out the first operation to the virtual screen to be instructed according to first real picture.
2. the method according to claim 1, wherein described is equipment to be operated or components to image content
Picture is scanned, and obtains equipment to be operated or the corresponding model of components in the picture, comprising:
It is the picture progress picture identification of equipment to be operated or components to image content, identifies the equipment to be operated or zero
The mark of component；
According to the mark, the corresponding model of the mark is determined from preset model library.
3. the method according to claim 1, wherein equipment to be operated or components pair in obtaining the picture
When the model answered, further includes: obtain the operating instruction of the model；Then it is described obtain to the model carry out first operation to
The virtual screen is instructed to include:
The gesture instruction for showing the operating instruction is received, is shown according to the operating instruction and each operation is carried out to the model
The first operation virtual screen before, and obtained from the first operation virtual screen and the first operation is carried out to the model
Virtual screen to be instructed.
4. according to the method described in claim 3, it is characterized by further comprising: described show according to the operating instruction to institute
The third operation stating the second operation virtual screen when model carries out each operation, and/or carrying out after each operation is virtual
Picture；And/or
Send the voice messaging that operational issue description is carried out to first operation.
5. the method according to claim 1, wherein further include:
Obtain the second true picture for carrying out the first operation to the equipment to be operated or components according to first Operating Guideline
Face sends second real picture and sends；
Receive the second Operating Guideline sent according to second real picture.
6. a kind of Operating Guideline method based on AR system, which is characterized in that the described method includes:
Receive the first real picture of virtual screen to be instructed and operation scene, wherein the virtual screen to be instructed is pair
Equipment to be operated or the corresponding model of components carry out the virtual screen before the first operation；
According to first real picture, the first Operating Guideline that the first operation is carried out to the virtual screen to be instructed is generated；
Send first Operating Guideline.
7. according to the method described in claim 6, it is characterized by further comprising:
Receive the second true picture for carrying out the first operation to the equipment to be operated or components according to first Operating Guideline
Face；
According to second real picture, the second Operating Guideline operated to second real picture is generated.
8. according to the method described in claim 6, it is characterized in that, described generate carries out first to the virtual screen to be instructed
First Operating Guideline of operation, comprising:
Show the virtual screen to be instructed, and the operating process for carrying out the first operation to the virtual screen to be instructed is marked
Note generates the first Operating Guideline；Or
It obtains to operating process when instructing virtual screen to carry out the first operation, using the operating process as the first behaviour
It coaches.
9. a kind of Operating Guideline device based on AR system, which is characterized in that described device includes:
Scanning element is scanned for the picture to image content for equipment to be operated or components, obtains in the picture
Equipment to be operated or the corresponding model of components；
First transmission unit carries out the virtual screen to be instructed and operate scene that first operates to the model for obtaining
First real picture sends the virtual screen to be instructed and the first real picture；Wherein, the virtual screen to be instructed is
Virtual screen before first operation is carried out to the model；
First receiving unit carries out the first operation to the virtual screen to be instructed according to first real picture for receiving
The first Operating Guideline.
10. a kind of Operating Guideline device based on AR system, which is characterized in that be applied to the network equipment, described device includes:
Second receiving unit, for receive virtual screen to be instructed and operation scene the first real picture, wherein it is described to
Instructing virtual screen is the virtual screen before treating operation equipment or corresponding the first operation of model progress of components；
Generation unit, for generating and carrying out the first operation to the virtual screen to be instructed according to first real picture
First Operating Guideline；
Second transmission unit, for sending first Operating Guideline.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811610289.3A CN109814709A (en) | 2018-12-27 | 2018-12-27 | Operating Guideline method and device based on AR system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811610289.3A CN109814709A (en) | 2018-12-27 | 2018-12-27 | Operating Guideline method and device based on AR system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109814709A true CN109814709A (en) | 2019-05-28 |
Family
ID=66602810
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811610289.3A Pending CN109814709A (en) | 2018-12-27 | 2018-12-27 | Operating Guideline method and device based on AR system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109814709A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112035045A (en) * | 2020-09-08 | 2020-12-04 | 广西中烟工业有限责任公司 | AR-based air compressor virtual simulation interaction system and device |
| CN113298588A (en) * | 2020-06-19 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing object information and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130113827A1 (en) * | 2011-11-08 | 2013-05-09 | Qualcomm Incorporated | Hands-free augmented reality for wireless communication devices |
| CN105759960A (en) * | 2016-02-02 | 2016-07-13 | 上海尚镜信息科技有限公司 | Augmented reality remote guidance method and system in combination with 3D camera |
| CN107277451A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of utilization AR realizes the method and apparatus of remote guide scene investigation failure |
| CN107645651A (en) * | 2017-10-12 | 2018-01-30 | 北京临近空间飞艇技术开发有限公司 | A kind of remote guide method and system of augmented reality |
| CN107656991A (en) * | 2017-09-14 | 2018-02-02 | 触景无限科技（北京）有限公司 | A kind of remote guide method, apparatus and system |
| CN107741785A (en) * | 2017-10-12 | 2018-02-27 | 北京临近空间飞艇技术开发有限公司 | A kind of remote guide method and system for protecting front end safety |
| CN107977080A (en) * | 2017-12-05 | 2018-05-01 | 北京小米移动软件有限公司 | Product uses methods of exhibiting and device |
| CN108830894A (en) * | 2018-06-19 | 2018-11-16 | 亮风台（上海）信息科技有限公司 | Remote guide method, apparatus, terminal and storage medium based on augmented reality |
-
2018
- 2018-12-27 CN CN201811610289.3A patent/CN109814709A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130113827A1 (en) * | 2011-11-08 | 2013-05-09 | Qualcomm Incorporated | Hands-free augmented reality for wireless communication devices |
| CN105759960A (en) * | 2016-02-02 | 2016-07-13 | 上海尚镜信息科技有限公司 | Augmented reality remote guidance method and system in combination with 3D camera |
| CN107277451A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of utilization AR realizes the method and apparatus of remote guide scene investigation failure |
| CN107656991A (en) * | 2017-09-14 | 2018-02-02 | 触景无限科技（北京）有限公司 | A kind of remote guide method, apparatus and system |
| CN107645651A (en) * | 2017-10-12 | 2018-01-30 | 北京临近空间飞艇技术开发有限公司 | A kind of remote guide method and system of augmented reality |
| CN107741785A (en) * | 2017-10-12 | 2018-02-27 | 北京临近空间飞艇技术开发有限公司 | A kind of remote guide method and system for protecting front end safety |
| CN107977080A (en) * | 2017-12-05 | 2018-05-01 | 北京小米移动软件有限公司 | Product uses methods of exhibiting and device |
| CN108830894A (en) * | 2018-06-19 | 2018-11-16 | 亮风台（上海）信息科技有限公司 | Remote guide method, apparatus, terminal and storage medium based on augmented reality |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113298588A (en) * | 2020-06-19 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing object information and electronic equipment |
| CN112035045A (en) * | 2020-09-08 | 2020-12-04 | 广西中烟工业有限责任公司 | AR-based air compressor virtual simulation interaction system and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104484171B (en) | Terminal interface design system, method and relevant device | |
| JP6616473B2 (en) | Method and apparatus for controlling pages | |
| CN103853761B (en) | Comment demonstration, adding method and the device of web page contents | |
| US8166383B1 (en) | System and method for sharing content based on positional tagging | |
| US9547631B1 (en) | Clickable links within live collaborative web meetings | |
| CN105930073A (en) | Method And Apparatus For Supporting Communication In Electronic Device | |
| US11368421B2 (en) | Terminal device, server, and method of providing messaging service | |
| US10439967B2 (en) | Attachment reply handling in networked messaging systems | |
| CN107315580A (en) | Component processing method, device and the equipment of user interface, computer-readable recording medium | |
| US20160224549A1 (en) | Methods, systems and recording mediums for managing conversation contents in messenger | |
| KR20210134359A (en) | Semantic intelligent task learning and adaptive execution method and system | |
| CN109814709A (en) | Operating Guideline method and device based on AR system | |
| CN108648140A (en) | Image split-joint method, system, equipment and storage medium | |
| CN109923834A (en) | Context for collaboration workspace environment is talked with | |
| CN105874807A (en) | Methods, systems, and media for remote rendering of web content on a television device | |
| CN110019058B (en) | Sharing method and device for file operation | |
| CN107888989A (en) | A kind of interactive system and method live based on internet | |
| CN110163788A (en) | Kitchen monitoring method based on artificial intelligence | |
| Cox et al. | Moving object-based media production from one-off examples to scalable workflows | |
| KR101425672B1 (en) | Building Information Modeling Based Communication System, Building Information Modeling Based Communication Server, and Building Information Modeling Based Communication Method in Mobile Terminal and Recording Medium Thereof | |
| US20180095605A1 (en) | Generating a Mixed reality Interface to Expose Object Functionality | |
| US20190172459A1 (en) | External control device, speech interactive control system, and control method | |
| WO2016053029A1 (en) | Method and system for generating message including virtual space and virtual object, and computer-readable recording medium | |
| WO2023114530A1 (en) | Augmented reality (ar) visual display to save | |
| CN110135342A (en) | Kitchen monitoring device based on artificial intelligence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |