CN110224994A - A kind of method, AR glasses and system by diagonal assembly control - Google Patents
A kind of method, AR glasses and system by diagonal assembly control Download PDFInfo
- Publication number
- CN110224994A CN110224994A CN201910410714.2A CN201910410714A CN110224994A CN 110224994 A CN110224994 A CN 110224994A CN 201910410714 A CN201910410714 A CN 201910410714A CN 110224994 A CN110224994 A CN 110224994A
- Authority
- CN
- China
- Prior art keywords
- accessory
- assembled
- assembly
- glasses
- identity information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to assembly fields, in particular disclose a kind of method, AR glasses and system by diagonal assembly control, wherein method includes: the identity information that augmented reality AR glasses obtain accessory to be assembled according to diagonal assemble sequence;AR glasses determine the rigging position information of the accessory to be assembled according to the identity information of the accessory to be assembled;AR glasses indicate that assembly tool assembles accessory to be assembled according to the rigging position information.The present invention program can guarantee diagonally sequentially assembling by process stipulation, avoid the problem of not causing by diagonal assembly.
Description
Technical field
The present invention relates to assembly field, specially a kind of method, AR glasses and system by diagonal assembly control.
Background technique
During train locomotive overhaul maintenance, often need that several hundred a important screws are carried out tightening assembly.These spiral shells
The assembly of bolt must comply with stringent sequence and appropriate torque.The process of traditional assembling process management is: technique
Engineer formulates assembling work guiding book, the assembly of the assemble sequence of strict regulations bolt, each bolt in job instruction
Job step and screw-down torque;Assembling work engineer in workshop carries out " secondary assembly " to locomotive by defined assembly technology;Matter
Inspection personnel detect the bolt of assembly, measure screw-down torque and record.
Traditional assembling process management, although in assembling work guiding book the assembly of strict difinition bolt technological specification,
But lack technological means to ensure the strict implement to assemble sequence and screw-down torque, the reliability of locomotive assembling quality is difficult always
To get a promotion.It is mainly manifested in: it is whether stringent by assembly technology operation, dependent on the sense of responsibility of assembling work engineer, dress
Reliability with quality needs further quality inspection to ensure;Quality inspection personnel rechecks bolt, there is biggish workload;Matter
Inspection whether strict implement, also rely on the sense of responsibility of quality inspection personnel;Manual record rechecks data then input system, there is mistake
Note, error of omission and the risk accidentally recorded.Therefore, there are certain uncontrollabilities for the assembling quality of traditional assembling process management.
Currently, in the assembling process management of the industries such as automobile, household electrical appliances, by some process controling elements and radio frequency
It identifies the technologies such as (RFID), barcode scanning, realizes digitlization, the flexibility of assembly.In maintenance industry, also there is new technology
Scheme: job content, software are selected by the good process flow of software plan, then by manual operation computer or direct barcode scanning
The technique torque value of job content is transmitted to Intelligent spanner by system, and Intelligent spanner tightens bolt, and tightening result is anti-
It feeds software systems.But there are still a biggish defects for the technical solution: i.e. it cannot be guaranteed that the bolt of worker's practical operation with
It is consistent specified in process flow, and cannot be guaranteed that worker is according to sequentially being tightened as defined in process flow.For example,
The bolt being circumferentially distributed in the plane, it is desirable that operated according to the method diagonally tightened, but be difficult to ensure that worker is in practice
It is operated according to requiring.
Summary of the invention
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind
A kind of bolt for stating problem assembles control method and system in order.
According to an aspect of the invention, there is provided a kind of by diagonal assembly control method, comprising: augmented reality AR glasses
The identity information of accessory to be assembled is obtained according to diagonal assemble sequence;AR glasses are true according to the identity information of the accessory to be assembled
The rigging position information of the fixed accessory to be assembled;AR glasses according to the rigging position information indicate assembly tool to it is described to
Assembly accessory is assembled.
Optionally, the AR glasses obtain the identity information of accessory to be assembled specifically: AR glasses acquisition it is described to
The scene image of scene, the identity information of the accessory to be assembled is obtained according to the scene image where assembling accessory.
Optionally, the identity information that the accessory to be assembled is obtained according to the scene image specifically: according to institute
The encoded information that scene image obtains accessory to be assembled is stated, the identity information of accessory to be assembled is determined according to the encoded information.
Optionally, the method also includes: the AR glasses obtain the identity information of assembly tool, according to the assembler
The identity information of the identity information of tool and accessory to be assembled obtains preset assembly parameter, so that the assembly tool is according to
Preset assembly parameter assembles the accessory.
Optionally, the method also includes: after the assembly is completed, AR glasses obtain the practical set of the assembly tool to accessory
Parameter, judges whether the practical set parameter is consistent with preset assembly parameter, and records the assembly manipulation information not being consistent.
According to another aspect of the present invention, a kind of AR glasses are provided, for by diagonal assembly control, the AR glasses packet
Include processor module and display, in which: the processor module is used to obtain accessory to be assembled according to diagonal assemble sequence
Identity information determines the rigging position information of the accessory to be assembled according to the identity information of the accessory to be assembled;It is described aobvious
Show device for indicating that assembly tool assembles accessory to be assembled according to the rigging position information.
Optionally, the AR glasses further include acquisition module, and the acquisition module is for acquiring the accessory institute to be assembled
In the scene image of scene, the processor module is also used to obtain the identity of the accessory to be assembled according to the scene image
Information.
Optionally, the identity information that the processor module obtains the accessory to be assembled according to the scene image is specific
Are as follows: the processor obtains the encoded information of accessory to be assembled according to the scene image, according to the encoded information determine to
Assemble the identity information of accessory.
Optionally, the processor module is also used to obtain the identity information of assembly tool, according to the assembly tool
The identity information of identity information and accessory to be assembled obtains preset assembly parameter, so that the assembly tool is according to described default
Assembly parameter assemble the accessory.
Optionally, the processor module is also used to obtain the reality of the assembly tool after the assembly is completed in the accessory
Assembly parameter, judges whether the practical set parameter is consistent with preset assembly parameter, and records the assembly manipulation not being consistent
Information.
According to another aspect of the present invention, provide it is a kind of by diagonal assembly control system, including AR glasses and server,
Wherein: the server is used to obtain the identity information of accessory to be assembled according to diagonal assemble sequence;The server is also used to
The rigging position information of the accessory to be assembled is determined according to the identity information of the accessory to be assembled;The AR glasses are used for root
Accessory to be assembled is assembled according to rigging position information instruction assembly tool.
Optionally, the scene image of scene, the service where the AR glasses are also used to acquire the accessory to be assembled
Device is also used to obtain the identity information of the accessory to be assembled according to the scene image.
Optionally, the server obtains the identity information of the accessory to be assembled according to the scene image specifically:
The server obtains the encoded information of accessory to be assembled according to the scene image, is determined according to the encoded information to be assembled
The identity information of accessory.
Optionally, the server is also used to obtain the identity information of assembly tool, according to the identity of the assembly tool
The identity information of information and accessory to be assembled obtains preset assembly parameter, so that the assembly tool is according to the preset dress
The accessory is assembled with parameter.
Optionally, the server is also used to obtain the practical set of the assembly tool after the assembly is completed in the accessory
Parameter, judges whether the practical set parameter is consistent with preset assembly parameter, and records the assembly manipulation information not being consistent.
The present invention requires the identity of practical accessory to be assembled and accessory to be assembled by the practical accessory to be assembled of identification
Unanimously, it is ensured that practical accessory to be assembled is accessory to be assembled, ensure that diagonally sequentially being assembled by process stipulation, avoids
The problem of not causing by diagonal assembly.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, identical bolt is denoted by the same reference numerals.In the accompanying drawings:
Fig. 1 shows the present invention by the flow chart of diagonal assembly control method first embodiment;
Fig. 2 shows the structural block diagrams of AR glasses first embodiment of the present invention;
Fig. 3 shows the structural block diagram of AR glasses second embodiment of the present invention;
Fig. 4 shows the present invention by the structural block diagram of diagonal assembly control system first embodiment;
Fig. 5 shows the present invention by the structural block diagram of server 402 in diagonal assembly control system second embodiment.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Fig. 1 is flow chart of the present invention by diagonal assembly control method first embodiment.As shown in Figure 1, should be by diagonal dress
Distribution controlling method the following steps are included:
Step 101: augmented reality AR glasses obtain the identity information of accessory to be assembled according to diagonal assemble sequence.
Augmented reality (Augmented Reality, AR) is a kind of interactive experience based on true environment.AR equipment can
Virtual sensory information is generated, as vision, the sense of hearing, tactile, body-sensing, smell, so that user is obtained one kind and expands
Or the impression of real world that enhances.AR glasses, also referred to as intelligent glasses, wearing mode, can be in true scapes such as glasses
For information about as upper Overlapping display.
In embodiments of the present invention, assembly scene is a part of locomotive to be repaired, is assembled multiple to be installed in scene
The component matched is bolt to be tightened.In some embodiments, component to be assembled can also be stud, screw, nut, pad
Circle, pin etc..Need to be tightened bolt to be bolt of the same race, bolt of the same race is the bolt of same model under same category, from shape
On be difficult to differentiate between.In some embodiments, bolt to be tightened is similar bolt, and similar bolt is different model under same category
Bolt is closer in shape.In further embodiments, bolt to be tightened is not of the same race or similar bolt, in shape difference compared with
Greatly.Each bolt has unique number.Assemble sequence data are stored in AR glasses.After AR glasses are worn above, assembly is obtained
The number of first bolt to be assembled in sequence.Assemble sequence be it is preparatory receive process engineer's setting by diagonally assembling
Sequentially.
Step 102:AR glasses determine the assembly position of the accessory to be assembled according to the identity information of the accessory to be assembled
Confidence breath.
In embodiments of the present invention, model of place library is stored in AR glasses.Model of place library includes some identified
Scene picture data.AR glasses find the bolt of the number in scene model library, obtain the position of the bolt.
Step 103:AR glasses indicate that assembly tool assembles accessory to be assembled according to the rigging position information.
AR glasses instruct picture and text to be superimposed upon in assembly scene for assembling work.AR glasses are according to the assemble sequence number of acquisition
According to indicating in order each bolt.The mode of instruction is to show the arrow flashed above next bolt to be assembled,
Arrow is directed toward the bolt, and shows a virtual spanner in bolt location.AR glasses can also show the parameter of bolt assembly
Etc. information, to assist, instruct to tighten operation.
In embodiments of the present invention, assembly tool is Intelligent spanner.Have motor and controller in Intelligent spanner, motor it is defeated
Outlet concatenates a strain-type torque sensor, which can feed back real-time torque value to controller.Intelligent spanner can connect
The target torque value that server is sent is received, and starts motor.When motor rotates, the constantly more real-time torque value of controller and target
Torque value, and leave the motor off or slow down in due course according to control logic.After the completion, tightening result data are sent to by Intelligent spanner
Server achieves.There is the bar code for indicating its identity on Intelligent spanner.When Intelligent spanner is enclosed in indicated by AR glasses wait tighten
When on bolt, AR glasses, which scan the bar code of the Intelligent spanner, knows its number to identify the Intelligent spanner.In some embodiments
In, there is its identity of two-dimentional code mark on Intelligent spanner.In further embodiments, there is its number on Intelligent spanner, AR glasses are clapped
It takes the photograph the photo of its number and is identified.In embodiments of the present invention, AR glasses receive what process engineer inputted according to preparatory
Locomotive assembling work process data, checks whether the Intelligent spanner matches with the bolt, i.e., whether the Intelligent spanner is to tighten this
The tool that bolt should use.If matching, is sent to the Intelligent spanner for the predetermined torque value of the bolt, otherwise, i.e. the intelligence
When energy spanner is placed on other bolts, the predetermined torque value of the bolt will not be sent to the Intelligent spanner.Intelligent spanner connects
After receipts, the bolt is tightened by predetermined torque value automatically.If the bolt of operation is not AR glasses indicated by AR glasses
Warning note will be issued, while the faulty operation being recorded and is achieved.After the completion of tightening operation, Intelligent spanner by the bolt number,
Operative employee's artificial board number tightens the work datas such as deadline, actual torque value and is uploaded to AR glasses archive.AR glasses receive
Afterwards, that is, it is completed to when front bolt is after tightening, continues to indicate next bolt to be tightened.And so on, until
Whole bolts are tightened in completion.
In some embodiments, assembly tool is the spanner with display screen, and display screen can show screw-down torque value.AR
Mirror shoots the spanner display screen photo and identifies the reading in display screen photo, and judges whether the torque value of identification meets currently
Bolt predetermined torque value achieves the work data of this assembly manipulation if not meeting, and AR glasses issue prompt, i.e., current to turn round
Square value is bigger than normal or less than normal, is tightened with prompt amendment to the bolt.
In embodiments of the present invention, by the practical bolt to be assembled of identification, and require the number of practical bolt to be assembled with
Bolt to be assembled it is consistent, it is ensured that practical bolt to be assembled is bolt to be assembled, ensure that the diagonal sequence by process stipulation
It is assembled, avoids the problem of not causing by diagonal assembly.
In some embodiments, AR glasses obtain the identity information of accessory to be assembled specifically: the acquisition of AR glasses is to be assembled
The scene image of scene, the identity information of accessory to be assembled is obtained according to scene image where accessory.
In some embodiments, the identity information of accessory to be assembled is obtained according to scene image specifically: according to scene figure
Encoded information as obtaining accessory to be assembled, the identity information of accessory to be assembled is determined according to encoded information.
In some embodiments, AR glasses obtain the identity information of assembly tool, according to the identity information of assembly tool and
The identity information of accessory to be assembled obtains preset assembly parameter, so that assembly tool is matched according to preset assembly parameter
Part.AR glasses confirm that the identity information of accessory to be assembled is matched with the identity information of assembly tool, i.e., the assembly tool is assembly
The assembly tool that the accessory to be assembled should use, is then sent to assembly tool for assembly parameter.If mismatching, will not incite somebody to action
Assembly parameter is sent to assembly tool.AR glasses can also show assembly parameter, and such as predetermined torque value, assembler is arranged in assembler
Tool is predetermined torque value, and assembly tool completes assembly or assembler is assembled using assembly tool by predetermined torque value.
In some embodiments, after the assembly is completed, AR glasses obtain the practical set parameter of assembly tool to accessory, judge reality
Whether border assembly parameter is consistent with preset assembly parameter, and records the assembly manipulation information not being consistent.
Fig. 2 is the structural block diagram of AR glasses first embodiment of the present invention.As shown in Fig. 2, AR glasses 20 include processor die
Block 201 and display 202.
Processor module 201 obtains the identity information of accessory to be assembled according to diagonal assemble sequence, according to accessory to be assembled
Identity information determine the rigging position information of accessory to be assembled.
Display 202 indicates that assembly tool assembles accessory to be assembled according to rigging position information.
In embodiments of the present invention, the method that AR glasses 20 are assembled as described above control method first embodiment is assembled.
In embodiments of the present invention, by the practical bolt to be assembled of identification, and require the number of practical bolt to be assembled with
Bolt to be assembled it is consistent, it is ensured that practical bolt to be assembled is bolt to be assembled, ensure that the diagonal sequence by process stipulation
It is assembled, avoids the problem of not causing by diagonal assembly.
Fig. 3 is the structural block diagram of AR glasses second embodiment of the present invention.As shown in figure 3, AR glasses 30 include acquisition module
301, processor module 302 and display 303.
The scene image of scene where acquisition module 301 is used to acquire accessory to be assembled.Processor module 302 is used for basis
Diagonal assemble sequence obtains the identity information of accessory to be assembled, determines accessory to be assembled according to the identity information of accessory to be assembled
Rigging position information and the identity information that accessory to be assembled is obtained according to scene image.Display 303 is used for according to assembly position
Confidence breath instruction assembly tool assembles accessory to be assembled.
In some embodiments, the identity information that processor module 302 obtains accessory to be assembled according to scene image is specific
Are as follows: processor module 302 obtains the encoded information of accessory to be assembled according to scene image, determines to be assembled match according to encoded information
The identity information of part.
In some embodiments, processor module 302 is also used to obtain the identity information of assembly tool, according to assembly tool
Identity information and the identity information of accessory to be assembled obtain preset assembly parameter so that assembly tool is according to preset assembly
Parameter assembles the accessory.
In some embodiments, processor module 302 is also used to obtain the reality of assembly tool after the assembly is completed in accessory
Assembly parameter, judges whether practical set parameter is consistent with preset assembly parameter, and records the assembly manipulation information not being consistent.
Fig. 4 is the structural block diagram that the present invention presses diagonal assembly control system first embodiment.As shown in figure 4, by diagonal dress
It include AR glasses 401 and server 402 with control system 40.
Server 402 is used to obtain the identity information of accessory to be assembled according to diagonal assemble sequence.Diagonally assemble sequence is
Server 402 receives process engineer's setting in advance.
Server 402 is also used to determine the rigging position information of accessory to be assembled according to the identity information of accessory to be assembled.
AR glasses 401 are used to indicate that assembly tool assembles accessory to be assembled according to rigging position information.
In embodiments of the present invention, AR glasses 401 are interconnected by wireless network and server 402.AR glasses 401 are from service
Device 402 obtains the identity information of first bolt to be assembled, and using first bolt to be assembled as current bolt to be assembled, holds
Row following steps:
Step 1:AR glasses 401 are believed according to the position that the identity information of current bolt to be assembled obtains current bolt to be assembled
Breath.
The identity information of current bolt to be assembled is sent server 402 by AR glasses 401.Server 402 is in scene mould
The location information of current bolt to be assembled is obtained in type library according to the identity information of current bolt to be assembled, and will be current to be assembled
The location information of bolt is sent to AR glasses 401.
Step 2:AR glasses 401 indicate current bolt to be assembled by the location information of current bolt to be assembled.
Step 3:AR glasses 401 obtain the identity information of practical bolt to be assembled, and judge the body of practical bolt to be assembled
Whether part information is consistent with the current identity information of bolt to be assembled, if so, continuing to execute step 4, otherwise returns and executes step
Rapid 2, wherein practical bolt to be assembled is located within the scope of 401 present viewing field of AR glasses.
The image of scene where AR glasses 401 acquire practical bolt to be assembled, and the image of scene is sent to server
402.After the assembly scene photo of 401 pairs of AR glasses shootings carries out Base64 coding, service is uploaded to the asynchronous mode of thread
Device 402.
The image for the scene that server 402 is sent in scene model library according to AR glasses 401 obtains practical spiral shell to be assembled
The identity information of bolt, and the identity information of practical bolt to be assembled is sent to AR glasses 401.Server 402 is by the scene
Photo is compared with pre-generated model of place library, to identify the scene to get the number of the scene is known.Scene mould
Type library includes some identified scene picture datas.Server 402 may recognize that bolt to be assembled in scene, learn
The number and location information of each bolt.
Step 4: assembly tool assembles current bolt to be assembled.
Step 5: if currently assembly bolt is the last one bolt to be assembled, stopping executing this method, otherwise AR glasses
401 obtain the identity information of next bolt to be assembled according to the identity information of current assembly bolt, by next spiral shell to be assembled
Bolt repeats step 1 as new current bolt to be assembled.Server 402 in advance receive process engineer setting to this
The alphabetic data that bolt in scape is assembled.AR glasses 401 obtain the alphabetic data from server.
Server 402 stores the predetermined torque value assembled to current bolt to be assembled, and assembly tool is that intelligence is pulled
Hand, there is coding on Intelligent spanner, and coding includes the identity information of Intelligent spanner.
For Intelligent spanner close to after current bolt to be assembled, AR glasses 401 acquire the image of the coding on Intelligent spanner.
The image of 401 pairs of AR glasses codings is identified to obtain recognition result, and recognition result is sent to server
402.Recognition result includes the identity information of Intelligent spanner.In some embodiments, the image of coding is sent to by AR glasses 401
The image of server 402,402 pairs of server codings is identified to obtain recognition result.
Server 402 according to recognition result judge current bolt to be assembled identity information whether the identity with Intelligent spanner
The predetermined torque value assembled to current bolt to be assembled is sent to Intelligent spanner if matching by information matches.
Intelligent spanner assembles current bolt to be assembled according to predetermined torque value.
In some embodiments, server 402 stores the predetermined torque value assembled to current bolt to be assembled, dress
It is the spanner with display screen with tool, display screen is used to show the actual torque value of spanner.Spanner is to current bolt to be assembled
After being assembled, AR glasses 401 acquire the image of the display screen of spanner, and the image of display screen is sent to server 402.Clothes
Business device 402 identifies the image of spanner to obtain recognition result, and recognition result includes that spanner carries out current bolt to be assembled
The actual torque value of assembly.Server 402 judges the reality that spanner assembles current bolt to be assembled according to recognition result
Whether torque value is consistent with the predetermined torque value assembled to current bolt to be assembled, and assembly manipulation letter is recorded if not being consistent
Breath, assembly manipulation information include the actual torque value that spanner assembles current bolt to be assembled.
In embodiments of the present invention, AR glasses 401 obtain bolt assemble sequence from server 402, and according to current assembly
The identity information and bolt assemble sequence of bolt obtain the identity information of next bolt to be assembled.In some embodiments, AR
The identity information of current assembly bolt is sent server 402 by glasses 401, and server 402 is according to the current body for assembling bolt
Part information and bolt assemble sequence obtain the identity information of next bolt to be assembled, and by the identity of next bolt to be assembled
Information is sent to AR glasses 401.
In embodiments of the present invention, by the practical bolt to be assembled of identification, and require the number of practical bolt to be assembled with
Bolt to be assembled it is consistent, it is ensured that practical bolt to be assembled is bolt to be assembled, ensure that the diagonal sequence by process stipulation
It is assembled, avoids the problem of not causing by diagonal assembly.
In some embodiments, the scene image of scene, server where AR glasses 401 are also used to acquire accessory to be assembled
402 are also used to obtain the identity information of accessory to be assembled according to scene image.
In some embodiments, server 402 obtains the identity information of accessory to be assembled according to scene image specifically: clothes
Business device 402 obtains the encoded information of accessory to be assembled according to scene image, and the identity of accessory to be assembled is determined according to encoded information
Information.
In some embodiments, server 402 is also used to obtain the identity information of assembly tool after the assembly is completed in accessory,
Preset assembly parameter is obtained according to the identity information of the identity information of assembly tool and accessory to be assembled, so that assembly tool root
Accessory is assembled according to preset assembly parameter.
Fig. 5 is structural block diagram of the present invention by server 402 in diagonal assembly control system second embodiment.Such as Fig. 5 institute
Show, server 402 includes image recognition server 4021 and technological data bank server 4022.
Image recognition server 4021 can assembly scene image collected to AR glasses, instrument and meter display screen, with
And bar code or image in 2 D code are identified.Preferably, the GPU performance in image recognition server 4021 is not less than GTX1080
The performance of video card, and image recognition is carried out using deep learning algorithm.
Image recognition server 4021 in advance learns scene.The method learnt to a scene is as follows.It is first
The archives of the scene are first added in technological data bank server 4022.Then the image of the scene is acquired with AR glasses in workshop,
It is acquired as far as possible from multiple angles, under different illumination conditions.After carrying out Base64 coding to the image of acquisition, thread is used
Asynchronous mode uploads to technological data bank server 4022, is added in the archives of the scene.Image recognition server 4021
Receive being labeled to the scene image for process engineer's input: to each bolt in scene image, from given inventory
Middle selection sets a unique number.Image recognition server 4021 is with deep learning algorithm in the scene archives
Image is learnt.After study, the scene image for providing acquisition verifies learning outcome.It is required that the response time is less than
It 1 second, identifies that the accuracy of scene is greater than 98%, identifies that the accuracy of any bolt in scene is greater than 99%, give number instruction
The accuracy of bolt location is greater than 99%, otherwise continues acquisition scene image and is learnt.
The algorithm that scene is identified include: scene characteristic point extract, scene positioning, with sample compare, if comparison at
Function, then export scene title, number and confidence level, otherwise resurveys scene image and is identified.
The algorithm identified to the bolt in scene includes: that bolt positioning, image segmentation and sample compare, if comparison
Success, then calculate bolt location and export confidence level, otherwise resurvey image and identified.During practical set,
AR glasses potential range bolt is close, and bolt is larger, and image captured by AR glasses may be bolt itself or part.If
Multiple bolts to be assembled be it is of the same race or similar, then be difficult to distinguish.The algorithm of bolt is identified in the present invention specifically:
Into assembly scene when, that is, the background for starting joint bolt position is identified, and continuous collecting assembly scene image, with
And the variation of tracking image, if variation is continuously, to inherit the result that an image is identified.
The algorithm of optical character identification (Optical Character Recognition, OCR) is carried out to display screen photo
It include: display screen area location algorithm, character locating and partitioning algorithm and character recognition algorithm.Position, the direction of spanner can
To be arbitrary.It is required that the response time, less than 1 second, accuracy rate is greater than 99%.
The algorithm identified to bar code includes: shooting bar code image, image binaryzation, positioning, image segmentation;If
Bar code positioning success then carries out rotational correction to bar code and then extracts barcode data, otherwise re-shoots bar code image and known
Not.It is required that the response time, less than 50 milliseconds, discrimination is greater than 99.5%.Bar code requires printing clear, and length is wide greater than 3 centimetres
Degree is greater than 2 centimetres, and white edge and black surround width are all larger than 2 millimeters in bar code.
Technological data bank server 4022 stores the master data of vehicle, scene, bolt, tool etc., including vehicle name
Claim, number, manufacturer and scene, the number of bolt etc..The data of vehicle, scene, bolt, tool etc. can be managed
Maintenance, including data increased newly, are deleted, are modified, inquires etc. and operated.Technological data bank server 4022 receives technique in advance
The assembling work task of engineer's typing, the requirement of assembling work technique, predetermined torque value and multiple spiral shells including each bolt
The assemble sequence of bolt.
The process for carrying out the business game of locomotive maintenance using assembling process management system 40 is as follows.Between bogie car,
Assembler is gradually completing assembling work according to the instruction of AR glasses.Workshop should have good illumination condition.After worker's working,
The tools such as spanner are got to teams and groups' strong point, and recruitment board swipes the card and obtains a secondary AR glasses.Server is on backstage by the work of the worker
Board and the AR glasses are bound, and AR glasses is made to enter the working condition for identifying rack bar code.In worker's wearing after AR glasses, according to
The prompt of display, before going to rack to be worked, scanning gantry bar code is simultaneously uploaded onto the server.Worker should face bar code as far as possible,
Left and right visual angle is no more than 20 degree.AR glasses should in a certain range at a distance from bar code, and such as larger than 10 centimetres and less than 40 lis
Rice.Server checks whether the bar code matches with the number to operation platform, if matching, server make AR glasses enter identification
The mode of scene, otherwise AR glasses show miscue and still in the states of identification bar code.After worker enters assembly scene, AR
Glasses identify locating scene.Worker should face scene as far as possible, and left and right visual angle is no more than 40 degree.If locating scene be to
Scene is assembled, AR glasses will indicate that worker executes the task of current scene.After the completion of all tasks in current scene, AR glasses
Instruction guides worker to next scene.After the completion of working as all tasks of front platform, AR glasses instruction guidance worker is to next
A rack.Worker can just go to next rack and carry out operation only after the completing a rack of the task, cannot be in two platforms
Operation back and forth between frame.Worker can power cut-off at any time, when lower task, the AR glasses of wearing can be with the difference of last time
System can be automatically since the task that worker's last time does not complete.
AR glasses, server, Intelligent spanner in conjunction with people, are constituted increasing by assembling process management method and system of the present invention
Strong manual work system.AR glasses enhance the vision of worker --- and worker, which wears AR glasses, can see briefing letter
Breath.Server enhances the brain of worker --- and all process flows of server storing memory and job specification simultaneously issue instruction.
Intelligent spanner enhances the both hands of worker --- and Intelligent spanner, which receives the torque value that server is sent and is automatically performed, tightens operation.
Assembling process management system of the present invention improves traditional fastener installation hand with technologies such as AR, image recognition, Internet of Things
Section, from tool, setting torsion to intelligent select tool, setting torsion is selected manually, from traditional drawing, Guide Book to AR
Mirror display reminding realizes assembly scene Recognition, assembling work instruction, assembling work control, assembling work feedback, assembling work
The closed-loop control of driving facilitates the burden for promoting the quality of assembly work, mitigating assembler, promotes assembling work efficiency,
It can be used for the assembling process management such as " the secondary assembly " of locomotive inspection and repair.
Claims (15)
1. one kind is by diagonal assembly control method characterized by comprising
Augmented reality AR glasses obtain the identity information of accessory to be assembled according to diagonal assemble sequence;
AR glasses determine the rigging position information of the accessory to be assembled according to the identity information of the accessory to be assembled;
AR glasses indicate that assembly tool assembles the accessory to be assembled according to the rigging position information.
2. the method according to claim 1, wherein the AR glasses obtain the identity information tool of accessory to be assembled
Body are as follows:
The scene image of scene where the AR glasses acquire the accessory to be assembled, according to the scene image obtain it is described to
Assemble the identity information of accessory.
3. according to the method described in claim 2, it is characterized in that, described obtain described to be assembled match according to the scene image
The identity information of part specifically: the encoded information that accessory to be assembled is obtained according to the scene image, according to the encoded information
Determine the identity information of accessory to be assembled.
4. method according to claim 1-3, which is characterized in that the method also includes:
The AR glasses obtain the identity information of assembly tool, according to the identity information of the assembly tool and accessory to be assembled
Identity information obtains preset assembly parameter, so that the assembly tool is matched according to the preset assembly parameter assembly
Part.
5. method according to claim 1-4, which is characterized in that the method also includes:
After the assembly is completed, AR glasses obtain the practical set parameter of the assembly tool to accessory, judge the practical set parameter
Whether it is consistent with preset assembly parameter, and records the assembly manipulation information not being consistent.
6. a kind of AR glasses, for by diagonal assembly control, which is characterized in that the AR glasses include processor module and display
Device, in which:
The processor module is used to obtain the identity information of accessory to be assembled according to diagonal assemble sequence, according to described to be assembled
The identity information of accessory determines the rigging position information of the accessory to be assembled;
The display is used to indicate that assembly tool assembles accessory to be assembled according to the rigging position information.
7. AR glasses according to claim 6, which is characterized in that the AR glasses further include acquisition module, the acquisition
The scene image of scene, the processor module are also used to according to the scene where module is used to acquire the accessory to be assembled
Image obtains the identity information of the accessory to be assembled.
8. AR glasses according to claim 7, which is characterized in that the processor module is obtained according to the scene image
The identity information of the accessory to be assembled specifically: the processor obtains the coding of accessory to be assembled according to the scene image
Information determines the identity information of accessory to be assembled according to the encoded information.
9. according to the described in any item AR glasses of claim 6-8, which is characterized in that the processor module is also used to obtain
The identity information of assembly tool obtains preset according to the identity information of the identity information of the assembly tool and accessory to be assembled
Assembly parameter, so that the assembly tool assembles the accessory according to the preset assembly parameter.
10. according to the described in any item AR glasses of claim 6-9, which is characterized in that the processor module is also used in institute
The practical set parameter that accessory obtains the assembly tool after the assembly is completed is stated, judges the practical set parameter and preset dress
Whether it is consistent with parameter, and records the assembly manipulation information not being consistent.
11. one kind presses diagonal assembly control system, which is characterized in that including AR glasses and server, in which:
The server is used to obtain the identity information of accessory to be assembled according to diagonal assemble sequence;
The server is also used to determine the rigging position of the accessory to be assembled according to the identity information of the accessory to be assembled
Information;
The AR glasses are used to indicate that assembly tool assembles accessory to be assembled according to the rigging position information.
12. according to claim 11 press diagonal assembly control system, which is characterized in that the AR glasses are also used to acquire
The scene image of scene where the accessory to be assembled, the server are also used to be obtained according to the scene image described to be installed
Identity information with accessory.
13. according to claim 12 press diagonal assembly control system, which is characterized in that the server is according to the field
Scape image obtains the identity information of the accessory to be assembled specifically: the server obtains to be assembled according to the scene image
The encoded information of accessory determines the identity information of accessory to be assembled according to the encoded information.
14. 1-13 is described in any item according to claim 1 presses diagonal assembly control system, which is characterized in that the server
It is also used to obtain the identity information of assembly tool, according to the identity information of the assembly tool and the identity information of accessory to be assembled
Preset assembly parameter is obtained, so that the assembly tool assembles the accessory according to the preset assembly parameter.
15. 1-14 is described in any item according to claim 1 presses diagonal assembly control system, which is characterized in that the server
It is also used to obtain the practical set parameter of the assembly tool after the assembly is completed in the accessory, judges the practical set parameter
Whether it is consistent with preset assembly parameter, and records the assembly manipulation information not being consistent.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2019101688488 | 2019-03-06 | ||
CN201910168848 | 2019-03-06 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110224994A true CN110224994A (en) | 2019-09-10 |
CN110224994B CN110224994B (en) | 2022-05-10 |
Family
ID=67821183
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910410714.2A Active CN110224994B (en) | 2019-03-06 | 2019-05-16 | Method for controlling assembly according to opposite angles, AR glasses and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110224994B (en) |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102336199A (en) * | 2011-09-19 | 2012-02-01 | 长春轨道客车股份有限公司 | Installation method of external display glass of railway passenger car |
US20120194420A1 (en) * | 2010-02-28 | 2012-08-02 | Osterhout Group, Inc. | Ar glasses with event triggered user action control of ar eyepiece facility |
US20120206323A1 (en) * | 2010-02-28 | 2012-08-16 | Osterhout Group, Inc. | Ar glasses with event and sensor triggered ar eyepiece interface to external devices |
CN102773822A (en) * | 2012-07-24 | 2012-11-14 | 青岛理工大学 | Wrench system with intelligent induction function, measuring method and induction method |
CN107730591A (en) * | 2017-09-14 | 2018-02-23 | 北京致臻智造科技有限公司 | A kind of assembling bootstrap technique and system based on mixed reality equipment |
CN108326541A (en) * | 2018-05-10 | 2018-07-27 | 中车株洲电机有限公司 | A kind of bolts assemblies clamp device |
CN109189213A (en) * | 2018-08-15 | 2019-01-11 | 华中科技大学 | A kind of assembling process of products augmented reality guidance method based on movable computer |
CN109623362A (en) * | 2018-12-11 | 2019-04-16 | 北京动力机械研究所 | A kind of assembly system of view-based access control model guidance |
-
2019
- 2019-05-16 CN CN201910410714.2A patent/CN110224994B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120194420A1 (en) * | 2010-02-28 | 2012-08-02 | Osterhout Group, Inc. | Ar glasses with event triggered user action control of ar eyepiece facility |
US20120206323A1 (en) * | 2010-02-28 | 2012-08-16 | Osterhout Group, Inc. | Ar glasses with event and sensor triggered ar eyepiece interface to external devices |
CN102336199A (en) * | 2011-09-19 | 2012-02-01 | 长春轨道客车股份有限公司 | Installation method of external display glass of railway passenger car |
CN102773822A (en) * | 2012-07-24 | 2012-11-14 | 青岛理工大学 | Wrench system with intelligent induction function, measuring method and induction method |
CN107730591A (en) * | 2017-09-14 | 2018-02-23 | 北京致臻智造科技有限公司 | A kind of assembling bootstrap technique and system based on mixed reality equipment |
CN108326541A (en) * | 2018-05-10 | 2018-07-27 | 中车株洲电机有限公司 | A kind of bolts assemblies clamp device |
CN109189213A (en) * | 2018-08-15 | 2019-01-11 | 华中科技大学 | A kind of assembling process of products augmented reality guidance method based on movable computer |
CN109623362A (en) * | 2018-12-11 | 2019-04-16 | 北京动力机械研究所 | A kind of assembly system of view-based access control model guidance |
Non-Patent Citations (1)
Title |
---|
王增磊、张树生、白晓亮: "基于增强现实的产品盲区装配技术研究", 《制造业自动化》 * |
Also Published As
Publication number | Publication date |
---|---|
CN110224994B (en) | 2022-05-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110223393A (en) | A kind of AR glasses and a kind of assembling process management system and method | |
US9329594B2 (en) | Verification methods and systems for use in computer directed assembly and manufacture | |
US9823649B2 (en) | Vehicle build information system | |
CN106228744A (en) | A kind of assembly line electric tightening rifle fail-safe system | |
CN107423650A (en) | Projection type augmented reality assembly induction and monitoring system and implementation method thereof | |
JP5394771B2 (en) | Process management system and IC tag | |
CN109414807A (en) | Fastening management method, fastening management system, fastening management program and the fastening managing device of flange | |
CN111045388A (en) | Matching identification method and system for cutting tool | |
CN107004165A (en) | Mark and auxiliary apparatus for repairing and method | |
CN115392512B (en) | Equipment maintenance method and system based on AR technology and related equipment | |
CN110315529A (en) | Machine vision and robot mounting system and method | |
CN110221692A (en) | A kind of method, AR glasses and the system of assembly control | |
CN105701496B (en) | A kind of go disk recognition methods based on artificial intelligence technology | |
CN112949457A (en) | Maintenance method, device and system based on augmented reality technology | |
US11455750B2 (en) | Operator characteristic-based visual overlays | |
EP3098033B1 (en) | Determination of the robot axle angle and selection of a robot with the aid of a camera | |
CN110224994A (en) | A kind of method, AR glasses and system by diagonal assembly control | |
US20220051579A1 (en) | Content creation system | |
CN110014305A (en) | A kind of control method and device, the system of part processing | |
JP2861014B2 (en) | Object recognition device | |
EP1487616B1 (en) | Automatic process control | |
CN105320053B (en) | Efficient sort method based on tire sequence | |
DE102016122163A1 (en) | Procedure for online configuration and ordering | |
CN115631525B (en) | Face edge point identification-based insurance instant matching method | |
US20220122482A1 (en) | Smart system for adapting and enforcing processes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |