CN105184276A - Method of recognizing parts during maintenance process by intelligent glasses - Google Patents
Method of recognizing parts during maintenance process by intelligent glasses Download PDFInfo
- Publication number
- CN105184276A CN105184276A CN201510628119.8A CN201510628119A CN105184276A CN 105184276 A CN105184276 A CN 105184276A CN 201510628119 A CN201510628119 A CN 201510628119A CN 105184276 A CN105184276 A CN 105184276A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- repair
- maintenance
- database
- intelligent glasses
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012423 maintenance Methods 0.000 title claims abstract description 106
- 238000000034 method Methods 0.000 title claims abstract description 98
- 239000011521 glass Substances 0.000 title claims abstract description 78
- 230000008569 process Effects 0.000 title claims abstract description 62
- 230000008439 repair process Effects 0.000 claims description 93
- 238000005452 bending Methods 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 14
- 238000000605 extraction Methods 0.000 claims description 7
- 230000009471 action Effects 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 6
- 230000015556 catabolic process Effects 0.000 claims description 3
- 230000008878 coupling Effects 0.000 claims description 3
- 238000010168 coupling process Methods 0.000 claims description 3
- 238000005859 coupling reaction Methods 0.000 claims description 3
- 239000004615 ingredient Substances 0.000 claims description 3
- 238000009434 installation Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000012797 qualification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001684 chronic effect Effects 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 235000021110 pickles Nutrition 0.000 description 1
- 238000010791 quenching Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000035922 thirst Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
- G06V20/653—Three-dimensional objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0176—Head mounted characterised by mechanical features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Optics & Photonics (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a method of recognizing parts during a maintenance process by intelligent glasses, which belongs to the field of vehicle maintenance, and solves the technical problems of intelligent glass data acquisition and a bad touch control operation position in the prior art. According to the technical point, a glass leg is provided with a cycle bend; one side of the cycle bend is connected with a first straight plate; the first straight plate is provided with a touch control plate facing the outer side of the glass leg; the other side of the cycle bend is connected with a second straight plate; the upper side and the lower side of the second straight plate are provided with extending bottom plates, an accommodating part for a camera is formed with the second straight plate, the second straight plate is provided with a camera mounting hole, the two bottom plates are connected with a ray machine, the ray machine is located in front of a closer glass frame, the glass frame is connected with the first straight plate and arranged at the place close to the cycle bend, and the first straight plate and the second straight plate are vertical basically. The method has effects of intelligent glass data acquisition and a good touch control operation position.
Description
Technical field
The invention belongs to automobile repair and maintenance field, particularly relate to a kind of Parts Recognition method in intelligent glasses repair and maintenance process.
Background technology
Domestic car owner, when automobile goes wrong or needs maintenance, still depends on 4s shop mostly.But there are two apparent drawbacks in 4S shop, expensive and time-consuming.
When people have to take the second best, when selecting numberless informal repair shop, although convenient cheap again, but expect the love car of oneself to be handed the repairman that those do not have formal qualification, be tantamount to the doctor health being handed qualification of not practising medicine, time child is delivered to the teacher there not having the system of qualifying for teachers, hang back a little again.
Also have some manipulative abilities, have a mind to do-it-yourself car owner, owing to not passing through the study of specialty, setting about always, some is not self-confident, and then loses interest.Certainly also there is other car owner, auto repair is not expert at, also not interested.But a storm may arise from a clear sky, driving is away from home, and can meet some emergency situations unavoidably, such as blow out, leak, leakage of oil etc.Oneself is repaiied, and has no way of doing it again; Deng rescue, Distant water cannot quench present thirst again.
Based on above all pickles, the intelligent glasses being applied to automobile repair and maintenance field arises at the historic moment.
Summary of the invention
The present invention proposes a kind of Parts Recognition method in intelligent glasses repair and maintenance process, object carries out image acquisition by intelligent glasses to auto parts, then identify, make recognition result can demonstrate the title of this part exactly, model, the information such as price, facilitate Automobile Service workman to carry out selection reference to it.
To achieve these goals, the technical solution used in the present invention is: the Parts Recognition method in intelligent glasses repair and maintenance process, comprises the following steps:
S1: first build offline feature storehouse to existing part, in order to support that the parts information gathered with follow-up intelligent glasses carries out characteristic matching, and is stored in server database module by this feature database;
S2: intelligent glasses pattern is adjusted to recognition mode, by the front-facing camera on intelligent glasses, carry out multi-angled shooting to part to be identified, shooting image must have lap, captured picture is reached server by communication module and carries out three-dimensional reconstruction, extract spatial context feature;
S3: compared by the part feature in the spatial context feature of extraction and offline feature storehouse, adopts LAPJV algorithm to carry out Optimum Matching operation to eigenmatrix, makes cost value minimum;
S4: choose the part that the auto parts corresponding to Least-cost value mate as current part to be detected most in offline feature database;
S5: server sends the information such as the title of the part of coupling, model, price to intelligent glasses, control module controls the displaying that image output module carries out parts information;
Described intelligent glasses comprises spectacle-frame (2) and temple (1), it is characterized in that: one of them temple (1) has convolution bending (3), the side of convolution bending (3) connects the first straight plate (4), this the first straight plate (4) is provided with the Trackpad (5) of outside temple (13), the opposite side of this convolution bending (3) connects the second straight plate (14), this the second straight plate (14) upper, lower both sides have the base plate (6) stretched out, the holding part of camera (15) is formed with the second straight plate (14), second straight plate (14) is provided with camera mounting hole, described two base plates (6) are connected with ray machine (7), and this ray machine (7) is positioned at the front of the lens frame (16) more close with it, lens frame is connected to the first straight plate (4) and is arranged at convolution bending (3) more nearby, first straight plate (4) is substantially vertical with the second straight plate (14).
Install light source in camera (15) holding part and correspond to the light source hole (8) on the second straight plate (14), microphone (11) is arranged on the spectacle-frame (2) inside the first straight plate (4) and circles round and bends near (3) junction; Loudspeaker (12) are installed on the upper position near ear of the temple (1) when wearing intelligent glasses; Camera (15) is supported by camera bracket (9) and is arranged in camera (15) holding part, gyroscope, in order to identify vibration signal, set different vibration signals with to make automobile repair and maintenance intelligent glasses perform respective action.
Described camera (15), light source, microphone (11) and loudspeaker (12) are connected to control panel (10), this control panel (10) has wireless communication module, for the signal receiving camera (15), light source, microphone (11) send, and data processing can be carried out to this Received signal strength, and this control panel (10) is provided with wireless signal transceiver module, and this signal transmitting and receiving module is used to send and Received signal strength to remote server.
Control panel (10) comprises image recognition matching module, for the pre-service of image, and feature extraction, Classification and Identification; Control module, after inputting information identifications not other, performs corresponding operating and feedback.Image output module, for carrying out image feedback to operator; Dio Output Modules, in order to carry out sound feedback to operator; Vibrational feedback module, in order to carry out vibrational feedback; Server database module, for the retrieval of service end data.
Control panel (10) goes back connected storage, this control panel (10) is connected with camera (15), light source, microphone (11) and loudspeaker (12) by signal wire, and being integrated in a mainframe box, this control panel (10) synchronously carries out data processing and signal transmitting and receiving.
The license plate image that camera (15) gathers, only performs figure identifying processing by control panel (10), obtains this license board information, directly license board information is sent in remote server.
Remote server has vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, tool model database, vehicle failure intelligent analysis system, the described vehicle information database storage cart trade mark, and the Vehicle Identify Number of vehicle corresponding to this license plate number, owner information, vehicle maintenance record and vehicle service record, and also store vehicle under this license plate number, year money and vehicle configuration information; Described travelling data database purchase is by the OBD data of vehicle corresponding to the Vehicle Identify Number under license plate number or this license plate number and diagnostic trouble code; Described vehicle structure model data library storage by vehicle, year money and vehicle corresponding to vehicle configuration information forms and the explanation of ingredient and 3D modeling figure; Described this license plate number of repair and maintenance flow data library storage or Vehicle-Miles of Travel corresponding to Vehicle Identify Number and failure message, and repair and maintenance process description; Described tool model database purchase needs illustrating and 3D modeling figure of the instrument used for different vehicle breakdown maintenance, described vehicle failure intelligent analysis system, integrate remote server and there is vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, analyze vehicle trouble and determine to maintain flow process.
Use intelligent glasses to carry out the method for vehicle repair and maintenance, it is characterized in that, comprise the steps:
S1. start the intelligent glasses being used for automobile repair and maintenance, first enter recognition mode: whether the video data come by camera collection, occurred license plate number in autoscan picture, if there is license plate number, identify license plate number; By the license plate number identified, from vehicle information database, obtain Vehicle Identify Number or Direct Recognition goes out Vehicle Identify Number; According to Vehicle Identify Number, obtain in vehicle information database vehicle corresponding to this Vehicle Identify Number, year money, in travelling data database, obtain distance travelled, OBD data and diagnostic trouble code; By vehicle failure intelligent analysis system, needed the maintenance project done by distance travelled determination vehicle; By vehicle failure intelligent analysis system, needed the maintenance items done by OBD data and diagnostic trouble code determination vehicle;
S2. enter operator scheme: user by phonetic entry and gesture, selective system prompting repair and maintenance project;
S3. enter teaching pattern: if the repair and maintenance project that user selects is video teaching, then obtain repair and maintenance flow process video by repair and maintenance flow database, and start to play;
S4. play in repair and maintenance video process and enter operator scheme: user, by phonetic entry and gesture, controls the broadcasting of repair and maintenance flow process video;
S5. teaching pattern is entered: if the repair and maintenance project that user selects is word image teaching, then obtain repair and maintenance flow process by repair and maintenance flow database, if when needing prompting user operation auto parts in repair and maintenance flow process, enter recognition mode;
S6. recognition mode is entered: identify the particular automobile part occurred in picture, and point out the installation site of this part of user, then return teaching pattern;
S7. enter teaching pattern: the 3D model obtaining this part from vehicle structure model database, and be presented at video output system, and the position that operates and method of operating should be carried out with the form of animation prompting user on 3D model;
S8. play in teaching animation process and enter operator scheme: user is by phonetic entry and gesture, and operation 3D model at the moment, comprises rotation, amplifies, reduces, and split, the action of merging, makes the more detailed understanding teaching process of user;
S9 exits teaching and operator scheme: complete operation and teaching, exits.
Beneficial effect: the use of technique scheme of the present invention, intelligent glasses allows professional repairman more specification: because can pass through background data base, obtain more detailed car status information, to be supplied to general repair work specification more, meet the repair and maintenance flow process of official standard completely.People are allowed to select non-4S shop repairman also not have trouble and worry.Make fan more professional: because intelligent glasses can pass through background data base, to obtain more detailed car status information, can to the repair and maintenance project more professional with user, can allow the maintenance process simulation of having done it yourself that fan is more professional.Make green hand more calm: because intelligent glasses can pass through background data base, to obtain more detailed car status information, can inform how the user felt simply helpless extricates oneself from a predicament the very first time.
Add the function of the intelligent glasses for auto repair, utilize glasses can identify auto parts.Carry out multi-angle image collection by intelligent glasses, carry out three-dimensional modeling, avoid the incomplete situation of picture shape feature extraction caused due to single direction image acquisition.Establish large-scale part feature database, almost contain part space characteristics all on the market.The present invention takes three-dimensional coordinate as unique point coordinate, and the determined spheric region of unique point is averaged Region dividing, avoid because the situation using logarithm to divide some concentrated unique point of causing to separate because region area is too small, improve the accuracy of characteristic matching.The Hungary Algorithm carrying out Optimum Matching due to tradition is consuming time longer, and the present invention uses LAPJV algorithm to substitute Hungary Algorithm, saves the time that algorithm runs, improves algorithm travelling speed.
Accompanying drawing explanation
Fig. 1 is the structural representation of the Parts Recognition method in intelligent glasses repair and maintenance process of the present invention;
Fig. 2 is the front view of the Parts Recognition method in intelligent glasses repair and maintenance process of the present invention;
Fig. 3 is the rear view of the Parts Recognition method in intelligent glasses repair and maintenance process of the present invention;
Fig. 4 is the left view of the Parts Recognition method in intelligent glasses repair and maintenance process of the present invention;
Fig. 5 is the right view of the Parts Recognition method in intelligent glasses repair and maintenance process of the present invention;
Fig. 6 is the vertical view of the Parts Recognition method in intelligent glasses repair and maintenance process of the present invention;
Fig. 7 is the upward view of the Parts Recognition method in intelligent glasses repair and maintenance process of the present invention;
Fig. 8 is the exploded view of the Parts Recognition method in intelligent glasses repair and maintenance process of the present invention.
Wherein: 1. temple, 2. spectacle-frame, 3. convolution bending, 4. the first straight plate, 5. Trackpad, 6. base plate, 7. ray machine, 8. light source hole, 9. camera bracket, 10. control panel, 11. microphones, 12. loudspeaker, outside 13. temples, 14. second straight plates, 15. cameras, 16. lens frame.
Embodiment
In order to more clearly set forth the invention, the present invention is further described in conjunction with specific embodiments.
Embodiment 1:
A Parts Recognition method in intelligent glasses repair and maintenance process, comprises the following steps:
S1: first build offline feature storehouse to existing part, in order to support that the parts information gathered with follow-up intelligent glasses carries out characteristic matching, and is stored in server database module by this feature database;
S2: intelligent glasses pattern is adjusted to recognition mode, by the front-facing camera on intelligent glasses, carry out multi-angled shooting to part to be identified, shooting image must have lap, captured picture is reached server by communication module and carries out three-dimensional reconstruction, extract spatial context feature;
S3: compared by the part feature in the spatial context feature of extraction and offline feature storehouse, adopts LAPJV algorithm to carry out Optimum Matching operation to eigenmatrix, makes cost value minimum;
S4: choose the part that the auto parts corresponding to Least-cost value mate as current part to be detected most in offline feature database;
S5: server sends the information such as the title of the part of coupling, model, price to intelligent glasses, control module controls the displaying that image output module carries out parts information;
Above-mentioned intelligent glasses, comprise spectacle-frame 2 and temple 1, one of them temple 1 has a convolution bending 3, the side of convolution bending 3 connects the first straight plate 4, this first straight plate 4 is provided with the Trackpad 5 of outside temple 13, the opposite side of this convolution bending 3 connects the second straight plate 14, this the second straight plate 14 upper, lower both sides have the base plate 6 stretched out, the holding part of camera 15 is formed with the second straight plate 14, second straight plate 14 is provided with camera 15 mounting hole, described two base plates 6 are connected with ray machine 7, and this ray machine 7 is positioned at the front of the lens frame 16 more close with it, lens frame 16 is connected to the first straight plate 4 and is arranged at convolution bending 3 more nearby, first straight plate 4 is substantially vertical with the second straight plate 14, described substantially vertical for about departing from vertical 0-5 degree, make the two roughly in vertical angle.
Convolution bending of the present invention is mainly used in connecting Trackpad and camera, and make these two kinds of components can substantially upright position, and this kind of position relationship of image acquisition and touch control operation, when user is used, there is a kind of more comfortable interaction locations, and this kind of positional structure, also ray machine is made can be in picture frame dead ahead, this kind of picture position and touch control operation position, it is the better position in repair and maintenance process, operation when facilitating repair and maintenance and viewing picture, and lens frame is connected to the first straight plate and be arranged at convolution bending more nearby, make to realize intelligentized component directly to be born by temple, unnecessary improvement do not caused to spectacle-frame and have influence on point of view scope.And camera function is a major function of the Parts Recognition method in intelligent glasses repair and maintenance process, thus camera is placed in holding part, is also to protect the one of camera, and this kind of structure also comparatively saves space.
Embodiment 2: have identical technical scheme with embodiment 1, difference is: install light source in camera 15 holding part and correspond to the light source hole 8 on the second straight plate 14, microphone 11 is arranged on inside the first straight plate 4, spectacle-frame 2 and convolution bend near junction; Loudspeaker 12 are installed on the position when wearing intelligent glasses near ear in temple 1; Camera 15 by camera 15 support 9 support be arranged in camera 15 holding part, gyroscope, in order to identify vibration signal, set different vibration signals with to make automobile repair and maintenance intelligent glasses perform respective action.Light source, microphone and loudspeaker realize using intelligent glasses to carry out the multi-faceted interactive means of repair and maintenance, achieves a kind of omnibearing intelligent interaction, to improve the intellectuality of intelligent glasses.
Embodiment 3: there is identical technical scheme with embodiment 2, difference is: camera 15, light source, microphone 11 and loudspeaker 12 are connected to control panel 10, this control panel 10 has wireless communication module, for the signal receiving camera 15, light source, microphone 11 send, and data processing can be carried out to this Received signal strength, and this control panel 10 is provided with wireless signal transceiver module, and use this signal transmitting and receiving module to send and Received signal strength to remote server, wireless signal comprises, Wifi, bluetooth, GPS, FM.Because intelligent glasses is directly connected with control panel, control panel carries out signal again with remote server mutual, and control panel also can carry out data processing to this Received signal strength, i.e. some simple identifying operations or other operation, can carry out identifying or other process by control panel completely again, or by control panel in first pre-service, the processing pressure of remote server can be alleviated, and further increase processing speed, particularly pretreated signal meets at remote server again and completes subsequent treatment, greatly can reduce the processing time of remote server, user is made to obtain result more quickly.
Embodiment 4: have identical technical scheme with embodiment 1 or 2 or 3, difference is: control panel 10 includes image recognition matching module, for the pre-service of image, feature extraction, Classification and Identification; Control module, after inputting information identification, performs corresponding operating and feedback; Image output module, for carrying out image feedback to operator; Dio Output Modules, in order to carry out sound feedback to operator; Vibrational feedback module, in order to carry out vibrational feedback; Server database module, for the retrieval of service end data; Above-mentioned each module of control panel program be loaded under being in control panel is run and is achieved, and sets above-mentioned module, and object is that the signal such as image, sound to gathering processes, to obtaining corresponding Output rusults.
Embodiment 5: there is identical technical scheme with embodiment 1-4 is individual arbitrarily, difference is: control panel 10 goes back connected storage, this control panel 10 is connected with camera 15, light source, microphone 11 and loudspeaker 12 by signal wire, and being integrated in a mainframe box, this control panel 10 synchronously carries out data processing and signal transmitting and receiving.The object of this place's controller connected storage is, time due to intelligent glasses repair and maintenance, likely occur network failure etc. cannot with the situation of remote server interaction data, but, intelligent glasses still needs image data, and the data so gathered just can temporarily not stopped, and advanced row data store, when network recovery, continue the transmission with regard to data.
Embodiment 6: have identical technical scheme with embodiment 1-5 is individual arbitrarily, difference is: the license plate image of camera collection, only performs figure identifying processing by control panel, obtains this license board information, directly license board information is sent in remote server.Camera collection license board information, this license board information is directly identified by the control panel of intelligent glasses, information after identifying is sent out and remote server again, the advantage of this kind of mode is: image to the remote server directly sending car plate carries out identifying and mates, the signal not only transmitted is many, expend time in, server receives this signal and carries out the chronic of identifying processing, and at the scene to this pictorial information process, the data obtaining identifying are transmitted, signal transmission time is short, speed is fast, the user that can be as early as possible obtains information of vehicles under this car plate or out of Memory.
Embodiment 7: there is identical technical scheme with embodiment 1-6 is individual arbitrarily, difference is: remote server has vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, tool model database, vehicle failure intelligent analysis system, the described vehicle information database storage cart trade mark, and the Vehicle Identify Number of vehicle corresponding to this license plate number, owner information, vehicle maintenance record and vehicle service record, and also store vehicle under this license plate number, year money and vehicle configuration information; Described travelling data database purchase is by the OBD data of vehicle corresponding to the Vehicle Identify Number under license plate number or this license plate number and diagnostic trouble code; Described vehicle structure model data library storage by vehicle, year money and vehicle corresponding to vehicle configuration information forms and the explanation of ingredient and 3D modeling figure; Described this license plate number of repair and maintenance flow data library storage or Vehicle-Miles of Travel corresponding to Vehicle Identify Number and failure message, and repair and maintenance process description; Described tool model database purchase needs illustrating and 3D modeling figure of the instrument used for different vehicle breakdown maintenance, described vehicle failure intelligent analysis system, integrate remote server and there is vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, analyze vehicle trouble and determine to maintain flow process.
At remote server, above-mentioned database is set, for the information about vehicle repair and maintenance that intelligent glasses gathers, the data in Relational database can be transferred, and feedback user result, carrying out showing and pointing out in ray machine, loudspeaker etc., is realize intelligent glasses for the intelligentized guarantee of vehicle repair and maintenance, and sets up, perfects the content of this database, the process of each image data of intelligent glasses can be related to, enrich the function of intelligent glasses for vehicle repair and maintenance.
Embodiment 8: the invention still further relates to a kind of method using intelligent glasses to carry out vehicle repair and maintenance, uses the Parts Recognition method in the intelligent glasses repair and maintenance process described in any one in technique scheme, comprises the steps:
S1. start the Parts Recognition method in intelligent glasses repair and maintenance process, first enter recognition mode:
By the video data that camera collection comes, whether there is license plate number in autoscan picture, if there is license plate number, identify license plate number; By the license plate number identified, from vehicle information database, obtain Vehicle Identify Number or Direct Recognition goes out Vehicle Identify Number; According to Vehicle Identify Number, obtain in vehicle information database vehicle corresponding to this Vehicle Identify Number, year money, in travelling data database, obtain distance travelled, OBD data and diagnostic trouble code; By vehicle failure intelligent analysis system, needed the maintenance project done by distance travelled determination vehicle; By vehicle failure intelligent analysis system, needed the maintenance items done by OBD data and diagnostic trouble code determination vehicle;
S2. enter operator scheme: user by phonetic entry and gesture, selective system prompting repair and maintenance project;
S3. enter teaching pattern: if the repair and maintenance project that user selects is video teaching, then obtain repair and maintenance flow process video by repair and maintenance flow database, and start to play;
S4. play in repair and maintenance video process and enter operator scheme: user, by phonetic entry and gesture, controls the broadcasting of repair and maintenance flow process video;
S5. teaching pattern is entered: if the repair and maintenance project that user selects is word image teaching, then obtain repair and maintenance flow process by repair and maintenance flow database, if when needing prompting user operation auto parts in repair and maintenance flow process, enter recognition mode;
S6. recognition mode is entered
Identify the particular automobile part occurred in picture, and point out the installation site of this part of user, then return teaching pattern;
S7. teaching pattern is entered
From vehicle structure model database, obtain the 3D model of this part, and be presented at video output system, and the position that operates and method of operating should be carried out with the form of animation prompting user on 3D model;
S8. play in teaching animation process and enter operator scheme
User is by phonetic entry and gesture, and operation 3D model at the moment, comprises rotation, amplifies, reduces, and split, the action of merging, makes the more detailed understanding teaching process of user;
S9 exits teaching and operator scheme
Complete operation and teaching, exit.
When intelligent glasses being applied to vehicle repair and maintenance, separating 3 patterns and (identify, operation, teaching), 3 patterns are relied on mutually, support mutually, change mutually, to realize the information acquisition of vehicle repair and maintenance, object that is auxiliary and that certainly realize, and 3 patterns all rely on vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, a series of infosystems such as vehicle failure intelligent analysis system (RDM).And present one and intactly use intelligent glasses to carry out the process of assisting vehicle repair and maintenance.
The above; be only the present invention's preferably embodiment; but protection scope of the present invention is not limited thereto; anyly be familiar with those skilled in the art in the technical scope that the present invention discloses; be equal to according to technical scheme of the present invention and inventive concept thereof and replace or change, all should be encompassed within protection scope of the present invention.
Claims (8)
1. the Parts Recognition method in intelligent glasses repair and maintenance process, concrete steps are as follows:
S1: first build offline feature storehouse to existing part, in order to support that the parts information gathered with follow-up intelligent glasses carries out characteristic matching, and is stored in server database module by this feature database;
S2: intelligent glasses pattern is adjusted to recognition mode, by the front-facing camera on intelligent glasses, carry out multi-angled shooting to part to be identified, shooting image must have lap, captured picture is reached server by communication module and carries out three-dimensional reconstruction, extract spatial context feature;
S3: compared by the part feature in the spatial context feature of extraction and offline feature storehouse, adopts LAPJV algorithm to carry out Optimum Matching operation to eigenmatrix, makes cost value minimum;
S4: choose the part that the auto parts corresponding to Least-cost value mate as current part to be detected most in offline feature database;
S5: server sends the information such as the title of the part of coupling, model, price to intelligent glasses, control module controls the displaying that image output module carries out parts information;
Above-mentioned intelligent glasses, comprise spectacle-frame (2) and temple (1), it is characterized in that: one of them temple (1) has convolution bending (3), the side of convolution bending (3) connects the first straight plate (4), this the first straight plate (4) is provided with the Trackpad (5) of outside temple (13), the opposite side of this convolution bending (3) connects the second straight plate (14), this the second straight plate (14) upper, lower both sides have the base plate (6) stretched out, the holding part of camera (15) is formed with the second straight plate (14), second straight plate (14) is provided with camera mounting hole, described two base plates (6) are connected with ray machine (7), and this ray machine (7) is positioned at the front of the lens frame (16) more close with it, lens frame is connected to the first straight plate (4) and is arranged at convolution bending (3) more nearby, first straight plate (4) is substantially vertical with the second straight plate (14).
2. the Parts Recognition method in intelligent glasses repair and maintenance process as claimed in claim 1, it is characterized in that: install light source in camera (15) holding part and correspond to the light source hole (8) on the second straight plate (14), microphone (11) is arranged on the spectacle-frame (2) inside the first straight plate (4) and circles round and bends near (3) junction; Loudspeaker (12) are installed on the upper position near ear of the temple (1) when wearing intelligent glasses; Camera (15) is supported by camera bracket (9) and is arranged in camera (15) holding part, gyroscope, in order to identify vibration signal, set different vibration signals with to make automobile repair and maintenance intelligent glasses perform respective action.
3. the Parts Recognition method in intelligent glasses repair and maintenance process as claimed in claim 2, it is characterized in that: described camera (15), light source, microphone (11) and loudspeaker (12) are connected to control panel (10), this control panel (10) has wireless communication module, for receiving camera (15), light source, the signal that microphone (11) sends, and data processing can be carried out to this Received signal strength, and this control panel (10) is provided with wireless signal transceiver module, and use this signal transmitting and receiving module to send and Received signal strength to remote server.
4. the Parts Recognition method in the intelligent glasses repair and maintenance process as described in any one of claim 1-3, is characterized in that: control panel (10) comprises image recognition matching module, for the pre-service of image, and feature extraction, Classification and Identification; Control module, after inputting information identifications not other, performs corresponding operating and feedback.Image output module, for carrying out image feedback to operator; Dio Output Modules, in order to carry out sound feedback to operator; Vibrational feedback module, in order to carry out vibrational feedback; Server database module, for the retrieval of service end data.
5. the Parts Recognition method in intelligent glasses repair and maintenance process as claimed in claim 3, it is characterized in that: control panel (10) goes back connected storage, this control panel (10) is connected with camera (15), light source, microphone (11) and loudspeaker (12) by signal wire, and being integrated in a mainframe box, this control panel (10) synchronously carries out data processing and signal transmitting and receiving.
6. the Parts Recognition method in intelligent glasses repair and maintenance process as claimed in claim 4, it is characterized in that: the license plate image that camera (15) gathers, only perform figure identifying processing by control panel (10), obtain this license board information, directly license board information is sent in remote server.
7. the Parts Recognition method in intelligent glasses repair and maintenance process as claimed in claim 4, it is characterized in that: remote server has vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, tool model database, vehicle failure intelligent analysis system, the described vehicle information database storage cart trade mark, and the Vehicle Identify Number of vehicle corresponding to this license plate number, owner information, vehicle maintenance record and vehicle service record, and also store vehicle under this license plate number, year money and vehicle configuration information; Described travelling data database purchase is by the OBD data of vehicle corresponding to the Vehicle Identify Number under license plate number or this license plate number and diagnostic trouble code; Described vehicle structure model data library storage by vehicle, year money and vehicle corresponding to vehicle configuration information forms and the explanation of ingredient and 3D modeling figure; Described this license plate number of repair and maintenance flow data library storage or Vehicle-Miles of Travel corresponding to Vehicle Identify Number and failure message, and repair and maintenance process description; Described tool model database purchase needs illustrating and 3D modeling figure of the instrument used for different vehicle breakdown maintenance, described vehicle failure intelligent analysis system, integrate remote server and there is vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, analyze vehicle trouble and determine to maintain flow process.
8. the Parts Recognition method in intelligent glasses repair and maintenance process according to claim 7, realizes using intelligent glasses to carry out the method for vehicle repair and maintenance, it is characterized in that, comprise the steps:
S1. start the Parts Recognition method in intelligent glasses repair and maintenance process, first enter recognition mode: whether the video data come by camera collection, occurred license plate number in autoscan picture, if there is license plate number, identify license plate number; By the license plate number identified, from vehicle information database, obtain Vehicle Identify Number or Direct Recognition goes out Vehicle Identify Number; According to Vehicle Identify Number, obtain in vehicle information database vehicle corresponding to this Vehicle Identify Number, year money, in travelling data database, obtain distance travelled, OBD data and diagnostic trouble code; By vehicle failure intelligent analysis system, needed the maintenance project done by distance travelled determination vehicle; By vehicle failure intelligent analysis system, needed the maintenance items done by OBD data and diagnostic trouble code determination vehicle;
S2. enter operator scheme: user by phonetic entry and gesture, selective system prompting repair and maintenance project;
S3. enter teaching pattern: if the repair and maintenance project that user selects is video teaching, then obtain repair and maintenance flow process video by repair and maintenance flow database, and start to play;
S4. play in repair and maintenance video process and enter operator scheme: user, by phonetic entry and gesture, controls the broadcasting of repair and maintenance flow process video;
S5. teaching pattern is entered: if the repair and maintenance project that user selects is word image teaching, then obtain repair and maintenance flow process by repair and maintenance flow database, if when needing prompting user operation auto parts in repair and maintenance flow process, enter recognition mode;
S6. recognition mode is entered: identify the particular automobile part occurred in picture, and point out the installation site of this part of user, then return teaching pattern;
S7. enter teaching pattern: the 3D model obtaining this part from vehicle structure model database, and be presented at video output system, and the position that operates and method of operating should be carried out with the form of animation prompting user on 3D model;
S8. play in teaching animation process and enter operator scheme: user is by phonetic entry and gesture, and operation 3D model at the moment, comprises rotation, amplifies, reduces, and split, the action of merging, makes the more detailed understanding teaching process of user;
S9 exits teaching and operator scheme: complete operation and teaching, exits.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510628119.8A CN105184276B (en) | 2015-09-28 | 2015-09-28 | Parts Recognition method during intelligent glasses maintenance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510628119.8A CN105184276B (en) | 2015-09-28 | 2015-09-28 | Parts Recognition method during intelligent glasses maintenance |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105184276A true CN105184276A (en) | 2015-12-23 |
| CN105184276B CN105184276B (en) | 2018-10-19 |
Family
ID=54906343
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510628119.8A Active CN105184276B (en) | 2015-09-28 | 2015-09-28 | Parts Recognition method during intelligent glasses maintenance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105184276B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106980846A (en) * | 2017-05-01 | 2017-07-25 | 刘至键 | A kind of auto parts machinery identifying device based on depth convolutional network |
| CN107153962A (en) * | 2016-03-04 | 2017-09-12 | 苏州俊峰伟业信息技术有限公司 | Vehicle maintenance Maintenance price method and system |
| CN111104542A (en) * | 2020-01-07 | 2020-05-05 | 成都睿琪科技有限责任公司 | Part identification management method and device |
| US11983959B2 (en) | 2019-04-18 | 2024-05-14 | Beckman Coulter, Inc. | Securing data of objects in a laboratory environment |
| US12001600B2 (en) | 2018-11-09 | 2024-06-04 | Beckman Coulter, Inc. | Service glasses with selective data provision |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101271582A (en) * | 2008-04-10 | 2008-09-24 | 清华大学 | Three-dimensional reconstruction method based on multi-vision angle two-dimension image combined with SIFT algorithm |
| CN202394110U (en) * | 2011-11-09 | 2012-08-22 | 张红泉 | Remote diagnostic device for automobile fault |
| CN104321684A (en) * | 2012-03-21 | 2015-01-28 | 谷歌公司 | Wearable device with input and output structures |
| CN104316033A (en) * | 2014-11-04 | 2015-01-28 | 无锡港湾网络科技有限公司 | Visual inspection system for automobile parts |
-
2015
- 2015-09-28 CN CN201510628119.8A patent/CN105184276B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101271582A (en) * | 2008-04-10 | 2008-09-24 | 清华大学 | Three-dimensional reconstruction method based on multi-vision angle two-dimension image combined with SIFT algorithm |
| CN202394110U (en) * | 2011-11-09 | 2012-08-22 | 张红泉 | Remote diagnostic device for automobile fault |
| CN104321684A (en) * | 2012-03-21 | 2015-01-28 | 谷歌公司 | Wearable device with input and output structures |
| CN104316033A (en) * | 2014-11-04 | 2015-01-28 | 无锡港湾网络科技有限公司 | Visual inspection system for automobile parts |
Non-Patent Citations (2)
| Title |
|---|
| MARCEL KORTGEN 等: "3D Shape Matching with 3D Shape Contexts", 《THE 7TH CENTRAL EUROPEAN SEMINAR ON COMPUTER GRAPHICS》 * |
| 陈华成 等: "基于三维特征的零件自动识别系统", 《传感器学报》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107153962A (en) * | 2016-03-04 | 2017-09-12 | 苏州俊峰伟业信息技术有限公司 | Vehicle maintenance Maintenance price method and system |
| CN106980846A (en) * | 2017-05-01 | 2017-07-25 | 刘至键 | A kind of auto parts machinery identifying device based on depth convolutional network |
| US12001600B2 (en) | 2018-11-09 | 2024-06-04 | Beckman Coulter, Inc. | Service glasses with selective data provision |
| US11983959B2 (en) | 2019-04-18 | 2024-05-14 | Beckman Coulter, Inc. | Securing data of objects in a laboratory environment |
| CN111104542A (en) * | 2020-01-07 | 2020-05-05 | 成都睿琪科技有限责任公司 | Part identification management method and device |
| CN111104542B (en) * | 2020-01-07 | 2023-04-18 | 成都睿琪科技有限责任公司 | Part identification management method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105184276B (en) | 2018-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105182535A (en) | Method of using intelligent glasses for vehicle maintenance | |
| CN105355196A (en) | Speech instruction recognition method for intelligent glasses applied to field of car maintenance | |
| CN105158927B (en) | The method of part dismounting of the intelligent glasses during automobile maintenance | |
| CN105223706B (en) | The method of vehicle damage degree is judged for the intelligent glasses during vehicle maintenance | |
| CN105182536B (en) | Intelligent glasses pass through Car license recognition and the method that obtains information of vehicles during automobile maintenance | |
| CN105184276A (en) | Method of recognizing parts during maintenance process by intelligent glasses | |
| CN105353510A (en) | Application method of smart glasses for automobile long-distance maintenance support | |
| CN105224923A (en) | Intelligent glasses is applied to the method for the division part setting loss grade in repair and maintenance process | |
| CN105259657B (en) | The means of illumination of intelligent glasses during automobile maintenance | |
| CN105353508A (en) | Detection method of automobile liquid residues through adoption of smart glasses | |
| JP2017055177A (en) | Image processing apparatus, image processing program, and image processing system | |
| CN106023619A (en) | Traffic signal lamp information obtaining method, device and vehicle | |
| CN108241623B (en) | Automatic assignment method and device, electronic map intelligent production system and navigation equipment | |
| CN106537476A (en) | Trainable transceiver and mobile communications device diagnostic systems and methods | |
| CN105205471B (en) | The method that blind area during intelligent glasses maintenance is checked | |
| CN105158900B (en) | Head pose on automobile maintenance intelligent glasses knows method for distinguishing | |
| US20210181331A1 (en) | Techniques for determining a location of a mobile object | |
| CN205080316U (en) | Smart spectacles | |
| CN105223694B (en) | Intelligent glasses are applied to the method for the indoor positioning and image recognition during automobile maintenance | |
| CN105182537A (en) | Method of recognizing liquid leakage during maintenance process by intelligent glasses | |
| CN105242401A (en) | Method for sharing other equipment data for automobile maintenance through intelligent eyeglasses | |
| CN105204643A (en) | Gesture recognition method for intelligent glasses used in vehicle maintaining process | |
| CN105158931A (en) | Oil stain preventing method for parallel usage of touchpad and keys of intelligent glasses in the vehicle maintenance process | |
| CN105353509A (en) | Determination method of abnormal sound of vehicle through adoption of smart glasses in process of vehicle maintenance | |
| CN105158901A (en) | Intelligent glasses used for automobile maintenance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |