CN105353509A - Determination method of abnormal sound of vehicle through adoption of smart glasses in process of vehicle maintenance - Google Patents
Determination method of abnormal sound of vehicle through adoption of smart glasses in process of vehicle maintenance Download PDFInfo
- Publication number
- CN105353509A CN105353509A CN201510631697.7A CN201510631697A CN105353509A CN 105353509 A CN105353509 A CN 105353509A CN 201510631697 A CN201510631697 A CN 201510631697A CN 105353509 A CN105353509 A CN 105353509A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- maintenance
- repair
- intelligent glasses
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012423 maintenance Methods 0.000 title claims abstract description 115
- 238000000034 method Methods 0.000 title claims abstract description 93
- 230000008569 process Effects 0.000 title claims abstract description 64
- 239000004984 smart glass Substances 0.000 title abstract 5
- 230000002159 abnormal effect Effects 0.000 title abstract 4
- 230000005236 sound signal Effects 0.000 claims abstract description 8
- 238000000605 extraction Methods 0.000 claims abstract description 7
- 230000009467 reduction Effects 0.000 claims abstract description 6
- 238000001514 detection method Methods 0.000 claims abstract description 5
- 230000008439 repair process Effects 0.000 claims description 98
- 239000011521 glass Substances 0.000 claims description 84
- 238000012545 processing Methods 0.000 claims description 19
- 238000005452 bending Methods 0.000 claims description 17
- 230000005540 biological transmission Effects 0.000 claims description 8
- 230000009471 action Effects 0.000 claims description 6
- 230000015556 catabolic process Effects 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 3
- 239000004615 ingredient Substances 0.000 claims description 3
- 238000009434 installation Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 description 8
- 230000003993 interaction Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000001684 chronic effect Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012797 qualification Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 235000021110 pickles Nutrition 0.000 description 1
- 238000010791 quenching Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000035922 thirst Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0176—Head mounted characterised by mechanical features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Abstract
The present invention provides a determination method of abnormal sound of a vehicle through adoption of smart glasses in the process of vehicle maintenance, belonging to the field of the vehicle maintenance. The technical problem that the smart glasses are configured to determine the abnormal sound of a vehicle in the process of the vehicle maintenance is solved. The technical scheme of the invention comprises: sound signals are transmitted to a sound recognition and matching module in the host of the smart glasses; noise reduction of sound, singularity detection and feature extraction of the sound signals are performed; the extracted features are classified and recognized; and the type of the sound and the fault degree is determined, and the analysis result information is transmitted to a control module. According to the invention, smart glasses have a recognition function of abnormal sound of a vehicle in the process of the vehicle maintenance.
Description
Technical field
The invention belongs to automobile repair and maintenance field, particularly relating in a kind of automobile repair and maintenance process intelligent glasses for judging the method for vehicle different sound.
Background technology
Domestic car owner, when automobile goes wrong or needs maintenance, still depends on 4s shop mostly.But there are two apparent drawbacks in 4S shop, expensive and time-consuming.
When people have to take the second best, when selecting numberless informal repair shop, although convenient cheap again, but expect the love car of oneself to be handed the repairman that those do not have formal qualification, be tantamount to the doctor health being handed qualification of not practising medicine, time child is delivered to the teacher there not having the system of qualifying for teachers, hang back a little again.
Also have some manipulative abilities, have a mind to do-it-yourself car owner, owing to not passing through the study of specialty, setting about always, some is not self-confident, and then loses interest.Certainly also there is other car owner, auto repair is not expert at, also not interested.But a storm may arise from a clear sky, driving is away from home, and can meet some emergency situations unavoidably, such as blow out, leak, leakage of oil etc.Oneself is repaiied, and has no way of doing it again; Deng rescue, Distant water cannot quench present thirst again.
Based on above all pickles, the intelligent glasses being applied to automobile repair and maintenance field arises at the historic moment.
Summary of the invention
In order to solve in prior art, because car owner's maintainability is different, supplementary means demand required for maintenance be there are differences, and in prior art, lack the aid of this kind of intelligent assisting vehicle repair and maintenance, causing existing vehicle repair and maintenance to be difficult to the problem of being undertaken by car owner oneself, the present invention proposes in a kind of automobile repair and maintenance process intelligent glasses for judging the method for vehicle different sound.
To achieve these goals, the technical solution used in the present invention is: in a kind of automobile repair and maintenance process, intelligent glasses is for judging the method for vehicle different sound, comprises the steps:
S1. glasses pattern is switched to recognition mode by operating personnel, sends phonetic order and carries out sound fault analysis identification;
S2. intelligent glasses microphone array obtains and collected sound signal;
S3. transmission of sound signals is to the voice recognition matching module in intelligent glasses main frame, carry out the noise reduction of sound, Singularity Detection, and the feature extraction of voice signal, Classification and Identification is carried out to the feature extracted, judge sound generic, and fault degree, simultaneously by analysis result information transmission to control module;
S4., after control module receives object information, control vibrational feedback module prompts user, and control image output module display analysis result;
Described intelligent glasses, comprise spectacle-frame and temple, one of them temple has a convolution bending, the side of convolution bending connects the first straight plate, this first straight plate is provided with towards the Trackpad outside temple, the opposite side of this convolution bending connects the second straight plate, this the second straight plate upper, lower both sides have the base plate stretched out, the holding part of camera is formed with the second straight plate, second straight plate is provided with camera mounting hole, described two base plates are connected with ray machine, and this ray machine is positioned at the front of the lens frame more close with it, lens frame is connected to the first straight plate and is arranged at convolution bending more nearby, first straight plate is substantially vertical with the second straight plate.
Convolution bending of the present invention is mainly used in connecting Trackpad and camera, and make these two kinds of components can substantially upright position, and this kind of position relationship of image acquisition and touch control operation, when user is used, there is a kind of more comfortable interaction locations, and this kind of positional structure, also ray machine is made can be in picture frame dead ahead, this kind of picture position and touch control operation position, it is the better position in repair and maintenance process, operation when facilitating repair and maintenance and viewing picture, and lens frame is connected to the first straight plate and be arranged at convolution bending more nearby, make to realize intelligentized component directly to be born by temple, unnecessary improvement do not caused to spectacle-frame and have influence on point of view scope.And camera function is that in automobile repair and maintenance process, intelligent glasses is for judging a major function of the method for vehicle different sound, thus camera is placed in holding part, is also to protect the one of camera, and this kind of structure also comparatively saves space.
Make intelligent glasses in vehicle repair and maintenance process, there is vehicle different sound recognition function, by the voice signal of vehicle as the Data support of vehicle fault detection, and the car vehicle noise reduction depositing magnanimity in database with to should noise reduction and the vehicle trouble data that exist, this function is applied to intelligent glasses, make it have the mutual of sound aspect, namely in order to realize the multi-faceted identification of intelligent glasses to the multi-signal such as sound, image, to obtain a feature richness, and the intelligent glasses that intellectuality is higher.
Further, install light source in camera holding part and correspond to the light source hole on the second straight plate, microphone is arranged on inside the first straight plate, and spectacle-frame and convolution bend near junction; ; Loudspeaker are installed on the position when wearing intelligent glasses near ear in temple; Camera by camera bracket support be arranged in camera holding part, gyroscope, in order to identify vibration signal, set different vibration signals with to make automobile repair and maintenance intelligent glasses perform respective action.
Light source, microphone loudspeaker realize using intelligent glasses to carry out the multi-faceted interactive means of repair and maintenance, achieves a kind of omnibearing intelligent interaction, to improve the intellectuality of intelligent glasses.
Further, described camera, light source, microphone and loudspeaker are connected to control panel, this control panel has wireless communication module, for the signal receiving camera, light source, microphone send, and data processing can be carried out to this Received signal strength, and this control panel is provided with wireless signal transceiver module, and this signal transmitting and receiving module is used to send and Received signal strength to remote server.
Because intelligent glasses is directly connected with control panel, control panel carries out signal again with remote server mutual, and control panel also can carry out data processing to this Received signal strength, i.e. some simple identifying operations or other operation, can carry out identifying or other process by control panel completely again, or by control panel in first pre-service, the processing pressure of remote server can be alleviated, and further increase processing speed, particularly pretreated signal meets at remote server again and completes subsequent treatment, greatly can reduce the processing time of remote server, user is made to obtain result more quickly.
Further, control panel includes image recognition matching module, for the pre-service of image, and feature extraction, Classification and Identification; Control module, after inputting information identification, performs corresponding operating and feedback; Image output module, for carrying out image feedback to operator; Dio Output Modules, in order to carry out sound feedback to operator; Vibrational feedback module, in order to carry out vibrational feedback; Server database module, for the retrieval of service end data;
Above-mentioned each module of control panel program be loaded under being in control panel is run and is achieved, and sets above-mentioned module, and object is that the signal such as image, sound to gathering processes, to obtaining corresponding Output rusults.
Further, control panel is connected storage also, and this control panel is connected with camera, light source, microphone and loudspeaker by signal wire, and is integrated in a mainframe box, and this control panel synchronously carries out data processing and signal transmitting and receiving.
The object of this place's controller connected storage is, time due to intelligent glasses repair and maintenance, likely occur network failure etc. cannot with the situation of remote server interaction data, but, intelligent glasses still needs image data, and the data so gathered just can temporarily not stopped, and advanced row data store, when network recovery, continue the transmission with regard to data.
Further, the license plate image of camera collection, only performs figure identifying processing by control panel, obtains this license board information, directly license board information is sent in remote server.
Camera collection license board information, this license board information is directly identified by the control panel of intelligent glasses, information after identifying is sent out and remote server again, the advantage of this kind of mode is: image to the remote server directly sending car plate carries out identifying and mates, the signal not only transmitted is many, expend time in, server receives this signal and carries out the chronic of identifying processing, and at the scene to this pictorial information process, the data obtaining identifying are transmitted, signal transmission time is short, speed is fast, the user that can be as early as possible obtains information of vehicles under this car plate or out of Memory.
Further, remote server has vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, tool model database, vehicle failure intelligent analysis system, the described vehicle information database storage cart trade mark, and the Vehicle Identify Number of vehicle corresponding to this license plate number, owner information, vehicle maintenance record and vehicle service record, and also store vehicle under this license plate number, year money and vehicle configuration information; Described travelling data database purchase is by the OBD data of vehicle corresponding to the Vehicle Identify Number under license plate number or this license plate number and diagnostic trouble code; Described vehicle structure model data library storage by vehicle, year money and vehicle corresponding to vehicle configuration information forms and the explanation of ingredient and 3D modeling figure; Described this license plate number of repair and maintenance flow data library storage or Vehicle-Miles of Travel corresponding to Vehicle Identify Number and failure message, and repair and maintenance process description; Described tool model database purchase needs illustrating and 3D modeling figure of the instrument used for different vehicle breakdown maintenance, described vehicle failure intelligent analysis system, integrate remote server and there is vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, analyze vehicle trouble and determine to maintain flow process.
At remote server, above-mentioned database is set, for the information about vehicle repair and maintenance that intelligent glasses gathers, the data in Relational database can be transferred, and feedback user result, carrying out showing and pointing out in ray machine, loudspeaker etc., is realize intelligent glasses for the intelligentized guarantee of vehicle repair and maintenance, and sets up, perfects the content of this database, the process of each image data of intelligent glasses can be related to, enrich the function of intelligent glasses for vehicle repair and maintenance.
Further, the invention still further relates to a kind of method using intelligent glasses to carry out vehicle repair and maintenance, using intelligent glasses in the automobile repair and maintenance process described in any one in technique scheme for judging the method for vehicle different sound, to comprise the steps:
S1. start intelligent glasses, first enter recognition mode:
By the video data that camera collection comes, whether there is license plate number in autoscan picture, if there is license plate number, identify license plate number; By the license plate number identified, from vehicle information database, obtain Vehicle Identify Number or Direct Recognition goes out Vehicle Identify Number; According to Vehicle Identify Number, obtain in vehicle information database vehicle corresponding to this Vehicle Identify Number, year money, in travelling data database, obtain distance travelled, OBD data and diagnostic trouble code; By vehicle failure intelligent analysis system, needed the maintenance project done by distance travelled determination vehicle; By vehicle failure intelligent analysis system, needed the maintenance items done by OBD data and diagnostic trouble code determination vehicle;
S2. enter operator scheme: user by phonetic entry and gesture, selective system prompting repair and maintenance project;
S3. enter teaching pattern: if the repair and maintenance project that user selects is video teaching, then obtain repair and maintenance flow process video by repair and maintenance flow database, and start to play;
S4. play in repair and maintenance video process and enter operator scheme: user, by phonetic entry and gesture, controls the broadcasting of repair and maintenance flow process video;
S5. teaching pattern is entered: if the repair and maintenance project that user selects is word image teaching, then obtain repair and maintenance flow process by repair and maintenance flow database, if when needing prompting user operation auto parts in repair and maintenance flow process, enter recognition mode;
S6. recognition mode is entered: identify the particular automobile part occurred in picture, and point out the installation site of this part of user, then return teaching pattern;
S7. enter teaching pattern: the 3D model obtaining this part from vehicle structure model database, and be presented at video output system, and the position that operates and method of operating should be carried out with the form of animation prompting user on 3D model;
S8. play in teaching animation process and enter operator scheme: user is by phonetic entry and gesture, and operation 3D model at the moment, comprises rotation, amplifies, reduces, and split, the action of merging, makes the more detailed understanding teaching process of user;
S9 exits teaching and operator scheme: complete operation and teaching, exits.
When intelligent glasses being applied to vehicle repair and maintenance, separating 3 patterns and (identify, operation, teaching), 3 patterns are relied on mutually, support mutually, change mutually, to realize the information acquisition of vehicle repair and maintenance, object that is auxiliary and that certainly realize, and 3 patterns all rely on vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, a series of infosystems such as vehicle failure intelligent analysis system (RDM).And present one and intactly use intelligent glasses to carry out the process of assisting vehicle repair and maintenance.
Beneficial effect: the use of technique scheme of the present invention, intelligent glasses allows professional repairman more specification: because can pass through background data base, obtain more detailed car status information, to be supplied to general repair work specification more, meet the repair and maintenance flow process of official standard completely.People are allowed to select non-4S shop repairman also not have trouble and worry.Make fan more professional: because intelligent glasses can pass through background data base, to obtain more detailed car status information, can to the repair and maintenance project more professional with user, can allow the maintenance process simulation of having done it yourself that fan is more professional.Make green hand more calm: because intelligent glasses can pass through background data base, to obtain more detailed car status information, can inform how the user felt simply helpless extricates oneself from a predicament the very first time.
Accompanying drawing explanation
Fig. 1 is the structural representation of intelligent glasses of the present invention;
Fig. 2 is the front view of intelligent glasses of the present invention;
Fig. 3 is the rear view of intelligent glasses of the present invention;
Fig. 4 is the left view of intelligent glasses of the present invention;
Fig. 5 is the right view of intelligent glasses of the present invention;
Fig. 6 is the vertical view of intelligent glasses of the present invention;
Fig. 7 is the upward view of intelligent glasses of the present invention;
Fig. 8 is the exploded view of intelligent glasses of the present invention.
Wherein: 1. temple, 2. spectacle-frame, 3. convolution bending, 4. the first straight plate, 5. Trackpad, 6. base plate, 7. ray machine, 8. light source hole, 9. camera bracket, 10. control panel, 11. microphones, 12. loudspeaker, outside 13. temples, 14. second straight plates, 15. cameras, 16. lens frame.
Embodiment
In order to more clearly set forth the invention, the present invention is further described in conjunction with specific embodiments.
Embodiment 1: in a kind of automobile repair and maintenance process, intelligent glasses is for judging the method for vehicle different sound, comprises the steps:
S1. glasses pattern is switched to recognition mode by operating personnel, sends phonetic order and carries out sound fault analysis identification;
S2. intelligent glasses microphone array obtains and collected sound signal;
S3. transmission of sound signals is to the voice recognition matching module in intelligent glasses main frame, carry out the noise reduction of sound, Singularity Detection, and the feature extraction of voice signal, Classification and Identification is carried out to the feature extracted, judge sound generic, and fault degree, simultaneously by analysis result information transmission to control module;
S4., after control module receives object information, control vibrational feedback module prompts user, and control image output module display analysis result;
Described intelligent glasses, comprise spectacle-frame 2 and temple 1, one of them temple 1 has a convolution bending 3, the side of convolution bending 3 connects the first straight plate 4, this first straight plate 4 is provided with the Trackpad 5 of outside temple 13, the opposite side of this convolution bending 3 connects the second straight plate 14, this the second straight plate 14 upper, lower both sides have the base plate 6 stretched out, the holding part of camera 15 is formed with the second straight plate 14, second straight plate 14 is provided with camera 15 mounting hole, described two base plates 6 are connected with ray machine 7, and this ray machine 7 is positioned at the front of the lens frame 16 more close with it, lens frame 16 is connected to the first straight plate 4 and is arranged at convolution bending 3 more nearby, first straight plate 4 is substantially vertical with the second straight plate 14, described substantially vertical for about departing from vertical 0-5 degree, make the two roughly in vertical angle.
Convolution bending of the present invention is mainly used in connecting Trackpad and camera, and make these two kinds of components can substantially upright position, and this kind of position relationship of image acquisition and touch control operation, when user is used, there is a kind of more comfortable interaction locations, and this kind of positional structure, also ray machine is made can be in picture frame dead ahead, this kind of picture position and touch control operation position, it is the better position in repair and maintenance process, operation when facilitating repair and maintenance and viewing picture, and lens frame is connected to the first straight plate and be arranged at convolution bending more nearby, make to realize intelligentized component directly to be born by temple, unnecessary improvement do not caused to spectacle-frame and have influence on point of view scope.And camera function is that in automobile repair and maintenance process, intelligent glasses is for judging a major function of the method for vehicle different sound, thus camera is placed in holding part, is also to protect the one of camera, and this kind of structure also comparatively saves space.
Embodiment 2: have identical technical scheme with embodiment 1, difference is: install light source in camera 15 holding part and correspond to the light source hole 8 on the second straight plate 14, microphone 11 is arranged on inside the first straight plate 4, spectacle-frame 2 and convolution bend near junction; Loudspeaker 12 are installed on the position when wearing intelligent glasses near ear in temple 1; Camera 15 by camera 15 support 9 support be arranged in camera 15 holding part, gyroscope, in order to identify vibration signal, set different vibration signals with to make automobile repair and maintenance intelligent glasses perform respective action.Light source, microphone and loudspeaker realize using intelligent glasses to carry out the multi-faceted interactive means of repair and maintenance, achieves a kind of omnibearing intelligent interaction, to improve the intellectuality of intelligent glasses.
Embodiment 3: there is identical technical scheme with embodiment 2, difference is: camera 15, light source, microphone 11 and loudspeaker 12 are connected to control panel 10, this control panel 10 has wireless communication module, for the signal receiving camera 15, light source, microphone 11 send, and data processing can be carried out to this Received signal strength, and this control panel 10 is provided with wireless signal transceiver module, and use this signal transmitting and receiving module to send and Received signal strength to remote server, wireless signal comprises, Wifi, bluetooth, GPS, FM.Because intelligent glasses is directly connected with control panel, control panel carries out signal again with remote server mutual, and control panel also can carry out data processing to this Received signal strength, i.e. some simple identifying operations or other operation, can carry out identifying or other process by control panel completely again, or by control panel in first pre-service, the processing pressure of remote server can be alleviated, and further increase processing speed, particularly pretreated signal meets at remote server again and completes subsequent treatment, greatly can reduce the processing time of remote server, user is made to obtain result more quickly.
Embodiment 4: have identical technical scheme with embodiment 1 or 2 or 3, difference is: control panel 10 includes image recognition matching module, for the pre-service of image, feature extraction, Classification and Identification; Control module, after inputting information identification, performs corresponding operating and feedback; Image output module, for carrying out image feedback to operator; Dio Output Modules, in order to carry out sound feedback to operator; Vibrational feedback module, in order to carry out vibrational feedback; Server database module, for the retrieval of service end data; Above-mentioned each module of control panel program be loaded under being in control panel is run and is achieved, and sets above-mentioned module, and object is that the signal such as image, sound to gathering processes, to obtaining corresponding Output rusults.
Embodiment 5: there is identical technical scheme with embodiment 1-4 is individual arbitrarily, difference is: control panel 10 goes back connected storage, this control panel 10 is connected with camera 15, light source, microphone 11 and loudspeaker 12 by signal wire, and being integrated in a mainframe box, this control panel 10 synchronously carries out data processing and signal transmitting and receiving.The object of this place's controller connected storage is, time due to intelligent glasses repair and maintenance, likely occur network failure etc. cannot with the situation of remote server interaction data, but, intelligent glasses still needs image data, and the data so gathered just can temporarily not stopped, and advanced row data store, when network recovery, continue the transmission with regard to data.
Embodiment 6: have identical technical scheme with embodiment 1-5 is individual arbitrarily, difference is: the license plate image of camera collection, only performs figure identifying processing by control panel, obtains this license board information, directly license board information is sent in remote server.Camera collection license board information, this license board information is directly identified by the control panel of intelligent glasses, information after identifying is sent out and remote server again, the advantage of this kind of mode is: image to the remote server directly sending car plate carries out identifying and mates, the signal not only transmitted is many, expend time in, server receives this signal and carries out the chronic of identifying processing, and at the scene to this pictorial information process, the data obtaining identifying are transmitted, signal transmission time is short, speed is fast, the user that can be as early as possible obtains information of vehicles under this car plate or out of Memory.
Embodiment 7: there is identical technical scheme with embodiment 1-6 is individual arbitrarily, difference is: remote server has vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, tool model database, vehicle failure intelligent analysis system, the described vehicle information database storage cart trade mark, and the Vehicle Identify Number of vehicle corresponding to this license plate number, owner information, vehicle maintenance record and vehicle service record, and also store vehicle under this license plate number, year money and vehicle configuration information; Described travelling data database purchase is by the OBD data of vehicle corresponding to the Vehicle Identify Number under license plate number or this license plate number and diagnostic trouble code; Described vehicle structure model data library storage by vehicle, year money and vehicle corresponding to vehicle configuration information forms and the explanation of ingredient and 3D modeling figure; Described this license plate number of repair and maintenance flow data library storage or Vehicle-Miles of Travel corresponding to Vehicle Identify Number and failure message, and repair and maintenance process description; Described tool model database purchase needs illustrating and 3D modeling figure of the instrument used for different vehicle breakdown maintenance, described vehicle failure intelligent analysis system, integrate remote server and there is vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, analyze vehicle trouble and determine to maintain flow process.
At remote server, above-mentioned database is set, for the information about vehicle repair and maintenance that intelligent glasses gathers, the data in Relational database can be transferred, and feedback user result, carrying out showing and pointing out in ray machine, loudspeaker etc., is realize intelligent glasses for the intelligentized guarantee of vehicle repair and maintenance, and sets up, perfects the content of this database, the process of each image data of intelligent glasses can be related to, enrich the function of intelligent glasses for vehicle repair and maintenance.
Embodiment 8: the invention still further relates to a kind of method using intelligent glasses to carry out vehicle repair and maintenance, uses intelligent glasses in the automobile repair and maintenance process described in any one in technique scheme for judging the method for vehicle different sound, to comprise the steps:
S1. start intelligent glasses, first enter recognition mode:
By the video data that camera collection comes, whether there is license plate number in autoscan picture, if there is license plate number, identify license plate number; By the license plate number identified, from vehicle information database, obtain Vehicle Identify Number or Direct Recognition goes out Vehicle Identify Number; According to Vehicle Identify Number, obtain in vehicle information database vehicle corresponding to this Vehicle Identify Number, year money, in travelling data database, obtain distance travelled, OBD data and diagnostic trouble code; By vehicle failure intelligent analysis system, needed the maintenance project done by distance travelled determination vehicle; By vehicle failure intelligent analysis system, needed the maintenance items done by OBD data and diagnostic trouble code determination vehicle;
S2. enter operator scheme: user by phonetic entry and gesture, selective system prompting repair and maintenance project;
S3. enter teaching pattern: if the repair and maintenance project that user selects is video teaching, then obtain repair and maintenance flow process video by repair and maintenance flow database, and start to play;
S4. play in repair and maintenance video process and enter operator scheme: user, by phonetic entry and gesture, controls the broadcasting of repair and maintenance flow process video;
S5. teaching pattern is entered: if the repair and maintenance project that user selects is word image teaching, then obtain repair and maintenance flow process by repair and maintenance flow database, if when needing prompting user operation auto parts in repair and maintenance flow process, enter recognition mode;
S6. recognition mode is entered: identify the particular automobile part occurred in picture, and point out the installation site of this part of user, then return teaching pattern;
S7. enter teaching pattern: the 3D model obtaining this part from vehicle structure model database, and be presented at video output system, and the position that operates and method of operating should be carried out with the form of animation prompting user on 3D model;
S8. play in teaching animation process and enter operator scheme: user is by phonetic entry and gesture, and operation 3D model at the moment, comprises rotation, amplifies, reduces, and split, the action of merging, makes the more detailed understanding teaching process of user;
S9 exits teaching and operator scheme: complete operation and teaching, exits.
When intelligent glasses being applied to vehicle repair and maintenance, separating 3 patterns and (identify, operation, teaching), 3 patterns are relied on mutually, support mutually, change mutually, to realize the information acquisition of vehicle repair and maintenance, object that is auxiliary and that certainly realize, and 3 patterns all rely on vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, a series of infosystems such as vehicle failure intelligent analysis system (RDM).And present one and intactly use intelligent glasses to carry out the process of assisting vehicle repair and maintenance.
The above; be only the present invention's preferably embodiment; but protection scope of the present invention is not limited thereto; anyly be familiar with those skilled in the art in the technical scope that the present invention discloses; be equal to according to technical scheme of the present invention and inventive concept thereof and replace or change, all should be encompassed within protection scope of the present invention.
Claims (9)
1. in automobile repair and maintenance process, intelligent glasses, for judging a method for vehicle different sound, is characterized in that, comprises the steps:
S1. glasses pattern is switched to recognition mode by operating personnel, sends phonetic order and carries out sound fault analysis identification;
S2. intelligent glasses microphone array obtains and collected sound signal;
S3. transmission of sound signals is to the voice recognition matching module in intelligent glasses main frame, carry out the noise reduction of sound, Singularity Detection, and the feature extraction of voice signal, Classification and Identification is carried out to the feature extracted, judge sound generic, and fault degree, simultaneously by analysis result information transmission to control module;
S4., after control module receives object information, control vibrational feedback module prompts user, and control image output module display analysis result;
Described intelligent glasses, comprise spectacle-frame (2) and temple (1), it is characterized in that: one of them temple (1) has convolution bending (3), the side of convolution bending (3) connects the first straight plate (4), this the first straight plate (4) is provided with the Trackpad (5) of outside temple (13), the opposite side of this convolution bending (3) connects the second straight plate (14), this the second straight plate (14) upper, lower both sides have the base plate (6) stretched out, the holding part of camera (15) is formed with the second straight plate (14), second straight plate (14) is provided with camera mounting hole, described two base plates (6) are connected with ray machine (7), and this ray machine (7) is positioned at the front of the lens frame (16) more close with it, lens frame is connected to the first straight plate (4) and is arranged at convolution bending (3) more nearby, first straight plate (4) is substantially vertical with the second straight plate (14).
2. in automobile repair and maintenance process as claimed in claim 1 intelligent glasses for judging the method for vehicle different sound, it is characterized in that: install light source in camera (15) holding part and correspond to the light source hole (8) on the second straight plate (14), microphone (11) is arranged on the spectacle-frame (2) inside the first straight plate (4) and circles round and bends near (3) junction; Loudspeaker (12) are installed on the upper position near ear of the temple (1) when wearing intelligent glasses; Camera (15) is supported by camera bracket (9) and is arranged in camera (15) holding part, gyroscope, in order to identify vibration signal, set different vibration signals with to make automobile repair and maintenance intelligent glasses perform respective action.
3. in automobile repair and maintenance process as claimed in claim 2 intelligent glasses for judging the method for vehicle different sound, it is characterized in that: described camera (15), light source, microphone (11) and loudspeaker (12) are connected to control panel (10), this control panel (10) has wireless communication module, for receiving camera (15), light source, the signal that microphone (11) sends, and data processing can be carried out to this Received signal strength, and this control panel (10) is provided with wireless signal transceiver module, and use this signal transmitting and receiving module to send and Received signal strength to remote server.
4. in the automobile repair and maintenance process as described in any one of claim 1-3, intelligent glasses is for judging the method for vehicle different sound, it is characterized in that: control panel (10) comprises image recognition matching module, for the pre-service of image, feature extraction, Classification and Identification; Control module, after inputting information identifications not other, performs corresponding operating and feedback.Image output module, for carrying out image feedback to operator; Dio Output Modules, in order to carry out sound feedback to operator; Vibrational feedback module, in order to carry out vibrational feedback; Server database module, for the retrieval of service end data.
5. in automobile repair and maintenance process as claimed in claim 3 intelligent glasses for judging the method for vehicle different sound, it is characterized in that: control panel (10) goes back connected storage, this control panel (10) is connected with camera (15), light source, microphone (11) and loudspeaker (12) by signal wire, and being integrated in a mainframe box, this control panel (10) synchronously carries out data processing and signal transmitting and receiving.
6. in automobile repair and maintenance process as claimed in claim 4 intelligent glasses for judging the method for vehicle different sound, it is characterized in that: the license plate image that camera (15) gathers, only perform figure identifying processing by control panel (10), obtain this license board information, directly license board information is sent in remote server.
7. in automobile repair and maintenance process as claimed in claim 4 intelligent glasses for judging the method for vehicle different sound, it is characterized in that: remote server has vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, tool model database, vehicle failure intelligent analysis system, the described vehicle information database storage cart trade mark, and the Vehicle Identify Number of vehicle corresponding to this license plate number, owner information, vehicle maintenance record and vehicle service record, and also store vehicle under this license plate number, year money and vehicle configuration information; Described travelling data database purchase is by the OBD data of vehicle corresponding to the Vehicle Identify Number under license plate number or this license plate number and diagnostic trouble code; Described vehicle structure model data library storage by vehicle, year money and vehicle corresponding to vehicle configuration information forms and the explanation of ingredient and 3D modeling figure; Described this license plate number of repair and maintenance flow data library storage or Vehicle-Miles of Travel corresponding to Vehicle Identify Number and failure message, and repair and maintenance process description; Described tool model database purchase needs illustrating and 3D modeling figure of the instrument used for different vehicle breakdown maintenance, described vehicle failure intelligent analysis system, integrate remote server and there is vehicle information database, travelling data database, vehicle structure model database, repair and maintenance flow database, analyze vehicle trouble and determine to maintain flow process.
8. in automobile repair and maintenance process as claimed in claim 7, intelligent glasses, for judging the method for vehicle different sound, realizes a kind of method using intelligent glasses to carry out vehicle repair and maintenance, it is characterized in that, comprise the steps:
S1. start intelligent glasses, first enter recognition mode: whether the video data come by camera collection, occurred license plate number in autoscan picture, if there is license plate number, identify license plate number; By the license plate number identified, from vehicle information database, obtain Vehicle Identify Number or Direct Recognition goes out Vehicle Identify Number; According to Vehicle Identify Number, obtain in vehicle information database vehicle corresponding to this Vehicle Identify Number, year money, in travelling data database, obtain distance travelled, OBD data and diagnostic trouble code; By vehicle failure intelligent analysis system, needed the maintenance project done by distance travelled determination vehicle; By vehicle failure intelligent analysis system, needed the maintenance items done by OBD data and diagnostic trouble code determination vehicle;
S2. enter operator scheme: user by phonetic entry and gesture, selective system prompting repair and maintenance project;
S3. enter teaching pattern: if the repair and maintenance project that user selects is video teaching, then obtain repair and maintenance flow process video by repair and maintenance flow database, and start to play;
S4. play in repair and maintenance video process and enter operator scheme: user, by phonetic entry and gesture, controls the broadcasting of repair and maintenance flow process video;
S5. teaching pattern is entered: if the repair and maintenance project that user selects is word image teaching, then obtain repair and maintenance flow process by repair and maintenance flow database, if when needing prompting user operation auto parts in repair and maintenance flow process, enter recognition mode;
S6. recognition mode is entered: identify the particular automobile part occurred in picture, and point out the installation site of this part of user, then return teaching pattern;
S7. enter teaching pattern: the 3D model obtaining this part from vehicle structure model database, and be presented at video output system, and the position that operates and method of operating should be carried out with the form of animation prompting user on 3D model;
S8. play in teaching animation process and enter operator scheme: user is by phonetic entry and gesture, and operation 3D model at the moment, comprises rotation, amplifies, reduces, and split, the action of merging, makes the more detailed understanding teaching process of user;
S9 exits teaching and operator scheme: complete operation and teaching, exits.
9. as claimed in claim 1 in automobile repair and maintenance process intelligent glasses for judging the method for vehicle different sound, it is characterized in that, when cannot send phonetic order loudly for operating personnel, operating personnel's hand-held intelligent glasses, glasses are placed in sound-generating element side simultaneously, carry out sound fault analysis identification.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510631697.7A CN105353509A (en) | 2015-09-28 | 2015-09-28 | Determination method of abnormal sound of vehicle through adoption of smart glasses in process of vehicle maintenance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510631697.7A CN105353509A (en) | 2015-09-28 | 2015-09-28 | Determination method of abnormal sound of vehicle through adoption of smart glasses in process of vehicle maintenance |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105353509A true CN105353509A (en) | 2016-02-24 |
Family
ID=55329503
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510631697.7A Pending CN105353509A (en) | 2015-09-28 | 2015-09-28 | Determination method of abnormal sound of vehicle through adoption of smart glasses in process of vehicle maintenance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105353509A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5563620A (en) * | 1992-12-21 | 1996-10-08 | Nissan Motor Co., Ltd. | Head up display installation arrangement |
| CN201110799Y (en) * | 2007-07-26 | 2008-09-03 | 长春工业大学 | Strange sound detector of car engine |
| CN101464562A (en) * | 2007-12-19 | 2009-06-24 | 株式会社日立制作所 | Automotive head up display apparatus |
| CN104321684A (en) * | 2012-03-21 | 2015-01-28 | 谷歌公司 | Wearable device with input and output structures |
| CN104880835A (en) * | 2015-05-13 | 2015-09-02 | 浙江吉利控股集团有限公司 | Intelligent glasses |
-
2015
- 2015-09-28 CN CN201510631697.7A patent/CN105353509A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5563620A (en) * | 1992-12-21 | 1996-10-08 | Nissan Motor Co., Ltd. | Head up display installation arrangement |
| CN201110799Y (en) * | 2007-07-26 | 2008-09-03 | 长春工业大学 | Strange sound detector of car engine |
| CN101464562A (en) * | 2007-12-19 | 2009-06-24 | 株式会社日立制作所 | Automotive head up display apparatus |
| CN104321684A (en) * | 2012-03-21 | 2015-01-28 | 谷歌公司 | Wearable device with input and output structures |
| CN104880835A (en) * | 2015-05-13 | 2015-09-02 | 浙江吉利控股集团有限公司 | Intelligent glasses |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105355196A (en) | Speech instruction recognition method for intelligent glasses applied to field of car maintenance | |
| CN105158927A (en) | Method for detaching parts in automobile maintenance process through intelligent glasses | |
| CN105182535B (en) | The method that automobile maintenance is carried out using intelligent glasses | |
| CN105223706A (en) | The method of vehicle degree of injury is judged for the intelligent glasses in vehicle repair and maintenance process | |
| CN105182536A (en) | Method of recognizing vehicle license plate through intelligent glasses and acquiring vehicle information during vehicle maintenance process | |
| CN104011734B (en) | System, the method and apparatus of information are obtained from the object for being attached to vehicle | |
| CN105966405A (en) | Driver distraction detection system | |
| CN105353510A (en) | Application method of smart glasses for automobile long-distance maintenance support | |
| CN205080316U (en) | Smart spectacles | |
| CN104494534A (en) | Vehicle transportation management system and method | |
| CN105223694B (en) | Intelligent glasses are applied to the method for the indoor positioning and image recognition during automobile maintenance | |
| CN105224923A (en) | Intelligent glasses is applied to the method for the division part setting loss grade in repair and maintenance process | |
| CN105184276A (en) | Method of recognizing parts during maintenance process by intelligent glasses | |
| CN105182537A (en) | Method of recognizing liquid leakage during maintenance process by intelligent glasses | |
| CN106686341A (en) | Interactive vehicle-mounted intelligent terminal system and monitoring method | |
| CN105259657B (en) | The means of illumination of intelligent glasses during automobile maintenance | |
| CN105353508A (en) | Detection method of automobile liquid residues through adoption of smart glasses | |
| CN105205471A (en) | Method for checking dead zone in maintenance process of intelligent glasses | |
| CN105158900B (en) | Head pose on automobile maintenance intelligent glasses knows method for distinguishing | |
| WO2018123041A1 (en) | Information processing system and information processing device | |
| CN106570801A (en) | Electronic driving trainer central control system for driving training | |
| CN105158901A (en) | Intelligent glasses used for automobile maintenance | |
| CN105242401A (en) | Method for sharing other equipment data for automobile maintenance through intelligent eyeglasses | |
| CN105353509A (en) | Determination method of abnormal sound of vehicle through adoption of smart glasses in process of vehicle maintenance | |
| CN105204643A (en) | Gesture recognition method for intelligent glasses used in vehicle maintaining process |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160224 |