CN117273693A - Method, device, equipment and storage medium for overhauling vehicle - Google Patents
Method, device, equipment and storage medium for overhauling vehicle Download PDFInfo
- Publication number
- CN117273693A CN117273693A CN202311034864.0A CN202311034864A CN117273693A CN 117273693 A CN117273693 A CN 117273693A CN 202311034864 A CN202311034864 A CN 202311034864A CN 117273693 A CN117273693 A CN 117273693A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- data
- overhaul
- overhauled
- fault
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 118
- 238000004422 calculation algorithm Methods 0.000 claims description 15
- 230000003190 augmentative effect Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 18
- 238000012423 maintenance Methods 0.000 description 57
- 230000008569 process Effects 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 11
- 239000011521 glass Substances 0.000 description 10
- 238000013473 artificial intelligence Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000001514 detection method Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000010224 classification analysis Methods 0.000 description 2
- 238000004140 cleaning Methods 0.000 description 2
- 238000007621 cluster analysis Methods 0.000 description 2
- 238000007418 data mining Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 239000000446 fuel Substances 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000010408 sweeping Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000005299 abrasion Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010219 correlation analysis Methods 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 238000003066 decision tree Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000000611 regression analysis Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/453—Help systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0808—Diagnosing performance data
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Multimedia (AREA)
- Human Resources & Organizations (AREA)
- Operations Research (AREA)
- Economics (AREA)
- Tourism & Hospitality (AREA)
- Strategic Management (AREA)
- Quality & Reliability (AREA)
- Marketing (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application provides a method, a device, equipment and a storage medium for overhauling a vehicle, wherein the method comprises the steps of obtaining overhauling data of a target vehicle through a part carried by AR equipment, and the overhauling data comprise the following steps: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data; analyzing the data to be overhauled, and determining a fault reason causing the fault of the target vehicle; according to the fault reasons, a vehicle overhaul method is provided, and vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method are displayed through a display screen of the AR equipment. The method can achieve the effect of accurately overhauling the vehicle.
Description
Technical Field
The present application relates to the field of intelligent ARs, and in particular, to a method, apparatus, device, and storage medium for vehicle service.
Background
At present, along with the continuous development of artificial intelligence technology, the application of AR intelligent glasses combined with AI technology in various fields is more and more widespread. In the field of vehicle overhaul, the AR intelligent glasses are combined with the application of the AI technology, and the overhaul position can be determined through image identification, so that the overhaul of the vehicle is realized.
However, the image recognition can only recognize a part of the overhauling area, especially the area which is not shot, and the overhauling is difficult to carry out, so that the final overhauling result of the vehicle is not accurate enough.
Therefore, how to accurately carry out the vehicle maintenance is a technical problem to be solved.
Disclosure of Invention
An object of the embodiment of the application is to provide a method for overhauling a vehicle, which can achieve an accurate overhauling effect of the vehicle through the technical scheme of the embodiment of the application.
In a first aspect, an embodiment of the present application provides a method for overhauling a vehicle, which is applied to an augmented reality AR device, and includes, through a component carried by the AR device, acquiring to-be-overhauled data of a target vehicle, where the to-be-overhauled data includes: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data; analyzing the data to be overhauled, and determining a fault reason causing the fault of the target vehicle; according to the fault reasons, a vehicle overhaul method is provided, and vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method are displayed through a display screen of the AR equipment.
In the embodiment, multiple maintenance data of the vehicle can be acquired by combining the AR equipment, multiple fault problems of the vehicle are comprehensively considered, and the fault reasons of the vehicle are analyzed, so that an accurate maintenance method is provided, and the effect of accurately carrying out vehicle maintenance can be achieved through the method.
In some embodiments, obtaining data to be serviced by a target vehicle through a component carried by an AR device includes: shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment, and identifying the plurality of images to obtain data to be overhauled; and/or acquiring voice information of maintenance personnel through a microphone of the AR equipment, and identifying the voice information to obtain data to be maintained; and/or receiving the data to be overhauled sent by the target vehicle through the wireless connection device of the AR equipment.
In the above embodiment, multiple maintenance data of the target vehicle can be obtained through the camera, the microphone and the wireless connection device of the AR equipment, and the fault cause of the target vehicle can be analyzed together through the multi-dimensional maintenance data, so that the effect of final accurate vehicle maintenance is achieved.
In some embodiments, capturing a plurality of images of a target vehicle in real time by a camera of an AR device, identifying the plurality of images, obtaining data to be serviced, includes: shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment; and identifying a plurality of images through an image identification algorithm to obtain data to be overhauled.
In the embodiment, the vehicle overhaul data can be accurately acquired by the image recognition method, and then the effect of final accurate vehicle overhaul can be achieved.
In some embodiments, obtaining the voice information of the service personnel through the microphone of the AR device, identifying the voice information, and obtaining the data to be serviced includes: acquiring voice information of an maintainer through a microphone of the AR equipment; and recognizing voice information through the voice recognition model to obtain data to be overhauled.
In the above-mentioned embodiment of this application, can acquire the maintenance data that the maintainer provided through the speech recognition model, and then can reach the effect of final accurate vehicle maintenance.
In some embodiments, receiving, by a wireless connection device of an AR device, data to be serviced sent by a target vehicle includes: and receiving data to be overhauled, which are sent by the target vehicle and are acquired by the sensor and the vehicle-mounted camera, through a wireless connection device of the AR equipment.
In the embodiment, the data in the vehicle can be acquired through the wireless connection device, so that other vehicle data can be analyzed, and the effect of final and accurate vehicle maintenance can be achieved.
In some embodiments, analyzing the data to be serviced, determining a cause of a fault that results in a fault in the target vehicle includes: comparing the data to be overhauled with the standard data of the target vehicle stored in the history to obtain a comparison result, and determining a fault cause according to the comparison result; and/or detecting the data to be overhauled through a preset algorithm to obtain the fault reason.
In the embodiment, the fault reasons can be analyzed by a comparison method, and the vehicle fault reasons can be detected by an algorithm, so that the effect of multiple detection is achieved, and the effect of final and accurate vehicle maintenance can be achieved.
In some embodiments, according to the cause of the fault, a vehicle maintenance method is provided, and a vehicle maintenance step and a vehicle maintenance video corresponding to the vehicle maintenance method are displayed through a display screen of the AR device, including: shooting a two-dimensional code or license plate number of a target vehicle through a camera of the AR equipment, and acquiring basic information, maintenance guide and expert contact information of the vehicle; according to the fault reasons, acquiring an overhaul method based on basic information, an overhaul guide and expert contact ways; and displaying related icons, overhaul steps and overhaul videos through a display screen.
In the above-mentioned embodiment of this application, can reach convenient maintenance through the mode of sweeping the sign indicating number, finally can be through the relevant icon of display screen display, maintenance step and maintenance video, can reach stepwise maintenance, accurate maintenance.
In a second aspect, embodiments of the present application provide a device for vehicle service, including:
the acquisition module is used for acquiring to-be-overhauled data of the target vehicle through a part carried by the augmented reality AR equipment, wherein the to-be-overhauled data comprises: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data;
the analysis module is used for analyzing the data to be overhauled and determining the fault reason causing the fault of the target vehicle;
and the overhaul module is used for providing a vehicle overhaul method according to the fault reasons and displaying vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method through a display screen of the AR equipment.
Optionally, the acquiring module is specifically configured to:
shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment, and identifying the plurality of images to obtain data to be overhauled;
and/or
Acquiring voice information of maintenance personnel through a microphone of the AR equipment, and recognizing the voice information to obtain data to be maintained;
and/or
And receiving the data to be overhauled sent by the target vehicle through the wireless connection device of the AR equipment.
Optionally, the acquiring module is specifically configured to:
shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment;
and identifying a plurality of images through an image identification algorithm to obtain data to be overhauled.
Optionally, the acquiring module is specifically configured to:
acquiring voice information of an maintainer through a microphone of the AR equipment;
and recognizing voice information through the voice recognition model to obtain data to be overhauled.
Optionally, the acquiring module is specifically configured to:
and receiving data to be overhauled, which are sent by the target vehicle and are acquired by the sensor and the vehicle-mounted camera, through a wireless connection device of the AR equipment.
Optionally, the analysis module is specifically configured to:
comparing the data to be overhauled with the standard data of the target vehicle stored in the history to obtain a comparison result, and determining a fault cause according to the comparison result;
and/or
And detecting the data to be overhauled through a preset algorithm to obtain a fault reason.
Optionally, the overhaul module is specifically configured to:
shooting a two-dimensional code or license plate number of a target vehicle through a camera of the AR equipment, and acquiring basic information, maintenance guide and expert contact information of the vehicle;
according to the fault reasons, acquiring an overhaul method based on basic information, an overhaul guide and expert contact ways;
and displaying related icons, overhaul steps and overhaul videos through a display screen.
In a third aspect, embodiments of the present application provide an electronic device comprising a processor and a memory storing computer readable instructions that, when executed by the processor, perform the steps of the method as provided in the first aspect above.
In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the method as provided in the first aspect above.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the embodiments of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method of vehicle service provided in an embodiment of the present application;
FIG. 2 is a flow chart of a method for implementing vehicle service according to an embodiment of the present application;
FIG. 3 is a schematic block diagram of a device for vehicle service provided in an embodiment of the present application;
fig. 4 is a schematic structural diagram of a device for repairing a vehicle according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. The components of the embodiments of the present application, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, as provided in the accompanying drawings, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, are intended to be within the scope of the present application.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only to distinguish the description, and are not to be construed as indicating or implying relative importance.
The method and the device are applied to the scene that intelligent AR (augmented reality) is combined with AI (artificial intelligence) technology to carry out vehicle overhaul.
At present, along with the continuous development of artificial intelligence technology, the application of AR intelligent glasses combined with AI technology in various fields is more and more widespread. In the field of vehicle overhaul, the AR intelligent glasses are combined with the application of the AI technology, and the overhaul position can be determined through image identification, so that the overhaul of the vehicle is realized. However, the image recognition can only recognize a part of the overhauling area, especially the area which is not shot, and the overhauling is difficult to carry out, so that the final overhauling result of the vehicle is not accurate enough.
For this purpose, the application obtains the data to be overhauled of target vehicle through the part that AR equipment carried, and wherein, wait to overhaul data includes: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data; analyzing the data to be overhauled, and determining a fault reason causing the fault of the target vehicle; according to the fault reasons, a vehicle overhaul method is provided, and vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method are displayed through a display screen of the AR equipment. The method can be combined with the AR equipment to acquire a plurality of pieces of overhaul data of the vehicle, comprehensively consider a plurality of fault problems of the vehicle, analyze the fault reasons of the vehicle, and further provide an accurate overhaul method, and can achieve an accurate overhaul effect of the vehicle.
In this embodiment of the present application, the execution body may be a vehicle maintenance device in a vehicle maintenance system, and in practical application, the vehicle maintenance device may be electronic devices such as a terminal device and a server, which is not limited herein.
A method of vehicle service according to an embodiment of the present application is described in detail below with reference to fig. 1.
Referring to fig. 1, fig. 1 is a flowchart of a method for repairing a vehicle, which is applied to an augmented reality AR device, according to an embodiment of the present application, where the method for repairing a vehicle shown in fig. 1 includes:
step 110: and acquiring the data to be overhauled of the target vehicle through the components carried by the AR equipment.
Wherein, wait to overhaul data includes: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle fault data. The AR device may be an AR device or a helmet, etc. The vehicle operation data includes various parameters of speed, temperature, fuel consumption, voltage, current, mileage, fault code, etc. of the vehicle. The vehicle component data includes component status, operating status, and the like. The vehicle history service data includes basic information of the vehicle (such as license plate number, vehicle type, vehicle age, etc.), service records (such as service time, service personnel, service contents, service results, etc.), vehicle images (such as vehicle appearance, internal structure, component status, etc.), etc. Vehicle fault data includes fault records (e.g., fault time, fault type, fault cause, fault handling, etc.), vehicle data (e.g., speed, temperature, fuel consumption, voltage, current, mileage, fault code, etc.).
In one embodiment, the acquired overhaul data can be further processed, including data cleaning can be performed on vehicle overhaul and fault data, invalid or erroneous data can be removed, and accuracy of the data can be improved. The data statistics can be carried out on the vehicle overhaul and fault data, and various indexes and proportions, such as the overhaul rate, the fault rate, the average overhaul time, the average fault time and the like of the vehicle are calculated to reflect the running condition and the fault condition of the vehicle. The vehicle maintenance and fault data can be visualized, and distribution and change of the data, such as the maintenance times, the fault times, the maintenance cost, the fault cost and the like of the vehicle can be intuitively displayed by using modes such as charts or images. Data mining may be performed on the vehicle service and fault data, and hidden patterns or relationships in the data, such as correlations between service and fault of the vehicle, clusters between type of vehicle and fault, classifications between status of vehicle and fault, etc., may be found using algorithms or methods, such as correlation analysis, cluster analysis, classification analysis, etc. The vehicle service and fault data may be data modeled, and prediction or reasoning capabilities of the data may be established using models or frameworks, such as regression models, neural network models, decision tree models, etc., such as predicting future service or fault conditions of the vehicle based on historical data of the vehicle, inferring possible service or fault causes of the vehicle based on current data of the vehicle, etc.
In some embodiments of the present application, obtaining, by a component carried by an AR device, data to be overhauled of a target vehicle includes: shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment, and identifying the plurality of images to obtain data to be overhauled; and/or acquiring voice information of maintenance personnel through a microphone of the AR equipment, and identifying the voice information to obtain data to be maintained; and/or receiving the data to be overhauled sent by the target vehicle through the wireless connection device of the AR equipment.
According to the method and the device, in the process, multiple maintenance data of the target vehicle can be obtained through the camera, the microphone and the wireless connection device of the AR equipment, and the fault reasons of the target vehicle can be analyzed through the multidimensional maintenance data together, so that the effect of final accurate vehicle maintenance is achieved.
The plurality of images of the target vehicle may be an appearance image, an interior component image, a malfunction-indicator lamp image, or the like. The voice information comprises the voice input by the overhauling personnel through overhauling, and comprises various fault data, fault reasons, fault positions and other information. The wireless connection device may be a wireless network connection device or a wireless bluetooth connection device, etc.
In some embodiments of the present application, capturing, in real time, a plurality of images of a target vehicle by a camera of an AR device, identifying the plurality of images, and obtaining data to be overhauled includes: shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment; and identifying a plurality of images through an image identification algorithm to obtain data to be overhauled.
In the process, the vehicle overhaul data can be accurately acquired through the image recognition method, and then the effect of final accurate vehicle overhaul can be achieved.
The AR equipment can capture real-time images of the vehicle through the camera, compare the real-time images with models and data of the vehicle, identify various parts and states of the vehicle, display structures and parameters of the vehicle on the glasses through an augmented reality technology, and help technicians to quickly locate fault points.
In some embodiments of the present application, obtaining, through a microphone of an AR device, voice information of an inspection staff, identifying the voice information, obtaining data to be inspected, including: acquiring voice information of an maintainer through a microphone of the AR equipment; and recognizing voice information through the voice recognition model to obtain data to be overhauled.
According to the vehicle maintenance system and method, in the process, maintenance data provided by maintenance personnel can be obtained through the voice recognition model, and then the effect of final accurate vehicle maintenance can be achieved.
The voice recognition is to convert voice instructions sent by technicians into text information through technologies such as voice enhancement, voice wakeup, voice recognition, semantic understanding and the like, and interact with a vehicle overhaul guiding system so as to obtain corresponding fault point positioning, fault type judgment, overhaul method, steps and other guiding information. The AR equipment can analyze and diagnose the fault point through the AI technology, deduce possible reasons and types of the fault according to the historical data of the vehicle, the fault library, expert knowledge and other information, and display corresponding prompts and suggestions on the glasses so as to help technicians accurately judge the fault types.
In some embodiments of the present application, receiving, by a wireless connection device of an AR apparatus, data to be overhauled sent by a target vehicle includes: and receiving data to be overhauled, which are sent by the target vehicle and are acquired by the sensor and the vehicle-mounted camera, through a wireless connection device of the AR equipment.
According to the vehicle data acquisition method and device, in the process, the data in the vehicle can be acquired through the wireless connection device, and then other vehicle data can be analyzed, so that the effect of final accurate vehicle maintenance can be achieved.
Step 120: and analyzing the data to be overhauled, and determining the fault reason causing the fault of the target vehicle.
For the vehicle related data, some statistical methods or machine learning algorithms may be used to analyze and process, such as regression analysis, classification analysis, cluster analysis, anomaly detection, etc., to find information such as rules, trends, anomalies, etc., in the data, so as to provide basis for fault diagnosis and prediction.
In some embodiments of the present application, analyzing data to be serviced, determining a cause of a fault that results in a fault in a target vehicle includes: comparing the data to be overhauled with the standard data of the target vehicle stored in the history to obtain a comparison result, and determining a fault cause according to the comparison result; and/or detecting the data to be overhauled through a preset algorithm to obtain the fault reason.
In the process, the fault reasons can be analyzed by a comparison method, and the vehicle fault reasons can be detected by an algorithm, so that the effect of multiple detection is achieved, and the effect of final and accurate vehicle maintenance can be achieved.
The standard data may be some data of normal vehicle components, including information such as operation data, component data, and the like. For vehicle images, some pattern recognition or computer vision techniques may be used to identify, for example, target detection, target tracking, target classification, target recognition, etc., to detect targets such as vehicles or license plates in the images, track the motion trajectories of the targets, classify the types or states of the targets, identify specific information of the targets, etc. The basis for diagnosis and prediction is to use some reasoning or decision technology to analyze and judge faults and predict and prevent faults according to the characteristics and information extracted from vehicle data and images and by combining the historical data, fault library, expert knowledge and other information of the vehicle. For example, if a certain parameter is displayed in the vehicle data to exceed a normal range, or a certain component is detected to be obviously damaged or deformed in the image, the vehicle is judged to have a fault, and the corresponding fault type and cause are given. If the vehicle data shows that a certain parameter has abnormal fluctuation or trend, or a certain component has slight abrasion or crack detected in the image, the possible failure of the vehicle can be predicted, and the corresponding failure probability and risk level are given.
Step 130: according to the fault reasons, a vehicle overhaul method is provided, and vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method are displayed through a display screen of the AR equipment.
The overhaul method comprises specific operation and technical selection of various steps such as fault data source, data cleaning, data statistics, data visualization, data mining, data modeling and the like, and the purpose and meaning of analysis and processing, possible problems, improvement direction and the like. The result is the output and presentation of analysis and processing of vehicle service and fault data, including the specification and scale of the data, graphs or images of the data, patterns or relationships of the data, predictions or inferences of the data, and suggestions and comments to the vehicle manager.
In some embodiments of the present application, according to a cause of a fault, a vehicle overhaul method is provided, and a vehicle overhaul step and a vehicle overhaul video corresponding to the vehicle overhaul method are displayed through a display screen of an AR device, including: shooting a two-dimensional code or license plate number of a target vehicle through a camera of the AR equipment, and acquiring basic information, maintenance guide and expert contact information of the vehicle; according to the fault reasons, acquiring an overhaul method based on basic information, an overhaul guide and expert contact ways; and displaying related icons, overhaul steps and overhaul videos through a display screen.
The application can reach convenient maintenance through the mode of sweeping the sign indicating number in above-mentioned in-process, finally can reach stepwise maintenance, accurate maintenance through the relevant icon of display screen display, maintenance step and maintenance video.
The two-dimensional code or license plate number of the target vehicle is shot through the camera of the AR equipment, basic information, overhaul guide and expert contact information of the vehicle are obtained, the basic information, overhaul guide and expert contact information of the vehicle carried by the radiation signals can be obtained through scanning the electronic two-dimensional code of the vehicle, or the license plate number can be scanned and identified, and the basic information, overhaul guide and expert contact information of the corresponding vehicle are matched from the database. For example, before overhaul, a technician scans a two-dimensional code or license plate number of the vehicle through the AR intelligent glasses to acquire basic information and overhaul guide of the vehicle and contact information of a remote expert. In the overhaul process, if a technician encounters a difficult or uncertain problem, a remote assistance request can be initiated through the AR intelligent glasses, and video call connection is established with a remote expert. The technical staff can display real-time images and sounds of the vehicle and voice descriptions and problems of the technical staff to a remote expert through a camera and a microphone of the AR intelligent glasses, and the remote expert can receive and watch the real-time images and sounds of the vehicle and the voice descriptions and problems of the remote expert through equipment such as a computer or a mobile phone. The remote expert analyzes and judges according to the information provided by the technician, gives guidance and advice through voice or characters, and can display relevant augmented reality elements such as icons, arrows, characters and the like in the field of view of the technician through the AR intelligent glasses so as to help the technician locate fault points, select maintenance methods, operate maintenance steps and the like. And the technical staff carries out maintenance operation according to the guidance and the suggestion of the remote expert, timely feeds back maintenance results, and communicates and confirms with the remote expert until the problem of vehicle failure is solved.
In the process shown in fig. 1, the method obtains to-be-overhauled data of a target vehicle through a component carried by the AR device, where the to-be-overhauled data includes: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data; analyzing the data to be overhauled, and determining a fault reason causing the fault of the target vehicle; according to the fault reasons, a vehicle overhaul method is provided, and vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method are displayed through a display screen of the AR equipment. The method can be combined with the AR equipment to acquire a plurality of pieces of overhaul data of the vehicle, comprehensively consider a plurality of fault problems of the vehicle, analyze the fault reasons of the vehicle, and further provide an accurate overhaul method, and can achieve an accurate overhaul effect of the vehicle.
A method for implementing the vehicle service according to the embodiment of the present application will be described in detail with reference to fig. 2.
Referring to fig. 2, fig. 2 is a flowchart of a method for implementing vehicle maintenance provided in an embodiment of the present application, where the method for implementing vehicle maintenance shown in fig. 2 is applied to an augmented reality AR device, and includes:
step 210: and acquiring the data to be overhauled of the target vehicle.
Specific: shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment, and identifying the plurality of images to obtain data to be overhauled; and/or acquiring voice information of maintenance personnel through a microphone of the AR equipment, and identifying the voice information to obtain data to be maintained; and/or receiving the data to be overhauled sent by the target vehicle through the wireless connection device of the AR equipment.
Step 220: and analyzing the data to be overhauled, and determining the fault reason.
Specific: comparing the data to be overhauled with the standard data of the target vehicle stored in the history to obtain a comparison result, and determining a fault cause according to the comparison result; and/or detecting the data to be overhauled through a preset algorithm to obtain the fault reason.
Step 230: according to the fault reasons, a vehicle maintenance method is provided.
Specific: shooting a two-dimensional code or license plate number of a target vehicle through a camera of the AR equipment, and acquiring basic information, maintenance guide and expert contact information of the vehicle; according to the fault reasons, acquiring an overhaul method based on basic information, an overhaul guide and expert contact ways; and displaying related icons, overhaul steps and overhaul videos through a display screen.
In addition, the specific method and steps shown in fig. 2 may refer to the method shown in fig. 1, and will not be described in detail herein.
The method of vehicle service is described above by means of fig. 1, and the apparatus for vehicle service is described below in connection with fig. 3-4.
Referring to fig. 3, a schematic block diagram of an apparatus 300 for repairing a vehicle according to an embodiment of the present application is provided, where the apparatus 300 may be a module, a program segment, or a code on an electronic device. The apparatus 300 corresponds to the embodiment of the method of fig. 1 described above, and is capable of performing the steps involved in the embodiment of the method of fig. 1. Specific functions of the apparatus 300 will be described below, and detailed descriptions thereof will be omitted herein as appropriate to avoid redundancy.
Optionally, the apparatus 300 includes:
the obtaining module 310 is configured to obtain, through a component carried by the augmented reality AR device, data to be overhauled of the target vehicle, where the data to be overhauled includes: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data;
the analysis module 320 is configured to analyze the data to be overhauled, and determine a fault reason that causes the fault of the target vehicle;
and the overhaul module 330 is used for providing a vehicle overhaul method according to the fault reasons and displaying vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method through a display screen of the AR equipment.
Optionally, the acquiring module is specifically configured to:
shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment, and identifying the plurality of images to obtain data to be overhauled; and/or acquiring voice information of maintenance personnel through a microphone of the AR equipment, and identifying the voice information to obtain data to be maintained; and/or receiving the data to be overhauled sent by the target vehicle through the wireless connection device of the AR equipment.
Optionally, the acquiring module is specifically configured to:
shooting a plurality of images of a target vehicle in real time through a camera of the AR equipment; and identifying a plurality of images through an image identification algorithm to obtain data to be overhauled.
Optionally, the acquiring module is specifically configured to:
acquiring voice information of an maintainer through a microphone of the AR equipment; and recognizing voice information through the voice recognition model to obtain data to be overhauled.
Optionally, the acquiring module is specifically configured to:
and receiving data to be overhauled, which are sent by the target vehicle and are acquired by the sensor and the vehicle-mounted camera, through a wireless connection device of the AR equipment.
Optionally, the analysis module is specifically configured to:
comparing the data to be overhauled with the standard data of the target vehicle stored in the history to obtain a comparison result, and determining a fault cause according to the comparison result; and/or detecting the data to be overhauled through a preset algorithm to obtain the fault reason.
Optionally, the overhaul module is specifically configured to:
shooting a two-dimensional code or license plate number of a target vehicle through a camera of the AR equipment, and acquiring basic information, maintenance guide and expert contact information of the vehicle; according to the fault reasons, acquiring an overhaul method based on basic information, an overhaul guide and expert contact ways; and displaying related icons, overhaul steps and overhaul videos through a display screen.
Referring to fig. 4, a schematic block diagram of a device for repairing a vehicle according to an embodiment of the present application may include a memory 410 and a processor 420. Optionally, the apparatus may further include: a communication interface 430 and a communication bus 440. The apparatus corresponds to the embodiment of the method of fig. 1 described above, and is capable of performing the steps involved in the embodiment of the method of fig. 1, and specific functions of the apparatus may be found in the following description.
In particular, the memory 410 is used to store computer readable instructions.
The processor 420, which processes the readable instructions stored in the memory, is capable of performing the various steps in the method of fig. 1.
Communication interface 430 is used for signaling or data communication with other node devices. For example: for communication with a server or terminal, or with other device nodes, the embodiments of the application are not limited in this regard.
A communication bus 440 for enabling direct connection communication of the above-described components.
The communication interface 430 of the device in the embodiment of the present application is used for performing signaling or data communication with other node devices. The memory 410 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. Memory 410 may also optionally be at least one storage device located remotely from the aforementioned processor. The memory 410 has stored therein computer readable instructions which, when executed by the processor 420, perform the method process described above in fig. 1. Processor 420 may be used on apparatus 300 and to perform the functions herein. By way of example, the processor 420 described above may be a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, and the embodiments are not limited in this regard.
Embodiments of the present application also provide a readable storage medium, which when executed by a processor, performs a method process performed by an electronic device in the method embodiment shown in fig. 1.
It will be clear to those skilled in the art that, for convenience and brevity of description, reference may be made to the corresponding procedure in the foregoing method for the specific working procedure of the apparatus described above, and this will not be repeated here.
In summary, the embodiments of the present application provide a method, an apparatus, a device, and a storage medium for repairing a vehicle, where the method includes obtaining, by means of a component carried by an AR device, data to be repaired of a target vehicle, where the data to be repaired includes: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data; analyzing the data to be overhauled, and determining a fault reason causing the fault of the target vehicle; according to the fault reasons, a vehicle overhaul method is provided, and vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method are displayed through a display screen of the AR equipment. The method can achieve the effect of accurately overhauling the vehicle.
In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners as well. The apparatus embodiments described above are merely illustrative, for example, flow diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present application may be integrated together to form a single part, or each module may exist alone, or two or more modules may be integrated to form a single part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely exemplary embodiments of the present application and is not intended to limit the scope of the present application, and various modifications and variations may be suggested to one skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application. It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.
The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A method of vehicle service, applied to an augmented reality AR device, comprising:
obtaining to-be-overhauled data of a target vehicle through a component carried by the AR equipment, wherein the to-be-overhauled data comprises: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data;
analyzing the data to be overhauled, and determining a fault reason causing the fault of the target vehicle;
according to the fault reasons, a vehicle overhaul method is provided, and vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method are displayed through a display screen of the AR equipment.
2. The method of claim 1, wherein the obtaining, by the component carried by the AR device, data to be serviced by the target vehicle comprises:
shooting a plurality of images of the target vehicle in real time through a camera of the AR equipment, and identifying the plurality of images to obtain the data to be overhauled;
and/or
Acquiring voice information of an overhauling personnel through a microphone of the AR equipment, and identifying the voice information to obtain the data to be overhauled;
and/or
And receiving the data to be overhauled sent by the target vehicle through a wireless connection device of the AR equipment.
3. The method of claim 2, wherein capturing a plurality of images of the target vehicle in real time by a camera of the AR device, identifying a plurality of images, and obtaining the data to be overhauled comprises:
capturing a plurality of images of the target vehicle in real time by the camera of the AR device;
and identifying the plurality of images through an image identification algorithm to obtain the data to be overhauled.
4. The method according to claim 2, wherein the obtaining the voice information of the service personnel through the microphone of the AR device, and identifying the voice information, and obtaining the data to be serviced, includes:
acquiring voice information of an maintainer through the microphone of the AR equipment;
and recognizing the voice information through a voice recognition model to obtain the data to be overhauled.
5. The method of claim 2, wherein the receiving, by the wireless connection device of the AR device, the data to be serviced sent by the target vehicle comprises:
and receiving the data to be overhauled, which are sent by the target vehicle and are acquired by a sensor and a vehicle-mounted camera, through the wireless connection device of the AR equipment.
6. The method of claim 5, wherein analyzing the data to be serviced, determining a cause of the failure that caused the failure of the target vehicle, comprises:
comparing the data to be overhauled with the historically stored standard data of the target vehicle to obtain a comparison result, and determining the fault cause according to the comparison result;
and/or
And detecting the data to be overhauled through a preset algorithm to obtain the fault reason.
7. The method according to any one of claims 1 to 6, wherein providing a vehicle service method according to the failure cause, and displaying a vehicle service step and a vehicle service video corresponding to the vehicle service method through a display screen of the AR device, includes:
shooting a two-dimensional code or a license plate number of the target vehicle through a camera of the AR equipment, and acquiring basic information, an overhaul guide and an expert contact way of the vehicle;
according to the fault reasons, acquiring the overhaul method based on the basic information, the overhaul guide and the expert contact way;
and displaying related icons, the overhaul step and the overhaul video through the display screen.
8. A vehicle service apparatus, comprising:
the acquisition module is used for acquiring to-be-overhauled data of the target vehicle through a part carried by the augmented reality AR equipment, wherein the to-be-overhauled data comprises: at least one of vehicle operation data, vehicle component data, vehicle history service data, and vehicle failure data;
the analysis module is used for analyzing the data to be overhauled and determining a fault reason for causing the fault of the target vehicle;
and the overhaul module is used for providing a vehicle overhaul method according to the fault cause and displaying vehicle overhaul steps and vehicle overhaul videos corresponding to the vehicle overhaul method through a display screen of the AR equipment.
9. An electronic device, comprising:
a memory and a processor, the memory storing computer readable instructions that, when executed by the processor, perform the steps in the method of any of claims 1-7.
10. A computer-readable storage medium, comprising:
computer program which, when run on a computer, causes the computer to perform the method according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311034864.0A CN117273693A (en) | 2023-08-16 | 2023-08-16 | Method, device, equipment and storage medium for overhauling vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311034864.0A CN117273693A (en) | 2023-08-16 | 2023-08-16 | Method, device, equipment and storage medium for overhauling vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117273693A true CN117273693A (en) | 2023-12-22 |
Family
ID=89209424
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311034864.0A Pending CN117273693A (en) | 2023-08-16 | 2023-08-16 | Method, device, equipment and storage medium for overhauling vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117273693A (en) |
-
2023
- 2023-08-16 CN CN202311034864.0A patent/CN117273693A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7017363B2 (en) | Anomaly detection device and anomaly detection method | |
| JP7048499B2 (en) | Semi-automatic labeling of datasets | |
| US20210081698A1 (en) | Systems and methods for physical object analysis | |
| EP2776815B1 (en) | System and method for improving automated defect detection user interface | |
| JP5016519B2 (en) | Diagnostic system and method for predictive condition monitoring | |
| CN110264444B (en) | Damage detection method and device based on weak segmentation | |
| US20200402221A1 (en) | Inspection system, image discrimination system, discrimination system, discriminator generation system, and learning data generation device | |
| KR102383139B1 (en) | Industrial facility failure prediction diagnosis data learning labeling system and method based on artificial intelligence | |
| CN110458794B (en) | Quality detection method and device for accessories of rail train | |
| CN108921840A (en) | Display screen peripheral circuit detection method, device, electronic equipment and storage medium | |
| CN113361539A (en) | Instrument reading method and device of underground inspection robot and electronic equipment | |
| US20230221684A1 (en) | Explaining Machine Learning Output in Industrial Applications | |
| CN116701992A (en) | Multi-mode anomaly detection method based on graph attention network and time convolution network | |
| US20240087105A1 (en) | Systems and Methods for Paint Defect Detection Using Machine Learning | |
| CN112085281B (en) | Method and device for detecting safety of business prediction model | |
| EP3748450A1 (en) | Data driven machine learning for modeling aircraft sensors | |
| JP5137805B2 (en) | Inspection system, control method therefor, and computer program | |
| US20230260259A1 (en) | Method and device for training a neural network | |
| CN117273693A (en) | Method, device, equipment and storage medium for overhauling vehicle | |
| CN113850773A (en) | Detection method, device, equipment and computer readable storage medium | |
| CN108760739B (en) | System and method for detecting rust state of civil air defense door | |
| Tronchin et al. | Explainable ai for car crash detection using multivariate time series | |
| KR102470520B1 (en) | Failure Mode and Effect Analysis(FMEA) Method | |
| CN117253176B (en) | Safe production Al intelligent detection method based on video analysis and computer vision | |
| CN111160454B (en) | Quick change signal detection method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |