CN109817056B - Driving behavior data acquisition device and evaluation device based on vehicle driving - Google Patents
Driving behavior data acquisition device and evaluation device based on vehicle driving Download PDFInfo
- Publication number
- CN109817056B CN109817056B CN201910089786.1A CN201910089786A CN109817056B CN 109817056 B CN109817056 B CN 109817056B CN 201910089786 A CN201910089786 A CN 201910089786A CN 109817056 B CN109817056 B CN 109817056B
- Authority
- CN
- China
- Prior art keywords
- data
- pressure
- driving behavior
- foot
- driving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000011156 evaluation Methods 0.000 title claims abstract description 35
- 230000001133 acceleration Effects 0.000 claims abstract description 84
- 238000004891 communication Methods 0.000 claims abstract description 38
- 230000006399 behavior Effects 0.000 claims description 75
- 238000012545 processing Methods 0.000 claims description 19
- 230000014509 gene expression Effects 0.000 claims description 18
- 230000008921 facial expression Effects 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 13
- 239000011159 matrix material Substances 0.000 claims description 11
- 230000033001 locomotion Effects 0.000 claims description 10
- 238000012360 testing method Methods 0.000 claims description 9
- 238000003384 imaging method Methods 0.000 claims description 4
- 210000002683 foot Anatomy 0.000 description 40
- 238000012549 training Methods 0.000 description 24
- 238000004458 analytical method Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 9
- 238000000034 method Methods 0.000 description 8
- 238000004088 simulation Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 210000003371 toe Anatomy 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 210000003423 ankle Anatomy 0.000 description 1
- 238000009530 blood pressure measurement Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000000881 depressing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 210000004744 fore-foot Anatomy 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention provides a driving behavior data acquisition device and an evaluation device based on vehicle driving, wherein the data acquisition device comprises: the pressure acquisition pad is distributed with at least one pressure sensor and is used for acquiring the pressure of at least one position of the sole of the tested foot; an acceleration sensor for sensing an acceleration of the subject foot; a wireless communication module for performing wireless communication; the first processor is connected with the pressure acquisition pad, the acceleration sensor and the wireless communication module and used for receiving data from the pressure acquisition pad and the acceleration sensor and transmitting the data to an external device through the wireless communication module.
Description
Technical Field
The invention relates to the technical field of human body parameter detection, in particular to a driving behavior data acquisition device and an evaluation device based on vehicle driving.
Background
The simulated driving system refers to a simulated driving environment built in a simulated driving cab, and as shown in fig. 1, the simulated driving system comprises a driving scene simulator, a fully-enclosed display screen 2 which is arranged right ahead and is used for simulating a driving scene and the environment of the driving cab, and further comprises an operation table 3 of a simulated automobile, a steering wheel 6, an accelerator pedal 4, a brake pedal 5, a clutch pedal 8 (a manual transmission type), a left foot rest pedal 9, a gear shifting device and the like, wherein the simulation scenes are similar to real vehicles. Still be provided with 3 scene cameras 1, 7, 10 in the simulation driver's cabin, shoot respectively and record vehicle the place ahead, the rear and driver, wherein the camera 1, 7 for shooing vehicle the place ahead, the rear can shoot the driving scene of vehicle, and the camera 10 for shooing driver's position can shoot driver's facial expression to can analyze driver's reaction, produce corresponding interactive scene based on driver's reaction. In addition, a sensor installed on the operating device is further arranged in the simulation cab and used for collecting the automobile driving operation of the driver. A virtual driving training environment can be created by combining the simulated driver with a virtual reality simulation technology, and people interact with the virtual environment through an operation part of the simulated driver so as to carry out driving training.
Although the existing simulation driver can simulate a training scene and carry out driving training through interaction with a driver, the existing simulation driver cannot find out the root cause of the driving problem of the driver accurately and quickly only through judging the facial expression of the user and operating the operation of the control sensor, and cannot better analyze the influence of the behavior and the psychology of the driver on the driving training, so that the training and the correction are difficult to carry out in a more targeted manner.
Therefore, how to improve the evaluation precision of the driving behavior of the simulated driving training and improve the training effect is a problem to be solved.
Disclosure of Invention
In view of this, the present invention provides a driving behavior data collecting device and an evaluation device based on vehicle driving, so as to solve at least one of the drawbacks in the prior art.
The technical scheme adopted by the invention is as follows:
in one aspect, the present invention provides a driving behavior data collecting apparatus based on vehicle driving, the apparatus including:
the pressure acquisition pad is distributed with at least one pressure sensor and is used for acquiring the pressure of at least one position of the sole of the tested foot;
an acceleration sensor for sensing an acceleration of the subject foot;
a wireless communication module for performing wireless communication;
the first processor is connected with the pressure acquisition pad, the acceleration sensor and the wireless communication module and used for receiving data from the pressure acquisition pad and the acceleration sensor and transmitting the data to an external device through the wireless communication module.
Preferably, the apparatus further comprises: a first imaging device for imaging a face image of a subject; the first processor is further configured to identify a facial expression based on the image of the subject's face to generate an expression event tag if a specific expression is identified.
Preferably, the apparatus further comprises: the second camera device is used for shooting the vehicle environment video; the first processor is further configured to identify a vehicle driving scene based on the vehicle environment video to generate a scene event tag if a specific driving scene is identified.
Preferably, the acceleration sensor is a three-axis acceleration sensor; the pressure acquisition pad is the matrix pressure acquisition pad that arranges a plurality of pressure sensor for detect the pressure of the different positions of the sole of being tried.
Preferably, the first processor is further configured to generate a trial-run event tag upon detecting that the rate of change of the acceleration reaches a predetermined value.
In another aspect, the present invention provides a driving behavior evaluation device based on driving of a vehicle, the device including:
the wireless communication module is used for receiving plantar pressure data and foot acceleration data from a driving behavior data acquisition device based on vehicle driving through wireless communication; and
and an evaluation processing unit which generates a foot pressure heat map based on the foot pressure data and determines a subject driving behavior based on the foot pressure data and the foot acceleration data according to a predetermined driving behavior determination model.
Preferably, the evaluation processing unit further receives the image data of the face to be tested from the driving behavior data acquisition device and the expression event label based on the specific expression through the wireless communication module.
Preferably, the sole pressure data is the pressure data of different positions measured by a matrix type pressure acquisition pad with a plurality of pressure sensors from the sole of the foot.
Preferably, the evaluation processing unit further receives a trial movement event tag and/or a scene event tag from the driving behavior data acquisition device through the wireless communication module.
Preferably, the evaluation processing unit determines a driving behavior element weight based on the received event label, and performs the evaluation of the driving behavior under test based on the driving behavior element weight.
The invention can collect the acceleration sensor data representing the foot acceleration and the pressure sensor data representing the sole pressure, and more accurately analyze the driver behavior based on the collected data.
Furthermore, the embodiment of the invention can also collect facial expression data and generate the event label under the specific expression so as to analyze the influence of the driver psychology on the driving behavior based on the event label, thereby carrying out targeted training and correction.
Further, for the data of the acceleration sensor, an event label may also be generated when the acceleration rate is greater than a predetermined threshold, so as to facilitate analysis of each behavior data (such as sole pressure, facial expression, and foot motions of the acceleration sensor to the driver) of the driver at a time point corresponding to the event label, thereby finding out a root cause of the driving problem of the driver and improving the training effect.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
It will be appreciated by those skilled in the art that the objects and advantages that can be achieved with the present invention are not limited to the specific details set forth above, and that these and other objects that can be achieved with the present invention will be more clearly understood from the detailed description that follows.
Drawings
FIG. 1 is a schematic diagram of a prior art simulated driving system;
FIG. 2 is a block diagram of a driving behavior data collection device according to an embodiment of the present disclosure;
FIG. 3 is a schematic block diagram of a driving behavior data collection device according to another embodiment of the present invention;
fig. 4 is a schematic view of a pressure collection region of a plantar pressure collection device in an embodiment of the present invention;
FIG. 5 is a schematic view of a pressure collection insole of a plantar pressure collection device according to an embodiment of the present invention;
fig. 6 is a display state diagram of the plantar pressure acquisition device when the plantar pressure acquisition device is not connected to an upper computer in one embodiment of the present invention;
fig. 7 is a display state diagram of the plantar pressure acquisition device connected to the upper computer in one embodiment of the present invention;
fig. 8 to 9 are schematic views of a plantar pressure collecting device connected to an upper computer and under different stress states in an embodiment of the present invention.
Detailed Description
Preferred embodiments of the present invention will be described in detail below. Examples of these preferred embodiments are illustrated in the accompanying drawings. The embodiments of the present invention shown in the drawings and described according to the drawings are merely exemplary, and the technical spirit of the present invention and the main operation thereof are not limited to these embodiments.
It should be noted that, in order to avoid obscuring the present invention with unnecessary details, only the structures and/or processing steps closely related to the scheme according to the present invention are shown in the drawings, and other details not so relevant to the present invention are omitted.
It should be emphasized that the term "comprises/comprising" when used herein, is taken to specify the presence of stated features, elements, steps or components, but does not preclude the presence or addition of one or more other features, elements, steps or components.
It is also noted herein that the term "coupled," if not specifically stated, may refer herein to not only a direct connection, but also an indirect connection in which an intermediate is present.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the drawings, the same reference numerals denote the same or similar parts, or the same or similar steps.
In the existing application of the simulated driving system, no one uses acceleration data caused by foot motions for more accurate analysis of simulated driving behaviors of a simulated driver (a subject, referred to as a test), no one relates the simulated driving behaviors of the simulated driver to psychological factors of the simulated driver, and no one uses plantar pressure analysis for improper driving behaviors of the driver. That is, the prior art does not use factors such as plantar pressure, foot acceleration, and/or the subject's psychology for testing, evaluation, or training of the subject's driving behavior. Therefore, in the embodiment of the invention, the acceleration data of the acceleration sensor and the pressure data of the sole of the tested person, which embody the foot of the user, are collected and are applied to the evaluation and analysis of the driving behavior of the user, so that the factors influencing the driving behavior of the user can be more accurately analyzed, the training can be more specifically carried out, and the training effect is improved. Furthermore, psychological factors of the testee are considered to find out the driving behavior problem caused by the psychological factors.
Fig. 2 is a block diagram of a driving behavior data acquisition device according to an embodiment of the present invention. As shown in fig. 2, the data acquisition includes: pressure acquisition pad 110, acceleration sensor 120, wireless communication module 130, and processor 100. Wherein, the pressure acquisition pad 110 is distributed with at least one pressure sensor for acquiring the pressure of at least one position of the sole of the tested foot; the acceleration sensor 120 is used for sensing the acceleration of the tested foot; the wireless communication module 130 is used for wireless communication with an external device; the processor 100 is connected to the pressure collection pad 110, the acceleration sensor 120 and the wireless communication module 130, and is used for receiving data from the pressure collection pad and the acceleration sensor and transmitting the data to an external device through the wireless communication module.
In one embodiment of the present invention, the pressure collection pad 110 may be a plantar pressure collection insole. In the example shown in fig. 5, the sole pressure collection insole is a matrix pressure collection insole, the matrix pressure collection insole refers to a plurality of pressure sensors arranged on the insole and used for collecting pressures applied to different positions of the sole, and the pressure sensors arranged on the insole can be regularly or irregularly arranged. In fig. 5, the sole pressure acquisition insole is provided with 16 pressure sensors, which can read the pressure applied to 16 positions on the sole, i.e. the matrix type pressure acquisition insole has a pressure sensor matrix consisting of 16 pressure acquisition points, but the invention is not limited thereto, and more or less pressure acquisition points can be provided. In fig. 5, 6.1, 6.2, 6.3 and 6.4 represent the pressure stress condition of toe part, 1.1, 1.2, 1.3, 1.4 and 5.4 represent the pressure stress condition of forefoot part, 2.2, 2.3 and 2.4 represent the pressure stress condition of middle part of sole, and 4.2, 4.3, 3.2 and 3.3 represent the pressure stress condition of heel part. The invention adopts a matrix type pressure measurement mode, ensures the sufficient quantity of the sole pressure test points and ensures that each position (test point) of the sole pressure is monitored. The acquisition of the plantar pressures of the two feet is mainly to acquire data of the plantar pressures of various pedals (an accelerator pedal, a brake pedal, a clutch pedal and a left foot rest pedal) when a human subject controls acceleration, deceleration and emergency handling of a vehicle in the process of simulating the driving of the vehicle, and a hotspot graph can be generated based on the acquired pressure data, which will be described in an exemplary manner later.
In an embodiment of the present invention, the acceleration sensor 120 may be disposed at an ankle portion of the testee or other positions capable of representing the foot movement state. The acceleration sensor is preferably a three-axis acceleration sensor for measuring acceleration of the foot from three mutually perpendicular directions (e.g., mutually perpendicular directions of the X, Y, Z axes), wherein the direction of the X, Y, Z axis may be determined by initial definition, for example, a direction perpendicular to the ball surface, a direction parallel to the ball surface toward the toes, and a direction parallel to the ball surface toward the sides of the foot may be taken as mutually perpendicular directions of the X, Y, Z axis, but the present invention is not limited thereto. Furthermore, in an embodiment of the present invention, the acceleration sensor 120 is used to collect acceleration mainly in two aspects: x, Y, Z, and the angle value calculated by the original data, X, Y, Z, the original data are mainly used to judge the control intensity of each pedal tested during driving, judge whether the tested driver has the behavior of driving violently, and the calculated angle value mainly measures the depth value of each pedal pressed by the tested driver. The data collected by the acceleration sensor 120 is transmitted to the processor 100, and the processor 100 processes the data and uploads the processed data to the upper computer.
In some embodiments of the present invention, the wireless communication module 130 may be a long-range or short-range wireless communication module, such as a bluetooth wireless communication module, a Wi-Fi wireless communication module, etc., but the present invention is not limited thereto. In other embodiments of the present invention, the wireless communication module may be replaced by a wired communication module to perform communication in a wired manner.
In some embodiments of the present invention, the processor 100 (the first processor) may be implemented by a single chip or a PLC, and may also be implemented by other types of processors or microprocessors. The processor 100 may be connected to the upper computer as a lower computer, and transmit the acquired data to the upper computer to display the acquired data on a display interface on the upper computer side, or display an intuitive schematic diagram formed by the acquired data, such as a hotspot diagram. Further, in a preferred embodiment of the present invention, the processor 100 may further perform data processing on the collected data, so as to generate an event tag carrying time information when it is determined that a predetermined condition is reached based on the collected data, and send the event tag together with the collected data to the upper computer.
In the embodiment of the present invention, as shown in fig. 4, a sole pressure collecting insole 110, a main control box (i.e. a processor) 100 for processing data, and a data connection line 102 between the sole pressure collecting insole 110 and the main control box 100 may constitute a sole pressure collecting device for collecting pressure of a sole and uploading the pressure to an upper computer. The main control box 100 may be a single chip microcomputer or a PLC, but the present invention is not limited thereto. The acceleration sensor may also be connected to the main control box 100 such that the main control box 100 constitutes an acceleration collecting device together with the acceleration sensor.
Under the condition that the pressure acquisition device is not connected with the upper computer, the stress condition of the plantar pressure insole displayed on the display interface of the upper computer is shown in fig. 6, and the pressure detection areas corresponding to the insole are all black when the pressure acquisition device is not connected. Under the condition that the pressure acquisition device is connected with the upper computer, the stress condition of the plantar pressure insole displayed on the display interface of the upper computer is shown in fig. 7, or as shown in fig. 8 or 9, the deeper the color area is, the greater the stress is. In which fig. 7 shows the pressure insole in a state substantially not subjected to pressure. Fig. 8 and 9 show pressure sensor data acquired by the pressure acquisition device connected to the upper computer and due to different exertion situations exerted by the subject, and hot spot maps generated based on raw data from the pressure sensors. As shown in fig. 8 to 9, a hotspot graph can be generated based on the pressure data detected by each pressure test point, and the position where the pressure of the tested person is the greatest can be visually seen based on the hotspot graph, so that whether the foot exertion part of the tested person is accurate or not can be judged. In addition, as shown in fig. 6-9, a column-shaped progress bar is arranged on the left side of the display interface to display the stress condition of each pressure detection point, and when the progress bar is full, the pressure reaches the maximum value state. In addition, data corresponding to the pressure of the sole of a foot, such as the received voltage value data shown in fig. 7-9, may also be displayed in real time on the display interface, where the voltage value data is proportional to the pressure.
In an exemplary embodiment of the present invention, the acquisition of matrix pressure may be acquired using a high precision analog to digital converter (ADC). The ADC can adopt 24 bits for data acquisition, the sampling frequency is 1024Hz, and the high sampling rate ensures the accuracy of data acquisition and the reducibility of data. As above, the accuracy of the ADC, i.e. the sampling frequency, is merely an example, and the present invention is not limited thereto, but may also be reasonably changed based on actual detection requirements.
After the sole pressure acquisition insole is electrified, signals output by each sensor on the insole can be subjected to primary amplification through a follower, then power frequency interference is filtered through a 50Hz power frequency wave trap, secondary amplification is carried out, then the signals are subjected to 0.1Hz high pass, then analog-digital data conversion is carried out after 1024Hz low pass, the converted data of discrete signals are transmitted to a single chip microcomputer (a first processor), and then the single chip microcomputer transmits the data to an upper computer in a Bluetooth or Wi-Fi (wireless fidelity) mode and the like. Because sole pressure acquisition shoe-pad includes the pressure sensor that the matrix was arranged, the singlechip can adopt the mode of timesharing scanning to gather each pressure sensor's value. And then storing and sending the data to an upper computer.
The single chip microcomputer collects data of the insole collected by sole pressure, collects acceleration values from the acceleration sensor, and further calculates change of the acceleration values based on the collected acceleration data. Judging whether a testee is in a violent driving state or not according to the change rate of the acceleration value, if the acceleration change rate is larger than a preset threshold value, adding an event tag to recorded data by a transient single chip with rapid acceleration change, namely generating an event tag to be added to the collected data, recording the value of each data in the current scene and identifying the value through the event tag, and determining whether violent driving exists or whether an emergency is processed or not in later analysis based on the data near the time point recorded by the event tag. The change in the acceleration value as described above may be a change in a component of the acceleration value in each direction (X, Y, Z axes) or may be a change in the total acceleration value.
After the single chip microcomputer obtains the original numerical value of the acceleration data, the included angle between the acceleration vector and each axis can be calculated according to the original data, and the formula is as follows:
the Z axis of the acceleration sensor forms an included angle with the Z axis of the natural system coordinate,
the X axis of the acceleration sensor forms an included angle with the X axis of the natural system coordinate,
the Y axis of the acceleration sensor forms an included angle with the Y axis of the natural system coordinate,
wherein A isx,Ay，AzIs raw data read from an acceleration sensor; representing acceleration data measured by XYZ axes of the acceleration sensor.
The change rate of the depth and the angle of the pedal treaded by the testee can be judged through the calculated angle value, and the data is stored. And generating an event label which represents the step motion condition in real time based on the change of the acceleration value, wherein the event label is called a trial step event label. Under the real condition, by measuring the sudden change of the acceleration, the software layer can generate an event label and record the acquisition conditions of all data of the current scene so as to analyze the driving behavior more pertinently.
The upper computer can comprise a processor (a second processor), a communication module and a display unit, and is used for receiving data from the lower computer through the wireless communication module, and storing the received data in the local or cloud end for driving behavior analysis. The received data may also be displayed on a display unit. The upper computer can make a comprehensive evaluation and training for the testee in the traffic field based on the plantar pressure data and the acceleration data acquired by the acquisition device shown in fig. 2. The upper computer can also carry out big data analysis on the driving behaviors of a plurality of testees and the corresponding plantar pressure data and foot acceleration data so as to more accurately analyze the correlation between the tested driving operation (such as driving habits) and the driving behaviors, thereby carrying out targeted training and improving the training effect. In the embodiment of the present invention, the second processor is mainly used for performing driving behavior evaluation processing based on the collected data, and therefore, is also referred to as an evaluation processing unit.
For example, the pressure level and the pressure distribution of the foot to be tested can be visually observed based on the drawn heat map. Darker colors indicate greater force used. By collecting the pressure data and the acceleration data, it is possible to judge the abnormality of the driving behavior to be tested and prompt training for the abnormality. For example, after sole pressure data and foot acceleration data are acquired in the process of driving behaviors to be tested, the fact that the tested object is violent to drive is judged according to the acceleration data, the fact that the foot position of an oil gate is frequently trodden by the center of a foot and the tip of the foot does not have data is judged according to the data of the sole pressure, the fact that the driving behaviors are abnormal can be judged according to a pre-established judgment model or through big data analysis, and the phenomenon that the error point is violent to drive and the center of the foot troddens. And provides training points such as stable driving, toe treading and the like.
As described above, the acquisition of the sole pressure data and the foot acceleration data, and the evaluation of the driving behavior based on the sole pressure data and the foot acceleration data are performed. Fig. 3 is a block diagram schematically illustrating a driving behavior data collecting apparatus according to another embodiment of the present invention. As shown in fig. 3, the driving behavior data collecting apparatus may further include a plurality of cameras 140 in addition to the pressure collecting mat 110, the acceleration sensor 120, the wireless communication module 130, and the processor 100 shown in fig. 2. The plurality of cameras may include, for example: the present invention relates to a simulation system for simulating a vehicle environment, and more particularly to a simulation system for simulating a vehicle environment, which includes a first camera for capturing an image of a subject's face, and one or more second cameras for capturing a video of the vehicle environment, preferably two cameras for capturing front and rear of the simulated vehicle, respectively, i.e., front and rear cameras, but the present invention is not limited thereto, and may be more or less cameras.
The front camera and the rear camera are responsible for normally recording the vehicle environment video and transmitting the video to the upper computer through the single chip microcomputer (the first processor) to be reserved for subsequent driving behavior analysis, and the front camera and the rear camera are a basis for judging the driving behavior. In a preferred embodiment of the present invention, the single chip microcomputer may further identify a vehicle driving scene where the vehicle is located based on the vehicle environment video, and determine whether to actively send a scene event flag (or label) according to the scene, so as to generate the scene event label in a case where a specific driving scene is identified. As an example, in the case of a simulated scene, when a scene screen has a complex situation, such as passing through a toll station and an obstacle on a road, the single chip may identify a corresponding scene based on videos shot by front and rear cameras, and when the identified scene is a predetermined scene requiring an event tag (e.g., passing through the toll station, having an obstacle, having a pedestrian in front, etc.), the single chip may generate an event tag from a software layer, and record all the situations of the collected data in the current scene.
The camera (first camera) of driver's seat is used for shooing driver's (being tested) facial expression and uploads to the host computer through singlechip (first treater). In the preferred embodiment of the invention, the single chip microcomputer can also recognize the facial expression and decide whether to actively send the event mark according to the real-time recognition result of the facial expression. When the facial expression recognition result is a preset facial expression (such as anger, panic, stress and the like) needing important attention, the single chip generates an expression event label which is used for identifying a specific expression and carries time information from a software layer, and transmits the expression event label to the upper computer together with the currently collected facial image data. The upper computer can determine the weight of the influence of the facial expression weight on the driving behavior according to whether the event label exists or not. For example, when the facial expression is angry, the single chip microcomputer system generates a label event mark according to the angry result and sends the label event mark and collected expression data to the upper computer, so that a prompt is provided for a person who analyzes subsequent data, the situation is the angry expression of a driver or a tested person, and the analyst can combine plantar pressure data and acceleration data and data of front and rear cameras to analyze and find out the reason.
In the embodiment of the present invention, the evaluation processing unit of the upper computer may generate a foot pressure hotspot graph based on the sole pressure data, and determine the attempted driving behavior based on the sole pressure data and the foot acceleration data according to a predetermined driving behavior determination model. The driving behavior under test can also be evaluated based on the plantar pressure data, the foot acceleration data, and the facial expression under test according to a predetermined driving behavior determination model.
The evaluation processing unit also receives the image data of the face to be tested from the driving behavior data acquisition device and the expression event labels based on the specific expressions through the wireless communication module. Further, the evaluation processing unit can also receive the trial movement event label and/or the scene event label from the driving behavior data acquisition device through the wireless communication module. The evaluation processing unit can determine the weight of the driving behavior element based on the received event label and carry out the evaluation of the tested driving behavior based on the weight of the driving behavior element. Here, the driving behavior elements may include a pedal depression operation element for depressing a pedal with a foot, a movement element for moving a foot, a vehicle scene element, a subject facial expression element, and the like. By comprehensively analyzing the relationship between the elements and the driving behaviors, the driving behaviors to be tested can be more accurately evaluated, and a more effective training scheme is provided.
Furthermore, in the embodiment of the present invention, the evaluation processing unit of the upper computer or the processor of the lower computer may further generate feedback information for the specific behavior elements based on the identification of the collected data, and display prompt information or play prompt voice information on the simulated driving display screen in the simulated driving cab. For example, if the tested person has a tense expression, the evaluation processing unit can send a tense prompting instruction to the lower computer to prompt the tested person to relax through voice or a display interface, so that the training experience can be greatly improved.
The embodiment of the invention is not only suitable for the driving training of the testee in the traffic field, but also can be used for the driving behavior analysis of big data.
In summary, the present invention can collect acceleration sensor data representing foot acceleration and pressure sensor data representing foot sole pressure, and more accurately analyze driver behavior based on the collected data.
Furthermore, the embodiment of the invention can also collect facial expression data and generate the event label under the specific expression so as to analyze the influence of the driver psychology on the driving behavior based on the event label, thereby carrying out targeted training and correction.
Further, for the data of the acceleration sensor, an event label may also be generated when the acceleration rate is greater than a predetermined threshold, so as to facilitate analysis of each behavior data (such as sole pressure, facial expression, and foot motions of the acceleration sensor to the driver) of the driver at a time point corresponding to the event label, thereby finding out a root cause of the driving problem of the driver and improving the training effect.
In addition, the invention can also carry out big data analysis based on the tested data so as to more accurately analyze the influence of each driving behavior element on the driving behavior, can more accurately evaluate the tested driving behavior and provide a more effective training scheme.
In addition, the present invention may have other advantages, which may or may not be obvious, and thus, will not be described in detail herein.
It is to be understood that the invention is not limited to the specific arrangements and instrumentality described above and shown in the drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present invention are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the present invention.
Those of ordinary skill in the art will appreciate that the various illustrative components, devices, and methods described in connection with the embodiments disclosed herein may be implemented as hardware, software, or combinations of both. Whether this is done in hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the invention are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
Features that are described and/or illustrated with respect to one embodiment may be used in the same way or in a similar way in one or more other embodiments and/or in combination with or instead of the features of the other embodiments in the present invention.
It should be noted that the above-mentioned embodiments are only for illustrating the present invention and not for limiting the scope of the present invention, and any equivalent transformation techniques based on the present invention should be within the scope of the present invention.
Claims (10)
1. A driving behavior data collecting apparatus based on vehicle driving, characterized in that the apparatus comprises:
the pressure acquisition pad is distributed with at least one pressure sensor and is used for acquiring sole pressure data, and the sole pressure data comprises pressure data of a toe part, a front sole part, a middle sole part and a rear root part;
an acceleration sensor for sensing an acceleration of the subject foot;
a wireless communication module for performing wireless communication;
a first processor connected to the pressure collection pad, the acceleration sensor and the wireless communication module, for receiving data from the pressure collection pad and the acceleration sensor, and transmitting data to an external device through the wireless communication module, to generate a foot pressure heat map based on the foot pressure data by the external device, and to determine a trial driving behavior based on the foot pressure data and the foot acceleration data according to a predetermined driving behavior determination model.
2. The apparatus of claim 1, further comprising:
a first imaging device for imaging a face image of a subject;
the first processor is further configured to identify a facial expression based on the image of the subject's face to generate an expression event tag if a specific expression is identified.
3. The apparatus of claim 1, further comprising:
the second camera device is used for shooting the vehicle environment video;
the first processor is further configured to identify a vehicle driving scene based on the vehicle environment video to generate a scene event tag if a specific driving scene is identified.
4. The apparatus of claim 1, wherein:
the acceleration sensor is a three-axis acceleration sensor;
the pressure acquisition pad is the matrix pressure acquisition pad that arranges a plurality of pressure sensor for detect the pressure of the different positions of the sole of being tried.
5. The apparatus of claim 1, wherein:
the first processor is further configured to generate a trial movement event tag upon detecting that the rate of change of the acceleration reaches a predetermined value.
6. A driving behavior evaluation device based on vehicle driving, characterized by comprising:
the wireless communication module is used for receiving plantar pressure data and foot acceleration data from a driving behavior data acquisition device based on vehicle driving through wireless communication, wherein the plantar pressure data comprise pressure data of a toe part, a front sole part, a middle part of a sole and a rear root part; and
and an evaluation processing unit which generates a foot pressure heat map based on the foot pressure data and determines a subject driving behavior based on the foot pressure data and the foot acceleration data according to a predetermined driving behavior determination model.
7. The evaluation device according to claim 6, wherein the evaluation processing unit further receives the image data of the face to be tested from the driving behavior data collecting device and the expression event label based on the specific expression through the wireless communication module.
8. The evaluation device according to claim 6, wherein the sole pressure data is pressure data of different positions measured from the sole of a foot by a matrix type pressure collecting pad having a plurality of pressure sensors.
9. The evaluation device according to claim 7, wherein the evaluation processing unit further receives a trial movement event tag and/or a scene event tag from a driving behavior data collecting device through the wireless communication module.
10. The evaluation apparatus according to claim 6, wherein the evaluation processing unit determines a driving behavior element weight based on the received event label, and performs the evaluation of the driving behavior under test based on the driving behavior element weight.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910089786.1A CN109817056B (en) | 2019-01-30 | 2019-01-30 | Driving behavior data acquisition device and evaluation device based on vehicle driving |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910089786.1A CN109817056B (en) | 2019-01-30 | 2019-01-30 | Driving behavior data acquisition device and evaluation device based on vehicle driving |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109817056A CN109817056A (en) | 2019-05-28 |
| CN109817056B true CN109817056B (en) | 2021-04-27 |
Family
ID=66605896
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910089786.1A Active CN109817056B (en) | 2019-01-30 | 2019-01-30 | Driving behavior data acquisition device and evaluation device based on vehicle driving |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109817056B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111310914B (en) * | 2020-01-20 | 2022-05-13 | 北京津发科技股份有限公司 | Driving state analysis method using neural network algorithm and computer device |
| CN111284497B (en) * | 2020-01-20 | 2022-04-12 | 北京津发科技股份有限公司 | Driving state recognition device |
| CN114312694B (en) * | 2021-12-27 | 2022-11-25 | 大连工业大学 | Automobile acceleration and deceleration control system and method based on foot posture control |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6486774B1 (en) * | 2001-03-16 | 2002-11-26 | Alphonso Arnold, Sr. | Vehicular deceleration warning system |
| CN203528376U (en) * | 2013-08-29 | 2014-04-09 | 重庆工业职业技术学院 | Device for correcting bad driving habits which can cause stepping on accelerator by mistake by mistaking accelerator as brake |
| CN105043444A (en) * | 2015-07-06 | 2015-11-11 | 湖南湖大艾盛汽车技术开发有限公司 | Man-machine engineering data measuring system and measuring method based on pedal interaction |
| CN106203626A (en) * | 2016-06-30 | 2016-12-07 | 北京奇虎科技有限公司 | Car steering behavioral value method and device, automobile |
| CN206436830U (en) * | 2017-02-16 | 2017-08-25 | 李昌邦 | A kind of automobile accelerator stepping misoperation preventing control device |
| CN108694815A (en) * | 2018-07-25 | 2018-10-23 | 合肥市智信汽车科技有限公司 | A kind of fatigue driving auxiliary device and method for detecting fatigue driving |
| CN208216696U (en) * | 2017-12-05 | 2018-12-11 | 长安大学 | A kind of detection device of driver's operating habit |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102271982B (en) * | 2009-09-09 | 2014-09-10 | 松下电器产业株式会社 | Vehicle control device and vehicle control method |
| CN206265022U (en) * | 2016-11-17 | 2017-06-20 | 吾拉依木江·司提瓦力地 | Anxious pine accelerator pedal brakes |
-
2019
- 2019-01-30 CN CN201910089786.1A patent/CN109817056B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6486774B1 (en) * | 2001-03-16 | 2002-11-26 | Alphonso Arnold, Sr. | Vehicular deceleration warning system |
| CN203528376U (en) * | 2013-08-29 | 2014-04-09 | 重庆工业职业技术学院 | Device for correcting bad driving habits which can cause stepping on accelerator by mistake by mistaking accelerator as brake |
| CN105043444A (en) * | 2015-07-06 | 2015-11-11 | 湖南湖大艾盛汽车技术开发有限公司 | Man-machine engineering data measuring system and measuring method based on pedal interaction |
| CN106203626A (en) * | 2016-06-30 | 2016-12-07 | 北京奇虎科技有限公司 | Car steering behavioral value method and device, automobile |
| CN206436830U (en) * | 2017-02-16 | 2017-08-25 | 李昌邦 | A kind of automobile accelerator stepping misoperation preventing control device |
| CN208216696U (en) * | 2017-12-05 | 2018-12-11 | 长安大学 | A kind of detection device of driver's operating habit |
| CN108694815A (en) * | 2018-07-25 | 2018-10-23 | 合肥市智信汽车科技有限公司 | A kind of fatigue driving auxiliary device and method for detecting fatigue driving |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109817056A (en) | 2019-05-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109887373B (en) | Driving behavior data acquisition method, evaluation method and device based on vehicle driving | |
| CN109817056B (en) | Driving behavior data acquisition device and evaluation device based on vehicle driving | |
| Altman et al. | A kinematic method for footstrike pattern detection in barefoot and shod runners | |
| US10568502B2 (en) | Visual disability detection system using virtual reality | |
| CN101545759B (en) | Vehicle brake pedal travel measuring method | |
| CN106667493A (en) | Human body balance assessment system and assessment method | |
| CN112319488B (en) | Method and system for identifying driving style of motor vehicle driver | |
| CN107590479B (en) | Road analysis processing method and device | |
| Horsley et al. | Does site matter? impact of inertial measurement unit placement on the validity and reliability of stride variables during running: a systematic review and meta-analysis | |
| Panero et al. | Comparison of different motion capture setups for gait analysis: Validation of spatio-temporal parameters estimation | |
| Aubol et al. | Foot contact identification using a single triaxial accelerometer during running | |
| CN104780840A (en) | Method and apparatus for measuring reaction forces | |
| KR20160107528A (en) | Apparatus and method for providing reliability for computer aided diagnosis | |
| KR20190120922A (en) | Method and system for walking ability prediction using stepping characteristics information | |
| US20230096232A1 (en) | Automated turf testing apparatus and system for using same | |
| CN111731302A (en) | Method and system for evaluating brain visual load of automobile driver based on subtask | |
| CN105136338B (en) | A kind of footwear foot-suitability evaluation method based on optical fiber sensing technology | |
| US7313957B1 (en) | Apparatus, method and program for evaluating work characteristic | |
| CN201821451U (en) | Measuring device for driver pedal operation | |
| CN102269656A (en) | Measuring apparatus for operation behavior on pedal by driver and monitoring method thereof | |
| CN107114863B (en) | Manufacturing method and manufacturing system of shoe tree for testing anti-skid performance of shoes | |
| CN113229809A (en) | Gait detection method and system | |
| JP6029236B2 (en) | Biological function diagnostic apparatus and program | |
| CN201397127Y (en) | Automotive brake pedal travel measurement system | |
| Weidensager et al. | Estimating vertical ground reaction forces from plantar pressure using interpretable high-dimensional approximation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |