CN115782752B

CN115782752B - Data processing method and related device for proximity event in hand-off detection scene

Info

Publication number: CN115782752B
Application number: CN202310029026.8A
Authority: CN
Inventors: 张海越; 杨斌; 王洁
Original assignee: Shenzhen Xihua Technology Co Ltd
Current assignee: Shenzhen Xihua Technology Co Ltd
Priority date: 2023-01-09
Filing date: 2023-01-09
Publication date: 2023-10-27
Anticipated expiration: 2043-01-09
Also published as: CN115782752A

Abstract

The application provides a data processing method and a related device aiming at a proximity event in a hand-off detection scene, wherein the method comprises the following steps: acquiring capacitance initial data of a target vehicle in the running process by a proximity detection sensor, acquiring target historical information of a first moment in m sampling moments in the capacitance initial data, acquiring m capacitance increment values corresponding to the m sampling moments according to capacitance sampling values of each sampling moment, determining a real capacitance value of a second moment according to a real environment reference and a capacitance sampling value of a second moment determined based on the target event and a target offset when a target event is determined according to the target historical information, and determining that a hand-off event occurs in the target vehicle when the real capacitance value is determined to be smaller than or equal to a first threshold value; generating early warning information according to the ongoing hand-off event, and outputting the early warning information through the early warning device. Therefore, the comprehensiveness and accuracy of determining the hand-leaving event are improved, and driving safety is improved.

Description

Data processing method and related device for proximity event in hand-off detection scene

Technical Field

The application belongs to the field of control of multifunctional steering wheel subsystems in new energy industry, and particularly relates to a data processing method and a related device aiming at a proximity event in a hand-off detection scene.

Background

In the running process of the vehicle, if the hands of the driver are separated from the steering wheel, safety accidents are easy to cause, therefore, whether the hands of the driver are in a close state or a non-close state needs to be determined, the detection of the proximity detection sensor can be influenced due to the change of the ambient temperature and the humidity, so that misjudgment is caused on whether the hands of the driver are separated from the steering wheel in the steering wheel separation detection process, and early warning errors are caused due to misjudgment results, so that the running safety accidents are caused.

Disclosure of Invention

The application provides a data processing method and a related device aiming at a proximity event in a hand-leaving detection scene, so as to improve the comprehensiveness and accuracy of the determination of the hand-leaving event, further ensure the effectiveness of early warning when the hand-leaving event occurs and improve the driving safety.

In a first aspect, an embodiment of the present application provides a data processing method for a proximity event in an off-hand detection scenario, which is applied to a micro control unit in a safe driving system of a target vehicle, where the safe driving system further includes a proximity detection sensor and an early warning device that are disposed on a steering wheel of the target vehicle, and the micro control unit is respectively connected with the proximity detection sensor and the early warning device, and the method includes:

Acquiring capacitance initial data of the target vehicle in the running process through the proximity detection sensor, wherein the capacitance initial data comprises a capacitance sampling value of each sampling moment in m sampling moments closest to the current system time, and m is an integer greater than or equal to 1;

acquiring target history information of a first moment in the m sampling moments, wherein the target history information is used for representing a target event which occurs in the target vehicle at the first moment, the first moment is a sampling moment before and closest to a second moment, the second moment is a sampling moment closest to the current system time, the target event comprises a proximity event and a hand-leaving event, the proximity event is used for indicating that the hand of a driver is in a state of touching a steering wheel, and the hand-leaving event is used for indicating that the hand of the driver is in a state of leaving the steering wheel;

determining a capacitance increment value of each sampling moment according to the capacitance sampling value of each sampling moment in the capacitance initial data to obtain m capacitance increment values corresponding to the m sampling moments, wherein the capacitance increment value of any sampling moment refers to a difference value between a first capacitance sampling value of any sampling moment and a second capacitance sampling value of a reference moment of any sampling moment, and the reference moment of any sampling moment refers to a sampling moment adjacent to and before the any sampling moment;

Determining a target offset at the second moment according to the m capacitance increment values;

when the target event is determined according to the target history information, determining a real environment reference at the second moment according to the target event and the target offset, wherein the real environment reference is used for representing an environment capacitor;

determining a real capacitance value at the second moment according to the capacitance sampling value at the second moment and the real environment reference at the second moment in the capacitance initial data;

when the real capacitance value is determined to be smaller than or equal to a first threshold value, determining that a hand-off event occurs in the target vehicle;

generating early warning information according to the hand-leaving event which is happening, wherein the early warning information is used for indicating the hand-leaving event which is happening;

and outputting the early warning information through the early warning device so as to remind a driver of the target vehicle of paying attention to the hand-leaving event which occurs.

In a second aspect, an embodiment of the present application provides a data processing device for a proximity event in an off-hand detection scenario, which is applied to a micro control unit in a safe driving system of a target vehicle, where the safe driving system further includes a proximity detection sensor and an early warning device that are disposed on a steering wheel of the target vehicle, and the micro control unit is respectively connected with the proximity detection sensor and the early warning device, where the data processing device for a proximity event in the off-hand detection scenario includes:

A first obtaining unit, configured to obtain, by using the proximity detection sensor, capacitance initial data of the target vehicle running process, where the capacitance initial data includes a capacitance sampling value at each of m sampling moments closest to a current system time, and m is an integer greater than or equal to 1;

a second obtaining unit, configured to obtain target history information of a first time out of the m sampling times, where the target history information is used to characterize a target event occurring in the target vehicle at the first time, the first time is a sampling time before and closest to a second time, the second time is a sampling time closest to the current system time, and the target event includes a proximity event and a hands-off event, where the proximity event is used to indicate that a hand of a driver is in a state of touching a steering wheel, and the hands-off event is used to indicate that the hand of the driver is in a state of leaving the steering wheel;

a first determining unit, configured to determine, according to the capacitance sampling value at each sampling time in the capacitance initial data, a capacitance increment value at each sampling time, to obtain m capacitance increment values corresponding to the m sampling times, where the capacitance increment value at any sampling time refers to a difference between a first capacitance sampling value at any sampling time and a second capacitance sampling value at a reference time at any sampling time, and the reference time at any sampling time refers to a sampling time adjacent to and before the any sampling time;

A second determining unit, configured to determine a target offset at the second moment according to the m capacitance increment values;

the third determining unit is used for determining a real environment reference at the second moment according to the target event and the target offset when the target event is determined according to the target history information, wherein the real environment reference is used for representing an environment capacitor;

a fourth determining unit, configured to determine a real capacitance value at the second time according to the capacitance sampling value at the second time and a real environment reference at the second time in the capacitance initial data;

a fifth determining unit, configured to determine that a hand-off event is occurring in the target vehicle when it is determined that the real capacitance value is less than or equal to a first threshold value;

the early warning information generation unit is used for generating early warning information according to the hand-leaving event which is happening, and the early warning information is used for indicating the hand-leaving event which is happening;

and the early warning unit is used for outputting the early warning information through the early warning device so as to remind a driver of the target vehicle of paying attention to the hand-leaving event which occurs.

In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for performing steps in the method according to the first aspect of the embodiment of the present application.

In a fourth aspect, embodiments of the present application provide a computer readable storage medium having stored thereon a program/instruction which when executed by a processor implements the steps of the method of the first aspect of embodiments of the present application.

In a fifth aspect, embodiments of the present application provide a program product comprising a program/instruction which, when executed by a processor, implements the steps of the method of the first aspect of embodiments of the present application.

It can be seen that, in the embodiment of the present application, the micro control unit obtains, through the proximity detection sensor, initial capacitance data of the target vehicle in the running process, where the initial capacitance data includes a capacitance sampling value at each of m sampling moments closest to the current system time; acquiring target historical information of a first moment in m sampling moments, wherein the target historical information is used for representing a target event which occurs in a target vehicle at the first moment, the first moment is a sampling moment which is before and closest to a second moment, the second moment is a sampling moment which is closest to the current system time, the target event comprises a proximity event and a hand-away event, the proximity event is used for indicating that the hand of a driver is in a state of touching a steering wheel, and the hand-away event is used for indicating that the hand of the driver is in a state of being away from the steering wheel; according to the capacitance sampling value of each sampling time in the capacitance initial data, determining the capacitance increment value of each sampling time to obtain m capacitance increment values corresponding to m sampling times; determining that the average value of the m capacitance increment values is the target offset at the second moment; when a target event is determined according to the target history information, determining a real environment reference at a second moment according to the target event and the target offset, wherein the real environment reference is used for representing the environment capacitance; determining a real capacitance value at the second moment according to the capacitance sampling value at the second moment in the capacitance initial data and the real environment reference at the second moment; when the real capacitance value is determined to be smaller than or equal to a first threshold value, determining that a hand-off event occurs in the target vehicle; generating early warning information according to the ongoing hand-off event; and outputting early warning information through the early warning device so as to remind a driver of the target vehicle of the ongoing hands-off event. Therefore, the determined real environment reference containing environment change factors is realized by introducing the average value of the current capacitance increment value, so that the comprehensiveness and accuracy of the determination of the hand-off event are improved, the effectiveness of early warning when the hand-off event occurs is further ensured, and the driving safety is improved.

Drawings

In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a block diagram of a safe driving system according to an embodiment of the present application;

fig. 2a is a schematic flow chart of a data processing method for a proximity event in a hands-off detection scenario according to an embodiment of the present application;

FIG. 2b is a schematic diagram of an early warning page according to an embodiment of the present application;

FIG. 3a is a functional block diagram of a data processing apparatus for a proximity event in a hands-off detection scenario according to an embodiment of the present application;

FIG. 3b is a functional block diagram of a data processing apparatus for a proximity event in another off-hand detection scenario provided by an embodiment of the present application;

fig. 4 is a block diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order that those skilled in the art will better understand the present application, a technical solution in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The terms first, second and the like in the description and in the claims and in the above-described figures are used for distinguishing between different objects and not necessarily for describing a sequential or chronological order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.

First, a system architecture according to an embodiment of the present application will be described.

Referring to fig. 1, fig. 1 is a block diagram of a safe driving system according to an embodiment of the present application, as shown in fig. 1, the safe driving system 10 includes a micro-control unit 11, a proximity detection sensor 12 disposed on a steering wheel of a target vehicle, and an early warning device 13, where the micro-control unit 11 is connected to the proximity detection sensor 12 and the early warning device 13, respectively. The micro control unit 11 is configured to receive various data collected by the proximity detection sensor 12, and process and analyze the collected data to perform a data processing method for a proximity event in a hands-off detection scene.

The early warning device 13 may include, but is not limited to, a display device and/or a voice broadcasting device, the display device may be, but is not limited to, a display screen installed on a center console of the target vehicle and/or an external electronic device connected with the micro control unit and provided with the display screen, the voice broadcasting device may be, but is not limited to, an audio device installed on the center console of the target vehicle and/or an external buzzer connected with the micro control unit, and the type, number, and the like of the early warning device 13 are not particularly limited.

Based on this, the embodiment of the application provides a data processing method for a proximity event in a hand-off detection scene, and the embodiment of the application is described in detail below with reference to the accompanying drawings.

Referring to fig. 2a, fig. 2a is a flowchart of a data processing method for a proximity event in a detection scene of a hand-away, which is applied to a micro control unit 11 in a safe driving system 10 of a target vehicle as shown in fig. 1, the safe driving system 10 further includes a proximity detection sensor 12 and an early warning device 13 disposed on a steering wheel of the target vehicle, and the micro control unit 11 is respectively connected with the proximity detection sensor 12 and the early warning device 13, as shown in fig. 2a, the method may include, but is not limited to, the following steps:

and step 201, acquiring initial capacitance data of the running process of the target vehicle through the proximity detection sensor.

The initial capacitance data comprises capacitance sampling values of each sampling time in m sampling times closest to the current system time, and m is an integer greater than or equal to 1.

In practical applications, the proximity detection sensor includes an Analog Front End (AFE), and the Analog Front End samples the capacitance physical quantity according to a preset sampling period, and can convert the capacitance physical quantity into a capacitance sampling value. The sampling period may be 1 second, 0.5 second, two seconds, etc., and the size of the sampling period is not particularly limited.

In this example, the initial data of the capacitance of the target vehicle in the driving process can be obtained by the proximity detection sensor, so as to provide data support for the subsequent data processing, and improve the intelligence and effectiveness of the data processing for the proximity event in the off-hand detection scene.

Step 202, obtaining target history information of a first moment in the m sampling moments, wherein the target history information is used for representing a target event happening in the target vehicle at the first moment.

The first time refers to a sampling time before and closest to a second time, and the second time refers to a sampling time closest to the current system time, it may be understood that the second time may be the current system time, that is, the second time may be the current sampling time, and the target event includes an approach event and a hands-off event, where the approach event is used to indicate that the hand of the driver is in a state of touching the steering wheel, and the hands-off event is used to indicate that the hand of the driver is in a state of leaving the steering wheel.

In a specific implementation, a reference value k is preset, if the number p of currently existing sampling moments is greater than or equal to k, m is equal to k, and if the number p of currently existing sampling moments is less than k, m=p.

The reference value k may be set according to actual requirements, for example, the reference value k may be 8, and the reference value k may be 5.

In a specific implementation, when the safe driving system determines that the target event occurs at the sampling time, the sampling time and the corresponding target event are stored as the historical information of the sampling time, so that the safe driving system is convenient to read.

It can be seen that, in this example, the target history information of the history sampling time can be obtained, and since the target history information is used to characterize the target event occurring in the target vehicle at the history sampling time, data support can be provided for determining whether the hands-off event or the proximity event occurs in the target vehicle at the history sampling time.

Step 203, determining a capacitance increment value at each sampling time according to the capacitance sampling value at each sampling time in the capacitance initial data, so as to obtain m capacitance increment values corresponding to the m sampling times.

The capacitance increment value of any sampling time refers to a difference value between a first capacitance sampling value of the any sampling time and a second capacitance sampling value of a reference time of the any sampling time, and the reference time of the any sampling time refers to a sampling time adjacent to and before the any sampling time.

For example, the correspondence between the capacitance increment value at the second time and the capacitance sampling value at the first time is: delta (n) =raw (n) -raw (n-1), wherein Delta (n) is a capacitance increment value at the second time, raw (n) is a capacitance sampling value at the second time, and raw (n-1) is a capacitance sampling value at the first time, that is, a capacitance increment value at the latter sampling time is equal to a difference value between the capacitance sampling value at the latter sampling time and the capacitance sampling value at the former sampling time in two adjacent sampling times.

And 204, determining the target offset of the second moment according to the m capacitance increment values.

The corresponding relation between the target offset and the m capacitance increment values at the second moment is as follows:

when p is greater than or equal to k, m is equal to k, drift (n) =sum (Delta (n- (k-1)) -Delta (n))/k;

when p is smaller than k, m=p, drift (n) =sum (Delta (0) -Delta (n))/p;

where Drift (n) is the target offset at the second time, sum (Delta (n- (k-1)) -Delta (n))/k is the average value of the sum of the values of the capacitance increases at k-1 sampling times before and closest to the second time and at the second time, sum (Delta (0) -Delta (n))/p is the average value of the sum of the values of the capacitance increases corresponding to all currently existing sampling times.

And 205, determining a real environment reference at the second moment according to the target event and the target offset when the target event is determined according to the target history information.

Wherein the real environmental reference is used to characterize an environmental capacitance.

And 206, determining a real capacitance value at the second moment according to the capacitance sampling value at the second moment and the real environment reference at the second moment in the capacitance initial data.

The actual capacitance value at the second moment is equal to the difference value between the capacitance sampling value at the second moment and the actual environment reference at the second moment.

Step 207, when it is determined that the actual capacitance value is less than or equal to a first threshold value, determining that a hand-off event is occurring in the target vehicle.

The first threshold value refers to a minimum capacitance value corresponding to a hand-off event occurring in the target vehicle, wherein the first threshold value may be obtained through a data test before product delivery or through big data statistical analysis, and is a critical capacitance value corresponding to the hand-off event occurring in the target vehicle.

Further, when it is determined that the true capacitance value is greater than the first threshold value, it is determined that a proximity event is occurring within the target vehicle.

And step 208, generating early warning information according to the hand-off event which is happening.

The early warning information is used for indicating the hand-off event which occurs. The early warning information comprises text prompt information and/or an image fragment of the hand-leaving event which is happening. In a specific implementation, the micro control unit sends a control instruction to a camera in a target vehicle for monitoring a steering wheel area, and the camera acquires an image fragment of the hand-leaving event.

For example, if it is determined that a hand-off event is occurring in the target vehicle during the driving process of the target vehicle, the early warning information may be, for example, a text prompt message such as "do not disengage the hand from the steering wheel", and/or an image segment of the hand-off event that is occurring.

Step 209, outputting the early warning information through the early warning device to remind the driver of the target vehicle of the hand-off event occurring.

In one possible example, the determining the real environment reference at the second time according to the target event and the target offset includes: determining that the target event is the proximity event; determining a reference environment datum at the second moment according to the target offset; comparing the reference environment with the capacitance sampling value at the second moment to obtain a first comparison result; when the first comparison result is that the reference environment datum is larger than the capacitance sampling value at the second moment, determining that the real environment datum at the second moment is the capacitance sampling value at the second moment; and when the first comparison result is that the reference environment datum is smaller than or equal to the capacitance sampling value at the second moment, determining the real environment datum at the second moment as the reference environment datum.

The method comprises the steps that an approaching event occurs in a target vehicle at a first moment, a capacitance sampling value changes due to the approaching event, the change affects a real environment standard at a second moment, at the moment, a reference environment standard at the second moment determined through a target offset at the second moment needs to be determined by combining the capacitance sampling value at the second moment, the real environment standard at the second moment is determined to be the capacitance sampling value at the second moment only when the reference environment standard is larger than the capacitance sampling value at the second moment, and the real environment standard at the second moment is determined to be the reference environment standard only when the reference environment standard is smaller than or equal to the capacitance sampling value at the second moment.

In this example, if a proximity event occurs in the vehicle at the previous sampling time of any sampling time, the real environmental reference at any sampling time needs to be determined by the capacitance sampling value at any sampling time and the reference environmental reference at any sampling time, and since the reference environmental reference at any sampling time is determined by an average value of capacitance increment values at a plurality of consecutive sampling times including the capacitance increment value at any sampling time, the influence of the previous proximity event superposition environmental factor on the environmental reference can be avoided, the reliability and the real effectiveness of the real environmental reference determination are improved, the data support is provided for the determination of the proximity event and the hands-off event in the target vehicle to be determined subsequently, and the accuracy and the intelligence of the subsequent proximity event and hands-off event determination are improved.

In one possible example, the determining the reference environment for the second time according to the target offset includes: when the target offset is greater than or equal to a second threshold value corresponding to the approaching event, determining that the reference environment datum is the sum value of the real environment datum at the first moment and a first correction parameter corresponding to the approaching event; or when the target offset is smaller than the second threshold and larger than a third threshold corresponding to a proximity event, determining that the reference environment benchmark is the sum of the real environment benchmark at the first moment and the target offset, wherein the third threshold is smaller than the second threshold; or when the target offset is smaller than or equal to the third threshold, determining that the reference environment datum is the sum of the real environment datum at the first moment and a second correction parameter corresponding to a proximity event.

The second threshold value refers to an offset upper limit value corresponding to the approaching event, the third threshold value refers to a lower limit value corresponding to the approaching event, the specific values of the second threshold value, the third threshold value, the first correction parameter and the second correction parameter can be obtained through experimental tests or big data statistical analysis, and the determined reference environment standard can be ensured to embody the real environment standard under the influence of the approaching event and the environment factors.

In this example, when a proximity event occurs in the vehicle at a previous sampling time of any sampling time, the reference environment datum is determined in a corresponding manner according to the comparison result of the target offset of any sampling time and different thresholds corresponding to the proximity event, so that convenience and effectiveness of determining the reference environment datum at any sampling time are ensured, and data support is provided for determining the real environment datum at any sampling time.

In one possible example, the determining the real environment reference at the second time according to the target event and the target offset includes: determining that the target event is the hands-off event; comparing the target offset with a fourth threshold corresponding to the hand-off event to obtain a second comparison result; when the second comparison result is that the target offset is greater than or equal to the fourth threshold value, determining that the real environment reference at the second moment is the sum of the real environment reference at the first moment and a third correction parameter corresponding to the hands-off event; and when the second comparison result is that the target offset is smaller than the fourth threshold, determining that the real environment reference at the second moment is the capacitance sampling value at the second moment when the target offset is smaller than or equal to 0, or determining that the real environment reference at the second moment is the capacitance sampling value at the first moment when the target offset is larger than 0.

The specific values of the fourth threshold and the third correction parameter can be obtained through experimental tests or big data statistical analysis, and the determined reference environment standard can be ensured to be capable of representing the real environment standard under the influence of the environmental factors when the hand-off event occurs.

In this example, if the hand-off event occurs in the vehicle at the previous sampling time of any sampling time, the real environment reference at any sampling time is determined according to the comparison result of the target offset of any sampling time and the fourth threshold corresponding to the hand-off event, so that the influence of the environment factor on the subsequent environment reference when the hand-off event occurs can be avoided, and the comprehensiveness and intelligence of the real environment reference determination are ensured.

In one possible example, after the determining the actual capacitance value at the second time according to the capacitance sampling value at the second time and the actual environment reference at the second time in the capacitance initial data, the method further includes: when the real capacitance value is determined to be larger than the first threshold value, determining that a proximity event is occurring in the target vehicle; detecting whether the early warning device is in a closed state or not when determining that a proximity event is occurring in the target vehicle; if not, a first instruction is sent to the early warning device to close the early warning device.

In addition, after the detection of whether the early warning device is in the closed state, if the early warning device is in the closed state, the current process is ended, so that the early warning device is ensured to be in the closed state.

Therefore, in this example, under the condition that a proximity event is occurring, the early warning device is ensured to be turned off, so as to save the power consumption of the safe driving system, improve the service life of the safe driving system, and simultaneously save the running memory and improve the running efficiency of other functions of the safe driving system.

In one possible example, the outputting, by the early warning device, the early warning information includes: when the target event is determined to be the approaching event, outputting the early warning information according to the first early warning times through the early warning device; when the target event is determined to be the hand-off event, outputting the early warning information according to second early warning times by the early warning device, wherein the second early warning times are larger than the first early warning times.

The first pre-warning number may be two, three, etc., and the second pre-warning number may be three, five, etc., without being limited thereto.

When it is determined that the sampling time before the current sampling time is close to an occurrence of an event in the vehicle, that is, when the current sampling time is away from the hand, that is, the occurrence of the event in a short time, the risk is relatively low, for example, 3 times of early warning information is broadcasted through a voice device, when the sampling time before the current sampling time is determined to be away from the hand in the vehicle, that is, when the current sampling time is determined to be away from the hand, that is, the event continuously occurs, the risk is relatively high, for example, 5 times of early warning information is broadcasted through a voice device, so that the reminding of a driver is enhanced, it is understood that the set second early warning times are more than the first early warning times, and specific values can be obtained through experimental tests or big data statistical analysis.

Therefore, in this example, the pre-warning frequency of the hand-off event is set to be more than the pre-warning frequency of the hand-off event in a short time, so that the effectiveness of pre-warning is improved, and the driving experience of the user is further improved.

In one possible example, the early warning device includes a voice broadcasting device and/or a display device, and the outputting, by the early warning device, the early warning information includes: broadcasting the early warning information through the voice broadcasting device; and/or displaying the early warning information through the display device.

For example, during the driving of the vehicle, a hand-off event is detected in the vehicle, a text prompt message similar to "do not get hands off the steering wheel" is broadcasted by the voice broadcasting device, and/or a text prompt message "please hold the steering wheel" is displayed by the display device, and/or an image segment of the hand-off event is displayed by the display device, for example, please refer to fig. 2b, fig. 2b is a schematic diagram of an early warning page provided in the embodiment of the present application, and as shown in fig. 2b, the early warning page includes the text prompt message "please hold the steering wheel".

Therefore, in this example, when the hand-off event is accurately determined to occur, the micro control unit in the safe driving system of the vehicle can broadcast corresponding early warning information through the voice broadcast device in the early warning device, and/or display corresponding early warning information through the display device, so that a driver can clearly perceive that the hand is separated from the steering wheel, the intelligence and the reliability of the system are improved, the effectiveness of early warning when the hand-off event occurs is further ensured, and the driving safety is improved.

It can be understood that, since the method embodiment and the apparatus embodiment are different presentation forms of the same technical concept, the content of the method embodiment portion in the present application should be synchronously adapted to the apparatus embodiment portion, which is not described herein.

Consistent with the above-described embodiments, fig. 3a is a functional unit block diagram of a data processing apparatus for a proximity event in a hands-free detection scenario according to an embodiment of the present application. In fig. 3a, a data processing device 300 for a proximity event in an off-hand detection scene is applied to a micro control unit in a safe driving system of a target vehicle, the safe driving system further includes a proximity detection sensor and an early warning device disposed on a steering wheel of the target vehicle, the micro control unit is respectively connected with the proximity detection sensor and the early warning device, and the data processing device 300 for a proximity event in the off-hand detection scene includes:

a first obtaining unit 301, configured to obtain, by using the proximity detection sensor, initial capacitance data of the target vehicle running process, where the initial capacitance data includes a capacitance sampling value at each of m sampling moments closest to a current system time, and m is an integer greater than or equal to 1;

A second obtaining unit 302, configured to obtain target history information at a first time of the m sampling times, where the target history information is used to characterize a target event occurring in the target vehicle at the first time, the first time is a sampling time before and closest to a second time, the second time is a sampling time closest to the current system time, and the target event includes a proximity event and a hands-off event, where the proximity event is used to indicate that a hand of a driver is in a state of touching a steering wheel, and the hands-off event is used to indicate that the hand of the driver is in a state of leaving the steering wheel;

a first determining unit 303, configured to determine, according to the capacitance sampling value at each sampling time in the capacitance initial data, a capacitance increment value at each sampling time, to obtain m capacitance increment values corresponding to the m sampling times, where the capacitance increment value at any sampling time refers to a difference between a first capacitance sampling value at any sampling time and a second capacitance sampling value at a reference time at any sampling time, and the reference time at any sampling time refers to a sampling time adjacent to and before the any sampling time;

A second determining unit 304, configured to determine a target offset at the second moment according to the m capacitance increment values;

a third determining unit 305, configured to determine, when the target event is determined according to the target history information, a real environmental reference at the second moment according to the target event and the target offset, where the real environmental reference is used to characterize an environmental capacitance;

a fourth determining unit 306, configured to determine a real capacitance value at the second time according to the capacitance sampling value at the second time and the real environment reference at the second time in the capacitance initial data;

a fifth determining unit 307, configured to determine that a hands-off event is occurring in the target vehicle when it is determined that the real capacitance value is less than or equal to a first threshold value;

an early warning information generating unit 308, configured to generate early warning information according to the ongoing hands-off event, where the early warning information is used to indicate the ongoing hands-off event;

and the early warning unit 309 is configured to output the early warning information through the early warning device, so as to remind the driver of the target vehicle of the hand-leaving event that is happening.

In the case of using integrated units, as shown in fig. 3b, fig. 3b is a block diagram of functional units of another data processing apparatus for a proximity event in an off-hand detection scenario according to an embodiment of the present application. In fig. 3b, the data processing device 310 for a proximity event in the hands-off detection scene is applied to a micro control unit in a safe driving system of a target vehicle, the safe driving system further comprises a proximity detection sensor and an early warning device which are arranged on a steering wheel of the target vehicle, the micro control unit is respectively connected with the proximity detection sensor and the early warning device, and the data processing device 310 for the proximity event in the hands-off detection scene comprises a communication module 311 and a processing module 312.

The processing module 312 is configured to obtain, by using the communication module 311, initial capacitance data of the target vehicle running process through the proximity detection sensor, where the initial capacitance data includes a capacitance sampling value at each of m sampling moments closest to a current system time, and m is an integer greater than or equal to 1; the method comprises the steps of acquiring target historical information of a first moment in m sampling moments, wherein the target historical information is used for representing a target event which occurs in a target vehicle at the first moment, the first moment is a sampling moment which is before a second moment and is closest to the second moment, the second moment is a sampling moment which is closest to the current system time, the target event comprises a approaching event and a hand-leaving event, the approaching event is used for indicating that the hand of a driver is in a state of touching a steering wheel, and the hand-leaving event is used for indicating that the hand of the driver is in a state of leaving the steering wheel; the capacitance increment value of each sampling moment is determined according to the capacitance sampling value of each sampling moment in the capacitance initial data, so that m capacitance increment values corresponding to the m sampling moments are obtained, the capacitance increment value of any sampling moment refers to the difference value between the first capacitance sampling value of any sampling moment and the second capacitance sampling value of the reference moment of any sampling moment, and the reference moment of any sampling moment refers to the sampling moment adjacent to and before any sampling moment; and determining a target offset for the second time instant from the m capacitance delta values; and determining a real environment reference at the second moment according to the target event and the target offset when the target event is determined according to the target history information, wherein the real environment reference is used for representing an environment capacitance; the real capacitance value at the second moment is determined according to the capacitance sampling value at the second moment in the capacitance initial data and the real environment reference at the second moment; and when the true capacitance value is determined to be less than or equal to a first threshold value, determining that a hands-off event is occurring in the target vehicle; generating early warning information according to the hand-leaving event which is happening, wherein the early warning information is used for indicating the hand-leaving event which is happening; and the early warning device is used for outputting the early warning information so as to remind a driver of the target vehicle of paying attention to the hand-leaving event which occurs. The communication module 311 is used to support interactions between the data processing apparatus 310 for proximity events and other devices in a hands-free detection scenario. As shown in fig. 3b, the data processing device 310 for a proximity event in the hands-off detection scenario may further comprise a storage module 313, the storage module 313 being configured to store program code and data of the data processing device 310 for a proximity event in the hands-on detection scenario.

The processing module 312 may be a processor or controller, such as a central processing unit (Central Processing Unit, CPU), general purpose processor, digital signal processor (Digital Signal Processor, DSP), ASIC, FPGA or other programmable logic device, transistor logic device, hardware components, or any combination thereof. Which may implement or perform the various exemplary logic blocks, modules and circuits described in connection with this disclosure. A processor may also be a combination that performs computing functions, e.g., including one or more microprocessors, a combination of a DSP and a microprocessor, and so forth. The communication module 311 may be a transceiver, an RF circuit, a communication interface, or the like. The storage module 313 may be a memory.

All relevant contents of each scenario related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein. The data processing device 310 for the proximity event in the above-mentioned leave-hand detection scenario may execute the data processing method for the proximity event in the above-mentioned leave-hand detection scenario shown in fig. 2 a.

The above embodiments may be implemented in whole or in part by software, hardware, firmware, or any other combination. When implemented in software, the embodiments described above may be implemented in whole or in part in the form of a program product. The program product comprises one or more computer instructions or programs. When the computer instructions or programs are loaded or executed on a computer, the processes or functions in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer readable storage medium to another, for example, by wired or wireless means from one website site, computer, microcontrol unit, or data center. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a micro control unit, data center, or the like, that contains a set of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium may be a solid state disk.

Fig. 4 is a block diagram of an electronic device according to an embodiment of the present application. As shown in fig. 4, the electronic device 400 may include one or more of the following components: a processor 401, a memory 402, and one or more programs, wherein the one or more programs are stored in the memory 402, which may be configured to implement the methods as described in the above embodiments when executed by the processor 401, the one or more programs comprising instructions for performing the steps in the methods as described in the above embodiments. The electronic device 400 may be a micro control unit in the target vehicle described above.

Processor 401 may include one or more processing cores. The processor 401 connects the various parts within the overall electronic device 400 using various interfaces and lines, performs various functions of the electronic device 400 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 402, and invoking data stored in the memory 402. Alternatively, the processor 401 may be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (FPGA), programmable Logic Array (PLA). The processor 401 may integrate one or a combination of several of a central processing unit (CentralProcessing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a modem, etc. The CPU mainly processes an operating system, a passenger interface, an application program and the like; the GPU is used for being responsible for rendering and drawing of display content; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 401 and may be implemented by a single communication chip.

The Memory 402 may include a random access Memory (Random Access Memory, RAM) or a Read-Only Memory (ROM). Memory 402 may be used to store instructions, programs, code sets, or instruction sets. The memory 402 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (e.g., a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like. The storage data area may also store data or the like created by the electronic device 400 in use.

It is to be appreciated that electronic device 400 may include more or fewer structural elements than those described in the above-described block diagrams, including, for example, a power module, physical key, wiFi (Wireless Fidelity ) module, speaker, bluetooth module, sensor, etc., without limitation.

The embodiment of the present application also provides a computer storage medium, in which a program/instruction is stored, which when executed by a processor, implements part or all of the steps of any one of the methods described in the method embodiments above.

Embodiments of the present application also provide a program product comprising a program/instruction which, when executed by a processor, implements the steps of the method according to the first aspect of the embodiments of the present application.

It should be understood that, in various embodiments of the present application, the sequence numbers of the foregoing processes do not mean the order of execution, and the order of execution of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present application.

In the several embodiments provided in the present application, it should be understood that the disclosed method, apparatus and system may be implemented in other manners. For example, the device embodiments described above are merely illustrative; for example, the division of the units is only one logic function division, and other division modes can be adopted in actual implementation; for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may be physically included separately, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.

The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a micro control unit, or a network device, etc.) to perform part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: u disk, removable hard disk, magnetic disk, optical disk, volatile memory or nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM) which acts as an external cache. By way of example, and not limitation, many forms of random access memory (random access memory, RAM) are available, such as Static RAM (SRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced Synchronous Dynamic Random Access Memory (ESDRAM), synchronous Link DRAM (SLDRAM), direct memory bus RAM (DR RAM), and the like, various mediums that can store program code.

Although the present invention is disclosed above, the present invention is not limited thereto. Variations and modifications, including combinations of the different functions and implementation steps, as well as embodiments of the software and hardware, may be readily apparent to those skilled in the art without departing from the spirit and scope of the invention.

Claims

1. A data processing method for a proximity event in a hands-off detection scene, characterized by being applied to a micro control unit in a safe driving system of a target vehicle, the safe driving system further comprising a proximity detection sensor and an early warning device arranged on a steering wheel of the target vehicle, the micro control unit being respectively connected with the proximity detection sensor and the early warning device, the method comprising:

outputting the early warning information through the early warning device so as to remind a driver of the target vehicle of the hand-off event occurring;

the determining the real environment benchmark at the second moment according to the target event and the target offset comprises the following steps:

determining that the target event is the hands-off event;

comparing the target offset with a fourth threshold corresponding to the hand-off event to obtain a second comparison result;

when the second comparison result is that the target offset is greater than or equal to the fourth threshold value, determining that the real environment reference at the second moment is the sum of the real environment reference at the first moment and a third correction parameter corresponding to the hands-off event;

and when the second comparison result is that the target offset is smaller than the fourth threshold, determining that the real environment reference at the second moment is the capacitance sampling value at the second moment when the target offset is smaller than or equal to 0, or determining that the real environment reference at the second moment is the capacitance sampling value at the first moment when the target offset is larger than 0.

2. The method of claim 1, wherein said determining a true environmental benchmark for said second time instant from said target event and said target offset comprises:

determining that the target event is the proximity event;

determining a reference environment datum at the second moment according to the target offset;

comparing the reference environment with the capacitance sampling value at the second moment to obtain a first comparison result;

when the first comparison result is that the reference environment datum is larger than the capacitance sampling value at the second moment, determining that the real environment datum at the second moment is the capacitance sampling value at the second moment;

and when the first comparison result is that the reference environment datum is smaller than or equal to the capacitance sampling value at the second moment, determining the real environment datum at the second moment as the reference environment datum.

3. The method of claim 2, wherein said determining the reference environment for the second time based on the target offset comprises:

when the target offset is greater than or equal to a second threshold value corresponding to the approaching event, determining that the reference environment datum is the sum value of the real environment datum at the first moment and a first correction parameter corresponding to the approaching event; or alternatively, the process may be performed,

When the target offset is smaller than a second threshold corresponding to the approaching event and larger than a third threshold corresponding to the approaching event, determining that the reference environment datum is the sum of the real environment datum at the first moment and the target offset, wherein the third threshold is smaller than the second threshold; or alternatively, the process may be performed,

and when the target offset is smaller than or equal to a third threshold value corresponding to the approaching event, determining that the reference environment standard is the sum value of the real environment standard at the first moment and a second correction parameter corresponding to the approaching event.

4. The method of claim 1, wherein after determining the actual capacitance value at the second time based on the capacitance sample value at the second time and the actual environment reference at the second time in the capacitance initial data, the method further comprises:

when the real capacitance value is determined to be larger than the first threshold value, determining that a proximity event is occurring in the target vehicle;

detecting whether the early warning device is in a closed state or not when determining that a proximity event is occurring in the target vehicle;

if not, a first instruction is sent to the early warning device to close the early warning device.

5. The method of claim 1, wherein outputting the pre-warning information by the pre-warning device comprises:

when the target event is determined to be the approaching event, outputting the early warning information according to the first early warning times through the early warning device;

when the target event is determined to be the hand-off event, outputting the early warning information according to second early warning times by the early warning device, wherein the second early warning times are larger than the first early warning times.

6. The method according to any one of claims 1-5, wherein the pre-warning device comprises a voice broadcasting device and/or a display device, and the outputting the pre-warning information by the pre-warning device comprises:

broadcasting the early warning information through the voice broadcasting device; and/or the number of the groups of groups,

and displaying the early warning information through the display device.

7. A data processing device for a proximity event in an off-hand detection scenario for implementing the data processing method for a proximity event in an off-hand detection scenario according to any one of claims 1 to 6, characterized by a micro control unit applied in a safe driving system of a target vehicle, the safe driving system further comprising a proximity detection sensor and an early warning device provided on a steering wheel of the target vehicle, the micro control unit being connected with the proximity detection sensor and the early warning device, respectively, the data processing device for a proximity event in an off-hand detection scenario comprising:

8. An electronic device comprising a processor, a memory, and one or more programs stored in the memory and configured to be executed by the processor, the one or more programs comprising instructions for performing the steps of the method of any of claims 1-6.

9. A computer readable storage medium having stored thereon a program/instruction, which when executed by a processor, implements the steps of the method of any of claims 1-6.