KR102596393B1 - Driving assistance method and apparatus for preventing drowsy driving based on in-vehicle ethernet - Google Patents

Abstract

This specification relates to a driving assistance method and device for preventing drowsy driving, and more specifically, to a driving assistance method and device for preventing drowsy driving based on automotive Ethernet. A driving assistance device according to an embodiment of the present specification includes a motion recognition module that is disposed inside a vehicle and detects the motion of the driver riding in the vehicle, recognizes an external object of the vehicle, and determines the distance between the vehicle and the external object. An abnormal motion detection module that compares and determines whether the vehicle is operating abnormally, and selectively generates electrical signals of wake-up, sleep, or power-off based on the driver's motion and the abnormal operation results. It includes a signal control unit that generates and transmits a signal, and a driving unit that performs different notification operations to the driver through a driving device according to the electric signal.

Description

Driving assistance method and device for preventing drowsy driving based on automotive Ethernet {DRIVING ASSISTANCE METHOD AND APPARATUS FOR PREVENTING DROWSY DRIVING BASED ON IN-VEHICLE ETHERNET}

This specification relates to a driving assistance method and device for preventing drowsy driving, and more specifically, to a driving assistance method and device for preventing drowsy driving based on automotive Ethernet.

Recently, automobiles, as a means of transportation, have made rapid progress in the field of electronic control, such as improving vehicle stability and efficiency by precisely controlling various functions inside the vehicle through the computer mounted on the vehicle. This was done.

Vehicle computing utilized in this electronic control area can be used in a variety of fields, including powertrain networks for motor control, body safety networks for airbags and door controls, and networks that control the infotainment field.

Previously, various communication methods such as CAN (Controller Area Network), LIN (Loacal Interconnect Network), FlexRay, and MOST (Media Oriented Systems Transport) were applied to vehicles to support vehicle computing.

However, in the case of conventional CAN, the maximum data transmission rate is 1Mbps, whereas in the case of autonomous driving-based driving assistance systems, communication and data processing of a lot of sensor data are required, so the problem is that CAN communication cannot meet the required data transmission amount. there is.

Therefore, there is a need for automotive Gigabit Ethernet technology that supports sufficient data transmission bandwidth for transmission of video data, etc. in a driving assistance system and is capable of real-time two-way communication.

Additionally, in the case of driving assistance systems, in-vehicle navigation system, Adaptive Cruise Control or Smart Cruise Control, Lane Departure Warning System or Lane Keeping Assist System, etc. Various technologies reduce driver fatigue and help drive safely.

However, these technologies are only based on information obtained from outside the vehicle and do not perform driving assistance functions by considering the driver's condition inside the vehicle. In the case of drowsy driving, it is a factor that cannot be solved through external crackdowns such as traffic regulations or police, and the need for technology that prevents drivers from drowsy driving and performs driving assistance functions depending on the driver's condition is increasing.

The purpose of this specification is to provide a driving assistance method and device that can prevent drivers from drowsy driving while driving using a vehicle Ethernet network.

Additionally, the purpose of this specification is to provide a driving assistance method and device that can accurately determine whether a driver is drowsy in real time using the vehicle's internal camera and lane departure detection module.

The purposes of the present specification are not limited to the purposes mentioned above, and other purposes and advantages of the present specification that are not mentioned can be understood through the following description and will be more clearly understood by the examples of the present specification. Additionally, it will be readily apparent that the objects and advantages of the present specification can be realized by the means and combinations thereof indicated in the patent claims.

A driving assistance device according to an embodiment of the present specification includes a motion recognition module that is disposed inside a vehicle and detects the motion of the driver riding in the vehicle, recognizes an external object of the vehicle, and determines the distance between the vehicle and the external object. An abnormal motion detection module that compares and determines whether the vehicle is operating abnormally, and selectively generates electrical signals of wake-up, sleep, or power-off based on the driver's motion and the abnormal operation results. It includes a signal control unit that generates and transmits a signal, and a driving unit that performs different notification operations to the driver through a driving device according to the electric signal.

In one embodiment of the present specification, the signal control unit includes a MAC layer (Medium Access Control Layer) and a PHY layer (Physical Layer), and the wakeup or sleep electrical signal is generated by GMII (gigabit MII) between the MAC layer and the PHY layer. , is transmitted via a medium independent interface (MII) including at least one of reduced GMII (RGMII), serial GMII (SGMII), and 10 GMII (XGMII).

In one embodiment of the present specification, a medium independent interface is formed through mapping electrical signals of the RGMII to the GMII.

In one embodiment of the present specification, the driver changes at least one of a wake-up state variable, a power-saving state variable, a power-off state variable, and a sleep state variable according to an electrical signal to perform different notification operations to the driver.

In one embodiment of the present specification, the driver's motion includes at least one of the driver's eye blink characteristics, frequency, number of times, face direction, neck and shoulder angle, and head tilt.

The driving assistance device according to an embodiment of the present specification includes a speed measurement module that measures the driving speed of the vehicle, and an abnormal motion detection module detects the vehicle and the external object when the speed of the vehicle exceeds a preset reference speed. Compare the distance with to determine whether the vehicle is operating abnormally.

A driving assistance method according to an embodiment of the present specification includes the steps of a motion recognition module detecting the motion of the driver riding in the vehicle from inside the vehicle, an abnormal motion detection module recognizing an object external to the vehicle, and the vehicle and the Comparing the distance to an external object to determine whether the vehicle is operating abnormally, the signal control unit wakes up, sleeps, or powers off based on the driver's motion and the abnormal operation result. It includes a step of selectively generating and transmitting an electrical signal (Power_off) and a step of the driving unit performing different notification operations to the driver through the driving device according to the electric signal.

In one embodiment of the present specification, the signal control unit includes a MAC layer (Medium Access Control Layer) and a PHY layer (Physical Layer), and the wakeup or sleep electrical signal is generated by GMII (gigabit MII) between the MAC layer and the PHY layer. , is transmitted via a medium independent interface (MII) including at least one of reduced GMII (RGMII), serial GMII (SGMII), and 10 GMII (XGMII).

In one embodiment of the present specification, a medium independent interface is formed through mapping electrical signals of the RGMII to the GMII.

In one embodiment of the present specification, the driving unit changes at least one of a wake-up state variable, a power-saving state variable, a power-off state variable, and a sleep state variable according to an electrical signal to perform different notification operations to the driver.

In one embodiment of the present specification, the driver's motion includes at least one of the driver's eye blink characteristics, frequency, number of times, face direction, neck and shoulder angle, and head tilt.

The driving assistance method according to an embodiment of the present specification includes a speed measurement module measuring the driving speed of the vehicle, and an abnormal motion detection module detecting the vehicle when the speed of the vehicle exceeds a preset reference speed. By comparing the distance to the external object, it is determined whether the vehicle is operating abnormally.

The driving assistance method and device according to an embodiment of the present specification can prevent a driver from drowsy driving while driving by using a vehicle Ethernet network.

Additionally, the driving assistance method and device according to an embodiment of the present specification can accurately determine whether the driver is drowsy in real time using the vehicle's internal camera and lane departure detection module.

1 is a block diagram of a driving assistance device according to an embodiment of the present specification.
Figure 2 is a diagram showing the MAC layer and PHY layer of the signal control unit in one embodiment of the present specification.
3 and 4 are diagrams showing electrical signal mapping tables of GMII and RGMII in one embodiment of the present specification.
Figure 5 is a table showing state variables in one embodiment of the present specification.
Figure 6 is a diagram showing the operation algorithm of wake-up and sleep electrical signals in one embodiment of the present specification.
Figure 7 is a flowchart of a driving assistance method according to an embodiment of the present specification.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention. While describing each drawing, similar reference numerals are used for similar components.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be named a second component, and similarly, the second component may also be named a first component without departing from the scope of the present invention. The term and/or includes any of a plurality of related stated items or a combination of a plurality of related stated items.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

FIG. 1 is a block diagram of a driving assistance device according to an embodiment of the present specification, FIG. 2 is a diagram showing the MAC layer and PHY layer of the signal control unit in an embodiment of the present specification, and FIGS. 3 and 4 are a block diagram of the driving assistance device according to an embodiment of the present specification. is a diagram showing an electrical signal mapping table of GMII and RGMII in an embodiment of the present specification, Figure 5 is a table showing state variables in an embodiment of the present specification, and Figure 6 is a diagram showing the wakeup and sleep electrical signals in an embodiment of the present specification. This diagram shows the signal operation algorithm. Hereinafter, the driving assistance device of this specification will be described with reference to FIGS. 1 to 6.

The driving assistance device 100 is a device that prevents the driver from drowsy driving while driving using a gigabit Ethernet network for vehicles, and is an advanced driver assistance system (ADAS) or a driver state warning system (Driver State Warning). DSW). In one embodiment, referring to FIG. 1, the driving assistance device 100 includes a motion recognition module 110, an abnormal motion detection module 120, a speed measurement module 130, a signal control unit 140, and a driving unit 150. It can be included.

The motion recognition module 110 is placed inside the vehicle and detects the motion of the driver riding in the vehicle. At this time, the motion recognition module 110 may be a driver state monitoring system (DSM), a facial recognition system using infrared or in-vehicle cameras, or a biometric system that acquires body information such as the driver's heart rate. However, the motion recognition module 110 is not limited to this and may include any device capable of recognizing the driver's motion, whether or not attached to the driver's body.

The driver's motion includes at least one of the driver's eye blink characteristics, frequency, number of times, face direction, neck and shoulder angle, and head tilt degree. The motion recognition module 110 can detect drowsy driving based on the driver's motion. For example, the motion recognition module 110 may compare the driver's eye blink count, period, and heart rate with the reference number, reference period, and reference heart rate and determine drowsy driving if there is a difference of more than 10%.

The abnormal operation detection module 120 recognizes an external object of the vehicle and determines whether the vehicle is operating abnormally by comparing the distance between the vehicle and the external object. The abnormal motion detection module 120 uses a lane departure detection sensor that detects whether the vehicle has deviated from the driving lane by more than a standard distance or an adaptive forward control that recognizes the gap to the vehicle in front using a radar mounted on the front of the vehicle. The device may be a pedestrian protection device that operates in blind spots or when the distance to pedestrians is below a certain distance. At this time, the external objects of the vehicle may be a lane, a vehicle in front, a pedestrian, or a blind spot feature.

The speed measurement module 130 measures the driving speed of the vehicle. The speed measurement module 130 may be a distance sensor module using a laser or may measure the driving speed of the vehicle by measuring the number of rotations per unit time of the vehicle wheels. At this time, if the vehicle's driving speed exceeds a preset reference speed, the abnormal operation detection module 120 determines whether the vehicle is operating abnormally by comparing the distance between the vehicle and an external object.

For example, even if the vehicle temporarily deviates from the lane at low speed for reasons such as parking, if it is judged to be an abnormal operation, an unwanted notification operation may be performed. Accordingly, the abnormal operation detection module 120 can more accurately determine abnormal operation of the vehicle by imposing a speed limit condition when determining abnormal operation.

The signal control unit 140 selectively generates an electrical signal based on the driver's motion and abnormal operation results. More specifically, the driving assistance device of this specification is a device using a vehicle Gigabit Ethernet network, and the signal control unit 140 includes a MAC layer (Medium Access Control Layer) and a PHY layer (Physical Layer), and wakeup or Sleep electrical signals are transmitted through a medium independent interface (MII) between the MAC layer and the PHY layer. Here, the medium independent interface may include at least one of gigabit MII (GMII), reduced GMII (RGGMII), serial GMII (SGMII), and 10 GMII (XGMII).

Referring to FIG. 2, the RS layer (Reconciliation sub-layer) included in the MAC layer and the PCS layer (Physical Coding Sub-layer) included in the PHY layer transmit electrical signals through GMII and RGMII. That is, electrical signals are transmitted through a transmit path from the RS layer to the PCS layer and a receive path from the PCS layer to the RS layer.

The RGMII interface uses half the number of electrical signal lines compared to the GMII interface. Therefore, when replacing some sections of GMII with RGMII, costs can be reduced and economic efficiency can be improved when manufacturing the signal control unit 140.

Meanwhile, in order to transmit electrical signals through GMII and RGMII, electrical signal lines must be mapped through a mapping table as shown in FIGS. 3 and 4.

Specifically, Figure 3(a) shows an electrical signal mapping table on the transmitter side of RGMII in the transmission path, and Figure 3(b) shows an electric signal mapping table on the receiver side of RGMII in the transmission path. represents. In addition, Figure 4 (a) shows an electrical signal mapping table on the receiver side of RGMII in the reception path, and Figure 3 (b) shows an electric signal mapping table on the transmitter side of RGMII in the reception path. indicates

Meanwhile, the electrical signal may include a wake-up, sleep, or power_off electrical signal. Wake-up, sleep, and power-off electrical signals change the state variables of the driving unit 150 so that the driving unit 150 can perform a notification operation to the driver, which will be described later.

The driving unit 150 performs different notification operations to the driver through the driving device according to the wake-up electrical signal. Here, there may be a plurality of driving devices and driving units, and a specific driving unit that receives the wake-up electrical signal may transmit the electrical signal to other driving units, allowing the plurality of driving units to perform different notification operations. At this time, electrical signals between driving units may be transmitted through forwarding glue logic.

Notification operations may differ depending on the abnormal motion detection module and driving device, and may be performed through a plurality of driving devices.

For example, if the abnormal motion detection module is a lane departure detection sensor, the driving unit 150 can control the vehicle steering device, which is a driving device, to maintain the lane, and at the same time, open the vehicle window with respect to the window control module, which is a driving device, so that the driver can It can be controlled to provide outside air to the

In addition, when the abnormal motion detection module is a pedestrian protection device, the driving unit 150 can control the brake module, which is a driving device, to make an emergency stop, and at the same time, control the speaker module, which is a driving device, to provide a notification sound to the driver. You can.

As such, the driving assistance device 100 of the present specification, unlike conventional CAN communication for vehicles, applies gigabit Ethernet technology to vehicles to provide large data such as image data generated from multiple motion recognition modules based on sufficient data transmission bandwidth and multiple Data generated from the abnormal motion detection module can be transmitted simultaneously, and real-time two-way communication can be implemented.

Meanwhile, as shown in FIG. 5, the driver 150 operates at least one of a wake-up state variable (WakeUp_request), a power-saving state variable (pd_status), a power-off state variable (power_off_entity), and a sleep state variable (link_sleep_success) according to the electrical signal. By changing the state value, different operation modes can be performed for the driver.

The wakeup state variable (WakeUp_request) has a state value of FALSE when a wakeup electrical signal is not received, and changes to a state value of TRUE when a wakeup electrical signal is received.

The power-off state variable (power_off_entity) has a state value of FALSE when a power-off signal is not received, and changes to a state value of TRUE when a power-off signal is received.

The sleep state variable (link_sleep_success) has a status value of FALSE when a sleep electrical signal is not received, and changes to a status value of TRUE when a sleep electrical signal is received.

The power saving status variable (pd_status) has a status value of TRUE or FALSE depending on the operating mode of the driving device. That is, as shown in FIG. 6, the operating mode of the driving device includes sleep mode and normal mode, and the state value of the wake-up state variable is TRUE or the state value of the power-off state variable is TRUE. If FALSE, the power saving status variable has a status value of TRUE and the driving device operates in sleep mode.

In contrast, when the state value of the sleep state variable is TRUE or the state value of the power-off state variable is TRUE, the power saving state variable has a state value of FALSE and the driving device operates in normal mode.

In this way, the driving assistance device 100 of the present specification can efficiently reduce the power consumption of the driving device by changing the sleep mode in the standby state.

Figure 7 is a flowchart of a driving assistance method according to an embodiment of the present specification.

Referring to the drawing, the driving assistance method of this specification relates to a method of preventing the driver from drowsy driving while driving using a vehicle Gigabit Ethernet network. The driving assistance device is a method of preventing drowsy driving of the driver inside the vehicle. Detect motion (S110).

Additionally, the driving assistance device recognizes an external object of the vehicle and determines whether the vehicle is operating abnormally by comparing the distance between the vehicle and the external object (S120).

Afterwards, the driving assistance device selectively generates electrical signals of Wake-up, Sleep, or Power_off based on the driver's motion and abnormal operation results (S140), and according to the electrical signals Different notification operations are performed to the driver through the driving device (S150).

In this way, the driving assistance method and device according to an embodiment of the present specification can prevent the driver from drowsy driving while driving by using a vehicle Ethernet network.

Additionally, the driving assistance method and device according to an embodiment of the present specification can accurately determine whether the driver is drowsy in real time using the vehicle's internal camera and lane departure detection module.

As described above, the present invention has been described with reference to the illustrative drawings, but the present invention is not limited to the embodiments and drawings disclosed herein, and various modifications may be made by those skilled in the art within the scope of the technical idea of the present invention. It is obvious that transformation can occur. In addition, although the operational effects according to the configuration of the present invention were not explicitly described and explained while explaining the embodiments of the present invention above, it is natural that the predictable effects due to the configuration should also be recognized.

Claims (12)

In a device that prevents drivers from drowsy driving while driving using a Gigabit Ethernet network for vehicles,
a motion recognition module disposed inside the vehicle to detect the motion of the driver riding the vehicle;
An abnormal motion detection module that recognizes an external object of the vehicle and compares the distance between the vehicle and the external object to determine whether the vehicle is operating abnormally;
a signal control unit that selectively generates and transmits a wake-up signal, a sleep signal, or a power_off signal based on the driver's motion and the abnormal operation result; and
A driving unit that performs different notification operations to the driver through a driving device according to the wake-up signal, the sleep signal, or the power-off signal,
If the driver is operating in sleep mode and the power-off signal is not received by the driver for a preset time, the driver changes the operation mode from sleep mode to normal mode,
When the driver is operating in the normal mode and the driver receives the sleep signal or the power-off signal, the driver changes the operation mode from the normal mode to the sleep mode.
Driving assistance devices.
According to paragraph 1,
The signal control unit
It includes a MAC layer (Medium Access Control Layer) and a PHY layer (Physical Layer), and the wake-up or sleep electrical signal is between the MAC layer and the PHY layer. transmitted via a medium independent interface (MII) that includes at least one of GMII) and XGMII (10 GMII).
Driving assistance devices.
According to paragraph 2,
The medium independent interface is
Formed through mapping of electrical signals of the RGMII to the GMII
Driving assistance devices.
According to paragraph 1,
The driving part
Performing different notification operations to the driver by changing at least one of a wake-up state variable, a power-saving state variable, a power-off state variable, and a sleep state variable according to the wake-up signal, the sleep signal, and the power-off signal.
Driving assistance devices.
According to paragraph 1,
The driver's motion is
Including at least one of the driver's eye blink characteristics, frequency, number of times, face direction, neck and shoulder angle, and head tilt degree.
Driving assistance devices.
According to paragraph 1,
It includes a speed measurement module that measures the driving speed of the vehicle,
The abnormal operation detection module determines whether the vehicle is operating abnormally by comparing the distance between the vehicle and the external object when the speed of the vehicle exceeds a preset reference speed.
Driving assistance devices.
In a method of preventing a driver from drowsy driving while driving using a vehicle Gigabit Ethernet network,
A motion recognition module detecting the motion of the driver riding the vehicle inside the vehicle;
An abnormal motion detection module recognizing an external object of the vehicle and comparing the distance between the vehicle and the external object to determine whether the vehicle is operating abnormally;
A signal control unit selectively generating and transmitting a wake-up signal, a sleep signal, or a power_off signal based on the driver's motion and the abnormal operation result;
A driving unit performing different notification operations to the driver through a driving device according to the wake-up signal, the sleep signal, or the power-off signal;
If the driving unit is operating in a sleep mode and the power-off signal is not received by the driving unit for a preset time, changing the operating mode of the driving unit from the sleep mode to the normal mode; and
When the driving unit is operating in normal mode and the driving unit receives the sleep signal or the power-off signal, changing the operating mode of the driving unit from normal mode to sleep mode.
How to assist driving.
In clause 7,
The signal control unit
It includes a MAC layer (Medium Access Control Layer) and a PHY layer (Physical Layer), and the wake-up or sleep electrical signal is between the MAC layer and the PHY layer. transmitted via a medium independent interface (MII) that includes at least one of GMII) and XGMII (10 GMII).
How to assist driving.
According to clause 8,
The medium independent interface is
Formed through mapping of electrical signals of the RGMII to the GMII
How to assist driving.
In clause 7,
The driving part
Performing different notification operations to the driver by changing at least one of a wake-up state variable, a sleep state variable, a power-off state variable, and a sleep state variable according to the wake-up signal, the sleep signal, or the power-off signal.
How to assist driving.
In clause 7,
The driver's motion is
Including at least one of the driver's eye blink characteristics, frequency, number of times, face direction, neck and shoulder angle, and head tilt degree.
How to assist driving.
In clause 7,
A speed measurement module measuring the driving speed of the vehicle,
The abnormal operation detection module determines whether the vehicle is operating abnormally by comparing the distance between the vehicle and the external object when the speed of the vehicle exceeds a preset reference speed.
How to assist driving.

Images