KR102632533B1 - System and method for providing video-based driving posture guidance and warnings - Google Patents

Abstract

The present invention relates to a system and method for providing image-based driving posture guidance and warnings.
The image-based driving posture guide and warning provision system according to the present invention uses an input unit that acquires the driver's image information and the results of analyzing the driver's image information to determine the driver's posture, seat (backrest) angle, headrest height, and risk. It includes a judgment unit that determines whether to take action and an information display unit that provides guide information and warning information according to the judgment result of the judgment unit.

Description

System and method for providing video-based driving posture guidance and warnings {SYSTEM AND METHOD FOR PROVIDING VIDEO-BASED DRIVING POSTURE GUIDANCE AND WARNINGS}

The present invention relates to a system and method for providing image-based driving posture guidance and warnings.

Due to the driver's incorrect driving posture and risky behavior, there is a risk of accidents not only worsening the individual's health condition.

Even though drivers acquire information about correct driving posture through various media, they unconsciously adopt incorrect seat (backrest) angle, headrest height, and driving posture while driving, causing pain in the neck, shoulders, and back.

According to the prior art, it simply provides a hands-on warning about the steering wheel, but the driver can abuse the hands-on recognition function by engaging in dangerous actions such as operating the steering wheel with the knee or one finger, resulting in an accident. There is a risk and there are limitations to improving the driver's risky behavior.

The present invention was proposed to solve the above-described problems, and is based on images acquired through a single or multiple network cameras placed at preset locations, and is based on the driver's risky behavior and incorrect posture or inappropriate seat that adversely affects his health. The purpose is to provide a system and method that can ensure the driver's health, driving safety, and convenience by determining the (backrest) angle and headrest height and providing guide information and warnings related to posture/behavior in real time. .

The image-based driving posture guide and warning provision system according to the present invention includes an input unit that acquires the driver's image information, a judgment unit that determines the driver's posture and risky behavior using the results of analyzing the driver's image information, and a judgment unit. It includes an information display unit that provides guide information and warning information according to the judgment result.

The input unit includes a health status information input unit that acquires health status information of the driver, and the determination unit generates guide information and warning information about correct posture using the health status information and posture.

The input unit acquires a frontal image and a side image of the driver using a single or multiple network cameras placed at a preset location.

The input unit acquires an image of a preset area near the steering wheel.

The determination unit uses the acquired image of a preset area near the steering wheel to determine whether the steering wheel is hands-on and whether there is a risky behavior situation that abuses the steering wheel hands-on recognition function.

The display unit displays the guide information and warning information using at least one of a head-up display and a digital cluster.

The method for providing an image-based driving posture guide and warning according to the present invention includes the steps of (a) acquiring a driver's driving image using a single or multiple network cameras placed in the vehicle, and (b) using the driving image to determine the driver's It includes a step of analyzing posture information and dangerous behavior posture information, and (c) providing guide information and warning information regarding correct posture and risky behavior prevention according to the analysis results in step (b).

In step (a), the front and side images of the driver are acquired, and in step (b), the driver's incorrect posture is determined using the front and side images.

The step (a) acquires an image of a preset area near the steering wheel, and the step (b) uses the image of the preset area near the steering wheel to determine whether there is a situation involving abuse of the steering wheel hands-on function. judge.

According to the present invention, it has the effect of preventing traffic accidents that occur when drivers using ADAS systems such as LKAS and HDA abuse the steering wheel hands-on recognition function, maintaining the driver's awareness of the hands-on obligation, and ensuring that the driver is It is possible to provide guidance information and warning information to monitor risky behavior and correct it.

We improve driver convenience and satisfaction by determining posture or inappropriate seat (backrest) angle and headrest height that can cause various joint diseases in drivers (especially drivers who drive for long periods of time) and providing guide information to prevent these in real time. It has an improving effect.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 illustrates an image-based driving posture guide and warning providing system according to an embodiment of the present invention.
Figure 2 shows a warning about a situation where the hands-on recognition function is abused according to an embodiment of the present invention.
Figure 3 shows a side image-based posture guide according to an embodiment of the present invention.
Figure 4 shows a frontal image-based posture guide according to an embodiment of the present invention.
Figure 5 shows a process for providing posture guide and warning according to an embodiment of the present invention.
Figure 6 shows a process for monitoring risky behavior and providing warnings according to an embodiment of the present invention.

The above-mentioned object and other objects, advantages and features of the present invention, and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings.

However, the present invention is not limited to the embodiments disclosed below and can be implemented in various different forms. The following embodiments are merely intended to convey to those skilled in the art the purpose of the invention, It is only provided to easily inform the configuration and effect, and the scope of rights of the present invention is defined by the description of the claims.

Meanwhile, the terms used in this specification are for describing embodiments and are not intended to limit the present invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” means that the mentioned element, step, operation and/or element is dependent on the presence of one or more other elements, steps, operations and/or elements. Or it is not excluded that it is added.

1 illustrates an image-based driving posture guide and warning providing system according to an embodiment of the present invention.

According to an embodiment of the present invention, based on a single or multiple network cameras placed at preset positions (driver's dashboard, B-pillar, passenger's A-pillar, etc.), the driver's risky behavior and incorrect posture that adversely affect health are detected. It is possible to ensure driving safety and convenience for the driver by determining inappropriate seat (backrest) angle and headrest height and providing guide information and warning information in real time through the head-up display, digital cluster, etc.

The input unit 100 includes a health status information input unit 110, a driver posture acquisition unit 120, and a risky behavior confirmation unit 130.

The health status information input unit 110 receives personal physical information (height, weight, sitting height), chronic disease, accident history, etc. entered by the driver before driving. Alternatively, the health status information input unit 110 may obtain personal health status information from a sensor or wearable device placed in the car. According to an embodiment of the present invention, a driving posture suitable for each individual's health condition is guided by considering the driver's health condition information.

The driver posture acquisition unit 120 acquires the driver's front image and the driver's side image from the first camera disposed in front of the driver's seat dashboard, the rear-view mirror, and the second camera disposed in the middle of the passenger seat A-pillar, respectively.

The risky behavior confirmation unit 130 acquires an image of a preset area near the steering wheel using a camera placed at the top of the driver's seat B-pillar or another location that can acquire an image of the steering wheel area.

The determination unit 200 includes a driver posture determination unit 210 and a risky behavior determination unit 220.

The driver posture determination unit 210 uses the driver posture image information acquired through the driver posture acquisition unit 120 and the driver's health status information obtained through the health status information input unit 110 to determine the current driver's posture. Determine whether the posture causes diseases such as neck, shoulder, and back pain or increases fatigue (e.g., driver's posture with maximum contact with the steering wheel or driver's posture lying backwards too much), and provides posture guidance if the posture is determined to be unhealthy. Information and warning information are generated and transmitted to the information display unit 300. At this time, unhealthy postures are indicated in red and postures that can be improved are indicated in green graphics.

The seat (backrest) angle and headrest height determination unit 230 receives the driver's front image and the driver's side image from the first camera disposed in front of the driver's dashboard, the rear-view mirror, and the second camera disposed in the middle of the passenger seat A-pillar, respectively. is obtained to determine whether it is an appropriate seat (backrest) angle or an appropriate headrest height to alleviate whiplash injuries in the event of a rear-end collision, generate appropriate guide information and warning information, and transmit them to the information display unit 300.

The risky behavior determination unit 220 determines whether the driver's hands are on the steering wheel, knee manipulation, finger manipulation, or object insertion situations that abuse the hands-on recognition function, based on the image information acquired by the risky behavior confirmation unit. If it is confirmed that a risky behavior has occurred as a result of risky behavior monitoring, guide information and warning information are generated to prevent risky behavior and are transmitted to the information display unit 300. At this time, dangerous behavior is indicated in red and correct hands-on posture is indicated in green.

The information display unit 300 includes a head-up display 310 and a digital cluster 320, and visually displays guide and warning information on correct posture determined based on images and guide and warning information on preventing dangerous behavior in real time. Display.

According to an embodiment of the present invention, surrounding traffic situation information is received using front and side cameras. The determination unit 200 controls the timing of providing guide information and warning information by considering surrounding traffic situation information along with health status information, driver posture information, and risky behavior confirmation information. For example, as a result of analysis of surrounding traffic situation information, the point in time that does not interfere with driving, such as waiting at a signal or in traffic, is identified, and guide information and guide information are provided through the head-up display 310 or digital cluster 320 at that point. Be sure to provide warning information. In addition, considering information on surrounding traffic conditions, a warning is issued in cases where the risk of an accident is high (for example, on a curved road and there is a dangerous object ahead, so the steering wheel must be turned more than a certain angle) or when there is a dangerous action (knee operation). It is possible to increase the intensity of provision (for example, by changing warning information displayed in red to displayed in red and with a highlight on). In addition, when increasing the intensity of warning provision, it is possible to provide additional warnings in various forms by providing a warning sound, seat vibration, etc. in addition to a visual display.

Figure 2 shows a warning about a situation where the hands-on recognition function is abused according to an embodiment of the present invention.

In situations where a driver uses the LKAS (Lane Keeping Assist System), there may be cases where the hands-on recognition function is abused by inserting a water bottle instead of directly performing hands-on.

At this time, if the image is acquired through a camera placed at the top of the driver's seat B-pillar or in another location that can capture images of the steering wheel area, and the video analysis results are used to determine that the hands-on recognition function is being abused, , Video information near the steering wheel and information on action methods are displayed and provided in real time on the digital cluster.

Figure 3 shows a side image-based posture guide according to an embodiment of the present invention.

When a driver drives for a long time with his head forward and his back bent, the neck joints, head position, and forward tilt angle of the neck are analyzed based on the driver's side image, and joint diseases that may be caused by this are analyzed. A posture guide to prevent this is displayed on the head-up display 310 or digital cluster 320 and provided in real time.

Figure 4 shows a frontal image-based posture guide according to an embodiment of the present invention.

When the driver drives for a long time with his head tilted to the left and leaning on his left hand, the determination unit 200 generates correct posture guide information based on the image acquired by the driver posture acquisition unit located in front of the driver's seat dashboard. The head-up display 310 displays images and correct posture guide information to prevent neck joint disease.

Figure 5 shows a process for providing posture guide and warning according to an embodiment of the present invention.

Step S501 acquires driver health status information. At this time, the driver can input his or her information through the input interface, and it is possible to obtain biometric signals using a wearable device, etc.

Step S502 acquires the driver's side image and front image.

Step S503 determines the driver's posture using the driver's health status information obtained in step S501 and the driver image obtained in step S502.

Step S504 checks whether the driver's posture is incorrect and whether the seat (backrest) angle and headrest height are appropriate, and step S505 is a guide to correct incorrect posture or seat (backrest) angle and headrest height. Controls display of information and warning information through the display unit.

Step S506 checks whether the correct posture is taken according to the instructions and whether the seat (backrest) angle and headrest height are appropriate. If the correct posture is not taken or the seat (backrest) angle and headrest height are inappropriate, the posture in step S505 or Guide information and warning information related to seat (backrest) angle and headrest height are continuously displayed. At this time, if the correct posture, seat (backrest) angle, and headrest height are not taken despite the guidance, the form of provision of guide information and warning information may change. For example, instead of displaying red graphics, the display may change to red and a flashing highlight. It is possible to display it graphically.

Figure 6 shows a process for monitoring risky behavior and providing warnings according to an embodiment of the present invention.

Step S601 acquires driver behavior information. For example, by acquiring an image of a preset area near the steering wheel, information about poor gripping of the steering wheel, such as knee driving or finger manipulation, is obtained.

Step S602 determines risky behavior based on video information.

Step S603 checks whether it is a dangerous behavior, and if it is a dangerous behavior, step S604 controls the display of guide information and warning information through the display unit to prevent the risky behavior from continuing.

Step S605 checks whether the correct action was taken according to the guidance, and if the correct action was not taken, guide information and warning information related to the action in step S604 are continuously displayed. At this time, if the correct action is not taken despite the guidance, the form of provision of guide information and warning information may change. For example, it is possible to display a graphic in red with a red color and a flashing highlight.

Meanwhile, the image-based driving posture guide and method for providing warnings according to an embodiment of the present invention may be implemented in a computer system or recorded on a recording medium. A computer system may include at least one processor, memory, user input device, data communication bus, user output device, and storage. Each of the above-described components communicates data through a data communication bus.

The computer system may further include a network interface coupled to the network. A processor may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in memory and/or storage.

Memory and storage may include various types of volatile or non-volatile storage media. For example, memory may include ROM and RAM.

Therefore, the method for providing image-based driving posture guidance and warnings according to an embodiment of the present invention can be implemented in a method executable on a computer. When the method for providing an image-based driving posture guide and warning according to an embodiment of the present invention is performed on a computer device, computer-readable instructions may perform the method for providing an image-based driving posture guide and warning according to the present invention.

Meanwhile, the image-based driving posture guide and warning providing method according to the present invention described above can be implemented as computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording media storing data that can be deciphered by a computer system. For example, there may be read only memory (ROM), random access memory (RAM), magnetic tape, magnetic disk, flash memory, and optical data storage devices. Additionally, the computer-readable recording medium can be distributed to a computer system connected through a computer communication network, and stored and executed as a code that can be read in a distributed manner.

A method of providing an image-based driving posture guide and warning according to an embodiment of the present invention includes the steps of (a) acquiring a driver's driving image using a single or multiple network cameras placed in the vehicle, and (b) using the driving image. (c) analyzing the driver's posture information and risky behavior seat (backrest) angle and headrest height information; and (c) determining correct posture or seat (backrest) angle and headrest height according to the analysis results in step (b) above. It includes steps to provide guide information and warning information regarding risk behavior prevention. In step (a), the front and side images of the driver are acquired, and in step (b), the driver's incorrect posture or inappropriate seat (backrest) angle and headrest height are determined using the front and side images. . The step (a) acquires an image of a preset area near the steering wheel, and the step (b) uses the image of the preset area near the steering wheel to determine whether there is a situation involving abuse of the steering wheel hands-on function. judge.

Claims (9)

An input unit that acquires image information of the driver and obtains health status information of the driver;
The results of analyzing the driver's image information are used to determine the driver's posture, seat angle, headrest height, and risky behavior, and the health status information and posture are used to generate guide information and warning information about correct posture. a judgment unit that does; and
An information display unit providing the guide information and warning information according to the judgment result of the determination unit,
The input unit receives personal physical information, chronic disease, and accident history information entered by the driver before driving, and obtains personal health status information from sensors and wearable devices placed in the car,
The determination unit considers the health status information and provides the guide information on a driving posture appropriate for the individual driver's health condition, determines whether the headrest height is appropriate to alleviate whiplash injuries in the event of a rear collision, and provides the guide information and warning. Providing information, controlling the timing of provision of the guide information and warning information by considering surrounding traffic situation information, and controlling the intensity of warning provision.
A video-based driving posture guide and warning system.
delete According to paragraph 1,
The input unit acquires frontal and side images of the driver using a network camera placed at a preset location.
A video-based driving posture guide and warning system.
According to paragraph 1,
The input unit acquires an image of a preset area near the steering wheel.
A video-based driving posture guide and warning system.
According to clause 4,
The determination unit uses the acquired image of a preset area near the steering wheel to determine whether the steering wheel is hands-on and whether there is a risky behavior situation that abuses the steering wheel hands-on recognition function.
A video-based driving posture guide and warning system.
According to paragraph 1,
The display unit displays the guide information and warning information using at least one of a head-up display and a digital cluster.
A video-based driving posture guide and warning system.
delete delete delete