KR20230050535A - Display system and method for improving autonomous driving safety of electric bus - Google Patents

Abstract

The display system for improving the safety of autonomous driving of an electric bus according to the embodiment provides a central information display (CID, Central Information display). In addition, in the embodiment, real-time driver information including the driver's gaze, motion, condition, emotion, and voice is recognized, and the color, layout, information, etc. of the content output to the central information display through the HMI (Human Machine Interface) is changed. In addition, in the embodiment, it is possible to maintain the visibility of the content output to the central information display by changing the output content by grasping the change in illumination due to the surrounding environment and time of the electric bus.

Description

Display system and method for improving autonomous driving safety of electric bus {DISPLAY SYSTEM AND METHOD FOR IMPROVING AUTONOMOUS DRIVING SAFETY OF ELECTRIC BUS}

The present disclosure relates to a display system and method for improving the safety of autonomous driving of electric buses. It relates to an electric bus display system and method that changes the contents and design of contents and recommends an ideal electric bus control method.

Unless otherwise indicated herein, material described in this section is not prior art to the claims in this application, and inclusion in this section is not an admission that it is prior art.

Recently, electric buses can be seen in the downtown area of the metropolitan area. In the past few years, air quality, which is rapidly deteriorating due to fine dust, and interest in climate change after COVID-19 have increased, and electric buses are being actively introduced. Since the electric bus can be driven with only a simple battery and a motor, as shown in FIG. 1, various companies participate in the development of the electric bus and compete, and the electric bus market is growing rapidly. Electric buses can be classified according to the charging method. The battery replacement method, which directly replaces the battery installed on the bus, the wireless charging method, which is wirelessly charged on top of the charging device buried in the road, the TOSA method, which provides instant rapid charging, and the plug-in method, which is generally charged by inserting a charging plug. In the past, research on charging methods of electric vehicles has been actively conducted, but recently, research and development on electric buses to which a state-of-the-art display system is applied is becoming active.

In-vehicle displays, starting with embedded navigation systems in the past, have recently developed into infotainment systems that provide various functions such as digital display of instrument clusters such as fuel amount, speed, and temperature, black box camera screen, and side camera screen. The vehicle display system is expected to become a major function of the vehicle infotainment system as autonomous driving technology develops in the future, such as TV playback and video playback functions, which are limited for safety.

In addition, as the amount of information related to safety and convenience acquired through the driver's vision while driving increases, various advanced display devices that support this are being developed and applied. It is being reborn as a device that exchanges and sometimes consumes. For this reason, it is urgent to research and develop a display system dedicated to electric buses applied to electric buses that are expected to be commercialized in the near future. In particular, it is urgent to research and develop a display system that can effectively deliver various information about autonomous driving sensing and operation in order to make drivers and passengers aware of safety during autonomous driving.

1. Korean Patent Publication No. 10-2021-0056583 (2021.05.20) 2. Korean Patent Publication No. 10-2019-0136151 (2019.12.10)

The display system for improving the safety of autonomous driving of an electric bus according to the embodiment provides a central information display (CID, Central Information display).

In addition, in the embodiment, real-time driver information including the driver's gaze, motion, condition, emotion, and voice is recognized, and the color, layout, information, etc. of the content output to the central information display through the HMI (Human Machine Interface) is changed.

In addition, in the embodiment, it is possible to maintain the visibility of the content output to the central information display by changing the output content by grasping the change in illumination due to the surrounding environment and time of the electric bus.

The display system of the electric bus according to the embodiment is a driving route registered in the electric bus, driving information including surrounding traffic conditions, bus internal information including the number of passengers inside the electric bus, temperature, and humidity information, and the driver's line of sight, eyesight , an information collection module that collects real-time driver information including motion, emotion, voice, and drowsiness; A driving guide generation module for generating a vehicle control guide according to the collected driving information and bus internal information; An autonomous driving control module that compares detailed driving information from the generated vehicle control guide with detailed driving information of an electric bus controlled by the driver in real time and controls the proportion of autonomous driving according to the comparison result; and a display module that changes the output location, color, layout, and composition of contents output to the central information display according to the collected real-time driver information. includes

A method for displaying an electric bus according to another embodiment is (A) a bus including a driving route registered in an electric bus in an information collection module, driving information including surrounding traffic conditions, number of passengers inside the electric bus, temperature, and humidity information. Collecting real-time driver information including internal information and driver's gaze, eyesight, motion, emotion, voice, and drowsiness state; (B) generating a vehicle control guide according to the driving information collected by the driving guide generating module and the internal information of the bus; (C) comparing detailed driving information generated by the vehicle control guide generated by the autonomous driving control module with detailed driving information of the electric bus controlled by the driver in real time, and controlling the proportion of autonomous driving according to the comparison result; and (D) changing the output position, color, layout, and composition of contents output to the central information display according to the real-time driver information collected from the display module. includes

The display system of the electric bus as described above improves the safety of autonomous driving of the electric bus by outputting the optimized vehicle control method to the central information display (CID).

In addition, in the embodiment, by changing the output content according to real-time driver information, the visibility of the output content and the information recognition rate are increased, and the driver can drive in a more comfortable state.

In addition, in the embodiment, driving time and environment are controlled not to affect the output content recognition rate, so that the driver can quickly and comfortably recognize important information while driving.

The effects of the present invention are not limited to the above effects, and should be understood to include all effects that can be inferred from the detailed description of the present invention or the configuration of the invention described in the claims.

1 is a diagram showing various types of electric buses
2 is a data processing block diagram of an electric bus display system according to an embodiment
3 is a data processing flow chart of an electric bus display method according to an embodiment

Advantages and features of the present invention, and methods for achieving them, will become clear with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments make the disclosure of the present invention complete, and common knowledge in the art to which the present invention belongs It is provided to fully inform the holder of the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals designate like elements throughout the specification.

In describing the embodiments of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, terms to be described below are terms defined in consideration of functions in the embodiments of the present invention, which may vary according to the intention or custom of a user or operator. Therefore, the definition should be made based on the contents throughout this specification.

1 is a diagram showing a display system of an electric bus according to an embodiment.

Referring to FIG. 1 , a display system of an electric bus according to an embodiment may include an information collection module 100, a driving guide generating module 200, an autonomous driving control module 300, and a display module 400. there is. The term 'module' used in this specification should be interpreted as including software, hardware, or a combination thereof, depending on the context in which the term is used. For example, the software may be machine language, firmware, embedded code, and application software. As another example, the hardware may be a circuit, processor, computer, integrated circuit, integrated circuit core, sensor, micro-electro-mechanical system (MEMS), passive device, or combination thereof.

The information collection module 100 collects driving information, bus internal information, and real-time driver information. In the embodiment, the driving information is information necessary for driving the electric bus, and may include a driving route, surrounding traffic conditions, and the like. The information inside the bus is state information inside the electric bus, and may include the number of passengers, getting on and off situation information for each stop, temperature and humidity information inside the electric bus, and the like. Real-time driver information is the driver's biometric information that can change according to the driver's condition, and may include the driver's gaze, visual acuity, motion, emotion, voice, drowsiness, and the like. Also, in the embodiment, the information collection module 100 may collect driving detailed information of the electric bus. The driving detailed information is data representing the driving state of the electric bus, such as the speed, acceleration, steering state, and deceleration state of the electric bus.

The driving guide generation module 200 generates an electric bus control guide according to the collected driving information and bus internal information. In an embodiment, the vehicle control guide is recommended driving information of an electric bus for realizing optimal bus driving according to collected driving information and bus internal information. For example, when an obstacle appears ahead or a signal change is expected, a vehicle control guide may be generated as a message recommending deceleration. In the embodiment, specific control values such as deceleration, acceleration, and steering angle may be included in the electric bus control guide. In addition, in an embodiment, the driving guide generation module 200 may determine real-time driver information and body information including the driver's height and weight, and generate a vehicle control guide considering the real-time driver information and body information.

The autonomous driving control module 300 compares detailed driving information generated by the vehicle control guide with detailed driving information of an electric bus controlled by a driver in real time, and controls the proportion of autonomous driving according to the comparison result. In an embodiment, the autonomous driving control module 300 may increase the proportion of autonomous driving in proportion to a difference between detailed driving information obtained by the vehicle control guide and detailed driving information measured in real time. For example, a plurality of section reference values are sequentially set to the difference between detailed driving information by the vehicle control guide and detailed driving information measured in real time, and detailed driving information by the vehicle control guide and detailed driving information measured in real time. Each time the difference value of exceeds the set reference value, the autonomous driving ratio may be improved step by step.

In addition, in the embodiment, the autonomous driving control module 300 controls a value corresponding to the difference between the control amount included in the vehicle control guide and the actual vehicle control value through autonomous driving, so that the electric bus is identical to the vehicle control guide without driver intervention. can drive. For example, if the steering angle value provided by the vehicle control guide is 60 degrees and the steering angle value controlled by the driver is 40 degrees, the steering angle value provided by the vehicle control guide is 60 degrees and the steering angle value controlled by the driver is 40 degrees. Steering control by 20 degrees corresponding to the difference value of is controlled by autonomous driving, so that the vehicle steering control value can be maintained at 60 degrees without driver's intervention.

The display module 400 changes the output position, color, layout, and composition of contents output to the central information display according to the collected real-time driver information. For example, the display module 400 may adjust the output position of driving information contents that the driver must check according to the direction of the driver's gaze. Specifically, when the driver's gaze is directed to the right in the right turn section, the driving information content may be output to the right area of the central information display. In addition, when the driver approaches the central information display, the size of the output content may be adjusted according to the change in the driver's position. In addition, in an embodiment, the display module 400 may more precisely adjust the output position of the content in consideration of the viewing angle that changes according to the body shape of the driver, such as a sitting height.

In addition, the display module 400 can change the color and layout of the contents output to the central information display, and change the brightness and background color of the central information display by identifying the change in illumination due to the surrounding environment and time of the electric bus. For example, when driving at night with low illumination, the color saturation of the output content and the brightness of the central information display are changed to high, and the illumination of the central information display is rapidly lowered due to the external environment such as the shadow of a building during daytime driving, By increasing the self-illumination of the central information display, the driver can continuously check the content displayed on the central information display without changing the settings.

In addition, the display module 400 outputs a comparison result between the generated vehicle control guide and detailed driving information based on the vehicle control guide and detailed driving information of the electric bus controlled by the driver in real time. For example, if the vehicle control guide is created as 'Accel 10 Pro' and the driver's accelerator control amount is 7%, in the embodiment, the layout corresponding to the control amount included in the vehicle control guide corresponds to the actual vehicle control information by the driver. By outputting a control information display icon in which icons are overlapped on the central information display, the driver can accurately check his or her control amount.

Hereinafter, the display method of the electric bus will be described in turn. Since the operation (function) of the display method of the electric bus according to the embodiment is essentially the same as the function of the display system of the electric bus, a duplicate description of FIG. 2 will be omitted.

3 is a data processing flowchart of an electric bus display method according to an embodiment.

In step S100, the driving route registered in the electric bus in the information collection module, driving information including surrounding traffic conditions, bus internal information including the number of passengers inside the electric bus, temperature and humidity information, driver's gaze, eyesight, motion, It collects real-time driver information including emotion, voice, and drowsiness.

In step S200, the vehicle control guide is generated according to the collected driving information and bus internal information in the driving guide generating module.

In step S300, detailed driving information by the vehicle control guide generated by the autonomous driving control module is compared with detailed driving information of the electric bus controlled by the driver in real time, and the proportion of autonomous driving is controlled according to the comparison result. For example, in step S300 , the autonomous driving control ratio may be increased in proportion to a difference between detailed driving information obtained by the vehicle control guide and detailed driving information measured in real time. In addition, in step S300, real-time driver information and body information including the driver's height and weight may be identified, and a vehicle control guide considering the real-time driver information and body information may be generated.

In step S400, the output location, color, layout, and composition of contents output to the central information display are changed according to the real-time driver information collected from the display module. In the embodiment, in step S400, it is possible to change the color and layout of the contents output to the central information display, and change the brightness and background color of the central information display by grasping the change in illumination due to the surrounding environment and time of the electric bus. In addition, in step S400, a result of comparing the generated vehicle control guide and driving detailed information by the vehicle control guide with detailed driving information of the electric bus controlled by the driver in real time may be output.

The display system of the electric bus as described above improves the safety of autonomous driving of the electric bus by outputting the optimized vehicle control method to the central information display (CID).

In addition, in the embodiment, by changing the output content according to real-time driver information, the visibility of the output content and the information recognition rate are increased, and the driver can drive in a more comfortable state. In addition, in the embodiment, the driving time and environment are controlled so that the output content recognition rate is not affected, so that the driver can quickly and comfortably recognize important information while driving.

The disclosed content is only an example, and can be variously modified and implemented by those skilled in the art without departing from the subject matter of the claim claimed in the claims, so the protection scope of the disclosed content is limited to the specific not limited to the examples.

Claims (10)

In the display system of the electric bus,
The driving route registered in the electric bus, driving information including surrounding traffic conditions, bus internal information including the number of passengers inside the electric bus, temperature and humidity information, and the driver's gaze, vision, motion, emotion, voice, and drowsiness An information collection module for collecting real-time driver information including;
a driving guide generation module for generating a vehicle control guide according to the collected driving information and bus internal information;
an autonomous driving control module that compares driving detailed information from the generated vehicle control guide with detailed driving information of an electric bus controlled by a driver in real time and controls a proportion of autonomous driving according to the comparison result; and
a display module that changes the output position, color, layout, and composition of contents output to the central information display according to the collected real-time driver information; A display system of an electric bus including a.
According to claim 1, The display module; silver
A display system of an electric bus, characterized in that it changes the color and layout of the content output to the central information display, and changes the brightness and background color of the central information display by grasping the change in illumination due to the surrounding environment and time of the electric bus. According to claim 1, The display module; silver
A display system for an electric bus, characterized in that for outputting a comparison result of the generated vehicle control guide and driving detailed information by the vehicle control guide and detailed driving information of an electric bus controlled by a driver in real time.
According to claim 1, The autonomous driving control module; silver
A display system for an electric bus characterized in that it increases the proportion of autonomous driving control in proportion to the difference between detailed driving information by the vehicle control guide and detailed driving information measured in real time.
The method of claim 1, further comprising: the driving guide generation module; silver
A display system for an electric bus characterized in that it generates a vehicle control guide considering real-time driver information and body information by identifying driver information and body information including the driver's height and weight.
In the display method of the electric bus,
(A) In the information collection module, the driving route registered in the electric bus, driving information including surrounding traffic conditions, bus internal information including the number of passengers inside the electric bus, temperature and humidity information, and the driver's gaze, eyesight, motion, Collecting real-time driver information including emotion, voice, and drowsiness;
(B) generating a vehicle control guide according to the collected driving information and bus internal information in a driving guide generating module;
(C) comparing detailed driving information from the generated vehicle control guide with detailed driving information of an electric bus controlled by a driver in real time in an autonomous driving control module, and controlling a proportion of autonomous driving according to the comparison result; and
(D) changing the output position, color, layout, and composition of contents output to the central information display according to the collected real-time driver information in a display module; A display system of an electric bus including a.
The method of claim 6, wherein the step of (D); Is
A display method of an electric bus, characterized in that changing the color and layout of the contents output to the central information display, and changing the brightness and background color of the central information display by grasping the change in illumination due to the surrounding environment and time of the electric bus.
The method of claim 6, wherein the step of (D); Is
A display method of an electric bus, characterized in that outputting a comparison result of the generated vehicle control guide and driving detailed information by the vehicle control guide and detailed driving information of an electric bus controlled by a driver in real time.
The method of claim 6, wherein the step of (C); Is
A display method of an electric bus characterized in that the proportion of autonomous driving control is increased in proportion to the difference between detailed driving information by a vehicle control guide and detailed driving information measured in real time.
The method of claim 6, wherein the step of (C); Is
A display method of an electric bus, characterized by generating a vehicle control guide considering real-time driver information and body information by identifying driver information and body information including the driver's height and weight.

Images