KR102208421B1 - Method for supporting vehicle safety for hearing-impaired, and electronic apparatus thereof - Google Patents

Abstract

A method for supporting the safe driving of a vehicle for the hearing impaired is disclosed. According to the present invention, the method for supporting the safe driving of a vehicle for the hearing impaired may comprise the processes of: receiving information about the deep-learning noise waveform from a server according to characteristics of a noise source; receiving external noise generated from the noise source from all directions outside of the vehicle; and displaying the waveform for the external noise on one area of a display unit. The display unit may display a vehicle-shaped vehicle item to overlap with the waveform for the external noise displayed on the one area of the display unit, and display a plurality of corner items that are disposed on the front left, front right, rear left, and rear right of the vehicle item to indicate the magnitude and direction of the external noise.

Description

Vehicle safe driving support method for the hearing impaired and its electronic device {METHOD FOR SUPPORTING VEHICLE SAFETY FOR HEARING-IMPAIRED, AND ELECTRONIC APPARATUS THEREOF}

The present invention relates to a method and apparatus for supporting safe driving of a vehicle for the hearing impaired, and for the hearing impaired to effectively recognize and identify an external noise source for the hearing impaired who has difficulty recognizing the noise generated from objects around the vehicle being driven. It is about a vehicle safe driving support method and its device for.

The many senses of man are essential to driving a car. Among them, hearing plays a very important function in preventing accidents by detecting noise from the surrounding environment.

However, in the case of the hearing impaired, it is virtually impossible to recognize ambient noise because of the loss of hearing. Accordingly, it is very difficult for the hearing impaired to predict the situation around the vehicle that changes from time to time.

Accordingly, various technologies are being developed to help the hearing impaired to operate safely. For example, Korean Patent Publication No. 10-2014-0071084 (2014.06.11.) allows the hearing impaired to recognize horn sounds generated around him. It discloses an alarm device that assists the user.

However, the existing technologies for safe operation of the hearing impaired have been difficult to provide comprehensive and immediate information on the surrounding hazards by adopting a simple alarm method such as lighting a light according to ambient noise.

The present invention has been devised to solve the above-described problems, and visually conveys the type of noise source and the characteristics of noise generated from the noise source to the hearing impaired, so that the hearing impaired can immediately and intuitively grasp the danger factors around the hearing impaired.

According to various embodiments of the present disclosure, a method for supporting safe driving of a vehicle for the hearing impaired is a process of receiving information on a deep-learned noise waveform from a server according to the characteristics of a noise source, and external noise generated from the noise source is external to the vehicle. A process of receiving input from all directions of and displaying a waveform of the external noise on a region of the display unit may be included. Here, the display unit displays a vehicle item in the shape of a vehicle so as to overlap with the waveform of the external noise displayed in the one area of the display unit, and is arranged on the front left, front right, rear left and rear right of the vehicle item. Thus, it is possible to display a plurality of corner items indicating the magnitude and direction of the external noise.

An electronic device supporting safe driving of a vehicle for a hearing impaired according to various embodiments of the present invention includes a communication unit, a noise input unit, a display unit, and the communication unit to receive information on a deep-learned noise waveform from a server according to characteristics of a noise source. And controlling the noise input unit to receive external noise generated from the noise source from all directions outside the vehicle, controlling the display to display a waveform of the external noise on a region of the display unit, and The display unit controls the display unit to display the vehicle item of the display unit to be overlapped with the waveform of the external noise displayed in the one area of the display unit, and is disposed at the front left, front right, rear left and rear right of the vehicle item. It may include a processor that controls the display unit to display a plurality of corner items indicating the magnitude and direction of external noise.

According to various embodiments of the present disclosure, the type of the noise source and the characteristics of the noise generated from the noise source are visually transmitted to the hearing impaired, so that the hearing impaired can immediately and intuitively grasp the surrounding risk factors.

1 shows a driving situation of a vehicle according to an embodiment of the present invention.
2 is a block diagram of an electronic device according to an embodiment of the present invention.
3 illustrates a virtual area of a display unit according to an exemplary embodiment of the present invention.
4 illustrates a display unit according to an embodiment of the present invention.
5 illustrates a display unit according to another embodiment of the present invention.
6 illustrates a display unit according to another embodiment of the present invention.
7 shows an item according to an embodiment of the present invention.
8 shows an item according to another embodiment of the present invention.
9 is a block diagram of a detailed configuration of an electronic device according to an embodiment of the present invention.
10 is a flowchart illustrating a method of supporting safe driving of a vehicle for the hearing impaired according to an embodiment of the present invention.

Hereinafter, the operating principle of a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings. In addition, when it is determined that a detailed description of a related known function or configuration may obscure the subject matter of the present disclosure in describing an exemplary embodiment of the present disclosure, a detailed description thereof will be omitted. In addition, terms used in the following are terms defined in consideration of functions in the present invention, which may vary according to the intention or custom of users or operators. Therefore, the definition of the terms used should be interpreted based on the contents throughout the specification and functions corresponding thereto.

1 shows a driving situation of a vehicle according to an embodiment of the present invention.

Referring to FIG. 1, a first vehicle 1 is a vehicle in which a hearing impaired person is aboard. The second car (2) is approaching the first car (1) by sounding a siren by an ambulance. In an emergency, the ambulance can accelerate or change lanes from time to time.

In this case, since the hearing impaired person cannot hear the siren of the second vehicle 2 approaching from behind, the probability of causing an ambulance and an accident that suddenly appears is inevitably greater than that of the general public.

Hereinafter, an electronic device capable of preventing a dangerous situation exemplified in the example of FIG. 1 will be described in detail.

2 is a block diagram of an electronic device according to an embodiment of the present invention.

Referring to FIG. 2, the electronic device 200 may include a communication unit 210, a noise input unit 220, a display unit 230, and a processor 240. Here, the electronic device 200 may operate independently or organically with a component included in the vehicle. In addition, the electronic device 200 may be included in a vehicle or may be implemented as a separate device for the driver such as a wearable device.

The communication unit 210 communicates with an external electronic device. Here, the communication unit 210 may be compatible with methods such as short-range communication (NFC), things communication (IoT), and Bluetooth.

For example, the communication unit 210 may transmit and receive data from the server. Here, the server may deep-learn the noise waveform according to the characteristics of the noise source by performing deep trunning. For example, the server may learn noise patterns according to the types of noise by deep learning sirens and horn noises generated from ambulances, police cars, fire trucks, lekka cars, and general vehicles. The server can build a database on noise waveforms according to the characteristics of various noise sources through such deep learning. The server may communicate with the communication unit 210 to periodically/irregularly transmit the database of the noise waveform to the electronic device 200. In addition, the communication unit 210 may transmit information on the newly measured external noise to the server.

The noise input unit 220 may receive external noise generated from a noise source from all directions outside the vehicle. Here, the noise input unit 220 may be defined as including at least one noise input unit. For example, the noise input unit 220 may be four microphones. In this case, the four microphones may be disposed at the front and rear sides and both sides of the vehicle including the electronic device 200, or may be disposed at the front left, front right, rear left, and rear right of the vehicle.

Specifically, the display unit 230 may display various types of information or items.

For example, the display unit 230 may display a waveform for external noise on a part of the display unit 230. Here, the display unit 230 may be defined as including a separate processor and may control the operation of the display unit 230 by itself, or may be understood as being controlled by the processor 240 to be described later.

The above-described display unit 230 may be implemented as an instrument panel of an automobile or a center fascia display.

The processor 240 may generally control the electronic device 200.

Specifically, the processor 240 may control each component of the electronic device 200 for safe driving of a vehicle for the hearing impaired.

As an example, the processor 240 may control the communication unit 210 to receive information on the deep-learned noise waveform from the above-described server according to the characteristics of the noise source.

In addition, the processor 240 may control the noise input unit 220 to receive external noise generated from the noise source from the front of the vehicle.

In addition, the processor 240 may control the display unit 230 to display a waveform of external noise on a region of the display unit 230.

Here, the processor 240 may display various information on external noise generated from the noise source through the display unit 230.

Hereinafter, various information on external noise displayed on the display unit 230 will be described in detail with reference to FIGS. 3 to 8.

3 illustrates a virtual area of a display unit according to an exemplary embodiment of the present invention.

Referring to FIG. 3, the display unit 330 may include a first display unit 331 and a second display unit 332.

Here, the first display unit 331 may display noise information such as a noise waveform, a size of the noise waveform, and a location of the noise. The second display unit 332 may display a noise type, for example, a noise source type.

Here, the first display unit 331 and the second display unit 332 are distinguished based on the function of information displayed by the display unit 330, and the display unit 330 can be divided into various areas according to various conditions. Yes, of course.

4 illustrates a display unit according to an embodiment of the present invention.

Referring to FIG. 4, the processor 240 may display various pieces of information or items on the display unit 430.

Specifically, the processor 240 may control the display unit 430 to display a waveform 431 for external noise. Here, a different waveform may be generated according to the characteristics of the noise source as the waveform 431 for external noise. A driver with a hearing impairment can intuitively find out a noise source that generates a waveform 431 for external noise through learning.

The horizontal axis of the waveform for the external noise may represent time, and the vertical axis of the waveform for the external noise may represent the magnitude of the external noise.

In this case, the processor 240 may control the display unit 430 to display a waveform for external noise in real time according to a change in time. In addition, the processor 240 may control the display unit 430 to display the highlight of the waveform for the external noise in a stopped state when the predetermined time elapses from a time when the external noise becomes less than or equal to the predetermined size. . Through this, even after the external noise is terminated, it is possible to continue safe driving by recognizing the existence of a noise source that generates external noise.

For example, the processor 240 may display the waveform 431 for the external noise described above to be symmetrical with respect to the central axis 431-1 of the waveform.

For example, in the processor 240, the outer area of the area in which the waveform 431 for external noise is greater than or equal to a predefined size may be flashed in a color to raise the driver's attention. Through this, the waveform 431 for external noise has a general shape as shown in FIG. 4, but when the external noise increases, that is, when the danger from the noise source increases, it flashes in a color having a warning meaning such as red or yellow, thereby hearing the sound. It can raise the attention of disabled drivers.

Also, the processor 240 may display the vehicle item 432 in the shape of a vehicle on the display unit 430. In this case, the processor 240 may control the display unit 430 to display the vehicle item 432 in the shape of a vehicle so as to be superimposed with a waveform for external noise displayed on the one area 433 of the display unit 430. have.

In addition, the processor 240 displays the display unit 430 to display a plurality of corner items 434-1, 434-2, 434-3, and 434-4 indicating the magnitude and direction of the external noise of the vehicle item 432. Can be controlled. Here, the plurality of corner items 434-1, 434-2, 434-3, and 434-4 are the front left (434-1), front right (434-2), and rear left (434) of the vehicle item 432. -3) and can be arranged in the rear right (434-4). In this case, the plurality of corner items 434-1, 434-2, 434-3, and 434-4 may correspond to the plurality of noise input units 220 disposed outside the vehicle. Here, the number of displayed colors of the plurality of corner items 434-1, 434-2, 434-3, and 434-4 may be increased and lengthened in stages as the amount of external noise increases.

The waveform 431 for the external noise, the vehicle item 432 and the plurality of corner items 434-1, 434-2, 434-3, and 434-4 are included in the first display unit 331 of FIG. 3. I can.

Meanwhile, the processor 240 may display an item 435 indicating the amount of noise in one area of the display unit 430. Here, the item 435 representing the magnitude of the noise may include an item 435-1 representing the magnitude of the noise as a numerical value. For example, an item indicating the amount of noise as a numerical value may indicate from 0% to 100%.

In addition, the processor 240 may show type items 436 and 437 indicating the type of the noise source in one area of the display unit 430. Here, the type items 436 and 437 indicating the type of the noise source may be in the shape of an ambulance, a police car, a fire truck, a lekka car, a general vehicle, a building, a road structure, or the like.

The processor 240 may determine the type of the noise source or the similarity of the noise source type based on a noise pattern according to the type of noise received from the server.

The type items 436 and 437 indicating the type of the noise source may display the degree of correspondence 436-1 and 437-1 for the type of the noise source.

Here, noise sources such as ambulances, police cars, fire trucks, lekka cars, general vehicles, buildings, road structures, etc. may have a predefined degree of risk. For example, it is assumed that ambulances and fire trucks are set with high risk.

In this case, the processor 240 determines that the degree of correspondence (436-1, 437-1) with the type of the noise source is equal to or greater than a predefined value, and the risk of the noise source is determined to be greater than or equal to a predefined risk such as an ambulance or a fire engine, By changing the color of the type items 436 and 437 indicating the type of noise source, or by controlling to blink, it is possible to warn a driver with a hearing impairment about the approach of a high-risk noise source.

Further, the processor 240 may display a location item 438 indicating the location and movement state of the noise source at the current location of the noise source.

In this case, the processor 240 determines that the degree of correspondence (436-1, 437-1) with the type of the noise source is equal to or greater than a predefined value, and the risk of the noise source is determined to be greater than or equal to a predefined risk such as an ambulance or a fire engine, By changing the color of the location item 438 or controlling it to blink, it is possible to warn a driver with a hearing impairment about the approach of a high-risk noise source.

The above-described item 435 indicating the level of noise and type items 436 and 437 indicating the type of noise source may be included in the first display unit 332 of FIG. 3.

Hereinafter, exemplary embodiments of items included in the display unit 430 will be described in detail with reference to FIGS. 5 to 8. Hereinafter, detailed descriptions of contents overlapping with those of FIG. 4 will be omitted for convenience of description.

5 illustrates a display unit according to another embodiment of the present invention.

Referring to FIG. 5, a plurality of corner items 534-1, 534-2, 534-3, and 534-4 may be shown on the display unit 530 as a plurality of circular shapes that are continuous in one direction. Here, among the plurality of corner items (534-1, 534-2, 534-3, 534-4), a circle in which colors are displayed from a plurality of circles included in the corner items in which the external noise generated from the noise source is relatively large. The number of may be set to be greater than the number of circles in which colors are displayed in a plurality of circles included in corner items in which external noise generated from a noise source is recognized as relatively small. That is, as the magnitude of the external noise increases, colors are displayed on a larger number of circles among the plurality of circles included in the plurality of corner items 534-1, 534-2, 534-3, and 534-4. In this case, when colors are sequentially displayed from the first displayed circle among the plurality of consecutive circles to a successive next-order circle, a lighter color or a darker color of a specific color may be displayed from the continuous circle.

6 illustrates a display unit according to another embodiment of the present invention.

Referring to FIG. 6, a plurality of corner items 634-1, 634-2, 634-3, and 634-4 are centered on a vertex area of the display unit 630, and may be shown in a fan shape having a right angle. have. Here, in the plurality of corner items 634-1, 634-2, 634-3, 634-4, the length of the arc increases as the magnitude of the external noise increases, and the number of colors displayed in the sector increases the arc from the center. It can be increased step by step in the direction you are facing. For example, a plurality of edge items 634-1, 634-2, 634-3, 634-4 may display a lighter color or a darker color of a specific color step by step in a direction from the center toward the arc. I can. Alternatively, a plurality of corner items 634-1, 634-2, 634-3, and 634-4 may be displayed in a rainbow color step by step in a direction from the center toward the arc.

7 shows an item according to an embodiment of the present invention.

Referring to FIG. 7, the processor 240 may display an item 735-1 indicating a level of noise and type items 736-1 and 737-1 indicating a type of a noise source.

Here, a box item 752-1 including an item 735-1 representing the level of noise and a box item 736-2 including type items 736-1 and 737-1 representing the type of noise source, 737-2) may be displayed in a predefined color.

Here, the box item 752-1 including the item 735-1 indicating the level of noise may be displayed in a predefined color according to the level of the noise. In addition, the box items 736-2 and 737-2 including the type items 736-1 and 737-1 indicating the type of the noise source are color defined according to at least one of the type of the noise source and the proximity of the noise source. Can be displayed.

Also, an icon 735-3 indicating the amount of noise may be displayed on one side of the box item 752-1 including the item 735-1 indicating the amount of noise. In addition, at one side of the box items 736-2 and 737-2, each of which includes type items 736-1 and 737-1 indicating the type of noise source, an icon 736-3 indicating the degree of similarity according to the type of the noise source. , 737-3) may be displayed.

8 shows an item according to another embodiment of the present invention.

Referring to FIG. 8, the processor 240 may display an item 835-1 indicating a level of noise and type items 836-1 and 837-1 indicating a type of a noise source.

In addition, the processor 240 displays an item 835-3 representing the magnitude of the noise numerically on one side of the item 835-1 representing the magnitude of the noise, and a type item 836-1 representing the type of the noise source. , 837-1) may display icons 836-3 and 837-3 indicating similarity according to the type of the noise source.

In addition, the processor 240 includes a box item 835-2 including an item 835-3 representing the amount of noise as a numerical value, and a type item 836-1 and 837-1 representing the type of noise source, respectively. It is possible to display the box items 836-2 and 837-2.

Here, the box item 835-2 including the item 835-3 representing the magnitude of the noise as a numerical value may be displayed with a predefined color according to the magnitude of the noise. In addition, box items 836-2 and 837-2 each including type items 836-1 and 837-1 indicating the type of noise source are predefined according to at least one of the type of the noise source and the proximity of the noise source. Color can be displayed.

According to various embodiments of the present invention described above, the type of noise source and the characteristics of noise generated from the noise source are visually transmitted to the hearing impaired, so that the hearing impaired can immediately and intuitively grasp the danger factors around the hearing impaired.

9 is a block diagram of a detailed configuration of an electronic device according to an embodiment of the present invention.

Referring to FIG. 9, the electronic device 900 includes a communication unit 910, a noise input unit 920, a display unit 930, and a processor 940.

The communication unit 910 performs communication. The communication unit 910 may communicate with an external device through various communication methods such as BT (BlueTooth), WI-FI (Wireless Fidelity), Zigbee, IR (Infrared), and NFC (Near Field Communication).

The noise input unit 920 receives external noise.

The display 930 may be implemented in various ways, such as a liquid crystal display (LCD), a light emitting display (LED), a head-up display (HUD) device using a windshield of an automobile.

The processor 940 generally controls the operation of the electronic device 900 by using various programs stored in the storage unit.

Specifically, the processor 940 includes a RAM 941, a ROM 942, a main CPU 943, a graphics processing unit 944, a first to n interfaces 945-1 to 945-n, and a bus 946. Include.

The RAM 941, the ROM 942, the main CPU 943, the graphic processing unit 944, the first to n interfaces 945-1 to 945-n, and the like may be connected to each other through the bus 946.

The first to nth interfaces 945-1 to 945-n are connected to the various components described above. One of the interfaces may be a network interface that is connected to an external device through a network.

The main CPU 943 accesses the storage unit and performs booting using the O/S stored in the storage unit. Then, various operations are performed using various programs, contents, data, etc. stored in the storage unit).

The ROM 942 stores an instruction set for booting the system, and the like. When the turn-on command is input and power is supplied, the main CPU 943 copies the O/S stored in the storage unit to the RAM 941 according to the command stored in the ROM 942, and executes the O/S to boot the system. Let it. When booting is complete, the main CPU 943 copies various stored application programs to the RAM 941 and executes the copied application programs in the RAM 941 to perform various operations.

The graphic processing unit 944 generates a screen including various objects such as icons, images, and texts using an operation unit and a rendering unit.

10 is a flowchart illustrating a method of supporting safe driving of a vehicle for the hearing impaired according to an embodiment of the present invention.

Referring to FIG. 10, the method of supporting safe driving of a vehicle for the hearing impaired is a process of receiving information on a deep-learned noise waveform from a server according to the characteristics of the noise source (1010), and external noise generated from the noise source is external to the vehicle. A process 1020 of receiving input from all directions and a process 1030 of displaying a waveform for external noise on a region of the display unit may be included. Here, the display unit displays an automobile item in the shape of a vehicle so as to overlap with the waveform of the external noise displayed in one area of the display unit, and is disposed on the front left, front right, rear left and rear right of the vehicle item to determine the magnitude of external noise A plurality of corner items indicating directions can be displayed.

The horizontal axis of the waveform for the above-described external noise represents time, and the vertical axis of the waveform for the external noise represents the magnitude.

In addition, the display unit may display a waveform for external noise in real time according to a change of time.

Here, when the predetermined time elapses from a time when the external noise becomes less than or equal to the predetermined size, the process of displaying the highlight of the waveform for the external noise in a stopped state may be further included.

The waveform of the external noise described above is symmetrical with respect to the central axis of the waveform, and an area outside the area where the waveform is greater than or equal to a predefined size may be flashed in a color to raise the driver's attention.

The above-described display unit may display an item indicating the amount of noise on one side of the display unit. In addition, the display unit may display a type item indicating the type of the noise source and a degree of correspondence with the type of the noise source on one side of the display unit. In addition, the display unit may display a location item indicating the location and movement state of the noise source at the location of the noise source.

In the above-described example, the number of displayed colors may be gradually increased and lengthened as the amount of external noise increases in the plurality of corner items.

In addition, the plurality of corner items may have a fan shape centered on a vertex area of the display unit and have a right angle. In this case, in the fan shape, the length of the arc increases as the size of the external noise increases, and the number of colors displayed on the fan shape may increase stepwise in a direction from the center toward the arc.

Meanwhile, the vehicle safe driving support method for the hearing impaired according to various embodiments of the present disclosure described above is implemented as a computer-executable program code and stored in various non-transitory computer readable media. It may be provided to each server or devices to be executed by.

For example, the process of receiving information on a noise waveform deep-learned according to the characteristics of the noise source from the server, the process of receiving external noise generated from the noise source from all directions outside the vehicle, and the process of receiving the external noise waveform from the display unit. A non-transitory computer readable medium in which a program for performing a process of displaying on the area is stored may be provided.

The non-temporary readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short moment, such as a register, cache, or memory. Specifically, the above-described various applications or programs may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, and ROM.

In addition, although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present disclosure claimed in the claims. In addition, various modifications may be possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical idea or perspective of the present disclosure.

1st car: 1
2nd car: 2
Ministry of Communications: 210, 910
Noise input: 220, 920
Display: 230, 330, 430,
Processor: 240, 940

Claims (22)

In the method of supporting safe driving of a vehicle for the hearing impaired, performed in an electronic device,
Receiving information on the deep-learned noise waveform from the server according to the characteristics of the noise source;
Receiving external noise generated from the noise source from all directions outside the vehicle; And
Including; displaying the waveform of the external noise in a region of the display unit,
The display unit,
Displaying a vehicle item in the shape of a vehicle so as to overlap with the waveform of the external noise displayed on the one area of the display unit,
A vehicle safe driving support method for displaying a plurality of corner items that are disposed on the front left, front right, rear left and rear right of the vehicle item to indicate the magnitude and direction of the external noise.
The method of claim 1,
A horizontal axis of the waveform for the external noise represents time, and a vertical axis of the waveform for the external noise represents a magnitude.
The method of claim 2,
The display unit,
A vehicle safety driving support method for displaying the waveform of the external noise in real time according to the change of time.
The method of claim 3,
When a predetermined time elapses from a time when the external noise becomes less than or equal to the predetermined size, displaying a highlight portion of the waveform for the external noise in a stopped state;
The method of claim 4,
The waveform for the external noise,
Symmetrical with respect to the central axis of the waveform,
A vehicle safe driving support method, wherein an area outside of an area in which the waveform is equal to or larger than a predefined size is flashed in a color to raise a driver's attention.
The method of claim 2,
The display unit,
A vehicle safe driving support method for displaying an item indicating the level of noise on one side of the display unit.
The method of claim 6,
The display unit,
A vehicle safe driving support method for displaying a type item indicating the type of the noise source and a degree of correspondence with the type of the noise source on the one side area of the display unit.
The method of claim 1,
The display unit,
A vehicle safe driving support method for displaying a location item indicating a location and a moving state of the noise source at the location of the noise source.
The method of claim 6,
The plurality of edge items,
A method for supporting safe driving of a vehicle, in which the number of displayed colors gradually increases and lengthens as the amount of external noise increases.
The method of claim 6,
The plurality of edge items,
It is a fan shape centered on the vertex area of the display unit and has a right angle,
The above fan shape,
As the magnitude of the external noise increases, the length of the arc increases, and the number of colors displayed on the fan shape increases step by step in a direction from the center toward the arc.
In an electronic device that supports safe driving of a vehicle for the hearing impaired,
Communication department;
Noise input unit;
A display unit; And
Control the communication unit to receive information on the deep-learned noise waveform from the server according to the characteristics of the noise source,
Controlling the noise input unit to receive external noise generated from the noise source from all directions outside the vehicle,
Controlling the display to display a waveform of the external noise on an area of the display unit,
Controlling the display unit to display a vehicle item in the shape of a vehicle so as to overlap with the waveform of the external noise displayed on the one area of the display unit
And a processor configured to control the display unit to display a plurality of corner items that are disposed on the front left, front right, rear left and rear right of the vehicle item to indicate the magnitude and direction of the external noise.
The method of claim 11,
The electronic device, wherein a horizontal axis of the waveform for the external noise represents time, and a vertical axis of the waveform for the external noise represents a magnitude.
The method of claim 12,
The processor,
The electronic device, wherein the display unit controls the display to display the waveform of the external noise in real time according to the change of time.
The method of claim 13,
The processor,
When a predetermined time elapses from a time when the external noise becomes less than or equal to the predetermined size, controlling the display unit to display a highlight portion of the waveform for the external noise in a stopped state.
The method of claim 14,
The waveform for the external noise,
Symmetrical with respect to the central axis of the waveform,
The electronic device, wherein an area outside of an area in which the waveform is equal to or larger than a predefined size is flashed in a color for raising a driver's attention.
The method of claim 12,
The processor,
The electronic device of claim 1, wherein the display unit controls the display unit to display an item indicating the level of noise in one area of the display unit.
The method of claim 16,
The processor,
The electronic device, wherein the display unit controls the display unit to display a type item indicating the type of the noise source and a degree of correspondence with the type of the noise source on the one side area of the display unit.
The method of claim 11,
The processor,
The electronic device, wherein the display unit controls the display unit to display a position item indicating a position and a moving state of the noise source at the position of the noise source.
The method of claim 16,
The plurality of edge items,
The electronic device, wherein the number of displayed colors gradually increases and lengthens as the magnitude of the external noise increases.
The method of claim 16,
The plurality of edge items,
It is a fan shape centered on the vertex area of the display unit and has a right angle,
The above fan shape,
The electronic device, wherein as the magnitude of the external noise increases, the length of the arc increases, and the number of colors displayed in the fan shape gradually increases in a direction from the center toward the arc.
A non-transitory computer-readable medium instructed to execute on a computer performing the method of any one of claims 1 to 10.
A vehicle comprising the electronic device of any one of claims 11 to 20.

Images