JP2018013386A - Display control unit for vehicle, display system for vehicle, display control method for vehicle, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To heighten visibility of an emergency vehicle.SOLUTION: A display control unit for a vehicle includes an image data acquisition part 31 for acquiring photographed viewdata photographed by an imaging part 2 for photographing a periphery of the vehicle, a detection part 32 for detecting existence of an emergency vehicle 200, a display viewdata generation part 33 for generating display viewdata 110 in which a lamp color of the emergency vehicle 200 is conspicuous in the display color of the photographed viewdata, when detecting existence of the emergency vehicle 200 by the detection part 32, and a display control part 34 for displaying the display viewdata 110 on a rear view monitor 3 installed on the front of a driver of the vehicle.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a vehicle display control device, a vehicle display system, a vehicle display control method, and a program.

  In place of the conventional optical rearview mirror, a technique relating to a so-called electronic rearview mirror that captures a rear peripheral area of a vehicle with a rear camera and displays it on a rear view monitor is known (for example, see Patent Document 1). In this technique, an image of the first area is extracted as a display target when the vehicle is moving backward, and an image of a second area that is narrower than the first area is extracted when the vehicle is moving forward. Then, an obstacle behind the vehicle is detected based on a change in the contrast pattern of the image that has not been extracted as a display target when the vehicle moves forward, from the image captured by the photographing unit.

Japanese Patent No. 5136071

  Drivers often recognize emergency vehicles by hearing prior to vision. However, it may be difficult to specify the direction in which the emergency vehicle is approaching with the siren sound. For this reason, the driver confirms the surroundings of the vehicle and confirms the direction in which the emergency vehicle is approaching visually or via an electronic room mirror. However, the electronic rearview mirror displays a clear video by image processing. For this reason, it may be difficult to find the emergency vehicle from the object to be photographed.

  This invention is made | formed in view of the above, Comprising: It aims at improving the visibility of an emergency vehicle.

  In order to solve the above-described problems and achieve the object, a vehicle display control device according to the present invention includes a video data acquisition unit that acquires captured video data captured by an imaging unit that captures the periphery of the vehicle, and an emergency vehicle. A detection unit that detects the presence of an emergency vehicle, and when the detection unit detects the presence of an emergency vehicle, a display video data generation unit that generates display video data in which the lighting color of the emergency vehicle is conspicuous in the display color of the captured video data, A display control unit configured to display the display video data on a display panel installed in front of the driver of the vehicle.

  The vehicle display system according to the present invention further includes at least one of the vehicle display control device, the imaging unit, and the display panel.

  The vehicle display control method according to the present invention includes a video data acquisition step of acquiring captured video data captured by an imaging unit that captures the periphery of the vehicle, a detection step of detecting the presence of an emergency vehicle, and the detection step being an emergency A display video data generating step for generating display video data in which the lighting color of the emergency vehicle is conspicuous in the display color of the captured video data when the presence of the vehicle is detected; and the display video data is installed in front of the driver of the vehicle. And a display control step for displaying on the display panel.

  The program according to the present invention includes a video data acquisition step for acquiring captured video data captured by an imaging unit that captures the periphery of a vehicle, a detection step for detecting the presence of an emergency vehicle, and the detection step detects the presence of an emergency vehicle. When detected, a display video data generation step for generating display video data in which the light color of the emergency vehicle is conspicuous in the display color of the captured video data; and the display video data is displayed on a display panel installed in front of the driver of the vehicle. The display control step to be displayed is executed by a computer that operates as a vehicle display control device.

  According to the present invention, it is possible to improve the visibility of an emergency vehicle.

FIG. 1 is a schematic diagram illustrating a configuration example of a vehicle display system according to the first embodiment. FIG. 2 is a block diagram illustrating a configuration example of the vehicle display system according to the first embodiment. FIG. 3 is a schematic diagram illustrating another example of the configuration example of the vehicle display system according to the first embodiment. FIG. 4 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 5 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 6 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 7 is a flowchart showing a flow of processing in the vehicle display system according to the first embodiment. FIG. 8 is a schematic diagram illustrating a configuration example of the vehicle display system according to the second embodiment. FIG. 9 is a diagram illustrating an example of a siren sound pattern table of the vehicle display system according to the second embodiment. FIG. 10 is a flowchart showing a flow of processing in the vehicle display system according to the second embodiment. FIG. 11 is a schematic diagram illustrating a configuration example of the vehicle display system according to the third embodiment. FIG. 12 is a flowchart showing the flow of processing in the vehicle display system according to the third embodiment.

  Exemplary embodiments of a vehicle display control device 10, a vehicle display system 1, a vehicle display control method, and a program according to the present invention will be described below in detail with reference to the accompanying drawings. In addition, this invention is not limited by the following embodiment.

[First embodiment]
The vehicle display system 1 is mounted on a vehicle and displays an image obtained by photographing the rear of the vehicle. FIG. 1 is a schematic diagram illustrating a configuration example of a vehicle display system according to the first embodiment. FIG. 2 is a block diagram illustrating a configuration example of the vehicle display system according to the first embodiment.

  The emergency vehicle 200 is, for example, an automobile such as an emergency car, a fire fighting car, or a police car that is being driven for an emergency service. The emergency vehicle 200 sounds a siren and lights up during emergency traveling. In the present embodiment, the lamp is red.

  As shown in FIGS. 1 and 2, the vehicle display system 1 includes an imaging unit 2, a rear view monitor 3, a microphone 4, and a vehicle display control device 10. In the present embodiment, the rear view monitor 3 will be described. However, the rear view monitor 3 is a monitor that displays an image of the front or the left and right sides, and a side view monitor that is an alternative to a door mirror that displays an image of the left and right sides of the vehicle. Is also applicable.

  The imaging part 2 is arrange | positioned at the back of a vehicle, and image | photographs the back of a vehicle. The imaging unit 2 is arranged facing the rear of the vehicle. The imaging unit 2 captures a range including a confirmation range by the rear view monitor 3. The imaging unit 2 has a horizontal angle of view of, for example, 30 to 60 °, and a vertical angle of view of, for example, 5 to 20 °. The imaging unit 2 can capture a wider range of video than the range displayed on the rear view monitor 3, but the rear view monitor 3 is used to cut out a range where the driver of the vehicle can properly recognize the rear. To display. In other words, the image pickup unit 2 normally takes a picture including a range not displayed on the rear view monitor 3. The imaging unit 2 outputs the captured video data to the video data acquisition unit 31 of the vehicle display control device 10.

  The rear view monitor 3 is an electronic room mirror as an example. When the rear view monitor 3 is used as an electronic room mirror, it does not matter whether there is a half mirror for confirming the rear by optical reflection. The rear view monitor 3 is a display including, for example, a liquid crystal display (LCD) or an organic EL (Organic Electro-Luminescence) display.

  The rear view monitor 3 is disposed at a position that is easily visible to the driver. In the present embodiment, the rear view monitor 3 is disposed at the center upper portion of the windshield S in the vehicle width direction, as shown in FIG. As shown in FIG. 3, the rear view monitor 3 may be arranged at the center upper portion of the dashboard D in the vehicle width direction.

  The rear view monitor 3 displays a rear image of the vehicle based on the video signal output from the display control unit 34 of the control unit 30 of the vehicle display control device 10. Specifically, the rear view monitor 3 displays a rear image as shown in FIG. In the display video data 100, an emergency vehicle 200, another vehicle 201, a road 202, and a building 203 are shown.

  The microphone 4 is a sound collecting device that collects sound around the vehicle. The microphone 4 converts the collected sound into an electrical signal and outputs it to the detection unit 32. The microphone 4 collects sound including the range shown in the video displayed on the rear view monitor 3.

  Returning to FIG. 2, the vehicle display control apparatus 10 includes a storage unit 20 and a control unit 30.

  The storage unit 20 stores data and various processing results required for various processes in the vehicle display control apparatus 10. The storage unit 20 is, for example, a semiconductor memory device such as a RAM (Random Access Memory), a ROM (Read Only Memory), or a flash memory, or a storage device such as a hard disk, an optical disk, or an external storage device via a network. Alternatively, an external storage device that is wirelessly connected via a communication device (not shown) may be used. The storage unit 20 stores a siren sound pattern table and a recognition dictionary.

  The recognition dictionary is stored as a dictionary capable of collating patterns such as the shape, size, and color of the front of the emergency vehicle 200.

  The control unit 30 is an arithmetic processing unit configured with, for example, a CPU (Central Processing Unit). The control unit 30 includes a video data acquisition unit 31, a detection unit 32, a display video data generation unit 33, and a display control unit 34. The control unit 30 executes instructions included in the program stored in the storage unit 20.

  The video data acquisition unit 31 acquires a video obtained by photographing the rear of the vehicle. The video data acquisition unit 31 acquires the captured video data output by the imaging unit 2. The video data acquired by the video data acquisition unit 31 is, for example, video data in which images of 60 frames per second are continuous. The video data acquisition unit 31 outputs the acquired captured video data to the detection unit 32.

  The detection unit 32 detects the presence of the emergency vehicle 200 based on the electrical signal input from the microphone 4. The detection part 32 detects the siren of the emergency vehicle 200 based on a frequency and a period. More specifically, the detection unit 32 extracts a siren sound included in the electric signal input from the microphone 4. The method for extracting the siren sound included in the electric signal input from the microphone 4 may be any known method and is not limited. For example, the detection unit 32 extracts a sound having a predetermined frequency and a predetermined period as a siren sound. The detection unit 32 outputs the detection result to the display video data generation unit 33.

  When the detection unit 32 has not detected the presence of the emergency vehicle 200, the display video data generation unit 33 generates the display video data 100 cut out in a predetermined range for displaying the captured video data on the rear view monitor 3, and displays the display video data. 100 is output to the display control unit 34. In other words, when the detection unit 32 does not detect the presence of the emergency vehicle 200, the display video data generation unit 33 does not perform a process of making the lighting color of the emergency vehicle 200 stand out in the display color of the captured video data.

  When the detection unit 32 detects the presence of the emergency vehicle 200, the display video data generation unit 33 generates the display video data 110 in which the lighting color of the emergency vehicle 200 is conspicuous in the display color of the captured video data. More specifically, the display video data generation unit 33 cuts out a predetermined range of display video data 100 from the captured video data. Then, the display video data generation unit 33 detects the emergency vehicle 200 by performing pattern matching using the recognition dictionary stored in the storage unit 20 on the cut display video data 100. The display video data generation unit 33 tracks the detected emergency vehicle 200 by image processing. Then, the display video data generation unit 33 generates display video data 110 in which the lighting color of the emergency vehicle 200 is conspicuous in the display color of the captured video data.

  More specifically, for example, the display video data generation unit 33 performs a color reduction process for reducing color information of a color different from the lighting color of the emergency vehicle 200 in the display color of the captured video data, or a contrast reduction process for reducing the contrast, or The icon display process in which the icons 210 are superimposed is performed. The display video data generation unit 33 outputs the generated display video data 110 to the display control unit 34. Note that the display video data generation unit 33 captures the display video data 100 with a high possibility of the lighting 200L of the emergency vehicle 200, such as a flashing subject or a rotating subject. When an object is detected, pattern matching may be performed intensively on the lower region of the object to be photographed. Further, when pattern matching with the emergency vehicle 200 is difficult, such as when the emergency vehicle 200 is behind another vehicle, the emergency vehicle 200 is detected based on the lighting color and flashing pattern of the emergency vehicle 200. Good.

  In the present embodiment, the color reduction process is a process of generating the display video data 110 shown in FIG. 5 in which the color information of colors other than red is reduced in the display color of the captured video data and outputting the display video data 110 to the display control unit 34. . For example, in the color reduction process, display video data 110 is generated by reducing the color saturation of RGB corresponding to a color different from the lighting color of the emergency vehicle 200 from the display video data 100 and reducing the color saturation to the display control unit 34. Output. Any known method may be used as a method for reducing RGB, and the method is not limited. Alternatively, for example, the color reduction processing generates display video data 110 in which the display video data 100 is dichroized with a predetermined amount or a predetermined ratio and a low monochrome or black and white color saturation different from the lighting color of the emergency vehicle 200. Then, it may be output to the display control unit 34.

  In the present embodiment, the contrast reduction process generates display video data 110 in which the brightness of each pixel having a color different from the lighting color of the emergency vehicle 200 is reduced by a predetermined amount or a predetermined rate with respect to the display video data 100. The data is output to the display control unit 34. Alternatively, for example, in the contrast reduction process, instead of generating the display video data 110, the backlight of the rear view monitor 3 corresponding to the light-colored pixels of the emergency vehicle 200 in the display video data 100 is set to normal luminance, and the display video data is displayed. The display control unit 34 generates a control signal for reducing the backlight of the rear view monitor 3 corresponding to a pixel of a color different from the lighting color of the emergency vehicle 200 by a predetermined amount or a predetermined rate from the normal luminance, and the display video data 100. May be output.

  In the present embodiment, the icon display process generates display video data 110 in which the icon 210 is superimposed on the light 200L of the emergency vehicle 200 shown in FIG. 6 with respect to the display video data 100, and outputs the display video data 110 to the display control unit 34. It is processing. For example, in the icon display process, display video data 110 in which an icon 210 such as a circle or an arrow is superimposed on the detected light 200L of the emergency vehicle 200 is generated and output to the display control unit 34.

  The display video data generation unit 33 may perform any one of a color reduction process, a contrast reduction process, and an icon display process, or may combine a plurality of them.

  The display control unit 34 causes the display video data 100 or the display video data 110 output from the display video data generation unit 33 to be displayed on the rear view monitor 3. More specifically, the display control unit 34 outputs a video signal to the rear view monitor 3.

  Next, the flow of processing by the control unit 30 will be described with reference to FIG. FIG. 7 is a flowchart showing a flow of processing in the vehicle display system according to the first embodiment.

  The control unit 30 acquires captured video data (step S11). More specifically, the control unit 30 causes the video data acquisition unit 31 to acquire the captured video data output from the imaging unit 2.

  The control unit 30 detects the presence of the emergency vehicle 200 (step S12). More specifically, the control unit 30 causes the detection unit 32 to detect the presence of the emergency vehicle 200 based on the electric signal input from the microphone 4.

  The control unit 30 determines whether or not the presence of the emergency vehicle 200 has been detected (step S13). When the detection unit 32 determines that the presence of the emergency vehicle 200 is not detected (No in Step S13), the control unit 30 proceeds to Step S14. When it is determined by the detection unit 32 that the presence of the emergency vehicle 200 is detected by the detection unit 32 (Yes in Step S13), the control unit 30 proceeds to Step S15.

  The control unit 30 generates display video data 100 (step S14). The control unit 30 causes the display video data generation unit 33 to generate the display video data 100 obtained by cutting out the captured video data within a predetermined range, and causes the display control unit 34 to output the display video data 100. In other words, in this case, the control unit 30 does not cause the display video data generation unit 33 to perform processing for conspicuous the lighting color of the emergency vehicle 200 in the display color of the captured video data.

  The control unit 30 generates display video data 110 in which the lighting color of the emergency vehicle 200 is conspicuous in the display color of the captured video data (step S15). The control unit 30 causes the display video data generation unit 33 to generate display video data 110 by performing a color reduction process, a contrast reduction process, or an icon display process.

  For example, the control unit 30 causes the display video data generation unit 33 to generate display video data 110 in which color information of a color different from the lighting color of the emergency vehicle 200 is reduced in the display color of the captured video data, and the display control unit 34. To output.

  Alternatively, for example, the control unit 30 causes the display video data generation unit 33 to display the display video data 110 in which the contrast of the portion displayed in a color different from the lighting color of the emergency vehicle 200 is reduced with respect to the display video data 100. Generate and output to the display control unit 34.

  Alternatively, for example, the control unit 30 causes the display video data generation unit 33 to generate display video data 110 in which the icon 210 is superimposed on the light 200L of the emergency vehicle 200 with respect to the display video data 100, and the display control unit 34 To output.

  The control unit 30 outputs the display video data 100 or the display video data 110 (step S16). More specifically, the control unit 30 causes the display control unit 34 to display the display video data 100 or the display video data 110 on the rear view monitor 3.

  For example, the case where the color reduction process is performed in step S15 will be described. The control unit 30 uses the display control unit 34 to display the display video data 100, which is a chrominance of a color different from the light color of the emergency vehicle 200 into a predetermined amount or a predetermined ratio, and is monochromatic or black and white. 110 is generated and output to the display control unit 34. In step S <b> 16, the control unit 30 causes the display control unit 34 to display the display video data 110 shown in FIG. 5 on the rear view monitor 3. More specifically, in the display video data 110 shown in FIG. 5, the portions other than the lights 200 </ b> L of the emergency vehicle 200, the other vehicle 201, the road 202, and the building 203 are reduced in color and are dichroized. . In the display video data 110, the lighting color of the emergency vehicle 200 is displayed as it is. In the case where the display image data 110 is generated and displayed in a predetermined amount or a predetermined ratio, which is a chrominance of a color different from the light color of the emergency vehicle 200, and is displayed in a single color or black and white, in addition to the light 200L of the emergency vehicle 200, Objects of similar colors other than the lamp 200L are also displayed in the same color. Even in such a case, since the lamp 200L is mostly blinking, it is easy to determine.

  For example, a case where contrast reduction processing is performed in step S15 will be described. The control unit 30 causes the display control unit 34 to generate display video data 110 in which the contrast of a portion displayed in a color different from the lighting color of the emergency vehicle 200 is reduced with respect to the display video data 100. To output. In step S <b> 16, the control unit 30 causes the display control unit 34 to display the display video data 110 with reduced contrast on the rear view monitor 3. In the display video data 110 in this case, the contrast between the emergency vehicle 200 other than the lights 200L, the other vehicle 201, the road 202, and the building 203 is reduced. In the display video data 110, the lighting color of the emergency vehicle 200 is displayed with the same contrast. When the display video data 110 in which the contrast of the portion displayed in a color different from the light color of the emergency vehicle 200 is reduced is generated and displayed, in addition to the light 200L of the emergency vehicle 200, objects of similar colors other than the fire 200L Is displayed with the contrast maintained. Even in such a case, since the lamp 200L is mostly blinking, it is easy to determine.

  For example, the case where icon display processing is performed in step S15 will be described. The display control unit 34 generates display video data 110 in which the icon 210 is superimposed on the lamp 200L of the emergency vehicle 200 with respect to the display video data 100, and outputs the display video data 110 to the display control unit 34. In step S <b> 16, the control unit 30 causes the display control unit 34 to display the display video data 110 shown in FIG. 6 on the rear view monitor 3. More specifically, in the display video data 110 shown in FIG. 6, the icon 210 is displayed superimposed on the light 200 </ b> L of the emergency vehicle 200. When the display image data 110 is generated and displayed in a single color or black and white with a saturation of a color different from the light color of the emergency vehicle 200, or a color different from the light color of the emergency vehicle 200 When the display image data 110 in which the contrast of the portion displayed at is reduced is generated and displayed, in addition to the light 200L of the emergency vehicle 200, the same color object other than the light 200L maintains the same display as the light 200L. However, the lamp 200L can be clearly identified by displaying the icon 210 superimposed on the lamp 200L.

  The control unit 30 repeats such processing at predetermined intervals such as every frame or every predetermined frame.

  As described above, according to the present embodiment, when the detection unit 32 detects the presence of the emergency vehicle 200, the rear view monitor 3 displays the display video data in which the lighting color of the emergency vehicle 200 is conspicuous in the display color of the captured video data. 110 is displayed. In other words, according to the present embodiment, when the emergency vehicle 200 is present near the host vehicle, the display video data 110 that makes it easy to recognize the lamp 200L of the emergency vehicle 200 is displayed on the rear view monitor 3. As described above, according to the present embodiment, when the presence of the emergency vehicle 200 is detected, the display video data 110 that can easily recognize the lamp 200L of the emergency vehicle 200 can be displayed. Thereby, this embodiment can improve the visibility of the emergency vehicle 200. According to the present embodiment, the driver can easily confirm the emergency vehicle 200 when the emergency vehicle 200 exists in the range displayed on the rear view monitor 3.

  Since the siren sound of the emergency vehicle 200 is highly recognizable by hearing, the siren sound is often noticed even when the emergency vehicle 200 cannot be visually recognized. For this reason, according to the present embodiment, the driver can easily and accurately confirm the emergency vehicle 200 on the rear view monitor 3 after recognizing the emergency vehicle 200 with a siren sound.

[Second Embodiment]
The vehicle display system 1 according to the present embodiment will be described with reference to FIGS. 8 to 10. FIG. 8 is a schematic diagram illustrating a configuration example of the vehicle display system according to the second embodiment. FIG. 9 is a diagram illustrating an example of a siren sound pattern table of the vehicle display system according to the second embodiment. FIG. 10 is a flowchart showing a flow of processing in the vehicle display system according to the second embodiment.

  The vehicle display system 1A has the same basic configuration as the vehicle display system 1 of the first embodiment. In the following description, the detailed description of the same components as those of the vehicle display system 1 is omitted. As shown in FIG. 8, in the vehicle display system 1A of the present embodiment, the storage unit 20 of the vehicle display control device 10A stores the siren sound pattern table 21A, and the control unit 30A includes the specifying unit 35A. The point provided is different from the vehicle display system 1 of the first embodiment.

  As shown in FIG. 9, the siren sound pattern table 21 </ b> A stores the siren sound pattern, the type of the emergency vehicle 200, and the lamp color in association with each other. For example, in the siren sound pattern table 21A, the siren sound of “pattern 1” is “emergency car” and is stored as “red”. The siren sound of “Pattern 2” is “Fire-fighting car” and is stored as “Yellow”. The siren sound of “Pattern 3” is “Police Car” and is stored as “Blue”. For example, a siren sound is defined by a frequency and a period. By referring to the siren sound pattern table 21 </ b> A, it is possible to specify the type and the light color of the emergency vehicle 200.

  The specifying unit 35A specifies the type and lighting color of the emergency vehicle 200 from the sound information of the emergency vehicle 200 detected by the detection unit 32. More specifically, the specifying unit 35A performs pattern matching using a recognition dictionary on the sound information of the emergency vehicle 200 detected by the detection unit 32, and detects a siren sound. The specifying unit 35A refers to the siren sound pattern table 21A of the storage unit 20 and specifies the type and lighting color of the emergency vehicle 200 that corresponds to the siren sound of the emergency vehicle 200. The identification unit 35A outputs the identification result to the display video data generation unit 33.

  Next, the flow of processing by the control unit 30A will be described with reference to FIG. Step S21, step S22, and step S24 to step S27 perform the same processing as step S11 to step S16 of the flowchart shown in FIG. 7 of the first embodiment.

  The control unit 30A identifies the lighting color of the emergency vehicle 200 (step S23). The control unit 30A refers to the siren sound pattern table 21A of the storage unit 20 based on the sound information of the emergency vehicle 200 detected by the detection unit 32 by the specifying unit 35A, and determines the type and lighting color of the emergency vehicle 200. Make it specific. In this embodiment, if the sound information is a siren sound of pattern 1, the type of the emergency vehicle 200 is specified as an emergency vehicle and the light color is specified as red. If the sound information is a siren sound of pattern 2, the type of emergency vehicle 200 is identified as a fire-fighting vehicle and the light color is identified as yellow. If the sound information is a siren sound of pattern 3, the type of emergency vehicle 200 is specified as a police car and the light color is specified as blue.

  In the display color of the captured video data, the control unit 30A displays the light color specified by the emergency vehicle 200, in this embodiment, red for an emergency car, yellow for a fire engine, and blue for a police car. Prominent display video data 110 is generated.

  For example, a case where the color reduction process is performed in step S26 will be described. In the present embodiment, it is assumed that the type of the emergency vehicle 200 is a police car. In the display control unit 34, the control unit 30 </ b> A binarizes the display video data 100 with a saturation of a color different from blue, which is the light color of the emergency vehicle 200, to a predetermined amount or a predetermined rate, a low single color or black and white. Display video data 110 is generated and output to the display control unit 34. In the display video data 110 in this case, the portions of the emergency vehicle 200 other than the lights 200L, the other vehicle 201, the road 202, and the building 203 are dichromated with reduced saturation. In the display video data 110, the blue color is displayed as it is.

  For example, the case where the contrast reduction process is performed in step S26 will be described. The control unit 30A causes the display control unit 34 to generate and display the display video data 110 in which the contrast of the portion displayed in a color different from the light blue of the emergency vehicle 200 is reduced with respect to the display video data 100. It is made to output to the control part 34. In step S27, the control unit 30A causes the display control unit 34 to display the display video data 110 with reduced contrast on the rear view monitor 3. In the display video data 110 in this case, the contrast between the emergency vehicle 200 other than the lights 200L, the other vehicle 201, the road 202, and the building 203 is reduced. In the display video data 110, the blue color is displayed with the same contrast.

  For example, a case where icon display processing is performed in step S26 will be described. The display control unit 34 generates display video data 110 in which the icon 210 is superimposed on the lamp 200L of the emergency vehicle 200 with respect to the display video data 100, and outputs the display video data 110 to the display control unit 34. In step S27, the control unit 30A causes the display control unit 34 to display the display video data 110 on the rear view monitor 3. More specifically, in the display video data 110, an icon 210 is superimposed on the lamp 200L of the emergency vehicle 200 and displayed.

  As described above, according to the present embodiment, by referring to the siren sound pattern table 21A, the type and lighting color of the emergency vehicle 200 can be specified from the sound information of the emergency vehicle 200 detected by the detection unit 32. it can. Thereby, this embodiment can display the display video data 110 which is easy to recognize the lamp 200L of the emergency vehicle 200 even when the lamp color is different for each type of the emergency vehicle 200. Thus, according to the present embodiment, the driver can easily confirm the emergency vehicle 200 even when the lighting color is different for each type of the emergency vehicle 200.

[Third embodiment]
The vehicle display system 1 according to the present embodiment will be described with reference to FIGS. 11 and 12. FIG. 11 is a schematic diagram illustrating a configuration example of the vehicle display system according to the third embodiment. FIG. 12 is a flowchart showing the flow of processing in the vehicle display system according to the third embodiment.

  As shown in FIG. 11, the vehicle display system 1B of the present embodiment is the vehicle display system of the first embodiment in that the microphone 4B and the control unit 30B of the vehicle display control device 10B include a direction detection unit 35B. Different from 1.

  The microphone 4B is a sound collecting device having directivity. In the present embodiment, the microphone 4B has directivity on the rear side. In other words, the microphone 4B has directivity in the range shown in the video displayed on the rear view monitor 3.

  The direction detection unit 35B detects the sound source direction of the siren sound from the sound information of the emergency vehicle 200 detected by the detection unit 32. In other words, the direction detection unit 35B detects the direction of the emergency vehicle 200 from the sound information of the emergency vehicle 200 detected by the detection unit 32. The direction of the emergency vehicle 200 is a direction in which the emergency vehicle 200 is located with respect to the host vehicle. The method for specifying the sound source direction from the sound information may be any known method and is not limited. The direction detection unit 35B outputs the detection result to the display video data generation unit 33B. For example, a plurality of microphones 4B each having directivity in a plurality of directions are installed in the host vehicle, and the emergency vehicle 200 is positioned relative to the host vehicle from the difference in sound intensity of the emergency vehicle 200 detected by the plurality of microphones 4B. The direction to be detected is detected.

  When the sound source direction of the siren sound of the emergency vehicle 200 detected by the direction detection unit 35B is the same direction as the direction of the imaging unit 2, the display video data generation unit 33B lights the emergency vehicle 200 in the display color of the captured video data. Display video data 110 that is conspicuous in color is generated. In the present embodiment, when the emergency vehicle 200 is approaching from behind, the display video data generation unit 33B generates display video data 110 in which the light color of the emergency vehicle 200 is conspicuous in the display color of the captured video data. 34. The display video data generation unit 33B outputs the cut out display video data 100 to the display control unit 34 as it is when the emergency vehicle 200 moves away from the host vehicle, for example.

  Next, the flow of processing by the control unit 30B will be described with reference to FIG. Step S31, step S32, step S34, and step S36 to step S38 perform the same processing as step S11 to step S16 of the first embodiment.

  Control unit 30B detects the direction of emergency vehicle 200 (step S33). The control unit 30B causes the direction detection unit 35B to detect the sound source direction of the siren sound from the sound information of the emergency vehicle 200 detected by the detection unit 32.

  The controller 30B determines whether or not the emergency vehicle 200 is approaching from behind (step S35). More specifically, when the display video data generation unit 33B determines that the sound source direction of the siren sound of the emergency vehicle 200 detected by the direction detection unit 35B is the same direction as the direction of the imaging unit 2, the control unit 30B Then, it is determined that the emergency vehicle 200 is approaching from behind (Yes in step S35). If Yes in step S35, the process proceeds to step S37. When the display video data generation unit 33B determines that the sound source direction of the siren sound of the emergency vehicle 200 detected by the direction detection unit 35B is not the same direction as the direction of the imaging unit 2, the control unit 30B Is determined not to approach from behind (No in step S35). If No in step S35, the process proceeds to step S36.

  As described above, according to the present embodiment, when it is determined that the emergency vehicle 200 is approaching from behind, the display video data 110 in which the lighting color of the emergency vehicle 200 is conspicuous in the display color of the captured video data is generated. In other words, when it is determined that the emergency vehicle 200 is approaching from behind, the display video data 110 that makes it easy to recognize the lamp 200L of the emergency vehicle 200 is displayed on the rear view monitor 3. Thus, according to the present embodiment, when it is determined that the emergency vehicle 200 is approaching from behind, the display video data 110 that can easily recognize the lamp 200L of the emergency vehicle 200 can be displayed. Thereby, according to this embodiment, the driver | operator can confirm easily the emergency vehicle 200 approaching from back.

[Fourth embodiment]
The vehicle display system 1 of the present embodiment is different from the vehicle display system 1B of the third embodiment in that the detection unit 32 detects the sound source direction of the siren sound.

The detection unit 32 detects the sound source direction of the siren sound by analyzing the Doppler effect of the siren sound of the emergency vehicle 200 acquired by the microphone 4B. Here, the frequency detected by the driver of the vehicle is f, the speed of sound is V, the frequency of the siren sound of the emergency vehicle 200 is f ₀ , the speed of the vehicle is v ₀ , and the speed of the emergency vehicle 200 is v _s. When the direction in which the vehicle 200 approaches the vehicle is positive, the following formula 1 is established.
f = ((V−v ₀ ) / (V−v _s )) · f ₀ (1)

The detection unit 32 determines whether the emergency vehicle 200 is approaching or moving away by comparing the frequency f sensed by the vehicle driver in Equation 1 with the frequency fo of the siren sound. More specifically, the detection unit 32 detects the frequency f sensed by the driver of the vehicle calculated by Equation 1 when the emergency vehicle 200 approaches the vehicle and when the emergency vehicle 200 moves away from the vehicle, and the emergency vehicle. The magnitude relationship with the frequency f ₀ of the siren sound of 200 changes. In this way, the detection unit 32 detects the sound source direction of the siren sound by analyzing the frequency change due to the Doppler effect.

  Thus, according to the present embodiment, when it is determined from the analysis result of the Doppler effect that the emergency vehicle 200 is approaching, the display video data in which the lighting color of the emergency vehicle 200 is conspicuous in the display color of the captured video data. 110 is displayed on the rear view monitor 3. When it is determined from the analysis result of the Doppler effect that the emergency vehicle 200 is moving away, the cut-out display video data 100 is displayed on the rear view monitor 3.

  As described above, according to the present embodiment, the sound source direction of the emergency vehicle 200 siren sound can be detected by the detection unit 32 without the microphone 4B and the direction detection unit 35B of the third embodiment. For this reason, this embodiment can be made into a simple structure.

  Each component of the illustrated vehicle display system 1 is functionally conceptual, and may not necessarily be physically configured as illustrated. That is, the specific form of each device is not limited to the one shown in the figure, and all or a part of them is functionally or physically distributed or integrated in arbitrary units according to the processing load or usage status of each device. May be.

  The configuration of the vehicle display system 1 is realized by, for example, a program loaded into a memory as software. The above embodiment has been described as a functional block realized by cooperation of these hardware or software. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

  The components described above include those that can be easily assumed by those skilled in the art and those that are substantially the same. Furthermore, the structures described above can be appropriately combined. In addition, various omissions, substitutions, or changes in the configuration can be made without departing from the scope of the present invention.

  In the above embodiment, the detection unit 32 detects the presence of the emergency vehicle 200 based on the electric signal input from the microphone 4. However, the configuration for detecting the presence of the emergency vehicle 200 is limited to this. Not. For example, the display video data generation unit 33 may detect the emergency vehicle 200 by performing pattern matching on the captured video data using a recognition dictionary stored in the storage unit 20. Alternatively, the storage unit 20 stores the processing for detecting the presence of the emergency vehicle 200 based on the electrical signal input from the microphone 4 by the detection unit 32 and the captured video data by the display video data generation unit 33. The pattern matching using the recognition dictionary that is performed may be performed in parallel with the process of detecting the emergency vehicle 200. Thereby, the emergency vehicle 200 can be detected earlier and more reliably.

  When recognizing the emergency vehicle 200, the display video data generation unit 33 may recognize the emergency vehicle 200 approaching from behind, in other words, traveling in the same direction as the host vehicle. The display video data generation unit 33 performs pattern matching using the recognition dictionary stored in the storage unit 20 on the display video data 100 to determine the presence of the emergency vehicle 200 traveling in the same direction as the host vehicle. To detect. As a result, the emergency vehicle 200 moving away from the host vehicle, in other words, moving rearward with respect to the host vehicle, is removed, so that the present embodiment can display a more appropriate amount of information for the driver.

  When the presence of the emergency vehicle 200 is detected, the display video data generation unit 33 lights the emergency vehicle 200 in the display color of the captured video data according to the flowchart shown in FIG. 7 every predetermined frame or every predetermined time. The process of generating and outputting the display video data 110 that is conspicuous in color and the process of outputting the cut out display video data 100 as they are may be performed alternately. Thereby, when the presence of the emergency vehicle 200 is detected, the display video data 110 in which the lighting color of the emergency vehicle 200 is conspicuous and the cut out display video data 100 are alternately displayed every predetermined frame or every predetermined time. The For this reason, the driver can easily recognize that the display video data 110 is displayed, and can view the emergency vehicle 200 more easily.

  The display video data generation unit 33 performs processing on the lighting 200L of the emergency vehicle 200 in the captured video data when generating the display video data 110 in which the lighting color of the emergency vehicle 200 is conspicuous in the display color of the captured video data. The object to be photographed may be excluded from the processing target. More specifically, the display video data generation unit 33 detects the lighting 200L of the emergency vehicle 200 in the captured video data. For example, the display video data generation unit 33 may perform pattern matching using the recognition dictionary stored in the storage unit 20 on the display video data 100 to detect the lamp 200L of the emergency vehicle 200. Alternatively, for example, the display video data generation unit 33 performs image processing on the display video data 100, extracts a flashing subject or a rotating subject, and turns on the lamp 200L of the emergency vehicle 200. It may be detected. The display video data generation unit 33 generates display video data 110 in which the detected lamp 200L of the emergency vehicle 200 is conspicuous. As a result, in the display color of the photographed video data, the image processing that makes the light color conspicuous is not performed on the object to be photographed other than the light 200L of the emergency vehicle 200. Therefore, more appropriate display video data 110 can be displayed.

  The above embodiment is applicable even if the emergency vehicle 200 has two colors of lights. In this case, the siren sound pattern table 21A stores a plurality of lamp colors for one siren sound. For example, in the siren sound pattern table 21A, the siren sound of “pattern 4” is “emergency car” and is stored as “red and blue”. When the detection unit 32 detects the presence of the emergency vehicle 200, the display video data generation unit 33 generates display video data 110 in which a plurality of lighting colors of the emergency vehicle 200 are conspicuous in the display color of the captured video data.

DESCRIPTION OF SYMBOLS 1 Display system for vehicles 2 Imaging part 3 Rear view monitor (display panel)
4 Microphone 10 Vehicle Display Control Device 30 Control Unit 31 Video Data Acquisition Unit 32 Detection Unit 33 Display Video Data Generation Unit 34 Display Control Unit 100 Display Video Data 110 Display Video Data 200 Emergency Vehicle 200L Light

Claims (13)

A video data acquisition unit that acquires captured video data captured by an imaging unit that captures the periphery of the vehicle;
A detection unit for detecting the presence of an emergency vehicle;
A display video data generation unit that generates display video data in which the lighting color of the emergency vehicle is conspicuous in the display color of the captured video data when the detection unit detects the presence of an emergency vehicle;
A display control unit for displaying the display video data on a display panel installed in front of the driver of the vehicle;
A vehicle display control device comprising:   The vehicle display control apparatus according to claim 1, wherein the detection unit detects the presence of an emergency vehicle based on sound information.   The display video data generation unit generates display video data in which a color other than a lighting color of the emergency vehicle in a display color of the captured video data is reduced when the detection unit detects the presence of an emergency vehicle. The vehicle display control apparatus according to 1 or 2.   When the detection unit detects the presence of an emergency vehicle, the display video data generation unit is a display in which a color other than the light color of the emergency vehicle in the display color of the captured video data is reduced to a single color or black and white The vehicle display control apparatus according to any one of claims 1 to 3, which generates video data.   The display video data generation unit reduces the contrast of a portion displayed in a color different from the lighting color of the emergency vehicle in the display color of the captured video data when the detection unit detects the presence of an emergency vehicle. The vehicle display control device according to claim 1, which generates data.   The vehicle display control device according to any one of claims 1 to 5, wherein the display video data generation unit generates display video data in which a red color in the display color of the captured video data is conspicuous. A specifying unit that specifies the light color of the emergency vehicle from the sound information of the emergency vehicle detected by the detection unit;
The display video data generation unit generates display video data in which the lighting color of the emergency vehicle specified by the specifying unit is conspicuous when the detection unit detects the presence of an emergency vehicle. The vehicle display control device according to Item. A direction detection unit that detects the direction of the siren sound from the emergency vehicle sound information detected by the detection unit;
The display video data generation unit is configured to light the emergency vehicle in the display color of the captured video data when the sound source direction of the emergency vehicle detected by the direction detection unit is the same as the direction of the imaging unit. The vehicle display control device according to any one of claims 1 to 7, which generates display image data in which colors are conspicuous. The detection unit detects a positional relationship between the emergency vehicle and the vehicle from sound information of the emergency vehicle,
The display video data generation unit is configured such that, when the positional relationship between the emergency vehicle detected by the detection unit and the vehicle is approaching from the rear of the vehicle, the lighting color of the emergency vehicle is the display color of the captured video data. The vehicle display control device according to any one of claims 1 to 8, which generates conspicuous display video data. The display video data generation unit generates display video data with a noticeable lighting color of an emergency vehicle at predetermined time intervals.
The vehicle display control apparatus according to any one of claims 1 to 9.   A vehicle display system, further comprising at least one of the vehicle display control device according to claim 1, the imaging unit, and the display panel. A video data acquisition step of acquiring captured video data captured by an imaging unit that captures the periphery of the vehicle;
A detection step for detecting the presence of an emergency vehicle;
A display video data generation step for generating display video data in which the lighting color of the emergency vehicle is conspicuous in the display color of the captured video data when the detection step detects the presence of an emergency vehicle;
A display control step of displaying the display video data on a display panel installed in front of the driver of the vehicle. A video data acquisition step of acquiring captured video data captured by an imaging unit that captures the periphery of the vehicle;
A detection step for detecting the presence of an emergency vehicle;
A display video data generation step for generating display video data in which the lighting color of the emergency vehicle is conspicuous in the display color of the captured video data when the detection step detects the presence of an emergency vehicle;
A program for causing a computer that operates as a vehicle display control device to execute a display control step of displaying the display video data on a display panel installed in front of a driver of the vehicle.