JP2007158578A - Entire circumference information annularly displaying system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an entire circumference information annularly displaying system for supporting a driver by processing moving pictures of cameras for imaging the perimeter of a vehicle and projecting or displaying moving picture information of the outside of the vehicle on an annular display part of the interior part of the vehicle. <P>SOLUTION: The entire circumference information annularly displaying system always acquires moving picture information of the entire circumference at the outside of the vehicle by using one or more of the moving picture camera. An annular display means displays information items of back and forth and around the vehicle in cross reference with the annular part. An image processing/recognition means applies display image processing to moving picture information from the cameras and recognizes an object in the image, composes a display cross-reference image with overlapping information by referencing operation unit information and attached information entered separately to form an annular part cross-reference display image, and outputs the image to the annular display means. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an all-around information annular display system that assists a driver by projecting or displaying moving image information outside a vehicle on a display portion in the vehicle based on a camera moving image that captures the vehicle periphery.

Visual information support for the driver is generally in the form of looking into a limited display area such as a rearview mirror or a back monitor, and only visual information for a specific part can be supported and the listability is poor. In addition, although there are mirrors and cameras that are movable, there is a problem that it is difficult to know which part is being viewed.
In addition, there exists a head-up display as what is projected on a windshield.

The invention described in Patent Document 1 (vehicle body lower display system) discloses that panoramic display or the like is performed by imaging the entire periphery of the lower part of the vehicle body.
The invention (vehicle periphery confirmation device) described in Patent Document 2 discloses that a panoramic image is obtained by rotating a wide-angle camera and synthesizing acquired images.
The invention described in Patent Document 3 (vehicle image information display device) discloses that a display device is installed from the vicinity of the right front pillar to the vicinity of the left front pillar so that a person other than the driver can view the image information. Yes.
The invention (in-vehicle display device) described in Patent Document 4 discloses displaying display information on a display unit provided at a predetermined position of a windshield of a vehicle.
In the invention disclosed in Patent Document 5 (vehicle head-up display device), the display information on the display panel surface placed inside the vehicle is optically displayed on the windshield of a vehicle such as an automobile as a conventional example. A vehicle head-up display device is described in which information is visually reflected and displayed as an optical virtual image in the visual field of a driver or the like.
JP 2004-320492 A JP-A-2005-051620 JP2004-243898 Japanese Patent No. 2616459 Shoko 63-053046

Conventionally, visual information support for a driver by a conventional technique is a room mirror, a back monitor, and the like, and is a form of looking into a limited display area.
On the other hand, there is a panoramic image of a horizontally long image display or a circular image display as a display of an image of the entire periphery of the vehicle instead of the limited display.
Among them, the one that displays the entire periphery as a horizontally long panoramic image can display the entire periphery of the vehicle, but it is difficult to grasp at a glance which direction the local area of the displayed image is.
In addition, those that display circular images of images acquired using fisheye lenses or hyperboloid mirrors can display the entire vehicle periphery, making it easy to grasp the direction of the local area of the image, but because the image is distorted, The sense of distance is difficult to grasp at a glance regardless of the human sense.
Also, rotating the camera to shoot the entire periphery of the vehicle to obtain a panoramic image requires a camera rotation time to make a round. Compared to creating a panoramic image without rotating the camera. The same panoramic image cannot be obtained at the same time. Therefore, when the vehicle is traveling, an unnatural image is obtained as compared to when the vehicle is stopped.

An object of the present invention is to provide a panorama in which the entire periphery of an outer peripheral annular region or a windshield peripheral portion (including a windshield and a windshield frame) in a display independently arranged in a vehicle is associated with the direction of the vehicle. An object of the present invention is to provide an all-around information circular display system that enables intuitive understanding of which direction of an image to be displayed corresponds to an image outside the vehicle by projecting and / or displaying the image.
A more detailed object of the present invention is to provide an all-around information circular display that enables individualized assistance by driver identification, display of marks and schematic diagrams, provision of audio information, etc. in the display system. To provide a system.

In order to achieve the object, an all-around information circular display system according to claim 1 according to the present invention is provided.
Camera means for constantly acquiring video information of the entire periphery outside the vehicle by one or more video cameras;
An annular display means for displaying information on the front, rear, left and right of the vehicle in association with the annular portion;
The moving image information from the camera means is subjected to image processing for display and recognition of an object in the image, and the display-corresponding image and the overlay information are synthesized with reference to the separately input operator information and additional information. And image processing / recognizing means for forming a partial corresponding display image and outputting it to the annular display means.

According to a second aspect of the present invention, there is provided an all around information circular display system according to the first aspect of the present invention.
The moving image camera is a plurality of cameras capable of controlling the depression angle, acquires moving image information of the entire periphery, and is configured to process the information based on the operating element information and the additional information and output the processed information to the annular display means. ing.

According to a third aspect of the present invention, there is provided an all-around information circular display system according to the third aspect of the present invention.
The moving image camera is configured to always acquire moving image information of the entire periphery with a single camera, process the information based on the operator information and additional information, and output the processed information to the annular display means. .

An all-around information circular display system according to a fourth aspect of the present invention is the system according to the first aspect,
The display means is configured such that the upper and lower sides of the screens arranged on approximately four sides display the vehicle front-rear direction information and the left and right sides display the vehicle left-right direction information.

An all-around information circular display system according to claim 5 of the present invention is the system according to claim 1,
The display means is configured such that the upper and lower sides of the display arranged on approximately four sides display the vehicle front-rear direction information, and the left and right sides display the vehicle left-right direction information.

An all-around information circular display system according to a sixth aspect of the present invention is the system according to the first aspect,
The display means is configured so that the correspondence between the display and the vehicle can be changed by an input from an operator.

An all-around information circular display system according to claim 7 according to the present invention is the system according to claim 1,
The additional information is configured to include vehicle speed information or travel mode information for changing the depression angle of the camera means.

An all-around information circular display system according to claim 8 according to the present invention is the system according to claim 1,
Registration identification means for registering and identifying the driver;
Situation detection means for detecting vehicle speed, driving mode or driver-specific behavior;
A control means for changing the degree of change in depression according to the vehicle speed and driving mode according to the driver and the situation, and a correction / learning means for correcting or learning the degree of change in depression according to the driver's instruction It is configured.

An all-around information circular display system according to claim 9 according to the present invention is the system according to claim 1,
The image processing / recognition means is capable of density adjustment, brightness adjustment and enhancement for display image processing processing,
Including recognition means for recognizing objects such as obstacles, dangerous objects, signs, road displays and pedestrians, and generating recognition output,
Additional information is added to the display image based on the recognition output.

An all-around information circular display system according to claim 10 according to the present invention is the system according to claim 1,
The all-around information circular display system includes a voice presentation unit, and performs voice presentation based on a recognition target of the recognition unit,
The voice presentation unit is a transparent speaker film, a speaker array, or several speakers, and is configured to perform voice presentation based on the recognition target of the recognition unit and the position of the target.

An all-around information circular display system according to claim 11 according to the present invention is the system according to claim 1,
Additional information such as video captured by the camera means and traffic information is input to the image processing / recognition means, and the image processing / recognition means processes the image into an image corresponding to the entire direction of the vehicle,
Associating the object recognized by the recognition means with additional information such as the input traffic information,
After the process of adding the additional information to the corresponding position on the image, the image processing / recognition means outputs it.

An all-around information circular display system according to claim 12 according to the present invention is the system according to claim 1,
Input the video imaged by the camera means to the image processing / recognition means,
The object recognized by the recognition means of the image processing / recognition means is recognized corresponding to the direction of the entire circumference of the vehicle, a recognition result is output, and the direction corresponding to the object is output according to this output information An image is displayed with a mark / schematic diagram corresponding to each object in an annular display area, or is displayed with an element that can be color-coded, such as an LED or a lamp.

  In the present invention, since images and information corresponding to the direction of the entire circumference of the vehicle are displayed, in which direction outside the vehicle more than the conventional image display and information display methods not compatible with the surrounding direction. Since the image / information is easy to understand with a sense of direction, safety confirmation is easy.

In the all-around information ring display system according to the present invention, first, an image of the entire periphery of the vehicle is taken with one or more moving-image cameras.
Associate the entire periphery of the windshield periphery (including the windshield and windshield frame) with the direction of the entire circumference of the vehicle (when viewed from the driver side, the upper part of the windshield is behind the vehicle, the right part is the right side of the vehicle, the left part is the vehicle (Left side, lower part is front of vehicle).
The camera image is processed into a panoramic image corresponding to the projected or displayed part (upper, lower, left, and right sides), and if there is additional information such as danger information, the image is superimposed and displayed. An image corresponding to the portion is projected onto the peripheral edge of the windshield by a projection device and / or displayed on a display installed at the peripheral edge of the windshield.

  It is possible to select from predetermined settings whether the image projected and / or displayed on the upper periphery of the windshield as viewed from the driver side is to be a mirror image display similar to a rearview mirror or a mirror image display inverted upside down. Or / and can be set by the user or / and can be changed by a dedicated operator.

Embodiments of an apparatus according to the present invention will be described below with reference to the drawings.
As shown in FIGS. 1 and 2, a plurality of video cameras are arranged all around the vehicle. As for the arrangement of the moving camera, a plurality of cameras may be arranged in an arrangement other than those shown in FIGS. 1 and 2 so as to cover the entire periphery of the vehicle. Images of the entire periphery of the vehicle 10 are taken with a plurality of video cameras as shown in FIGS. In the camera arrangement examples of FIGS. 1 and 2, the effective shooting range is indicated by an arrow range for the cameras 1 to 4. If a fisheye lens or a hyperboloid mirror is attached to the moving image camera, a wide range of photographing can be performed for each camera as shown in FIGS. Further, in the case of shooting with a wide-angle camera or a super-wide-angle camera, the shooting range becomes narrower than when a fisheye lens or a hyperboloid mirror is used, and it is necessary to arrange the shooting ranges of the cameras little by little. It is necessary to increase the number of cameras arranged from 2.

[All-round information ring display example and basic configuration]
FIG. 3 shows an embodiment of the display means of the peripheral display portion of the windshield 5. In this embodiment, four displays are arranged, but this portion can be projected and displayed as a screen. In FIG. 3, the display part of the peripheral part (including the windshield and the windshield frame) of the windshield 5 is as follows. The windshield upper part is the rear side of the vehicle, the right part is the right side of the vehicle, the left part is the left side of the vehicle, and the lower part. Respectively correspond to the front of the vehicle, and as a whole, the entire periphery of the windshield peripheral portion corresponds to the direction of the entire periphery of the vehicle. FIG. 4 uses an outer portion surrounding the center of one display portion of one display 6 (plasma display, liquid crystal display, etc.) as an annular display portion. The central part can be used for other displays as appropriate.

FIG. 5 is a block diagram showing an embodiment of the all-around information ring display system.
The display unit (FIG. 3) for each of the four sides is processed so as to obtain an image in the corresponding direction for each of the four sides. In FIG. 5, the display device for displaying an image is a projection device such as a projector, or a display display such as a liquid crystal display device.
The corresponding image output from the image processing / recognition device is projected onto the display portion of each of the four sides by the projection device, or the image is displayed on the display display arranged around the entire periphery of the windshield. Is displayed.
In the display means of FIG. 3, the upper part in the figure projects an image with a projection device, the right and left parts of the figure display an image on a display display, and the lower part of the figure displays an image with a projection apparatus and a display display. It is also possible to project and / or display an image by combining a projection apparatus and a display display as a whole so as to perform projection display.

In FIG. 5, signals from cameras 1 to 4 (or the only camera not shown) are connected to the image processing / recognition apparatus. Further, additional information such as operator information and danger information is input from the operator. The image processing / recognition apparatus processes these pieces of information (entire surrounding information) and sends them to the annular display unit described with reference to FIGS.
Images taken by a plurality of cameras (or the only camera not shown) are input to the image processing / recognition device, where the image processing is performed in the image processing device, and the additional information is superimposed and displayed. After the synthesizing process is performed, the image data is output to the display device.

FIG. 6 systematically shows the processing inside the image processing / recognition apparatus shown in FIG.
In the figure, camera images input from a plurality of cameras (see FIGS. 1, 2 and 7) are input-processed as camera image data, a virtual depression angle is set by the depression angle setting unit, and perspective projection is performed by the perspective projection conversion unit. A perspective projection image is generated by the conversion process.
Thereafter, the four-side panoramic image synthesis portion is processed as a perspective projection image corresponding to each of the four sides, and is synthesized into a panoramic image as the entire periphery of the vehicle. Then, an additional information superimposing unit performs an image synthesizing process for displaying additional information such as danger information on the panoramic image, and displays it by the display means.

An image taken with a camera that uses a fisheye lens or a hyperboloid mirror as a moving image camera (in the case of the only camera not shown) is a circular image as it is. Therefore, the perspective projection conversion unit cuts out the image data area necessary for displaying each side from the captured image data using the image data area of the camera corresponding to the display direction of each side and the virtual depression angle information, and performs the perspective projection conversion process. A perspective projection image is generated. Thereafter, the four-side panoramic image synthesis portion is treated as a perspective projection image corresponding to the display direction of each side, and is synthesized into a panoramic image as the entire circumference of the vehicle.
When using a wide-angle camera or a super-wide-angle camera for the video camera, the captured image is a distorted image and a limited shooting range, so the perspective projection conversion unit can display camera image data corresponding to the display direction of each side. A perspective projection conversion process is performed using the virtual depression angle information, and a partial perspective projection image corresponding to the display direction of each side is generated. Thereafter, a perspective projection image corresponding to the display direction of each side is generated by image synthesis from the partial perspective projection images necessary for display in each side direction in the four-side panoramic image synthesis portion, and the panorama image as the entire vehicle periphery is generated. It is synthesized.

  When using a fisheye lens or a hyperboloid mirror to obtain moving image information around the entire vehicle with a single moving camera, the camera is installed vertically upward on the roof of the vehicle. At this time, the camera is installed so that the area around the vehicle that is invisible (behind the vehicle) is reduced depending on the vehicle. The captured image is a circular image centered on the vehicle, and the same circular image is input to all the camera images in FIG. In this way, the processing / recognition unit shown in FIG. 6 can be executed by the same processing as when the fisheye lens or the hyperboloid mirror described above is used.

Whether or not the mirror image projected or / and displayed on the upper peripheral edge of the windshield is turned upside down can be set, selected or changed according to the operator information of the dedicated operator.
The operator information corresponding to the operation of the dedicated operator in the operators shown in FIG. 5 is processed by the image processing / recognition means shown in FIG. In the four-side panoramic image synthesis part of the image processing / recognition means, the image projected or / and displayed on the upper edge of the windshield according to the information of this operator is displayed as a mirror image similar to the room mirror or upside down. Whether to display a mirror image is determined, processed into a perspective projection image corresponding to this information, and combined with the panoramic image. In this case, whether or not the image projected or / and displayed on the upper peripheral edge of the windshield is turned upside down can be selected from a predetermined setting or / and can be set by the user or / And can be changed with a dedicated operator.

[Control of panoramic image depression]
In the all-around information annular display system according to the present invention, the depression angle of the panoramic image can be controlled according to the vehicle speed and the driving mode. Information on the vehicle speed and the travel mode is supplied as additional information to the image processing / recognition means in FIG. 6, and the setting of the depression angle corresponding to the input information of the vehicle speed and the traveling mode is changed in the depression angle setting portion. FIG. 7 illustrates the depression angles α and β. The camera arrangement in the figure corresponds to the camera arrangement example in FIG. In the depression angle setting unit in the image processing / recognition means of FIG. 6, when the vehicle speed is low, the input information of the vehicle speed and the driving mode is converted into information with a large depression angle so as to look near the vehicle (α and β are set to large values). Set). When the vehicle speed is high, the input information of the vehicle speed and the driving mode is converted into information with a small depression angle so as to look far away from the vehicle (α and β are set to small values). Similarly, the image processing means can generate images in each direction with depression angles corresponding to the vehicle speed and the driving mode for the right side and the left side of the vehicle. In addition, it is possible to change the degree of change of the depression angle according to the vehicle speed and the driving mode for each direction corresponding to each projection unit or each display unit. In this way, it is possible to project and / or display an image in which the depression angle corresponding to the vehicle speed and the driving mode is changed in correspondence with each of the annular (side) directions of the display means of FIGS.

[Voice presentation]
In the all-around information circular display system according to the present invention, it is possible to present direction information and what the object is as an audio signal for the object recognized by the above-described system. FIG. 8 is a block diagram of a circuit added for voice presentation. The recognition information output from the image recognition processing unit in FIG. 6 is input to the recognized object audio signal generation apparatus in FIG. The sound signal of the recognized object is input to the sound signal arbitrary localization setting device shown in FIG.
On the other hand, the position information output from the image recognition processing unit in FIG. 6 is input to the audio signal arbitrary localization setting device in FIG. 8, and the image of the recognition target is displayed using the position of the audio signal input through another route. Voice localization processing is performed so that voice information can be heard by the driver from the direction.
The processed sound is output to a speaker through an amplifier. An audio signal processing device or the like can be used for the audio localization process. The installation location of the two or more speakers shown in FIG. 8 is not limited, and the installed speakers and the audio signal arbitrary localization setting device shown in FIG. 8 are combined so that sound can be heard from a designated direction. It only has to be set.
If a transparent speaker film is used, it can be installed on the image display device and sound can be generated from the portion where the image is displayed. Further, it can be installed on the periphery of the windshield without obstructing the driver's view. By using the speaker array, it is possible to easily localize the direction in which the audio signal is presented. Any speaker may be used as long as the speaker installed in FIG. 8 and the audio signal arbitrary localization setting device are combined and initialized so that sound can be heard from a designated direction. In this way, by presenting the audio corresponding to the recognition object from the direction in which the recognition object is displayed as an image, the visual information of the part that cannot be seen by the eye, the part that cannot be watched, or the part that cannot be seen by the eye is complemented It can be performed.

[Additional information display]
By displaying the recognition object as a mark / schematic diagram, it is possible to make the display visually understandable to the driver.
A process may be added to display the mark / schematic diagram of the object recognized in the superimposed combination portion of the additional information in FIG. 6 with respect to the position direction of the object recognized by the image recognition processing unit in FIG. it can. FIG. 9 shows a display example of the mark / schematic diagram corresponding to the position direction of the recognized object.
FIG. 10 shows a display example in the case of displaying a mark / schematic diagram corresponding to the position direction of the recognized object by lighting the light emitting element.
In FIG. 10, a picture of an object can be prepared for each recognition target area, and the picture can be displayed dark when the LED or lamp is turned off, and bright when turned on. In the mark / schematic diagram, the dotted line indicates that the LED / lamp or the like is turned off, and the solid line indicates that the LED / lamp or the like is turned on. In this case, the target object recognized by the image recognition processing unit in FIG. 6 is converted into a position direction according to the approximate direction corresponding to the display in FIG. Output as lighting information such as LED / lamp for displaying objects. By doing in this way, it can respond to LED / lamp etc.
When displaying a picture of an object, displaying it in a different color for each object, not the same color, can improve the ease of recognition and prevent erroneous recognition.
Instead of displaying a picture of the object, it is also possible to display the recognition object by the color of the LED / lamp or the like that is lit. It is also possible to implement by arranging LEDs / lamps having different colors instead of pictures for each region. In this case, it is possible to improve the ease of recognition if characters indicating what the object is near the LED / lamp or the like are displayed by printing or the like.

[Driver information processing]
It is possible to make the change in depression angle correspond to each driver or to learn for each driver. To that end, FIG. 11 shows a circuit block that is operated in relation to the basic operation of FIG.
The registration identification means shown in FIG. 11 includes an operator, an identification sensor, and a registration identification device. The identification sensor can be composed of a fingerprint verification device, a face authentication device, an eye iris verification device, a palm vein authentication device, or the like. Used for driver registration and identification.
The operator shown in the figure can be constituted by a switch, a voice recognition device, or the like, and registration or identification is performed according to the operation order of the switch, turning on the dedicated switch, or the recognition result of the voice recognition device.
At the time of registration, the identification sensor information is stored in the registration identification device with the driver name assigned by the operator. At the time of identification, the identification sensor information and the stored driver are collated, and if the identification can be made, the driver name is output from the registration identification device, and if the identification is not possible, the output of the registration identification device at the time of starting the engine The general person who is is output.
The situation detection means is constituted by the situation detection apparatus shown in the figure, detects the vehicle speed or the driving mode or the behavior of the driver, and outputs the situation information to the control apparatus as the control means. The travel mode includes information such as forward, reverse, left turn, right turn, stop, parking, steering angle information, accelerator information, and brake information.

The control device shown in FIG. 11 changes the depression angle change degree using the situation information and the driver information, and outputs the depression angle information to a correction learning device that is a correction / learning unit. The degree of depression change is stored for each driver and situation.
The correction learning device shown in FIG. 6 corrects or learns the degree of change in the depression angle for each driver using the operator information that is an instruction of the driver, and obtains the depression angle information via the additional information in FIG. Output to the depression setting part instead of the driving mode information.
For ordinary people, it is prepared as standard data. This is because various information during driving for a predetermined number of people is acquired, statistical processing is performed on each item to be classified, and the central value or average value etc. is used as standard data as standard data. it can. In addition, in the case of data that deviates statistically from the data of the general public, it can be detected as the driver's habit or behavior.
In addition, data that always shows the same movement can be detected as a habit or behavior peculiar to the driver.
For example, if the driver A always steps twice when braking, the change in the vehicle speed is not linear, and the driver A sees the image when the depression angle is changed according to the change in the vehicle speed. Sometimes I feel uncomfortable or uncomfortable. In such a case, the change in the vehicle speed is not linear according to the instruction from the driver's operator, but the degree of change in the depression angle is corrected linearly or learned to change smoothly instead of following the change in the vehicle speed. To do. The correction result and the learning result are stored for each driver and reflected immediately. Alternatively, when the brake is stepped twice, the depression angle information of the control device can be output so that the depression angle changes smoothly according to the situation so as to change smoothly with reference to the vehicle speed and the brake information.
When a driver sees an image that is displayed depending on the degree of change in depression, the feeling (discomfort, unpleasantness, seasickness, no particular problems, etc.) seen for each driver is different, and the driver has an adverse effect on driving. There is a case. According to the present invention, it is possible to give a more suitable depression angle change degree corresponding to the driver, and it is possible to display a gentle image without feeling uncomfortable for the driver.

[Display additional information]
The recognized object can be promptly recognized by the driver by adding a visual display difference on the display image by adjusting the density, adjusting the brightness, and emphasizing the detected object. 6 recognizes objects such as obstacles, dangerous objects, signs, road surface displays, and pedestrians using image processing techniques such as projective transformation, normalized correlation, pattern recognition, and character recognition. Output.
In the superimposed combination portion of the additional information shown in the figure, the image data of the image position of the recognition target detected based on the recognition information is subjected to visually different image processing such as density adjustment, luminance adjustment and enhancement, and output. To do. For example, two levels of luminance enhancement with visual differences are prepared, and luminance enhancement 1 and luminance enhancement 2 are alternately displayed at a fixed time or displayed with varying time intervals to detect and detect the driver's attention. The recognition degree of the recognized recognition object can be increased.
Further, additional information such as what the recognition object is based on the recognition information can be added as character information, or a frame around the object can be added. Furthermore, the character information described can be added as additional information for signs, road surface displays, and the like.
It is possible to turn on / off display such as density adjustment, brightness adjustment, and emphasis of a recognition target detected by information on the operation unit in FIG. Similarly, the display of additional information can be turned on / off. Each display ON / OFF can be set independently, and the display of the recognition object is not displayed (such as density adjustment, brightness adjustment or emphasis) (off), and only the additional information is displayed (ON). Is possible. It is also possible to turn on / off the display collectively. In this way, the detected recognition object is visually highlighted / displayed with a visual difference on the display image by density adjustment, brightness adjustment, emphasis, etc., and frame display, character information, etc. are added. By adding information, it is possible to easily recognize the recognition target object detected by the driver.

[Additional information related to other systems]
In addition to the above-mentioned information that adds the information of the recognition object in the image as additional information, the additional information obtained through a different route from the image is associated with the recognition object in the image to obtain a corresponding position on the image. Additional information can also be added.
The image recognition processing unit shown in FIG. 6 recognizes an object in the same manner as described above, and associates additional information obtained by a different route from the image with the recognized object in the image and adds it to the corresponding position on the image. Output as recognition information.
The association of information can be performed by a method in which the correspondence is performed based on a correspondence table in which the correspondence is predetermined. In the superimposed combination portion of the additional information shown in the figure, image processing for adding the additional information to the corresponding image position based on the recognition information is performed and output.
For example, traffic information such as VICS (Vehicle Information and Communication System) is input into the additional information shown in FIGS. 5 and 6, and road traffic information such as traffic jams and traffic regulations is associated with the vehicle ahead as the recognized object. Thus, when there is no forward vehicle at the corresponding position, traffic restriction information such as forward traffic jams and traffic restrictions can be displayed at a predetermined position or a position corresponding to a far distance ahead. In addition, traffic regulation information such as speed regulation can be associated with a speed limit sign or speed road surface display and replaced with character information of traffic regulation information instead of the recognized sign or road surface text information and displayed as additional information. it can.
Or, correlate traffic obstacle information such as accidents, broken cars, road obstacles, construction, work, etc. with the front vehicle that is the recognized object, and if there is no front vehicle, it corresponds to a predetermined position or far ahead Traffic obstacle information such as accidents, broken cars, road obstacles, construction, and work can be displayed at the location.
In this way, by associating the recognized object with the additional information such as the input traffic information and adding the additional information to the corresponding position, more accurate information can be given to the driver.

  According to the present invention, images and information necessary for driving support are associated with display directions, and can be projected or / and displayed on, for example, the windshield peripheral edge, and which image corresponds to which direction outside the vehicle. The driver can understand intuitively. It can be widely used in automobile-related industries and transportation industries.

It is a top view which shows the example which arrange | positions several cameras in the all-around information cyclic | annular display system by this invention. It is a top view which shows the other example of arrangement | positioning of the several camera in the said system. It is a figure which shows the example which provided the display part in the windshield periphery in the said system. In the said system, it is a figure which shows the example which uses the periphery of the display part of one display as a cyclic | annular display means. It is a block diagram which shows the basic composition of the all-around information cyclic | annular display system by this invention. It is a figure which shows the process inside the image processing and recognition apparatus of a omnidirectional information cyclic | annular display system. It is explanatory drawing which shows the depression angle of the camera mounted in the vehicle. FIG. 3 is a block diagram for presenting voice in the all-around information ring display system according to the present invention. It is the schematic which shows the example of a display of the mark / schematic diagram corresponding to the position direction of the recognized target object. It is the schematic which shows the example of a display in the case of displaying the mark / schematic diagram corresponding to the position direction of the recognized target object by lighting of a light emitting element. It is a block diagram of the circuit relevant to utilization of driver information in the all-around information ring display system by the present invention.

Explanation of symbols

1-4 Camera 5 Windshield 6 Display 10 Vehicle

Claims (12)

Camera means for constantly acquiring video information of the entire periphery outside the vehicle by one or more video cameras;
An annular display means for displaying information on the front, rear, left and right of the vehicle in association with the annular portion;
The moving image information from the camera means is subjected to image processing for display and recognition of an object in the image, and the display-corresponding image and the overlay information are synthesized with reference to the separately input operator information and additional information. An image processing / recognizing means for forming a partial corresponding display image and outputting it to the annular display means;
An all-around information ring display system composed of   The moving image camera acquires a plurality of moving image information by a plurality of cameras capable of controlling a depression angle, processes the information based on operation information and additional information, and outputs the processed information to the annular display means. All-around information ring display system.   The whole moving image camera according to claim 1, wherein the moving image camera always acquires moving image information of the entire periphery with one camera, and processes the information based on operation information and additional information and outputs the processed information to the annular display means. Ambient information ring display system.   2. The all-around information ring-shaped display system according to claim 1, wherein the display means displays information about the front-rear direction of the vehicle on the upper and lower sides of the screens arranged on substantially four sides and information on the left-right direction of the vehicle on the left and right sides.   2. The all-around information ring display system according to claim 1, wherein the display means displays information on the front-rear direction of the vehicle on the upper and lower sides of the display arranged on approximately four sides and information on the left-right direction of the vehicle on the left and right sides.   2. The all-around information ring display system according to claim 1, wherein the display means can change a correspondence between the display and the vehicle by an input of an operation element.   2. The all-around information annular display system according to claim 1, wherein the additional information includes vehicle speed information or travel mode information for changing a depression angle of the camera means. The all-around information circular display system according to claim 1,
Registration identification means for registering and identifying the driver;
Situation detection means for detecting vehicle speed, driving mode or driver-specific behavior;
Control means for changing the degree of change of the depression angle according to the vehicle speed and the driving mode according to the driver and the situation,
Correction / learning means for correcting or learning the degree of change of the depression angle according to a driver's instruction;
An all-around information ring display system consisting of The image processing / recognition means is capable of density adjustment, brightness adjustment and enhancement for display image processing processing,
Including recognition means for recognizing objects such as obstacles, dangerous objects, signs, road displays and pedestrians, and generating recognition output,
The all-around information circular display system according to claim 1, wherein additional information is added to a display image based on the recognition output. The all-around information circular display system includes a voice presentation unit, and performs voice presentation based on a recognition target of the recognition unit,
The all-around information circular display system according to claim 1, wherein the voice presentation means is a transparent speaker film, a speaker array, or several speakers, and performs voice presentation based on a recognition target of the recognition means and a position of the target. Additional information such as video captured by the camera means and traffic information is input to the image processing / recognition means, and the image processing / recognition means processes the image into an image corresponding to the entire direction of the vehicle,
Associating the object recognized by the recognition means with additional information such as the input traffic information,
The all-around information circular display system according to claim 1, wherein after the process of adding additional information to the corresponding position on the image is performed, the information is output from the image processing / recognition means. Input the video imaged by the camera means to the image processing / recognition means,
The object recognized by the recognition means of the image processing / recognition means is recognized corresponding to the direction of the entire circumference of the vehicle, a recognition result is output, and the direction corresponding to the object is output according to this output information 2. The all-around information annular display system according to claim 1, wherein the annular display area is configured to display an image with a mark / schematic diagram corresponding to each object or display with a color-coded light emitting element.

Images