JP2009083791A - Image display method, on-vehicle image display system and image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display method, a car-mounted image display system and an image processing apparatus capable of imaging a driver and an assistant driver of a front seat without uncomfortable feeling against the rear passengers when imaging a driver and an asistant driver together using an imaging device having a wide-angle lens. <P>SOLUTION: The image picked up by the imaging device 1 is laterally reversed and divided into two areas, left and right. Each area is processed to be respectively laterally reversed by an image processing part 22 of an ECU 2 to be displayed on the image display device 3. The image picked up by the imaging device 1 may be divided into two areas, left and right, and processed to laterally replace the arrangement of the two areas each other. Storing data of a corresponding position of each picture element of an original image and a replaced image in a conversion table or the like, the each picture element of a picked up image may be processed to be moved from the stored data of the corresponding positions. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image display method, an in-vehicle image display system, and an image processing apparatus that provide a comfortable in-vehicle environment to passengers in a rear seat of a vehicle.

  In recent years, vehicles have been equipped with car navigation devices or television devices, and by displaying guidance images or television programs related to traveling on image display devices such as liquid crystal displays, the comfort of passengers traveling in vehicles has been improved. It is illustrated.

  While the vehicle is running, the occupant often has the opportunity to enjoy conversations with other occupants as well as view images displayed on the image display device. When a passenger in the rear seat of a vehicle has a conversation with a passenger in the driver's seat and passenger's seat, the passenger's seat in the rear seat cannot directly see the facial expressions of the passenger in the driver's seat and passenger's seat, so the conversation's true intentions may be changed. There are prisoners who are in a situation where it is difficult to have a simple conversation. Therefore, a method for improving the conversation between the front seat passenger and the rear seat passenger by imaging the front seat passenger with an imaging device such as a camera and displaying the captured image of the front seat passenger on the image display device is proposed. Has been.

  In Patent Document 1, an image of a rear-seat occupant captured by a rear-seat video camera is displayed on a front-seat display arranged at a position visible to the front-seat occupant, and before the front-seat video camera captures the image. A vehicle-mounted video display device that displays an image of a seat occupant on a rear seat display arranged at a position visible to the rear seat occupant has been proposed. This in-vehicle video display device allows the front seat parent to easily check the state of the rear seat child during driving of the vehicle, for example, and the rear seat child can see the face of the front seat parent. Therefore, the front seat parent can easily and safely rear the rear seat child.

In Patent Document 2, the state of the backseat of the vehicle is photographed with a rear-facing camera, and the period during which the vehicle is traveling on a sharp curve is detected. If the vehicle is not traveling on a sharp curve, driving is performed. An in-vehicle image information processing device that displays car navigation images on the driver's monitor and displays the rear seat image on the driver's monitor when the vehicle is traveling on a sharp curve has been proposed. ing. This in-vehicle image information processing device automatically displays the state of the backseat on the driver's monitor when it is necessary to monitor the child in the backseat during a period when the vehicle is traveling on a sharp curve. Therefore, when the driver who is driving wants to grasp or should grasp the situation of the rear seat, this can be efficiently grasped.
JP 2003-25911 A JP 2005-249586 A

  In order to display the expression of the passengers in the driver's seat and the passenger seat on the passenger in the rear seat of the vehicle, it is necessary to mount an imaging device for imaging the driver's seat and the passenger seat in the front part of the vehicle. The imaging device can be mounted separately for the driver seat and the passenger seat, but due to the problem of high cost, one imaging device is mounted near the center cluster in the front of the vehicle, and one imaging device It is desirable that the driver's seat and passenger's seat be imaged together. However, when an image captured by the single imaging device in the driver's seat and front passenger seat is displayed on the rear seat image display device, the positional relationship between the driver's seat passenger and the passenger's seat viewed from the rear seat passenger There is a problem that the image is displayed opposite to the left and right.

  In addition, since the inside of the vehicle is narrow and the distance between the imaging device and the driver's seat and the passenger seat is short, in order for one imaging device to collectively capture the driver's seat and the passenger seat, the focal length is short and the wide range is captured. It is necessary to use a wide-angle lens that can be used in an imaging device. However, when a wide-angle lens is used in the imaging device, the wide-angle lens has a large depth of field and a wide angle of view, but the image on the periphery of the screen is distorted. However, there is a problem that the image is taken with an outward line of sight and gives an uncomfortable feeling to the rear seat occupant.

  The above-described problem may also occur in the in-vehicle video display device described in Patent Document 1 and the in-vehicle image information processing device described in Patent Document 2. Further, the in-vehicle video display device described in Patent Document 1 and the in-vehicle image information processing device described in Patent Document 2 are not intended for conversation between a front seat passenger and a rear seat passenger, The purpose is to confirm the state of the child in the rear seat by the parent in the front seat. For this reason, the in-vehicle image information processing apparatus disclosed in Patent Document 2 detects the running state of the vehicle and automatically displays the state of the rear seat on the monitor when the vehicle is traveling on a sharp curve, for example. Features are provided. However, for the purpose of conversation between the front passenger and the rear passenger, there is a problem that such an automatic switching function of the display hinders the conversation.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image in which passengers on the driver's seat side and the passenger seat side are collectively imaged using an imaging device having a wide-angle lens. , An image display method capable of displaying an image of a front seat occupant that does not give a sense of incongruity to a rear seat occupant by performing predetermined image processing and displaying the image on an image display device directed toward the rear seat, and a vehicle-mounted image It is to provide a display system and an image processing apparatus.

  Another object of the present invention is an image in which an image input from another device such as a car navigation device or a TV tuner and an image of a front seat occupant captured by the imaging device are directed to the rear seat. An object of the present invention is to provide an in-vehicle image display system that can use an image display device for multiple purposes by switching to a display device for display.

  Another object of the present invention is to detect the shape of the occupant's mouth from the image captured by the imaging device and / or to detect the sound produced by the occupant in the front seat and display an image based on the detection result. Even if the image from another device is displayed on the image display device by switching the image to be displayed on the device, the image captured by the imaging device during the conversation of the front seat occupant can be transferred to the rear seat occupant. An object is to provide an in-vehicle image display system capable of displaying.

  An image display method according to a first aspect of the present invention is an image display device in which an image pickup device having a wide-angle lens is used to collectively image a driver's side and a passenger's side occupant of a vehicle, and the captured image is directed to the rear seat of the vehicle. In the image display method displayed on the screen, each pixel of the image captured by the imaging device is moved to a position that is horizontally reversed, and the horizontally reversed image is a first area corresponding to the driver seat side and a second corresponding to the passenger seat side. Dividing into regions, moving each pixel in the first region to a horizontally reversed position in the first region, moving each pixel in the second region to a horizontally reversed position in the second region, An image obtained by horizontally inverting each region is displayed on the image display device.

  The image display method according to the second aspect of the present invention is a method in which an image pickup apparatus having a wide-angle lens is used to collect images of passengers on the driver's seat and passenger's side of a vehicle at once, and the captured images are directed to the rear seat of the vehicle. In an image display method for displaying on a display device, an image captured by the imaging device is divided into a first region corresponding to a driver seat side and a second region corresponding to a passenger seat side, and the first region and the second region are divided. Each pixel of the image is moved to a position where left and right are replaced, and an image in which each region is replaced left and right is displayed on the image display device.

  The image display method according to the third aspect of the present invention is an image pickup apparatus having a wide-angle lens that collectively captures a driver's side and a passenger's side occupant of the vehicle and directs the captured image to the rear seat of the vehicle. In the image display method for displaying on a display device, the correspondence between the positions of each pixel is stored in advance for an image captured by the imaging device and an image in which the driver seat side and the passenger seat side of the image are replaced to the left and right. Each pixel of an image captured by the imaging device is moved in accordance with the correspondence, and an image in which each pixel is moved in accordance with the correspondence is displayed on the image display device.

  An in-vehicle image display system according to a fourth aspect of the present invention is mounted on a vehicle, and includes an imaging device having a wide-angle lens that collectively images passengers on the driver side and the passenger side of the vehicle, and the rear seat of the vehicle. In an in-vehicle image display system comprising: an image display device that displays an image toward the image; and an image processing device that performs image processing on the image captured by the imaging device and displays the image on the image display device. The processing device includes means for moving each pixel of the image captured by the imaging device to a position that is horizontally reversed, and a horizontally reversed image in the first region corresponding to the driver seat side and the second region corresponding to the passenger seat side. Means for dividing, and means for moving each pixel in the first area to a position horizontally reversed in the first area, and for moving each pixel in the second area to a position reversed horizontally in the second area And having And wherein the door.

  In addition, an in-vehicle image display system according to a fifth aspect of the present invention is mounted on a vehicle, and includes an imaging device having a wide-angle lens that collectively images passengers on the driver's seat and passenger's side of the vehicle, and the rear seat of the vehicle. In an in-vehicle image display system comprising: an image display device that displays an image toward the image; and an image processing device that performs image processing on the image captured by the imaging device and displays the image on the image display device. The processing device replaces the image captured by the imaging device into a first region corresponding to the driver seat side and a second region corresponding to the passenger seat side, and the first region and the second region left and right. And a means for moving each pixel of the image to a position.

  An in-vehicle image display system according to a sixth aspect of the present invention is mounted on a vehicle, and includes an imaging device having a wide-angle lens that collectively images passengers on the driver's seat and passenger's side of the vehicle, and the rear seat of the vehicle. In an in-vehicle image display system comprising: an image display device that displays an image toward the image; and an image processing device that performs image processing on the image captured by the imaging device and displays the image on the image display device. The processing device includes a storage unit that stores in advance correspondence between the positions of the pixels of the image captured by the imaging device and an image in which the driver seat side and the passenger seat side of the image are replaced to the left and right, and the imaging device And a means for moving each pixel of the captured image in accordance with the correspondence stored in the storage means.

  The on-vehicle image display system according to a seventh aspect of the present invention is an image input receiving unit that receives an image input from another device and an image obtained by performing image processing on an image captured by the imaging device, or The image display device further comprises image switching means for switching display of the image received by the image input receiving means on the image display device.

  In the in-vehicle image display system according to the eighth aspect of the present invention, the image processing device further includes mouth shape detection means for detecting the shapes of the mouths of the driver seat passenger and the passenger seat passenger from the image captured by the imaging device. The image switching means switches the display image based on the mouth shape detected by the mouth shape detection unit.

  The vehicle-mounted image display system according to a ninth aspect of the present invention further includes sound detection means for detecting the sound of the front seat occupant of the vehicle, and the image switching means displays a display image based on the detection result of the sound detection means. It is characterized by switching between.

  An image processing apparatus according to a tenth aspect of the present invention is mounted on a vehicle, and an image pickup apparatus having a wide-angle lens performs image processing on an image obtained by collectively capturing a driver seat side and a passenger seat side passenger of the vehicle, In the image processing device for performing processing to display on the image display device toward the rear seat of the vehicle, means for moving each pixel of the image captured by the imaging device to a horizontally reversed position, and a horizontally reversed image of the driver seat Means for dividing the first area corresponding to the side and the second area corresponding to the passenger seat side, and moving each pixel of the first area to a position horizontally reversed in the first area, and the second area And a means for moving each pixel to a position that is horizontally reversed in the second region.

  An image processing apparatus according to an eleventh aspect of the invention is mounted on a vehicle, and an image pickup apparatus having a wide-angle lens performs image processing on an image in which the driver's side and passenger's side passengers of the vehicle are collectively imaged, In the image processing device for performing processing to be displayed on the image display device directed to the rear seat of the vehicle, the image captured by the imaging device is displayed in a first region corresponding to the driver seat side and a second region corresponding to the passenger seat side. And means for dividing the image forming apparatus, and means for moving each pixel of the image to a position where the first area and the second area are replaced to the left and right.

  An image processing apparatus according to a twelfth aspect of the present invention is mounted on a vehicle, and an image pickup apparatus having a wide-angle lens performs image processing on images obtained by collectively capturing the driver side and passenger side passengers of the vehicle, In the image processing device that performs processing to be displayed on the image display device toward the rear seat of the vehicle, the image captured by the imaging device, and the image in which the driver seat side and the passenger seat side of the image are replaced with left and right, The image processing apparatus includes: a storage unit that stores in advance a correspondence between positions of the pixels; and a unit that moves each pixel of the image captured by the imaging apparatus according to the correspondence stored in the storage unit.

  In the present invention, various image processing for the occupants of the rear seats is performed on the images of the occupants on the driver's seat and passenger's side that are collectively imaged by the imaging device having the wide-angle lens, and the images are directed to the rear seats. Displayed on the image display device. The image processing performed at this time can be image processing in which an image obtained by imaging is first reversed horizontally, and then this image is divided into two regions on the left and right, and each region is horizontally reversed. Thus, the image displayed on the image display device for the rear seat corresponds to the positional relationship between the driver's seat and the passenger seat in the driver's seat and the passenger seat as viewed from the rear seat passenger. The outward line-of-sight of the passengers in the driver seat and the passenger seat is corrected inward.

  In the present invention, first, an image obtained by imaging may be divided into two regions on the left and right, and then image processing may be performed to replace the arrangement of the two divided regions on the left and right. Even in the case of this image processing, as in the case described above, the image displayed on the image display device for the rear seat is the positional relationship between the driver seat and the passenger seat viewed from the rear seat passenger. This corresponds to the positional relationship between the driver's seat and the passenger seat, and the outward line of sight of the driver seat and passenger seat passenger is corrected inward.

  Further, in the present invention, when replacing the driver's seat side and the passenger's seat side of the image captured by the imaging device to the left and right, the correspondence of the position of each pixel between the original image and the replaced image is previously stored in a conversion table or the like. Image processing may be performed in which each pixel of the image obtained by imaging is moved based on the stored correspondence. As a result, image processing can be performed with only simple pixel movements, and the image displayed on the image display device for the rear seats has a positional relationship between the driver's seat and the passenger's seat in the same manner as described above. This corresponds to the positional relationship between the driver seat and the passenger seat in the passenger seat viewed from the rear seat passenger, and the outward line of sight of the driver seat and passenger seat passenger is corrected inward.

  Further, in the present invention, an image input from another device such as a car navigation device or a TV tuner and an image of a front seat occupant captured by the imaging device are switched to an image display device directed to the rear seat. indicate. Switching of images to be displayed may be a method based on a manual operation by the occupant, or may be a method automatically performed by determining the presence or absence of occupant conversation. Accordingly, the image display device provided for the rear seat can be used for other purposes, and an image obtained by capturing the front seat occupant can be displayed when a conversation is performed.

  In the present invention, the shape of the mouth of the passenger in the front seat is detected from the image captured by the imaging device. For example, the detection of the mouth shape is performed by first extracting a region corresponding to the occupant's face from an image obtained by imaging (so-called face recognition processing), and further extracting upper and lower lips from the face region. This is done by calculating the degree of curvature of the upper lip and the lower lip, or the distance between the vertex of the upper lip and the vertex of the lower lip. The degree of opening of the occupant's mouth (hereinafter referred to as the opening degree of the mouth) can be calculated from the detected shape of the mouth, and when the opening degree of the mouth exceeds a predetermined amount, an image display device of the occupant in the front seat By displaying on the screen, automatic switching of the display image according to the presence or absence of conversation can be realized.

  In the present invention, a microphone or the like is mounted on the vehicle to detect a voice emitted by the front seat occupant. Thereby, for example, when the detected sound volume exceeds a predetermined amount, it is determined that a passenger's conversation has occurred, and an image of the passenger in the front seat can be displayed on the image display device. Alternatively, it is possible to determine whether or not the voice detected by performing the voice recognition process is related to the conversation, and in the case of the voice of the conversation, the image of the front seat occupant can be displayed on the image display device. In any method, the presence or absence of conversation can be determined based on the detected voice, and automatic switching of display images according to the presence or absence of conversation can be realized.

  In the case of the present invention, predetermined image processing is performed on images obtained by collectively capturing the passengers on the driver's seat and passenger's side, and the positional relationship between the passengers on the driver's seat and the passenger's seat is viewed from the rear passengers. By displaying on the image display device facing the rear seat, an image corresponding to the positional relationship between the passengers in the seat and the passenger seat, and the outward line of sight of the passengers in the driver seat and the passenger seat corrected inward, The passenger in the rear seat can talk in the vehicle without feeling uncomfortable while checking the facial expression of the passenger in the front seat.

  Further, according to the present invention, an image display device provided for the rear seat is displayed by switching an image input from another device or an image captured by the imaging device manually or automatically on the image display device. Since it can be used for multiple purposes, the convenience of the in-vehicle image display system can be improved.

  Further, according to the present invention, the shape of the passenger's mouth is detected from the image captured by the imaging device, and / or the sound emitted by the passenger in the front seat is detected, and displayed on the image display device based on the detection result. By switching the image, even when an image from another device is displayed on the image display device, the display image can be automatically switched according to the presence or absence of a passenger in the front seat. The convenience of the image display system can be further improved.

(Embodiment 1)
Hereinafter, the present invention will be specifically described with reference to the drawings showing embodiments thereof. FIG. 1 is a block diagram showing a configuration of an in-vehicle image display system according to Embodiment 1 of the present invention. In the figure, reference numeral 1 denotes an imaging device that is mounted in the center (center cluster) of an instrument panel of a vehicle and images a driver's seat and a passenger seat (passenger) of the vehicle. The image picked up by the image pickup device 1 is subjected to various image processing by an ECU (Electronic Control Unit) 2 mounted at an appropriate position of the vehicle so as to be displayed on the image display device 3 for the rear seat of the vehicle. It is. The imaging device 1 and the ECU 2 and the ECU 2 and the image display device 3 are connected by a dedicated communication line, a general-purpose in-vehicle LAN (Local Area Network) cable, or wirelessly.

  The imaging device 1 is a video camera that performs imaging using a wide-angle lens 11 and an imaging element 12. The wide-angle lens 11 is a lens having a wide angle of view of, for example, 90 ° or more. The imaging range of the imaging device 1 mounted on the center cluster of the vehicle can include a driver seat and a passenger seat of the vehicle. The passengers and passengers in the passenger seat can be imaged collectively. The image pickup device 12 can pick up an image with a frequency of about 60 times per second using, for example, a CCD (Charge Coupled Device), and outputs an electric signal corresponding to the light collected by the wide-angle lens 11 to the ECU 2. It is.

  The ECU 2 includes an A / D conversion unit 21, an image processing unit 22, a D / A conversion unit 23, an image memory 24, a table memory 25, and the like. The electric signal output from the image pickup device 12 of the image pickup apparatus 1 is supplied to the A / D converter 21 of the ECU 2 and converted from an analog electric signal to an image of digital data. The A / D conversion unit 21 provides an image of the converted digital data to the image processing unit 22.

  The image processing unit 22 performs various image processing on the image given from the A / D conversion unit 21 and outputs the processed image to the D / A conversion unit 23. The image processing performed by the image processing unit 22 is, for example, processing such as distortion correction, enlargement / reduction, partial clipping, and superimposition of other images, and the image processing unit 22 of the ECU 2 in the in-vehicle image display system of the present invention. Then, image processing for displaying on the image display device 3 an image suitable for the conversation between the front passenger and the rear passenger is performed (details of this image processing will be described later).

  The image processing unit 22 stores the image provided from the A / D conversion unit 21, a temporary image generated in the course of image processing, an image after image processing, or the like in the image memory 24 for processing. is there. The image memory 24 is composed of a large-capacity memory device such as SRAM (Static Random Access Memory) or DRAM (Dynamic Random Access Memory) that can rewrite data. The table memory 25 stores in advance a conversion table (for example, a distortion correction table) used when the image processing unit 22 performs the above-described image processing, and the image processing unit 22 stores the table memory 25. The conversion table is read out from the image and image processing is performed. The table memory 25 is composed of a nonvolatile memory element such as a mask ROM (Read Only Memory) or an EEPROM (Electrically Erasable Programmable ROM).

  The D / A conversion unit 23 is given an image subjected to image processing from the image processing unit 22, converts the image of the given digital data into an analog signal suitable for display on the image display device 3, and The image is output to the image display device 3. The image display device 3 is, for example, a liquid crystal display, and performs display based on a signal given from the D / A conversion unit 23 of the ECU 2. The image display device is arranged on the back of the driver's seat or the front passenger seat of the vehicle, or on the ceiling of the vehicle, and can display an image to the passengers in the rear seat.

  FIG. 2 is a schematic diagram for explaining image processing performed by the image processing unit 22 of the in-vehicle image display system according to Embodiment 1 of the present invention, and (a) shows an image captured by the imaging device 1. Thereafter, the processing is shown in time series in alphabetical order from (a) to (d). The illustrated image example is a so-called right-hand drive vehicle in which a driver's seat is provided on the right side of the vehicle. When the imaging device 1 mounted in the center cluster of the vehicle images the interior of the vehicle using the wide-angle lens 11, the wide-angle lens 11 has a large depth of field and a wide angle of view, and distortion occurs in the peripheral portion of the image. In the image (original image 51) obtained by the above, the lines of sight of the passengers in the driver's seat and the passenger seat are outward (see FIG. 2 (a)).

  First, the image processing unit 22 performs image processing for moving the position of each pixel so that the original image 51 given from the imaging device 1 is a horizontally reversed image (mirror image 52) (FIG. 2B). reference). Next, the image processing unit 22 divides the mirror image 52 obtained by the image processing into a first area 53a on the driver's seat side and a second area 53b on the passenger seat side (see FIG. 2C). Image processing is performed to move the respective pixel positions of the first region 53a and the second region 53b so that the region 53a and the second region 53b are two mirror image images that are horizontally reversed, and the display image 54 is acquired. (See FIG. 2 (d)).

  FIG. 3 is a display example of an image displayed on the image display device 3, (A) shows the interior of the vehicle as viewed from the rear seat of the vehicle and the state of the image display device 3, and (B) shows the image display device 3. The displayed image is shown. The illustrated vehicle 60 is a right-hand drive vehicle with a driver's seat 61 provided on the right side, and the imaging device 1 is disposed in a center cluster provided substantially at the center of the instrument panel. The image display device 3 is arranged in a mode that is suspended from the ceiling of the vehicle 60 at a position between the driver's seat 61 and the passenger seat 62 of the vehicle 60 so that an occupant in the rear seat of the vehicle can see. is there. When viewed from the rear seat passenger, the right side is the driver 71 of the driver seat 61, and the left side is the passenger 72 of the passenger seat 62.

  The original image 51 captured by the imaging device 1 arranged in the center cluster in the vehicle 60 provided with the driver's seat 61 on the right side is a photograph of the driver 71 of the driver's seat 61 on the left side as shown in FIG. The image shows the passenger 72 of the passenger seat 62 on the right side. When the original image 51 is directly displayed on the image display device 3, the positional relationship between the displayed driver 71 and the passenger 72 of the passenger seat 62 and the actual state of the driver 71 and the passenger 72 viewed from the passenger in the rear seat are displayed. The positional relationship is reversed left and right.

  On the other hand, when the display image 54 obtained by performing the image processing shown in FIG. 2 in the image processing unit 22 is displayed on the image display device 3, the positional relationship between the displayed images and the actual view from the occupant of the rear seat The right side is the driver 71 of the driver seat 61 and the left side is the passenger 72 of the passenger seat 62 (see FIG. 3). Further, when the mirror image 52 and the display image 54 are compared, in the mirror image 52, the lines of sight of the driver 71 in the driver seat 61 and the passenger 72 in the passenger seat 62 are outward in opposite directions, which is unnatural for conversation. Although it is an image, the display image 54 is inward and is an image suitable for conversation.

  FIG. 4 is a flowchart showing a procedure of processing performed by the ECU 2 of the in-vehicle image display system according to Embodiment 1 of the present invention. The ECU 2 first acquires an image (original image 51) captured by the imaging device 1 by converting an electrical signal given from the imaging device 1 into an image of digital data by the A / D converter 21 ( Step S1, see FIG. 2 (a)). Next, the ECU 2 performs image processing for horizontally inverting the original image 51 in the image processing unit 22 (step S2), and acquires a mirror image 52 (see FIG. 2B). Note that the horizontal reversal of the original image 51 by the image processing unit 22 can be performed by moving each pixel constituting the original image 51 to a predetermined position.

  Next, the ECU 2 divides the mirror image 52 into a first region 53a on the driver's seat 61 side and a second region 53b on the passenger seat 62 side (see step S3, FIG. 2 (c)), and the first region 53a. And the image processing which reverses right and left each of the 2nd field 53b is performed (Step S4), and display picture 54 is acquired (refer to Drawing 2 (d)). Note that the horizontal reversal of the first region 53a and the second region 53b by the image processing unit 22 can be performed by moving the pixels constituting the first region 53a and the second region 53b to predetermined positions, respectively. it can. Thereafter, the ECU 2 displays the image by converting the display image 54 of the digital data into an analog signal by the D / A conversion unit 23 and outputting the analog signal to the image display device 3 (step S5). finish.

  Note that the illustrated process is repeatedly performed at a frequency of about 60 times per second each time the imaging apparatus 1 captures an image. Further, the image division shown in step S3 does not need to actually divide the image data into two, and it is sufficient if the left-right reversal of step S4 can be performed separately on the driver seat side and the passenger seat side. is there.

  The in-vehicle image display system according to the first embodiment having the above configuration horizontally inverts an image captured by the imaging device 1, divides the image into two regions on the left and right, and horizontally inverts each region, so that the image display device 3 With the configuration displayed in FIG. 5, the positional relationship between the driver 71 of the driver seat 61 and the passenger 72 of the passenger seat 62 viewed from the rear passenger, and the driver 71 and the passenger 72 displayed on the image display device 3 are displayed. The positional relationship can be matched, and the driver's 71 and the occupant 72's line of sight are corrected inward, so that the occupant in the rear seat has a conversation while looking at the image displayed on the image display device 3. be able to.

  In the present embodiment, the imaging device 1, the ECU 2, and the image display device 3 of the in-vehicle image display system are separately mounted on the vehicle. However, the present invention is not limited to this, and the imaging device 1 And the ECU 2 may be integrated, or the ECU 2 and the image display device 3 may be integrated. In addition, the image captured by the image capturing apparatus 1 is output as an analog electrical signal. However, the present invention is not limited to this, and the image capturing apparatus 1 may output an image of digital data to the ECU 2. Further, the ECU 2 is configured to convert the image-processed image into an analog signal and output the analog signal to the image display device 3. However, the present invention is not limited to this, and the image-processed image is output as digital data. It is good.

  In addition, the display example of the image shown in FIG. 3 is a case where the driver 71 and the passenger 72 are on the driver seat 61 and the passenger seat 62 of the vehicle 60, respectively. For example, the driver 71 gets on the driver seat 61. However, when the passenger 72 is not in the passenger seat 62, a different display may be used as in the following example. FIG. 5 is another display example of the image displayed on the image display device 3, (A) shows the interior of the vehicle and the image display device 3 as seen from the rear seat of the vehicle, and (B) shows the image display device. 3 shows a display image 154 displayed.

  When the driver 71 gets on the driver's seat 61 of the vehicle 60 and the passenger 72 does not get on the passenger seat 62, the ECU 2 cuts and enlarges the half image on the driver's seat 61 side from the image captured by the imaging device 1. The image processing is performed and displayed on the image display device 3. At this time, the ECU 2 may display the clipped image of the driver's seat 61 in a horizontally reversed manner, or may display the image without horizontally flipping (FIG. 5 shows a horizontally reversed image). Further, the ECU 2 may display the clipped driver seat 61 side image without enlarging it.

(Embodiment 2)
The in-vehicle image display system according to Embodiment 1 performs image processing in which the original image 51 captured by the imaging device 1 is horizontally reversed, divided into a first region 53a and a second region 53b, and each region is horizontally reversed. Although the image processing unit 22 of the ECU 2 performs the configuration, the image processing performed by the image processing unit 22 is not limited to this. The in-vehicle image display system according to Embodiment 2 has a configuration in which the image processing unit 22 performs image processing different from this. FIG. 6 is a schematic diagram for explaining the image processing performed by the image processing unit 22 of the in-vehicle image display system according to the second embodiment of the present invention. FIG. 6A shows an image captured by the imaging device 1. Thereafter, the processing is shown in time series in alphabetical order from (a) to (c).

  First, the image processing unit 22 divides the original image 51 (see FIG. 6A) given from the imaging device 1 into a first area 252a on the driver's seat side and a second area 252b on the passenger seat side. (See FIG. 6 (b)). Next, the image processing unit 22 acquires the display image 54 by performing image processing for moving the pixel position of each region so as to replace the positions of the first region 252a and the second region 252b to the left and right.

  The display image 54 obtained by the image processing shown in FIG. 6 and the display image 54 obtained by the image processing shown in FIG. 2 are the same image, and the vehicle-mounted image display system according to the second embodiment displays this display image. By displaying 54 on the image display device 3, the same effect as the vehicle-mounted image display system according to the first embodiment can be obtained.

  FIG. 7 is a flowchart showing a procedure of processing performed by the ECU 2 of the in-vehicle image display system according to Embodiment 2 of the present invention. The ECU 2 first acquires an image (original image 51) captured by the imaging device 1 by converting an electrical signal given from the imaging device 1 into an image of digital data by the A / D converter 21 ( Step S11, see FIG. 6A). Next, the ECU 2 divides the original image 51 into a first area 252a on the driver's seat side and a second area 252b on the passenger seat side (see step S12, FIG. 6B), and the first area 252a and the second area 252a. Image processing for replacing the position of the region 252b to the left and right is performed (step S13), and the display image 54 is acquired (see FIG. 6C). Thereafter, the ECU 2 displays the image by converting the display image 54 of the digital data into an analog signal by the D / A conversion unit 23 and outputting the analog signal to the image display device 3 (step S14), and ends the processing. To do.

  Note that the illustrated process is repeatedly performed at a frequency of about 60 times per second each time the imaging apparatus 1 captures an image. Further, the image division shown in step S12 does not need to actually divide the image data into two, and it is sufficient if the left and right replacement in step S13 can be performed separately on the driver seat side and the passenger seat side. is there.

  The in-vehicle image display system according to the second embodiment having the above configuration divides an image captured by the imaging device 1 into two regions on the left and right, and displays the image on the image display device 3 by replacing the position of each region to the left and right. By adopting such a configuration, the positional relationship between the driver in the driver seat and the passenger in the passenger seat viewed from the passenger in the rear seat and the positional relationship between the driver and the passenger displayed on the image display device 3 can be matched. In addition, since the driver's and passenger's line of sight are corrected inwardly, the passenger in the rear seat can talk with the user while looking at the image displayed on the image display device 3.

  In addition, since the other structure of the vehicle-mounted image display system which concerns on Embodiment 2 is the same as that of the vehicle-mounted image display system which concerns on Embodiment 1, it attaches | subjects the same code | symbol to a corresponding location, and demonstrates it. Is omitted.

(Embodiment 3)
The in-vehicle image display system according to Embodiment 3 has a configuration in which the image processing unit 22 performs image processing that is further different from the above-described image processing. FIG. 8 is a schematic diagram for explaining image processing performed by the image processing unit 22 of the in-vehicle image display system according to Embodiment 3 of the present invention. FIG. 8A shows an image captured by the imaging device 1. (B) shows an image displayed on the image display device 3.

  When comparing the original image 51 and the display image 54 shown in FIG. 2 in Embodiment 1 or the original image 51 and the display image 54 shown in FIG. 6 in Embodiment 2, the display image 54 is the original image 51. It can be seen that this is an image in which the driver's seat side and the passenger's seat side are replaced on the left and right. Therefore, in the in-vehicle image display system according to the third embodiment, the conversion table 25a in which the position of each pixel in the display image 54 corresponding to the position of each pixel in the original image 51 is stored in advance is used as the table memory 35. Is stored in advance.

  The conversion table 25a outputs the movement destination position with respect to the input pixel position, and stores the movement destination positions for all the pixels of the original image 51. The image processing unit 22 of the ECU 2 reads the conversion table 25a from the table memory 25, acquires the display image 54 by moving the position of each pixel of the original image 51 given from the imaging device 1, and displays the image. The information is displayed on the device 3.

  FIG. 9 is a schematic diagram for explaining the movement of the pixels by the conversion table 25a. (A) shows the eight pixels A to H of the original image 51, and (b) shows each pixel A in the display image 54. The movement destination of ~ H is shown. FIG. 10 is a schematic diagram showing a configuration example of the conversion table 25a, and shows the configuration of the conversion table 25a for realizing the movement of the pixels shown in FIG. In FIG. 9 and FIG. 10, each pixel of the image has a position indicated by coordinates (x, y). Also, “m” and “n” in the figure are even constants determined by the size of the image, and “i” is a constant that satisfies i = m−i (ie, (i, y) and (i + 1, y) is a constant that becomes the center pixel in the x direction).

  For example, the upper left pixel A (0, 0) of the original image 51 is moved to the center right pixel A (i + 1, 0) in the x direction of the display image 54, and the center left pixel B (i, 0) of the original image 51 is moved. 0) is moved to the upper right pixel B (m, 0) of the display image 54. Further, the pixel C (i + 1, 0) on the right side of the center of the original image 51 is moved to the pixel C (0, 0) on the upper left of the display image 54, and the pixel D (m, 0) on the upper right of the original image 51 is The pixel is moved to the pixel D (i, 0) on the left side of the center of the display image 54. The position of each pixel in the original image 51 and the position in the display image 54 are stored in the conversion table 25a in a predetermined one-to-one relationship as input coordinates and output coordinates.

  FIG. 11 is a flowchart showing a procedure of processing performed by the ECU 2 of the in-vehicle image display system according to Embodiment 3 of the present invention. The ECU 2 first acquires an image (original image 51) captured by the imaging device 1 by converting an electrical signal given from the imaging device 1 into an image of digital data by the A / D converter 21 ( Step S21, see FIG. 8A). Next, the ECU 2 reads the conversion table 25a stored in advance from the table memory 25 (step S22), moves the position of each pixel of the original image 51 according to the conversion table 25a (step S23), and acquires the display image 54. (See FIG. 8 (b)). Thereafter, the ECU 2 displays the image by converting the display image 54 of the digital data into an analog signal by the D / A conversion unit 23 and outputting the analog signal to the image display device 3 (step S24), and ends the processing. To do.

  In the on-vehicle image display system according to Embodiment 3 having the above-described configuration, the position where each pixel of the image captured by the imaging device 1 is moved is stored in advance in the conversion table 25a, and each pixel is stored using the conversion table 25a. The display image 54 obtained by moving the image is displayed on the image display device 3, so that the display image 54 can be acquired by simple image processing as compared with the case of the first and second embodiments. It is possible to display on the image display device 3 an image that allows a passenger in the rear seat to talk without feeling uncomfortable while looking at the image.

  In addition, since the other structure of the vehicle-mounted image display system which concerns on Embodiment 3 is the same as that of the structure of the vehicle-mounted image display system which concerns on Embodiment 1, it attaches | subjects the same code | symbol to a corresponding location, and demonstrates it. Is omitted.

(Embodiment 4)
Although the in-vehicle image display system according to the first to third embodiments only displays the image captured by the imaging device 1 on the image display device 3, the in-vehicle image display system according to the fourth embodiment is the imaging device. Reference numeral 1 denotes a configuration in which an image captured by an image and an image given from another device are switched to the image display device 3 and displayed. FIG. 12 is a block diagram showing a configuration of an in-vehicle image display system according to Embodiment 4 of the present invention. In the in-vehicle image display system according to the fourth embodiment, the image pickup apparatus 1 provides the ECU 202 with images of the driver's seat and the passenger's seat collectively, and the car navigation device 204 provides a map image for guidance to the ECU 202. It is like that. The ECU 202 selects either an image given from the imaging device 1 or an image given from the car navigation device 204 and displays it on the image display device 3.

  The ECU 202 includes an operation unit 227 that receives an operation by a user, and a control unit 226 that performs control related to selection of which image to be displayed from the imaging device 1 and the car navigation device 204 is displayed. The operation unit 227 has one or a plurality of buttons or switches, and notifies the control unit 226 of the operation content received from the user. For example, the user operates the operation unit 227 to (1) fix the setting of an image displayed on the image display device 3 to an image captured by the imaging device 1 and (2) fix the image to the image of the car navigation device 204 ( 3) It can be selected from three settings of automatic switching by the ECU 202.

  Based on the operation content notified from the operation unit 227, the control unit 226 determines which of the above-described (1) to (3) is the image display setting by the user, and the image processing unit according to this setting. The operation of 222 is controlled. The image processing unit 222 is provided with an image captured by the imaging device 1 from the A / D conversion unit 21 and a map image for guidance from the car navigation device 204. The image processing unit 222 selects one of these images in accordance with the control of the control unit 226, performs various image processing, and gives the selected image to the image display device 3 by giving it to the D / A conversion unit 23. It is supposed to be displayed.

  When the user selects (1) a fixed setting for an image captured by the imaging device 1, the control unit 226 displays the image captured by the imaging device 1 on the image display device 3. The selection is controlled. When the user selects (2) a fixed setting for the image of the car navigation device 204, the control unit 226 displays the image from the car navigation device 204 on the image display device 3. The selection is controlled.

  When the user selects (3) automatic switching setting by the ECU 202, the control unit 226 allows the passengers in the front seats (driver's seat and front passenger seat) of the vehicle to talk based on the image captured by the imaging device 1. It is determined whether or not it has been done. When it is determined that the front seat occupant has a conversation, the control unit 226 controls the selection of the image processing unit 222 so that the image captured by the imaging device 1 is displayed on the image display device 3, and the front seat occupant has a conversation. If it is determined that the image processing unit 222 has not been selected, the selection of the image processing unit 222 is controlled so that the image from the car navigation device 204 is displayed on the image display device 3.

  At this time, the control unit 226 detects the front passenger's face from the image captured by the imaging device 1 and determines the presence / absence of the passenger's conversation by detecting the shape of the mouth of the passenger's face. . The detection of the occupant's face from the image captured by the image capturing apparatus 1 is performed by the existing face recognition technology and the like, and thus detailed description thereof is omitted. For example, the two eyes are based on the contrast of the image. This can be done by searching for a portion corresponding to and determining whether or not the region including the two eyes has a facial structure. Further, the shape of the mouth can be detected by extracting the contours of the upper lip and the lower lip by performing filter processing and threshold processing on the face image, and the control unit 226 detects the shape of the detected mouth. The opening degree of the mouth is calculated based on the degree of curvature of the upper lip and the lower lip, the distance between the upper lip vertex and the lower lip vertex, or the like. The control unit 226 determines whether or not the calculated opening of the mouth exceeds a predetermined amount, and can determine that the occupant has a conversation when the opening of the mouth exceeds the predetermined amount.

  FIG. 13 is a flowchart showing a procedure of image switching processing performed by ECU 202 of the vehicle-mounted image display system according to Embodiment 4 of the present invention, and shows processing performed by control unit 226 of ECU 202. First, the control unit 226 acquires an image captured by the imaging apparatus 1 from the image processing unit 222 (step S31), searches for a portion corresponding to the two eyes based on the contrast of the image, and the two eyes. The occupant's face is detected by determining whether or not the area to be included has a face structure (step S32). Next, the control unit 226 detects the shape of the mouth by extracting the contours of the upper lip and the lower lip from the face part of the occupant in the detected image (step S33), and detects the upper lip and the lower lip from the detected mouth shape. The opening degree of the mouth is calculated based on the degree of curvature or the distance between the apex of the upper lip and the apex of the lower lip (step S34).

  Next, the control unit 226 determines whether or not the calculated opening of the mouth exceeds a predetermined amount determined in advance (step S35). When the opening degree of the mouth exceeds a predetermined amount (S35: YES), the control unit 226 controls the selection of the image processing unit 222 so that the image captured by the imaging device 1 is displayed on the image display device 3 (step S36). Then, the image switching process ends. When the opening degree of the mouth does not exceed the predetermined amount (S35: NO), the control unit 226 controls the selection of the image processing unit 222 so as to display the image from the car navigation device 204 (step S37). The switching process is terminated.

  In the in-vehicle image display system according to the fourth embodiment having the above-described configuration, the display setting by the user is received by the operation unit 227, and the ECU 2 receives the image from the imaging device 1 or the car navigation device 204 according to the received setting. By selecting one of the images and displaying it on the image display device 3, the rear seat image display device can be used for multiple purposes. Further, the ECU 2 detects the shape of the mouth of the occupant in the front seat based on the image captured by the imaging device 1 and switches the image to be displayed according to the opening of the mouth, so that the conversation by the occupant in the front seat The display image can be automatically switched according to the presence or absence of the camera, and the convenience of the in-vehicle image display system can be further improved.

  In the fourth embodiment, the control unit 226 acquires an image from the image processing unit 222 and performs processing such as face detection, mouth shape detection, mouth opening calculation, and opening degree determination. However, the present invention is not limited to this, and a part of these processes may be performed by the image processing unit 222. Further, although the operation unit 227 is provided in the ECU 2, the present invention is not limited to this, and may be provided in the image display device 3. In this case, the operation content of the user is notified from the image display device 3 to the ECU 2. What is necessary is just composition. The operation unit 227 may be configured as a separate unit such as a remote controller.

  In the flowchart shown in FIG. 13, when the opening degree of the mouth does not exceed a predetermined amount, an image of the car navigation device 204 is displayed on the image display device 3, so immediately after the passenger in the front seat ends the conversation. Since there is a possibility that the image is switched, when switching is performed so that the image from the imaging device 1 is displayed, the image of the car navigation device 204 is not switched until the predetermined time elapses. It is good also as a structure which displays the image of the apparatus 1 continuously.

  Further, the image display device 3 is configured to display either the image of the imaging device 1 or the image of the car navigation device 204. However, the present invention is not limited to this. For example, no passenger is in the passenger seat of the vehicle. In some cases, the display area of the image display device 3 may be divided into two to display both images. FIG. 14 is another display example of an image displayed on the image display device 3, (A) shows the interior of the vehicle as viewed from the rear seat of the vehicle and the state of the image display device 3, and (B) the image display device. 3 shows a display image 254 displayed. In the display example shown in this figure, the display area of the image display device 3 is divided into right and left, a map image from the car navigation device 204 is displayed on the left side, and an image captured by the imaging device 1 is displayed on the right side. Thus, when the conversation by the front seat driver 71 is detected in the ECU 2, both images are displayed, and when the conversation is not detected, only the image from the car navigation device 204 may be displayed. .

  In addition, since the other structure of the vehicle-mounted image display system which concerns on Embodiment 4 is the same as that of the structure of the vehicle-mounted image display system which concerns on Embodiment 1, it attaches | subjects the same code | symbol to a corresponding location, and demonstrates it. Is omitted.

(Embodiment 5)
The in-vehicle image display system according to the fourth embodiment is configured to determine whether or not there is a conversation by a passenger in the front seat based on the image captured by the imaging device 1, but the in-vehicle image display system according to the fifth embodiment It is the structure which determines the presence or absence of a conversation by audio | voice detection. FIG. 15 is a block diagram showing a configuration of an in-vehicle image display system according to Embodiment 5 of the present invention. The in-vehicle image display system according to Embodiment 4 includes a microphone 305, and the sound collected by the microphone 305 is given to the control unit 326 of the ECU 302 as an electric signal or digital data. The microphone 305 is disposed at a position where it is possible to detect the sound emitted by the front passenger, such as an instrument panel of a vehicle. The control unit 326 controls the image processing unit 322 in accordance with the user operation received by the operation unit 227 and the sound detected by the microphone 305 to switch the image displayed on the image display device 3. .

  When the user selects automatic switching as the setting related to the image displayed on the image display device 3, the control unit 326 determines whether or not the sound collected by the microphone 305 is due to the conversation of the occupant. The display image is switched based on this. Whether or not the collected sound is due to conversation is obtained by acquiring feature data such as a waveform or a result of acoustic analysis from the collected sound, and storing pre-stored sound and non-speech (environmental sound) This can be done by comparing with a feature amount template. However, the determination method is not limited to the above method, and may be a method used in general speech recognition technology. In addition, if the microphone 305 has high directivity and can accurately detect the voice emitted by the passenger in the front seat, the voice detected by the microphone 305 can be acquired without acquiring the sound feature data as described above. It is good also as a structure which determines the presence or absence of a conversation only by simple determination of whether the sound volume of exceeds the predetermined amount.

  The control unit 326 controls the selection of the image processing unit 322 so that the image captured by the imaging device 1 is displayed on the image display device 3 when it is determined from the sound detected by the microphone 305 that the front seat occupant has a conversation. When it is determined that the front passenger is not talking, the selection of the image processing unit 322 is controlled so that the image from the car navigation device 204 is displayed on the image display device 3. Based on the control by the control unit 326, the image processing unit 322 selects either the image given from the imaging device 1 and converted by the A / D conversion unit 21 or the image given from the car navigation device 204. The selected image is displayed on the image display device 3 by giving it to the D / A converter 23.

  FIG. 16 is a flowchart showing a procedure of image switching processing performed by the ECU 302 of the vehicle-mounted image display system according to Embodiment 5 of the present invention, and shows processing performed by the control unit 326 of the ECU 302. First, the control unit 326 collects sound with the microphone 305 to detect the front seat voice of the vehicle (step S41), and determines the presence or absence of passenger conversation from the detected voice (step S42). If there is a passenger conversation as a result of the determination (S43: YES), the control unit 326 controls the selection of the image processing unit 322 so that the image captured by the imaging device 1 is displayed on the image display device 3 (step S44). Then, the image switching process ends. If there is no occupant conversation (S43: NO), the control unit 326 controls the selection of the image processing unit 322 to display an image from the car navigation device 204 (step S45), and the image switching process is terminated. .

  The vehicle-mounted image display system according to the fifth embodiment having the above configuration determines the presence or absence of a conversation by the front seat occupant based on the sound detected by the microphone 305 and displays it on the image display device 3 according to the determination result. By adopting a configuration for switching images, it is possible to automatically switch display images according to the presence or absence of a conversation by a passenger in the front seat, and the convenience of the in-vehicle image display system can be further improved.

  Note that although there is only one microphone 305 shown in FIG. 15 in the present embodiment, the present invention is not limited to this. The microphone 305 may be provided on the driver seat side and the passenger seat side. Alternatively, three or more microphones 305 may be mounted. The ECU 302 may use not only switching based on the sound detection of the microphone 305 but also switching based on the detection result of the passenger's mouth shape from the image captured by the imaging device 1 (see Embodiment 4).

  In addition, since the other structure of the vehicle-mounted image display system which concerns on Embodiment 5 is the same as that of the structure of the vehicle-mounted image display system which concerns on Embodiment 4, it attaches | subjects the same code | symbol to a corresponding location, and demonstrates it. Is omitted.

It is a block diagram which shows the structure of the vehicle-mounted image display system which concerns on Embodiment 1 of this invention. It is a schematic diagram for demonstrating the image process which the image process part of the vehicle-mounted image display system which concerns on Embodiment 1 of this invention performs. It is an example of a display of the image displayed on an image display device. It is a flowchart which shows the procedure of the process which ECU of the vehicle-mounted image display system which concerns on Embodiment 1 of this invention performs. It is another example of a display of the image displayed on an image display apparatus. It is a schematic diagram for demonstrating the image process which the image process part of the vehicle-mounted image display system which concerns on Embodiment 2 of this invention performs. It is a flowchart which shows the procedure of the process which ECU of the vehicle-mounted image display system which concerns on Embodiment 2 of this invention performs. It is a schematic diagram for demonstrating the image process which the image process part of the vehicle-mounted image display system which concerns on Embodiment 3 of this invention performs. It is a schematic diagram for demonstrating the movement of the pixel by a conversion table. It is a schematic diagram which shows one structural example of a conversion table. It is a flowchart which shows the procedure of the process which ECU of the vehicle-mounted image display system which concerns on Embodiment 3 of this invention performs. It is a block diagram which shows the structure of the vehicle-mounted image display system which concerns on Embodiment 4 of this invention. It is a flowchart which shows the procedure of the image switching process which ECU of the vehicle-mounted image display system which concerns on Embodiment 4 of this invention performs. It is another example of a display of the image displayed on an image display apparatus. It is a block diagram which shows the structure of the vehicle-mounted image display system which concerns on Embodiment 5 of this invention. It is a flowchart which shows the procedure of the image switching process which ECU of the vehicle-mounted image display system which concerns on Embodiment 5 of this invention performs.

Explanation of symbols

1 imaging device 2 ECU (image processing device)
3 Image display device 11 Wide-angle lens 12 Image sensor 21 A / D converter 22 Image processing unit (moving means, dividing means)
23 D / A converter 24 Image memory 25 Table memory (storage means)
25a conversion table 51 original image 52 mirror image 53a first area 53b second area 54 display image 60 vehicle 61 driver's seat 62 passenger's seat 154 display image 202 ECU (image processing device)
204 Car navigation device (other devices)
222 Image processing unit (moving means, dividing means, image input means, image switching means)
226 Control unit (mouth shape detection means)
227 Operation unit 302 ECU (image processing apparatus)
305 Microphone (voice detection means)
322 Image processing unit (moving means, dividing means, image input means, image switching means)
326 Control unit 327 Operation unit

Claims (12)

In an image display method for capturing images of passengers on the driver's side and passenger's side of a vehicle at a time with an imaging device having a wide-angle lens, and displaying the captured image on an image display device facing the rear seat of the vehicle,
Move each pixel of the image captured by the imaging device to a position that is horizontally reversed,
The horizontally reversed image is divided into a first area corresponding to the driver seat side and a second area corresponding to the passenger seat side,
Moving each pixel in the first area to a position horizontally reversed in the first area, and moving each pixel in the second area to a position horizontally reversed in the second area;
An image display method, comprising: displaying an image obtained by horizontally inverting each region on the image display device. In an image display method for capturing images of passengers on the driver's side and passenger's side of a vehicle at a time with an imaging device having a wide-angle lens, and displaying the captured image on an image display device facing the rear seat of the vehicle,
The image captured by the imaging device is divided into a first region corresponding to the driver's seat side and a second region corresponding to the passenger seat side,
Move each pixel of the image to a position where the first region and the second region are replaced left and right;
An image display method, comprising: displaying an image in which each region is replaced left and right on the image display device. In an image display method for capturing images of passengers on the driver's side and passenger's side of a vehicle at a time with an imaging device having a wide-angle lens, and displaying the captured image on an image display device facing the rear seat of the vehicle,
For the image captured by the imaging device and the image in which the driver seat side and the passenger seat side of the image are replaced on the left and right, the correspondence between the positions of the pixels is stored in advance.
Move each pixel of the image captured by the imaging device according to the correspondence,
An image display method, wherein an image in which each pixel is moved in accordance with the correspondence is displayed on the image display device. An imaging device mounted on a vehicle and having a wide-angle lens that collectively images passengers on the driver side and passenger side of the vehicle, an image display device that displays an image toward the rear seat of the vehicle, and the imaging In an in-vehicle image display system comprising: an image processing apparatus that performs image processing on an image captured by the apparatus and displays the image on the image display apparatus;
The image processing apparatus includes:
Means for moving each pixel of the image captured by the imaging device to a position that is horizontally reversed;
Means for dividing the horizontally reversed image into a first region corresponding to the driver's seat side and a second region corresponding to the passenger seat side;
And means for moving each pixel in the first region to a horizontally reversed position in the first region and moving each pixel in the second region to a horizontally reversed position in the second region. An on-vehicle image display system that is characterized. An imaging device mounted on a vehicle and having a wide-angle lens that collectively images passengers on the driver side and passenger side of the vehicle, an image display device that displays an image toward the rear seat of the vehicle, and the imaging In an in-vehicle image display system comprising: an image processing apparatus that performs image processing on an image captured by the apparatus and displays the image on the image display apparatus;
The image processing apparatus includes:
Means for dividing an image captured by the imaging device into a first region corresponding to a driver seat side and a second region corresponding to a passenger seat side;
An in-vehicle image display system comprising: means for moving each pixel of the image to a position where the first region and the second region are replaced left and right. An imaging device mounted on a vehicle and having a wide-angle lens that collectively images passengers on the driver side and passenger side of the vehicle, an image display device that displays an image toward the rear seat of the vehicle, and the imaging In an in-vehicle image display system comprising: an image processing apparatus that performs image processing on an image captured by the apparatus and displays the image on the image display apparatus;
The image processing apparatus includes:
Storage means for storing in advance the correspondence of the position of each pixel for the image captured by the imaging device and the image in which the driver seat side and the passenger seat side of the image are replaced on the left and right;
An in-vehicle image display system comprising: means for moving each pixel of an image picked up by the image pickup device according to the correspondence stored in the storage means. The image processing apparatus includes:
Image input receiving means for receiving image input from another device;
5. An image switching unit that switches an image obtained by performing image processing on an image captured by the imaging device or an image received by the image input receiving unit on the image display device. Item 7. The vehicle-mounted image display system according to any one of Items 6. The image processing apparatus includes:
Further comprising mouth shape detection means for detecting the mouth shape of the driver seat passenger and the passenger seat passenger from the image captured by the imaging device;
The in-vehicle image display system according to claim 7, wherein the image switching unit is configured to switch a display image based on a mouth shape detected by the mouth shape detection unit. Voice detection means for detecting the voice of the front seat occupant of the vehicle,
The in-vehicle image display system according to claim 7 or 8, wherein the image switching unit is configured to switch a display image based on a detection result of the sound detection unit. An image display device mounted on a vehicle and having a wide-angle lens performs image processing on images obtained by collectively capturing images of passengers on the driver side and passenger side of the vehicle, and provides an image display device directed toward the rear seat of the vehicle In an image processing apparatus that performs processing for display,
Means for moving each pixel of the image captured by the imaging device to a position that is horizontally reversed;
Means for dividing the horizontally reversed image into a first region corresponding to the driver's seat side and a second region corresponding to the passenger seat side;
And means for moving each pixel in the first region to a horizontally reversed position in the first region and moving each pixel in the second region to a horizontally reversed position in the second region. A featured image processing apparatus. An image display device mounted on a vehicle and having a wide-angle lens performs image processing on images obtained by collectively capturing images of passengers on the driver side and passenger side of the vehicle, and provides an image display device directed toward the rear seat of the vehicle In an image processing apparatus that performs processing for display,
Means for dividing an image captured by the imaging device into a first region corresponding to a driver seat side and a second region corresponding to a passenger seat side;
An image processing apparatus comprising: means for moving each pixel of the image to a position where the first region and the second region are replaced left and right. An image display device mounted on a vehicle and having a wide-angle lens performs image processing on images obtained by collectively capturing images of passengers on the driver side and passenger side of the vehicle, and provides an image display device directed toward the rear seat of the vehicle In an image processing apparatus that performs processing for display,
Storage means for storing in advance the correspondence of the position of each pixel for the image captured by the imaging device and the image in which the driver seat side and the passenger seat side of the image are replaced on the left and right;
An image processing apparatus comprising: means for moving each pixel of an image captured by the imaging apparatus according to the correspondence stored by the storage means.

Images