JP4977482B2 - Image providing apparatus, vehicle, and image providing method - Google Patents

Description

  The present invention relates to an image providing device, a vehicle, and an image providing method.

  2. Description of the Related Art Conventionally, there has been known an image providing apparatus that assists in confirming safety around a vehicle by capturing the outside of the vehicle with an in-vehicle camera and displaying the image. In these devices, a wide range of images are displayed on the in-vehicle monitor by combining images acquired by a plurality of cameras or using a wide-angle camera (see Patent Document 1 and Non-Patent Document 1).

  In addition, an image providing apparatus that processes imaging data from a camera having a moving mechanism capable of changing the imaging direction has been proposed. Since this apparatus has a switch for moving the imaging direction of the camera, an image in the direction desired by the driver can be displayed on the monitor (see Patent Document 2).

  There has also been proposed an image providing apparatus that captures the rear of the vehicle with a plurality of cameras and displays the combined image data obtained by the plurality of cameras on a display device provided near the seat back of the rear seat. In this device, a state outside the vehicle recognized when the driver visually recognizes the rear of the vehicle from the inside of the vehicle is displayed on the display device. Further, in this device, the display area is adjusted according to the viewpoint position of the driver. For this reason, even a large driver or a small driver can provide an appropriate vehicle rear image (see Patent Document 3).

In addition, an image providing apparatus that switches an image to be displayed on a monitor by moving the driver's head has been proposed. This device is configured to switch between an image from a camera installed on the left side of the vehicle and a car navigation image (see Patent Document 4).
JP 2002-83285 A JP 2003-284056 A JP 2006-135797 A JP 2005-51403 A Written by Kei Okubo, “Alps Electric 190 Degree Camera”, [online], October 4, 2006, Nikkei Electronics, [searched on December 1, 2006], Internet <URL: http: //techon.nikkeibp. co.jp/article/NEWS/20061004/121928/ ＞

  However, when an image is displayed on a monitor as in the prior art, if an obstacle or the like around the vehicle is displayed small on the monitor, it becomes difficult to visually recognize the obstacle or the like. In particular, this problem becomes more prominent when a wide range of images are displayed on a monitor as in the devices described in Patent Document 1 and Non-Patent Document 1. And this problem is not solved even if the technique of patent documents 2-patent documents 4 is applied to the above-mentioned device. Such a problem is not limited to an image display device mounted on a vehicle, but is common to image display devices used for other purposes.

  In view of the above problems, an object of the present invention is to provide an image providing device, a vehicle, and an image providing method capable of improving visibility.

  An image providing apparatus according to the present invention includes a processing unit that processes captured image data obtained by imaging, a display unit that displays an image for a user in accordance with processing by the processing unit, and a user for an installation position of the display unit. Head position detection means for detecting the front and back position of the head, and the processing means is a captured image based on the imaging data in accordance with the front and back position of the user head detected by the head position detection means. An enlargement process for enlarging and displaying a part is executed.

  According to the image providing apparatus of the present invention, the image is enlarged according to the front-rear position of the user's head. For this reason, for example, the image is enlarged by an intuitive and natural movement in which the user brings his / her face close to the installation position of the display means, and an image easy to see for the user is displayed. Therefore, visibility can be improved.

  In the image providing apparatus of the present invention, the head position detecting means detects the left and right positions of the user's head relative to the installation position of the display means, and the processing means is the user head detected by the head position detecting means. It is preferable to execute a position changing process for changing the position of the area to be enlarged and displayed in the captured image according to the left and right positions of the unit.

  According to this image providing apparatus, the image enlargement portion moves according to the left and right positions of the user's head, and the user's intuitive and natural head lateral movement causes the portion desired by the user to be enlarged and displayed. be able to. Therefore, the visibility can be further improved.

  The image providing apparatus according to the present invention further includes an operation detection unit that detects an operation performed on an operation device operated by a user, and the processing unit performs an enlargement process according to the operation detected by the operation detection unit. It is preferable to execute at least one of the position changing process.

  According to this image providing apparatus, when at least one of the image enlargement and the movement of the enlarged portion is performed according to the user's operation on the operation device, it is estimated that the user's operation desires the image enlargement. It is possible to enlarge the image or to move the enlarged portion when it is estimated that the user's operation desires to move the enlarged portion. Therefore, convenience can be improved.

  The image providing apparatus according to the present invention further includes an operation detection unit that detects an operation of the moving body operated by the user, and the processing unit performs an enlargement process according to the operation detected by the operation detection unit, and It is preferable to execute at least one of the position change processing.

  According to this image providing apparatus, at least one of image enlargement and movement of the enlarged portion is performed according to the operation of the moving body, and the image enlargement is performed when it is determined that the image enlargement is appropriate from the operation of the moving body. When the change of the enlarged portion is determined to be appropriate from the operation of the moving body, the enlarged portion can be moved. Therefore, convenience can be improved.

  The image providing apparatus of the present invention further includes stop detection means for detecting the stop of the moving body operated by the user, and the processing means is enlarged only when the stop of the vehicle is detected by the stop detection means. It is preferable to execute at least one of the process and the position change process.

  According to this image providing apparatus, at least one of the image enlargement and the movement of the enlarged portion is performed only when the moving body is stopped, and the situation where the user confirms the image while moving the moving body is prevented. be able to.

  In addition, a vehicle according to the present invention includes a camera installed in the vehicle, and the above-described image providing device that is mounted on the vehicle and inputs imaging data captured by the camera.

  According to the vehicle of the present invention, the user can confirm safety around the vehicle by displaying images.

  In addition, the image providing method of the present invention includes a processing step for processing imaging data obtained by imaging, a display step for displaying an image on a display unit having an image display function according to the processing in the processing step, and a display unit A head position detection step for detecting a front and back position of the user's head relative to the installation position, and in the processing step, imaging is performed according to the front and back position of the user head detected in the head position detection step. An enlargement process for enlarging a part of the captured image based on the data and displaying it on the display means is performed.

  According to the image providing method of the present invention, the image is enlarged according to the front and back positions of the user's head. For this reason, for example, the image is enlarged by an intuitive and natural movement in which the user brings his / her face close to the installation position of the display means, and an image easy to see for the user is displayed. Therefore, visibility can be improved.

  According to the present invention, visibility can be improved.

  Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic configuration diagram of a vehicle surrounding image providing system including an image providing apparatus according to the present embodiment, and FIG. 2 is a diagram showing an installation state and a display image example of the vehicle surrounding image providing system shown in FIG. It is. In FIG. 2, a part of the configuration shown in FIG. 1 is omitted. Further, in the following embodiments, a case where the image providing device is mounted on a vehicle will be described as an example. However, the image providing device may not be provided on the vehicle, may be mounted on another moving body, or may be moved. It does not have to be mounted on the body.

  As shown in FIG. 1, the vehicle surrounding image providing system 1 includes an outside camera (camera) 10, an in-vehicle camera 11, and an image providing device 20. The vehicle exterior camera 10 is attached to the vehicle body so as to image the rear of the vehicle as shown in FIG. The vehicle exterior camera 10 is configured by a wide-angle camera that can image a wide range behind the vehicle. In addition, in this embodiment, although the vehicle exterior camera 10 is image | photographing the vehicle back, it is not restricted to back especially, You may image another direction.

  The in-vehicle camera 11 is provided in the passenger compartment and is configured to image the driver's head. The in-vehicle camera 11 is configured by, for example, an infrared camera, and is configured to be able to capture the driver's head even when the interior of the vehicle is dark, such as during night driving.

  The image providing device 20 processes image data captured by the outside camera 10 and displays an image for the user. The image providing apparatus 20 includes an image processing unit (processing unit) 21, a monitor (display unit) 22, a head position detection unit (head position detection unit) 23, and an in-vehicle device detection unit (operation detection unit) 24. And a wheel motion detector (motion detector) 25 and a vehicle speed detector (stop detector) 26.

  The image processing unit 21 processes imaging data obtained by imaging with the outside camera 10. The monitor 22 displays an image for the user according to the processing by the image processing unit 21. FIG. 2B shows an example of a display image. As shown in FIG. 2B, obstacles O1 to O3 exist behind the vehicle. In this case, an image including the obstacles O1 to O3 is displayed on the monitor 22. Since the vehicle exterior camera 10 is a wide-angle camera, the obstacles O1 to O3 displayed on the monitor 22 are displayed small on the monitor 22 one by one.

  The head position detection unit 23 detects the front and rear positions and the left and right positions of the user's head relative to the installation position of the monitor 22. The head position detector 23 detects the front and rear positions and the left and right positions of the user's head based on the image data captured by the in-vehicle camera 11. Here, the monitor 22 is provided in the center of the instrument panel. For this reason, the head position detection part 23 will detect the front-back position and left-right position of a user's head with respect to the center part of an instrument panel. In detecting the user head position, the head position detection unit 23 may track the movement of an elliptical object in the three-dimensional space, or may track a skin color region. Further, the head position detection unit 23 cuts out a candidate area where a face is highly likely to be present from the captured image obtained by the imaging of the in-vehicle camera 11, performs image processing in the candidate area, and performs a head (face) May be tracked.

  In the present embodiment, the head position detection unit 23 detects the position of the user's head based on the image from the in-vehicle camera 11, but is not limited to the image processing technique, and a signal from an ultrasonic sensor or the like. Thus, the position of the user's head may be detected.

  The in-vehicle device detection unit 24 detects an operation performed on an operation device mounted on a vehicle and operated by a user. Here, the in-vehicle device includes a steering device, pedals such as an accelerator pedal, a shift lever, and the like in addition to the navigation device and the audio device. That is, the in-vehicle device includes both a device related to traveling of the vehicle and a device not related to traveling. The in-vehicle device detection unit 24 is configured to detect operations performed on these devices.

  The wheel motion detection unit 25 detects the motion of the vehicle (moving body operated by the user), and specifically detects the rotation of the wheel and the direction in which the wheel faces. The vehicle speed detection unit 26 detects the stop of the vehicle (a moving body operated by the user), and specifically detects the speed of the vehicle. The wheel motion detection unit 25 and the vehicle speed detection unit 26 are connected to a sensor attached in the vicinity of the wheel, and are configured to detect the operation and the vehicle speed of the vehicle based on an output signal from the sensor.

  The image providing device 20 includes a wheel motion detection unit 25 and a vehicle speed detection unit 26. These functions are shared, and the rotation of the wheel and the direction of the wheel are detected by one detection unit, and The vehicle speed may be detected.

  Further, the image providing device 20 may include another detection unit instead of the wheel motion detection unit 25 and the vehicle speed detection unit 26. For example, the image providing device 20 may include a detection unit that detects the movement of the vehicle based on a signal from the navigation device, instead of the wheel motion detection unit 25. Further, the image providing device 20 may include a shift lever detection unit that detects whether or not the shift lever is in the parking position, instead of the vehicle speed detection unit 26.

  Further, the image processing unit 21 enlarges a part of a captured image based on the captured data (that is, an image as shown in FIG. 2B) and displays the enlarged image on the monitor 22, and enlarges the captured image. A position changing process for changing the position of the area to be displayed is executed. Specifically, the image providing device 20 executes an enlargement process for enlarging a part of the captured image according to the front and back positions of the user's head detected by the head position detection unit 23. In addition, the image providing device 20 executes a position changing process for changing the position of the area to be enlarged and displayed in the captured image according to the left and right positions of the user's head detected by the head position detecting unit 23. .

  FIG. 3 is a diagram illustrating a display example of the monitor 22 when the enlargement process and the position change process are performed. Assume that an image as shown in FIG. 3A, that is, a captured image based on the entire captured data is displayed. Here, when the user brings his face close to the monitor 22, the image processing unit 21 executes enlargement processing. At this time, the region T1 in the image shown in FIG. 3A is enlarged, and the image shown in FIG. 3B is displayed. As a result, the obstacle O2 is enlarged and displayed, and the user can easily check the obstacle O2, thereby improving the visibility.

  If the user moves his / her head to the right (or left) with respect to the monitor 22, the image processing unit 21 executes position change processing. At this time, the region T1 shown in FIG. 3A moves to the right. That is, the area T2 shown in FIG. 3A is enlarged, and an image as shown in FIG. 3C is displayed on the monitor 22. As a result, the user can easily check the obstacle O1, and the visibility is improved.

  The head position detection unit 23 may detect the vertical position of the user's head, and the image processing unit 21 may execute position change processing according to the vertical position of the user's head. Thereby, the visibility is further improved.

  Further, the image processing unit 21 may execute at least one of an enlargement process and a position change process in accordance with an operation detected by the in-vehicle device sensor 24. For example, assume that the user turns the steering of the vehicle to the right. In this case, it can be estimated that the user wants to watch the right side of the vehicle. For this reason, the image processing unit 21 enlarges the image as shown in FIG. 3B and changes the enlarged portion to the right side as shown in FIG. In this way, when it is estimated that the user's operation wants to enlarge the image, the image is enlarged, or when the user's operation is expected to move the enlarged portion, the enlarged portion is moved. It becomes possible to do.

  The image processing unit 21 may execute at least one of an enlargement process and a position change process in accordance with the movement of the vehicle detected by the wheel motion detection unit 25. For example, assume that the vehicle is about to change lanes to the right lane. In this case, it can be estimated that the user wants to watch the right side of the vehicle. For this reason, the image processing unit 21 enlarges the image as shown in FIG. 3B and changes the enlarged portion to the right side as shown in FIG. In this way, it is possible to enlarge the image when it is determined that the image enlargement is appropriate from the movement of the moving body, or to move the enlargement portion when the enlargement portion is determined to be appropriate from the movement of the moving body. It becomes.

  Furthermore, the image processing unit 21 may execute at least one of the enlargement process and the position change process only when the vehicle speed detection unit 26 detects the stop of the vehicle. Accordingly, at least one of image enlargement and movement of the enlarged portion is performed only when the vehicle is stopped, and a situation in which the user confirms the image while driving the vehicle can be prevented.

  FIG. 4 is a flowchart illustrating an example of an image providing method according to the present embodiment. As shown in FIG. 4, first, the image providing device 20 inputs imaging data obtained by imaging with the outside camera 10 (step S <b> 1). Next, the vehicle speed detection unit 26 determines whether or not the vehicle is stopped (step S2).

  When it is determined that the vehicle is not stopped (step S2: NO), the image processing unit 21 performs image processing on the entire captured data obtained by the vehicle camera 10 (step S8), and displays the entire captured image. (Step S9). Thereafter, the process proceeds to step S1.

  On the other hand, when it is determined that the vehicle is stopped (step S2: YES), the image providing device 20 determines whether or not a predetermined time has elapsed since the previous head position was determined (for example, the previous head position is determined). Whether one second has elapsed since then) (step S3). If it is determined that the predetermined time has not elapsed (step S3: NO), the process proceeds to step S6.

  If it is determined that the predetermined time has elapsed (step S3: YES), the head position detection unit 23 determines and stores the head position based on the imaging data from the in-vehicle camera 11 (step S4). Next, the head position detection unit 23 determines the amount of movement of the head position based on the head position determined and stored last time and the head position determined this time (step S5). Thereby, the head position detector 23 determines in which direction the user's head has moved. Then, the process proceeds to step S6.

  In step S6, the operating device detection unit 24 detects an operation on the operating device performed by the user (step S6). Next, the wheel motion detection unit 25 detects the motion of the wheel (step S7).

  Thereafter, the image processing unit 21 performs image processing (step S8). At this time, the image processing unit 21 determines whether or not the head back-and-forth movement amount determined in step S5 exceeds a predetermined threshold value, and executes the enlargement process when it exceeds the predetermined threshold value. Further, the image processing unit 21 determines whether or not the amount of movement of the head up, down, left, and right determined in step S5 exceeds a predetermined threshold value, and executes the position changing process when it exceeds the predetermined threshold value. Furthermore, the image processing unit 21 executes an enlargement process and a position change process based on the operation content to the operation device detected in step S6 and the wheel operation detected in step S7.

  Thereafter, the monitor 22 displays an image according to the process of step S8 (step S9). Thereby, an image in which a part of the image is enlarged or the position of the enlarged portion is changed is displayed on the monitor 22. Then, the process proceeds to step S1, and the above process is repeatedly executed. Note that the above process ends when the vehicle engine stops, for example.

  Thus, according to the image providing device 20 and the image providing method according to the present embodiment, the image is enlarged according to the front and back positions of the user's head. For this reason, for example, the image is enlarged by an intuitive and natural movement in which the user brings his face close to the installation position of the monitor 22, and an image easy to see for the user is displayed. Therefore, visibility can be improved.

  Further, according to the present embodiment, the image enlargement location moves according to the left and right positions of the user's head, and the location desired by the user can be enlarged and displayed by the user's intuitive and natural movement. it can. Therefore, the visibility can be further improved.

  Further, according to the present embodiment, at least one of the image enlargement and the movement of the enlarged portion is performed according to the user's operation on the operation device. For this reason, when it is estimated that the user's operation wants to enlarge the image, the image is enlarged, or when the user's operation is expected to move the enlarged portion, the enlarged portion is moved. It becomes possible. Therefore, convenience can be improved.

  Further, according to the present embodiment, at least one of image enlargement and movement of the enlarged portion is performed according to the operation of the vehicle. For this reason, it is possible to enlarge the image when it is determined that the image enlargement is appropriate from the operation of the vehicle, or to move the enlarged portion when it is determined that the change of the enlarged portion is appropriate from the operation of the moving body. It becomes. Therefore, convenience can be improved.

  Further, according to the present embodiment, at least one of the image enlargement and the movement of the enlarged portion is performed only when the vehicle is stopped, and the situation where the user confirms the image while moving the vehicle is prevented. be able to.

  In addition, according to the vehicle according to the present embodiment, the user can confirm safety around the vehicle by displaying an image.

  As described above, the present invention has been described based on the embodiment, but the present invention is not limited to the above embodiment, and may be modified without departing from the gist of the present invention. For example, although only the image has been described in the above embodiment, the visibility can be similarly improved for a video in which images are continuous.

  For example, in the present embodiment, the image providing apparatus 20 displays the image data captured by the wide-angle camera on the monitor 22, but the present invention is not limited to this. May be provided to the user. Further, the vehicle exterior camera 10 may be a camera having a normal angle of view instead of a wide-angle camera.

  In this embodiment, the image is enlarged when the user's head approaches the monitor 22, but the image may be enlarged when the user's head moves away from the monitor 22. Furthermore, the enlargement ratio of the image may be changed according to the degree of approach (or the degree of separation) of the user's head to the monitor 22, and the movement of the enlarged portion may be changed according to the amount of movement of the head up, down, left, or right The amount may be changed. Further, the enlargement ratio may be changed step by step or may not be stepwise. The amount of movement of the enlarged portion may be changed step by step or may not be stepwise.

  Further, in the present embodiment, a passenger car is taken as an example, but the present invention is not limited to this, and can be applied to a large vehicle such as a truck or an industrial vehicle such as a forklift. Furthermore, the present invention can be applied to other mobile bodies, and can be applied to a case where the mobile body is not installed.

1 is a schematic configuration diagram of a vehicle surrounding image providing system including an image providing apparatus according to the present embodiment. It is a figure which shows the installation state and display image example of the vehicle surrounding image provision system shown in FIG. 1, (a) has shown the installation state, (b) has shown the example of a display. It is a figure which shows the example of a display of the monitor 22 when an expansion process and a position change process are performed, (a) shows a captured image, (b) shows the image after an expansion process, (c) is a position change. The image after processing is shown. It is a flowchart which shows an example of the image provision method which concerns on this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Outside camera 11 ... In-vehicle camera 20 ... Image provision apparatus 21 ... Image processing part 22 ... Monitor 23 ... Head position detection part 24 ... In-vehicle apparatus detection part 25 ... Wheel motion detection part 26 ... Vehicle speed detection part

Claims (5)

Processing means for processing imaging data obtained by imaging;
Display means for displaying an image to the user in accordance with processing by the processing means;
Head position detecting means for detecting front and back positions of the user's head with respect to the installation position of the display means,
The processing means executes an enlargement process for enlarging a part of a captured image based on the imaging data and displaying the enlarged image on the display means according to the front and back positions of the user's head detected by the head position detecting means. And
It further comprises stop detection means for detecting the stop of the moving body operated by the user,
The processing means executes at least one of the enlargement process and the position change process only when a stop of the vehicle is detected by the stop detection means,
The image processing apparatus according to claim 1, wherein the processing unit executes a process of displaying the entire captured image when the stop of the vehicle is not detected by the stop detection unit. The head position detection means detects the left and right positions of the user's head relative to the installation position of the display means,
The processing means changes a position of a region to be enlarged and displayed in the captured image of the captured image according to the left and right positions of the user's head detected by the head position detecting means. The image providing apparatus according to claim 1, wherein: It further comprises operation detection means for detecting an operation performed on the operation device operated by the user,
The image providing apparatus according to claim 2, wherein the processing unit executes at least one of the enlargement process and the position change process in accordance with an operation detected by the operation detection unit. A camera installed in the vehicle;
The image providing device according to any one of claims 1 to 3 , wherein the image providing device is mounted on the vehicle and inputs imaging data captured by a camera.
A vehicle comprising: Processing steps for processing imaging data obtained by imaging;
In accordance with the processing in the processing step, a display step of displaying an image on a display unit having an image display function;
A head position detecting step for detecting front and back positions of the user's head relative to an installation position of the display means,
In the processing step, an enlargement process for enlarging a part of the captured image based on the imaging data and displaying the enlarged image on the display unit according to the front and rear position of the user's head detected in the head position detecting step is executed. It is,
It further comprises a stop detection step for detecting a stop of the moving body operated by the user,
The processing step executes at least one of the enlargement process and the position change process only when a stop of the vehicle is detected by the stop detection step,
The image providing method is characterized in that the processing step executes a process of displaying the entire captured image when a stop of the vehicle is not detected by the stop detection means .

Images