JP6027406B2 - Vehicle interior camera scanning method, vehicle interior camera search method, and vehicle interior camera - Google Patents

Description

  Embodiments described herein relate generally to a vehicle interior camera scanning method, a vehicle interior camera searching method, and a vehicle interior camera.

  2. Description of the Related Art In recent years, image processing apparatuses that use cameras and navigation devices mounted on vehicles have become widespread. As one example, a drive recorder that mounts a camera on a vehicle and captures a scenery outside the vehicle is known.

  This drive recorder can process the image data of the scenery photographed by the camera, thereby acquiring information relating to the movement of the vehicle and temporarily storing the image data at a certain time (for example, , See Patent Document 1).

JP 2006-347493 A

  By the way, when detecting a target object in a captured image, the target image is captured by a camera or a scanner, image data is acquired, scanned rightward from the upper left position of the image data to the right end, and then temporarily moved to the left end. Returning, the next scanning line scanned is scanned rightward to the right end again. A common object detection method is to detect an object in image data by sequentially scanning one lower scanning line in the right direction.

  Therefore, since a normal image processing apparatus scans in the right direction from the upper left position of the image data, for example, when an object appears from the lower right position of the image data, it takes time until the object is detected. There is a problem that requires.

  That is, when a scene is photographed with a camera, and the target object to be detected appears in the captured image data from the lower right of the image data, the target is detected by the method of detecting the target from the upper left of the image data. There is a problem that it takes time to detect an object.

According to the present embodiment, in the vehicle interior camera scanning method according to the present embodiment, the photographing step of photographing the operation panel unit provided in the driver's seat in the vehicle interior with the photographing camera, and the operation panel unit are photographed. an image data obtaining step of obtaining image data, from the shooting range in the acquired image data, scanning for a given range of detection of the driver's seat side, in the longitudinal direction from the upper side toward the lower side of the image data The object determination step for determining whether or not the image of the driver's object located in the driver's seat is in the image data, and the object determination step determines that the object is in the image data. A determination result notification step of notifying that the determination has been made.

The schematic block diagram which showed the schematic structure of the vehicle interior camera which concerns on this embodiment. The hardware block diagram which shows the structure of the hardware of the vehicle interior camera which concerns on this embodiment. Explanatory drawing which showed the place where the vehicle interior camera which concerns on this embodiment image | photographs the operation panel periphery. Explanatory drawing which showed an example in which the vehicle interior camera which concerns on this embodiment was installed in the ceiling in a vehicle. Explanatory drawing which showed the direction which the vehicle interior camera which concerns on this embodiment scans the image | photographed image data. The comparative example which showed the method of the scan for detecting the presence or absence of the target object conventionally performed. The object detection processing procedure for notifying that the driver's hand has been detected when the vehicle interior camera according to the present embodiment scans a predetermined detection range of the shooting range and detects the driver's hand. The flowchart which showed.

  Hereinafter, the vehicle interior camera 100 according to the present embodiment will be described with reference to the accompanying drawings.

  FIG. 1 is a schematic configuration diagram showing a schematic configuration of a vehicle interior camera 100 according to the present embodiment.

  As shown in FIG. 1, the vehicle interior camera 100 includes a photographing camera 110, an image data acquisition unit 120, an object determination unit 130, a determination result notification unit 140, and the like.

  The vehicle interior camera 100 captures the area around the operation panel of the dashboard provided in the front part of the driver's seat. In this embodiment, photographing is performed including at least the operation panel. The vehicle interior camera 100 is installed on the ceiling in the vehicle interior. Details will be described later.

  The image data obtaining unit 120 obtains image data obtained by photographing the periphery of the operation panel with the photographing camera 110.

  The object determination unit 130 is on the driver's seat side of the acquired image data, and performs scanning (scanning) from the upper side to the lower side of the image data, and the driver's hand (object) located in the driver's seat. However, it is determined whether or not the image data is present.

  When the object determination unit 130 determines that there is a driver's hand in the image data, the determination result notification unit 140 notifies an external device or the like of the result determined that there is a driver's hand. Yes. In this case, for example, when it is determined that the driver's hand has approached the operation panel during music playback, a control button on the operation panel can be displayed, or a song name list of the artist being played back can be displayed.

  The image data acquisition unit 120, the object determination unit 130, and the determination result notification unit 140 are realized by a CPU (Central Processing Unit) described later executing a program.

  FIG. 2 is a hardware block diagram showing a hardware configuration of the vehicle interior camera 100 according to the present embodiment.

  As shown in FIG. 2, the vehicle interior camera 100 includes a CPU 150, a ROM (Read Only Memory) 160, a RAM (Random Access Memory) 170, a storage unit 180, and an internal bus 190 in addition to the photographing camera 110 shown in FIG. 1. And so on.

  The CPU 150 can realize the functions of various programs by loading various programs stored in the ROM 160 into the RAM 170 and expanding the programs. The RAM 170 is used as a work area (working memory). The ROM 160 stores various programs. The various programs stored in the ROM 160 include programs for realizing the various functions shown in FIG.

  The storage unit 180 is a storage unit that configures a storage memory, and includes a RAM, a hard disk, and the like. For example, the storage unit 180 temporarily stores the image data acquired by the image data acquisition unit 120.

  The internal bus 190 is connected to each component so that the CPU 150 controls the entire vehicle interior camera 100.

  Next, the shooting position when the vehicle interior camera 100 according to the present embodiment captures the interior of the vehicle will be described.

  FIG. 3 is an explanatory diagram showing a place where the vehicle interior camera 100 according to the present embodiment is photographing the periphery of the operation panel.

  As shown in FIG. 3, the vehicle interior camera 100 captures an area around the operation panel located on the dashboard provided in front of the driver's seat. The vehicle interior camera 100 is installed on the ceiling inside the vehicle.

  The shooting range 200 indicates a range shot by the vehicle interior camera 100. Note that the imaging range 200 includes, for example, the periphery of an operation panel including an operation unit such as a car navigation system, audio, or an air conditioner.

  A driver's hand 300 indicates a driver's hand that drives the vehicle.

  Next, the position (place) where the vehicle interior camera 100 according to the present embodiment is provided in the vehicle will be described.

  FIG. 4 is an explanatory diagram showing an example in which the vehicle interior camera 100 according to the present embodiment is installed on the ceiling inside the vehicle.

  As shown in FIG. 4, the vehicle interior camera 100 is installed on the ceiling inside the vehicle. The installation position is provided slightly above the driver's head. The installation position of the vehicle interior camera 100 is an example, and is not limited to the position shown in FIG. That is, as long as the photographing range 200 shown in FIG.

  In FIG. 4, the driver's hand 300 indicates the position of the driver's hand, and shows a state where the driver's hand is gripped.

  Next, the direction in which the vehicle interior camera 100 according to the present embodiment scans captured image data will be described.

  FIG. 5 is an explanatory diagram showing a direction in which the vehicle interior camera 100 according to the present embodiment scans captured image data.

  As shown in FIG. 5, the in-vehicle camera 100 scans for detecting the presence / absence of an object (driver's hand) with respect to a predetermined detection range in the shooting range 200 of the shot image data. Is supposed to be implemented. The screen resolution of the shooting range 200 is displayed as 640 × 480 (VGA), but this is an example in the present embodiment and is not limited to the screen resolution.

  In addition, although the predetermined detection range in the imaging range 200 is indicated by 3 lines, it is not limited to this, and may be 1 line or 5 lines.

  Here, a scanning method for detecting the presence / absence of an object that has been conventionally performed will be described.

  FIG. 6 is a comparative example showing a scanning method for detecting the presence / absence of an object, which has been performed conventionally.

  As shown in FIG. 6, conventionally, a scan for detecting the presence or absence of an object is performed by moving a block determined from the upper left to the upper right for convenience of storage of an image in a memory and calculation speed. Was done.

  In this case, when an object comes out from the lower right in the imaging range 200, it takes time until the object is detected. In addition, since the detection process is repeatedly executed even in a place where the object does not appear in the shooting range 200, an unnecessary detection process is executed until the object appears in the shooting range 200.

  On the other hand, in the vehicle interior camera 100 according to the present embodiment, the object determination unit 130 is on the driver's seat side of the image data, and the target is within a predetermined detection range from the upper side to the lower side of the image data. A scan for detecting the presence or absence of an object is performed, and it is determined whether or not the driver's hand (object) located in the driver's seat is in the image data.

  Thereby, the determination result notification unit 140 determines that the driver's hand 300 is present when the object determination unit 130 determines that the driver's hand is within the predetermined detection range in the shooting range 200. Can be immediately notified to an external device.

  As shown in FIG. 5, when the driver is located on the right driver's seat with respect to the shooting range 200 with the operation panel, the driver's hand 300 moves from the right side of the shooting range 200 to the left. Appears in the direction.

  That is, in the case of a vehicle made in Japan, a driver's seat is often provided on the right side in the vehicle, so that the driver is positioned on the right side with respect to the photographing range 200 including the operation panel. Therefore, the vehicle interior camera 100 determines whether or not the driver's hand 300 appears from the right side in the shooting range 200.

  On the other hand, in the case of a foreign-made vehicle, the driver's seat is often provided on the left side in the vehicle. In this case, it is determined whether or not the driver's hand 300 appears from the left side in the shooting range 200. It has become.

  Next, the vehicle interior camera 100 according to the present embodiment performs the object detection determination on the driver's hand 300 that is the object, and when the driver's hand 300 is detected, notifies the detection. The object detection processing procedure will be described.

(Object detection processing procedure)
FIG. 7 shows that when the vehicle interior camera 100 according to the present embodiment scans a predetermined detection range of the shooting range 200 and detects the driver's hand 300, the driver's hand 300 is detected. It is the flowchart which showed the target object detection processing procedure which notifies.

  First, the photographing camera 110 provided in the vehicle interior camera 100 photographs the periphery of the operation panel (step S001).

  Next, the image data obtaining unit 120 obtains image data around the operation panel photographed by the photographing camera 110 (step S003).

  Next, the object determination unit 130 is on the driver's seat side with respect to the image data in a predetermined detection range in the captured imaging range 200, and downward (vertical direction) from the upper side of the image data. A scan is performed toward (step S005).

  If the object determination unit 130 determines that there is a driver's hand 300 located in the driver's seat in the image data in the predetermined detection range in the shooting range 200 (Yes in step S007), the determination result notification is sent to that effect. Notification to the unit 140.

  When the determination result notification unit 140 acquires a notification that the driver's hand 300 is in the shooting range 200, the determination result notification unit 140 notifies the control unit that controls the operation panel, which is an external device, so that the operation panel is displayed brightly. (Step S009).

  On the other hand, when there is no driver's hand 300 located in the driver's seat in the image data of the predetermined detection range in the imaging range 200 (No in step S007), the object determination unit 130 stops the vertical scanning. Then, the photographing camera 110 is again photographed around the operation panel, and the processes after step S001 are repeated.

  As described above, the vehicle interior camera 100 according to the present embodiment acquires image data of the shooting range 200 including the operation panel shot by the shooting camera 110, and the vertical direction with respect to the image data of the predetermined detection range. To determine whether or not there is a driver's hand 300 in the image data. When the driver's hand 300 is in the shooting range 200, the vehicle interior camera 100 notifies the control unit that controls the operation panel, which is an external device, via the determination result notification unit 140. Display the operation panel brightly.

  Accordingly, the in-vehicle camera 100 according to the present embodiment can promptly display the operation panel brightly when the driver's hand 300 is in the shooting range 200, thereby preventing the user from driving the vehicle. The operation panel can be operated smoothly.

  In the object detection processing procedure described above, the operation panel is displayed brightly, but the present embodiment is not limited to this. For example, the vehicle interior camera 100 according to the present embodiment lights up a button indicating playback or stop on an audio device on the operation panel, or displays an icon image (album image) for changing music to be played back. Also good.

  As described above, the vehicle interior camera 100 according to the present embodiment is provided with the photographing camera 110 for photographing the periphery of the operation panel on the ceiling in the vehicle, and scans the photographing range 200 where the periphery of the operation panel is photographed in the vertical direction from the driver's seat side. By doing so, the driver's hand 300 can be detected early. As a result, the in-vehicle camera 100 can detect the driver's hand 300 earlier than before, and thus can perform signal notification and information processing in accordance with the behavior of the driver.

  In addition, in the vehicle interior camera 100 according to the present embodiment, for example, when the driver's seat is on the left side of the vehicle (in the case of a so-called left-hand drive vehicle), scanning is performed in the vertical direction from the left side in the photographed photographing range 200. To do. Therefore, even when the driver's seat is on the left side, the operation panel can be operated smoothly without hindering the user's driving of the vehicle.

  In the present embodiment, the vehicle interior camera 100 is provided on the ceiling in the vehicle interior. For example, when it is difficult to install the photographing camera 110 on the ceiling as in an open car, The photographing camera 110 may be provided in the center console section that separates the driver seat and the passenger seat.

(Modification)
In the above-described embodiment, the CPU 150 executes the program to realize the image data acquisition unit 120, the object determination unit 130, the determination result notification unit 140, and the like.

  Here, by changing the program for executing the above-described function, as a method of searching for an object in the vehicle interior camera 100, the vicinity of the driver's seat photographed by the photographing camera 110 provided in the vehicle interior of the moving body is photographed. A setting step set as an area (shooting range 200) and image data corresponding to the shooting area shot by the shooting camera 110 are sequentially scanned from the upper side to the lower side of the image data, and the operation is performed within the image data. An object search method including an object search step (object determination unit 130) for determining whether or not there is an object corresponding to a hand or a finger of a hand.

  In this case, in the setting step, the shooting area is set so that the side closer to the driver's seat in the shooting area is the upper side of the image data, and the side away from the driver's seat in the shooting area is the lower side of the image data.

  As a result, as a method for searching for an object in the vehicle interior camera 100, whether or not there is a driver's hand or finger (object) is determined on the driver's seat side of the image data from the upper side of the image data. Since it is possible to perform scanning for detecting the presence or absence of the object in the downward direction, it is possible to determine whether or not the driver's hand (object) is in the image data in a short time. It can be carried out.

  Therefore, according to the object searching method in the vehicle interior camera 100 as described above, the time required for determining the presence or absence of the object can be shortened.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

  Further, in the embodiment of the present invention, each step of the flowchart shows an example of processing that is performed in time series in the order described. The process to be executed is also included.

100 vehicle interior camera 110 photographing camera 120 image data acquisition unit 130 object determination unit 140 determination result notification unit 150 CPU
160 ROM
170 RAM
180 Storage unit 190 Internal bus 200 Shooting range 300 Driver's hand

Claims (4)

A shooting step of shooting an operation panel provided in the driver's seat in the passenger compartment with a shooting camera
An image data acquisition step of acquiring image data taken by the operation panel unit;
From the shooting range in the acquired image data, with respect to a predetermined detection range of the driver's seat side, performed scan in the vertical direction from the upper side toward the lower side of the image data, the driver is located in the driver's seat An object determination step for determining whether or not the object is present in the image data;
A determination result notifying step for notifying that the determination is made when it is determined in the object determination step that the object is present in the image data;
A vehicle interior camera scanning method including: 2. The vehicle interior camera scanning method according to claim 1, wherein, in the photographing step, the photographing camera photographs the operation panel unit in a state of being provided on a ceiling portion of the vehicle interior. A setting step for setting the vicinity of the driver's seat to be photographed by the photographing camera provided in the vehicle interior of the moving body as a photographing area;
In the image data corresponding to the shooting area shot by the shooting camera , the image data is scanned in the vertical direction from the upper side to the lower side, and the object corresponding to the driver's hand or finger in the image data An object search step for determining whether or not there is,
In the setting step, the shooting area is set so that a side closer to the driver's seat in the shooting area is an upper side of the image data, and a side away from the driver's seat in the shooting area is a lower side of the image data. A method for searching for an object in an indoor camera. A photographing camera for photographing the operation panel provided in the driver's seat in the passenger compartment;
An image data acquisition unit for acquiring image data obtained by photographing the operation panel unit;
From the shooting range in the acquired image data, with respect to a predetermined detection range of the driver's seat side, performed scan in the vertical direction from the upper side toward the lower side of the image data, the driver is located in the driver's seat An object determination unit for determining whether or not the object is present in the image data;
A determination result notifying unit for notifying that the object is determined when the object determining unit determines that the object is present in the image data;
A vehicle interior camera.

Images