JP5729110B2 - Image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing method for realizing a plurality of functions related to vehicle management using a single camera installed in a vehicle.

  Regarding a device for managing a vehicle, a driving support system (Patent Document 1) that presents driving information recorded by a drive recorder and a vehicle that issues a warning to a moving object detected from an image of a camera attached to the vehicle A monitoring device (Patent Document 2) is known.

JP 2010-257484 A JP 2006-321357 A

  However, when realizing a plurality of functions related to vehicle management, if an area including the inside and outside of the vehicle is imaged with one camera, the brightness varies depending on the imaging area, and the image becomes partially unclear. There was a problem that the function might not be realized correctly.

  The problem to be solved by the present invention is to accurately realize a plurality of functions related to vehicle management using a single wide-angle camera.

  The present invention acquires an inside / outside image of a vehicle imaged by a single wide-angle camera installed in the vehicle, and an outside region image corresponding to the outside region of the vehicle set in the inside / outside image and a vehicle interior region of the vehicle The brightness of each region image including the vehicle interior region image corresponding to is adjusted based on the inner / outer region or the brightness of each region, and each region image is associated with each management function of the vehicle in which they are used. By referring to the correspondence relationship, each area image whose brightness has been adjusted is output to each management apparatus in which the management function is executed, thereby solving the above problem.

  According to the present invention, the front area of the vehicle, the side area of the vehicle, and the vehicle interior area are imaged with a single wide-angle camera, and each area image set in the captured inside and outside images of the vehicle is cut out. Since the brightness of each area image is adjusted based on the brightness of each area, even when the brightness varies depending on the imaging area, it is possible to prevent the image from being partially obscured, and to The function can be realized accurately.

1 is a configuration diagram of a vehicle management system including an image processing apparatus according to an embodiment of the present invention. It is a figure which shows an example of the installation position of the camera of this embodiment, and the inside / outside area | region of the vehicle imaged with a camera. It is a figure which shows an example of each area | region image set to the inside / outside image of a vehicle. It is a figure which shows the other example of each area | region image set to the inside / outside image of a vehicle. It is a figure which shows the correspondence of each area | region image and a management apparatus. It is a flowchart figure which shows the control procedure of the vehicle management system which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the present embodiment, a case where the image processing apparatus according to the present invention is applied to the vehicle management system 1000 will be described as an example.

  FIG. 1 is a block configuration diagram of a vehicle management system 1000 including an image processing apparatus 100 according to the present embodiment. As shown in FIG. 1, the vehicle management system 1000 according to this embodiment includes an image processing device 100, an in-vehicle device 200, and a vehicle controller 300.

  The vehicle management system 1000 includes an in-vehicle device such as an ignition switch 400 that receives an engine start / stop command, a positioning switch 500 that outputs a signal corresponding to the position of the shift position of the vehicle, and a drive system 600 related to driving the vehicle. You can also.

  These devices are connected by a CAN (Controller Area Network) or other vehicle-mounted LAN, and can exchange information with each other indirectly or directly via the vehicle controller 300.

  As illustrated in FIG. 1, the image processing apparatus 100 includes a control device 10, a camera 20, and an illuminance sensor 30.

  The camera 20 of the image processing apparatus 100 according to the present embodiment is installed in the vehicle compartment of each vehicle, and has a relatively short focal length (for example, a focal length of less than 40 mm in terms of 35 mm film). (Wide angle of view) camera. The wide-angle camera 20 is configured using an imaging device such as a CCD (Charge Coupled Devices), and images the vehicle interior and exterior regions including the vehicle interior and exterior of the vehicle at a predetermined cycle.

  The inside / outside region of the vehicle includes an outside region outside the vehicle and a vehicle interior region inside the vehicle. Further, the vehicle outside region includes a front region outside the vehicle that can be seen mainly from the vehicle interior through the front window and a side region outside the vehicle that can be seen from the vehicle cabin mainly through the side door window. Further, the vehicle interior region includes a vehicle interior region of a part or all of the driver's seat, the passenger seat, and the rear seat of the vehicle. That is, the inside / outside region of the vehicle according to the present embodiment includes a front region outside the vehicle, a side region outside the vehicle, and a vehicle interior region.

  FIG. 2 is a view of an installation example of the camera 10 and an example of the inside / outside region E of the vehicle V as viewed from the side of the vehicle V. As shown in FIG. 2, the camera 20 is provided on the ceiling at the top of the driver's seat in the passenger compartment, around the map lamp, or on the rearview mirror, and the front area of the vehicle V, the side area of the vehicle V (outside area), and The inside / outside area E including the vehicle interior area is imaged. The installation position of the camera 20, the focal length, and the range of the inner and outer area E are appropriately set according to the size of the vehicle V, the height of the driver's seat, the size of the rear seat, the size of the window, the contents of the management function, etc. Is done.

  The camera 20 images the inside / outside area E and then sends an inside / outside image, which is a video of the inside / outside area E of the vehicle V, to the control device 10. The trigger for starting imaging is not limited, and an on signal input to any one of the management devices 210 to 260, an on signal input to the ignition switch 400, or an on signal input to the switch 21 of the camera 20 When acquired, imaging can be started. Further, from the viewpoint of always managing the vehicle V, it is also possible to continue imaging.

  The control device 10 of the image processing apparatus 100 according to the present embodiment sets and sets region images necessary for realizing a plurality of management functions of the vehicle V in the inside and outside images of the vehicle V captured by a single camera. By adjusting the brightness of each area image, a ROM (Read Only Memory) 12 storing a program to be transmitted to each device in which these are used, and a program stored in the ROM 12 are executed. A CPU (Central Processing Unit) 11 as an operation circuit that functions as the image processing apparatus 100 according to the embodiment of the present invention and a RAM (Random Access Memory) 13 that functions as an accessible storage device are provided. The control device 10 according to the present embodiment is activated in response to an on signal input to any one of the in-vehicle devices 200 and an on signal input to a switch of the image processing device 100, but always manages the vehicle V. From this point of view, the operation can be continued at any time.

  The control device 10 of the image processing apparatus 100 according to the present embodiment includes an area setting function, a brightness acquisition function, an image adjustment function, and an output function. The control device 10 according to the present embodiment can execute the function by the cooperation of software for realizing the function and the hardware described above.

  Hereinafter, each function realized by the control device 10 of the image processing apparatus 100 will be described.

  First, the area setting function of the control device 10 will be described. The control device 10 according to the present embodiment corresponds to a first region image corresponding to the front region, a second region image corresponding to the side region, and a vehicle interior region from the inside / outside image P of the vehicle V captured by the camera 20. The boundary of the third region image is extracted. In the present embodiment, an example in which the inside / outside image P is processed by being divided into three regions will be described. However, the inside / outside image P is a region outside the vehicle corresponding to the region including the front region and the side region of the vehicle, and the vehicle interior. Processing can also be divided into two areas, a vehicle interior area corresponding to the area. Here, avoiding redundant description, the process will be described as an example divided into three regions of the inner and outer images P.

  FIG. 3 is a diagram illustrating an example of the inside / outside image P obtained by capturing the inside / outside region E (see FIG. 2) of the vehicle V with the camera 20. As shown in FIG. 3, the inside / outside image P in this example is rectangular image data surrounded by a first side R1, a second side R2, a third side R3, and a fourth side R4. The inside / outside image P in this example corresponds to the first region image P1 corresponding to the front region seen from the vehicle interior through the front window of the vehicle V and the side region seen from the vehicle interior through the side door window of the vehicle V. The second region image P2 and the third region image P3 corresponding to the vehicle interior region of the vehicle V (hereinafter, each region image may be collectively referred to as Pn) are included.

  The control device 10 extracts the boundary between the first region image P1, the second region image P2, and the third region image P3 described above from the inside / outside image P of the vehicle V. Although the boundary extraction method is not particularly limited, the control device 10 according to the present embodiment performs edge detection processing on the inner and outer images P based on the brightness of the pixels, and subjects (objects) existing inside and outside the vehicle V. Based on the edge Q corresponding to the feature, the boundaries of the first region image P1, the second region image P2, and the third region image P3 are extracted. In this example, an example in which the first to third region images P1 to P3 (hereinafter collectively referred to as Pn) are set will be described. However, the region image can be appropriately defined according to the contents of the management function.

  In this embodiment, the control apparatus 10 extracts the edge of the dashboard, side door, and side door window of the vehicle V. Specifically, as shown in FIG. 3, the control device 10 detects a first edge Q1 that is a boundary between the dashboard and the front window, and a second edge Q2 that is a boundary between the dashboard and the seat space. . In parallel with this, as shown in the figure, the control device 10 detects the third edge Q3, the fourth edge Q4, and the fifth edge Q5 that are the boundary between the side door and the side door window of the vehicle V.

  The control device 10 extracts each boundary of the first region image P1, the second region image P2, and the third region image P3 based on the detected first edge Q1 to fifth edge Q5.

  In the present embodiment, as a method for acquiring the boundary of each region image Pn, a method for detecting the edge Q based on the image data of the inner and outer image P and extracting the boundary of each region image Pn based on the edge Q. However, it is also possible to predefine the boundary of each region image Pn on the coordinates of the inner and outer images P and store them in a readable state.

  And the control apparatus 10 of this embodiment sets the 1st area | region image P1, the 2nd area | region image P2, and the 3rd area | region image P3 which are contained in the inside / outside image P of the vehicle V based on the extracted boundary, respectively.

  As illustrated in FIG. 3, the control device 10 sets a region surrounded by the first side R1, the third side R3, the fourth side R4, and the first edge Q1 of the inside / outside image P as the first region image P1. . In addition, the control device 10 determines the area surrounded by the second side R2, the third side R3, the second edge Q2, the fourth edge Q4, and the fifth edge Q5 of the inside / outside image P, and the first side of the inside / outside image P. An area surrounded by R1, the second edge Q2, and the third edge Q3 is set as the second area image P2. Further, the control device 10 sets a region surrounded by the second edge Q2, the third edge Q3, the fourth edge Q4 and the fifth edge Q5, and the first side R1 and the second side R2 of the inner and outer image P to the third region. Set as image P3.

  In addition, the control apparatus 10 can set the vehicle exterior area image corresponding to the vehicle exterior area and the vehicle interior area image corresponding to the vehicle interior area in the interior / exterior image P. In this case, the control device 10 detects the first edge Q1 that is the boundary between the dashboard and the front window, and the second edge Q2 that is the boundary between the dashboard and the seat space. Then, the control device 10 determines the area surrounded by the first side R1, the third side R3, the fourth side R4, and the first edge Q1 of the inner and outer image P, the second side R2, and the third side of the inner and outer image P. A region surrounded by R3, the second edge Q2, the fourth edge Q4, and the fifth edge Q5 and a region surrounded by the first side R1, the second edge Q2, and the third edge Q3 of the inside / outside image P are outside the vehicle. Set as area. In addition, the control device 10 determines a region surrounded by the second edge Q2, the third edge Q3, the fourth edge Q4, the fifth edge Q5, and the first side R1 and the second side R2 of the inside / outside image P as a vehicle interior region. Set as.

  In addition, depending on the arrangement of the camera 20, an object attached to the vehicle V may be reflected in the inside / outside image P. For example, when the camera 20 is provided on the upper part of the rearview mirror, or when the camera 20 is provided on the ceiling of the passenger compartment and the rearview mirror is provided below the rear view mirror, as shown in FIG. The mirror image P3 is always reflected in the inside / outside image P.

  When the image of the object (back mirror) attached to the vehicle V is included in the inside / outside image P of the vehicle V, the control device 10 of the present embodiment performs the first outer edge B1 in the region corresponding to the image P3 of the back mirror. , The second outer edge B2, the third outer edge B3, and the fourth outer edge B4 are set in the inner / outer image P in advance, and the boundaries of the region images P1 to P4 are extracted using the set outer edges B1 to B4. That is, based on the boundaries including the first outer edge B1, the second outer edge B2, the third outer edge B3, and the fourth outer edge B4 of the area corresponding to the rearview mirror image P3 set in the inner / outer image P in advance. Set P4.

  Specifically, in the example illustrated in FIG. 4, the control device 10 includes areas corresponding to the first side R1, the third side R3, the fourth side R4, the first edge Q1, and the rear-view mirror image P3 of the inside / outside image P. The region surrounded by the fourth outer edge B4 (the third outer edge B3 depending on the shape of the image P3) can be set as the first region image P1. Further, the control device 10 controls the second outer edge B2 of the region corresponding to the image P3 of the rearview mirror, the third side R3 of the inner and outer image P, the second side R2 of the inner and outer image P, the fifth edge Q5, and the fourth edge Q4. A region surrounded by can be set as the second region image P2. Further, the control device 10 controls the second edge Q2, the second outer edge B1, the second outer edge B2, the fourth edge Q4, the fifth edge Q5, and the second side of the inner / outer image P in the region corresponding to the image P3 of the rearview mirror. A region surrounded by R2, the first side R1, and the third edge Q3 can be set as the third region image P3. In addition, when the inside / outside image P is divided into two parts, a vehicle outside region image and a vehicle interior region image, a combination of the first region image P1 and the second region image P2 is used as a vehicle outside region image, and a third The region image P3 is defined as a vehicle interior region image.

  Although it is difficult to accurately detect the shape of the rearview mirror and other objects by the edge detection process, by setting the outer edge of the region corresponding to the rearview mirror image P3 in advance, while eliminating the influence of the object, Image processing can be performed quickly.

  Thus, by setting the outer edge B corresponding to the image of an object such as a rearview mirror attached to the vehicle V in advance as the inner and outer images P, and using this to set the boundaries of the region images P1 to P3, The region images P <b> 1 to P <b> 4 can be accurately set without being affected by an object provided in the inner and outer regions imaged by the camera 20.

  Moreover, the control apparatus 10 of this embodiment extracts the boundary of each area | region image Pn with a predetermined | prescribed period about the inside / outside image P of the vehicle V imaged with the predetermined | prescribed period, and each inside / outside image P based on the extracted boundary. Each area image Pn included in each can be set.

  If the position of the camera 20 is fixed, the extension of the inner / outer region E captured by the camera 20 is always constant, but the camera 20 is attached to a variable part E such as a rearview mirror. When the rearview mirror is moved, the extension of the inner / outer region E to be imaged changes. In the present embodiment, since the boundary of each region image Pn is extracted at a predetermined cycle, even if the extension of the inner and outer region E changes, such as the position of the camera 20 changes, and the target range of the inner and outer image P changes. Thus, it is possible to obtain an accurate boundary of each area image Pn and accurately set each area image Pn.

  Furthermore, the control device 10 of the present embodiment can extract each boundary of each region image Pn based on a plurality of inner and outer images P captured at different timings until the vehicle V travels a predetermined distance. . That is, the boundary Q of each region image Pn is extracted from the inside / outside image P captured at a predetermined timing from when the vehicle V starts to travel to travel a predetermined distance, and each inside / outside image P based on the boundary Q is extracted. Each area image Pn included in each can be set. The start of traveling of the vehicle V can be determined based on the timing at which the ON signal is acquired from the ignition switch 400 via the vehicle controller 300. Specifically, the control device 10 calculates a positional shift amount for each edge Q detected from each of the inner and outer images P captured at a predetermined period from when the ignition is turned on until traveling a predetermined distance. The edge group Q having the smallest deviation amount can be obtained, and the edge group Q can be extracted as the boundary of each region image Pn. Further, the control device 10 obtains the coordinate distribution of each edge Q detected from each of the inside and outside images P captured at a predetermined period from when the ignition is turned on until traveling a predetermined distance, and obtains the coordinate value having the highest distribution probability. It is also possible to obtain an edge Q group having and to extract an edge Q having a high distribution probability as a boundary of each region image Pn.

  Depending on the driving environment, sunlight and streetlights may be temporarily reflected on the dashboard. In such a case, the inside / outside image P includes a fictitious image, the edge Q is not accurately detected, and the boundary of each region image Pn cannot be accurately extracted. In such a scene, the image processing apparatus 100 according to the present embodiment extracts the boundary of each region image Pn using a plurality of internal and external images P captured during a predetermined distance from ignition on. It is possible to accurately extract the boundary of each area image Pn by eliminating the influence of temporary reflection due to the environment of the travel point. As a result, each area image Pn can be set accurately.

  Next, the brightness acquisition function of the control device 10 will be described. The control device 10 of the image processing apparatus 100 according to the present embodiment acquires the brightness of the inner and outer regions (entire) of the vehicle V or the brightness of each region including the front region, the side region, and the vehicle interior region. Specifically, the control device 10 can acquire a representative value such as an average value of the light amount of the image sensor of the camera 20 at the brightness detection timing as brightness information of the inner and outer regions. In addition, when acquiring brightness information for each area, the control device 10 sets the representative value of the light amount of each element that captures the first area image corresponding to the front area of the vehicle V to the brightness of the front area. It can be acquired as information, and a representative value such as an average value of the amount of light of each element that captures the second region image corresponding to the side region of the vehicle V can be acquired as brightness information of the side region. The representative value such as the average value of the light intensity of each element that captures the third region image corresponding to the indoor region of the vehicle V can be acquired as the brightness information of the vehicle indoor region.

  In addition, as shown in FIG. 1, one or a plurality of illuminance sensors 30 that detect the brightness of each region such as an inside / outside region of the vehicle V or a front region, a side region, and a vehicle interior region of the vehicle V are installed in the vehicle V. can do. One illuminance sensor 30 detects the average brightness of a part or all of the inner and outer regions of the vehicle V and sends it to the control device 10. The plurality of illuminance sensors 30 detect the illuminance of each region including the front region of the vehicle V, the side region of the vehicle V, and the vehicle interior region of the vehicle V, and the identifier of each region using the illuminance of each region as brightness information. Is sent to the control device 10. For this reason, the control device 10 can acquire information on the brightness of each region detected by each illuminance sensor 30.

  Of course, it is also possible to acquire brightness information of each area detected by the illuminance sensor 30 while acquiring brightness information of each area based on the amount of light in each element of the image sensor of the camera 20. The control device 10 compares the brightness detected by each element of the image sensor of the camera 20 with the brightness detected by the illuminance sensor 30, and if the difference is greater than or equal to a predetermined value, the detected value of the illuminance sensor 30 The brightness detected by each element of the image sensor of the camera 20 and the average value of the brightness detected by the illuminance sensor 30 may be used. Thus, by using both the brightness detected by the image sensor of the camera 20 and the brightness detected by the illuminance sensor 30, the brightness of each area image can be controlled with high accuracy.

  Next, the image adjustment function of the control device 10 will be described.

  The control apparatus 10 of the image processing apparatus 100 according to the present embodiment is set by the area setting function according to the brightness information of the entire inner and outer areas acquired by the brightness acquisition function or the brightness information of each area. The brightness of each region image Pn including the first region image P1, the second region image P2, and the third region image P3 is adjusted.

  In the vehicle V having a general structure, the front window is provided so as to be inclined from the ceiling, and since the area thereof is large, the front region of the vehicle V captured by the camera 20 is the side region of the vehicle V or the vehicle V. Brighter than the vehicle interior region, the side region of the vehicle V is brighter than the vehicle interior region of the vehicle V. For this reason, the control device 10 of the present embodiment causes the brightness of the first region image P1 corresponding to the brightest front region to be dark when the brightness of the image suitable for the brightness of the inner and outer regions is used as a reference. Further, the adjustment amount for improving the brightness is reduced (for example, the exposure time is shortened) so as not to be overexposed, and the brightness of the third region image P3 corresponding to the darkest vehicle interior region becomes brighter. As described above, the amount of adjustment for improving the brightness is increased (for example, the exposure time is lengthened), and the adjustment is performed so that there is no blackout. In addition, the second region image P2 corresponding to the side region having the intermediate brightness is not adjusted according to the reference brightness (for example, the exposure time is not changed).

  For example, in consideration of the structure of the vehicle V and the performance of the camera 20, the brightness Y of each region image Pn is defined in advance for the average brightness X of the entire inside / outside image P of the vehicle V. When the brightness of the front area is X, the control device 10 adjusts the brightness of the first area image P1 to be Y1 (Y1 <Y), and the brightness of the third area image P3 is Y2. Adjustment can be made so that (Y2> Y). That is, since the first region image P1 in the front region may have an excessive light amount, the first region image P1 is adjusted to be darker than the appropriate image brightness obtained based on the average brightness, Since the three-region image P3 may be insufficient in light amount, it can be adjusted more brightly than the appropriate image brightness obtained based on the average brightness.

  Although the adjustment method of each area image is not particularly limited, in the present embodiment, the control device 10 can adjust the brightness of each area image Pn by controlling the exposure of the camera 20.

  Specifically, the control device 10 associates the brightness of the inner and outer regions of the vehicle V or the brightness of each region including the front region, the side region, and the vehicle interior region of the vehicle V with the exposure time of the camera 20 in advance. With reference to the exposure data, an exposure control command for controlling the exposure time of the image sensor that captures the area image Pn of each area is created according to the brightness of each area acquired by the brightness acquisition function, and is sent to the camera 20. Can be sent out.

  Incidentally, since the information for specifying the group of the image sensor corresponding to each set area image Pn can be added to the exposure control command, the camera 20 is specified based on the acquired exposure control command. The exposure time can be controlled for each group of image sensors. Thereby, the 1st area image P1, the 2nd area image P2, and the 3rd area image P3 by which the brightness of the image was adjusted according to the brightness of each area can be obtained.

  Note that the control device 10 uses the appropriate exposure control function, ISO sensitivity adjustment, and other image adjustment functions provided in the camera 20 to send a control command to the camera 20 according to the brightness of each area corresponding to each function. The brightness of each area image Pn can also be adjusted.

  When it is necessary to set a unified exposure time for the entire inside / outside image P, the entire inside / outside region is imaged with an exposure time corresponding to the brightness of the front region, and the first region image P1 is obtained from the inside / outside image P. Is set, only the second area image P2 is set from the inside / outside image P, and the exposure time according to the brightness of the vehicle interior area is set. It is also possible to capture the entire inner / outer region and set only the third region image P3 from the inner / outer image P. According to this processing, the image processing can be performed with one wide-angle camera 20 although the number of imaging increases.

Furthermore, the control device 10 of the present embodiment can adjust the brightness of each region image Pn by performing processing on each region image Pn of the inside / outside image P captured by the camera 20. Specifically, the control device 10 previously associates the brightness of each region including the inside / outside region of the vehicle V or the front region, the side region, and the vehicle interior region of the vehicle V with the appropriate brightness of each region image Pn. The brightness of the area image Pn is adjusted according to the brightness of each area acquired by the brightness acquisition function with reference to the image adjustment data. The image adjustment data can be defined by experiment according to the structure of the vehicle V (the position and size of the window, the size of the vehicle interior) and the performance of the camera 20. Although not particularly limited, the control apparatus 10 uses an image processing method for adjusting brightness, such as density value conversion, contrast correction, gamma correction, density value histogram conversion, and the like known at the time of filing, The brightness of each area image Pn can also be adjusted.
The brightness adjustment may be performed by either one of the exposure control of the camera 20 or the image processing, or may be performed by both methods. For example, the brightness of each captured area image Pn can be adjusted by image processing while controlling the exposure of the camera 20.

  In addition, since it is generally estimated that the inner and outer regions of the vehicle V when traveling are brighter than the inner and outer regions of the vehicle V than when parked, the control device 10 of the present embodiment. Can change the degree of adjustment of the brightness of each area image Pn according to the state of the vehicle V, such as whether the vehicle is traveling or parked.

  The control device 10 of the present embodiment acquires information indicating whether the vehicle V is running or parked from the vehicle V from the positioning switch 500, and acquires information indicating that the vehicle V is parked. The amount of adjustment for improving the brightness of each area image Pn to be imaged later can be increased. Moreover, the control apparatus 10 of this embodiment acquires the information that the said vehicle V is drive | working from the vehicle V, or is parked from the positioning switch 500, The information that the vehicle V is drive | working is acquired. The adjustment amount that improves the brightness of each area image Pn that is captured after acquisition can be reduced.

  Specifically, when the information that the vehicle V is parked is acquired, the exposure time of the image sensor that captures each area image Pn is extended thereafter, and the information that the vehicle V is traveling After acquiring, it is possible to shorten the exposure time of the image sensor that captures each area image Pn thereafter.

  For example, in consideration of the structure of the vehicle V and the performance of the camera 20, the brightness W of the first region image P <b> 1 is defined with respect to the brightness Z of the traveling / parking inside / outside region or the front region of the vehicle V. When the brightness of the inner / outer region or the front region is Z, the control device 10 adjusts the brightness of the first region image P1 captured during parking so that W1 (W1> W). be able to. Independently of this adjustment or together with this adjustment, the brightness of the first region image P1 imaged during traveling can be adjusted to be W2 (W2 <W). That is, since the first area image P1 captured during parking may be insufficient in light quantity, the first area image P1 can be adjusted to be brighter than in the case where the state of the vehicle V is not considered. In addition, since the first region image P1 captured during traveling may be excessive in light amount, the first region image P1 can be adjusted to be darker than when the state of the vehicle V is not considered. Similar adjustments can be made for the side region and the vehicle interior region.

  As described above, the amount of light of each area image Pn in imaging while parked by changing the adjustment amount for improving the brightness of each area image Pn depending on whether the vehicle V is traveling or parked. Even if this is not sufficient, it is possible to obtain a region image Pn having appropriate brightness. In addition, the amount of light in each region image Pn is excessive in imaging during traveling by changing the adjustment amount for improving the brightness of each region image Pn depending on whether the vehicle V is traveling or parked. Even in such a case, it is possible to obtain a region image Pn having appropriate brightness.

  Next, the output control function of the control device 10 will be described.

  The control device 10 of the image processing apparatus 100 according to the present embodiment refers to a correspondence relationship described later, and is a first region that is set by the region setting function described above and the brightness of each region image Pn is adjusted by the image adjustment function. The image P1, the second region image P2, and the third region image P3 (or the vehicle exterior region image and the vehicle interior region image) are cut out and output to each management device that executes the management function.

  The in-vehicle device 200 of the present embodiment presents the management results of the lane recognition device 210, the obstacle detection device 220, the drive recorder device 230, the snapshot device 240, the driver monitoring device 250, the security device 260, and other management devices to the user. An output device 270 is provided.

  Hereinafter, the management devices 210 to 260 will be described as an example of a device that executes the management function. The management device applied to the vehicle management system 1000 according to the embodiment of the present invention is based on an image captured by the camera 20. As long as it has a function of managing the state of the vehicle V, there is no particular limitation.

  The lane identification device 210 according to the present embodiment has a lane recognition function for recognizing the lane of the road on which the host vehicle is traveling based on the image of the front area of the vehicle V and determining the positional relationship between the host vehicle and the lane. Have. When the lane identification device 210 according to the present embodiment determines that the possibility that the host vehicle is out of the lane exceeds a predetermined threshold, the lane identification device 210 alerts the occupant through the output device 270 such as the display 271 and the speaker 272. Information is output or a signal related to the control of the drive system 600 of the vehicle V is sent to the vehicle controller 300.

  The obstacle detection device 220 according to the present embodiment detects an obstacle such as a vehicle or a pedestrian in front of the vehicle based on an image of a front area of the vehicle V, and determines the positional relationship between the own vehicle and the obstacle. Has an object detection function. When the obstacle detection device 220 according to the present embodiment determines that the possibility that the host vehicle and the obstacle are approaching exceeds a predetermined threshold value, the obstacle detection device 220 of the occupant via the output device 270 such as the display 271 and the speaker 272 is used. Information for calling attention is output, or a signal related to drive control of the vehicle V is sent to the vehicle controller 300.

  The drive recorder device 230 according to the present embodiment captures an image of the front area of the traveling vehicle V and the side area of the vehicle V, and when an accident occurs in the vehicle V or another vehicle during traveling, the situation when the accident occurs Has a drive recorder function of recording an image for confirming. The drive recorder device 230 of the present embodiment can present the captured image via the output device 270 such as the display 271 and the speaker 272, or the image captured via the communication device 273 such as a computer or a mobile phone. It can be sent to the external terminal 800.

  The snapshot device 240 according to the present embodiment captures an image of a driving area for the purpose of taking an image of a front area of the running vehicle V and a side area of the vehicle V and enjoying the scenery of the running route after running. It has a function. The snapshot device 240 according to the present embodiment can present a captured image via the output device 270 such as the display 271 and the speaker 272, or the image captured via the communication device 273 such as a computer or a mobile phone. It can be sent to the external terminal 800.

  The driver monitor device 250 of the present embodiment has a driver monitor function that detects the state of the driver based on the image of the driver's body and determines whether the driver is in a state suitable for driving. The obstacle detection device 220 according to the present embodiment displays a display when it is determined that the driver is not suitable for driving based on the body such as the shoulder and arm of the driver and facial expressions such as the face and eyes. Information for recommending a break to the driver and information for alerting the driver are output via the output device 270 such as the 271 and the speaker 272, or a signal related to the drive control of the vehicle V is transmitted to the vehicle controller 300.

  The security device 260 according to the present embodiment images the front area of the parked vehicle V, the side area of the vehicle V, and the interior area of the vehicle V, and protects the safety of the vehicle V after the occupant gets off the vehicle V. It has a security function to acquire an image at parking. The security device 260 of the present embodiment determines that the safety of the vehicle is threatened based on the captured image around the vehicle (for example, the possibility of theft of vehicle parts, theft of mounted cargo, etc. is high). In such a case, a warning may be presented to the outside via the output device 270 such as the display 271 and the speaker 272, or an image captured via the communication device 273 may be sent to the external terminal 800 such as a computer or a mobile phone. it can.

  Next, the correspondence S referred to when the control device 10 of the image processing apparatus 100 according to the present embodiment performs output processing will be described.

  The control device 10 corresponds in advance to the first region image P1, the second region image P2, the third region image P3, and the management devices 210 to 260 that execute the management function of the vehicle V in which each region image Pn is used. The management devices 210 to 260 that execute the management function described above with respect to the first region image P1, the second region image P2, and the third region image P3 set by the region setting function with reference to the assigned correspondence S. Respectively.

  An example of the correspondence S in this embodiment is shown in FIG.

  As shown in FIG. 5, the first area image P <b> 1 whose brightness has been adjusted is a lane identification device 210 that performs a lane recognition function using the first area image P <b> 1, and obstacle detection using the first area image P <b> 1. Obstacle detection device 220 that executes the function, drive recorder device 230 that executes the drive recorder function using the first region image P1, snapshot device 240 that executes the snapshot function using the first region image P1, and the first The area image P1 is output to any one or more of the security devices 260 that execute the security function.

  Further, as shown in the figure, the second area image P2 whose brightness has been adjusted is snapped using the second area image P2 and the drive recorder device 230 that executes the drive recorder function using the second area image P2. The snapshot device 240 that executes the shot function and the security device 260 that executes the security function using the second area image P2 are output to any one or more of the devices.

  Furthermore, as shown in the figure, the third region image P3 whose brightness has been adjusted is obtained by using the drive recorder device 230 that executes the drive recorder function using the third region image P3 and the third region image P3. The image is output to any one or more of the driver monitor device 250 that executes the driver monitor function and the security device 260 that executes the security function using the third region image P3.

  Further, when the inside / outside image P is divided into a vehicle outside region image and a vehicle interior region image and each image is output to each of the devices 210 to 260, as shown in FIG. 5, as shown in FIG. Is output to any one or more of the lane identification device 210, the obstacle detection device 220, the drive recorder device 230, the snapshot device 240, and the security device 260. The data is output to any one or more of the drive recorder device 230, the driver monitor device 250, and the security device 260.

  In the correspondence S shown in FIG. 5, one device is associated with one function. However, when the security device has both a security function and a drive recorder function, the drive recorder device in the correspondence S is Can be rewritten to a security device.

  In this way, management is performed in which each region image Pn set to the inside / outside image P of the vehicle V imaged by the single wide-angle camera 20 and adjusted in brightness is cut out from the inside / outside image P, and vehicle management is performed using this. Since it outputs to each of the devices 210 to 260, a plurality of vehicle management can be executed in parallel by a single inside / outside image P. Further, when executing the management function, the management devices 210 to 260 need to perform predetermined image processing only for the set area images P1 to P3, so that the processing load can be reduced.

  In addition, the correspondence S in the present embodiment is defined separately for the case where the vehicle V is parked and the case where the vehicle V is traveling as shown in FIG.

  The control device 10 of the image processing apparatus 100 according to the present embodiment receives the signal indicating that the vehicle V such as the D, R, and N ranges is traveling from the positioning switch 500 and the P range from the positioning switch 500. Each region image P whose brightness has been adjusted is sent to each of the management devices 210 to 260 in response to a signal indicating that the vehicle V is parked.

  The control device 10 can acquire a signal of the positioning switch 500 indicating whether or not the vehicle V is traveling through the vehicle controller 300.

  Specifically, when the control device 10 acquires information indicating that the vehicle V is parked from the vehicle V, the controller 10 refers to the correspondence S and drives the first region image P1 whose brightness is adjusted. The second region image P2 that is output to any one of the recorder device 230 and the security device 260 and adjusted in brightness is sent to any one or more devices of the drive recorder device 230 and the security device 260. The third region image P <b> 3 whose brightness is adjusted is output to the security device 260.

  On the other hand, when the control device 10 acquires information indicating that the vehicle V is traveling from the vehicle V, the lane recognition device refers to the correspondence S and uses the first region image P1 whose brightness is adjusted as the lane recognition device. 210, the obstacle detection device 220, the drive recorder device 230, and the snapshot device 240, and outputs the second region image P <b> 2 whose brightness has been adjusted to the drive recorder device 230 and One or more devices of the drive recorder device 230 and the driver monitor device 250 output the third region image P3 adjusted in brightness to one or more devices of the snapshot device 240. Output to.

  In this way, by sending out the area image P3 whose brightness is adjusted to the predetermined management devices 210 to 260 according to whether the vehicle V is traveling or parked, in a necessary scene, the vehicle V Images necessary for execution of each management function can be adjusted to an appropriate brightness and output to the devices 210 to 260 that execute the management functions.

  Further, when the inside / outside image P is divided into a vehicle outside region image and a vehicle interior region image and each image is output to the devices 210 to 260, as shown in FIG. When the information to the effect is acquired, the correspondence relationship S is referred to, the set outside vehicle area image is output to any one of the drive recorder device 230 and the security device 260, and the set vehicle interior region image P3 is output. Is output to the security device 260. On the other hand, when information indicating that the vehicle V is traveling is acquired from the vehicle V, the vehicle outside area image is one of the lane identification device 210, the obstacle detection device 220, the drive recorder device 230, and the snapshot device 240. The vehicle interior region image output and set to one or more devices is output to any one or more of the drive recorder device 230 and the driver monitor device 250. Even if it does in this way, the effect similar to the above-mentioned process can be acquired.

  Next, the control procedure of the image processing apparatus 100 according to the present embodiment will be specifically described with reference to FIG.

  First, in step 10, the control device 10 starts imaging processing of the camera 20 in response to acquisition of an activation signal that is a trigger for starting image processing. The activation signal appropriately defines an ignition on signal acquired from the ignition switch 400, an on signal acquired from the switch 21 of the image processing apparatus 100, an on signal acquired from any one or more of the management apparatuses 210 to 260, and the like. can do.

  The wide-angle camera 20 images a predetermined inner / outer region E (see FIG. 2) at a predetermined cycle and sends it to the control device 10. The inside / outside image P obtained by capturing the inside / outside region E includes a first region image P1 corresponding to the front region, a second region image P2 corresponding to the side region, and a third region image P3 corresponding to the vehicle interior region.

  In step 20, the control device 10 extracts the boundary between the first region image P 1, the second region image P 2, and the third region image P 3 from the inside / outside image P of the vehicle V captured by the wide-angle camera 20. Edges are detected based on the brightness of P pixels. The edge detection process is performed for each of the inside and outside images P captured at a predetermined cycle. As shown in FIG. 3, the edge detected in the present embodiment includes a first edge Q1 serving as a boundary between the dashboard and the front window, a second edge Q2 serving as a boundary between the dashboard and the seat space, and a side door. And a third edge Q3, a fourth edge Q4, and a fifth edge Q5 that are the boundary between the window and the side door window.

  After the edge detection, the process proceeds to step 50. In step 50, based on each detected edge, the control device 10 performs the first region image P1 corresponding to the front region, the second region image P2 corresponding to the side region, and the third region corresponding to the vehicle interior region. The boundary of the image P3 is extracted. Then, the control device 10 sets the first region image P1, the second region image P2, and the third region image P3 that are delimited by the boundaries extracted in step 20. Further, the control device 10 extracts the boundary between the vehicle exterior region image including the first region image P1 and the second region image P2 and the vehicle interior region image including the third region image P3, and the vehicle exterior region divided by each boundary. Set the image and the vehicle interior area image. In addition, with the setting of each area image P1 to P3, the identifier, address, position (coordinate), etc. of the pixel corresponding to each area image P1 to P3 can be specified.

  In addition, when the image of an object such as a rearview mirror attached to the vehicle V is included in the inside / outside image P of the vehicle V, the control device 10 sets an outer edge of a region corresponding to the image of the object in advance. The boundaries of the region images P1 to P3 can be extracted using the set outer edge.

  Moreover, the control apparatus 10 of this embodiment can perform the process of step 30 after an edge detection process. Specifically, the control device 10 can return to step 20 and perform edge detection processing again after a predetermined time has elapsed or after the vehicle V has traveled a predetermined distance.

  When the camera 20 is attached to a movable member such as a rearview mirror, when the position of the rearview mirror moves, the imaging range (internal / external area) of the camera 20 is changed, so the acquired inside / outside image P also changes. The region images P1 to P3 cannot be set accurately. On the other hand, by performing this processing, the boundaries of the area images P1 to P3 can be extracted at a predetermined cycle. Therefore, even if the imaging range (inside / outside area) of the camera 20 is changed, the area images P1 to P1 are changed. P3 can be set accurately.

  The starting point for determining whether or not the vehicle V has traveled a predetermined distance (travel start timing) may be the timing at which an ON signal is acquired from the ignition switch 400, that is, at the start of travel. The timing at which the boundary detection process is started may be used.

  Furthermore, the control apparatus 10 of this embodiment can perform the processing of steps 30 and 40 after the edge detection processing. Specifically, the control device 10 proceeds to step 40 after a predetermined time has elapsed or after the vehicle V has traveled a predetermined distance (Yes in step 30), and in step 40, the edge detected from the inside / outside image P captured in the previous process. Is compared with the position of the edge detected from the inside / outside image P imaged in the current process, and it is determined whether or not the position of both edges has changed by a predetermined value or more (Step 40). If there is a change, the process returns to step 20, and the boundaries of the region images P <b> 1 to P <b> 3 can be re-extracted based on the inside / outside image P captured in the current process.

  When the vehicle V travels and the position of the vehicle V changes, the way the sunlight and streetlights hit changes, but depending on how the sunlight and streetlights hit, the light is reflected on the instrument panel and edge detection ( In some cases, the extraction of the boundary of each region image cannot be accurately performed. On the other hand, in this embodiment, by extracting the boundary of each area image P1-P3 based on the inside / outside image P imaged at different timings until the vehicle V travels a predetermined distance, at a certain position Even if sunlight or streetlight light is reflected on the dashboard, the area images P1 to P3 can be accurately set by eliminating the influence of such sunlight and streetlight light.

  On the other hand, if it is determined in step 40 that there is no change (shift) greater than or equal to a predetermined value at the edge of each inside / outside image P, the image processing based on the boundary extraction result in the previous processing may be followed, and the processing ends. To do.

  The boundaries of the region images P1 to P3 can be extracted from the edges detected through the processing of Step 30, Steps 30 and 40, and the setting processing of the region images P1 to P3 in Step 50 described above can be executed.

  In Step 60 following Step 50 described above, the control device 10 acquires the brightness of the inner and outer regions or the brightness information of each region from the image sensor and / or the illuminance sensor 30 of the camera 20.

  In step 70, the control device 10 acquires shift position information from the positioning switch 500. The control device 10 determines whether the vehicle V is traveling or parked based on the shift position information. Specifically, the control device 10 determines that the vehicle V is traveling when acquiring the shift position signals of the D range, the R range, and the N range. On the other hand, the control apparatus 10 determines that the vehicle V is parked when the shift position signal of the P range is acquired.

  In the next step 80, the control device 10, based on the acquired information on the brightness of the inside / outside area or each area, the brightness of the inside / outside area or each area and the exposure time of the camera 20 in advance are associated with each other. ”Or“ image adjustment data ”in which the brightness of the inner and outer regions or each region and the appropriate brightness of each region image Pn are associated in advance, and the first region image P1 and the second region set in step S50 The brightness of each area image Pn including the image P2 and the third area image P3 is adjusted. Note that the brightness of each region image Pn can be adjusted by exposure control or ISO control of the camera 20 as described above, and can also be performed by image processing of the control device 10.

  As shown in FIG. 6, the process of step 80 can be executed without obtaining the shift position information after the process of step 60. However, in this embodiment, the vehicle V is traveling or parked. Depending on whether or not the information indicating that the vehicle V is parked is increased by increasing the amount of adjustment for improving the brightness of each area image Pn captured after acquiring the information that the vehicle V is parked. The adjustment amount that improves the brightness of each area image Pn that is captured after acquisition is reduced.

  When shifting from step 60 to step 80, the above-described exposure data or image adjustment data referred to in the image adjustment process is defined separately for the case where the vehicle V is parked and the case where the vehicle V is traveling. Can be kept. In this case, when the vehicle V is parked, the appropriate brightness of each area image Pn with respect to the brightness of the area can be set higher than the brightness when the state of the vehicle V is not considered. In addition, when the vehicle V is traveling, the appropriate brightness of each area image Pn with respect to the brightness of the area can be set lower than the brightness when the state of the vehicle V is not taken into consideration.

  In the next step 90, the control device 10 performs a management function for executing a management function of the vehicle V in which the first region image P1, the second region image P2, the third region image P3, and the region images P1 to P3 are used. Reference is made to a correspondence S (for example, FIG. 5) in which the devices 210 to 260 are associated in advance. This correspondence S can be defined separately when the vehicle V is parked and when the vehicle V is traveling.

  Then, in step 100, the control device 10 determines whether the vehicle V is running or parked, according to the correspondence S, set in step 50, and adjusted in brightness in step 80. The lane recognition device 210, the obstacle detection device 220, the drive recorder device 230, and the snapshot device that cut out the first region image P1, the second region image P2, and the third region image P3 from the inner and outer images P and execute various management functions. 240, the driver monitor device 250, the security device 260, and other management devices 210 to 260, respectively.

  In this case, when the control device 10 acquires information indicating that the vehicle V is parked from the vehicle V, the control device 10 displays the first region image P1 as the drive recorder device 230 that executes the drive recorder function and / or The second area image P2 is output to the security apparatus 260 that executes the security function, and the second area image P2 is output to the drive recorder apparatus 230 that executes the drive recorder function and / or the security apparatus 260 that executes the security function, and the third area image P3 is output. To the security device 260 that executes the security function. Thereby, the area | region image Pn can be output only to the management apparatus by which a function is implement | achieved during parking.

  In addition, when acquiring information indicating that the vehicle V is traveling from the vehicle V in step 70, the control device 10 executes the lane recognition function on the first region image P1 whose brightness has been adjusted. Output to any one or more of the lane recognition device 210, the obstacle detection device 220 that executes the obstacle detection function, the drive recorder device 230 that executes the drive recorder function, and the snapshot device 240 that executes the snapshot function Then, the second area image P2 is output to the drive recorder apparatus 230 that executes the drive recorder function and / or the snapshot apparatus 240 that executes the snapshot function, and the third area image P3 is output to the drive that executes the drive recorder function. Driver for executing recorder device 230 and / or driver monitor function And outputs it to the Nita device 250. As a result, the region image Pn can be output only to a management device that realizes the function during traveling.

  In addition, the control apparatus 10 can output each area | region image to each management apparatus 210-260 based on the correspondence S, without determining whether the vehicle V is driving | running | working or is parked. In this case, the control device 10 converts the first region image P1 into the lane identification device 210 that executes the lane recognition function, the obstacle detection device 220 that executes the obstacle detection function, and the drive recorder device 230 that executes the drive recorder function. The data can be output to any one or more of the snapshot device 240 that executes the snapshot function and the security device 260 that executes the security function. In addition, the control device 10 outputs the second region image P2 to any one of the drive recorder device 230 that executes the drive recorder function, the snapshot device 240 that executes the snapshot function, and the security device 260 that executes the security function. Can output more than one. Furthermore, the control device 10 selects the third region image P3 from any one of the drive recorder device 230 that executes the drive recorder function, the driver monitor device 250 that executes the driver monitor function, and the security device 260 that executes the security function. Can output more than one.

  This process will be described using an example in which three area images are set in the inside / outside image P. However, when the inside / outside image P is divided into a vehicle outside area image and a vehicle interior area image, the brightness increases according to the correspondence S shown in FIG. Each adjusted area image is output to each device 210-260.

  Finally, in step 110, the control devices of the management devices 210 to 260 execute the management functions by using the region images P1 to P3 acquired in accordance with commands from the control device 10. The contents of each management function and the execution method of each management function are not particularly limited, and the contents and techniques known at the time of filing can be used. In this embodiment, the lane recognition device 210, the obstacle detection device 220, the drive recorder device 230, the snapshot device 240, the driver monitor device 250, and the security device 260 are illustrated as examples of the management devices 210 to 260. The management device is not particularly limited as long as it is a management device that executes a predetermined function using an image captured by a camera.

  In this embodiment, the case where the image processing apparatus 100 is installed in the vehicle V has been described as an example. However, the image processing method according to this embodiment of the present invention is a client that can control the management apparatuses 210 to 260. It can also be executed in a server (computer / control device) capable of exchanging information with (computer / control device). The server can be located remotely from the client.

  A server capable of exchanging information with the management devices 210 to 260 can execute the image processing method by sending the following command to the vehicle-side client. The content of the command is the vehicle V including images of the vehicle outside region of the vehicle V and the vehicle interior region (front region, side region, vehicle interior region) of the vehicle V using one wide-angle camera 20 installed in the vehicle V. Based on the inside / outside image P, a vehicle exterior region image corresponding to the vehicle exterior region and a vehicle interior region image corresponding to the vehicle interior region (or the first region image P1, the second region). The processing (step) for setting the image P2 and the third region image P3), the inside / outside region or outside region image of the vehicle V and the inside region image (or the first region image P1, the second region image P2, and the third region image). In accordance with the brightness of each region including the region image P3), the set inside / outside region or vehicle outside region image and vehicle interior region image (or the first region image P1, the second region image P2, and the third region) of the vehicle V are set. Each region image including the image P3) A process (step) for adjusting the brightness of each, a vehicle exterior region image and a vehicle interior region image (or first region image P1, second region image P2, and third region image P3, and region images P1 to P3) ) Is used with reference to the correspondence relationship S previously associated with the management devices 210 to 260 that execute the management function of the vehicle V, and the set vehicle exterior region image and vehicle interior region image (first region image P1, A process (step) of outputting the second region image P2 and the third region image P3) to each of the management devices 210 to 260 that execute the management function. Since the specific contents of the process are common to the image processing apparatus 100 and the vehicle management system 1000 on the vehicle side of the present embodiment, these descriptions are used.

  Since this invention is comprised as mentioned above and acts as mentioned above, there exist the following effects.

  According to the image processing apparatus 100 or the vehicle management system 1000 including the image processing apparatus 100 according to the present invention, the vehicle V region and the vehicle V region (or the vehicle V front region, the vehicle V side region). And the vehicle interior area of the vehicle V) with a single wide-angle camera 20, and each area image set in the captured inside and outside image of the vehicle V is cut out, and the brightness of each of these area images is set to the inside or outside area or each Since the adjustment is based on the brightness of the area, even if the brightness varies depending on the imaging area, the image is prevented from being partially obscured and a plurality of functions related to the management of the vehicle V are accurately realized in parallel. can do. Moreover, since only one wide-angle camera 20 needs to be installed as the imaging means, the cost required for managing the vehicle V can be reduced.

  Further, when executing the management function, the management devices 210 to 260 need to perform predetermined image processing only for the set area images P1 to P3, so that the processing load can be reduced.

  Also by the image processing method of the embodiment according to the present invention, the same effect can be obtained and the same effect can be obtained.

  According to the image processing apparatus 100 or the vehicle management system 1000 including the same according to the embodiment of the present invention, the brightness of each region image Pn is improved depending on whether the vehicle V is traveling or parked. Since the amount of adjustment to be changed is changed, there is a tendency that the amount of light of each area image Pn becomes insufficient when taking an image during parking, but even in such a case, an area image Pn with appropriate brightness is obtained. be able to. As a result, the management function of the vehicle V can be executed accurately.

  According to the image processing apparatus 100 or the vehicle management system 1000 including the same according to the embodiment of the present invention, the brightness of each region image Pn is improved depending on whether the vehicle V is traveling or parked. Since the amount of adjustment to be performed is changed, the amount of light in the corner area image Pn tends to be excessive when taking an image during traveling. Even in such a case, an area image Pn with appropriate brightness can be obtained. Can do. As a result, the management function of the vehicle V can be executed accurately.

  Since the image processing apparatus 100 according to the embodiment of the present invention or the vehicle management system 1000 including the image processing apparatus 100 includes one or a plurality of illuminance sensors 30 that detect the brightness of each region, the image sensor of the camera 20 is not used. Since the brightness of each area can be accurately detected, the brightness of each area image can be controlled with high accuracy. Furthermore, by using both the brightness detected by the image sensor of the camera 20 and the brightness detected by the illuminance sensor 30, it is possible to detect the brightness of each region more accurately.

  According to the image processing apparatus 100 or the vehicle management system 1000 including the same according to the embodiment of the present invention, the vehicle exterior region image and the vehicle interior region image (or the first region image to the third region are images) are defined in advance. Since it outputs to an apparatus, each area image which image | photographed each area required in the implementation | achievement of a management function can be output appropriately to the apparatuses 210-260 which implement | achieve the management function. As a result, a plurality of management functions can be realized by one inside / outside image P captured by the wide-angle camera 20. In addition, since only each region image necessary for executing the management function is output to each management device 210-260, the load of image processing on each management device 210-260 executing the management function is reduced. Can do.

  When the image processing apparatus 100 according to the embodiment of the present invention or the vehicle management system 1000 including the image processing apparatus 100 acquires information indicating that the vehicle V is parked from the vehicle V, the vehicle exterior region image and the vehicle interior region Since the image (or the first region image to the third region is an image) is output to a predetermined device, each of the region images P1 to P3 is realized by the devices 210 to 260 that realize each management function according to the state of the vehicle V. Can be output properly.

  That is, each area image P1 obtained by imaging each area required for realizing the management function in the state of each vehicle V according to the state of the vehicle V such that the vehicle V is traveling or the vehicle V is parked. ˜P3 can be adjusted to an appropriate brightness, and can be appropriately output to the devices 210 to 260 that realize the management function. As a result, a plurality of management functions corresponding to the state of the vehicle V can be realized by one internal / external image P captured by the wide-angle camera 20.

  The image processing apparatus 100 according to the embodiment of the present invention or the vehicle management system 1000 including the same extracts the boundaries between the region images P1 to P3 at a predetermined cycle and sets the region images P1 to P3. Even when the extension of the inner / outer region E changes due to a change in the position of the image 20 and the target range of the inner / outer image P changes, the exact boundary of each region image Pn can be obtained by obtaining the exact boundary. Each region image Pn can be accurately set based on this. For example, when the camera 20 is attached to a member whose position is variable such as a rearview mirror, the outer extension of the inner and outer regions to be imaged changes. In this embodiment, each region image Pn is changed at a predetermined cycle. Since the boundary is extracted, an accurate boundary of each region image Pn can be obtained from the changed inside / outside image P, and each region image Pn can be accurately set based on this accurate boundary.

  The image processing apparatus 100 according to the embodiment of the present invention or the vehicle management system 1000 including the image processing apparatus 100 includes each region image P1 based on the inside / outside images P captured at different timings until the vehicle V travels a predetermined distance. Since the boundary of .about.P3 is extracted, it is possible to accurately extract the boundary of each region image Pn by eliminating the influence of the environment of the travel location. Depending on the environment of the travel point, sunlight or streetlight may be temporarily reflected on the dashboard, and the edge Q may not be detected accurately. However, according to the present embodiment, the vehicle travels a predetermined distance. Since the boundary of each area image Pn is extracted using a plurality of inside and outside images P captured during the period, the influence of temporary reflection due to the environment of the traveling point is eliminated, and the boundary of each area image Pn is determined. It can be extracted accurately. As a result, each area image Pn can be set accurately.

  In the image processing apparatus 100 according to the embodiment of the present invention or the vehicle management system 1000 including the image processing apparatus 100, an object image such as a rearview mirror attached to the vehicle V is included in the inside / outside image P of the vehicle V. Since the outer edge of the area corresponding to the image is preset and the boundaries of the area images P1 to P3 are extracted using the set outer edge, it is affected by the object provided in the inner and outer areas imaged by the camera 20 The region images P1 to P4 can be accurately set.

  The embodiment described above is described for facilitating the understanding of the present invention, and is not described for limiting the present invention. Therefore, each element disclosed in the above embodiment is intended to include all design changes and equivalents belonging to the technical scope of the present invention.

  That is, in this specification, the image processing apparatus 100 and the vehicle management system 1000 including the image processing apparatus 100 will be described as an example of the image processing apparatus according to the present invention. However, the present invention is limited to this. It is not a thing.

  In this specification, the image processing apparatus 100 including the control device 10 including the CPU 11, the ROM 12, and the RAM 13 will be described as an example of one aspect of the image processing apparatus according to the present invention, but the present invention is not limited to this.

  Further, in this specification, as an aspect of an image processing apparatus having a wide-angle camera, an area setting unit, an image adjustment unit, and an output control unit according to the present invention, a camera 20, an area setting function, and an image adjustment function The image processing apparatus 100 including the control device 10 that executes the output control function and the illuminance sensor 30 will be described as an example, but the present invention is not limited to this.

  In this specification, a lane recognition device 210, an obstacle detection device 220, a drive recorder device 230, a snapshot device 240, a driver monitor device 250, and a security device 260 are used as examples of devices that execute the management function according to the present invention. Although the management apparatus 210-260 including at least is illustrated, this invention is not limited to this.

1000 ... Vehicle management system 100 ... Image processing device 10 ... Control device 11 ... CPU
12 ... ROM
13 ... RAM
DESCRIPTION OF SYMBOLS 20 ... Wide-angle camera 200 ... In-vehicle apparatus 210-260 ... Management apparatus 220 ... Lane recognition apparatus 230 ... Obstacle detection apparatus 240 ... Snapshot apparatus 250 ... Driver monitor apparatus 260 ... Security apparatus 270 ... Output apparatus 271 ... Display 272 ... Speaker 273 ... Communication device 300 ... Vehicle controller 400 ... Ignition switch 500 ... Positioning switch 600 ... Drive system 800 ... portable terminal V ... vehicle E ... imaging area M ... occupant P ... inside / outside images P1, Pn ... first area image (front area of vehicle) Image corresponding to
P2, Pn ... second area image (image corresponding to the side area of the vehicle)
P3, Pn: Third region image (image corresponding to the vehicle interior region)
Q ... Edge (boundary)
Q1 ... first edge, Q2 ... second edge, Q3 ... third edge, Q4 ... fourth edge, Q5 ... fifth edge R1 ... first side, R2 ... second side, R3 ... third side, R4 ... first 4 sides B1 ... 1st outer edge, B2 ... 2nd outer edge, B3 ... 3rd outer edge, B4 ... 4th outer edge S ... Correspondence

Claims (12)

One wide-angle camera installed in the vehicle and capable of imaging the vehicle interior and exterior regions including the vehicle exterior region and the vehicle interior region;
From the inside and outside images of the vehicle imaged by the wide-angle camera, the boundary of each region image including the vehicle outside region image corresponding to the vehicle outside region and the vehicle interior region image corresponding to the vehicle interior region is extracted and extracted. Area setting means for setting each area image including the vehicle outside area image and the vehicle interior area image included in the vehicle inside / outside image based on a boundary;
Brightness acquisition means for acquiring information on the brightness of each region including the inner and outer regions, or the vehicle outer region and the vehicle interior region,
Based on the brightness information acquired by the brightness acquisition unit, the brightness of each region image including the vehicle exterior region image and the vehicle interior region image set by the region setting unit is adjusted. Image adjustment means;
Reference is made to a correspondence relationship in which each region image including the vehicle exterior region image and the vehicle interior region image and the management function of the vehicle in which each region image is used, and brightness is adjusted by the image adjustment unit. An image processing apparatus comprising: output control means for outputting each of the area images adjusted to the above to each apparatus that executes the management function based on each of the area images.   The image adjusting means acquires information on whether the vehicle is running or parked from the vehicle, and acquires information indicating that the vehicle is parked. The image processing apparatus according to claim 1, wherein an adjustment amount for improving brightness of the region image is increased.   The image adjustment means obtains information on whether the vehicle is running or parked from the vehicle, and obtains information indicating that the vehicle is running. The image processing apparatus according to claim 1, wherein an adjustment amount for improving brightness is reduced. One or a plurality of illuminance sensors that are installed in the vehicle and detect the brightness of each region including the vehicle exterior region and the vehicle interior region of the vehicle,
The image processing apparatus according to claim 1, wherein the brightness acquisition unit acquires information on brightness of each region detected by the illuminance sensor. The output control means refers to the correspondence relationship,
A device for executing a lane recognition function, a device for executing an obstacle detection function, a device for executing a drive recorder function, a device for executing a snapshot function, and a security function for the outside region image set by the region setting means Output to any one or more of the executing devices,
The vehicle interior region image set by the region setting means is output to any one or more of a device that executes a drive recorder function, a device that executes a driver monitor function, and a device that executes a security function. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The correspondence is defined separately when the vehicle is parked and when the vehicle is running,
When the output control means acquires information indicating that the vehicle is parked from the vehicle, the output control means refers to the correspondence relationship, and uses the vehicle outside area image set by the area setting means as a drive recorder function. Output to any one or more of the apparatus that executes the security function and the apparatus that executes the security function, and outputs the vehicle interior area image set by the area setting means to the apparatus that executes the security function,
When the output control means acquires information indicating that the vehicle is running from the vehicle, the output control means refers to the correspondence relationship, and uses the vehicle area image set by the area setting means as a lane recognition function. Is output to any one or more of a device that executes the obstacle detection function, a device that executes the drive recorder function, and a device that executes the snapshot function, and is set by the area setting unit 5. The vehicle interior region image thus output is output to any one or more of a device that executes a drive recorder function and a device that executes a driver monitor function. The image processing apparatus according to one item. The vehicle outside area includes a front area of the vehicle, a side area of the vehicle,
The region setting means corresponds to a first region image corresponding to the front region, a second region image corresponding to the side region, and the vehicle interior region from inside and outside images of the vehicle captured by the wide-angle camera. A boundary of each region image including the third region image is extracted, and the first region image, the second region image, and the third region image included in the inside / outside image of the vehicle based on the extracted boundary are included. Set each area image individually
The output control means refers to the correspondence relationship,
A device for executing a lane recognition function, a device for executing an obstacle detection function, a device for executing a drive recorder function, and a device for executing a snapshot function for the first area image whose brightness has been adjusted by the image adjusting means And output to one or more of the devices that execute the security function,
One or more devices selected from a device that executes a drive recorder function, a device that executes a snapshot function, and a device that executes a security function for the second area image whose brightness has been adjusted by the image adjusting means Output to
One or more of a device that executes a drive recorder function, a device that executes a driver monitor function, and a device that executes a security function for the third region image whose brightness has been adjusted by the image adjusting means The image processing apparatus according to claim 1, wherein the image processing apparatus outputs an image to the image processing apparatus. The vehicle outside area includes a front area of the vehicle, a side area of the vehicle,
The region setting means corresponds to a first region image corresponding to the front region, a second region image corresponding to the side region, and the vehicle interior region from inside and outside images of the vehicle captured by the wide-angle camera. A boundary of each region image including the third region image is extracted, and the first region image, the second region image, and the third region image included in the inside / outside image of the vehicle based on the extracted boundary are included. Set each area image individually
The correspondence is defined separately when the vehicle is parked and when the vehicle is running,
When the output control unit acquires information indicating that the vehicle is parked from the vehicle, the output control unit refers to the correspondence relationship and reads the first region image whose brightness is adjusted by the image adjustment unit. The second area image whose brightness is adjusted by the image adjusting means is output to any one or more of the apparatus that executes the drive recorder function and the apparatus that executes the security function, and the drive recorder function Output to any one or more of the apparatus that executes the security function and the apparatus that executes the security function, and the third area image whose brightness is adjusted by the image adjusting means is used as the apparatus that executes the security function Output,
When the output control means acquires information indicating that the vehicle is running from the vehicle, the output control means refers to the correspondence relationship and reads the first area image whose brightness is adjusted by the image adjustment means. Output to any one or more of a device that executes a lane recognition function, a device that executes an obstacle detection function, a device that executes a drive recorder function, and a device that executes a snapshot function, The second area image whose brightness has been adjusted by the adjusting means is output to one or more of a device that executes a drive recorder function and a device that executes a snapshot function, and the image adjusting means The third area image whose brightness has been adjusted is selected from one of a device that executes a drive recorder function and a device that executes a driver monitor function. The image processing apparatus according to any one of claims 1 to 4 and outputs to the device.   The region setting means extracts a boundary of each region image from the inside and outside images of the vehicle imaged at a predetermined cycle, and sets each region image included in each inside and outside image based on the boundary. The image processing apparatus according to claim 1, wherein:   The region setting means extracts a boundary between the region images from the inner and outer images captured at different timings until the vehicle travels a predetermined distance, and is included in the inner and outer images based on the boundary. The image processing apparatus according to claim 1, wherein each of the region images is set.   When the image of the object attached to the vehicle is included in the inside / outside image of the vehicle, the area setting means presets an outer edge of the area corresponding to the image of the object, and uses the set outer edge. The image processing apparatus according to claim 1, wherein a boundary of the region image is extracted. One wide-angle camera installed in the vehicle and capable of imaging the vehicle interior and exterior regions including the vehicle exterior region and the vehicle interior region;
An image processing method used in an image processing apparatus comprising: a region setting unit; a brightness acquisition unit; an image adjustment unit; and a control device having an output control unit.
The region setting means extracts a boundary between each region image including a vehicle exterior region image corresponding to the vehicle exterior region and a vehicle interior region image corresponding to the vehicle interior region from the vehicle interior and exterior images captured by the wide-angle camera. And executing the step of setting each region image including the vehicle exterior region image and the vehicle interior region image included in the vehicle interior and exterior images based on the extracted boundary,
The brightness acquisition means executes a step of acquiring information on the brightness of each area including the inside / outside area or the outside area and the interior area of the vehicle,
Each of the region images including the vehicle exterior region image and the vehicle interior region image set by the region setting unit based on the brightness information acquired by the brightness acquisition unit. Perform steps to adjust the brightness of
The output control means refers to a correspondence relationship in which each region image including the vehicle exterior region image and the vehicle interior region image is associated in advance with the management function of the vehicle in which each region image is used, An image processing method for executing a step of outputting each area image whose brightness has been adjusted by an image adjusting unit to each apparatus that executes the management function based on each area image.

Images